2024-05-09T00:38:55.321 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T00:38:55.321 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} --archive /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915 --owner scheduled_pdonnell@teuthology --name pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/orig.config.yaml 2024-05-09T00:38:55.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T00:38:55.503 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915 branch: wip-pdonnell-testing-20240508.183908-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698915' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240508.183908-debug ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.183908-debug sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1722 sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.183908-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHMM0oyeg/rts1LYE3O86d++khfdns45zmSFMB8s0FTBvexX5r8fsqp1twQmthj9KSJtyF6lRD7xnxT5yCC4ag= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHikpoGZS4zdZdP8mpfo66YVeEAmxx8tcj6dmin9/USFUIQhwAKbTh/IZ3XN39VqzLUL9mhXtg5gshMmKLgeFHw= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxEOyrD/fnG/6UdipwLu/+15N8lCOa4kfef30wFLdbS7D03dfK+rQXaRnqRKCU3MqvXmictC89CWrMpKsmrscM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_22:06:20 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T00:38:55.503 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa; will attempt to use it 2024-05-09T00:38:55.504 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks 2024-05-09T00:38:55.504 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T00:38:55.506 INFO:teuthology.task.internal:Checking packages... 2024-05-09T00:38:55.534 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c9da4049f638c0f84bdd9b4e33c42e86046ac554' 2024-05-09T00:38:55.534 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T00:38:55.534 INFO:teuthology.packaging:ref: None 2024-05-09T00:38:55.534 INFO:teuthology.packaging:tag: None 2024-05-09T00:38:55.534 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.183908-debug 2024-05-09T00:38:55.535 INFO:teuthology.packaging:sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:38:55.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240508.183908-debug 2024-05-09T00:38:55.750 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3594.gc9da4049 2024-05-09T00:38:55.752 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T00:38:55.759 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T00:38:55.759 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T00:38:55.793 INFO:teuthology.task.internal:Saving configuration 2024-05-09T00:38:55.820 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T00:38:55.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T00:38:55.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 00:33:28.388700', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHMM0oyeg/rts1LYE3O86d++khfdns45zmSFMB8s0FTBvexX5r8fsqp1twQmthj9KSJtyF6lRD7xnxT5yCC4ag='} 2024-05-09T00:38:55.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 00:33:28.391871', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHikpoGZS4zdZdP8mpfo66YVeEAmxx8tcj6dmin9/USFUIQhwAKbTh/IZ3XN39VqzLUL9mhXtg5gshMmKLgeFHw='} 2024-05-09T00:38:55.896 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 00:33:28.390395', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxEOyrD/fnG/6UdipwLu/+15N8lCOa4kfef30wFLdbS7D03dfK+rQXaRnqRKCU3MqvXmictC89CWrMpKsmrscM='} 2024-05-09T00:38:55.896 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T00:38:55.902 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-09T00:38:55.903 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-09T00:38:55.903 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-09T00:38:55.903 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T00:38:56.011 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2dc8a000d0>, signals=[15]) 2024-05-09T00:38:56.011 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T00:38:56.017 INFO:teuthology.task.internal:Opening connections... 2024-05-09T00:38:56.017 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T00:38:56.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:38:56.096 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-05-09T00:38:56.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:38:56.170 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-05-09T00:38:56.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:38:56.248 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T00:38:56.255 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-05-09T00:38:56.274 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-05-09T00:38:56.274 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T00:38:56.332 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-05-09T00:38:56.333 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-05-09T00:38:56.333 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T00:38:56.333 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-05-09T00:38:56.333 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T00:38:56.333 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T00:38:56.333 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T00:38:56.333 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-05-09T00:38:56.356 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-05-09T00:38:56.378 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-05-09T00:38:56.378 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-05-09T00:38:56.434 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T00:38:56.435 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T00:38:56.436 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T00:38:56.436 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-05-09T00:38:56.456 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-05-09T00:38:56.474 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-05-09T00:38:56.474 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-05-09T00:38:56.531 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T00:38:56.532 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T00:38:56.533 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-05-09T00:38:56.548 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T00:38:56.558 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T00:38:56.577 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T00:38:56.577 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-05-09T00:38:56.581 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-05-09T00:38:56.583 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-05-09T00:38:56.599 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T00:38:56.605 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T00:38:56.605 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-05-09T00:38:56.637 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-05-09T00:38:56.640 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-05-09T00:38:56.662 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T00:38:56.735 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T00:38:56.749 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-09T00:38:56.749 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-09T00:38:56.750 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-09T00:38:56.750 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T00:38:56.767 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:38:56.768 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-05-09T00:38:56.826 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-437.el9.x86_64 2024-05-09T00:38:56.826 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-437.el9.x86_64 2024-05-09T00:38:56.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-05-09T00:38:58.994 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-09T00:39:01.020 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-05-09T00:39:05.163 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-09T00:39:06.622 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 16 kB 00:00 2024-05-09T00:39:08.809 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-09T00:39:14.099 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-09T00:39:16.163 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T00:39:16.163 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T00:39:16.246 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T00:39:16.257 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 78 M 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 123 M 2024-05-09T00:39:16.258 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-05-09T00:39:17.225 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 704 kB/s | 484 kB 00:00 2024-05-09T00:39:29.749 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 1.2 MB/s | 15 MB 00:13 2024-05-09T00:39:46.690 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 972 kB/s | 28 MB 00:29 2024-05-09T00:39:55.539 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 891 kB/s | 34 MB 00:39 2024-05-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-05-09T00:39:55.540 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.0 MB/s | 78 MB 00:39 2024-05-09T00:39:56.244 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-05-09T00:39:56.639 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-05-09T00:39:56.640 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-05-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-05-09T00:39:57.604 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-05-09T00:40:00.153 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-05-09T00:40:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T00:40:00.881 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T00:40:03.689 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T00:40:03.818 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T00:40:08.892 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T00:40:08.938 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T00:40:14.032 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T00:40:45.197 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T00:40:45.236 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T00:40:45.565 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T00:40:45.565 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T00:40:45.566 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T00:40:45.566 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:40:46.358 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-05-09T00:40:46.707 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T00:40:46.781 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T00:40:46.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T00:40:46.782 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T00:40:46.782 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T00:40:46.782 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T00:40:46.782 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-09T00:40:46.782 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T00:40:46.782 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T00:40:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T00:40:46.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T00:40:46.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-05-09T00:40:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 68.el9 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8264254 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T00:40:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-05-09T00:40:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-05-09T00:40:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T00:40:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-05-09T00:40:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-05-09T00:40:46.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:40:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T00:40:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T00:40:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T00:40:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-05-09T00:40:46.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:40:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T00:40:46.874 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T00:40:46.874 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-444.el9.x86_64 2024-05-09T00:40:46.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T00:40:47.513 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-05-09T00:40:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T00:40:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-05-09T00:40:48.949 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-05-09T00:40:48.965 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.AZc62Ikdk2 2024-05-09T00:40:48.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AZc62Ikdk2 2024-05-09T00:40:49.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.AZc62Ikdk2 2024-05-09T00:40:49.174 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.AZc62Ikdk2 is 6KB 2024-05-09T00:40:49.227 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.AZc62Ikdk2 2024-05-09T00:40:49.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T00:40:49.304 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T00:40:49.304 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T00:40:49.305 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T00:40:49.305 INFO:teuthology.orchestra.run.smithi037.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T00:40:49.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T00:40:49.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-05-09T00:41:19.453 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-09T00:41:19.454 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-09T00:41:19.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:42:19.458 DEBUG:teuthology.orchestra.remote:timed out 2024-05-09T00:42:28.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-09T00:42:28.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:42:28.782 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-05-09T00:42:29.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-09T00:42:29.124 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-09T00:42:29.124 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-05-09T00:42:29.142 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-444.el9.x86_64 2024-05-09T00:42:29.142 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T00:42:29.142 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T00:42:29.142 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T00:42:30.143 DEBUG:teuthology.parallel:result is None 2024-05-09T00:42:30.144 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T00:42:30.151 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T00:42:30.152 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T00:42:30.154 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T00:42:30.157 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T00:42:30.175 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T00:42:30.201 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T00:42:30.236 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T00:42:30.237 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T00:42:30.239 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T00:42:30.241 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T00:42:30.333 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T00:42:30.339 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T00:42:30.339 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T00:42:30.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:42:30.356 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T00:42:30.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:42:30.372 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T00:42:30.375 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T00:42:30.398 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T00:42:30.435 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T00:42:30.441 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T00:42:30.448 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T00:42:30.457 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T00:42:30.487 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T00:42:30.491 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T00:42:30.493 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T00:42:30.501 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T00:42:30.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T00:42:30.504 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T00:42:30.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T00:42:30.555 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T00:42:30.564 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T00:42:30.565 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T00:42:30.575 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T00:42:30.578 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T00:42:30.612 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T00:42:30.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T00:42:30.726 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T00:42:30.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T00:42:30.854 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:42:30.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T00:42:30.922 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T00:42:30.961 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T00:42:31.015 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T00:42:31.092 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T00:42:31.137 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:42:31.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T00:42:31.202 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T00:42:31.248 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T00:42:31.308 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T00:42:31.350 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T00:42:31.392 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:42:31.392 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T00:42:31.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-05-09T00:42:31.461 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-05-09T00:42:31.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-05-09T00:42:31.498 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:42:31.508 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:42:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:42:32.022 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T00:42:32.030 INFO:teuthology.task.internal:Starting timer... 2024-05-09T00:42:32.030 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T00:42:32.072 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T00:42:32.112 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-09T00:42:32.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-05-09T00:42:32.196 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-05-09T00:42:32.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-05-09T00:42:32.271 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-05-09T00:42:32.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2024-05-09T00:42:32.328 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2024-05-09T00:42:32.330 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T00:42:32.331 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-05-09T00:42:32.359 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-05-09T00:42:32.359 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-05-09T00:42:32.387 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-05-09T00:42:32.387 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2024-05-09T00:42:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2024-05-09T00:42:32.410 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2024-05-09T00:42:32.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T00:42:32.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:42:32.442 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T00:42:32.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:42:32.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T00:42:32.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:42:32.497 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T00:42:32.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-05-09T00:42:32.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-05-09T00:42:32.555 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2024-05-09T00:42:32.579 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T00:42:32.589 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T00:42:32.608 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T00:42:32.609 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi136.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T00:46:48.229 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-05-09T00:46:48.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-09T00:46:48.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:46:48.308 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-05-09T00:46:48.387 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-09T00:46:48.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-09T00:46:48.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:46:48.460 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-05-09T00:46:48.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-09T00:46:48.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-09T00:46:48.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T00:46:48.655 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-05-09T00:46:48.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-09T00:46:48.738 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T00:46:48.750 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T00:46:48.750 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T00:46:48.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:46:48.753 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T00:46:48.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:46:48.755 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T00:46:48.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:46:48.783 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T00:46:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T00:46:48.797 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T00:46:48.801 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T00:46:48.806 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T00:46:48.820 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T00:46:48.821 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-05-09T00:46:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-05-09T00:46:48.831 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-05-09T00:46:48.841 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-05-09T00:46:48.843 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2024-05-09T00:46:48.844 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T00:46:48.853 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2024-05-09T00:46:48.856 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T00:46:48.857 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T00:46:48.867 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T00:46:48.871 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T00:46:48.879 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T00:46:48.914 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-05-09T00:46:48.916 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:46:48.917 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-05-09T00:46:48.917 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.917 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.917 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.917 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-05-09T00:46:48.934 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:46:48.934 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-05-09T00:46:48.934 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.935 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.935 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.935 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.935 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-05-09T00:46:48.938 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:46:48.938 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-05-09T00:46:48.938 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.938 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.938 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.938 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:46:48.939 INFO:teuthology.run_tasks:Running task install... 2024-05-09T00:46:48.948 DEBUG:teuthology.task.install:project ceph 2024-05-09T00:46:48.948 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}} 2024-05-09T00:46:48.948 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'} 2024-05-09T00:46:48.948 INFO:teuthology.task.install:Using flavor: default 2024-05-09T00:46:48.954 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T00:46:48.954 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T00:46:48.954 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T00:46:48.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:46:48.957 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T00:46:48.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:46:48.958 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T00:46:48.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:46:49.180 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T00:46:49.181 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T00:46:49.188 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T00:46:49.188 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T00:46:49.192 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T00:46:49.192 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T00:46:49.445 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T00:46:49.446 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:46:49.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T00:46:49.474 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T00:46:49.474 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T00:46:49.517 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T00:46:49.518 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:46:49.518 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T00:46:49.521 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T00:46:49.521 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:46:49.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T00:46:49.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T00:46:49.544 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T00:46:49.545 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T00:46:49.546 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T00:46:49.546 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T00:46:49.611 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T00:46:49.612 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T00:46:49.622 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T00:46:49.685 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T00:46:49.686 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T00:46:49.689 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-05-09T00:46:49.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-05-09T00:46:49.748 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2024-05-09T00:46:49.749 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-05-09T00:46:49.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2024-05-09T00:46:49.751 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-05-09T00:46:49.941 INFO:teuthology.orchestra.run.smithi037.stdout:54 files removed 2024-05-09T00:46:49.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T00:46:49.975 INFO:teuthology.orchestra.run.smithi136.stdout:54 files removed 2024-05-09T00:46:49.977 INFO:teuthology.orchestra.run.smithi151.stdout:54 files removed 2024-05-09T00:46:50.003 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T00:46:50.004 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T00:46:50.850 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 143 kB/s | 84 kB 00:00 2024-05-09T00:46:50.909 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 130 kB/s | 84 kB 00:00 2024-05-09T00:46:50.931 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 124 kB/s | 84 kB 00:00 2024-05-09T00:46:51.576 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 17 kB/s | 12 kB 00:00 2024-05-09T00:46:51.601 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-05-09T00:46:51.690 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 17 kB/s | 12 kB 00:00 2024-05-09T00:46:52.093 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-05-09T00:46:52.102 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-05-09T00:46:52.191 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-05-09T00:46:52.902 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-09T00:46:53.977 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.1 MB 00:01 2024-05-09T00:46:54.299 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.1 MB 00:02 2024-05-09T00:46:57.161 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 6.0 MB/s | 19 MB 00:03 2024-05-09T00:46:57.894 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 19 MB 00:02 2024-05-09T00:47:01.942 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 19 MB 00:06 2024-05-09T00:47:01.987 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.2 MB 00:01 2024-05-09T00:47:03.561 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.2 MB 00:02 2024-05-09T00:47:04.296 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-05-09T00:47:05.204 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-09T00:47:06.273 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-09T00:47:06.860 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-09T00:47:07.459 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-05-09T00:47:09.077 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-05-09T00:47:11.272 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-09T00:47:11.431 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-05-09T00:47:12.255 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 5.9 kB/s | 1.7 kB 00:00 2024-05-09T00:47:13.767 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:47:13.767 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:47:13.778 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T00:47:13.779 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T00:47:13.780 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T00:47:13.781 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T00:47:13.782 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T00:47:13.784 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T00:47:13.785 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T00:47:13.847 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-05-09T00:47:13.860 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T00:47:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 764 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T00:47:13.862 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 161 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 322 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 300 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T00:47:13.863 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-05-09T00:47:13.864 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T00:47:13.865 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T00:47:13.866 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T00:47:13.867 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T00:47:13.868 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T00:47:13.869 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T00:47:13.870 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T00:47:13.871 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2024-05-09T00:47:13.872 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout:Install 148 Packages 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 8 Packages 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 219 M 2024-05-09T00:47:13.873 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-05-09T00:47:14.391 INFO:teuthology.orchestra.run.smithi151.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-05-09T00:47:14.531 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:47:14.532 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:47:14.543 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T00:47:14.543 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T00:47:14.544 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T00:47:14.545 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T00:47:14.547 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T00:47:14.549 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T00:47:14.550 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T00:47:14.610 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-05-09T00:47:14.626 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T00:47:14.627 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 764 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T00:47:14.628 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 161 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 322 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 300 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T00:47:14.629 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T00:47:14.630 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T00:47:14.631 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T00:47:14.632 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T00:47:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T00:47:14.634 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T00:47:14.635 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T00:47:14.636 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T00:47:14.637 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T00:47:14.638 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:47:14.639 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-05-09T00:47:14.639 INFO:teuthology.orchestra.run.smithi136.stdout:======================================================================================= 2024-05-09T00:47:14.639 INFO:teuthology.orchestra.run.smithi136.stdout:Install 148 Packages 2024-05-09T00:47:14.639 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 8 Packages 2024-05-09T00:47:14.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:47:14.639 INFO:teuthology.orchestra.run.smithi151.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 3.5 MB/s | 863 kB 00:00 2024-05-09T00:47:14.640 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 219 M 2024-05-09T00:47:14.640 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-05-09T00:47:14.683 INFO:teuthology.orchestra.run.smithi151.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 2.9 MB/s | 147 kB 00:00 2024-05-09T00:47:14.967 INFO:teuthology.orchestra.run.smithi151.stdout:(4/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 8.0 MB/s | 2.3 MB 00:00 2024-05-09T00:47:15.176 INFO:teuthology.orchestra.run.smithi151.stdout:(5/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 7.2 MB/s | 1.5 MB 00:00 2024-05-09T00:47:15.473 INFO:teuthology.orchestra.run.smithi136.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-05-09T00:47:15.709 INFO:teuthology.orchestra.run.smithi151.stdout:(6/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 3.6 MB/s | 5.4 MB 00:01 2024-05-09T00:47:15.801 INFO:teuthology.orchestra.run.smithi151.stdout:(7/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 7.8 MB/s | 4.9 MB 00:00 2024-05-09T00:47:16.115 INFO:teuthology.orchestra.run.smithi136.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 1.3 MB/s | 863 kB 00:00 2024-05-09T00:47:16.135 INFO:teuthology.orchestra.run.smithi151.stdout:(8/156): ceph-common-19.0.0-3594.gc9da4049.el9. 10 MB/s | 20 MB 00:01 2024-05-09T00:47:16.201 INFO:teuthology.orchestra.run.smithi151.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 378 kB/s | 25 kB 00:00 2024-05-09T00:47:16.216 INFO:teuthology.orchestra.run.smithi136.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 1.4 MB/s | 147 kB 00:00 2024-05-09T00:47:16.587 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-09T00:47:17.044 INFO:teuthology.orchestra.run.smithi151.stdout:(10/156): ceph-radosgw-19.0.0-3594.gc9da4049.el 8.1 MB/s | 10 MB 00:01 2024-05-09T00:47:17.135 INFO:teuthology.orchestra.run.smithi151.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 2.4 MB/s | 224 kB 00:00 2024-05-09T00:47:17.219 INFO:teuthology.orchestra.run.smithi151.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 325 kB/s | 27 kB 00:00 2024-05-09T00:47:17.303 INFO:teuthology.orchestra.run.smithi151.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 380 kB/s | 32 kB 00:00 2024-05-09T00:47:17.611 INFO:teuthology.orchestra.run.smithi151.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 2.4 MB/s | 756 kB 00:00 2024-05-09T00:47:17.695 INFO:teuthology.orchestra.run.smithi151.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 1.8 MB/s | 158 kB 00:00 2024-05-09T00:47:17.707 INFO:teuthology.orchestra.run.smithi136.stdout:(4/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-05-09T00:47:17.762 INFO:teuthology.orchestra.run.smithi151.stdout:(16/156): librados-devel-19.0.0-3594.gc9da4049. 1.9 MB/s | 127 kB 00:00 2024-05-09T00:47:17.920 INFO:teuthology.orchestra.run.smithi151.stdout:(17/156): libradosstriper1-19.0.0-3594.gc9da404 3.1 MB/s | 497 kB 00:00 2024-05-09T00:47:18.057 INFO:teuthology.orchestra.run.smithi136.stdout:(5/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 1.2 MB/s | 2.3 MB 00:01 2024-05-09T00:47:18.091 INFO:teuthology.orchestra.run.smithi136.stdout:(6/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 3.9 MB/s | 1.5 MB 00:00 2024-05-09T00:47:18.905 INFO:teuthology.orchestra.run.smithi151.stdout:(18/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 5.2 MB/s | 5.2 MB 00:00 2024-05-09T00:47:18.987 INFO:teuthology.orchestra.run.smithi151.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 547 kB/s | 45 kB 00:00 2024-05-09T00:47:19.015 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:47:19.016 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T00:47:19.027 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T00:47:19.028 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T00:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T00:47:19.030 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T00:47:19.031 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T00:47:19.034 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T00:47:19.035 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T00:47:19.088 INFO:teuthology.orchestra.run.smithi151.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 1.3 MB/s | 135 kB 00:00 2024-05-09T00:47:19.102 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-05-09T00:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-05-09T00:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-05-09T00:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-05-09T00:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-05-09T00:47:19.123 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 764 k 2024-05-09T00:47:19.124 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T00:47:19.125 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 161 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 322 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 300 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T00:47:19.126 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T00:47:19.127 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T00:47:19.128 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T00:47:19.129 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T00:47:19.130 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T00:47:19.131 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T00:47:19.132 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T00:47:19.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T00:47:19.134 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-05-09T00:47:19.135 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 8 Packages 2024-05-09T00:47:19.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:47:19.136 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 219 M 2024-05-09T00:47:19.136 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-05-09T00:47:19.188 INFO:teuthology.orchestra.run.smithi151.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 1.6 MB/s | 161 kB 00:00 2024-05-09T00:47:19.297 INFO:teuthology.orchestra.run.smithi151.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 2.9 MB/s | 322 kB 00:00 2024-05-09T00:47:19.397 INFO:teuthology.orchestra.run.smithi151.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 2.9 MB/s | 300 kB 00:00 2024-05-09T00:47:19.472 INFO:teuthology.orchestra.run.smithi151.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 1.3 MB/s | 99 kB 00:00 2024-05-09T00:47:19.547 INFO:teuthology.orchestra.run.smithi151.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.1 MB/s | 86 kB 00:00 2024-05-09T00:47:19.989 INFO:teuthology.orchestra.run.smithi037.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-05-09T00:47:20.023 INFO:teuthology.orchestra.run.smithi151.stdout:(26/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 4.1 MB/s | 18 MB 00:04 2024-05-09T00:47:20.073 INFO:teuthology.orchestra.run.smithi151.stdout:(27/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 5.8 MB/s | 3.0 MB 00:00 2024-05-09T00:47:20.115 INFO:teuthology.orchestra.run.smithi151.stdout:(28/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 1.8 MB/s | 169 kB 00:00 2024-05-09T00:47:20.140 INFO:teuthology.orchestra.run.smithi151.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3594.g 512 kB/s | 34 kB 00:00 2024-05-09T00:47:20.190 INFO:teuthology.orchestra.run.smithi151.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 1.8 MB/s | 142 kB 00:00 2024-05-09T00:47:20.382 INFO:teuthology.orchestra.run.smithi136.stdout:(7/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x86 7.7 MB/s | 18 MB 00:02 2024-05-09T00:47:20.556 INFO:teuthology.orchestra.run.smithi037.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 1.5 MB/s | 863 kB 00:00 2024-05-09T00:47:20.691 INFO:teuthology.orchestra.run.smithi151.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 6.4 MB/s | 3.5 MB 00:00 2024-05-09T00:47:20.791 INFO:teuthology.orchestra.run.smithi151.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 2.7 MB/s | 274 kB 00:00 2024-05-09T00:47:20.900 INFO:teuthology.orchestra.run.smithi151.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 455 kB/s | 49 kB 00:00 2024-05-09T00:47:20.973 INFO:teuthology.orchestra.run.smithi037.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 352 kB/s | 147 kB 00:00 2024-05-09T00:47:20.983 INFO:teuthology.orchestra.run.smithi151.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 197 kB/s | 16 kB 00:00 2024-05-09T00:47:21.084 INFO:teuthology.orchestra.run.smithi151.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 2.7 MB/s | 273 kB 00:00 2024-05-09T00:47:21.334 INFO:teuthology.orchestra.run.smithi151.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 3.0 MB/s | 764 kB 00:00 2024-05-09T00:47:21.398 INFO:teuthology.orchestra.run.smithi037.stdout:(4/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-05-09T00:47:21.410 INFO:teuthology.orchestra.run.smithi151.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 241 kB/s | 18 kB 00:00 2024-05-09T00:47:21.533 INFO:teuthology.orchestra.run.smithi136.stdout:(8/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 1.4 MB/s | 4.9 MB 00:03 2024-05-09T00:47:21.599 INFO:teuthology.orchestra.run.smithi136.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 379 kB/s | 25 kB 00:00 2024-05-09T00:47:21.656 INFO:teuthology.orchestra.run.smithi037.stdout:(5/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 5.8 MB/s | 1.5 MB 00:00 2024-05-09T00:47:21.775 INFO:teuthology.orchestra.run.smithi136.stdout:(10/156): ceph-radosgw-19.0.0-3594.gc9da4049.el 7.3 MB/s | 10 MB 00:01 2024-05-09T00:47:21.785 INFO:teuthology.orchestra.run.smithi151.stdout:(38/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 7.7 MB/s | 43 MB 00:05 2024-05-09T00:47:21.825 INFO:teuthology.orchestra.run.smithi136.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 4.4 MB/s | 224 kB 00:00 2024-05-09T00:47:21.867 INFO:teuthology.orchestra.run.smithi136.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 651 kB/s | 27 kB 00:00 2024-05-09T00:47:21.909 INFO:teuthology.orchestra.run.smithi136.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 762 kB/s | 32 kB 00:00 2024-05-09T00:47:21.910 INFO:teuthology.orchestra.run.smithi151.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 161 kB/s | 80 kB 00:00 2024-05-09T00:47:21.977 INFO:teuthology.orchestra.run.smithi151.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-05-09T00:47:22.003 INFO:teuthology.orchestra.run.smithi151.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-09T00:47:22.026 INFO:teuthology.orchestra.run.smithi136.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 6.3 MB/s | 756 kB 00:00 2024-05-09T00:47:22.028 INFO:teuthology.orchestra.run.smithi151.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-05-09T00:47:22.065 INFO:teuthology.orchestra.run.smithi037.stdout:(6/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 2.1 MB/s | 2.3 MB 00:01 2024-05-09T00:47:22.076 INFO:teuthology.orchestra.run.smithi136.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 3.1 MB/s | 158 kB 00:00 2024-05-09T00:47:22.095 INFO:teuthology.orchestra.run.smithi151.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-09T00:47:22.129 INFO:teuthology.orchestra.run.smithi151.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-05-09T00:47:22.154 INFO:teuthology.orchestra.run.smithi151.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-09T00:47:22.179 INFO:teuthology.orchestra.run.smithi151.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-09T00:47:22.204 INFO:teuthology.orchestra.run.smithi151.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-09T00:47:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:(7/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 8.7 MB/s | 4.9 MB 00:00 2024-05-09T00:47:22.277 INFO:teuthology.orchestra.run.smithi136.stdout:(16/156): ceph-common-19.0.0-3594.gc9da4049.el9 2.8 MB/s | 20 MB 00:07 2024-05-09T00:47:22.302 INFO:teuthology.orchestra.run.smithi136.stdout:(17/156): librados-devel-19.0.0-3594.gc9da4049. 563 kB/s | 127 kB 00:00 2024-05-09T00:47:22.452 INFO:teuthology.orchestra.run.smithi136.stdout:(18/156): libradosstriper1-19.0.0-3594.gc9da404 2.8 MB/s | 497 kB 00:00 2024-05-09T00:47:22.519 INFO:teuthology.orchestra.run.smithi136.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 680 kB/s | 45 kB 00:00 2024-05-09T00:47:22.586 INFO:teuthology.orchestra.run.smithi136.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 2.0 MB/s | 135 kB 00:00 2024-05-09T00:47:22.671 INFO:teuthology.orchestra.run.smithi151.stdout:(48/156): ceph-mgr-diskprediction-local-19.0.0- 3.0 MB/s | 7.4 MB 00:02 2024-05-09T00:47:22.695 INFO:teuthology.orchestra.run.smithi136.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 1.5 MB/s | 161 kB 00:00 2024-05-09T00:47:22.845 INFO:teuthology.orchestra.run.smithi136.stdout:(22/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 9.5 MB/s | 5.2 MB 00:00 2024-05-09T00:47:22.871 INFO:teuthology.orchestra.run.smithi136.stdout:(23/156): python3-rados-19.0.0-3594.gc9da4049.e 1.8 MB/s | 322 kB 00:00 2024-05-09T00:47:22.896 INFO:teuthology.orchestra.run.smithi136.stdout:(24/156): python3-rbd-19.0.0-3594.gc9da4049.el9 5.8 MB/s | 300 kB 00:00 2024-05-09T00:47:22.921 INFO:teuthology.orchestra.run.smithi136.stdout:(25/156): python3-rgw-19.0.0-3594.gc9da4049.el9 1.9 MB/s | 99 kB 00:00 2024-05-09T00:47:22.946 INFO:teuthology.orchestra.run.smithi136.stdout:(26/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.7 MB/s | 86 kB 00:00 2024-05-09T00:47:23.005 INFO:teuthology.orchestra.run.smithi136.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 2.8 MB/s | 169 kB 00:00 2024-05-09T00:47:23.055 INFO:teuthology.orchestra.run.smithi136.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 684 kB/s | 34 kB 00:00 2024-05-09T00:47:23.114 INFO:teuthology.orchestra.run.smithi136.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 2.4 MB/s | 142 kB 00:00 2024-05-09T00:47:23.188 INFO:teuthology.orchestra.run.smithi151.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 683 kB/s | 689 kB 00:01 2024-05-09T00:47:23.221 INFO:teuthology.orchestra.run.smithi151.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 927 kB/s | 943 kB 00:01 2024-05-09T00:47:23.389 INFO:teuthology.orchestra.run.smithi151.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 149 kB/s | 107 kB 00:00 2024-05-09T00:47:23.424 INFO:teuthology.orchestra.run.smithi037.stdout:(8/156): ceph-radosgw-19.0.0-3594.gc9da4049.el9 8.4 MB/s | 10 MB 00:01 2024-05-09T00:47:23.465 INFO:teuthology.orchestra.run.smithi136.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 10 MB/s | 3.5 MB 00:00 2024-05-09T00:47:23.466 INFO:teuthology.orchestra.run.smithi037.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 608 kB/s | 25 kB 00:00 2024-05-09T00:47:23.598 INFO:teuthology.orchestra.run.smithi136.stdout:(31/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 4.5 MB/s | 3.0 MB 00:00 2024-05-09T00:47:23.715 INFO:teuthology.orchestra.run.smithi136.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 2.3 MB/s | 274 kB 00:00 2024-05-09T00:47:23.755 INFO:teuthology.orchestra.run.smithi151.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 38 kB/s | 21 kB 00:00 2024-05-09T00:47:23.790 INFO:teuthology.orchestra.run.smithi136.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 659 kB/s | 49 kB 00:00 2024-05-09T00:47:23.849 INFO:teuthology.orchestra.run.smithi136.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 282 kB/s | 16 kB 00:00 2024-05-09T00:47:23.966 INFO:teuthology.orchestra.run.smithi136.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 2.3 MB/s | 273 kB 00:00 2024-05-09T00:47:23.997 INFO:teuthology.orchestra.run.smithi151.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-05-09T00:47:24.131 INFO:teuthology.orchestra.run.smithi151.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 345 kB/s | 313 kB 00:00 2024-05-09T00:47:24.241 INFO:teuthology.orchestra.run.smithi136.stdout:(36/156): ceph-mgr-diskprediction-local-19.0.0- 9.5 MB/s | 7.4 MB 00:00 2024-05-09T00:47:24.266 INFO:teuthology.orchestra.run.smithi136.stdout:(37/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 2.5 MB/s | 764 kB 00:00 2024-05-09T00:47:24.292 INFO:teuthology.orchestra.run.smithi136.stdout:(38/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 364 kB/s | 18 kB 00:00 2024-05-09T00:47:24.606 INFO:teuthology.orchestra.run.smithi151.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 31 kB/s | 18 kB 00:00 2024-05-09T00:47:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-05-09T00:47:24.957 INFO:teuthology.orchestra.run.smithi151.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-05-09T00:47:24.975 INFO:teuthology.orchestra.run.smithi136.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 113 kB/s | 80 kB 00:00 2024-05-09T00:47:25.276 INFO:teuthology.orchestra.run.smithi136.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 817 kB/s | 803 kB 00:00 2024-05-09T00:47:25.290 INFO:teuthology.orchestra.run.smithi151.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-05-09T00:47:25.391 INFO:teuthology.orchestra.run.smithi151.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 204 kB/s | 160 kB 00:00 2024-05-09T00:47:25.776 INFO:teuthology.orchestra.run.smithi136.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 244 kB/s | 195 kB 00:00 2024-05-09T00:47:25.891 INFO:teuthology.orchestra.run.smithi151.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 710 kB/s | 662 kB 00:00 2024-05-09T00:47:25.966 INFO:teuthology.orchestra.run.smithi151.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-05-09T00:47:26.118 INFO:teuthology.orchestra.run.smithi136.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 301 kB/s | 253 kB 00:00 2024-05-09T00:47:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 641 kB/s | 582 kB 00:00 2024-05-09T00:47:26.608 INFO:teuthology.orchestra.run.smithi151.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 66 kB/s | 47 kB 00:00 2024-05-09T00:47:26.785 INFO:teuthology.orchestra.run.smithi136.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-05-09T00:47:26.827 INFO:teuthology.orchestra.run.smithi136.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 151 kB/s | 106 kB 00:00 2024-05-09T00:47:26.850 INFO:teuthology.orchestra.run.smithi151.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 331 kB/s | 292 kB 00:00 2024-05-09T00:47:26.957 INFO:teuthology.orchestra.run.smithi037.stdout:(10/156): ceph-common-19.0.0-3594.gc9da4049.el9 2.7 MB/s | 20 MB 00:07 2024-05-09T00:47:27.101 INFO:teuthology.orchestra.run.smithi151.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 209 kB/s | 188 kB 00:00 2024-05-09T00:47:27.218 INFO:teuthology.orchestra.run.smithi037.stdout:(11/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 3.4 MB/s | 18 MB 00:05 2024-05-09T00:47:27.234 INFO:teuthology.orchestra.run.smithi151.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 56 kB/s | 35 kB 00:00 2024-05-09T00:47:27.250 INFO:teuthology.orchestra.run.smithi037.stdout:(12/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 767 kB/s | 224 kB 00:00 2024-05-09T00:47:27.275 INFO:teuthology.orchestra.run.smithi037.stdout:(13/156): cephfs-shell-19.0.0-3594.gc9da4049.el 476 kB/s | 27 kB 00:00 2024-05-09T00:47:27.519 INFO:teuthology.orchestra.run.smithi136.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 184 kB/s | 135 kB 00:00 2024-05-09T00:47:27.552 INFO:teuthology.orchestra.run.smithi136.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 172 kB/s | 125 kB 00:00 2024-05-09T00:47:27.717 INFO:teuthology.orchestra.run.smithi037.stdout:(14/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 10 MB/s | 43 MB 00:04 2024-05-09T00:47:27.742 INFO:teuthology.orchestra.run.smithi037.stdout:(15/156): libcephfs-devel-19.0.0-3594.gc9da4049 64 kB/s | 32 kB 00:00 2024-05-09T00:47:27.784 INFO:teuthology.orchestra.run.smithi037.stdout:(16/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 1.5 MB/s | 756 kB 00:00 2024-05-09T00:47:27.868 INFO:teuthology.orchestra.run.smithi037.stdout:(17/156): libcephsqlite-19.0.0-3594.gc9da4049.e 1.0 MB/s | 158 kB 00:00 2024-05-09T00:47:27.893 INFO:teuthology.orchestra.run.smithi037.stdout:(18/156): librados-devel-19.0.0-3594.gc9da4049. 842 kB/s | 127 kB 00:00 2024-05-09T00:47:27.985 INFO:teuthology.orchestra.run.smithi037.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 492 kB/s | 45 kB 00:00 2024-05-09T00:47:28.010 INFO:teuthology.orchestra.run.smithi037.stdout:(20/156): libradosstriper1-19.0.0-3594.gc9da404 2.1 MB/s | 497 kB 00:00 2024-05-09T00:47:28.077 INFO:teuthology.orchestra.run.smithi037.stdout:(21/156): python3-ceph-common-19.0.0-3594.gc9da 1.4 MB/s | 135 kB 00:00 2024-05-09T00:47:28.084 INFO:teuthology.orchestra.run.smithi151.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.9 MB/s | 4.7 MB 00:01 2024-05-09T00:47:28.111 INFO:teuthology.orchestra.run.smithi037.stdout:(22/156): python3-cephfs-19.0.0-3594.gc9da4049. 1.6 MB/s | 161 kB 00:00 2024-05-09T00:47:28.262 INFO:teuthology.orchestra.run.smithi037.stdout:(23/156): python3-rados-19.0.0-3594.gc9da4049.e 1.7 MB/s | 322 kB 00:00 2024-05-09T00:47:28.295 INFO:teuthology.orchestra.run.smithi037.stdout:(24/156): python3-rbd-19.0.0-3594.gc9da4049.el9 1.6 MB/s | 300 kB 00:00 2024-05-09T00:47:28.303 INFO:teuthology.orchestra.run.smithi136.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 274 kB/s | 215 kB 00:00 2024-05-09T00:47:28.318 INFO:teuthology.orchestra.run.smithi151.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-05-09T00:47:28.345 INFO:teuthology.orchestra.run.smithi136.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 870 kB/s | 689 kB 00:00 2024-05-09T00:47:28.362 INFO:teuthology.orchestra.run.smithi037.stdout:(25/156): python3-rgw-19.0.0-3594.gc9da4049.el9 991 kB/s | 99 kB 00:00 2024-05-09T00:47:28.385 INFO:teuthology.orchestra.run.smithi151.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-05-09T00:47:28.387 INFO:teuthology.orchestra.run.smithi037.stdout:(26/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 931 kB/s | 86 kB 00:00 2024-05-09T00:47:28.453 INFO:teuthology.orchestra.run.smithi136.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-05-09T00:47:28.471 INFO:teuthology.orchestra.run.smithi037.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 2.0 MB/s | 169 kB 00:00 2024-05-09T00:47:28.545 INFO:teuthology.orchestra.run.smithi136.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 235 kB/s | 21 kB 00:00 2024-05-09T00:47:28.563 INFO:teuthology.orchestra.run.smithi037.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 373 kB/s | 34 kB 00:00 2024-05-09T00:47:28.654 INFO:teuthology.orchestra.run.smithi136.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-05-09T00:47:28.663 INFO:teuthology.orchestra.run.smithi037.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 1.4 MB/s | 142 kB 00:00 2024-05-09T00:47:28.754 INFO:teuthology.orchestra.run.smithi136.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-05-09T00:47:29.052 INFO:teuthology.orchestra.run.smithi151.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 943 kB/s | 911 kB 00:00 2024-05-09T00:47:29.077 INFO:teuthology.orchestra.run.smithi151.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 182 kB/s | 133 kB 00:00 2024-05-09T00:47:29.080 INFO:teuthology.orchestra.run.smithi037.stdout:(30/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 4.3 MB/s | 5.2 MB 00:01 2024-05-09T00:47:29.146 INFO:teuthology.orchestra.run.smithi136.stdout:(53/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-05-09T00:47:29.213 INFO:teuthology.orchestra.run.smithi136.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-05-09T00:47:29.246 INFO:teuthology.orchestra.run.smithi136.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-05-09T00:47:29.314 INFO:teuthology.orchestra.run.smithi136.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-05-09T00:47:29.355 INFO:teuthology.orchestra.run.smithi136.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-09T00:47:29.414 INFO:teuthology.orchestra.run.smithi136.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-05-09T00:47:29.473 INFO:teuthology.orchestra.run.smithi136.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-05-09T00:47:29.523 INFO:teuthology.orchestra.run.smithi136.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-05-09T00:47:29.574 INFO:teuthology.orchestra.run.smithi136.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 253 kB/s | 25 kB 00:00 2024-05-09T00:47:29.611 INFO:teuthology.orchestra.run.smithi151.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-05-09T00:47:29.624 INFO:teuthology.orchestra.run.smithi136.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-05-09T00:47:29.664 INFO:teuthology.orchestra.run.smithi037.stdout:(31/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 2.3 MB/s | 3.0 MB 00:01 2024-05-09T00:47:29.682 INFO:teuthology.orchestra.run.smithi136.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-09T00:47:29.733 INFO:teuthology.orchestra.run.smithi136.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-09T00:47:29.775 INFO:teuthology.orchestra.run.smithi136.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 383 kB/s | 35 kB 00:00 2024-05-09T00:47:29.803 INFO:teuthology.orchestra.run.smithi151.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 121 kB/s | 87 kB 00:00 2024-05-09T00:47:29.864 INFO:teuthology.orchestra.run.smithi037.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 1.3 MB/s | 274 kB 00:00 2024-05-09T00:47:29.956 INFO:teuthology.orchestra.run.smithi037.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 539 kB/s | 49 kB 00:00 2024-05-09T00:47:30.090 INFO:teuthology.orchestra.run.smithi037.stdout:(34/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 2.5 MB/s | 3.5 MB 00:01 2024-05-09T00:47:30.111 INFO:teuthology.orchestra.run.smithi151.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 976 kB/s | 1.0 MB 00:01 2024-05-09T00:47:30.114 INFO:teuthology.orchestra.run.smithi037.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3594.gc 104 kB/s | 16 kB 00:00 2024-05-09T00:47:30.282 INFO:teuthology.orchestra.run.smithi037.stdout:(36/156): ceph-volume-19.0.0-3594.gc9da4049.el9 1.4 MB/s | 273 kB 00:00 2024-05-09T00:47:30.390 INFO:teuthology.orchestra.run.smithi037.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 168 kB/s | 18 kB 00:00 2024-05-09T00:47:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:(38/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 1.9 MB/s | 764 kB 00:00 2024-05-09T00:47:30.574 INFO:teuthology.orchestra.run.smithi037.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 438 kB/s | 80 kB 00:00 2024-05-09T00:47:30.620 INFO:teuthology.orchestra.run.smithi151.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 299 kB/s | 244 kB 00:00 2024-05-09T00:47:30.666 INFO:teuthology.orchestra.run.smithi037.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-09T00:47:30.725 INFO:teuthology.orchestra.run.smithi037.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-05-09T00:47:30.792 INFO:teuthology.orchestra.run.smithi037.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-05-09T00:47:30.812 INFO:teuthology.orchestra.run.smithi151.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-05-09T00:47:30.851 INFO:teuthology.orchestra.run.smithi037.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-09T00:47:30.934 INFO:teuthology.orchestra.run.smithi037.stdout:(44/156): ceph-mgr-diskprediction-local-19.0.0- 4.0 MB/s | 7.4 MB 00:01 2024-05-09T00:47:30.954 INFO:teuthology.orchestra.run.smithi151.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 294 kB/s | 248 kB 00:00 2024-05-09T00:47:30.959 INFO:teuthology.orchestra.run.smithi037.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-09T00:47:30.993 INFO:teuthology.orchestra.run.smithi037.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-05-09T00:47:31.018 INFO:teuthology.orchestra.run.smithi037.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-09T00:47:31.144 INFO:teuthology.orchestra.run.smithi037.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 598 kB/s | 125 kB 00:00 2024-05-09T00:47:31.246 INFO:teuthology.orchestra.run.smithi151.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 41 kB/s | 26 kB 00:00 2024-05-09T00:47:31.329 INFO:teuthology.orchestra.run.smithi151.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 37 kB/s | 19 kB 00:00 2024-05-09T00:47:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 215 kB/s | 172 kB 00:00 2024-05-09T00:47:31.846 INFO:teuthology.orchestra.run.smithi151.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-05-09T00:47:31.860 INFO:teuthology.orchestra.run.smithi037.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 149 kB/s | 107 kB 00:00 2024-05-09T00:47:31.945 INFO:teuthology.orchestra.run.smithi037.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 725 kB/s | 689 kB 00:00 2024-05-09T00:47:31.978 INFO:teuthology.orchestra.run.smithi037.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 983 kB/s | 943 kB 00:00 2024-05-09T00:47:32.503 INFO:teuthology.orchestra.run.smithi037.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 33 kB/s | 21 kB 00:00 2024-05-09T00:47:32.547 INFO:teuthology.orchestra.run.smithi151.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-09T00:47:32.572 INFO:teuthology.orchestra.run.smithi151.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 307 kB/s | 250 kB 00:00 2024-05-09T00:47:32.603 INFO:teuthology.orchestra.run.smithi037.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 52 kB/s | 33 kB 00:00 2024-05-09T00:47:32.664 INFO:teuthology.orchestra.run.smithi151.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 272 kB/s | 222 kB 00:00 2024-05-09T00:47:32.812 INFO:teuthology.orchestra.run.smithi037.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 362 kB/s | 313 kB 00:00 2024-05-09T00:47:33.100 INFO:teuthology.orchestra.run.smithi136.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 1.4 MB/s | 4.7 MB 00:03 2024-05-09T00:47:33.129 INFO:teuthology.orchestra.run.smithi037.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-05-09T00:47:33.214 INFO:teuthology.orchestra.run.smithi151.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 66 kB/s | 42 kB 00:00 2024-05-09T00:47:33.239 INFO:teuthology.orchestra.run.smithi151.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 111 kB/s | 77 kB 00:00 2024-05-09T00:47:33.250 INFO:teuthology.orchestra.run.smithi136.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 4.4 MB 00:03 2024-05-09T00:47:33.396 INFO:teuthology.orchestra.run.smithi037.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 19 kB/s | 11 kB 00:00 2024-05-09T00:47:33.515 INFO:teuthology.orchestra.run.smithi151.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 317 kB/s | 269 kB 00:00 2024-05-09T00:47:33.692 INFO:teuthology.orchestra.run.smithi136.stdout:(68/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 3.6 MB/s | 43 MB 00:12 2024-05-09T00:47:33.754 INFO:teuthology.orchestra.run.smithi037.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-05-09T00:47:33.971 INFO:teuthology.orchestra.run.smithi037.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 190 kB/s | 160 kB 00:00 2024-05-09T00:47:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-05-09T00:47:34.055 INFO:teuthology.orchestra.run.smithi037.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-05-09T00:47:34.057 INFO:teuthology.orchestra.run.smithi151.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 341 kB/s | 279 kB 00:00 2024-05-09T00:47:34.125 INFO:teuthology.orchestra.run.smithi136.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 308 kB/s | 133 kB 00:00 2024-05-09T00:47:34.174 INFO:teuthology.orchestra.run.smithi151.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 77 kB/s | 51 kB 00:00 2024-05-09T00:47:34.630 INFO:teuthology.orchestra.run.smithi037.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-05-09T00:47:34.642 INFO:teuthology.orchestra.run.smithi136.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 655 kB/s | 911 kB 00:01 2024-05-09T00:47:34.682 INFO:teuthology.orchestra.run.smithi151.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 77 kB/s | 54 kB 00:00 2024-05-09T00:47:34.689 INFO:teuthology.orchestra.run.smithi037.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 710 kB/s | 662 kB 00:00 2024-05-09T00:47:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-05-09T00:47:34.914 INFO:teuthology.orchestra.run.smithi037.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 618 kB/s | 582 kB 00:00 2024-05-09T00:47:35.256 INFO:teuthology.orchestra.run.smithi037.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-05-09T00:47:35.300 INFO:teuthology.orchestra.run.smithi151.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 72 kB/s | 44 kB 00:00 2024-05-09T00:47:35.401 INFO:teuthology.orchestra.run.smithi136.stdout:(71/156): postgresql-13.14-1.el9.x86_64.rpm 707 kB/s | 1.6 MB 00:02 2024-05-09T00:47:35.539 INFO:teuthology.orchestra.run.smithi037.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 344 kB/s | 292 kB 00:00 2024-05-09T00:47:35.584 INFO:teuthology.orchestra.run.smithi136.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-05-09T00:47:35.625 INFO:teuthology.orchestra.run.smithi151.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-09T00:47:35.675 INFO:teuthology.orchestra.run.smithi151.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 252 kB/s | 221 kB 00:00 2024-05-09T00:47:35.732 INFO:teuthology.orchestra.run.smithi037.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 239 kB/s | 188 kB 00:00 2024-05-09T00:47:35.865 INFO:teuthology.orchestra.run.smithi037.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 58 kB/s | 35 kB 00:00 2024-05-09T00:47:36.034 INFO:teuthology.orchestra.run.smithi151.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 49 kB/s | 36 kB 00:00 2024-05-09T00:47:36.093 INFO:teuthology.orchestra.run.smithi136.stdout:(73/156): postgresql-server-13.14-1.el9.x86_64. 2.9 MB/s | 5.8 MB 00:01 2024-05-09T00:47:36.135 INFO:teuthology.orchestra.run.smithi136.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 692 kB/s | 1.0 MB 00:01 2024-05-09T00:47:36.267 INFO:teuthology.orchestra.run.smithi151.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-05-09T00:47:36.435 INFO:teuthology.orchestra.run.smithi136.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 713 kB/s | 244 kB 00:00 2024-05-09T00:47:36.477 INFO:teuthology.orchestra.run.smithi136.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 725 kB/s | 248 kB 00:00 2024-05-09T00:47:36.492 INFO:teuthology.orchestra.run.smithi151.stdout:(98/156): socat-1.7.4.1-5.el9.x86_64.rpm 373 kB/s | 305 kB 00:00 2024-05-09T00:47:36.536 INFO:teuthology.orchestra.run.smithi136.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-05-09T00:47:36.577 INFO:teuthology.orchestra.run.smithi136.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-05-09T00:47:36.690 INFO:teuthology.orchestra.run.smithi037.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 4.1 MB/s | 4.7 MB 00:01 2024-05-09T00:47:36.695 INFO:teuthology.orchestra.run.smithi136.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-05-09T00:47:36.709 INFO:teuthology.orchestra.run.smithi151.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 86 kB/s | 58 kB 00:00 2024-05-09T00:47:36.803 INFO:teuthology.orchestra.run.smithi136.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 644 kB/s | 172 kB 00:00 2024-05-09T00:47:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-05-09T00:47:36.983 INFO:teuthology.orchestra.run.smithi037.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2024-05-09T00:47:36.985 INFO:teuthology.orchestra.run.smithi151.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 135 kB/s | 94 kB 00:00 2024-05-09T00:47:37.110 INFO:teuthology.orchestra.run.smithi151.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 179 kB/s | 22 kB 00:00 2024-05-09T00:47:37.144 INFO:teuthology.orchestra.run.smithi151.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 98 kB/s | 64 kB 00:00 2024-05-09T00:47:37.145 INFO:teuthology.orchestra.run.smithi136.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 733 kB/s | 250 kB 00:00 2024-05-09T00:47:37.344 INFO:teuthology.orchestra.run.smithi151.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-05-09T00:47:37.369 INFO:teuthology.orchestra.run.smithi151.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.3 MB/s | 863 kB 00:00 2024-05-09T00:47:37.487 INFO:teuthology.orchestra.run.smithi136.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 650 kB/s | 222 kB 00:00 2024-05-09T00:47:37.619 INFO:teuthology.orchestra.run.smithi151.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-09T00:47:37.645 INFO:teuthology.orchestra.run.smithi151.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 71 kB/s | 19 kB 00:00 2024-05-09T00:47:37.671 INFO:teuthology.orchestra.run.smithi136.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 421 kB/s | 77 kB 00:00 2024-05-09T00:47:37.674 INFO:teuthology.orchestra.run.smithi037.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 926 kB/s | 911 kB 00:00 2024-05-09T00:47:37.700 INFO:teuthology.orchestra.run.smithi037.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 176 kB/s | 133 kB 00:00 2024-05-09T00:47:37.745 INFO:teuthology.orchestra.run.smithi151.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2024-05-09T00:47:37.771 INFO:teuthology.orchestra.run.smithi136.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-05-09T00:47:37.803 INFO:teuthology.orchestra.run.smithi151.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 673 kB/s | 309 kB 00:00 2024-05-09T00:47:37.862 INFO:teuthology.orchestra.run.smithi151.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-05-09T00:47:37.887 INFO:teuthology.orchestra.run.smithi151.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-05-09T00:47:37.954 INFO:teuthology.orchestra.run.smithi151.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-09T00:47:38.038 INFO:teuthology.orchestra.run.smithi151.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-05-09T00:47:38.072 INFO:teuthology.orchestra.run.smithi151.stdout:(113/156): luarocks-3.9.2-1.el9.noarch.rpm 722 kB/s | 151 kB 00:00 2024-05-09T00:47:38.105 INFO:teuthology.orchestra.run.smithi151.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-05-09T00:47:38.122 INFO:teuthology.orchestra.run.smithi151.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 518 kB/s | 43 kB 00:00 2024-05-09T00:47:38.148 INFO:teuthology.orchestra.run.smithi151.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 426 kB/s | 32 kB 00:00 2024-05-09T00:47:38.173 INFO:teuthology.orchestra.run.smithi151.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 222 kB/s | 15 kB 00:00 2024-05-09T00:47:38.188 INFO:teuthology.orchestra.run.smithi136.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 646 kB/s | 269 kB 00:00 2024-05-09T00:47:38.198 INFO:teuthology.orchestra.run.smithi151.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-09T00:47:38.225 INFO:teuthology.orchestra.run.smithi037.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-05-09T00:47:38.257 INFO:teuthology.orchestra.run.smithi151.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-05-09T00:47:38.324 INFO:teuthology.orchestra.run.smithi151.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2024-05-09T00:47:38.357 INFO:teuthology.orchestra.run.smithi151.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-05-09T00:47:38.383 INFO:teuthology.orchestra.run.smithi151.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-05-09T00:47:38.425 INFO:teuthology.orchestra.run.smithi151.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-05-09T00:47:38.442 INFO:teuthology.orchestra.run.smithi037.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 118 kB/s | 87 kB 00:00 2024-05-09T00:47:38.447 INFO:teuthology.orchestra.run.smithi136.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 615 kB/s | 159 kB 00:00 2024-05-09T00:47:38.458 INFO:teuthology.orchestra.run.smithi151.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-05-09T00:47:38.484 INFO:teuthology.orchestra.run.smithi151.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-05-09T00:47:38.509 INFO:teuthology.orchestra.run.smithi151.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-05-09T00:47:38.534 INFO:teuthology.orchestra.run.smithi151.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-05-09T00:47:38.559 INFO:teuthology.orchestra.run.smithi151.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-05-09T00:47:38.584 INFO:teuthology.orchestra.run.smithi151.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-05-09T00:47:38.635 INFO:teuthology.orchestra.run.smithi151.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-05-09T00:47:38.660 INFO:teuthology.orchestra.run.smithi151.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-05-09T00:47:38.692 INFO:teuthology.orchestra.run.smithi037.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-09T00:47:38.710 INFO:teuthology.orchestra.run.smithi151.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-05-09T00:47:38.744 INFO:teuthology.orchestra.run.smithi151.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-05-09T00:47:38.769 INFO:teuthology.orchestra.run.smithi151.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-05-09T00:47:38.794 INFO:teuthology.orchestra.run.smithi151.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-05-09T00:47:38.820 INFO:teuthology.orchestra.run.smithi151.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-05-09T00:47:38.845 INFO:teuthology.orchestra.run.smithi151.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 372 kB/s | 28 kB 00:00 2024-05-09T00:47:38.870 INFO:teuthology.orchestra.run.smithi151.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-09T00:47:38.872 INFO:teuthology.orchestra.run.smithi136.stdout:(87/156): python3-pyasn1-modules-0.4.8-6.el9.no 656 kB/s | 279 kB 00:00 2024-05-09T00:47:38.896 INFO:teuthology.orchestra.run.smithi151.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-05-09T00:47:38.921 INFO:teuthology.orchestra.run.smithi151.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-05-09T00:47:38.946 INFO:teuthology.orchestra.run.smithi151.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-05-09T00:47:38.972 INFO:teuthology.orchestra.run.smithi151.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-05-09T00:47:38.981 INFO:teuthology.orchestra.run.smithi136.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-05-09T00:47:38.997 INFO:teuthology.orchestra.run.smithi151.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-09T00:47:39.022 INFO:teuthology.orchestra.run.smithi151.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-09T00:47:39.064 INFO:teuthology.orchestra.run.smithi151.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-05-09T00:47:39.089 INFO:teuthology.orchestra.run.smithi136.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 496 kB/s | 54 kB 00:00 2024-05-09T00:47:39.090 INFO:teuthology.orchestra.run.smithi151.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 216 kB/s | 20 kB 00:00 2024-05-09T00:47:39.123 INFO:teuthology.orchestra.run.smithi151.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-05-09T00:47:39.207 INFO:teuthology.orchestra.run.smithi151.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-09T00:47:39.284 INFO:teuthology.orchestra.run.smithi037.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 290 kB/s | 244 kB 00:00 2024-05-09T00:47:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-05-09T00:47:39.534 INFO:teuthology.orchestra.run.smithi037.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 305 kB/s | 248 kB 00:00 2024-05-09T00:47:39.607 INFO:teuthology.orchestra.run.smithi151.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 5.8 MB/s | 2.3 MB 00:00 2024-05-09T00:47:39.716 INFO:teuthology.orchestra.run.smithi151.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-05-09T00:47:39.758 INFO:teuthology.orchestra.run.smithi151.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-05-09T00:47:39.816 INFO:teuthology.orchestra.run.smithi151.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.1 MB/s | 248 kB 00:00 2024-05-09T00:47:39.883 INFO:teuthology.orchestra.run.smithi151.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-05-09T00:47:39.918 INFO:teuthology.orchestra.run.smithi037.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 40 kB/s | 26 kB 00:00 2024-05-09T00:47:39.975 INFO:teuthology.orchestra.run.smithi151.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-05-09T00:47:40.060 INFO:teuthology.orchestra.run.smithi037.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 31 kB/s | 19 kB 00:00 2024-05-09T00:47:40.352 INFO:teuthology.orchestra.run.smithi037.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 218 kB/s | 172 kB 00:00 2024-05-09T00:47:40.392 INFO:teuthology.orchestra.run.smithi151.stdout:(155/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-05-09T00:47:40.501 INFO:teuthology.orchestra.run.smithi151.stdout:(156/156): librados2-19.0.0-3594.gc9da4049.el9. 2.4 MB/s | 3.3 MB 00:01 2024-05-09T00:47:40.508 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-05-09T00:47:40.508 INFO:teuthology.orchestra.run.smithi151.stdout:Total 8.2 MB/s | 219 MB 00:26 2024-05-09T00:47:40.519 INFO:teuthology.orchestra.run.smithi037.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-05-09T00:47:41.178 INFO:teuthology.orchestra.run.smithi037.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 304 kB/s | 250 kB 00:00 2024-05-09T00:47:41.253 INFO:teuthology.orchestra.run.smithi037.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-05-09T00:47:41.353 INFO:teuthology.orchestra.run.smithi037.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 267 kB/s | 222 kB 00:00 2024-05-09T00:47:41.711 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-05-09T00:47:41.866 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-05-09T00:47:41.866 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-05-09T00:47:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 60 kB/s | 42 kB 00:00 2024-05-09T00:47:42.204 INFO:teuthology.orchestra.run.smithi037.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 317 kB/s | 269 kB 00:00 2024-05-09T00:47:42.771 INFO:teuthology.orchestra.run.smithi037.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 194 kB/s | 159 kB 00:00 2024-05-09T00:47:43.063 INFO:teuthology.orchestra.run.smithi037.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 336 kB/s | 279 kB 00:00 2024-05-09T00:47:43.413 INFO:teuthology.orchestra.run.smithi037.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-05-09T00:47:43.631 INFO:teuthology.orchestra.run.smithi136.stdout:(90/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 753 kB/s | 5.1 MB 00:06 2024-05-09T00:47:43.638 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-05-09T00:47:43.638 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-05-09T00:47:43.705 INFO:teuthology.orchestra.run.smithi037.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-05-09T00:47:43.747 INFO:teuthology.orchestra.run.smithi136.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 357 kB/s | 42 kB 00:00 2024-05-09T00:47:43.856 INFO:teuthology.orchestra.run.smithi136.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-05-09T00:47:43.931 INFO:teuthology.orchestra.run.smithi136.stdout:(93/156): python3-babel-2.9.1-2.el9.noarch.rpm 732 kB/s | 6.0 MB 00:08 2024-05-09T00:47:44.032 INFO:teuthology.orchestra.run.smithi136.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 359 kB/s | 36 kB 00:00 2024-05-09T00:47:44.038 INFO:teuthology.orchestra.run.smithi037.stdout:(91/156): python3-packaging-20.9-5.el9.noarch.r 27 kB/s | 77 kB 00:02 2024-05-09T00:47:44.140 INFO:teuthology.orchestra.run.smithi136.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-05-09T00:47:44.216 INFO:teuthology.orchestra.run.smithi136.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 615 kB/s | 221 kB 00:00 2024-05-09T00:47:44.316 INFO:teuthology.orchestra.run.smithi136.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 577 kB/s | 58 kB 00:00 2024-05-09T00:47:44.330 INFO:teuthology.orchestra.run.smithi037.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-05-09T00:47:44.508 INFO:teuthology.orchestra.run.smithi136.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 490 kB/s | 94 kB 00:00 2024-05-09T00:47:44.617 INFO:teuthology.orchestra.run.smithi136.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 640 kB/s | 305 kB 00:00 2024-05-09T00:47:44.672 INFO:teuthology.orchestra.run.smithi037.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 70 kB/s | 44 kB 00:00 2024-05-09T00:47:44.683 INFO:teuthology.orchestra.run.smithi136.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 362 kB/s | 64 kB 00:00 2024-05-09T00:47:44.717 INFO:teuthology.orchestra.run.smithi136.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-05-09T00:47:44.809 INFO:teuthology.orchestra.run.smithi136.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-05-09T00:47:44.998 INFO:teuthology.orchestra.run.smithi037.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-05-09T00:47:45.018 INFO:teuthology.orchestra.run.smithi136.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-05-09T00:47:45.306 INFO:teuthology.orchestra.run.smithi037.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 226 kB/s | 221 kB 00:00 2024-05-09T00:47:45.406 INFO:teuthology.orchestra.run.smithi037.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 49 kB/s | 36 kB 00:00 2024-05-09T00:47:45.681 INFO:teuthology.orchestra.run.smithi037.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 72 kB/s | 47 kB 00:00 2024-05-09T00:47:45.868 INFO:teuthology.orchestra.run.smithi136.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 364 kB/s | 309 kB 00:00 2024-05-09T00:47:45.910 INFO:teuthology.orchestra.run.smithi136.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 498 kB/s | 548 kB 00:01 2024-05-09T00:47:45.969 INFO:teuthology.orchestra.run.smithi136.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 194 kB/s | 19 kB 00:00 2024-05-09T00:47:46.057 INFO:teuthology.orchestra.run.smithi037.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 89 kB/s | 58 kB 00:00 2024-05-09T00:47:46.069 INFO:teuthology.orchestra.run.smithi136.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-05-09T00:47:46.177 INFO:teuthology.orchestra.run.smithi136.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 449 kB/s | 49 kB 00:00 2024-05-09T00:47:46.199 INFO:teuthology.orchestra.run.smithi037.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 342 kB/s | 305 kB 00:00 2024-05-09T00:47:46.370 INFO:teuthology.orchestra.run.smithi136.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 351 kB/s | 67 kB 00:00 2024-05-09T00:47:46.391 INFO:teuthology.orchestra.run.smithi037.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 132 kB/s | 94 kB 00:00 2024-05-09T00:47:46.474 INFO:teuthology.orchestra.run.smithi037.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 272 kB/s | 22 kB 00:00 2024-05-09T00:47:46.600 INFO:teuthology.orchestra.run.smithi037.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 6.8 MB/s | 863 kB 00:00 2024-05-09T00:47:46.628 INFO:teuthology.orchestra.run.smithi136.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 585 kB/s | 151 kB 00:00 2024-05-09T00:47:46.700 INFO:teuthology.orchestra.run.smithi037.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.4 MB/s | 548 kB 00:00 2024-05-09T00:47:46.742 INFO:teuthology.orchestra.run.smithi037.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-05-09T00:47:46.767 INFO:teuthology.orchestra.run.smithi037.stdout:(105/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 90 kB/s | 64 kB 00:00 2024-05-09T00:47:46.792 INFO:teuthology.orchestra.run.smithi037.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 397 kB/s | 19 kB 00:00 2024-05-09T00:47:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:(107/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-05-09T00:47:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 344 kB/s | 26 kB 00:00 2024-05-09T00:47:46.902 INFO:teuthology.orchestra.run.smithi037.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-05-09T00:47:46.927 INFO:teuthology.orchestra.run.smithi037.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-05-09T00:47:46.952 INFO:teuthology.orchestra.run.smithi037.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-05-09T00:47:47.002 INFO:teuthology.orchestra.run.smithi037.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-05-09T00:47:47.078 INFO:teuthology.orchestra.run.smithi037.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-05-09T00:47:47.103 INFO:teuthology.orchestra.run.smithi037.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2024-05-09T00:47:47.128 INFO:teuthology.orchestra.run.smithi037.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-05-09T00:47:47.154 INFO:teuthology.orchestra.run.smithi037.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-05-09T00:47:47.179 INFO:teuthology.orchestra.run.smithi037.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-09T00:47:47.204 INFO:teuthology.orchestra.run.smithi037.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-05-09T00:47:47.230 INFO:teuthology.orchestra.run.smithi037.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-05-09T00:47:47.255 INFO:teuthology.orchestra.run.smithi037.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 705 kB/s | 35 kB 00:00 2024-05-09T00:47:47.280 INFO:teuthology.orchestra.run.smithi037.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-09T00:47:47.347 INFO:teuthology.orchestra.run.smithi037.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-05-09T00:47:47.372 INFO:teuthology.orchestra.run.smithi037.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-05-09T00:47:47.398 INFO:teuthology.orchestra.run.smithi037.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-05-09T00:47:47.423 INFO:teuthology.orchestra.run.smithi037.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-05-09T00:47:47.449 INFO:teuthology.orchestra.run.smithi037.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-05-09T00:47:47.474 INFO:teuthology.orchestra.run.smithi037.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-05-09T00:47:47.499 INFO:teuthology.orchestra.run.smithi037.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-05-09T00:47:47.541 INFO:teuthology.orchestra.run.smithi037.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.1 MB/s | 2.0 MB 00:00 2024-05-09T00:47:47.566 INFO:teuthology.orchestra.run.smithi037.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-05-09T00:47:47.591 INFO:teuthology.orchestra.run.smithi037.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-09T00:47:47.742 INFO:teuthology.orchestra.run.smithi037.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-05-09T00:47:47.767 INFO:teuthology.orchestra.run.smithi037.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 288 kB/s | 58 kB 00:00 2024-05-09T00:47:47.784 INFO:teuthology.orchestra.run.smithi037.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 393 kB/s | 16 kB 00:00 2024-05-09T00:47:47.809 INFO:teuthology.orchestra.run.smithi037.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-05-09T00:47:47.827 INFO:teuthology.orchestra.run.smithi037.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 671 kB/s | 28 kB 00:00 2024-05-09T00:47:47.844 INFO:teuthology.orchestra.run.smithi037.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 910 kB/s | 31 kB 00:00 2024-05-09T00:47:47.869 INFO:teuthology.orchestra.run.smithi037.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 984 kB/s | 272 kB 00:00 2024-05-09T00:47:47.886 INFO:teuthology.orchestra.run.smithi037.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-05-09T00:47:47.903 INFO:teuthology.orchestra.run.smithi037.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-05-09T00:47:47.928 INFO:teuthology.orchestra.run.smithi037.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-09T00:47:47.953 INFO:teuthology.orchestra.run.smithi037.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 760 kB/s | 51 kB 00:00 2024-05-09T00:47:47.978 INFO:teuthology.orchestra.run.smithi037.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-05-09T00:47:48.004 INFO:teuthology.orchestra.run.smithi037.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-09T00:47:48.029 INFO:teuthology.orchestra.run.smithi037.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-05-09T00:47:48.054 INFO:teuthology.orchestra.run.smithi037.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-09T00:47:48.095 INFO:teuthology.orchestra.run.smithi136.stdout:(111/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 572 kB/s | 839 kB 00:01 2024-05-09T00:47:48.289 INFO:teuthology.orchestra.run.smithi037.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 1.2 MB/s | 427 kB 00:00 2024-05-09T00:47:48.330 INFO:teuthology.orchestra.run.smithi037.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-05-09T00:47:48.664 INFO:teuthology.orchestra.run.smithi037.stdout:(149/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 8.2 MB/s | 3.1 MB 00:00 2024-05-09T00:47:48.722 INFO:teuthology.orchestra.run.smithi037.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-05-09T00:47:48.773 INFO:teuthology.orchestra.run.smithi037.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 838 kB/s | 42 kB 00:00 2024-05-09T00:47:48.831 INFO:teuthology.orchestra.run.smithi037.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-09T00:47:48.837 INFO:teuthology.orchestra.run.smithi136.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 739 kB/s | 548 kB 00:00 2024-05-09T00:47:48.937 INFO:teuthology.orchestra.run.smithi136.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-05-09T00:47:49.038 INFO:teuthology.orchestra.run.smithi136.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-05-09T00:47:49.048 INFO:teuthology.orchestra.run.smithi037.stdout:(153/156): librados2-19.0.0-3594.gc9da4049.el9. 3.3 MB/s | 3.3 MB 00:00 2024-05-09T00:47:49.090 INFO:teuthology.orchestra.run.smithi037.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 5.2 MB/s | 1.3 MB 00:00 2024-05-09T00:47:49.132 INFO:teuthology.orchestra.run.smithi037.stdout:(155/156): NetworkManager-libnm-1.47.5-1.el9.x8 3.9 MB/s | 1.8 MB 00:00 2024-05-09T00:47:49.138 INFO:teuthology.orchestra.run.smithi136.stdout:(115/156): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-05-09T00:47:49.414 INFO:teuthology.orchestra.run.smithi136.stdout:(116/156): python3-cheroot-8.6.0-4.el9.noarch.r 624 kB/s | 172 kB 00:00 2024-05-09T00:47:49.449 INFO:teuthology.orchestra.run.smithi037.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.0 MB/s | 2.4 MB 00:00 2024-05-09T00:47:49.452 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-05-09T00:47:49.452 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.2 MB/s | 219 MB 00:30 2024-05-09T00:47:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-05-09T00:47:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T00:47:49.818 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T00:47:49.880 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T00:47:49.914 INFO:teuthology.orchestra.run.smithi136.stdout:(117/156): python3-cherrypy-18.6.1-2.el9.noarch 717 kB/s | 358 kB 00:00 2024-05-09T00:47:49.914 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T00:47:49.940 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T00:47:49.983 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T00:47:50.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T00:47:50.347 INFO:teuthology.orchestra.run.smithi136.stdout:(118/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 699 kB/s | 303 kB 00:00 2024-05-09T00:47:50.439 INFO:teuthology.orchestra.run.smithi136.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 386 kB/s | 35 kB 00:00 2024-05-09T00:47:50.466 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:47:50.575 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:47:50.600 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:47:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:47:50.696 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-05-09T00:47:50.721 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:47:50.781 INFO:teuthology.orchestra.run.smithi136.stdout:(120/156): python3-google-auth-2.29.0-1.el9.noa 601 kB/s | 206 kB 00:00 2024-05-09T00:47:50.868 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-05-09T00:47:50.868 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-05-09T00:47:50.876 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T00:47:50.943 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T00:47:50.971 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:47:51.076 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:47:51.105 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:47:51.151 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:47:51.173 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:47:51.198 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:47:51.231 INFO:teuthology.orchestra.run.smithi136.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 849 kB/s | 4.4 MB 00:05 2024-05-09T00:47:51.390 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:47:51.499 INFO:teuthology.orchestra.run.smithi136.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 541 kB/s | 144 kB 00:00 2024-05-09T00:47:51.517 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:47:51.599 INFO:teuthology.orchestra.run.smithi136.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2024-05-09T00:47:51.671 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:47:51.699 INFO:teuthology.orchestra.run.smithi136.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-05-09T00:47:51.723 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:47:51.816 INFO:teuthology.orchestra.run.smithi136.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-05-09T00:47:51.835 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:47:51.916 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:47:51.916 INFO:teuthology.orchestra.run.smithi136.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 194 kB/s | 19 kB 00:00 2024-05-09T00:47:52.017 INFO:teuthology.orchestra.run.smithi136.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2024-05-09T00:47:52.105 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:47:52.212 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T00:47:52.237 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T00:47:52.271 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T00:47:52.337 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T00:47:52.371 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T00:47:52.415 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T00:47:52.447 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T00:47:52.475 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T00:47:52.544 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T00:47:52.606 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T00:47:52.636 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T00:47:52.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T00:47:52.748 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T00:47:52.782 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T00:47:52.825 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T00:47:52.855 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T00:47:52.934 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T00:47:52.978 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T00:47:53.053 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T00:47:53.174 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-05-09T00:47:53.175 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-05-09T00:47:53.189 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T00:47:53.239 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T00:47:53.409 INFO:teuthology.orchestra.run.smithi136.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 794 kB/s | 2.0 MB 00:02 2024-05-09T00:47:53.442 INFO:teuthology.orchestra.run.smithi136.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 733 kB/s | 1.0 MB 00:01 2024-05-09T00:47:53.509 INFO:teuthology.orchestra.run.smithi136.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2024-05-09T00:47:53.626 INFO:teuthology.orchestra.run.smithi136.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 429 kB/s | 79 kB 00:00 2024-05-09T00:47:53.693 INFO:teuthology.orchestra.run.smithi136.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 314 kB/s | 58 kB 00:00 2024-05-09T00:47:53.775 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T00:47:53.793 INFO:teuthology.orchestra.run.smithi136.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-09T00:47:53.860 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T00:47:53.897 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T00:47:53.987 INFO:teuthology.orchestra.run.smithi136.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 491 kB/s | 90 kB 00:00 2024-05-09T00:47:53.988 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T00:47:53.988 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T00:47:54.020 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T00:47:54.102 INFO:teuthology.orchestra.run.smithi136.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 572 kB/s | 272 kB 00:00 2024-05-09T00:47:54.127 INFO:teuthology.orchestra.run.smithi136.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 188 kB/s | 28 kB 00:00 2024-05-09T00:47:54.181 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T00:47:54.211 INFO:teuthology.orchestra.run.smithi136.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2024-05-09T00:47:54.247 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T00:47:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T00:47:54.395 INFO:teuthology.orchestra.run.smithi136.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2024-05-09T00:47:54.406 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T00:47:54.420 INFO:teuthology.orchestra.run.smithi136.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 645 kB/s | 188 kB 00:00 2024-05-09T00:47:54.479 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T00:47:54.504 INFO:teuthology.orchestra.run.smithi136.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-05-09T00:47:54.517 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T00:47:54.554 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T00:47:54.554 INFO:teuthology.orchestra.run.smithi136.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 382 kB/s | 51 kB 00:00 2024-05-09T00:47:54.601 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T00:47:54.645 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T00:47:54.713 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T00:47:54.738 INFO:teuthology.orchestra.run.smithi136.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 489 kB/s | 90 kB 00:00 2024-05-09T00:47:54.755 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T00:47:54.846 INFO:teuthology.orchestra.run.smithi136.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 671 kB/s | 230 kB 00:00 2024-05-09T00:47:54.893 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T00:47:54.935 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T00:47:54.955 INFO:teuthology.orchestra.run.smithi136.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-05-09T00:47:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T00:47:55.006 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T00:47:55.101 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T00:47:55.140 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T00:47:55.180 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T00:47:55.206 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T00:47:55.213 INFO:teuthology.orchestra.run.smithi136.stdout:(145/156): re2-20211101-3.el9.x86_64.rpm 742 kB/s | 192 kB 00:00 2024-05-09T00:47:55.231 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T00:47:55.306 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T00:47:55.322 INFO:teuthology.orchestra.run.smithi136.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 731 kB/s | 427 kB 00:00 2024-05-09T00:47:55.433 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T00:47:55.462 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T00:47:55.490 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T00:47:55.525 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T00:47:55.564 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T00:47:55.604 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T00:47:55.633 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T00:47:55.668 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T00:47:55.701 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T00:47:55.743 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T00:47:55.777 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T00:47:55.831 INFO:teuthology.orchestra.run.smithi136.stdout:(147/156): librados2-19.0.0-3594.gc9da4049.el9. 6.5 MB/s | 3.3 MB 00:00 2024-05-09T00:47:55.866 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T00:47:55.916 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T00:47:55.947 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T00:47:55.994 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T00:47:56.094 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T00:47:56.148 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T00:47:56.206 INFO:teuthology.orchestra.run.smithi136.stdout:(148/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 8.2 MB/s | 3.1 MB 00:00 2024-05-09T00:47:56.698 INFO:teuthology.orchestra.run.smithi136.stdout:(149/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 945 kB/s | 16 MB 00:17 2024-05-09T00:47:56.895 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T00:47:56.945 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T00:47:56.979 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T00:47:57.081 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T00:47:57.137 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T00:47:57.225 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T00:47:57.264 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T00:47:57.298 INFO:teuthology.orchestra.run.smithi136.stdout:(150/156): thrift-0.15.0-2.el9.x86_64.rpm 777 kB/s | 1.6 MB 00:02 2024-05-09T00:47:57.365 INFO:teuthology.orchestra.run.smithi136.stdout:(151/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.0 MB/s | 2.3 MB 00:01 2024-05-09T00:47:57.442 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T00:47:57.470 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T00:47:57.556 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T00:47:57.757 INFO:teuthology.orchestra.run.smithi136.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-05-09T00:47:57.924 INFO:teuthology.orchestra.run.smithi136.stdout:(153/156): NetworkManager-team-1.47.5-1.el9.x86 67 kB/s | 42 kB 00:00 2024-05-09T00:47:58.183 INFO:teuthology.orchestra.run.smithi136.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 304 kB/s | 248 kB 00:00 2024-05-09T00:47:58.214 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T00:47:58.319 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T00:47:58.808 INFO:teuthology.orchestra.run.smithi136.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.3 MB/s | 1.3 MB 00:01 2024-05-09T00:47:59.050 INFO:teuthology.orchestra.run.smithi136.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-05-09T00:47:59.056 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-05-09T00:47:59.056 INFO:teuthology.orchestra.run.smithi136.stdout:Total 4.9 MB/s | 219 MB 00:44 2024-05-09T00:47:59.498 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-05-09T00:47:59.563 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T00:47:59.583 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T00:47:59.603 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T00:47:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T00:47:59.665 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T00:47:59.693 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T00:47:59.706 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T00:47:59.726 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T00:47:59.730 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T00:47:59.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T00:48:00.056 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T00:48:00.097 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:48:00.188 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:48:00.218 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T00:48:00.224 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T00:48:00.252 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-05-09T00:48:00.254 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T00:48:00.265 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:48:00.377 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:48:00.404 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-05-09T00:48:00.405 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-05-09T00:48:00.407 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:48:00.483 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:48:00.512 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:48:00.705 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T00:48:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T00:48:00.763 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T00:48:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:48:00.791 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:48:00.862 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:48:00.884 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T00:48:00.893 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:48:00.921 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:48:00.984 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:48:01.014 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:48:01.034 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:48:01.232 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:48:01.410 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:48:01.552 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:48:01.613 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:48:01.714 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:48:01.806 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:48:02.123 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T00:48:02.152 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T00:48:02.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T00:48:02.241 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-05-09T00:48:02.242 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-05-09T00:48:02.263 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T00:48:02.303 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T00:48:02.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T00:48:02.380 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T00:48:02.407 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T00:48:02.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T00:48:02.530 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T00:48:02.560 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T00:48:02.609 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T00:48:02.682 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T00:48:02.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T00:48:02.767 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T00:48:02.795 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T00:48:02.868 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T00:48:02.918 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T00:48:02.997 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T00:48:03.105 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:03.143 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T00:48:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T00:48:03.214 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:03.756 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T00:48:03.772 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:03.817 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:48:03.835 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T00:48:03.871 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T00:48:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:48:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T00:48:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T00:48:03.906 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:03.914 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T00:48:03.935 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:48:03.960 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T00:48:04.003 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T00:48:04.169 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T00:48:04.230 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T00:48:04.325 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T00:48:04.388 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T00:48:04.462 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T00:48:04.498 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T00:48:04.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T00:48:04.573 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T00:48:04.617 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T00:48:04.661 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T00:48:04.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T00:48:04.847 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T00:48:04.891 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T00:48:04.921 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T00:48:04.963 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T00:48:05.062 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T00:48:05.096 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T00:48:05.137 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T00:48:05.170 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T00:48:05.195 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T00:48:05.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T00:48:05.552 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T00:48:05.594 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T00:48:05.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T00:48:05.667 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T00:48:05.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T00:48:05.736 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T00:48:05.766 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T00:48:05.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T00:48:05.834 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T00:48:05.867 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T00:48:05.901 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T00:48:05.992 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T00:48:06.041 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T00:48:06.071 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T00:48:06.120 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T00:48:06.230 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T00:48:06.290 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T00:48:07.063 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T00:48:07.112 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T00:48:07.145 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T00:48:07.249 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T00:48:07.303 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T00:48:07.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T00:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T00:48:07.623 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T00:48:07.653 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T00:48:07.734 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T00:48:08.355 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-05-09T00:48:08.421 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T00:48:08.436 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T00:48:08.475 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T00:48:08.536 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T00:48:08.547 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T00:48:08.571 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T00:48:08.605 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T00:48:08.647 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T00:48:08.975 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T00:48:09.098 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:48:09.223 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:48:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:48:09.340 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:48:09.403 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:48:09.550 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T00:48:09.609 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T00:48:09.636 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:48:09.740 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:48:09.763 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:48:09.825 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T00:48:09.847 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:48:09.870 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T00:48:09.882 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T00:48:09.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T00:48:09.993 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T00:48:10.027 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T00:48:10.065 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:48:10.190 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T00:48:10.354 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:48:10.365 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T00:48:10.406 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:48:10.447 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T00:48:10.498 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:48:10.536 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T00:48:10.567 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:48:10.579 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T00:48:10.657 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:48:10.853 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T00:48:10.961 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T00:48:10.995 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T00:48:11.029 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T00:48:11.093 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T00:48:11.096 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T00:48:11.126 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:48:11.129 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T00:48:11.181 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:48:11.181 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T00:48:11.210 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T00:48:11.213 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T00:48:11.242 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T00:48:11.309 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T00:48:11.363 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T00:48:11.394 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T00:48:11.430 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T00:48:11.514 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T00:48:11.558 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T00:48:11.600 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T00:48:11.630 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T00:48:11.698 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T00:48:11.745 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T00:48:11.818 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T00:48:11.949 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T00:48:12.005 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T00:48:12.529 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T00:48:12.609 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T00:48:12.639 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T00:48:12.673 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T00:48:12.711 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T00:48:12.753 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T00:48:12.905 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T00:48:12.965 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T00:48:13.055 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T00:48:13.112 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T00:48:13.184 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T00:48:13.225 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T00:48:13.261 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T00:48:13.307 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T00:48:13.344 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T00:48:13.387 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T00:48:13.429 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T00:48:13.565 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T00:48:13.610 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T00:48:13.636 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:13.640 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T00:48:13.674 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:13.681 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T00:48:13.775 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T00:48:13.816 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T00:48:13.855 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T00:48:13.881 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T00:48:13.915 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T00:48:13.987 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T00:48:14.106 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T00:48:14.139 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T00:48:14.167 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T00:48:14.201 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T00:48:14.240 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T00:48:14.265 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:14.272 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T00:48:14.302 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T00:48:14.302 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:48:14.337 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T00:48:14.381 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:48:14.382 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T00:48:14.382 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T00:48:14.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:14.395 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T00:48:14.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:48:14.436 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T00:48:14.479 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T00:48:14.565 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T00:48:14.610 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T00:48:14.642 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T00:48:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T00:48:14.785 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T00:48:14.835 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T00:48:15.560 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T00:48:15.607 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T00:48:15.641 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T00:48:15.739 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T00:48:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T00:48:15.894 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T00:48:15.923 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2024-05-09T00:48:15.924 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:15.937 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T00:48:16.096 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:48:16.112 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:48:16.112 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:16.112 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T00:48:16.112 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:16.113 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T00:48:16.143 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T00:48:16.221 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T00:48:16.861 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T00:48:16.989 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T00:48:17.759 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:48:17.785 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:48:17.785 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:17.786 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T00:48:17.786 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:48:17.786 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:48:17.786 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:18.009 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:48:18.032 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:48:18.032 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:18.032 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T00:48:18.032 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:48:18.033 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:48:18.033 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:18.206 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T00:48:18.288 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T00:48:18.315 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T00:48:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T00:48:18.493 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:48:18.516 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:48:18.516 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:18.516 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T00:48:18.516 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:48:18.516 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:48:18.516 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T00:48:18.662 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T00:48:18.680 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T00:48:18.744 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T00:48:18.853 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:48:18.931 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T00:48:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T00:48:18.974 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T00:48:18.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T00:48:19.027 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T00:48:19.063 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T00:48:19.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T00:48:19.300 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T00:48:19.352 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T00:48:19.384 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T00:48:19.412 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T00:48:19.516 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T00:48:19.567 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:48:19.618 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T00:48:19.649 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T00:48:19.822 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:48:19.851 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:48:19.884 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T00:48:19.953 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T00:48:19.983 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:48:21.026 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:48:21.068 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:48:21.880 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:21.921 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:22.038 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:48:22.068 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:48:22.181 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:48:22.352 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T00:48:22.378 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:48:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:48:22.402 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:22.402 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T00:48:22.402 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:48:22.402 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:48:22.402 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:22.446 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:48:22.457 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:48:22.476 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T00:48:22.508 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:48:22.555 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T00:48:22.600 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T00:48:22.600 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T00:48:22.600 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T00:48:22.600 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:22.611 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T00:48:22.634 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:48:23.546 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T00:48:23.581 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:48:23.604 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:48:23.604 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:23.605 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T00:48:23.605 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:48:23.605 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:48:23.605 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:23.649 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:48:23.671 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:48:23.671 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:23.671 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T00:48:23.672 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:23.724 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:48:23.747 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:48:23.747 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:23.747 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T00:48:23.747 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:48:23.747 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:48:23.747 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:24.075 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:48:24.097 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:48:24.098 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:24.098 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T00:48:24.098 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:48:24.098 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:48:24.098 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:26.841 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:48:26.841 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-05-09T00:48:26.841 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-05-09T00:48:26.841 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-05-09T00:48:26.842 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-05-09T00:48:26.842 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-05-09T00:48:26.842 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-05-09T00:48:26.842 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-05-09T00:48:26.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:27.028 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:48:27.045 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:48:27.045 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:27.045 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T00:48:27.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:28.379 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T00:48:28.420 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T00:48:28.486 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T00:48:28.517 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T00:48:28.544 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T00:48:28.706 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:48:28.735 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:48:28.735 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:28.735 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T00:48:28.735 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:48:28.735 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:48:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:28.736 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T00:48:28.782 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T00:48:28.812 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T00:48:28.842 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T00:48:28.888 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T00:48:28.973 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:48:28.999 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:48:28.999 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:28.999 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T00:48:28.999 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:48:28.999 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:48:28.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:29.472 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:29.482 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:48:29.507 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:48:29.507 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:29.507 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T00:48:29.507 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:48:29.507 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:48:29.508 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:29.519 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:29.540 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:29.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T00:48:29.680 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T00:48:29.744 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T00:48:29.938 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T00:48:29.992 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T00:48:30.073 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T00:48:30.173 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T00:48:30.320 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T00:48:30.359 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T00:48:30.385 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T00:48:30.399 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T00:48:30.426 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T00:48:30.473 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T00:48:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T00:48:30.598 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T00:48:30.634 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T00:48:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T00:48:30.660 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:48:30.736 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:48:30.761 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T00:48:30.761 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:48:30.846 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:48:30.870 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T00:48:30.876 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:30.876 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:31.052 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:48:31.055 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:31.055 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:48:31.084 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:48:31.117 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T00:48:31.139 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:48:31.182 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T00:48:31.203 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:31.215 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:48:32.314 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:48:32.350 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:48:33.366 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:48:33.392 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:48:33.509 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:48:33.675 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T00:48:33.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:48:33.727 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:48:33.727 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:33.727 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T00:48:33.727 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:48:33.727 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:48:33.728 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:33.778 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:48:33.790 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:48:33.893 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T00:48:33.951 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T00:48:34.305 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-05-09T00:48:34.306 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:34.494 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:48:34.511 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T00:48:34.511 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:34.511 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T00:48:34.511 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:34.942 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T00:48:34.981 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:48:35.006 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:48:35.006 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:35.006 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T00:48:35.006 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:48:35.006 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:48:35.006 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:35.048 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:48:35.073 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:48:35.073 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:35.073 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T00:48:35.073 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:35.124 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:48:35.149 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:48:35.149 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:35.149 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T00:48:35.149 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:48:35.149 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:48:35.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:35.474 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:48:35.499 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:48:35.499 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:35.499 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T00:48:35.499 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:48:35.499 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:48:35.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:36.064 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:48:36.090 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T00:48:36.090 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:36.090 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T00:48:36.090 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:48:36.090 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T00:48:36.091 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:36.331 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:48:36.354 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T00:48:36.354 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:36.354 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T00:48:36.354 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:48:36.354 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T00:48:36.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:36.815 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:48:36.838 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T00:48:36.838 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:36.838 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T00:48:36.838 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:48:36.838 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T00:48:36.838 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:36.945 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T00:48:36.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T00:48:36.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T00:48:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T00:48:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T00:48:36.951 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T00:48:36.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T00:48:36.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T00:48:36.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T00:48:36.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T00:48:36.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T00:48:36.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T00:48:36.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T00:48:36.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T00:48:36.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T00:48:36.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T00:48:36.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T00:48:36.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T00:48:36.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T00:48:36.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T00:48:36.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T00:48:36.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T00:48:37.002 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T00:48:37.057 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T00:48:37.240 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T00:48:37.290 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T00:48:37.367 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T00:48:37.456 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T00:48:37.594 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T00:48:37.640 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T00:48:37.680 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T00:48:37.708 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T00:48:38.161 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:48:38.190 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T00:48:38.222 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T00:48:38.283 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T00:48:38.329 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:48:39.373 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T00:48:39.406 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.579 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.580 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.581 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T00:48:39.582 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T00:48:39.583 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T00:48:39.584 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T00:48:39.585 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T00:48:39.586 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T00:48:39.587 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T00:48:39.588 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T00:48:39.589 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T00:48:39.590 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:48:39.591 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-05-09T00:48:40.012 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T00:48:40.040 DEBUG:teuthology.parallel:result is None 2024-05-09T00:48:40.054 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T00:48:40.095 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T00:48:40.134 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T00:48:40.170 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T00:48:40.370 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T00:48:40.381 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T00:48:40.398 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:48:40.424 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T00:48:40.454 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T00:48:40.484 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T00:48:40.508 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T00:48:40.530 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T00:48:40.673 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T00:48:40.700 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:48:40.723 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T00:48:40.723 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:40.723 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T00:48:40.723 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:48:40.723 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T00:48:40.723 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:40.767 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:48:40.778 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T00:48:40.877 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T00:48:40.923 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T00:48:41.117 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:41.854 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T00:48:41.894 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:48:41.917 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T00:48:41.917 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:41.917 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T00:48:41.917 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:48:41.917 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T00:48:41.918 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:41.961 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:48:41.983 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T00:48:41.984 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:41.984 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T00:48:41.984 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:42.029 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:48:42.051 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T00:48:42.051 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:42.052 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T00:48:42.052 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:48:42.052 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T00:48:42.052 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T00:48:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T00:48:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T00:48:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T00:48:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T00:48:42.363 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:48:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T00:48:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:48:42.385 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T00:48:42.386 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T00:48:42.386 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T00:48:42.386 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:48:42.386 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T00:48:42.386 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:48:42.504 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T00:48:42.504 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:48:42.580 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:48:42.613 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T00:48:42.620 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:42.620 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:42.807 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:42.807 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:48:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:48:42.967 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:46.649 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T00:48:46.690 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T00:48:46.731 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T00:48:46.763 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T00:48:46.790 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T00:48:46.970 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T00:48:47.011 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T00:48:47.042 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T00:48:47.080 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T00:48:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T00:48:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:47.773 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:47.792 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T00:48:48.607 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T00:48:48.694 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T00:48:48.735 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T00:48:48.781 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:48.781 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T00:48:48.781 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T00:48:48.782 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T00:48:48.783 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T00:48:48.795 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T00:48:48.795 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T00:48:48.795 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T00:48:48.795 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T00:48:48.795 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T00:48:48.795 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T00:48:48.795 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T00:48:48.796 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T00:48:48.797 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T00:48:48.798 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T00:48:48.799 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T00:48:48.800 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T00:48:48.801 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T00:48:48.802 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T00:48:48.803 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T00:48:48.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T00:48:48.816 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T00:48:48.855 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T00:48:48.881 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T00:48:48.882 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:48:48.949 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T00:48:48.982 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T00:48:48.982 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:48:49.058 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T00:48:49.083 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T00:48:49.088 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:49.088 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:49.277 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T00:48:49.277 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:48:49.360 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T00:48:49.425 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:51.095 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T00:48:51.096 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T00:48:51.098 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T00:48:51.099 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T00:48:51.100 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T00:48:51.101 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T00:48:51.102 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T00:48:51.103 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T00:48:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T00:48:51.105 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:48:51.107 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-05-09T00:48:51.518 DEBUG:teuthology.parallel:result is None 2024-05-09T00:48:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T00:48:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T00:48:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T00:48:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T00:48:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T00:48:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T00:48:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T00:48:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T00:48:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T00:48:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T00:48:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T00:48:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T00:48:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T00:48:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T00:48:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T00:48:55.089 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T00:48:55.090 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.651 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.652 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.653 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T00:48:57.654 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.655 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T00:48:57.656 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T00:48:57.657 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T00:48:57.658 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T00:48:57.659 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T00:48:57.660 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T00:48:57.661 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T00:48:57.662 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-09T00:48:57.663 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-05-09T00:48:58.059 DEBUG:teuthology.parallel:result is None 2024-05-09T00:48:58.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:48:58.213 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T00:48:58.241 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T00:48:58.241 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T00:48:58.241 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T00:48:58.243 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:48:58.381 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T00:48:58.403 INFO:teuthology.orchestra.run.smithi136.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T00:48:58.403 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T00:48:58.403 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T00:48:58.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:48:58.619 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T00:48:58.645 INFO:teuthology.orchestra.run.smithi151.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T00:48:58.645 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T00:48:58.645 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T00:48:58.648 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T00:48:58.648 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:48:58.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T00:48:58.681 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:48:58.682 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T00:48:58.708 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:48:58.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T00:48:58.738 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T00:48:58.739 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:48:58.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T00:48:58.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T00:48:58.838 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:48:58.838 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T00:48:58.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T00:48:58.928 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:48:58.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T00:48:58.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T00:48:59.024 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T00:48:59.025 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:48:59.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T00:48:59.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T00:48:59.120 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:48:59.120 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T00:48:59.144 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T00:48:59.209 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:48:59.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T00:48:59.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T00:48:59.298 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T00:48:59.298 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:48:59.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T00:48:59.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T00:48:59.391 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:48:59.391 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T00:48:59.416 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T00:48:59.481 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:48:59.481 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T00:48:59.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T00:48:59.567 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-09T00:48:59.670 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'subvols': {'create': 2}} 2024-05-09T00:48:59.670 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:48:59.671 INFO:tasks.cephadm:Cluster fsid is ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:48:59.671 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-09T00:48:59.671 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.b': '172.21.15.136', 'mon.c': '172.21.15.151'} 2024-05-09T00:48:59.672 INFO:tasks.cephadm:First mon is mon.a on smithi037 2024-05-09T00:48:59.672 INFO:tasks.cephadm:First mgr is x 2024-05-09T00:48:59.672 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-09T00:48:59.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-05-09T00:48:59.698 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2024-05-09T00:48:59.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname $(hostname -s) 2024-05-09T00:48:59.746 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-09T00:48:59.747 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:48:59.887 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79224/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3594-gc9da4049', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3594.gc9da4049'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 19:52:58.989794', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.183908-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-09T00:49:00.028 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-pdonnell-testing-20240508.183908-debug, sha1 c9da4049f638c0f84bdd9b4e33c42e86046ac554 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:49:00.030 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm 2024-05-09T00:49:00.030 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:00.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 782809 May 9 00:49 /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:00.607 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:01.034 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-r--r--. 1 ubuntu ubuntu 782809 May 9 00:49 /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:01.034 DEBUG:teuthology.orchestra.run.smithi151:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:01.562 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-r--r--. 1 ubuntu ubuntu 782809 May 9 00:49 /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:01.563 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:01.583 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:01.602 DEBUG:teuthology.orchestra.run.smithi151:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T00:49:01.637 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 on all hosts... 2024-05-09T00:49:01.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 pull 2024-05-09T00:49:01.640 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 pull 2024-05-09T00:49:01.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 pull 2024-05-09T00:49:03.092 INFO:teuthology.orchestra.run.smithi151.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T00:49:03.185 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T00:49:03.316 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T00:49:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T00:49:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T00:49:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7", 2024-05-09T00:49:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-05-09T00:49:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584" 2024-05-09T00:49:44.990 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T00:49:44.990 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T00:50:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-09T00:50:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T00:50:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "image_id": "db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7", 2024-05-09T00:50:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "repo_digests": [ 2024-05-09T00:50:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584" 2024-05-09T00:50:03.998 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-09T00:50:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-09T00:50:07.724 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-09T00:50:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T00:50:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7", 2024-05-09T00:50:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2024-05-09T00:50:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584" 2024-05-09T00:50:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-05-09T00:50:07.724 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-09T00:50:07.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-05-09T00:50:07.785 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2024-05-09T00:50:07.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph 2024-05-09T00:50:07.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-05-09T00:50:07.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2024-05-09T00:50:07.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /etc/ceph 2024-05-09T00:50:07.927 INFO:tasks.cephadm:Writing seed config... 2024-05-09T00:50:07.928 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-09T00:50:07.928 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-09T00:50:07.928 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-09T00:50:07.929 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-09T00:50:07.930 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-09T00:50:07.931 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-05-09T00:50:07.932 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:50:07.932 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-09T00:50:07.948 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ec4482a6-0d9d-11ef-bc97-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-09T00:50:07.949 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a.service 2024-05-09T00:50:07.991 DEBUG:teuthology.orchestra.run.smithi037:mgr.x> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.x.service 2024-05-09T00:50:08.033 INFO:tasks.cephadm:Bootstrapping... 2024-05-09T00:50:08.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 -v bootstrap --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:50:08.231 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-05-09T00:50:08.231 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554', '-v', 'bootstrap', '--fsid', 'ec4482a6-0d9d-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-05-09T00:50:08.232 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-09T00:50:08.232 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-05-09T00:50:08.257 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T00:50:08.257 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-05-09T00:50:08.257 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-05-09T00:50:08.265 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T00:50:08.265 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T00:50:08.272 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T00:50:08.272 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-05-09T00:50:08.279 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-05-09T00:50:08.285 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-05-09T00:50:08.285 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-05-09T00:50:08.286 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-05-09T00:50:08.310 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T00:50:08.310 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-09T00:50:08.311 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-05-09T00:50:08.311 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-05-09T00:50:08.317 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T00:50:08.317 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T00:50:08.323 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T00:50:08.324 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-05-09T00:50:08.330 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-05-09T00:50:08.337 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-05-09T00:50:08.337 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-05-09T00:50:08.338 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-05-09T00:50:08.338 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:08.338 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140472321727936 on /run/cephadm/ec4482a6-0d9d-11ef-bc97-c7b262605968.lock 2024-05-09T00:50:08.338 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140472321727936 acquired on /run/cephadm/ec4482a6-0d9d-11ef-bc97-c7b262605968.lock 2024-05-09T00:50:08.338 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-05-09T00:50:08.338 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-05-09T00:50:08.339 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-05-09T00:50:08.342 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-05-09T00:50:08.342 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-05-09T00:50:08.344 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-09T00:50:08.345 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-09T00:50:08.345 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-09T00:50:08.347 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-09T00:50:08.347 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-09T00:50:08.347 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T00:50:08.347 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-09T00:50:08.347 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-09T00:50:08.348 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T00:50:08.348 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-05-09T00:50:08.348 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-05-09T00:50:08.348 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-09T00:50:08.349 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-09T00:50:08.350 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T00:50:11.414 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 2024-05-09T00:50:11.415 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T00:50:11.415 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-05-09T00:50:11.415 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:0411e0fd7a5d45f8ab31b23cec89f97c70494de39461f644c7cdc77de3b9cbca 2024-05-09T00:50:11.415 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-09T00:50:11.415 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 2024-05-09T00:50:11.415 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-09T00:50:14.064 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev) 2024-05-09T00:50:14.065 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev) 2024-05-09T00:50:14.065 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-05-09T00:50:15.077 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-05-09T00:50:15.077 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-05-09T00:50:16.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDHHTxmQQm7FxAAlLVR0jcT/CHmFGQR5YcNPw== 2024-05-09T00:50:16.822 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDIHTxmqPgdFBAAtT/avY2Y6XqBFLSkYxdtAw== 2024-05-09T00:50:17.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDJHTxmm0wqChAAhEYDzV4FiOe9TiDE4T4Mwg== 2024-05-09T00:50:17.762 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-05-09T00:50:19.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T00:50:19.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-09T00:50:19.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:19.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T00:50:19.815 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T00:50:19.815 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-05-09T00:50:19.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:19.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T00:50:19.815 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:50:19.815 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-05-09T00:50:21.780 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.a on 2024-05-09T00:50:21.997 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-09T00:50:22.144 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-09T00:50:22.323 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968.target. 2024-05-09T00:50:22.323 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968.target. 2024-05-09T00:50:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a 2024-05-09T00:50:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-09T00:50:22.751 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968.target.wants/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@.service. 2024-05-09T00:50:23.264 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T00:50:23.264 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-05-09T00:50:23.271 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T00:50:23.271 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-05-09T00:50:23.271 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-05-09T00:50:23.272 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T00:50:23.272 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-05-09T00:50:23.272 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-05-09T00:50:23.391 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:23 smithi037 ceph-mon[29751]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-09T00:50:24.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-05-09T00:50:24.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:24.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.540434s) 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:24.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.705+0000 7efc8e274700 1 Processor -- start 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.705+0000 7efc8e274700 1 -- start start 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.705+0000 7efc8e274700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8807db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.705+0000 7efc8e274700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efc8807e0d0 con 0x7efc8807f6d0 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.706+0000 7efc87fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8807db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.706+0000 7efc87fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8807db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45090/0 (socket says 172.21.15.37:45090) 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.706+0000 7efc87fff700 1 -- 172.21.15.37:0/3165678157 learned_addr learned my addr 172.21.15.37:0/3165678157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.706+0000 7efc87fff700 1 -- 172.21.15.37:0/3165678157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8807e250 con 0x7efc8807f6d0 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.706+0000 7efc87fff700 1 --2- 172.21.15.37:0/3165678157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8807db00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efc780098a0 tx=0x7efc78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedaf878387553e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc86ffd700 1 -- 172.21.15.37:0/3165678157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc78004160 con 0x7efc8807f6d0 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc86ffd700 1 -- 172.21.15.37:0/3165678157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc78004300 con 0x7efc8807f6d0 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc86ffd700 1 -- 172.21.15.37:0/3165678157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc780036a0 con 0x7efc8807f6d0 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc8e274700 1 -- 172.21.15.37:0/3165678157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 msgr2=0x7efc8807db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:24.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc8e274700 1 --2- 172.21.15.37:0/3165678157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8807db00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efc780098a0 tx=0x7efc78009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc8e274700 1 -- 172.21.15.37:0/3165678157 shutdown_connections 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc8e274700 1 --2- 172.21.15.37:0/3165678157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8807db00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc8e274700 1 -- 172.21.15.37:0/3165678157 >> 172.21.15.37:0/3165678157 conn(0x7efc881052d0 msgr2=0x7efc88107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc8e274700 1 -- 172.21.15.37:0/3165678157 shutdown_connections 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.707+0000 7efc8e274700 1 -- 172.21.15.37:0/3165678157 wait complete. 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.708+0000 7efc8e274700 1 Processor -- start 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.708+0000 7efc8e274700 1 -- start start 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.708+0000 7efc8e274700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8819f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.708+0000 7efc8e274700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efc8807e780 con 0x7efc8807f6d0 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc87fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8819f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc87fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8819f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45104/0 (socket says 172.21.15.37:45104) 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc87fff700 1 -- 172.21.15.37:0/1494817902 learned_addr learned my addr 172.21.15.37:0/1494817902 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:24.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc87fff700 1 -- 172.21.15.37:0/1494817902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8819fea0 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc87fff700 1 --2- 172.21.15.37:0/1494817902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8819f960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efc78000c00 tx=0x7efc78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc857fa700 1 -- 172.21.15.37:0/1494817902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc78003db0 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc857fa700 1 -- 172.21.15.37:0/1494817902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc78011630 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc881a0130 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc881a2d40 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.709+0000 7efc857fa700 1 -- 172.21.15.37:0/1494817902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc78011950 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.710+0000 7efc857fa700 1 -- 172.21.15.37:0/1494817902 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc7801a460 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.710+0000 7efc857fa700 1 -- 172.21.15.37:0/1494817902 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efc7801b780 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.710+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc88064e20 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.713+0000 7efc857fa700 1 -- 172.21.15.37:0/1494817902 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7efc78031020 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.786+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7efc8802e8c0 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.786+0000 7efc857fa700 1 -- 172.21.15.37:0/1494817902 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7efc7801b9d0 con 0x7efc8807f6d0 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.787+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 msgr2=0x7efc8819f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:24.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.787+0000 7efc8e274700 1 --2- 172.21.15.37:0/1494817902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8819f960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efc78000c00 tx=0x7efc78004750 comp rx=0 tx=0).stop 2024-05-09T00:50:24.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.787+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 shutdown_connections 2024-05-09T00:50:24.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.787+0000 7efc8e274700 1 --2- 172.21.15.37:0/1494817902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8807f6d0 0x7efc8819f960 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:24.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.787+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 >> 172.21.15.37:0/1494817902 conn(0x7efc881052d0 msgr2=0x7efc88107150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:24.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.788+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 shutdown_connections 2024-05-09T00:50:24.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:23.788+0000 7efc8e274700 1 -- 172.21.15.37:0/1494817902 wait complete. 2024-05-09T00:50:24.352 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-05-09T00:50:24.352 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: monmap epoch 1 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: last_changed 2024-05-09T00:50:18.107396+0000 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: created 2024-05-09T00:50:18.107396+0000 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: min_mon_release 19 (squid) 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: election_strategy: 1 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: fsmap 2024-05-09T00:50:24.456 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: osdmap e1: 0 total, 0 up, 0 in 2024-05-09T00:50:24.457 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: mgrmap e1: no daemons active 2024-05-09T00:50:24.457 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:24 smithi037 ceph-mon[29751]: from='client.? 172.21.15.37:0/1494817902' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-09T00:50:25.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:25 smithi037 ceph-mon[29751]: from='client.? 172.21.15.37:0/370230284' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T00:50:25.428 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:25 smithi037 ceph-mon[29751]: from='client.? 172.21.15.37:0/370230284' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-09T00:50:25.437 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:25.437 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T00:50:25.437 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T00:50:25.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.747+0000 7fcaa60e1700 1 Processor -- start 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.747+0000 7fcaa60e1700 1 -- start start 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.747+0000 7fcaa60e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa0108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.747+0000 7fcaa60e1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa01094e0 con 0x7fcaa0108ae0 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa0108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa0108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45108/0 (socket says 172.21.15.37:45108) 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9f7fe700 1 -- 172.21.15.37:0/98023175 learned_addr learned my addr 172.21.15.37:0/98023175 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9f7fe700 1 -- 172.21.15.37:0/98023175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa0109cb0 con 0x7fcaa0108ae0 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9f7fe700 1 --2- 172.21.15.37:0/98023175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa0108ef0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fca9000bb40 tx=0x7fca9000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d027f0b09bcafc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9e7fc700 1 -- 172.21.15.37:0/98023175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9000dbe0 con 0x7fcaa0108ae0 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9e7fc700 1 -- 172.21.15.37:0/98023175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9000dd80 con 0x7fcaa0108ae0 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.748+0000 7fca9e7fc700 1 -- 172.21.15.37:0/98023175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca90004180 con 0x7fcaa0108ae0 2024-05-09T00:50:25.439 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.749+0000 7fcaa60e1700 1 -- 172.21.15.37:0/98023175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 msgr2=0x7fcaa0108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.749+0000 7fcaa60e1700 1 --2- 172.21.15.37:0/98023175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa0108ef0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fca9000bb40 tx=0x7fca9000be50 comp rx=0 tx=0).stop 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.749+0000 7fcaa60e1700 1 -- 172.21.15.37:0/98023175 shutdown_connections 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.749+0000 7fcaa60e1700 1 --2- 172.21.15.37:0/98023175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa0108ef0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.749+0000 7fcaa60e1700 1 -- 172.21.15.37:0/98023175 >> 172.21.15.37:0/98023175 conn(0x7fcaa0104120 msgr2=0x7fcaa01065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.749+0000 7fcaa60e1700 1 -- 172.21.15.37:0/98023175 shutdown_connections 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.749+0000 7fcaa60e1700 1 -- 172.21.15.37:0/98023175 wait complete. 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.750+0000 7fcaa60e1700 1 Processor -- start 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.750+0000 7fcaa60e1700 1 -- start start 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.750+0000 7fcaa60e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.750+0000 7fcaa60e1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa010a180 con 0x7fcaa0108ae0 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.750+0000 7fca9f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.750+0000 7fca9f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa019f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45112/0 (socket says 172.21.15.37:45112) 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.750+0000 7fca9f7fe700 1 -- 172.21.15.37:0/370230284 learned_addr learned my addr 172.21.15.37:0/370230284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fca9f7fe700 1 -- 172.21.15.37:0/370230284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa019fef0 con 0x7fcaa0108ae0 2024-05-09T00:50:25.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fca9f7fe700 1 --2- 172.21.15.37:0/370230284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa019f9b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fca9000e010 tx=0x7fca90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca900044e0 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca90010470 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca90010750 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa01a0180 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa01a2d90 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca90010980 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.751+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca9002cd70 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.752+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa0064e20 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.755+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fca90015070 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.826+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fcaa002e800 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.831+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+492 (secure 0 0 0) 0x7fca90010e00 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.832+0000 7fca9cff9700 1 -- 172.21.15.37:0/370230284 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fca9000dd80 con 0x7fcaa0108ae0 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.832+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 msgr2=0x7fcaa019f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.832+0000 7fcaa60e1700 1 --2- 172.21.15.37:0/370230284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa019f9b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fca9000e010 tx=0x7fca90004750 comp rx=0 tx=0).stop 2024-05-09T00:50:25.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.833+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 shutdown_connections 2024-05-09T00:50:25.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.833+0000 7fcaa60e1700 1 --2- 172.21.15.37:0/370230284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa0108ae0 0x7fcaa019f9b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:25.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.833+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 >> 172.21.15.37:0/370230284 conn(0x7fcaa0104120 msgr2=0x7fcaa0191c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:25.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.833+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 shutdown_connections 2024-05-09T00:50:25.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:24.833+0000 7fcaa60e1700 1 -- 172.21.15.37:0/370230284 wait complete. 2024-05-09T00:50:25.442 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-05-09T00:50:26.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:26 smithi037 ceph-mon[29751]: from='client.? 172.21.15.37:0/2626564226' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf", "output-file": "/var/lib/ceph/mon/ceph-a/config"}]: dispatch 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.888+0000 7fd1eb8a5700 1 Processor -- start 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.888+0000 7fd1eb8a5700 1 -- start start 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.888+0000 7fd1eb8a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e4108300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.888+0000 7fd1eb8a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e41088d0 con 0x7fd1e4107ef0 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.888+0000 7fd1e9641700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e4108300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.888+0000 7fd1e9641700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e4108300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45124/0 (socket says 172.21.15.37:45124) 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.888+0000 7fd1e9641700 1 -- 172.21.15.37:0/1925165231 learned_addr learned my addr 172.21.15.37:0/1925165231 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:26.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.889+0000 7fd1e9641700 1 -- 172.21.15.37:0/1925165231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e410aef0 con 0x7fd1e4107ef0 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.889+0000 7fd1e9641700 1 --2- 172.21.15.37:0/1925165231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e4108300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00098a0 tx=0x7fd1e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bd440220846242 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.889+0000 7fd1dbfff700 1 -- 172.21.15.37:0/1925165231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e0004160 con 0x7fd1e4107ef0 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.889+0000 7fd1dbfff700 1 -- 172.21.15.37:0/1925165231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd1e0004300 con 0x7fd1e4107ef0 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.889+0000 7fd1dbfff700 1 -- 172.21.15.37:0/1925165231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e0011af0 con 0x7fd1e4107ef0 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/1925165231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 msgr2=0x7fd1e4108300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 --2- 172.21.15.37:0/1925165231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e4108300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00098a0 tx=0x7fd1e0009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/1925165231 shutdown_connections 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 --2- 172.21.15.37:0/1925165231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e4108300 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/1925165231 >> 172.21.15.37:0/1925165231 conn(0x7fd1e4103960 msgr2=0x7fd1e4105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/1925165231 shutdown_connections 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/1925165231 wait complete. 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.890+0000 7fd1eb8a5700 1 Processor -- start 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1eb8a5700 1 -- start start 2024-05-09T00:50:26.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1eb8a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1eb8a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e410e120 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1e9641700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1e9641700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e419e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45136/0 (socket says 172.21.15.37:45136) 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1e9641700 1 -- 172.21.15.37:0/2626564226 learned_addr learned my addr 172.21.15.37:0/2626564226 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1e9641700 1 -- 172.21.15.37:0/2626564226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e419e7e0 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1e9641700 1 --2- 172.21.15.37:0/2626564226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e419e2a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0011670 tx=0x7fd1e0004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1da7fc700 1 -- 172.21.15.37:0/2626564226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e00036a0 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1da7fc700 1 -- 172.21.15.37:0/2626564226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd1e001a430 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e419ea70 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.891+0000 7fd1da7fc700 1 -- 172.21.15.37:0/2626564226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1e0019550 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.892+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e41a1680 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.892+0000 7fd1da7fc700 1 -- 172.21.15.37:0/2626564226 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd1e0019b50 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.892+0000 7fd1da7fc700 1 -- 172.21.15.37:0/2626564226 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd1e0024800 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.892+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e410e2a0 con 0x7fd1e4107ef0 2024-05-09T00:50:26.828 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.895+0000 7fd1da7fc700 1 -- 172.21.15.37:0/2626564226 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd1e0043ec0 con 0x7fd1e4107ef0 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.966+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config generate-minimal-conf", "output-file": "/var/lib/ceph/mon/ceph-a/config"} v 0) -- 0x7fd1e41a1850 con 0x7fd1e4107ef0 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.966+0000 7fd1da7fc700 1 -- 172.21.15.37:0/2626564226 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf", "output-file": "/var/lib/ceph/mon/ceph-a/config"}]=0 v2) ==== 126+0+175 (secure 0 0 0) 0x7fd1e0032020 con 0x7fd1e4107ef0 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.967+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 msgr2=0x7fd1e419e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.967+0000 7fd1eb8a5700 1 --2- 172.21.15.37:0/2626564226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e419e2a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0011670 tx=0x7fd1e0004280 comp rx=0 tx=0).stop 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.967+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 shutdown_connections 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.967+0000 7fd1eb8a5700 1 --2- 172.21.15.37:0/2626564226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e4107ef0 0x7fd1e419e2a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.967+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 >> 172.21.15.37:0/2626564226 conn(0x7fd1e4103960 msgr2=0x7fd1e41053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.967+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 shutdown_connections 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:25.967+0000 7fd1eb8a5700 1 -- 172.21.15.37:0/2626564226 wait complete. 2024-05-09T00:50:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-05-09T00:50:27.097 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:26 smithi037 systemd[1]: Stopping Ceph mon.a for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:50:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a[29747]: 2024-05-09T00:50:27.096+0000 7f8c74b47700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:50:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a[29747]: 2024-05-09T00:50:27.096+0000 7f8c74b47700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-09T00:50:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 podman[29994]: 2024-05-09 00:50:27.280781938 +0000 UTC m=+0.286010737 container died df79949ef192fcf84a2604a948752407d63d9e8cae7f512c67d4dc8b01809020 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True) 2024-05-09T00:50:27.796 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 podman[29994]: 2024-05-09 00:50:27.545530737 +0000 UTC m=+0.550759528 container cleanup df79949ef192fcf84a2604a948752407d63d9e8cae7f512c67d4dc8b01809020 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-09T00:50:27.797 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 bash[29994]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a 2024-05-09T00:50:28.147 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 podman[30008]: 2024-05-09 00:50:27.796655695 +0000 UTC m=+0.513494886 container remove df79949ef192fcf84a2604a948752407d63d9e8cae7f512c67d4dc8b01809020 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T00:50:28.147 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 systemd[1]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-09T00:50:28.147 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 systemd[1]: Stopped Ceph mon.a for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:50:28.147 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:27 smithi037 systemd[1]: Starting Ceph mon.a for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:50:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 podman[30103]: 2024-05-09 00:50:28.147305229 +0000 UTC m=+0.110353620 container create d9bacac277c5f3e9798373200224b9a06a0810c3dc6ffdb070d139df5a1c2fbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T00:50:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 podman[30103]: 2024-05-09 00:50:28.055307197 +0000 UTC m=+0.018355589 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:50:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 podman[30103]: 2024-05-09 00:50:28.358318466 +0000 UTC m=+0.321366860 container init d9bacac277c5f3e9798373200224b9a06a0810c3dc6ffdb070d139df5a1c2fbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T00:50:28.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 podman[30103]: 2024-05-09 00:50:28.361462004 +0000 UTC m=+0.324510396 container start d9bacac277c5f3e9798373200224b9a06a0810c3dc6ffdb070d139df5a1c2fbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T00:50:28.402 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T00:50:28.402 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev), process ceph-mon, pid 2 2024-05-09T00:50:28.402 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: pidfile_write: ignore empty --pid-file 2024-05-09T00:50:28.402 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: load: jerasure load: lrc 2024-05-09T00:50:28.437 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: RocksDB version: 7.9.2 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Git sha 0 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Compile date 2024-05-08 19:33:14 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: DB SUMMARY 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: DB Session ID: H6IUGIADT0JZ9RSTH52S 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: CURRENT file: CURRENT 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-09T00:50:28.661 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105166 ; 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.error_if_exists: 0 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.create_if_missing: 0 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.paranoid_checks: 1 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.env: 0x55896e389500 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.info_log: 0x5589708bc020 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.statistics: (nil) 2024-05-09T00:50:28.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.use_fsync: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_log_file_size: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.allow_fallocate: 1 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.use_direct_reads: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.db_log_dir: 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.wal_dir: 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T00:50:28.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T00:50:28.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T00:50:28.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.write_buffer_manager: 0x5589707868c0 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T00:50:28.665 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.unordered_write: 0 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.row_cache: None 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.wal_filter: None 2024-05-09T00:50:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.two_write_queues: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.wal_compression: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.atomic_flush: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.log_readahead_size: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T00:50:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_background_jobs: 2 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_background_compactions: -1 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_subcompactions: 1 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_open_files: -1 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T00:50:28.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_background_flushes: -1 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Compression algorithms supported: 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kZSTD supported: 0 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kXpressCompression supported: 0 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kZlibCompression supported: 1 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kSnappyCompression supported: 1 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kLZ4Compression supported: 1 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: kBZip2Compression supported: 0 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-09T00:50:28.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.merge_operator: 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_filter: None 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5589708bc1e0) 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_type: 0 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2024-05-09T00:50:28.670 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_shortening: 1 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: checksum: 4 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: no_block_cache: 0 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache: 0x5589707b91f0 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_options: 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: capacity : 536870912 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size: 4096 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2024-05-09T00:50:28.671 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: partition_filters: 0 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: filter_policy: bloomfilter 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: verify_compression: 0 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: format_version: 5 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_align: 0 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: max_auto_readahead_size: 262144 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: prepopulate_block_cache: 0 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: initial_auto_readahead_size: 8192 2024-05-09T00:50:28.672 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression: NoCompression 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.num_levels: 7 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T00:50:28.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T00:50:28.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T00:50:28.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T00:50:28.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.inplace_update_support: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.bloom_locality: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.max_successive_merges: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.ttl: 2592000 2024-05-09T00:50:28.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.enable_blob_files: false 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.min_blob_size: 0 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-09T00:50:28.678 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e1ae6c03-c626-4f8e-aebd-de5a3e2b5571 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715215828403848, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715215828405041, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100335, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 98219, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14153, "raw_average_key_size": 49, "raw_value_size": 90518, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715215828, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e1ae6c03-c626-4f8e-aebd-de5a3e2b5571", "db_session_id": "H6IUGIADT0JZ9RSTH52S", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715215828405129, "job": 1, "event": "recovery_finished"} 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55897079dc00 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: DB pointer 0x558975590000 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** DB Stats ** 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:50:28.679 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: L0 2/0 99.84 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: Sum 2/0 99.84 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 158.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 158.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:50:28.680 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative compaction: 0.00 GB write, 28.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval compaction: 0.00 GB write, 28.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache BinnedLRUCache@0x5589707b91f0#2 capacity: 512.00 MB usage: 1.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.03 KB,0.000196695%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-09T00:50:28.681 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???) e1 preinit fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???).mds e1 new map 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???).mds e1 print_map 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout: e1 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout: legacy client fscid: -1 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout: No filesystems configured 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T00:50:28.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 bash[30103]: d9bacac277c5f3e9798373200224b9a06a0810c3dc6ffdb070d139df5a1c2fbf 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 systemd[1]: Started Ceph mon.a for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: monmap epoch 1 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: last_changed 2024-05-09T00:50:18.107396+0000 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: created 2024-05-09T00:50:18.107396+0000 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: min_mon_release 19 (squid) 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: election_strategy: 1 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: fsmap 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: osdmap e1: 0 total, 0 up, 0 in 2024-05-09T00:50:28.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:28 smithi037 ceph-mon[30122]: mgrmap e1: no daemons active 2024-05-09T00:50:29.538 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.885+0000 7fa0cf531700 1 Processor -- start 2024-05-09T00:50:29.538 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.885+0000 7fa0cf531700 1 -- start start 2024-05-09T00:50:29.538 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.885+0000 7fa0cf531700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c810a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.885+0000 7fa0cf531700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810a610 con 0x7fa0c8109c10 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.885+0000 7fa0cd2cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c810a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.885+0000 7fa0cd2cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c810a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45140/0 (socket says 172.21.15.37:45140) 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.885+0000 7fa0cd2cd700 1 -- 172.21.15.37:0/895497359 learned_addr learned my addr 172.21.15.37:0/895497359 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.886+0000 7fa0cd2cd700 1 -- 172.21.15.37:0/895497359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c810ade0 con 0x7fa0c8109c10 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.886+0000 7fa0cd2cd700 1 --2- 172.21.15.37:0/895497359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c810a020 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40098a0 tx=0x7fa0c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fe2775a9ac9893 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.886+0000 7fa0bffff700 1 -- 172.21.15.37:0/895497359 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c4004160 con 0x7fa0c8109c10 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.886+0000 7fa0bffff700 1 -- 172.21.15.37:0/895497359 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa0c4004300 con 0x7fa0c8109c10 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.886+0000 7fa0bffff700 1 -- 172.21.15.37:0/895497359 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c4011af0 con 0x7fa0c8109c10 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.887+0000 7fa0cf531700 1 -- 172.21.15.37:0/895497359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 msgr2=0x7fa0c810a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.887+0000 7fa0cf531700 1 --2- 172.21.15.37:0/895497359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c810a020 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40098a0 tx=0x7fa0c4009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.887+0000 7fa0cf531700 1 -- 172.21.15.37:0/895497359 shutdown_connections 2024-05-09T00:50:29.539 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.887+0000 7fa0cf531700 1 --2- 172.21.15.37:0/895497359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c810a020 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.887+0000 7fa0cf531700 1 -- 172.21.15.37:0/895497359 >> 172.21.15.37:0/895497359 conn(0x7fa0c81052d0 msgr2=0x7fa0c8107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.887+0000 7fa0cf531700 1 -- 172.21.15.37:0/895497359 shutdown_connections 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.887+0000 7fa0cf531700 1 -- 172.21.15.37:0/895497359 wait complete. 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.888+0000 7fa0cf531700 1 Processor -- start 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.888+0000 7fa0cf531700 1 -- start start 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.888+0000 7fa0cf531700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.888+0000 7fa0cf531700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810e190 con 0x7fa0c8109c10 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.888+0000 7fa0cd2cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.888+0000 7fa0cd2cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c819e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45154/0 (socket says 172.21.15.37:45154) 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.888+0000 7fa0cd2cd700 1 -- 172.21.15.37:0/2063271576 learned_addr learned my addr 172.21.15.37:0/2063271576 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0cd2cd700 1 -- 172.21.15.37:0/2063271576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c819e5f0 con 0x7fa0c8109c10 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0cd2cd700 1 --2- 172.21.15.37:0/2063271576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c819e0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4011670 tx=0x7fa0c4004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0be7fc700 1 -- 172.21.15.37:0/2063271576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40036a0 con 0x7fa0c8109c10 2024-05-09T00:50:29.540 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c819e880 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0be7fc700 1 -- 172.21.15.37:0/2063271576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa0c4003cd0 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0be7fc700 1 -- 172.21.15.37:0/2063271576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0c40193c0 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c81a1490 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0be7fc700 1 -- 172.21.15.37:0/2063271576 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa0c4019a10 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.889+0000 7fa0be7fc700 1 -- 172.21.15.37:0/2063271576 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa0c40243f0 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.890+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c8064e20 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.893+0000 7fa0be7fc700 1 -- 172.21.15.37:0/2063271576 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa0c4043ec0 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.962+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fa0c81a1660 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.965+0000 7fa0be7fc700 1 -- 172.21.15.37:0/2063271576 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fa0c4032020 con 0x7fa0c8109c10 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.965+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 msgr2=0x7fa0c819e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.965+0000 7fa0cf531700 1 --2- 172.21.15.37:0/2063271576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c819e0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4011670 tx=0x7fa0c4004280 comp rx=0 tx=0).stop 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.966+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 shutdown_connections 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.966+0000 7fa0cf531700 1 --2- 172.21.15.37:0/2063271576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0c8109c10 0x7fa0c819e0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.966+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 >> 172.21.15.37:0/2063271576 conn(0x7fa0c81052d0 msgr2=0x7fa0c8106bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:29.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.966+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 shutdown_connections 2024-05-09T00:50:29.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:28.966+0000 7fa0cf531700 1 -- 172.21.15.37:0/2063271576 wait complete. 2024-05-09T00:50:29.542 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-09T00:50:29.564 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:50:29.564 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-05-09T00:50:29.564 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-09T00:50:29.565 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-09T00:50:29.812 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.x 2024-05-09T00:50:29.812 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-09T00:50:29.963 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968.target.wants/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@.service. 2024-05-09T00:50:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:29 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2063271576' entity='client.admin' 2024-05-09T00:50:30.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:29 smithi037 systemd[1]: Starting Ceph mgr.x for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:50:30.502 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 podman[30337]: 2024-05-09 00:50:30.224638796 +0000 UTC m=+0.130577722 container create 00d64b3c7a23ef9eab3b80d11f93993f82a9080a78d70646189d46d4b28ecc09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-09T00:50:30.502 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 podman[30337]: 2024-05-09 00:50:30.128003181 +0000 UTC m=+0.033942109 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T00:50:30.502 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 podman[30337]: 2024-05-09 00:50:30.418566922 +0000 UTC m=+0.324505851 container init 00d64b3c7a23ef9eab3b80d11f93993f82a9080a78d70646189d46d4b28ecc09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T00:50:30.502 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 podman[30337]: 2024-05-09 00:50:30.421447349 +0000 UTC m=+0.327386278 container start 00d64b3c7a23ef9eab3b80d11f93993f82a9080a78d70646189d46d4b28ecc09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-09T00:50:30.502 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 bash[30337]: 00d64b3c7a23ef9eab3b80d11f93993f82a9080a78d70646189d46d4b28ecc09 2024-05-09T00:50:30.516 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T00:50:30.516 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-05-09T00:50:30.524 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T00:50:30.524 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-05-09T00:50:30.524 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-05-09T00:50:30.524 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T00:50:30.533 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T00:50:30.533 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-05-09T00:50:30.541 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T00:50:30.541 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-05-09T00:50:30.541 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-05-09T00:50:30.541 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-09T00:50:30.541 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-05-09T00:50:30.541 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-05-09T00:50:30.781 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 systemd[1]: Started Ceph mgr.x for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:50:30.781 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:30.592+0000 7f57e20de200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:50:31.031 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:30.787+0000 7f57e20de200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:50:31.031 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:30 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:30.894+0000 7f57e20de200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:50:31.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:31 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3089026432' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T00:50:31.319 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:31 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:31.230+0000 7f57e20de200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:50:31.320 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:31 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:31.318+0000 7f57e20de200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T00:50:31.638 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T00:50:31.639 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:31.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T00:50:31.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T00:50:31.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T00:50:31.647 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T00:50:31.647 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T00:50:31.648 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T00:50:31.649 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T00:50:23.248821+0000", 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.028+0000 7fe4abb56700 1 Processor -- start 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.029+0000 7fe4abb56700 1 -- start start 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.029+0000 7fe4abb56700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a410cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:31.650 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.029+0000 7fe4abb56700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a407ce10 con 0x7fe4a410a750 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.029+0000 7fe4a98f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a410cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.029+0000 7fe4a98f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a410cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45174/0 (socket says 172.21.15.37:45174) 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.029+0000 7fe4a98f2700 1 -- 172.21.15.37:0/1918726546 learned_addr learned my addr 172.21.15.37:0/1918726546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.029+0000 7fe4a98f2700 1 -- 172.21.15.37:0/1918726546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a410d0b0 con 0x7fe4a410a750 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.030+0000 7fe4a98f2700 1 --2- 172.21.15.37:0/1918726546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a410cb70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098a0 tx=0x7fe4a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0eed566bc5a3f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.030+0000 7fe4a88f0700 1 -- 172.21.15.37:0/1918726546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0004160 con 0x7fe4a410a750 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.030+0000 7fe4a88f0700 1 -- 172.21.15.37:0/1918726546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe4a0004300 con 0x7fe4a410a750 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.030+0000 7fe4a88f0700 1 -- 172.21.15.37:0/1918726546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0011af0 con 0x7fe4a410a750 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.031+0000 7fe4abb56700 1 -- 172.21.15.37:0/1918726546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 msgr2=0x7fe4a410cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.031+0000 7fe4abb56700 1 --2- 172.21.15.37:0/1918726546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a410cb70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098a0 tx=0x7fe4a0009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.031+0000 7fe4abb56700 1 -- 172.21.15.37:0/1918726546 shutdown_connections 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.031+0000 7fe4abb56700 1 --2- 172.21.15.37:0/1918726546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a410cb70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.031+0000 7fe4abb56700 1 -- 172.21.15.37:0/1918726546 >> 172.21.15.37:0/1918726546 conn(0x7fe4a41041d0 msgr2=0x7fe4a4106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.031+0000 7fe4abb56700 1 -- 172.21.15.37:0/1918726546 shutdown_connections 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.031+0000 7fe4abb56700 1 -- 172.21.15.37:0/1918726546 wait complete. 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.032+0000 7fe4abb56700 1 Processor -- start 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.032+0000 7fe4abb56700 1 -- start start 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.032+0000 7fe4abb56700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.032+0000 7fe4abb56700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a410dfa0 con 0x7fe4a410a750 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.032+0000 7fe4a98f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.032+0000 7fe4a98f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45186/0 (socket says 172.21.15.37:45186) 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe4a98f2700 1 -- 172.21.15.37:0/3089026432 learned_addr learned my addr 172.21.15.37:0/3089026432 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe4a98f2700 1 -- 172.21.15.37:0/3089026432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a419e580 con 0x7fe4a410a750 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe4a98f2700 1 --2- 172.21.15.37:0/3089026432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a419e040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009fb0 tx=0x7fe4a0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe49affd700 1 -- 172.21.15.37:0/3089026432 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a0011bc0 con 0x7fe4a410a750 2024-05-09T00:50:31.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe49affd700 1 -- 172.21.15.37:0/3089026432 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe4a0024440 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a419e810 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe49affd700 1 -- 172.21.15.37:0/3089026432 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4a001a5c0 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a41a1420 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.033+0000 7fe49affd700 1 -- 172.21.15.37:0/3089026432 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe4a001abc0 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.034+0000 7fe49affd700 1 -- 172.21.15.37:0/3089026432 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe4a0019700 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.034+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a4064e20 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.038+0000 7fe49affd700 1 -- 172.21.15.37:0/3089026432 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe4a002dd90 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.114+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe4a41a1640 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.114+0000 7fe49affd700 1 -- 172.21.15.37:0/3089026432 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fe4a00245f0 con 0x7fe4a410a750 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.115+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 msgr2=0x7fe4a419e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.115+0000 7fe4abb56700 1 --2- 172.21.15.37:0/3089026432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a419e040 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009fb0 tx=0x7fe4a0011890 comp rx=0 tx=0).stop 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.115+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 shutdown_connections 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.115+0000 7fe4abb56700 1 --2- 172.21.15.37:0/3089026432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a410a750 0x7fe4a419e040 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:31.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.115+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 >> 172.21.15.37:0/3089026432 conn(0x7fe4a41041d0 msgr2=0x7fe4a4105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:31.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.115+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 shutdown_connections 2024-05-09T00:50:31.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:31.115+0000 7fe4abb56700 1 -- 172.21.15.37:0/3089026432 wait complete. 2024-05-09T00:50:31.654 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-05-09T00:50:32.941 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:32.587+0000 7f57e20de200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:50:32.942 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:32.763+0000 7f57e20de200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:50:32.942 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:32.940+0000 7f57e20de200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:50:33.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:33.244+0000 7f57e20de200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:50:33.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:33.340+0000 7f57e20de200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:50:33.882 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:33.551+0000 7f57e20de200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:50:33.882 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:33.761+0000 7f57e20de200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:50:34.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:34 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3470543935' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T00:50:34.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:34 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:34.404+0000 7f57e20de200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:50:34.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-05-09T00:50:34.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T00:50:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T00:50:34.812 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T00:50:34.813 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T00:50:23.248821+0000", 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.106+0000 7f3f8cce0700 1 Processor -- start 2024-05-09T00:50:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.106+0000 7f3f8cce0700 1 -- start start 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.106+0000 7f3f8cce0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8810a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.106+0000 7f3f8cce0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8810ab00 con 0x7f3f8810a0c0 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.107+0000 7f3f8659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8810a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.107+0000 7f3f8659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8810a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46466/0 (socket says 172.21.15.37:46466) 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.107+0000 7f3f8659c700 1 -- 172.21.15.37:0/838341047 learned_addr learned my addr 172.21.15.37:0/838341047 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.107+0000 7f3f8659c700 1 -- 172.21.15.37:0/838341047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f88108dd0 con 0x7f3f8810a0c0 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.107+0000 7f3f8659c700 1 --2- 172.21.15.37:0/838341047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8810a4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f700098a0 tx=0x7f3f70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24cfc6ccf6f3088 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.107+0000 7f3f8559a700 1 -- 172.21.15.37:0/838341047 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f70004160 con 0x7f3f8810a0c0 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8559a700 1 -- 172.21.15.37:0/838341047 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3f70004300 con 0x7f3f8810a0c0 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8559a700 1 -- 172.21.15.37:0/838341047 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f70011af0 con 0x7f3f8810a0c0 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8cce0700 1 -- 172.21.15.37:0/838341047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 msgr2=0x7f3f8810a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8cce0700 1 --2- 172.21.15.37:0/838341047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8810a4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f700098a0 tx=0x7f3f70009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8cce0700 1 -- 172.21.15.37:0/838341047 shutdown_connections 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8cce0700 1 --2- 172.21.15.37:0/838341047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8810a4f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8cce0700 1 -- 172.21.15.37:0/838341047 >> 172.21.15.37:0/838341047 conn(0x7f3f881039b0 msgr2=0x7f3f88105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.108+0000 7f3f8cce0700 1 -- 172.21.15.37:0/838341047 shutdown_connections 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.109+0000 7f3f8cce0700 1 -- 172.21.15.37:0/838341047 wait complete. 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.109+0000 7f3f8cce0700 1 Processor -- start 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.109+0000 7f3f8cce0700 1 -- start start 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8cce0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8cce0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8810d190 con 0x7f3f8810a0c0 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8819d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46480/0 (socket says 172.21.15.37:46480) 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8659c700 1 -- 172.21.15.37:0/3470543935 learned_addr learned my addr 172.21.15.37:0/3470543935 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8659c700 1 -- 172.21.15.37:0/3470543935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8819d560 con 0x7f3f8810a0c0 2024-05-09T00:50:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8659c700 1 --2- 172.21.15.37:0/3470543935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8819d020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009fb0 tx=0x7f3f70011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f7f7fe700 1 -- 172.21.15.37:0/3470543935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f70011bc0 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8819d7f0 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f7f7fe700 1 -- 172.21.15.37:0/3470543935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3f70024440 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f7f7fe700 1 -- 172.21.15.37:0/3470543935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f7001a5c0 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.110+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f881a0400 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.111+0000 7f3f7f7fe700 1 -- 172.21.15.37:0/3470543935 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f7001ac10 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.111+0000 7f3f7f7fe700 1 -- 172.21.15.37:0/3470543935 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3f70019700 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.111+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f88064e20 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.114+0000 7f3f7f7fe700 1 -- 172.21.15.37:0/3470543935 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3f70033080 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.188+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3f88107cf0 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.189+0000 7f3f7f7fe700 1 -- 172.21.15.37:0/3470543935 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f3f70019900 con 0x7f3f8810a0c0 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.190+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 msgr2=0x7f3f8819d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:34.817 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.190+0000 7f3f8cce0700 1 --2- 172.21.15.37:0/3470543935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8819d020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009fb0 tx=0x7f3f70011890 comp rx=0 tx=0).stop 2024-05-09T00:50:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.190+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 shutdown_connections 2024-05-09T00:50:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.190+0000 7f3f8cce0700 1 --2- 172.21.15.37:0/3470543935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f8810a0c0 0x7f3f8819d020 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.190+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 >> 172.21.15.37:0/3470543935 conn(0x7f3f881039b0 msgr2=0x7f3f88105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.190+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 shutdown_connections 2024-05-09T00:50:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:34.190+0000 7f3f8cce0700 1 -- 172.21.15.37:0/3470543935 wait complete. 2024-05-09T00:50:34.818 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (2/15)... 2024-05-09T00:50:34.974 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:34 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:34.635+0000 7f57e20de200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T00:50:35.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:35.076+0000 7f57e20de200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:50:35.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:35.176+0000 7f57e20de200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:50:35.933 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:35.561+0000 7f57e20de200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:50:35.933 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:35.932+0000 7f57e20de200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:50:36.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:36.028+0000 7f57e20de200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:50:36.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:36.284+0000 7f57e20de200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:50:36.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:36.423+0000 7f57e20de200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:50:36.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:36.523+0000 7f57e20de200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:50:37.158 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:36.866+0000 7f57e20de200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:50:37.158 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:36.964+0000 7f57e20de200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:50:37.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:37 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3124883942' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T00:50:37.959 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:37 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:37.609+0000 7f57e20de200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:50:37.959 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:37 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:37.837+0000 7f57e20de200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:50:38.050 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:38.050 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:50:38.050 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-09T00:50:38.051 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:38.052 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:38.053 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T00:50:23.248821+0000", 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:38.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.270+0000 7fd2c5b36700 1 Processor -- start 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.271+0000 7fd2c5b36700 1 -- start start 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.271+0000 7fd2c5b36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c010cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.271+0000 7fd2c5b36700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c007ce30 con 0x7fd2c010a730 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.271+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c010cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.271+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c010cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46488/0 (socket says 172.21.15.37:46488) 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.271+0000 7fd2bf7fe700 1 -- 172.21.15.37:0/2856430000 learned_addr learned my addr 172.21.15.37:0/2856430000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.271+0000 7fd2bf7fe700 1 -- 172.21.15.37:0/2856430000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c010d090 con 0x7fd2c010a730 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.272+0000 7fd2bf7fe700 1 --2- 172.21.15.37:0/2856430000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c010cb50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00098a0 tx=0x7fd2b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab04d8bcea62008 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.272+0000 7fd2beffd700 1 -- 172.21.15.37:0/2856430000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b0004160 con 0x7fd2c010a730 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.272+0000 7fd2beffd700 1 -- 172.21.15.37:0/2856430000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd2b0004300 con 0x7fd2c010a730 2024-05-09T00:50:38.055 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.272+0000 7fd2beffd700 1 -- 172.21.15.37:0/2856430000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b0011af0 con 0x7fd2c010a730 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 -- 172.21.15.37:0/2856430000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 msgr2=0x7fd2c010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 --2- 172.21.15.37:0/2856430000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c010cb50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00098a0 tx=0x7fd2b0009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 -- 172.21.15.37:0/2856430000 shutdown_connections 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 --2- 172.21.15.37:0/2856430000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c010cb50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 -- 172.21.15.37:0/2856430000 >> 172.21.15.37:0/2856430000 conn(0x7fd2c01041d0 msgr2=0x7fd2c0106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 -- 172.21.15.37:0/2856430000 shutdown_connections 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 -- 172.21.15.37:0/2856430000 wait complete. 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.273+0000 7fd2c5b36700 1 Processor -- start 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2c5b36700 1 -- start start 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2c5b36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2c5b36700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c010df80 con 0x7fd2c010a730 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2bf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46500/0 (socket says 172.21.15.37:46500) 2024-05-09T00:50:38.056 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2bf7fe700 1 -- 172.21.15.37:0/3124883942 learned_addr learned my addr 172.21.15.37:0/3124883942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2bf7fe700 1 -- 172.21.15.37:0/3124883942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c019e560 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.274+0000 7fd2bf7fe700 1 --2- 172.21.15.37:0/3124883942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c019e020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00117b0 tx=0x7fd2b0011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.275+0000 7fd2bd7fa700 1 -- 172.21.15.37:0/3124883942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b00039c0 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.275+0000 7fd2bd7fa700 1 -- 172.21.15.37:0/3124883942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd2b0003b60 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.275+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c019e7f0 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.275+0000 7fd2bd7fa700 1 -- 172.21.15.37:0/3124883942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2b00196a0 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.275+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c01a1400 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.275+0000 7fd2bd7fa700 1 -- 172.21.15.37:0/3124883942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd2b0019ca0 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.275+0000 7fd2bd7fa700 1 -- 172.21.15.37:0/3124883942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd2b0024aa0 con 0x7fd2c010a730 2024-05-09T00:50:38.057 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.276+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c0064e20 con 0x7fd2c010a730 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.278+0000 7fd2bd7fa700 1 -- 172.21.15.37:0/3124883942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd2b00042a0 con 0x7fd2c010a730 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.353+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd2c01a15d0 con 0x7fd2c010a730 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.354+0000 7fd2bd7fa700 1 -- 172.21.15.37:0/3124883942 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fd2b0024ca0 con 0x7fd2c010a730 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.355+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 msgr2=0x7fd2c019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.355+0000 7fd2c5b36700 1 --2- 172.21.15.37:0/3124883942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c019e020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00117b0 tx=0x7fd2b0011b70 comp rx=0 tx=0).stop 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.355+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 shutdown_connections 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.355+0000 7fd2c5b36700 1 --2- 172.21.15.37:0/3124883942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c010a730 0x7fd2c019e020 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.355+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 >> 172.21.15.37:0/3124883942 conn(0x7fd2c01041d0 msgr2=0x7fd2c0105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.355+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 shutdown_connections 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:37.355+0000 7fd2c5b36700 1 -- 172.21.15.37:0/3124883942 wait complete. 2024-05-09T00:50:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (3/15)... 2024-05-09T00:50:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: Activating manager daemon x 2024-05-09T00:50:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: mgrmap e2: x(active, starting, since 0.00372571s) 2024-05-09T00:50:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:50:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:50:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:50:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:50:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T00:50:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: Manager daemon x is now available 2024-05-09T00:50:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:50:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:50:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' 2024-05-09T00:50:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' 2024-05-09T00:50:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:38 smithi037 ceph-mon[30122]: from='mgr.14100 172.21.15.37:0/355577813' entity='mgr.x' 2024-05-09T00:50:40.175 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:39 smithi037 ceph-mon[30122]: mgrmap e3: x(active, since 1.00912s) 2024-05-09T00:50:41.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:40 smithi037 ceph-mon[30122]: mgrmap e4: x(active, since 2s) 2024-05-09T00:50:41.531 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-05-09T00:50:41.532 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T00:50:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T00:50:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T00:50:41.543 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T00:50:23.248821+0000", 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.602+0000 7fb209f94700 1 Processor -- start 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.602+0000 7fb209f94700 1 -- start start 2024-05-09T00:50:41.544 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.603+0000 7fb209f94700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb204108330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.603+0000 7fb209f94700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb204108900 con 0x7fb204107f20 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.603+0000 7fb2037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb204108330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.603+0000 7fb2037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb204108330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46564/0 (socket says 172.21.15.37:46564) 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.603+0000 7fb2037fe700 1 -- 172.21.15.37:0/2944126683 learned_addr learned my addr 172.21.15.37:0/2944126683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.603+0000 7fb2037fe700 1 -- 172.21.15.37:0/2944126683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20410af20 con 0x7fb204107f20 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.603+0000 7fb2037fe700 1 --2- 172.21.15.37:0/2944126683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb204108330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40098a0 tx=0x7fb1f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f52fa20c3fcfb63 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.604+0000 7fb2027fc700 1 -- 172.21.15.37:0/2944126683 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f4004160 con 0x7fb204107f20 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.604+0000 7fb2027fc700 1 -- 172.21.15.37:0/2944126683 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb1f4004300 con 0x7fb204107f20 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.604+0000 7fb2027fc700 1 -- 172.21.15.37:0/2944126683 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f4011af0 con 0x7fb204107f20 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.604+0000 7fb209f94700 1 -- 172.21.15.37:0/2944126683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 msgr2=0x7fb204108330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.604+0000 7fb209f94700 1 --2- 172.21.15.37:0/2944126683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb204108330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40098a0 tx=0x7fb1f4009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.605+0000 7fb209f94700 1 -- 172.21.15.37:0/2944126683 shutdown_connections 2024-05-09T00:50:41.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.605+0000 7fb209f94700 1 --2- 172.21.15.37:0/2944126683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb204108330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.605+0000 7fb209f94700 1 -- 172.21.15.37:0/2944126683 >> 172.21.15.37:0/2944126683 conn(0x7fb204103910 msgr2=0x7fb204105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.605+0000 7fb209f94700 1 -- 172.21.15.37:0/2944126683 shutdown_connections 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.605+0000 7fb209f94700 1 -- 172.21.15.37:0/2944126683 wait complete. 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.605+0000 7fb209f94700 1 Processor -- start 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.605+0000 7fb209f94700 1 -- start start 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb209f94700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb20410a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb209f94700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb20410bdb0 con 0x7fb204107f20 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb2037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb20410a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb2037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb20410a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46578/0 (socket says 172.21.15.37:46578) 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb2037fe700 1 -- 172.21.15.37:0/1340874811 learned_addr learned my addr 172.21.15.37:0/1340874811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb2037fe700 1 -- 172.21.15.37:0/1340874811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20410abe0 con 0x7fb204107f20 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb2037fe700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb20410a6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40090e0 tx=0x7fb1f4011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb200ff9700 1 -- 172.21.15.37:0/1340874811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f40039e0 con 0x7fb204107f20 2024-05-09T00:50:41.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb200ff9700 1 -- 172.21.15.37:0/1340874811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb1f4003b80 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.606+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb204108e30 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.607+0000 7fb200ff9700 1 -- 172.21.15.37:0/1340874811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f40246e0 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.607+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb204109310 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.608+0000 7fb200ff9700 1 -- 172.21.15.37:0/1340874811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fb1f4022020 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.608+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb204064e20 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.608+0000 7fb200ff9700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fb1ec03e470 0x7fb1ec040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.608+0000 7fb200ff9700 1 -- 172.21.15.37:0/1340874811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb1f4053430 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.608+0000 7fb202ffd700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fb1ec03e470 0x7fb1ec040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.608+0000 7fb202ffd700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fb1ec03e470 0x7fb1ec040980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8006fd0 tx=0x7fb1f8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.614+0000 7fb200ff9700 1 -- 172.21.15.37:0/1340874811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb1f40172b0 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.916+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb204197890 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.917+0000 7fb200ff9700 1 -- 172.21.15.37:0/1340874811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fb1f400fdd0 con 0x7fb204107f20 2024-05-09T00:50:41.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fb1ec03e470 msgr2=0x7fb1ec040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fb1ec03e470 0x7fb1ec040980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8006fd0 tx=0x7fb1f8006e40 comp rx=0 tx=0).stop 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 msgr2=0x7fb20410a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb20410a6a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40090e0 tx=0x7fb1f4011940 comp rx=0 tx=0).stop 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 shutdown_connections 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fb1ec03e470 0x7fb1ec040980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 --2- 172.21.15.37:0/1340874811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204107f20 0x7fb20410a6a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 >> 172.21.15.37:0/1340874811 conn(0x7fb204103910 msgr2=0x7fb2041043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 shutdown_connections 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:40.919+0000 7fb209f94700 1 -- 172.21.15.37:0/1340874811 wait complete. 2024-05-09T00:50:41.548 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-05-09T00:50:41.963 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:41 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1340874811' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T00:50:42.756 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T00:50:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-09T00:50:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T00:50:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T00:50:42.757 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T00:50:42.758 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T00:50:42.758 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:42.758 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T00:50:42.758 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T00:50:42.758 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-05-09T00:50:42.758 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T00:50:42.758 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.001+0000 7fda2c0bc700 1 Processor -- start 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.001+0000 7fda2c0bc700 1 -- start start 2024-05-09T00:50:42.759 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda2c0bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda24108970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda2c0bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda2407cdf0 con 0x7fda24108560 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda29e58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda24108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda29e58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda24108970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59694/0 (socket says 172.21.15.37:59694) 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda29e58700 1 -- 172.21.15.37:0/3522852579 learned_addr learned my addr 172.21.15.37:0/3522852579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda29e58700 1 -- 172.21.15.37:0/3522852579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda24108eb0 con 0x7fda24108560 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda29e58700 1 --2- 172.21.15.37:0/3522852579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda24108970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda200098a0 tx=0x7fda20009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b320eb299fe46b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.002+0000 7fda28e56700 1 -- 172.21.15.37:0/3522852579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda20004160 con 0x7fda24108560 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda28e56700 1 -- 172.21.15.37:0/3522852579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fda20004300 con 0x7fda24108560 2024-05-09T00:50:42.760 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda28e56700 1 -- 172.21.15.37:0/3522852579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda20011af0 con 0x7fda24108560 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3522852579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 msgr2=0x7fda24108970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda2c0bc700 1 --2- 172.21.15.37:0/3522852579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda24108970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda200098a0 tx=0x7fda20009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3522852579 shutdown_connections 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda2c0bc700 1 --2- 172.21.15.37:0/3522852579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda24108970 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3522852579 >> 172.21.15.37:0/3522852579 conn(0x7fda241041d0 msgr2=0x7fda24106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3522852579 shutdown_connections 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.003+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3522852579 wait complete. 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.004+0000 7fda2c0bc700 1 Processor -- start 2024-05-09T00:50:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.004+0000 7fda2c0bc700 1 -- start start 2024-05-09T00:50:42.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.004+0000 7fda2c0bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda241a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:42.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.004+0000 7fda2c0bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda24109ec0 con 0x7fda24108560 2024-05-09T00:50:42.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.004+0000 7fda29e58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda241a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:42.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.004+0000 7fda29e58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda241a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59708/0 (socket says 172.21.15.37:59708) 2024-05-09T00:50:42.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.004+0000 7fda29e58700 1 -- 172.21.15.37:0/3054632799 learned_addr learned my addr 172.21.15.37:0/3054632799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:42.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.005+0000 7fda29e58700 1 -- 172.21.15.37:0/3054632799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda241a0760 con 0x7fda24108560 2024-05-09T00:50:42.762 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.005+0000 7fda29e58700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda241a0220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fb0 tx=0x7fda20011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:42.763 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.005+0000 7fda1affd700 1 -- 172.21.15.37:0/3054632799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda20011bc0 con 0x7fda24108560 2024-05-09T00:50:42.763 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.005+0000 7fda1affd700 1 -- 172.21.15.37:0/3054632799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fda20024440 con 0x7fda24108560 2024-05-09T00:50:42.763 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.005+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda241a09f0 con 0x7fda24108560 2024-05-09T00:50:42.763 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.005+0000 7fda1affd700 1 -- 172.21.15.37:0/3054632799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda2001a5c0 con 0x7fda24108560 2024-05-09T00:50:42.763 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.005+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda241a3600 con 0x7fda24108560 2024-05-09T00:50:42.763 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.006+0000 7fda1affd700 1 -- 172.21.15.37:0/3054632799 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fda2001a830 con 0x7fda24108560 2024-05-09T00:50:42.763 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.006+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda24064e20 con 0x7fda24108560 2024-05-09T00:50:42.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.006+0000 7fda1affd700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fda1003e420 0x7fda10040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:42.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.006+0000 7fda1affd700 1 -- 172.21.15.37:0/3054632799 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fda20053850 con 0x7fda24108560 2024-05-09T00:50:42.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.007+0000 7fda29657700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fda1003e420 0x7fda10040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:42.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.007+0000 7fda29657700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fda1003e420 0x7fda10040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda14006fd0 tx=0x7fda14006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:42.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.012+0000 7fda1affd700 1 -- 172.21.15.37:0/3054632799 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fda2000b3e0 con 0x7fda24108560 2024-05-09T00:50:42.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.226+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fda2402e930 con 0x7fda24108560 2024-05-09T00:50:42.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.228+0000 7fda1affd700 1 -- 172.21.15.37:0/3054632799 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+436 (secure 0 0 0) 0x7fda200246f0 con 0x7fda24108560 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fda1003e420 msgr2=0x7fda10040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fda1003e420 0x7fda10040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda14006fd0 tx=0x7fda14006e40 comp rx=0 tx=0).stop 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 msgr2=0x7fda241a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda241a0220 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fda20009fb0 tx=0x7fda20011890 comp rx=0 tx=0).stop 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 shutdown_connections 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fda1003e420 0x7fda10040930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 --2- 172.21.15.37:0/3054632799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda24108560 0x7fda241a0220 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:42.765 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 >> 172.21.15.37:0/3054632799 conn(0x7fda241041d0 msgr2=0x7fda24194230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:42.766 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 shutdown_connections 2024-05-09T00:50:42.766 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:42.230+0000 7fda2c0bc700 1 -- 172.21.15.37:0/3054632799 wait complete. 2024-05-09T00:50:42.766 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-05-09T00:50:43.161 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:42 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3054632799' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T00:50:44.164 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:43 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3085856232' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-09T00:50:44.164 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: ignoring --setuser ceph since I am not root 2024-05-09T00:50:44.165 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: ignoring --setgroup ceph since I am not root 2024-05-09T00:50:44.165 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:44.063+0000 7fbb12ae1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:50:44.473 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:44.259+0000 7fbb12ae1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:50:44.473 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:44.366+0000 7fbb12ae1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:50:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.204+0000 7f3b98211700 1 Processor -- start 2024-05-09T00:50:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.204+0000 7f3b98211700 1 -- start start 2024-05-09T00:50:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.204+0000 7f3b98211700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b9010cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.204+0000 7f3b98211700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9007d700 con 0x7f3b9010a6f0 2024-05-09T00:50:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b95fad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b9010cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b95fad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b9010cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59714/0 (socket says 172.21.15.37:59714) 2024-05-09T00:50:44.481 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b95fad700 1 -- 172.21.15.37:0/2395653315 learned_addr learned my addr 172.21.15.37:0/2395653315 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b95fad700 1 -- 172.21.15.37:0/2395653315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9010d050 con 0x7f3b9010a6f0 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b95fad700 1 --2- 172.21.15.37:0/2395653315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b9010cb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0098a0 tx=0x7f3b8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406eee41e3fdac1f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b94fab700 1 -- 172.21.15.37:0/2395653315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c004160 con 0x7f3b9010a6f0 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b94fab700 1 -- 172.21.15.37:0/2395653315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3b8c004300 con 0x7f3b9010a6f0 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.205+0000 7f3b94fab700 1 -- 172.21.15.37:0/2395653315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c011af0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.206+0000 7f3b98211700 1 -- 172.21.15.37:0/2395653315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 msgr2=0x7f3b9010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.206+0000 7f3b98211700 1 --2- 172.21.15.37:0/2395653315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b9010cb10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0098a0 tx=0x7f3b8c009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.206+0000 7f3b98211700 1 -- 172.21.15.37:0/2395653315 shutdown_connections 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.206+0000 7f3b98211700 1 --2- 172.21.15.37:0/2395653315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b9010cb10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.206+0000 7f3b98211700 1 -- 172.21.15.37:0/2395653315 >> 172.21.15.37:0/2395653315 conn(0x7f3b901041d0 msgr2=0x7f3b90106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.206+0000 7f3b98211700 1 -- 172.21.15.37:0/2395653315 shutdown_connections 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.206+0000 7f3b98211700 1 -- 172.21.15.37:0/2395653315 wait complete. 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.207+0000 7f3b98211700 1 Processor -- start 2024-05-09T00:50:44.482 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.207+0000 7f3b98211700 1 -- start start 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.207+0000 7f3b98211700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b90109e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.207+0000 7f3b98211700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9010e010 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.207+0000 7f3b95fad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b90109e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.207+0000 7f3b95fad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b90109e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59728/0 (socket says 172.21.15.37:59728) 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.207+0000 7f3b95fad700 1 -- 172.21.15.37:0/3085856232 learned_addr learned my addr 172.21.15.37:0/3085856232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.208+0000 7f3b95fad700 1 -- 172.21.15.37:0/3085856232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9010a3b0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.208+0000 7f3b95fad700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b90109e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009fb0 tx=0x7f3b8c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.208+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c011bc0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.208+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3b8c024440 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.208+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b90108600 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.208+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b8c01a5c0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.208+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b90108ae0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.209+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f3b8c01a830 con 0x7f3b9010a6f0 2024-05-09T00:50:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.209+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b90064e20 con 0x7f3b9010a6f0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.209+0000 7f3b86ffd700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f3b7c03e470 0x7f3b7c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.209+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3b8c0539a0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.210+0000 7f3b957ac700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f3b7c03e470 0x7f3b7c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.210+0000 7f3b957ac700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f3b7c03e470 0x7f3b7c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006fd0 tx=0x7f3b80006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.215+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3b8c00b3e0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.494+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f3b90109260 con 0x7f3b9010a6f0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.854+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f3b8c021d00 con 0x7f3b9010a6f0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.856+0000 7f3b86ffd700 1 -- 172.21.15.37:0/3085856232 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f3b8c0245f0 con 0x7f3b9010a6f0 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f3b7c03e470 msgr2=0x7f3b7c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f3b7c03e470 0x7f3b7c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006fd0 tx=0x7f3b80006e40 comp rx=0 tx=0).stop 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 msgr2=0x7f3b90109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b90109e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009fb0 tx=0x7f3b8c011890 comp rx=0 tx=0).stop 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 shutdown_connections 2024-05-09T00:50:44.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f3b7c03e470 0x7f3b7c040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:44.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 --2- 172.21.15.37:0/3085856232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9010a6f0 0x7f3b90109e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:44.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 >> 172.21.15.37:0/3085856232 conn(0x7f3b901041d0 msgr2=0x7f3b90105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:44.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 shutdown_connections 2024-05-09T00:50:44.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:43.857+0000 7f3b98211700 1 -- 172.21.15.37:0/3085856232 wait complete. 2024-05-09T00:50:44.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:44.702+0000 7fbb12ae1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:50:45.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:44 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3085856232' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-09T00:50:45.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:44 smithi037 ceph-mon[30122]: mgrmap e5: x(active, since 6s) 2024-05-09T00:50:45.011 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:44.797+0000 7fbb12ae1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:50:45.890 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:45 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2268742312' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.949+0000 7f5209151700 1 Processor -- start 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.949+0000 7f5209151700 1 -- start start 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.949+0000 7f5209151700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f5204108990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.949+0000 7f5209151700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f520407cdd0 con 0x7f5204108580 2024-05-09T00:50:45.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.949+0000 7f5202d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f5204108990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.949+0000 7f5202d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f5204108990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59744/0 (socket says 172.21.15.37:59744) 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.949+0000 7f5202d9d700 1 -- 172.21.15.37:0/3213595217 learned_addr learned my addr 172.21.15.37:0/3213595217 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.950+0000 7f5202d9d700 1 -- 172.21.15.37:0/3213595217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5204108ed0 con 0x7f5204108580 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.950+0000 7f5202d9d700 1 --2- 172.21.15.37:0/3213595217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f5204108990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f51f40098a0 tx=0x7f51f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e957aa914faf4fe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.950+0000 7f5201d9b700 1 -- 172.21.15.37:0/3213595217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51f4004160 con 0x7f5204108580 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.950+0000 7f5201d9b700 1 -- 172.21.15.37:0/3213595217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f51f4004300 con 0x7f5204108580 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.950+0000 7f5201d9b700 1 -- 172.21.15.37:0/3213595217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51f4011af0 con 0x7f5204108580 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.951+0000 7f5209151700 1 -- 172.21.15.37:0/3213595217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 msgr2=0x7f5204108990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.951+0000 7f5209151700 1 --2- 172.21.15.37:0/3213595217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f5204108990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f51f40098a0 tx=0x7f51f4009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.951+0000 7f5209151700 1 -- 172.21.15.37:0/3213595217 shutdown_connections 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.951+0000 7f5209151700 1 --2- 172.21.15.37:0/3213595217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f5204108990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.951+0000 7f5209151700 1 -- 172.21.15.37:0/3213595217 >> 172.21.15.37:0/3213595217 conn(0x7f52041041d0 msgr2=0x7f5204106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:45.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.951+0000 7f5209151700 1 -- 172.21.15.37:0/3213595217 shutdown_connections 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.951+0000 7f5209151700 1 -- 172.21.15.37:0/3213595217 wait complete. 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.952+0000 7f5209151700 1 Processor -- start 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.952+0000 7f5209151700 1 -- start start 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.952+0000 7f5209151700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f52041a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.952+0000 7f5209151700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5204109d60 con 0x7f5204108580 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f5202d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f52041a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f5202d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f52041a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59752/0 (socket says 172.21.15.37:59752) 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f5202d9d700 1 -- 172.21.15.37:0/2268742312 learned_addr learned my addr 172.21.15.37:0/2268742312 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f5202d9d700 1 -- 172.21.15.37:0/2268742312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52041a0780 con 0x7f5204108580 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f5202d9d700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f52041a0240 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51f40117b0 tx=0x7f51f4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f51ebfff700 1 -- 172.21.15.37:0/2268742312 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51f40039c0 con 0x7f5204108580 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f51ebfff700 1 -- 172.21.15.37:0/2268742312 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f51f4003b60 con 0x7f5204108580 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.953+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52041a0a10 con 0x7f5204108580 2024-05-09T00:50:45.900 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.954+0000 7f51ebfff700 1 -- 172.21.15.37:0/2268742312 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51f40196a0 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.954+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52041a3620 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.955+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5204064e20 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.955+0000 7f51ebfff700 1 -- 172.21.15.37:0/2268742312 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f51f4019910 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.955+0000 7f51ebfff700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 0x7f51ec0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.955+0000 7f51ebfff700 1 -- 172.21.15.37:0/2268742312 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f51f4053bf0 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.955+0000 7f520259c700 1 -- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 msgr2=0x7f51ec0409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1416845590 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.955+0000 7f520259c700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 0x7f51ec0409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:44.965+0000 7f51ebfff700 1 -- 172.21.15.37:0/2268742312 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f51f400b3e0 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.156+0000 7f520259c700 1 -- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 msgr2=0x7f51ec0409d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1416845590 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.156+0000 7f520259c700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 0x7f51ec0409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.290+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f520402e8f0 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.290+0000 7f51ebfff700 1 -- 172.21.15.37:0/2268742312 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f51f4020e20 con 0x7f5204108580 2024-05-09T00:50:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 msgr2=0x7f51ec0409d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 0x7f51ec0409d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 msgr2=0x7f52041a0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f52041a0240 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51f40117b0 tx=0x7f51f4011b70 comp rx=0 tx=0).stop 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 shutdown_connections 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7f51ec03e4c0 0x7f51ec0409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 --2- 172.21.15.37:0/2268742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5204108580 0x7f52041a0240 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 >> 172.21.15.37:0/2268742312 conn(0x7f52041041d0 msgr2=0x7f5204194250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 shutdown_connections 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:45.293+0000 7f5209151700 1 -- 172.21.15.37:0/2268742312 wait complete. 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-05-09T00:50:45.902 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-05-09T00:50:46.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:46.099+0000 7fbb12ae1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:50:46.550 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:46.286+0000 7fbb12ae1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:50:46.550 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:46.467+0000 7fbb12ae1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:50:46.871 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:46.772+0000 7fbb12ae1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:50:46.871 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:46.870+0000 7fbb12ae1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:50:47.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:47.083+0000 7fbb12ae1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:50:47.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:47.286+0000 7fbb12ae1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:50:48.154 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:47.920+0000 7fbb12ae1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:50:48.154 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:48.153+0000 7fbb12ae1200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T00:50:48.974 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:48.598+0000 7fbb12ae1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:50:48.974 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:48.700+0000 7fbb12ae1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:50:49.354 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:49.089+0000 7fbb12ae1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:50:49.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:49.466+0000 7fbb12ae1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:50:49.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:49.563+0000 7fbb12ae1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:50:50.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:49.823+0000 7fbb12ae1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:50:50.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:49.964+0000 7fbb12ae1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:50:50.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:50 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:50.065+0000 7fbb12ae1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:50:50.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:50 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:50.413+0000 7fbb12ae1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:50:50.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:50 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:50.511+0000 7fbb12ae1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:50:51.429 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:51 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:51.146+0000 7fbb12ae1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:50:51.429 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:51 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:50:51.374+0000 7fbb12ae1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:50:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: Active manager daemon x restarted 2024-05-09T00:50:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: Activating manager daemon x 2024-05-09T00:50:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: osdmap e2: 0 total, 0 up, 0 in 2024-05-09T00:50:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: mgrmap e6: x(active, starting, since 0.00374335s) 2024-05-09T00:50:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:50:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: Manager daemon x is now available 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:50:51.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:51 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:50:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:52 smithi037 ceph-mon[30122]: Found migration_current of "None". Setting to last migration. 2024-05-09T00:50:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:52 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:50:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:52 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:50:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:52 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:50:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:52 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:50:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:52 smithi037 ceph-mon[30122]: mgrmap e7: x(active, since 1.00622s) 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc19e7b700 1 Processor -- start 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc19e7b700 1 -- start start 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc19e7b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc14109ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc19e7b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1410a5e0 con 0x7fcc14109be0 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc14109ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:52.956 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc14109ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59764/0 (socket says 172.21.15.37:59764) 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc137fe700 1 -- 172.21.15.37:0/3742533288 learned_addr learned my addr 172.21.15.37:0/3742533288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.342+0000 7fcc137fe700 1 -- 172.21.15.37:0/3742533288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1410adb0 con 0x7fcc14109be0 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.343+0000 7fcc137fe700 1 --2- 172.21.15.37:0/3742533288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc14109ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0098a0 tx=0x7fcbfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93064480b514415 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.343+0000 7fcc127fc700 1 -- 172.21.15.37:0/3742533288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbfc004160 con 0x7fcc14109be0 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.343+0000 7fcc127fc700 1 -- 172.21.15.37:0/3742533288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcbfc004300 con 0x7fcc14109be0 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.343+0000 7fcc127fc700 1 -- 172.21.15.37:0/3742533288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbfc011af0 con 0x7fcc14109be0 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.344+0000 7fcc19e7b700 1 -- 172.21.15.37:0/3742533288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 msgr2=0x7fcc14109ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.344+0000 7fcc19e7b700 1 --2- 172.21.15.37:0/3742533288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc14109ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0098a0 tx=0x7fcbfc009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.344+0000 7fcc19e7b700 1 -- 172.21.15.37:0/3742533288 shutdown_connections 2024-05-09T00:50:52.957 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.344+0000 7fcc19e7b700 1 --2- 172.21.15.37:0/3742533288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc14109ff0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.344+0000 7fcc19e7b700 1 -- 172.21.15.37:0/3742533288 >> 172.21.15.37:0/3742533288 conn(0x7fcc14105260 msgr2=0x7fcc141076d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.344+0000 7fcc19e7b700 1 -- 172.21.15.37:0/3742533288 shutdown_connections 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.344+0000 7fcc19e7b700 1 -- 172.21.15.37:0/3742533288 wait complete. 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.345+0000 7fcc19e7b700 1 Processor -- start 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.345+0000 7fcc19e7b700 1 -- start start 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.345+0000 7fcc19e7b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc1419e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.345+0000 7fcc19e7b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1410e160 con 0x7fcc14109be0 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.345+0000 7fcc137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc1419e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.345+0000 7fcc137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc1419e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59774/0 (socket says 172.21.15.37:59774) 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.345+0000 7fcc137fe700 1 -- 172.21.15.37:0/134786871 learned_addr learned my addr 172.21.15.37:0/134786871 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.346+0000 7fcc137fe700 1 -- 172.21.15.37:0/134786871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1419e5e0 con 0x7fcc14109be0 2024-05-09T00:50:52.958 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.346+0000 7fcc137fe700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc1419e0a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc011670 tx=0x7fcbfc004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.346+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbfc0036a0 con 0x7fcc14109be0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.346+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcbfc003cd0 con 0x7fcc14109be0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.346+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1419e870 con 0x7fcc14109be0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.346+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbfc0193c0 con 0x7fcc14109be0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.346+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc141a1480 con 0x7fcc14109be0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.347+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fcbfc019680 con 0x7fcc14109be0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.347+0000 7fcc10ff9700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.347+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 --> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcc00041040 con 0x7fcc0003e420 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.347+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcbfc053890 con 0x7fcc14109be0 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.347+0000 7fcc12ffd700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 msgr2=0x7fcc00040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1416845590 2024-05-09T00:50:52.959 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.348+0000 7fcc12ffd700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.549+0000 7fcc12ffd700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 msgr2=0x7fcc00040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1416845590 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.549+0000 7fcc12ffd700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.950+0000 7fcc12ffd700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 msgr2=0x7fcc00040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1416845590 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:46.950+0000 7fcc12ffd700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:47.751+0000 7fcc12ffd700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 msgr2=0x7fcc00040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1416845590 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:47.751+0000 7fcc12ffd700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:49.352+0000 7fcc12ffd700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 msgr2=0x7fcc00040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1416845590 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:49.352+0000 7fcc12ffd700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:51.378+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7fcbfc0199c0 con 0x7fcc14109be0 2024-05-09T00:50:52.960 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:51.379+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 msgr2=0x7fcc00040930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:51.379+0000 7fcc10ff9700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.380+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7fcbfc01a6c0 con 0x7fcc14109be0 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.380+0000 7fcc10ff9700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fcc00041d60 0x7fcc00044180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.380+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcbfc008ec0 con 0x7fcc00041d60 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.380+0000 7fcc12ffd700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fcc00041d60 0x7fcc00044180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.381+0000 7fcc12ffd700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fcc00041d60 0x7fcc00044180 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcc04003a10 tx=0x7fcc04009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.382+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fcbfc008ec0 con 0x7fcc00041d60 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.390+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fcc14064e20 con 0x7fcc00041d60 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.390+0000 7fcc10ff9700 1 -- 172.21.15.37:0/134786871 <== mgr.14120 v2:172.21.15.37:6800/1512065281 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fcc14064e20 con 0x7fcc00041d60 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.390+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fcc00041d60 msgr2=0x7fcc00044180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.390+0000 7fcc19e7b700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fcc00041d60 0x7fcc00044180 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcc04003a10 tx=0x7fcc04009290 comp rx=0 tx=0).stop 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.390+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 msgr2=0x7fcc1419e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.390+0000 7fcc19e7b700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc1419e0a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc011670 tx=0x7fcbfc004280 comp rx=0 tx=0).stop 2024-05-09T00:50:52.961 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.391+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 shutdown_connections 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.391+0000 7fcc19e7b700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fcc00041d60 0x7fcc00044180 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.391+0000 7fcc19e7b700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc14109be0 0x7fcc1419e0a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.391+0000 7fcc19e7b700 1 --2- 172.21.15.37:0/134786871 >> [v2:172.21.15.37:6800/1416845590,v1:172.21.15.37:6801/1416845590] conn(0x7fcc0003e420 0x7fcc00040930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.391+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 >> 172.21.15.37:0/134786871 conn(0x7fcc14105260 msgr2=0x7fcc14105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.391+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 shutdown_connections 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:52.391+0000 7fcc19e7b700 1 -- 172.21.15.37:0/134786871 wait complete. 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-05-09T00:50:52.962 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-05-09T00:50:53.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:53 smithi037 ceph-mon[30122]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-09T00:50:53.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:53 smithi037 ceph-mon[30122]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-09T00:50:53.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:53 smithi037 ceph-mon[30122]: [09/May/2024:00:50:52] ENGINE Bus STARTING 2024-05-09T00:50:53.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:53 smithi037 ceph-mon[30122]: [09/May/2024:00:50:52] ENGINE Serving on http://172.21.15.37:8765 2024-05-09T00:50:53.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:53 smithi037 ceph-mon[30122]: [09/May/2024:00:50:52] ENGINE Serving on https://172.21.15.37:7150 2024-05-09T00:50:53.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:53 smithi037 ceph-mon[30122]: [09/May/2024:00:50:52] ENGINE Bus STARTED 2024-05-09T00:50:53.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:53 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:50:54.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.372+0000 7f0fd038c700 1 Processor -- start 2024-05-09T00:50:54.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.372+0000 7f0fd038c700 1 -- start start 2024-05-09T00:50:54.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.372+0000 7f0fd038c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc8108f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:54.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.372+0000 7f0fd038c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8109510 con 0x7f0fc8108b10 2024-05-09T00:50:54.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.372+0000 7f0fce128700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc8108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:54.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.372+0000 7f0fce128700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc8108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46854/0 (socket says 172.21.15.37:46854) 2024-05-09T00:50:54.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.372+0000 7f0fce128700 1 -- 172.21.15.37:0/1112890444 learned_addr learned my addr 172.21.15.37:0/1112890444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:54.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.373+0000 7f0fce128700 1 -- 172.21.15.37:0/1112890444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc8109ce0 con 0x7f0fc8108b10 2024-05-09T00:50:54.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.373+0000 7f0fce128700 1 --2- 172.21.15.37:0/1112890444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc8108f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40098a0 tx=0x7f0fc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb420c18cd51f3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:54.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.373+0000 7f0fcd126700 1 -- 172.21.15.37:0/1112890444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc4004160 con 0x7f0fc8108b10 2024-05-09T00:50:54.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.373+0000 7f0fcd126700 1 -- 172.21.15.37:0/1112890444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0fc4004300 con 0x7f0fc8108b10 2024-05-09T00:50:54.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.373+0000 7f0fcd126700 1 -- 172.21.15.37:0/1112890444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc4011af0 con 0x7f0fc8108b10 2024-05-09T00:50:54.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.374+0000 7f0fd038c700 1 -- 172.21.15.37:0/1112890444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 msgr2=0x7f0fc8108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:54.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.374+0000 7f0fd038c700 1 --2- 172.21.15.37:0/1112890444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc8108f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40098a0 tx=0x7f0fc4009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:54.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.374+0000 7f0fd038c700 1 -- 172.21.15.37:0/1112890444 shutdown_connections 2024-05-09T00:50:54.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.374+0000 7f0fd038c700 1 --2- 172.21.15.37:0/1112890444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc8108f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:54.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.374+0000 7f0fd038c700 1 -- 172.21.15.37:0/1112890444 >> 172.21.15.37:0/1112890444 conn(0x7f0fc81041d0 msgr2=0x7f0fc8106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:54.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.374+0000 7f0fd038c700 1 -- 172.21.15.37:0/1112890444 shutdown_connections 2024-05-09T00:50:54.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.374+0000 7f0fd038c700 1 -- 172.21.15.37:0/1112890444 wait complete. 2024-05-09T00:50:54.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fd038c700 1 Processor -- start 2024-05-09T00:50:54.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fd038c700 1 -- start start 2024-05-09T00:50:54.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fd038c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:54.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fd038c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc810d090 con 0x7f0fc8108b10 2024-05-09T00:50:54.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fce128700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:54.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fce128700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc819cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46866/0 (socket says 172.21.15.37:46866) 2024-05-09T00:50:54.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fce128700 1 -- 172.21.15.37:0/4236473389 learned_addr learned my addr 172.21.15.37:0/4236473389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:54.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.375+0000 7f0fce128700 1 -- 172.21.15.37:0/4236473389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc819d4f0 con 0x7f0fc8108b10 2024-05-09T00:50:54.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.376+0000 7f0fce128700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc819cfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4011670 tx=0x7f0fc4004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:54.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.376+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc40036a0 con 0x7f0fc8108b10 2024-05-09T00:50:54.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.376+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0fc4003cd0 con 0x7f0fc8108b10 2024-05-09T00:50:54.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.376+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0fc40193c0 con 0x7f0fc8108b10 2024-05-09T00:50:54.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.376+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc819d780 con 0x7f0fc8108b10 2024-05-09T00:50:54.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.376+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc81a0390 con 0x7f0fc8108b10 2024-05-09T00:50:54.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.377+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f0fc4019630 con 0x7f0fc8108b10 2024-05-09T00:50:54.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.377+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc8064e20 con 0x7f0fc8108b10 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.377+0000 7f0fbf7fe700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f0fb403e360 0x7f0fb4040870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.377+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0fc40544e0 con 0x7f0fc8108b10 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.377+0000 7f0fcd927700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f0fb403e360 0x7f0fb4040870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.378+0000 7f0fcd927700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f0fb403e360 0x7f0fb4040870 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8006fd0 tx=0x7f0fb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.383+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0fc4017e90 con 0x7f0fc8108b10 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.432+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f0fc400fd70 con 0x7f0fc8108b10 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.621+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f0fc81061e0 con 0x7f0fb403e360 2024-05-09T00:50:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.626+0000 7f0fbf7fe700 1 -- 172.21.15.37:0/4236473389 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0fc81061e0 con 0x7f0fb403e360 2024-05-09T00:50:54.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f0fb403e360 msgr2=0x7f0fb4040870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:54.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f0fb403e360 0x7f0fb4040870 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8006fd0 tx=0x7f0fb8006e40 comp rx=0 tx=0).stop 2024-05-09T00:50:54.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 msgr2=0x7f0fc819cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:54.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc819cfb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4011670 tx=0x7f0fc4004280 comp rx=0 tx=0).stop 2024-05-09T00:50:54.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 shutdown_connections 2024-05-09T00:50:54.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f0fb403e360 0x7f0fb4040870 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:54.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 --2- 172.21.15.37:0/4236473389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fc8108b10 0x7f0fc819cfb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:54.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 >> 172.21.15.37:0/4236473389 conn(0x7f0fc81041d0 msgr2=0x7f0fc8105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:54.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 shutdown_connections 2024-05-09T00:50:54.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:53.629+0000 7f0fd038c700 1 -- 172.21.15.37:0/4236473389 wait complete. 2024-05-09T00:50:54.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:54 smithi037 ceph-mon[30122]: mgrmap e8: x(active, since 2s) 2024-05-09T00:50:54.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:54 smithi037 ceph-mon[30122]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:50:54.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:54 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:50:54.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:54 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:50:55.481 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:55 smithi037 ceph-mon[30122]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:50:55.490 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.699+0000 7f581d79b700 1 Processor -- start 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.699+0000 7f581d79b700 1 -- start start 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.699+0000 7f581d79b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f581810cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.699+0000 7f581d79b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f581807ce70 con 0x7f581810a6f0 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f581810cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f581810cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46880/0 (socket says 172.21.15.37:46880) 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5816ffd700 1 -- 172.21.15.37:0/2038372039 learned_addr learned my addr 172.21.15.37:0/2038372039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5816ffd700 1 -- 172.21.15.37:0/2038372039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581810d050 con 0x7f581810a6f0 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5816ffd700 1 --2- 172.21.15.37:0/2038372039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f581810cb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5808009e80 tx=0x7f580800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa31887d0b2c26e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5815ffb700 1 -- 172.21.15.37:0/2038372039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808017070 con 0x7f581810a6f0 2024-05-09T00:50:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5815ffb700 1 -- 172.21.15.37:0/2038372039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f580800b8c0 con 0x7f581810a6f0 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.700+0000 7f5815ffb700 1 -- 172.21.15.37:0/2038372039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808004490 con 0x7f581810a6f0 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.701+0000 7f581d79b700 1 -- 172.21.15.37:0/2038372039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 msgr2=0x7f581810cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.701+0000 7f581d79b700 1 --2- 172.21.15.37:0/2038372039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f581810cb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5808009e80 tx=0x7f580800b330 comp rx=0 tx=0).stop 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.701+0000 7f581d79b700 1 -- 172.21.15.37:0/2038372039 shutdown_connections 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.701+0000 7f581d79b700 1 --2- 172.21.15.37:0/2038372039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f581810cb10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.701+0000 7f581d79b700 1 -- 172.21.15.37:0/2038372039 >> 172.21.15.37:0/2038372039 conn(0x7f58181041d0 msgr2=0x7f5818106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.701+0000 7f581d79b700 1 -- 172.21.15.37:0/2038372039 shutdown_connections 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.701+0000 7f581d79b700 1 -- 172.21.15.37:0/2038372039 wait complete. 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.702+0000 7f581d79b700 1 Processor -- start 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.702+0000 7f581d79b700 1 -- start start 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.702+0000 7f581d79b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f5818109e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.702+0000 7f581d79b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f581810dfa0 con 0x7f581810a6f0 2024-05-09T00:50:55.492 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.702+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f5818109e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.702+0000 7f5816ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f5818109e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46884/0 (socket says 172.21.15.37:46884) 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.702+0000 7f5816ffd700 1 -- 172.21.15.37:0/4231151159 learned_addr learned my addr 172.21.15.37:0/4231151159 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.703+0000 7f5816ffd700 1 -- 172.21.15.37:0/4231151159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581810a3b0 con 0x7f581810a6f0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.703+0000 7f5816ffd700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f5818109e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f580800b7b0 tx=0x7f580800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.703+0000 7f57fffff700 1 -- 172.21.15.37:0/4231151159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808020020 con 0x7f581810a6f0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.703+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5818108600 con 0x7f581810a6f0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.703+0000 7f57fffff700 1 -- 172.21.15.37:0/4231151159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5808012430 con 0x7f581810a6f0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.703+0000 7f57fffff700 1 -- 172.21.15.37:0/4231151159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5808017040 con 0x7f581810a6f0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.703+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5818108b40 con 0x7f581810a6f0 2024-05-09T00:50:55.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.704+0000 7f57fffff700 1 -- 172.21.15.37:0/4231151159 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f5808023020 con 0x7f581810a6f0 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.704+0000 7f57fffff700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f580003e470 0x7f5800040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.704+0000 7f57fffff700 1 -- 172.21.15.37:0/4231151159 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f580800f050 con 0x7f581810a6f0 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.704+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5818064e20 con 0x7f581810a6f0 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.704+0000 7f58167fc700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f580003e470 0x7f5800040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.705+0000 7f58167fc700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f580003e470 0x7f5800040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f580c006fd0 tx=0x7f580c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.710+0000 7f57fffff700 1 -- 172.21.15.37:0/4231151159 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f580802a020 con 0x7f581810a6f0 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.928+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f58181091c0 con 0x7f580003e470 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.928+0000 7f57fffff700 1 -- 172.21.15.37:0/4231151159 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f58181091c0 con 0x7f580003e470 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f580003e470 msgr2=0x7f5800040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f580003e470 0x7f5800040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f580c006fd0 tx=0x7f580c006e40 comp rx=0 tx=0).stop 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 msgr2=0x7f5818109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:55.494 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f5818109e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f580800b7b0 tx=0x7f580800bd50 comp rx=0 tx=0).stop 2024-05-09T00:50:55.495 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 shutdown_connections 2024-05-09T00:50:55.495 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f580003e470 0x7f5800040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:55.495 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 --2- 172.21.15.37:0/4231151159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f581810a6f0 0x7f5818109e70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:55.495 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 >> 172.21.15.37:0/4231151159 conn(0x7f58181041d0 msgr2=0x7f5818105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:55.495 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 shutdown_connections 2024-05-09T00:50:55.495 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:54.931+0000 7f581d79b700 1 -- 172.21.15.37:0/4231151159 wait complete. 2024-05-09T00:50:55.495 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-05-09T00:50:56.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: Generating public/private rsa key pair. 2024-05-09T00:50:56.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: Your identification has been saved in /tmp/tmpkyxxd2po/key. 2024-05-09T00:50:56.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: Your public key has been saved in /tmp/tmpkyxxd2po/key.pub. 2024-05-09T00:50:56.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: The key fingerprint is: 2024-05-09T00:50:56.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: SHA256:lXAmtHh2yCGXxRJkHA1k0UN6AVyjosMVOm8xusm6E3E ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:56.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: The key's randomart image is: 2024-05-09T00:50:56.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: +---[RSA 3072]----+ 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | o*^#O | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | . O=@=+ | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | o * O.=. | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | ..E* * + | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | o= o S | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | .. = | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | .+ | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | .. | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: | oo | 2024-05-09T00:50:56.725 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:50:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: +----[SHA256]-----+ 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.985+0000 7fbf5825d700 1 Processor -- start 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.985+0000 7fbf5825d700 1 -- start start 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.985+0000 7fbf5825d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf5007db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.985+0000 7fbf5825d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5007e0d0 con 0x7fbf5007f6d0 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.985+0000 7fbf55ff9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf5007db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.985+0000 7fbf55ff9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf5007db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46888/0 (socket says 172.21.15.37:46888) 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.985+0000 7fbf55ff9700 1 -- 172.21.15.37:0/1161706669 learned_addr learned my addr 172.21.15.37:0/1161706669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.986+0000 7fbf55ff9700 1 -- 172.21.15.37:0/1161706669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5007e250 con 0x7fbf5007f6d0 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.986+0000 7fbf55ff9700 1 --2- 172.21.15.37:0/1161706669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf5007db00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0098a0 tx=0x7fbf4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a429ad1acafa89 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.986+0000 7fbf54ff7700 1 -- 172.21.15.37:0/1161706669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf4c004160 con 0x7fbf5007f6d0 2024-05-09T00:50:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.986+0000 7fbf54ff7700 1 -- 172.21.15.37:0/1161706669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbf4c004300 con 0x7fbf5007f6d0 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.986+0000 7fbf54ff7700 1 -- 172.21.15.37:0/1161706669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf4c011af0 con 0x7fbf5007f6d0 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.987+0000 7fbf5825d700 1 -- 172.21.15.37:0/1161706669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 msgr2=0x7fbf5007db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.987+0000 7fbf5825d700 1 --2- 172.21.15.37:0/1161706669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf5007db00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0098a0 tx=0x7fbf4c009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.987+0000 7fbf5825d700 1 -- 172.21.15.37:0/1161706669 shutdown_connections 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.987+0000 7fbf5825d700 1 --2- 172.21.15.37:0/1161706669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf5007db00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.987+0000 7fbf5825d700 1 -- 172.21.15.37:0/1161706669 >> 172.21.15.37:0/1161706669 conn(0x7fbf50105380 msgr2=0x7fbf501077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.987+0000 7fbf5825d700 1 -- 172.21.15.37:0/1161706669 shutdown_connections 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.987+0000 7fbf5825d700 1 -- 172.21.15.37:0/1161706669 wait complete. 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.988+0000 7fbf5825d700 1 Processor -- start 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.988+0000 7fbf5825d700 1 -- start start 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.988+0000 7fbf5825d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf501a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.988+0000 7fbf5825d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf50110200 con 0x7fbf5007f6d0 2024-05-09T00:50:56.922 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.988+0000 7fbf55ff9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf501a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.988+0000 7fbf55ff9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf501a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46894/0 (socket says 172.21.15.37:46894) 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.988+0000 7fbf55ff9700 1 -- 172.21.15.37:0/1718951572 learned_addr learned my addr 172.21.15.37:0/1718951572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.989+0000 7fbf55ff9700 1 -- 172.21.15.37:0/1718951572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf501a07c0 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.989+0000 7fbf55ff9700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf501a0280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0117b0 tx=0x7fbf4c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.989+0000 7fbf46ffd700 1 -- 172.21.15.37:0/1718951572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf4c0039c0 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.989+0000 7fbf46ffd700 1 -- 172.21.15.37:0/1718951572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbf4c003b60 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.989+0000 7fbf46ffd700 1 -- 172.21.15.37:0/1718951572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf4c0196a0 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.989+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf501a0a50 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.989+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf501a3660 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.990+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf50064e20 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.990+0000 7fbf46ffd700 1 -- 172.21.15.37:0/1718951572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fbf4c019910 con 0x7fbf5007f6d0 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.990+0000 7fbf46ffd700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fbf3c03e4c0 0x7fbf3c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:56.923 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.990+0000 7fbf46ffd700 1 -- 172.21.15.37:0/1718951572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbf4c053b70 con 0x7fbf5007f6d0 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.991+0000 7fbf557f8700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fbf3c03e4c0 0x7fbf3c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.991+0000 7fbf557f8700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fbf3c03e4c0 0x7fbf3c0409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf40006fd0 tx=0x7fbf40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:55.996+0000 7fbf46ffd700 1 -- 172.21.15.37:0/1718951572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbf4c017e90 con 0x7fbf5007f6d0 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.210+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fbf50107510 con 0x7fbf3c03e4c0 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.419+0000 7fbf46ffd700 1 -- 172.21.15.37:0/1718951572 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbf50107510 con 0x7fbf3c03e4c0 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fbf3c03e4c0 msgr2=0x7fbf3c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fbf3c03e4c0 0x7fbf3c0409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbf40006fd0 tx=0x7fbf40006e40 comp rx=0 tx=0).stop 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 msgr2=0x7fbf501a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf501a0280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0117b0 tx=0x7fbf4c011b70 comp rx=0 tx=0).stop 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 shutdown_connections 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fbf3c03e4c0 0x7fbf3c0409d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 --2- 172.21.15.37:0/1718951572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5007f6d0 0x7fbf501a0280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 >> 172.21.15.37:0/1718951572 conn(0x7fbf50105380 msgr2=0x7fbf50106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:56.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 shutdown_connections 2024-05-09T00:50:56.925 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:56.421+0000 7fbf5825d700 1 -- 172.21.15.37:0/1718951572 wait complete. 2024-05-09T00:50:57.527 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:57 smithi037 ceph-mon[30122]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:50:57.528 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:57 smithi037 ceph-mon[30122]: Generating ssh key... 2024-05-09T00:50:57.528 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:57 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:50:57.528 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:57 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:50:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFoljjP9ap8IQ3zIdf1XcYfGD9kak+/e1fMvNOoKH+iOznJEqTywp/JYjJQ90tGyONpzVGc0/C4lKkpjJEdvzGC1htS9ALMLvc0telZhbUm+hJxDhlFJqnGePIzTGApRNKiyQOYfwxKsIt2PWTOna9oaBF7f1Cy3CIAS3tkMcsXhnbp2jFEEgqpFMpgQXHTX2WUXRz8WBVxaEt/atMA4cO/vq5/ZY9QjK8e9Nuvruzfz1TNgnxACUJFYa1jPykT2zNQkOODvmsjb92Ol8nWbxRYFaBKj/K6UOFmhT/bKqolicObPJ/B03zVqrgDU4efT3z0nmlkEdnAZ7rEJffmMSFmvkyB6dxjyTapUvIEOjpHGgKBUN7EnqEvkF72qHvgjG6zdaZUswHBJK3eU99ipc/8aabBlV8iKdVyPL192FP4C/xreu0i08Q3CMPiOGTz/syhskjMW2xtisjM9w6zhlVKZsS6gcnsQsjhpHEASfU7SptmpGmIj/nzk0EGyOtHGU= ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:50:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.299+0000 7f2e0701d700 1 Processor -- start 2024-05-09T00:50:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.299+0000 7f2e0701d700 1 -- start start 2024-05-09T00:50:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.299+0000 7f2e0701d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0010cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.299+0000 7f2e0701d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0007ce30 con 0x7f2e0010a730 2024-05-09T00:50:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2e04db9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0010cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2e04db9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0010cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46902/0 (socket says 172.21.15.37:46902) 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2e04db9700 1 -- 172.21.15.37:0/4101195768 learned_addr learned my addr 172.21.15.37:0/4101195768 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2e04db9700 1 -- 172.21.15.37:0/4101195768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0010d090 con 0x7f2e0010a730 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2e04db9700 1 --2- 172.21.15.37:0/4101195768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0010cb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0098a0 tx=0x7f2dfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23903657937f2392 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2df77fe700 1 -- 172.21.15.37:0/4101195768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dfc004160 con 0x7f2e0010a730 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2df77fe700 1 -- 172.21.15.37:0/4101195768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2dfc004300 con 0x7f2e0010a730 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.300+0000 7f2df77fe700 1 -- 172.21.15.37:0/4101195768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dfc011af0 con 0x7f2e0010a730 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.301+0000 7f2e0701d700 1 -- 172.21.15.37:0/4101195768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 msgr2=0x7f2e0010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.301+0000 7f2e0701d700 1 --2- 172.21.15.37:0/4101195768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0010cb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0098a0 tx=0x7f2dfc009bb0 comp rx=0 tx=0).stop 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.301+0000 7f2e0701d700 1 -- 172.21.15.37:0/4101195768 shutdown_connections 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.301+0000 7f2e0701d700 1 --2- 172.21.15.37:0/4101195768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0010cb50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.301+0000 7f2e0701d700 1 -- 172.21.15.37:0/4101195768 >> 172.21.15.37:0/4101195768 conn(0x7f2e001041d0 msgr2=0x7f2e00106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.301+0000 7f2e0701d700 1 -- 172.21.15.37:0/4101195768 shutdown_connections 2024-05-09T00:50:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.301+0000 7f2e0701d700 1 -- 172.21.15.37:0/4101195768 wait complete. 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e0701d700 1 Processor -- start 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e0701d700 1 -- start start 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e0701d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e0701d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0010df80 con 0x7f2e0010a730 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e04db9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e04db9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46914/0 (socket says 172.21.15.37:46914) 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e04db9700 1 -- 172.21.15.37:0/2857155937 learned_addr learned my addr 172.21.15.37:0/2857155937 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.302+0000 7f2e04db9700 1 -- 172.21.15.37:0/2857155937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0019e560 con 0x7f2e0010a730 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.303+0000 7f2e04db9700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0019e020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009fb0 tx=0x7f2dfc011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.303+0000 7f2df5ffb700 1 -- 172.21.15.37:0/2857155937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dfc011bc0 con 0x7f2e0010a730 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.303+0000 7f2df5ffb700 1 -- 172.21.15.37:0/2857155937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2dfc024440 con 0x7f2e0010a730 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.303+0000 7f2df5ffb700 1 -- 172.21.15.37:0/2857155937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2dfc01a5c0 con 0x7f2e0010a730 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.303+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0019e7f0 con 0x7f2e0010a730 2024-05-09T00:50:58.146 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.303+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e001a1400 con 0x7f2e0010a730 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.304+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e00064e20 con 0x7f2e0010a730 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.304+0000 7f2df5ffb700 1 -- 172.21.15.37:0/2857155937 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f2dfc0245f0 con 0x7f2e0010a730 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.304+0000 7f2df5ffb700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f2de803e470 0x7f2de8040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.304+0000 7f2df5ffb700 1 -- 172.21.15.37:0/2857155937 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2dfc0537d0 con 0x7f2e0010a730 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.304+0000 7f2df7fff700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f2de803e470 0x7f2de8040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.305+0000 7f2df7fff700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f2de803e470 0x7f2de8040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2df0006fd0 tx=0x7f2df0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.310+0000 7f2df5ffb700 1 -- 172.21.15.37:0/2857155937 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2dfc017e40 con 0x7f2e0010a730 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.526+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f2e00106330 con 0x7f2de803e470 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.527+0000 7f2df5ffb700 1 -- 172.21.15.37:0/2857155937 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f2e00106330 con 0x7f2de803e470 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.529+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f2de803e470 msgr2=0x7f2de8040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.529+0000 7f2e0701d700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f2de803e470 0x7f2de8040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2df0006fd0 tx=0x7f2df0006e40 comp rx=0 tx=0).stop 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.529+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 msgr2=0x7f2e0019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:50:58.147 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.529+0000 7f2e0701d700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0019e020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009fb0 tx=0x7f2dfc011890 comp rx=0 tx=0).stop 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.530+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 shutdown_connections 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.530+0000 7f2e0701d700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f2de803e470 0x7f2de8040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.530+0000 7f2e0701d700 1 --2- 172.21.15.37:0/2857155937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0010a730 0x7f2e0019e020 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.530+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 >> 172.21.15.37:0/2857155937 conn(0x7f2e001041d0 msgr2=0x7f2e00105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.530+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 shutdown_connections 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:57.530+0000 7f2e0701d700 1 -- 172.21.15.37:0/2857155937 wait complete. 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-05-09T00:50:58.148 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-05-09T00:50:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:58 smithi037 ceph-mon[30122]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:50:59.714 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:50:59 smithi037 ceph-mon[30122]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:00.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:00 smithi037 ceph-mon[30122]: Deploying cephadm binary to smithi037 2024-05-09T00:51:03.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.576+0000 7fc4e3c68700 1 Processor -- start 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.576+0000 7fc4e3c68700 1 -- start start 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.576+0000 7fc4e3c68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc07dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.576+0000 7fc4e3c68700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc07e000 con 0x7fc4dc07f690 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e1a04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc07dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e1a04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc07dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46916/0 (socket says 172.21.15.37:46916) 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e1a04700 1 -- 172.21.15.37:0/3071521101 learned_addr learned my addr 172.21.15.37:0/3071521101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e1a04700 1 -- 172.21.15.37:0/3071521101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc07e180 con 0x7fc4dc07f690 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e1a04700 1 --2- 172.21.15.37:0/3071521101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc07dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098a0 tx=0x7fc4d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e49dcaf0d73509 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e0a02700 1 -- 172.21.15.37:0/3071521101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d8004160 con 0x7fc4dc07f690 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e0a02700 1 -- 172.21.15.37:0/3071521101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc4d8004300 con 0x7fc4dc07f690 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.577+0000 7fc4e0a02700 1 -- 172.21.15.37:0/3071521101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d8011af0 con 0x7fc4dc07f690 2024-05-09T00:51:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.578+0000 7fc4e3c68700 1 -- 172.21.15.37:0/3071521101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 msgr2=0x7fc4dc07dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.578+0000 7fc4e3c68700 1 --2- 172.21.15.37:0/3071521101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc07dac0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80098a0 tx=0x7fc4d8009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.578+0000 7fc4e3c68700 1 -- 172.21.15.37:0/3071521101 shutdown_connections 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.578+0000 7fc4e3c68700 1 --2- 172.21.15.37:0/3071521101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc07dac0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.578+0000 7fc4e3c68700 1 -- 172.21.15.37:0/3071521101 >> 172.21.15.37:0/3071521101 conn(0x7fc4dc1052d0 msgr2=0x7fc4dc107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.578+0000 7fc4e3c68700 1 -- 172.21.15.37:0/3071521101 shutdown_connections 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.578+0000 7fc4e3c68700 1 -- 172.21.15.37:0/3071521101 wait complete. 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.579+0000 7fc4e3c68700 1 Processor -- start 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.579+0000 7fc4e3c68700 1 -- start start 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.579+0000 7fc4e3c68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc1a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.579+0000 7fc4e3c68700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc1101f0 con 0x7fc4dc07f690 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.579+0000 7fc4e1a04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc1a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.579+0000 7fc4e1a04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc1a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46928/0 (socket says 172.21.15.37:46928) 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.579+0000 7fc4e1a04700 1 -- 172.21.15.37:0/1371678449 learned_addr learned my addr 172.21.15.37:0/1371678449 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.580+0000 7fc4e1a04700 1 -- 172.21.15.37:0/1371678449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc1a0780 con 0x7fc4dc07f690 2024-05-09T00:51:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.580+0000 7fc4e1a04700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc1a0240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009fb0 tx=0x7fc4d8011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.580+0000 7fc4d2ffd700 1 -- 172.21.15.37:0/1371678449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d8011bc0 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.580+0000 7fc4d2ffd700 1 -- 172.21.15.37:0/1371678449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc4d8024440 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.580+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4dc1a0a10 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.580+0000 7fc4d2ffd700 1 -- 172.21.15.37:0/1371678449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4d801a5c0 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.580+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4dc1a3620 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.581+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4dc064e20 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.581+0000 7fc4d2ffd700 1 -- 172.21.15.37:0/1371678449 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fc4d801a880 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.582+0000 7fc4d2ffd700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fc4c803e420 0x7fc4c8040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.582+0000 7fc4d2ffd700 1 -- 172.21.15.37:0/1371678449 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc4d80539a0 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.582+0000 7fc4e1203700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fc4c803e420 0x7fc4c8040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.582+0000 7fc4e1203700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fc4c803e420 0x7fc4c8040930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc006fd0 tx=0x7fc4cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.587+0000 7fc4d2ffd700 1 -- 172.21.15.37:0/1371678449 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc4d8024930 con 0x7fc4dc07f690 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:50:58.810+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}) -- 0x7fc4dc1073e0 con 0x7fc4c803e420 2024-05-09T00:51:03.889 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.105+0000 7fc4d2ffd700 1 -- 172.21.15.37:0/1371678449 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fc4dc1073e0 con 0x7fc4c803e420 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fc4c803e420 msgr2=0x7fc4c8040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fc4c803e420 0x7fc4c8040930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc006fd0 tx=0x7fc4cc006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 msgr2=0x7fc4dc1a0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc1a0240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009fb0 tx=0x7fc4d8011890 comp rx=0 tx=0).stop 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 shutdown_connections 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fc4c803e420 0x7fc4c8040930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 --2- 172.21.15.37:0/1371678449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4dc07f690 0x7fc4dc1a0240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 >> 172.21.15.37:0/1371678449 conn(0x7fc4dc1052d0 msgr2=0x7fc4dc106c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 shutdown_connections 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:03.108+0000 7fc4e3c68700 1 -- 172.21.15.37:0/1371678449 wait complete. 2024-05-09T00:51:03.890 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mon service... 2024-05-09T00:51:04.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:04 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:51:04.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:04 smithi037 ceph-mon[30122]: Added host smithi037 2024-05-09T00:51:04.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:04 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:51:05.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7fe9a1700 1 Processor -- start 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7fe9a1700 1 -- start start 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7fe9a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f8108690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7fe9a1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8108c80 con 0x7fd7f8108280 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f8108690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f8108690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58164/0 (socket says 172.21.15.37:58164) 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7f7fff700 1 -- 172.21.15.37:0/3396766962 learned_addr learned my addr 172.21.15.37:0/3396766962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.335+0000 7fd7f7fff700 1 -- 172.21.15.37:0/3396766962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f8109450 con 0x7fd7f8108280 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.336+0000 7fd7f7fff700 1 --2- 172.21.15.37:0/3396766962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f8108690 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bb40 tx=0x7fd7e800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb417a33827970d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:05.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.336+0000 7fd7f77fe700 1 -- 172.21.15.37:0/3396766962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e800dad0 con 0x7fd7f8108280 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.336+0000 7fd7f77fe700 1 -- 172.21.15.37:0/3396766962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd7e80044c0 con 0x7fd7f8108280 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.336+0000 7fd7f77fe700 1 -- 172.21.15.37:0/3396766962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e8003de0 con 0x7fd7f8108280 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/3396766962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 msgr2=0x7fd7f8108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 --2- 172.21.15.37:0/3396766962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f8108690 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bb40 tx=0x7fd7e800be50 comp rx=0 tx=0).stop 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/3396766962 shutdown_connections 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 --2- 172.21.15.37:0/3396766962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f8108690 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/3396766962 >> 172.21.15.37:0/3396766962 conn(0x7fd7f8103960 msgr2=0x7fd7f8105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/3396766962 shutdown_connections 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/3396766962 wait complete. 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 Processor -- start 2024-05-09T00:51:05.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.337+0000 7fd7fe9a1700 1 -- start start 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7fe9a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f81a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7fe9a1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8109c20 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f81a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f81a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58172/0 (socket says 172.21.15.37:58172) 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f7fff700 1 -- 172.21.15.37:0/2501774810 learned_addr learned my addr 172.21.15.37:0/2501774810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f7fff700 1 -- 172.21.15.37:0/2501774810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f81a07a0 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f7fff700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f81a0260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8003b20 tx=0x7fd7e8003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f5ffb700 1 -- 172.21.15.37:0/2501774810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e80042d0 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f5ffb700 1 -- 172.21.15.37:0/2501774810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd7e8024070 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f81a0a30 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.338+0000 7fd7f5ffb700 1 -- 172.21.15.37:0/2501774810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7e801f740 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.339+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f81a3640 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.339+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7f8064e20 con 0x7fd7f8108280 2024-05-09T00:51:05.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.340+0000 7fd7f5ffb700 1 -- 172.21.15.37:0/2501774810 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fd7e801f9f0 con 0x7fd7f8108280 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.340+0000 7fd7f5ffb700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fd7e403e4c0 0x7fd7e40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.340+0000 7fd7f5ffb700 1 -- 172.21.15.37:0/2501774810 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd7e8053960 con 0x7fd7f8108280 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.340+0000 7fd7effff700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fd7e403e4c0 0x7fd7e40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.340+0000 7fd7effff700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fd7e403e4c0 0x7fd7e40409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0006fd0 tx=0x7fd7e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.345+0000 7fd7f5ffb700 1 -- 172.21.15.37:0/2501774810 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd7e8012070 con 0x7fd7f8108280 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.573+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fd7f802ea00 con 0x7fd7e403e4c0 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.581+0000 7fd7f5ffb700 1 -- 172.21.15.37:0/2501774810 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd7f802ea00 con 0x7fd7e403e4c0 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fd7e403e4c0 msgr2=0x7fd7e40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fd7e403e4c0 0x7fd7e40409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0006fd0 tx=0x7fd7e0006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 msgr2=0x7fd7f81a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f81a0260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8003b20 tx=0x7fd7e8003ee0 comp rx=0 tx=0).stop 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 shutdown_connections 2024-05-09T00:51:05.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fd7e403e4c0 0x7fd7e40409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:05.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 --2- 172.21.15.37:0/2501774810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108280 0x7fd7f81a0260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:05.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.583+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 >> 172.21.15.37:0/2501774810 conn(0x7fd7f8103960 msgr2=0x7fd7f81924e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:05.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.584+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 shutdown_connections 2024-05-09T00:51:05.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:04.584+0000 7fd7fe9a1700 1 -- 172.21.15.37:0/2501774810 wait complete. 2024-05-09T00:51:05.177 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mgr service... 2024-05-09T00:51:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:05 smithi037 ceph-mon[30122]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:05 smithi037 ceph-mon[30122]: Saving service mon spec with placement count:5 2024-05-09T00:51:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:05 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:51:07.167 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:06 smithi037 ceph-mon[30122]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:07.168 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:06 smithi037 ceph-mon[30122]: Saving service mgr spec with placement count:2 2024-05-09T00:51:07.168 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:06 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:51:07.175 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.590+0000 7f375edf1700 1 Processor -- start 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.590+0000 7f375edf1700 1 -- start start 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.590+0000 7f375edf1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375810cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.590+0000 7f375edf1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f375807ce30 con 0x7f375810a730 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.590+0000 7f375cb8d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375810cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.590+0000 7f375cb8d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375810cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58188/0 (socket says 172.21.15.37:58188) 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.590+0000 7f375cb8d700 1 -- 172.21.15.37:0/1637407035 learned_addr learned my addr 172.21.15.37:0/1637407035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.591+0000 7f375cb8d700 1 -- 172.21.15.37:0/1637407035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375810d090 con 0x7f375810a730 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.591+0000 7f375cb8d700 1 --2- 172.21.15.37:0/1637407035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375810cb50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f37480098a0 tx=0x7f3748009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330fe890e69c2497 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.591+0000 7f374f7fe700 1 -- 172.21.15.37:0/1637407035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3748004160 con 0x7f375810a730 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.591+0000 7f374f7fe700 1 -- 172.21.15.37:0/1637407035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3748004300 con 0x7f375810a730 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.591+0000 7f374f7fe700 1 -- 172.21.15.37:0/1637407035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3748011af0 con 0x7f375810a730 2024-05-09T00:51:07.176 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.592+0000 7f375edf1700 1 -- 172.21.15.37:0/1637407035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 msgr2=0x7f375810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.592+0000 7f375edf1700 1 --2- 172.21.15.37:0/1637407035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375810cb50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f37480098a0 tx=0x7f3748009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.592+0000 7f375edf1700 1 -- 172.21.15.37:0/1637407035 shutdown_connections 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.592+0000 7f375edf1700 1 --2- 172.21.15.37:0/1637407035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375810cb50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.592+0000 7f375edf1700 1 -- 172.21.15.37:0/1637407035 >> 172.21.15.37:0/1637407035 conn(0x7f37581041d0 msgr2=0x7f3758106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.592+0000 7f375edf1700 1 -- 172.21.15.37:0/1637407035 shutdown_connections 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.592+0000 7f375edf1700 1 -- 172.21.15.37:0/1637407035 wait complete. 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375edf1700 1 Processor -- start 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375edf1700 1 -- start start 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375edf1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375819e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375edf1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f375810df80 con 0x7f375810a730 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375cb8d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375819e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375cb8d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375819e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58194/0 (socket says 172.21.15.37:58194) 2024-05-09T00:51:07.177 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375cb8d700 1 -- 172.21.15.37:0/1480766914 learned_addr learned my addr 172.21.15.37:0/1480766914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.593+0000 7f375cb8d700 1 -- 172.21.15.37:0/1480766914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375819e560 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.594+0000 7f375cb8d700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375819e020 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37480117b0 tx=0x7f3748011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.594+0000 7f374dffb700 1 -- 172.21.15.37:0/1480766914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37480039c0 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.594+0000 7f374dffb700 1 -- 172.21.15.37:0/1480766914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3748003b60 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.594+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375819e7f0 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.594+0000 7f374dffb700 1 -- 172.21.15.37:0/1480766914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37480196a0 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.594+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37581a1400 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.595+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3758064e20 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.595+0000 7f374dffb700 1 -- 172.21.15.37:0/1480766914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f3748019910 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.596+0000 7f374dffb700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f374003e4c0 0x7f37400409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.596+0000 7f374dffb700 1 -- 172.21.15.37:0/1480766914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3748053bf0 con 0x7f375810a730 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.596+0000 7f374ffff700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f374003e4c0 0x7f37400409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:07.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.596+0000 7f374ffff700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f374003e4c0 0x7f37400409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3754006fd0 tx=0x7f3754006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.601+0000 7f374dffb700 1 -- 172.21.15.37:0/1480766914 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f374802cdf0 con 0x7f375810a730 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.838+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f37581a15d0 con 0x7f374003e4c0 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.843+0000 7f374dffb700 1 -- 172.21.15.37:0/1480766914 <== mgr.14120 v2:172.21.15.37:6800/1512065281 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f37581a15d0 con 0x7f374003e4c0 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f374003e4c0 msgr2=0x7f37400409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f374003e4c0 0x7f37400409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3754006fd0 tx=0x7f3754006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 msgr2=0x7f375819e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375819e020 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f37480117b0 tx=0x7f3748011b70 comp rx=0 tx=0).stop 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 shutdown_connections 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f374003e4c0 0x7f37400409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 --2- 172.21.15.37:0/1480766914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f375810a730 0x7f375819e020 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 >> 172.21.15.37:0/1480766914 conn(0x7f37581041d0 msgr2=0x7f3758105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 shutdown_connections 2024-05-09T00:51:07.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:05.846+0000 7f375edf1700 1 -- 172.21.15.37:0/1480766914 wait complete. 2024-05-09T00:51:08.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:07 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:51:08.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:07 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:51:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.649+0000 7fdd3e59d700 1 Processor -- start 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.649+0000 7fdd3e59d700 1 -- start start 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.649+0000 7fdd3e59d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38108f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.649+0000 7fdd3e59d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd38109510 con 0x7fdd38108b10 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58204/0 (socket says 172.21.15.37:58204) 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd37fff700 1 -- 172.21.15.37:0/3602029017 learned_addr learned my addr 172.21.15.37:0/3602029017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd37fff700 1 -- 172.21.15.37:0/3602029017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd38109ce0 con 0x7fdd38108b10 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd37fff700 1 --2- 172.21.15.37:0/3602029017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38108f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd280098a0 tx=0x7fdd28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432c2fbe0735526c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd36ffd700 1 -- 172.21.15.37:0/3602029017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd28004160 con 0x7fdd38108b10 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd36ffd700 1 -- 172.21.15.37:0/3602029017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd28004300 con 0x7fdd38108b10 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.650+0000 7fdd36ffd700 1 -- 172.21.15.37:0/3602029017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd28011a20 con 0x7fdd38108b10 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.651+0000 7fdd3e59d700 1 -- 172.21.15.37:0/3602029017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 msgr2=0x7fdd38108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:08.484 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.651+0000 7fdd3e59d700 1 --2- 172.21.15.37:0/3602029017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38108f20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdd280098a0 tx=0x7fdd28009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.651+0000 7fdd3e59d700 1 -- 172.21.15.37:0/3602029017 shutdown_connections 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.651+0000 7fdd3e59d700 1 --2- 172.21.15.37:0/3602029017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38108f20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.651+0000 7fdd3e59d700 1 -- 172.21.15.37:0/3602029017 >> 172.21.15.37:0/3602029017 conn(0x7fdd381041d0 msgr2=0x7fdd38106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.651+0000 7fdd3e59d700 1 -- 172.21.15.37:0/3602029017 shutdown_connections 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.651+0000 7fdd3e59d700 1 -- 172.21.15.37:0/3602029017 wait complete. 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.652+0000 7fdd3e59d700 1 Processor -- start 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.652+0000 7fdd3e59d700 1 -- start start 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.652+0000 7fdd3e59d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38107370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.652+0000 7fdd3e59d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3810d090 con 0x7fdd38108b10 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.652+0000 7fdd37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38107370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.652+0000 7fdd37fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38107370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58208/0 (socket says 172.21.15.37:58208) 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd37fff700 1 -- 172.21.15.37:0/1983679027 learned_addr learned my addr 172.21.15.37:0/1983679027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd37fff700 1 -- 172.21.15.37:0/1983679027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd381078b0 con 0x7fdd38108b10 2024-05-09T00:51:08.485 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd37fff700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38107370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd28011a20 tx=0x7fdd28011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd357fa700 1 -- 172.21.15.37:0/1983679027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd280039c0 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd357fa700 1 -- 172.21.15.37:0/1983679027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd28003b60 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd38105b00 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd357fa700 1 -- 172.21.15.37:0/1983679027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd28019700 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.653+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd38105fe0 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.654+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd38064e20 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.654+0000 7fdd357fa700 1 -- 172.21.15.37:0/1983679027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fdd280199b0 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.655+0000 7fdd357fa700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fdd2003e470 0x7fdd20040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.655+0000 7fdd357fa700 1 -- 172.21.15.37:0/1983679027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdd28053cc0 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.655+0000 7fdd377fe700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fdd2003e470 0x7fdd20040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.655+0000 7fdd377fe700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fdd2003e470 0x7fdd20040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c006fd0 tx=0x7fdd2c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.660+0000 7fdd357fa700 1 -- 172.21.15.37:0/1983679027 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdd28017e90 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.875+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fdd381971e0 con 0x7fdd38108b10 2024-05-09T00:51:08.486 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.878+0000 7fdd357fa700 1 -- 172.21.15.37:0/1983679027 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fdd28023390 con 0x7fdd38108b10 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fdd2003e470 msgr2=0x7fdd20040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fdd2003e470 0x7fdd20040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c006fd0 tx=0x7fdd2c006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 msgr2=0x7fdd38107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38107370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd28011a20 tx=0x7fdd28011b00 comp rx=0 tx=0).stop 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 shutdown_connections 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7fdd2003e470 0x7fdd20040980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 --2- 172.21.15.37:0/1983679027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd38108b10 0x7fdd38107370 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 >> 172.21.15.37:0/1983679027 conn(0x7fdd381041d0 msgr2=0x7fdd38194620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 shutdown_connections 2024-05-09T00:51:08.487 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:07.880+0000 7fdd3e59d700 1 -- 172.21.15.37:0/1983679027 wait complete. 2024-05-09T00:51:09.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:08 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1983679027' entity='client.admin' 2024-05-09T00:51:10.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:10 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2391039258' entity='client.admin' 2024-05-09T00:51:10.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:10 smithi037 ceph-mon[30122]: from='mgr.14120 172.21.15.37:0/4237911941' entity='mgr.x' 2024-05-09T00:51:10.375 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.938+0000 7f7c073b2700 1 Processor -- start 2024-05-09T00:51:10.375 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.939+0000 7f7c073b2700 1 -- start start 2024-05-09T00:51:10.375 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.939+0000 7f7c073b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0010a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:10.375 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.939+0000 7f7c073b2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0010a610 con 0x7f7c00109c10 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.939+0000 7f7c0514e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0010a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.939+0000 7f7c0514e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0010a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58220/0 (socket says 172.21.15.37:58220) 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.939+0000 7f7c0514e700 1 -- 172.21.15.37:0/3162859566 learned_addr learned my addr 172.21.15.37:0/3162859566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.939+0000 7f7c0514e700 1 -- 172.21.15.37:0/3162859566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0010ade0 con 0x7f7c00109c10 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.940+0000 7f7c0514e700 1 --2- 172.21.15.37:0/3162859566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0010a020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0098a0 tx=0x7f7bfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f673890adc8a0d1d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.940+0000 7f7bf7fff700 1 -- 172.21.15.37:0/3162859566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc004160 con 0x7f7c00109c10 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.940+0000 7f7bf7fff700 1 -- 172.21.15.37:0/3162859566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bfc004300 con 0x7f7c00109c10 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.940+0000 7f7bf7fff700 1 -- 172.21.15.37:0/3162859566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc011a20 con 0x7f7c00109c10 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 -- 172.21.15.37:0/3162859566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 msgr2=0x7f7c0010a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 --2- 172.21.15.37:0/3162859566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0010a020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0098a0 tx=0x7f7bfc009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 -- 172.21.15.37:0/3162859566 shutdown_connections 2024-05-09T00:51:10.376 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 --2- 172.21.15.37:0/3162859566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0010a020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 -- 172.21.15.37:0/3162859566 >> 172.21.15.37:0/3162859566 conn(0x7f7c001052d0 msgr2=0x7f7c00107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 -- 172.21.15.37:0/3162859566 shutdown_connections 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 -- 172.21.15.37:0/3162859566 wait complete. 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.941+0000 7f7c073b2700 1 Processor -- start 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c073b2700 1 -- start start 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c073b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0007f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c073b2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0010e190 con 0x7f7c00109c10 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c0514e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0007f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c0514e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0007f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58228/0 (socket says 172.21.15.37:58228) 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c0514e700 1 -- 172.21.15.37:0/2391039258 learned_addr learned my addr 172.21.15.37:0/2391039258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c0514e700 1 -- 172.21.15.37:0/2391039258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0007f830 con 0x7f7c00109c10 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7c0514e700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0007f2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc011a20 tx=0x7f7bfc011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.942+0000 7f7bf67fc700 1 -- 172.21.15.37:0/2391039258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc0039c0 con 0x7f7c00109c10 2024-05-09T00:51:10.377 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.943+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0007da80 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.943+0000 7f7bf67fc700 1 -- 172.21.15.37:0/2391039258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bfc003b60 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.943+0000 7f7bf67fc700 1 -- 172.21.15.37:0/2391039258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bfc019700 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.943+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0007df60 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.944+0000 7f7bf67fc700 1 -- 172.21.15.37:0/2391039258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f7bfc019a00 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.944+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c00064e20 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.944+0000 7f7bf67fc700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f7bec03e420 0x7f7bec040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.944+0000 7f7bf67fc700 1 -- 172.21.15.37:0/2391039258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7bfc053c00 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.944+0000 7f7c0494d700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f7bec03e420 0x7f7bec040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.944+0000 7f7c0494d700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f7bec03e420 0x7f7bec040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0006fd0 tx=0x7f7bf0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:08.949+0000 7f7bf67fc700 1 -- 172.21.15.37:0/2391039258 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7bfc00b3e0 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.190+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f7c0007e680 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.194+0000 7f7bf67fc700 1 -- 172.21.15.37:0/2391039258 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f7bfc023e00 con 0x7f7c00109c10 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f7bec03e420 msgr2=0x7f7bec040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:10.378 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f7bec03e420 0x7f7bec040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0006fd0 tx=0x7f7bf0006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 msgr2=0x7f7c0007f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0007f2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc011a20 tx=0x7f7bfc011b00 comp rx=0 tx=0).stop 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 shutdown_connections 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f7bec03e420 0x7f7bec040930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 --2- 172.21.15.37:0/2391039258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c00109c10 0x7f7c0007f2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 >> 172.21.15.37:0/2391039258 conn(0x7f7c001052d0 msgr2=0x7f7c00106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 shutdown_connections 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:09.197+0000 7f7c073b2700 1 -- 172.21.15.37:0/2391039258 wait complete. 2024-05-09T00:51:10.379 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-05-09T00:51:11.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:11 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1666675676' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-09T00:51:11.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: ignoring --setuser ceph since I am not root 2024-05-09T00:51:11.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: ignoring --setgroup ceph since I am not root 2024-05-09T00:51:11.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:11.420+0000 7f84ac4dc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:51:11.875 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:11.623+0000 7f84ac4dc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:51:11.875 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:11.731+0000 7f84ac4dc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:51:11.882 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.827+0000 7efd1369b700 1 Processor -- start 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.828+0000 7efd1369b700 1 -- start start 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.828+0000 7efd1369b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c10cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.828+0000 7efd1369b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c07d840 con 0x7efd0c10a720 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.828+0000 7efd11437700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c10cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.828+0000 7efd11437700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c10cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58242/0 (socket says 172.21.15.37:58242) 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.828+0000 7efd11437700 1 -- 172.21.15.37:0/3271351165 learned_addr learned my addr 172.21.15.37:0/3271351165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.828+0000 7efd11437700 1 -- 172.21.15.37:0/3271351165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c10d080 con 0x7efd0c10a720 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.829+0000 7efd11437700 1 --2- 172.21.15.37:0/3271351165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c10cb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd080098a0 tx=0x7efd08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e9aca9b0e753c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.829+0000 7efd03fff700 1 -- 172.21.15.37:0/3271351165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd08004160 con 0x7efd0c10a720 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.829+0000 7efd03fff700 1 -- 172.21.15.37:0/3271351165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd08004300 con 0x7efd0c10a720 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.829+0000 7efd03fff700 1 -- 172.21.15.37:0/3271351165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd08011a20 con 0x7efd0c10a720 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.829+0000 7efd1369b700 1 -- 172.21.15.37:0/3271351165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 msgr2=0x7efd0c10cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:11.883 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.829+0000 7efd1369b700 1 --2- 172.21.15.37:0/3271351165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c10cb40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd080098a0 tx=0x7efd08009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.830+0000 7efd1369b700 1 -- 172.21.15.37:0/3271351165 shutdown_connections 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.830+0000 7efd1369b700 1 --2- 172.21.15.37:0/3271351165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c10cb40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.830+0000 7efd1369b700 1 -- 172.21.15.37:0/3271351165 >> 172.21.15.37:0/3271351165 conn(0x7efd0c104120 msgr2=0x7efd0c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.830+0000 7efd1369b700 1 -- 172.21.15.37:0/3271351165 shutdown_connections 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.830+0000 7efd1369b700 1 -- 172.21.15.37:0/3271351165 wait complete. 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.830+0000 7efd1369b700 1 Processor -- start 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.830+0000 7efd1369b700 1 -- start start 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd1369b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd1369b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c10e020 con 0x7efd0c10a720 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd11437700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd11437700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c19dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58258/0 (socket says 172.21.15.37:58258) 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd11437700 1 -- 172.21.15.37:0/1666675676 learned_addr learned my addr 172.21.15.37:0/1666675676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:11.884 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd11437700 1 -- 172.21.15.37:0/1666675676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c19e520 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd11437700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c19dfe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd08004660 tx=0x7efd08011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd08003a60 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd0801b8f0 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0c19e7b0 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd08023890 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.831+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0c1a13c0 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.832+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0c064e20 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.833+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7efd0802c3f0 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.833+0000 7efd027fc700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7efcf803e420 0x7efcf8040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.833+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efd080540b0 con 0x7efd0c10a720 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.833+0000 7efd10c36700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7efcf803e420 0x7efcf8040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.833+0000 7efd10c36700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7efcf803e420 0x7efcf8040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcfc006fd0 tx=0x7efcfc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:11.885 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:10.838+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efd0801f030 con 0x7efd0c10a720 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.136+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7efd0c1a19c0 con 0x7efd0c10a720 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.198+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7efd0801bda0 con 0x7efd0c10a720 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.200+0000 7efd027fc700 1 -- 172.21.15.37:0/1666675676 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7efd08018530 con 0x7efd0c10a720 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7efcf803e420 msgr2=0x7efcf8040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7efcf803e420 0x7efcf8040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efcfc006fd0 tx=0x7efcfc006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 msgr2=0x7efd0c19dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c19dfe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd08004660 tx=0x7efd08011aa0 comp rx=0 tx=0).stop 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 shutdown_connections 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7efcf803e420 0x7efcf8040930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 --2- 172.21.15.37:0/1666675676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd0c10a720 0x7efd0c19dfe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 >> 172.21.15.37:0/1666675676 conn(0x7efd0c104120 msgr2=0x7efd0c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 shutdown_connections 2024-05-09T00:51:11.886 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:11.201+0000 7efd1369b700 1 -- 172.21.15.37:0/1666675676 wait complete. 2024-05-09T00:51:12.156 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:12 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:12.060+0000 7f84ac4dc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:51:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:12 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1666675676' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-09T00:51:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:12 smithi037 ceph-mon[30122]: mgrmap e9: x(active, since 19s) 2024-05-09T00:51:12.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:12 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:12.155+0000 7f84ac4dc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.343+0000 7f6f23d76700 1 Processor -- start 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.343+0000 7f6f23d76700 1 -- start start 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.344+0000 7f6f23d76700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c108f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.344+0000 7f6f23d76700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c109510 con 0x7f6f1c108b10 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.344+0000 7f6f21b12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.344+0000 7f6f21b12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39352/0 (socket says 172.21.15.37:39352) 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.344+0000 7f6f21b12700 1 -- 172.21.15.37:0/2397481115 learned_addr learned my addr 172.21.15.37:0/2397481115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.344+0000 7f6f21b12700 1 -- 172.21.15.37:0/2397481115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c109ce0 con 0x7f6f1c108b10 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.345+0000 7f6f21b12700 1 --2- 172.21.15.37:0/2397481115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c108f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f180098a0 tx=0x7f6f18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96184b17d19fb27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.345+0000 7f6f20b10700 1 -- 172.21.15.37:0/2397481115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f18004160 con 0x7f6f1c108b10 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.345+0000 7f6f20b10700 1 -- 172.21.15.37:0/2397481115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f18004300 con 0x7f6f1c108b10 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.345+0000 7f6f20b10700 1 -- 172.21.15.37:0/2397481115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f18011a20 con 0x7f6f1c108b10 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.346+0000 7f6f23d76700 1 -- 172.21.15.37:0/2397481115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 msgr2=0x7f6f1c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.346+0000 7f6f23d76700 1 --2- 172.21.15.37:0/2397481115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c108f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f180098a0 tx=0x7f6f18009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.346+0000 7f6f23d76700 1 -- 172.21.15.37:0/2397481115 shutdown_connections 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.346+0000 7f6f23d76700 1 --2- 172.21.15.37:0/2397481115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c108f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.346+0000 7f6f23d76700 1 -- 172.21.15.37:0/2397481115 >> 172.21.15.37:0/2397481115 conn(0x7f6f1c1041d0 msgr2=0x7f6f1c106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.346+0000 7f6f23d76700 1 -- 172.21.15.37:0/2397481115 shutdown_connections 2024-05-09T00:51:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.346+0000 7f6f23d76700 1 -- 172.21.15.37:0/2397481115 wait complete. 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.347+0000 7f6f23d76700 1 Processor -- start 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.347+0000 7f6f23d76700 1 -- start start 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.347+0000 7f6f23d76700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c19cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.347+0000 7f6f23d76700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c10d090 con 0x7f6f1c108b10 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.347+0000 7f6f21b12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c19cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.347+0000 7f6f21b12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c19cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39354/0 (socket says 172.21.15.37:39354) 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.347+0000 7f6f21b12700 1 -- 172.21.15.37:0/3961832175 learned_addr learned my addr 172.21.15.37:0/3961832175 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.348+0000 7f6f21b12700 1 -- 172.21.15.37:0/3961832175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c19d4a0 con 0x7f6f1c108b10 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.348+0000 7f6f21b12700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c19cf60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f18011a20 tx=0x7f6f18011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.348+0000 7f6f12ffd700 1 -- 172.21.15.37:0/3961832175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f180039c0 con 0x7f6f1c108b10 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.348+0000 7f6f12ffd700 1 -- 172.21.15.37:0/3961832175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f18003b60 con 0x7f6f1c108b10 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.348+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c19d730 con 0x7f6f1c108b10 2024-05-09T00:51:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.348+0000 7f6f12ffd700 1 -- 172.21.15.37:0/3961832175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f18019700 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.348+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c1a0340 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.349+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f1c064e20 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.350+0000 7f6f12ffd700 1 -- 172.21.15.37:0/3961832175 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f6f1801ab00 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.350+0000 7f6f12ffd700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 0x7f6f08040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.350+0000 7f6f21311700 1 -- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 msgr2=0x7f6f08040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1512065281 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.350+0000 7f6f12ffd700 1 -- 172.21.15.37:0/3961832175 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6f18053a00 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.350+0000 7f6f21311700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 0x7f6f08040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.355+0000 7f6f12ffd700 1 -- 172.21.15.37:0/3961832175 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6f18053760 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.551+0000 7f6f21311700 1 -- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 msgr2=0x7f6f08040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1512065281 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.551+0000 7f6f21311700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 0x7f6f08040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.675+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f6f1c1a0510 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.676+0000 7f6f12ffd700 1 -- 172.21.15.37:0/3961832175 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f6f1801a860 con 0x7f6f1c108b10 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 msgr2=0x7f6f08040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:51:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 0x7f6f08040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 msgr2=0x7f6f1c19cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c19cf60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f18011a20 tx=0x7f6f18011b00 comp rx=0 tx=0).stop 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 shutdown_connections 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f6f0803e470 0x7f6f08040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 --2- 172.21.15.37:0/3961832175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f1c108b10 0x7f6f1c19cf60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 >> 172.21.15.37:0/3961832175 conn(0x7f6f1c1041d0 msgr2=0x7f6f1c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 shutdown_connections 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:12.678+0000 7f6f23d76700 1 -- 172.21.15.37:0/3961832175 wait complete. 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-05-09T00:51:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 9... 2024-05-09T00:51:13.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:13 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3961832175' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T00:51:13.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:13.437+0000 7f84ac4dc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:51:13.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:13.624+0000 7f84ac4dc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:51:14.116 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:13.810+0000 7f84ac4dc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:51:14.116 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:14.116+0000 7f84ac4dc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:51:14.399 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:14.216+0000 7f84ac4dc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:51:14.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:14.429+0000 7f84ac4dc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:51:14.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:14.636+0000 7f84ac4dc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:51:15.474 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:15 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:15.297+0000 7f84ac4dc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:51:15.864 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:15 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:15.537+0000 7f84ac4dc200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T00:51:16.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:15 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:15.993+0000 7f84ac4dc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:51:16.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:16 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:16.097+0000 7f84ac4dc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:51:16.801 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:16 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:16.495+0000 7f84ac4dc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:51:17.223 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:16 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:16.874+0000 7f84ac4dc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:51:17.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:16 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:16.973+0000 7f84ac4dc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:51:17.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:17 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:17.232+0000 7f84ac4dc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:51:17.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:17 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:17.374+0000 7f84ac4dc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:51:17.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:17 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:17.477+0000 7f84ac4dc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:51:18.223 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:17 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:17.818+0000 7f84ac4dc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:51:18.224 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:17 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:17.917+0000 7f84ac4dc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:51:18.840 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:18 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:18.554+0000 7f84ac4dc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:51:18.840 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:51:18 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:51:18.786+0000 7f84ac4dc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: Active manager daemon x restarted 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: Activating manager daemon x 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: osdmap e3: 0 total, 0 up, 0 in 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: mgrmap e10: x(active, starting, since 0.00427877s) 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:51:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:51:19.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:51:19.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: Manager daemon x is now available 2024-05-09T00:51:19.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:51:20.123 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:51:20.123 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:51:20.123 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:19 smithi037 ceph-mon[30122]: [09/May/2024:00:51:19] ENGINE Bus STARTING 2024-05-09T00:51:20.123 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:19 smithi037 ceph-mon[30122]: mgrmap e11: x(active, since 1.00662s) 2024-05-09T00:51:20.417 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.791+0000 7f5611f7c700 1 Processor -- start 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.791+0000 7f5611f7c700 1 -- start start 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.791+0000 7f5611f7c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c10cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.791+0000 7f5611f7c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f560c07ce10 con 0x7f560c10a750 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.791+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c10cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.792+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c10cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39356/0 (socket says 172.21.15.37:39356) 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.792+0000 7f560b7fe700 1 -- 172.21.15.37:0/2042453013 learned_addr learned my addr 172.21.15.37:0/2042453013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.792+0000 7f560b7fe700 1 -- 172.21.15.37:0/2042453013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c10d0b0 con 0x7f560c10a750 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.792+0000 7f560b7fe700 1 --2- 172.21.15.37:0/2042453013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c10cb70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0098a0 tx=0x7f55fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1568909f323bc438 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.792+0000 7f560a7fc700 1 -- 172.21.15.37:0/2042453013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc004160 con 0x7f560c10a750 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.792+0000 7f560a7fc700 1 -- 172.21.15.37:0/2042453013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55fc004300 con 0x7f560c10a750 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.792+0000 7f560a7fc700 1 -- 172.21.15.37:0/2042453013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc011a20 con 0x7f560c10a750 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.793+0000 7f5611f7c700 1 -- 172.21.15.37:0/2042453013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 msgr2=0x7f560c10cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.793+0000 7f5611f7c700 1 --2- 172.21.15.37:0/2042453013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c10cb70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0098a0 tx=0x7f55fc009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.793+0000 7f5611f7c700 1 -- 172.21.15.37:0/2042453013 shutdown_connections 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.793+0000 7f5611f7c700 1 --2- 172.21.15.37:0/2042453013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c10cb70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.793+0000 7f5611f7c700 1 -- 172.21.15.37:0/2042453013 >> 172.21.15.37:0/2042453013 conn(0x7f560c1041d0 msgr2=0x7f560c106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.793+0000 7f5611f7c700 1 -- 172.21.15.37:0/2042453013 shutdown_connections 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.793+0000 7f5611f7c700 1 -- 172.21.15.37:0/2042453013 wait complete. 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.794+0000 7f5611f7c700 1 Processor -- start 2024-05-09T00:51:20.426 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.794+0000 7f5611f7c700 1 -- start start 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.794+0000 7f5611f7c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.794+0000 7f5611f7c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f560c10e050 con 0x7f560c10a750 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f560b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c19dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39368/0 (socket says 172.21.15.37:39368) 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f560b7fe700 1 -- 172.21.15.37:0/3102836310 learned_addr learned my addr 172.21.15.37:0/3102836310 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f560b7fe700 1 -- 172.21.15.37:0/3102836310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560c19e530 con 0x7f560c10a750 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f560b7fe700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c19dff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55fc004660 tx=0x7f55fc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc003a60 con 0x7f560c10a750 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f560c19e7c0 con 0x7f560c10a750 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55fc01b8f0 con 0x7f560c10a750 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55fc023890 con 0x7f560c10a750 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.795+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f560c1a13d0 con 0x7f560c10a750 2024-05-09T00:51:20.427 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.796+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f55fc02c3f0 con 0x7f560c10a750 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.797+0000 7f5608ff9700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.797+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 --> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f55f8041090 con 0x7f55f803e470 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.797+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f55fc054f30 con 0x7f560c10a750 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.797+0000 7f560affd700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 msgr2=0x7f55f8040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1512065281 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.797+0000 7f560affd700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.998+0000 7f560affd700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 msgr2=0x7f55f8040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1512065281 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:13.998+0000 7f560affd700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:14.399+0000 7f560affd700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 msgr2=0x7f55f8040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1512065281 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:14.399+0000 7f560affd700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:15.200+0000 7f560affd700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 msgr2=0x7f55f8040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1512065281 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:15.200+0000 7f560affd700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:16.800+0000 7f560affd700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 msgr2=0x7f55f8040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1512065281 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:16.800+0000 7f560affd700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T00:51:20.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:18.790+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f55fc02c780 con 0x7f560c10a750 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:18.790+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 msgr2=0x7f55f8040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:18.790+0000 7f5608ff9700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.791+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f55fc02cca0 con 0x7f560c10a750 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.792+0000 7f5608ff9700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f55fc054ac0 0x7f55f8043f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.792+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f55fc012ec0 con 0x7f55fc054ac0 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.792+0000 7f560affd700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f55fc054ac0 0x7f55f8043f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.793+0000 7f560affd700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f55fc054ac0 0x7f55f8043f70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f55f4003a10 tx=0x7f55f40092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.794+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f55fc012ec0 con 0x7f55fc054ac0 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.802+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f560c064e20 con 0x7f55fc054ac0 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.802+0000 7f5608ff9700 1 -- 172.21.15.37:0/3102836310 <== mgr.14152 v2:172.21.15.37:6800/2764436863 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f560c064e20 con 0x7f55fc054ac0 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.802+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f55fc054ac0 msgr2=0x7f55f8043f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.802+0000 7f5611f7c700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f55fc054ac0 0x7f55f8043f70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f55f4003a10 tx=0x7f55f40092b0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.429 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.802+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 msgr2=0x7f560c19dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.802+0000 7f5611f7c700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c19dff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55fc004660 tx=0x7f55fc011aa0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.803+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 shutdown_connections 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.803+0000 7f5611f7c700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f55fc054ac0 0x7f55f8043f70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.803+0000 7f5611f7c700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560c10a750 0x7f560c19dff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.803+0000 7f5611f7c700 1 --2- 172.21.15.37:0/3102836310 >> [v2:172.21.15.37:6800/1512065281,v1:172.21.15.37:6801/1512065281] conn(0x7f55f803e470 0x7f55f8040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.803+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 >> 172.21.15.37:0/3102836310 conn(0x7f560c1041d0 msgr2=0x7f560c105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.803+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 shutdown_connections 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:19.803+0000 7f5611f7c700 1 -- 172.21.15.37:0/3102836310 wait complete. 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 9 is available 2024-05-09T00:51:20.430 INFO:teuthology.orchestra.run.smithi037.stdout:Generating a dashboard self-signed certificate... 2024-05-09T00:51:20.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:20 smithi037 ceph-mon[30122]: [09/May/2024:00:51:19] ENGINE Serving on http://172.21.15.37:8765 2024-05-09T00:51:20.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:20 smithi037 ceph-mon[30122]: [09/May/2024:00:51:19] ENGINE Serving on https://172.21.15.37:7150 2024-05-09T00:51:20.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:20 smithi037 ceph-mon[30122]: [09/May/2024:00:51:19] ENGINE Bus STARTED 2024-05-09T00:51:20.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:20 smithi037 ceph-mon[30122]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-09T00:51:20.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:20 smithi037 ceph-mon[30122]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-09T00:51:21.805 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.888+0000 7f312d0b3700 1 Processor -- start 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.888+0000 7f312d0b3700 1 -- start start 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.889+0000 7f312d0b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312810a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.889+0000 7f312d0b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f312810a610 con 0x7f3128109c10 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.889+0000 7f3126d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312810a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.889+0000 7f3126d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312810a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39428/0 (socket says 172.21.15.37:39428) 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.889+0000 7f3126d9d700 1 -- 172.21.15.37:0/2333847870 learned_addr learned my addr 172.21.15.37:0/2333847870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.889+0000 7f3126d9d700 1 -- 172.21.15.37:0/2333847870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312810ade0 con 0x7f3128109c10 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.889+0000 7f3126d9d700 1 --2- 172.21.15.37:0/2333847870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312810a020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31100098a0 tx=0x7f3110009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e9e37fb307ad02 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:21.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f3125d9b700 1 -- 172.21.15.37:0/2333847870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3110004160 con 0x7f3128109c10 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f3125d9b700 1 -- 172.21.15.37:0/2333847870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3110004300 con 0x7f3128109c10 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f3125d9b700 1 -- 172.21.15.37:0/2333847870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3110011a20 con 0x7f3128109c10 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f312d0b3700 1 -- 172.21.15.37:0/2333847870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 msgr2=0x7f312810a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f312d0b3700 1 --2- 172.21.15.37:0/2333847870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312810a020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31100098a0 tx=0x7f3110009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f312d0b3700 1 -- 172.21.15.37:0/2333847870 shutdown_connections 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f312d0b3700 1 --2- 172.21.15.37:0/2333847870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312810a020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f312d0b3700 1 -- 172.21.15.37:0/2333847870 >> 172.21.15.37:0/2333847870 conn(0x7f31281052d0 msgr2=0x7f3128107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f312d0b3700 1 -- 172.21.15.37:0/2333847870 shutdown_connections 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.890+0000 7f312d0b3700 1 -- 172.21.15.37:0/2333847870 wait complete. 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.891+0000 7f312d0b3700 1 Processor -- start 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f312d0b3700 1 -- start start 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f312d0b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312819e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f312d0b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f312810e190 con 0x7f3128109c10 2024-05-09T00:51:21.807 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f3126d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312819e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f3126d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312819e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39444/0 (socket says 172.21.15.37:39444) 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f3126d9d700 1 -- 172.21.15.37:0/2597357425 learned_addr learned my addr 172.21.15.37:0/2597357425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f3126d9d700 1 -- 172.21.15.37:0/2597357425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312819e590 con 0x7f3128109c10 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f3126d9d700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312819e050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3110011a20 tx=0x7f3110011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.892+0000 7f311ffff700 1 -- 172.21.15.37:0/2597357425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31100039c0 con 0x7f3128109c10 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.893+0000 7f311ffff700 1 -- 172.21.15.37:0/2597357425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3110003b60 con 0x7f3128109c10 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.893+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312819e820 con 0x7f3128109c10 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.893+0000 7f311ffff700 1 -- 172.21.15.37:0/2597357425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3110019700 con 0x7f3128109c10 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.893+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31281a1430 con 0x7f3128109c10 2024-05-09T00:51:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.894+0000 7f311ffff700 1 -- 172.21.15.37:0/2597357425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f3110019a00 con 0x7f3128109c10 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.894+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3128064e20 con 0x7f3128109c10 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.894+0000 7f311ffff700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f311403e470 0x7f3114040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.894+0000 7f311ffff700 1 -- 172.21.15.37:0/2597357425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3110053e80 con 0x7f3128109c10 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.894+0000 7f312659c700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f311403e470 0x7f3114040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.895+0000 7f312659c700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f311403e470 0x7f3114040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3118006fd0 tx=0x7f3118006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:20.899+0000 7f311ffff700 1 -- 172.21.15.37:0/2597357425 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3110017e90 con 0x7f3128109c10 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.126+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f31281a16c0 con 0x7f311403e470 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.202+0000 7f311ffff700 1 -- 172.21.15.37:0/2597357425 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f31281a16c0 con 0x7f311403e470 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f311403e470 msgr2=0x7f3114040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f311403e470 0x7f3114040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3118006fd0 tx=0x7f3118006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 msgr2=0x7f312819e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312819e050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3110011a20 tx=0x7f3110011b00 comp rx=0 tx=0).stop 2024-05-09T00:51:21.809 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 shutdown_connections 2024-05-09T00:51:21.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f311403e470 0x7f3114040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:21.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 --2- 172.21.15.37:0/2597357425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3128109c10 0x7f312819e050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:21.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 >> 172.21.15.37:0/2597357425 conn(0x7f31281052d0 msgr2=0x7f3128106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:21.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 shutdown_connections 2024-05-09T00:51:21.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:21.205+0000 7f312d0b3700 1 -- 172.21.15.37:0/2597357425 wait complete. 2024-05-09T00:51:21.810 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-05-09T00:51:22.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:21 smithi037 ceph-mon[30122]: mgrmap e12: x(active, since 2s) 2024-05-09T00:51:22.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:21 smithi037 ceph-mon[30122]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:22.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:22.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:22.061 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:23.314 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$WSYh/TenM7APUdag824bpuCP9/fVixjTJ6TzVW/AW6XRHfLJ/3PXe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715215882, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.287+0000 7f46d1745700 1 Processor -- start 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.287+0000 7f46d1745700 1 -- start start 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.287+0000 7f46d1745700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc108f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.287+0000 7f46d1745700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc109510 con 0x7f46cc108b10 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.287+0000 7f46caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.287+0000 7f46caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39810/0 (socket says 172.21.15.37:39810) 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.287+0000 7f46caffd700 1 -- 172.21.15.37:0/3294448652 learned_addr learned my addr 172.21.15.37:0/3294448652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.288+0000 7f46caffd700 1 -- 172.21.15.37:0/3294448652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc109ce0 con 0x7f46cc108b10 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.288+0000 7f46caffd700 1 --2- 172.21.15.37:0/3294448652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc108f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0098a0 tx=0x7f46bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a613f6de39d46 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:23.315 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.288+0000 7f46c9ffb700 1 -- 172.21.15.37:0/3294448652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46bc004160 con 0x7f46cc108b10 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.288+0000 7f46c9ffb700 1 -- 172.21.15.37:0/3294448652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46bc004300 con 0x7f46cc108b10 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.288+0000 7f46c9ffb700 1 -- 172.21.15.37:0/3294448652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46bc011a20 con 0x7f46cc108b10 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.289+0000 7f46d1745700 1 -- 172.21.15.37:0/3294448652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 msgr2=0x7f46cc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.289+0000 7f46d1745700 1 --2- 172.21.15.37:0/3294448652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc108f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46bc0098a0 tx=0x7f46bc009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.289+0000 7f46d1745700 1 -- 172.21.15.37:0/3294448652 shutdown_connections 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.289+0000 7f46d1745700 1 --2- 172.21.15.37:0/3294448652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc108f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.289+0000 7f46d1745700 1 -- 172.21.15.37:0/3294448652 >> 172.21.15.37:0/3294448652 conn(0x7f46cc1041d0 msgr2=0x7f46cc106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.289+0000 7f46d1745700 1 -- 172.21.15.37:0/3294448652 shutdown_connections 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.289+0000 7f46d1745700 1 -- 172.21.15.37:0/3294448652 wait complete. 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.290+0000 7f46d1745700 1 Processor -- start 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.290+0000 7f46d1745700 1 -- start start 2024-05-09T00:51:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.290+0000 7f46d1745700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.290+0000 7f46d1745700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10d090 con 0x7f46cc108b10 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.290+0000 7f46caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.290+0000 7f46caffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc19e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39814/0 (socket says 172.21.15.37:39814) 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.290+0000 7f46caffd700 1 -- 172.21.15.37:0/1799149686 learned_addr learned my addr 172.21.15.37:0/1799149686 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.291+0000 7f46caffd700 1 -- 172.21.15.37:0/1799149686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc19e5a0 con 0x7f46cc108b10 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.291+0000 7f46caffd700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc19e060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009130 tx=0x7f46bc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.291+0000 7f46b3fff700 1 -- 172.21.15.37:0/1799149686 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46bc003aa0 con 0x7f46cc108b10 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.291+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc19e830 con 0x7f46cc108b10 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.291+0000 7f46b3fff700 1 -- 172.21.15.37:0/1799149686 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46bc01a8e0 con 0x7f46cc108b10 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.291+0000 7f46b3fff700 1 -- 172.21.15.37:0/1799149686 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46bc0248f0 con 0x7f46cc108b10 2024-05-09T00:51:23.317 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.291+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc1a1440 con 0x7f46cc108b10 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.292+0000 7f46b3fff700 1 -- 172.21.15.37:0/1799149686 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f46bc022020 con 0x7f46cc108b10 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.292+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46cc064e20 con 0x7f46cc108b10 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.293+0000 7f46b3fff700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f46b403e4c0 0x7f46b40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.293+0000 7f46b3fff700 1 -- 172.21.15.37:0/1799149686 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f46bc054900 con 0x7f46cc108b10 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.293+0000 7f46ca7fc700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f46b403e4c0 0x7f46b40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.293+0000 7f46ca7fc700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f46b403e4c0 0x7f46b40409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46c0006fd0 tx=0x7f46c0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.298+0000 7f46b3fff700 1 -- 172.21.15.37:0/1799149686 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f46bc029df0 con 0x7f46cc108b10 2024-05-09T00:51:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.529+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f46cc1974d0 con 0x7f46b403e4c0 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.776+0000 7f46b3fff700 1 -- 172.21.15.37:0/1799149686 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f46cc1974d0 con 0x7f46b403e4c0 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f46b403e4c0 msgr2=0x7f46b40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f46b403e4c0 0x7f46b40409d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46c0006fd0 tx=0x7f46c0006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 msgr2=0x7f46cc19e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc19e060 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009130 tx=0x7f46bc011aa0 comp rx=0 tx=0).stop 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 shutdown_connections 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f46b403e4c0 0x7f46b40409d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 --2- 172.21.15.37:0/1799149686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46cc108b10 0x7f46cc19e060 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:23.319 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 >> 172.21.15.37:0/1799149686 conn(0x7f46cc1041d0 msgr2=0x7f46cc194610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:23.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 shutdown_connections 2024-05-09T00:51:23.320 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:22.779+0000 7f46d1745700 1 -- 172.21.15.37:0/1799149686 wait complete. 2024-05-09T00:51:23.320 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-05-09T00:51:23.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:23.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:23 smithi037 ceph-mon[30122]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:23.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:24 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/893468856' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-09T00:51:25.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-05-09T00:51:25.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.750+0000 7f2a1841c700 1 Processor -- start 2024-05-09T00:51:25.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.750+0000 7f2a1841c700 1 -- start start 2024-05-09T00:51:25.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a1841c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1010cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:25.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a1841c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1007cdf0 con 0x7f2a1010a770 2024-05-09T00:51:25.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a161b8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1010cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a161b8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1010cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39830/0 (socket says 172.21.15.37:39830) 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a161b8700 1 -- 172.21.15.37:0/3050317249 learned_addr learned my addr 172.21.15.37:0/3050317249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a161b8700 1 -- 172.21.15.37:0/3050317249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1010d0d0 con 0x7f2a1010a770 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a161b8700 1 --2- 172.21.15.37:0/3050317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1010cb90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e80 tx=0x7f2a0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7d0e679a8882a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.751+0000 7f2a151b6700 1 -- 172.21.15.37:0/3050317249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00017070 con 0x7f2a1010a770 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a151b6700 1 -- 172.21.15.37:0/3050317249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a0000b8c0 con 0x7f2a1010a770 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a151b6700 1 -- 172.21.15.37:0/3050317249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00004490 con 0x7f2a1010a770 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a1841c700 1 -- 172.21.15.37:0/3050317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 msgr2=0x7f2a1010cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a1841c700 1 --2- 172.21.15.37:0/3050317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1010cb90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009e80 tx=0x7f2a0000b330 comp rx=0 tx=0).stop 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a1841c700 1 -- 172.21.15.37:0/3050317249 shutdown_connections 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a1841c700 1 --2- 172.21.15.37:0/3050317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1010cb90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:25.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a1841c700 1 -- 172.21.15.37:0/3050317249 >> 172.21.15.37:0/3050317249 conn(0x7f2a101041d0 msgr2=0x7f2a10106620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a1841c700 1 -- 172.21.15.37:0/3050317249 shutdown_connections 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.752+0000 7f2a1841c700 1 -- 172.21.15.37:0/3050317249 wait complete. 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.753+0000 7f2a1841c700 1 Processor -- start 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.753+0000 7f2a1841c700 1 -- start start 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.753+0000 7f2a1841c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.753+0000 7f2a1841c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1010e070 con 0x7f2a1010a770 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.753+0000 7f2a161b8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.753+0000 7f2a161b8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39836/0 (socket says 172.21.15.37:39836) 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.753+0000 7f2a161b8700 1 -- 172.21.15.37:0/893468856 learned_addr learned my addr 172.21.15.37:0/893468856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.754+0000 7f2a161b8700 1 -- 172.21.15.37:0/893468856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1019e560 con 0x7f2a1010a770 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.754+0000 7f2a161b8700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1019e020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000b7b0 tx=0x7f2a0000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.754+0000 7f2a0f7fe700 1 -- 172.21.15.37:0/893468856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00020020 con 0x7f2a1010a770 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.754+0000 7f2a0f7fe700 1 -- 172.21.15.37:0/893468856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a00012430 con 0x7f2a1010a770 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.754+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1019e7f0 con 0x7f2a1010a770 2024-05-09T00:51:25.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.754+0000 7f2a0f7fe700 1 -- 172.21.15.37:0/893468856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00017040 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.754+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a101a1400 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.755+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a10064e20 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.755+0000 7f2a0f7fe700 1 -- 172.21.15.37:0/893468856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f2a00023020 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.755+0000 7f2a0f7fe700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29f803e4c0 0x7f29f80409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.756+0000 7f2a0f7fe700 1 -- 172.21.15.37:0/893468856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2a0000f050 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.756+0000 7f2a159b7700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29f803e4c0 0x7f29f80409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.756+0000 7f2a159b7700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29f803e4c0 0x7f29f80409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a04006fd0 tx=0x7f2a04006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.761+0000 7f2a0f7fe700 1 -- 172.21.15.37:0/893468856 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2a0002a020 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.982+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f2a101a15d0 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.982+0000 7f2a0f7fe700 1 -- 172.21.15.37:0/893468856 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f2a101a15d0 con 0x7f2a1010a770 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29f803e4c0 msgr2=0x7f29f80409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29f803e4c0 0x7f29f80409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a04006fd0 tx=0x7f2a04006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:25.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 msgr2=0x7f2a1019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:25.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1019e020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000b7b0 tx=0x7f2a0000bd30 comp rx=0 tx=0).stop 2024-05-09T00:51:25.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 shutdown_connections 2024-05-09T00:51:25.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29f803e4c0 0x7f29f80409d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:25.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 --2- 172.21.15.37:0/893468856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a1010a770 0x7f2a1019e020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:25.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 >> 172.21.15.37:0/893468856 conn(0x7f2a101041d0 msgr2=0x7f2a10105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:25.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 shutdown_connections 2024-05-09T00:51:25.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:23.985+0000 7f2a1841c700 1 -- 172.21.15.37:0/893468856 wait complete. 2024-05-09T00:51:25.075 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T00:51:25.075 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-05-09T00:51:25.085 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T00:51:25.085 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-05-09T00:51:25.085 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-05-09T00:51:25.085 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-09T00:51:25.088 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-05-09T00:51:25.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:25.088 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037.front.sepia.ceph.com:8443/ 2024-05-09T00:51:25.088 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-05-09T00:51:25.088 INFO:teuthology.orchestra.run.smithi037.stdout: Password: pbe97etjzc 2024-05-09T00:51:25.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:25.089 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config directory 2024-05-09T00:51:25.089 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling autotune for osd_memory_target 2024-05-09T00:51:26.665 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.883+0000 7fd111b4f700 1 Processor -- start 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.883+0000 7fd111b4f700 1 -- start start 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.883+0000 7fd111b4f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.883+0000 7fd111b4f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c07d820 con 0x7fd10c1085a0 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.884+0000 7fd10b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.884+0000 7fd10b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1089b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39846/0 (socket says 172.21.15.37:39846) 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.884+0000 7fd10b7fe700 1 -- 172.21.15.37:0/1833240856 learned_addr learned my addr 172.21.15.37:0/1833240856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.884+0000 7fd10b7fe700 1 -- 172.21.15.37:0/1833240856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c108ef0 con 0x7fd10c1085a0 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.884+0000 7fd10b7fe700 1 --2- 172.21.15.37:0/1833240856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1089b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0098a0 tx=0x7fd0fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1317583e771fba3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.884+0000 7fd10a7fc700 1 -- 172.21.15.37:0/1833240856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc004160 con 0x7fd10c1085a0 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.884+0000 7fd10a7fc700 1 -- 172.21.15.37:0/1833240856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0fc004300 con 0x7fd10c1085a0 2024-05-09T00:51:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.885+0000 7fd10a7fc700 1 -- 172.21.15.37:0/1833240856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc011a20 con 0x7fd10c1085a0 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.885+0000 7fd111b4f700 1 -- 172.21.15.37:0/1833240856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 msgr2=0x7fd10c1089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.885+0000 7fd111b4f700 1 --2- 172.21.15.37:0/1833240856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1089b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0098a0 tx=0x7fd0fc009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.886+0000 7fd111b4f700 1 -- 172.21.15.37:0/1833240856 shutdown_connections 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.886+0000 7fd111b4f700 1 --2- 172.21.15.37:0/1833240856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1089b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.886+0000 7fd111b4f700 1 -- 172.21.15.37:0/1833240856 >> 172.21.15.37:0/1833240856 conn(0x7fd10c104190 msgr2=0x7fd10c106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.886+0000 7fd111b4f700 1 -- 172.21.15.37:0/1833240856 shutdown_connections 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.886+0000 7fd111b4f700 1 -- 172.21.15.37:0/1833240856 wait complete. 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.886+0000 7fd111b4f700 1 Processor -- start 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd111b4f700 1 -- start start 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd111b4f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd111b4f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd10c109fb0 con 0x7fd10c1085a0 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd10b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd10b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39852/0 (socket says 172.21.15.37:39852) 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd10b7fe700 1 -- 172.21.15.37:0/2989646303 learned_addr learned my addr 172.21.15.37:0/2989646303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd10b7fe700 1 -- 172.21.15.37:0/2989646303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10c1a0770 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.887+0000 7fd10b7fe700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1a0230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc004660 tx=0x7fd0fc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.888+0000 7fd108ff9700 1 -- 172.21.15.37:0/2989646303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc003a60 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.888+0000 7fd108ff9700 1 -- 172.21.15.37:0/2989646303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0fc01b8f0 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.888+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10c1a0a00 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.888+0000 7fd108ff9700 1 -- 172.21.15.37:0/2989646303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0fc023890 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.888+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10c1a3610 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.889+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd10c064e20 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.889+0000 7fd108ff9700 1 -- 172.21.15.37:0/2989646303 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd0fc02c3f0 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.889+0000 7fd108ff9700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0f803e570 0x7fd0f8040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.889+0000 7fd108ff9700 1 -- 172.21.15.37:0/2989646303 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd0fc054120 con 0x7fd10c1085a0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.890+0000 7fd10affd700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0f803e570 0x7fd0f8040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.890+0000 7fd10affd700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0f803e570 0x7fd0f8040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006fd0 tx=0x7fd0f4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:25.895+0000 7fd108ff9700 1 -- 172.21.15.37:0/2989646303 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd0fc01f030 con 0x7fd10c1085a0 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.112+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fd10c02e8d0 con 0x7fd10c1085a0 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.112+0000 7fd108ff9700 1 -- 172.21.15.37:0/2989646303 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fd0fc0202b0 con 0x7fd10c1085a0 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0f803e570 msgr2=0x7fd0f8040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0f803e570 0x7fd0f8040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006fd0 tx=0x7fd0f4006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 msgr2=0x7fd10c1a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1a0230 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc004660 tx=0x7fd0fc011aa0 comp rx=0 tx=0).stop 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 shutdown_connections 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0f803e570 0x7fd0f8040a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 --2- 172.21.15.37:0/2989646303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10c1085a0 0x7fd10c1a0230 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 >> 172.21.15.37:0/2989646303 conn(0x7fd10c104190 msgr2=0x7fd10c194230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 shutdown_connections 2024-05-09T00:51:26.669 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:26.115+0000 7fd111b4f700 1 -- 172.21.15.37:0/2989646303 wait complete. 2024-05-09T00:51:26.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:26 smithi037 ceph-mon[30122]: mgrmap e13: x(active, since 6s) 2024-05-09T00:51:28.064 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.111+0000 7fe68d225700 1 Processor -- start 2024-05-09T00:51:28.064 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.111+0000 7fe68d225700 1 -- start start 2024-05-09T00:51:28.064 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.111+0000 7fe68d225700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68810a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:28.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.111+0000 7fe68d225700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe68810a5f0 con 0x7fe688109bf0 2024-05-09T00:51:28.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.111+0000 7fe686d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68810a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:28.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.111+0000 7fe686d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68810a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39868/0 (socket says 172.21.15.37:39868) 2024-05-09T00:51:28.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.111+0000 7fe686d9d700 1 -- 172.21.15.37:0/945656405 learned_addr learned my addr 172.21.15.37:0/945656405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:28.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.112+0000 7fe686d9d700 1 -- 172.21.15.37:0/945656405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68810adc0 con 0x7fe688109bf0 2024-05-09T00:51:28.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.112+0000 7fe686d9d700 1 --2- 172.21.15.37:0/945656405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68810a000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6780098a0 tx=0x7fe678009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d046b802654346 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:28.065 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.112+0000 7fe685d9b700 1 -- 172.21.15.37:0/945656405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe678004160 con 0x7fe688109bf0 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.112+0000 7fe685d9b700 1 -- 172.21.15.37:0/945656405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe678004300 con 0x7fe688109bf0 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.112+0000 7fe685d9b700 1 -- 172.21.15.37:0/945656405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe678011a20 con 0x7fe688109bf0 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.113+0000 7fe68d225700 1 -- 172.21.15.37:0/945656405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 msgr2=0x7fe68810a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.113+0000 7fe68d225700 1 --2- 172.21.15.37:0/945656405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68810a000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe6780098a0 tx=0x7fe678009bb0 comp rx=0 tx=0).stop 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.113+0000 7fe68d225700 1 -- 172.21.15.37:0/945656405 shutdown_connections 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.113+0000 7fe68d225700 1 --2- 172.21.15.37:0/945656405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68810a000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.113+0000 7fe68d225700 1 -- 172.21.15.37:0/945656405 >> 172.21.15.37:0/945656405 conn(0x7fe688105330 msgr2=0x7fe688107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.113+0000 7fe68d225700 1 -- 172.21.15.37:0/945656405 shutdown_connections 2024-05-09T00:51:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.113+0000 7fe68d225700 1 -- 172.21.15.37:0/945656405 wait complete. 2024-05-09T00:51:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.114+0000 7fe68d225700 1 Processor -- start 2024-05-09T00:51:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.114+0000 7fe68d225700 1 -- start start 2024-05-09T00:51:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.114+0000 7fe68d225700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68819e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.114+0000 7fe68d225700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe68810e170 con 0x7fe688109bf0 2024-05-09T00:51:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.114+0000 7fe686d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68819e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.114+0000 7fe686d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68819e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39872/0 (socket says 172.21.15.37:39872) 2024-05-09T00:51:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.114+0000 7fe686d9d700 1 -- 172.21.15.37:0/2163261903 learned_addr learned my addr 172.21.15.37:0/2163261903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.115+0000 7fe686d9d700 1 -- 172.21.15.37:0/2163261903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68819e590 con 0x7fe688109bf0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.115+0000 7fe686d9d700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68819e050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe678011a20 tx=0x7fe678011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.115+0000 7fe66ffff700 1 -- 172.21.15.37:0/2163261903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6780039c0 con 0x7fe688109bf0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.115+0000 7fe66ffff700 1 -- 172.21.15.37:0/2163261903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe678003b60 con 0x7fe688109bf0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.115+0000 7fe66ffff700 1 -- 172.21.15.37:0/2163261903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe678019700 con 0x7fe688109bf0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.115+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68819e820 con 0x7fe688109bf0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.115+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6881a1430 con 0x7fe688109bf0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.116+0000 7fe66ffff700 1 -- 172.21.15.37:0/2163261903 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fe678019a00 con 0x7fe688109bf0 2024-05-09T00:51:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.116+0000 7fe66ffff700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe67003e570 0x7fe670040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.116+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe688064e20 con 0x7fe688109bf0 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.116+0000 7fe66ffff700 1 -- 172.21.15.37:0/2163261903 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe678054e90 con 0x7fe688109bf0 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.116+0000 7fe68659c700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe67003e570 0x7fe670040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.117+0000 7fe68659c700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe67003e570 0x7fe670040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe67c006fd0 tx=0x7fe67c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.122+0000 7fe66ffff700 1 -- 172.21.15.37:0/2163261903 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe678017e90 con 0x7fe688109bf0 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.453+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fe6881a1a00 con 0x7fe688109bf0 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.456+0000 7fe66ffff700 1 -- 172.21.15.37:0/2163261903 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fe678023390 con 0x7fe688109bf0 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.458+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe67003e570 msgr2=0x7fe670040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.458+0000 7fe68d225700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe67003e570 0x7fe670040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe67c006fd0 tx=0x7fe67c006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:28.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.458+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 msgr2=0x7fe68819e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.458+0000 7fe68d225700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68819e050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe678011a20 tx=0x7fe678011b00 comp rx=0 tx=0).stop 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.458+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 shutdown_connections 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.459+0000 7fe68d225700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe67003e570 0x7fe670040a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.459+0000 7fe68d225700 1 --2- 172.21.15.37:0/2163261903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe688109bf0 0x7fe68819e050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.459+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 >> 172.21.15.37:0/2163261903 conn(0x7fe688105330 msgr2=0x7fe688106c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.459+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 shutdown_connections 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-05-09T00:51:27.459+0000 7fe68d225700 1 -- 172.21.15.37:0/2163261903 wait complete. 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:51:28.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-09T00:51:28.071 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:28.072 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-05-09T00:51:28.107 INFO:tasks.cephadm:Fetching config... 2024-05-09T00:51:28.107 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:51:28.108 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-09T00:51:28.125 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-09T00:51:28.125 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:51:28.126 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-09T00:51:28.182 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-09T00:51:28.183 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:51:28.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-09T00:51:28.249 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-09T00:51:28.249 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:51:28.249 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-09T00:51:28.306 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-09T00:51:28.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFoljjP9ap8IQ3zIdf1XcYfGD9kak+/e1fMvNOoKH+iOznJEqTywp/JYjJQ90tGyONpzVGc0/C4lKkpjJEdvzGC1htS9ALMLvc0telZhbUm+hJxDhlFJqnGePIzTGApRNKiyQOYfwxKsIt2PWTOna9oaBF7f1Cy3CIAS3tkMcsXhnbp2jFEEgqpFMpgQXHTX2WUXRz8WBVxaEt/atMA4cO/vq5/ZY9QjK8e9Nuvruzfz1TNgnxACUJFYa1jPykT2zNQkOODvmsjb92Ol8nWbxRYFaBKj/K6UOFmhT/bKqolicObPJ/B03zVqrgDU4efT3z0nmlkEdnAZ7rEJffmMSFmvkyB6dxjyTapUvIEOjpHGgKBUN7EnqEvkF72qHvgjG6zdaZUswHBJK3eU99ipc/8aabBlV8iKdVyPL192FP4C/xreu0i08Q3CMPiOGTz/syhskjMW2xtisjM9w6zhlVKZsS6gcnsQsjhpHEASfU7SptmpGmIj/nzk0EGyOtHGU= ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T00:51:28.381 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFoljjP9ap8IQ3zIdf1XcYfGD9kak+/e1fMvNOoKH+iOznJEqTywp/JYjJQ90tGyONpzVGc0/C4lKkpjJEdvzGC1htS9ALMLvc0telZhbUm+hJxDhlFJqnGePIzTGApRNKiyQOYfwxKsIt2PWTOna9oaBF7f1Cy3CIAS3tkMcsXhnbp2jFEEgqpFMpgQXHTX2WUXRz8WBVxaEt/atMA4cO/vq5/ZY9QjK8e9Nuvruzfz1TNgnxACUJFYa1jPykT2zNQkOODvmsjb92Ol8nWbxRYFaBKj/K6UOFmhT/bKqolicObPJ/B03zVqrgDU4efT3z0nmlkEdnAZ7rEJffmMSFmvkyB6dxjyTapUvIEOjpHGgKBUN7EnqEvkF72qHvgjG6zdaZUswHBJK3eU99ipc/8aabBlV8iKdVyPL192FP4C/xreu0i08Q3CMPiOGTz/syhskjMW2xtisjM9w6zhlVKZsS6gcnsQsjhpHEASfU7SptmpGmIj/nzk0EGyOtHGU= ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:51:28.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFoljjP9ap8IQ3zIdf1XcYfGD9kak+/e1fMvNOoKH+iOznJEqTywp/JYjJQ90tGyONpzVGc0/C4lKkpjJEdvzGC1htS9ALMLvc0telZhbUm+hJxDhlFJqnGePIzTGApRNKiyQOYfwxKsIt2PWTOna9oaBF7f1Cy3CIAS3tkMcsXhnbp2jFEEgqpFMpgQXHTX2WUXRz8WBVxaEt/atMA4cO/vq5/ZY9QjK8e9Nuvruzfz1TNgnxACUJFYa1jPykT2zNQkOODvmsjb92Ol8nWbxRYFaBKj/K6UOFmhT/bKqolicObPJ/B03zVqrgDU4efT3z0nmlkEdnAZ7rEJffmMSFmvkyB6dxjyTapUvIEOjpHGgKBUN7EnqEvkF72qHvgjG6zdaZUswHBJK3eU99ipc/8aabBlV8iKdVyPL192FP4C/xreu0i08Q3CMPiOGTz/syhskjMW2xtisjM9w6zhlVKZsS6gcnsQsjhpHEASfU7SptmpGmIj/nzk0EGyOtHGU= ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T00:51:28.431 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFoljjP9ap8IQ3zIdf1XcYfGD9kak+/e1fMvNOoKH+iOznJEqTywp/JYjJQ90tGyONpzVGc0/C4lKkpjJEdvzGC1htS9ALMLvc0telZhbUm+hJxDhlFJqnGePIzTGApRNKiyQOYfwxKsIt2PWTOna9oaBF7f1Cy3CIAS3tkMcsXhnbp2jFEEgqpFMpgQXHTX2WUXRz8WBVxaEt/atMA4cO/vq5/ZY9QjK8e9Nuvruzfz1TNgnxACUJFYa1jPykT2zNQkOODvmsjb92Ol8nWbxRYFaBKj/K6UOFmhT/bKqolicObPJ/B03zVqrgDU4efT3z0nmlkEdnAZ7rEJffmMSFmvkyB6dxjyTapUvIEOjpHGgKBUN7EnqEvkF72qHvgjG6zdaZUswHBJK3eU99ipc/8aabBlV8iKdVyPL192FP4C/xreu0i08Q3CMPiOGTz/syhskjMW2xtisjM9w6zhlVKZsS6gcnsQsjhpHEASfU7SptmpGmIj/nzk0EGyOtHGU= ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:51:28.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFoljjP9ap8IQ3zIdf1XcYfGD9kak+/e1fMvNOoKH+iOznJEqTywp/JYjJQ90tGyONpzVGc0/C4lKkpjJEdvzGC1htS9ALMLvc0telZhbUm+hJxDhlFJqnGePIzTGApRNKiyQOYfwxKsIt2PWTOna9oaBF7f1Cy3CIAS3tkMcsXhnbp2jFEEgqpFMpgQXHTX2WUXRz8WBVxaEt/atMA4cO/vq5/ZY9QjK8e9Nuvruzfz1TNgnxACUJFYa1jPykT2zNQkOODvmsjb92Ol8nWbxRYFaBKj/K6UOFmhT/bKqolicObPJ/B03zVqrgDU4efT3z0nmlkEdnAZ7rEJffmMSFmvkyB6dxjyTapUvIEOjpHGgKBUN7EnqEvkF72qHvgjG6zdaZUswHBJK3eU99ipc/8aabBlV8iKdVyPL192FP4C/xreu0i08Q3CMPiOGTz/syhskjMW2xtisjM9w6zhlVKZsS6gcnsQsjhpHEASfU7SptmpGmIj/nzk0EGyOtHGU= ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T00:51:28.483 INFO:teuthology.orchestra.run.smithi151.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFoljjP9ap8IQ3zIdf1XcYfGD9kak+/e1fMvNOoKH+iOznJEqTywp/JYjJQ90tGyONpzVGc0/C4lKkpjJEdvzGC1htS9ALMLvc0telZhbUm+hJxDhlFJqnGePIzTGApRNKiyQOYfwxKsIt2PWTOna9oaBF7f1Cy3CIAS3tkMcsXhnbp2jFEEgqpFMpgQXHTX2WUXRz8WBVxaEt/atMA4cO/vq5/ZY9QjK8e9Nuvruzfz1TNgnxACUJFYa1jPykT2zNQkOODvmsjb92Ol8nWbxRYFaBKj/K6UOFmhT/bKqolicObPJ/B03zVqrgDU4efT3z0nmlkEdnAZ7rEJffmMSFmvkyB6dxjyTapUvIEOjpHGgKBUN7EnqEvkF72qHvgjG6zdaZUswHBJK3eU99ipc/8aabBlV8iKdVyPL192FP4C/xreu0i08Q3CMPiOGTz/syhskjMW2xtisjM9w6zhlVKZsS6gcnsQsjhpHEASfU7SptmpGmIj/nzk0EGyOtHGU= ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:51:28.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-09T00:51:28.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:28 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2163261903' entity='client.admin' 2024-05-09T00:51:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:51:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.490+0000 7f94e580d700 1 -- 172.21.15.37:0/1137864768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 msgr2=0x7f94e0102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.490+0000 7f94e580d700 1 --2- 172.21.15.37:0/1137864768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e0102ee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009910 tx=0x7f94d0009c20 comp rx=0 tx=0).stop 2024-05-09T00:51:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.490+0000 7f94e580d700 1 -- 172.21.15.37:0/1137864768 shutdown_connections 2024-05-09T00:51:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.490+0000 7f94e580d700 1 --2- 172.21.15.37:0/1137864768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e0102ee0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.490+0000 7f94e580d700 1 -- 172.21.15.37:0/1137864768 >> 172.21.15.37:0/1137864768 conn(0x7f94e00fe110 msgr2=0x7f94e01005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.490+0000 7f94e580d700 1 -- 172.21.15.37:0/1137864768 shutdown_connections 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.490+0000 7f94e580d700 1 -- 172.21.15.37:0/1137864768 wait complete. 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.491+0000 7f94e580d700 1 Processor -- start 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.491+0000 7f94e580d700 1 -- start start 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.491+0000 7f94e580d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e006c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.491+0000 7f94e580d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0108a90 con 0x7f94e0102ad0 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.491+0000 7f94deffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e006c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.491+0000 7f94deffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e006c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39900/0 (socket says 172.21.15.37:39900) 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.491+0000 7f94deffd700 1 -- 172.21.15.37:0/3900147169 learned_addr learned my addr 172.21.15.37:0/3900147169 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.492+0000 7f94deffd700 1 -- 172.21.15.37:0/3900147169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e006c6e0 con 0x7f94e0102ad0 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.492+0000 7f94deffd700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e006c1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94d00057d0 tx=0x7f94d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.492+0000 7f94e480b700 1 -- 172.21.15.37:0/3900147169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0027070 con 0x7f94e0102ad0 2024-05-09T00:51:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.492+0000 7f94e480b700 1 -- 172.21.15.37:0/3900147169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d000be10 con 0x7f94e0102ad0 2024-05-09T00:51:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.492+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e019c4a0 con 0x7f94e0102ad0 2024-05-09T00:51:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.492+0000 7f94e480b700 1 -- 172.21.15.37:0/3900147169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d0022dd0 con 0x7f94e0102ad0 2024-05-09T00:51:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.492+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e019c920 con 0x7f94e0102ad0 2024-05-09T00:51:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.493+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e0109210 con 0x7f94e0102ad0 2024-05-09T00:51:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.493+0000 7f94e480b700 1 -- 172.21.15.37:0/3900147169 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f94d002a070 con 0x7f94e0102ad0 2024-05-09T00:51:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.494+0000 7f94e480b700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94c803e4c0 0x7f94c80409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.494+0000 7f94e480b700 1 -- 172.21.15.37:0/3900147169 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f94d001e030 con 0x7f94e0102ad0 2024-05-09T00:51:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.494+0000 7f94de7fc700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94c803e4c0 0x7f94c80409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.494+0000 7f94de7fc700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94c803e4c0 0x7f94c80409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f94d4006fd0 tx=0x7f94d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.499+0000 7f94e480b700 1 -- 172.21.15.37:0/3900147169 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f94d0013070 con 0x7f94e0102ad0 2024-05-09T00:51:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.712+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f94e002e870 con 0x7f94e0102ad0 2024-05-09T00:51:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.715+0000 7f94e480b700 1 -- 172.21.15.37:0/3900147169 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f94d00310c0 con 0x7f94e0102ad0 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94c803e4c0 msgr2=0x7f94c80409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94c803e4c0 0x7f94c80409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f94d4006fd0 tx=0x7f94d4006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 msgr2=0x7f94e006c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e006c1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94d00057d0 tx=0x7f94d0005800 comp rx=0 tx=0).stop 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 shutdown_connections 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94c803e4c0 0x7f94c80409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 --2- 172.21.15.37:0/3900147169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0102ad0 0x7f94e006c1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 >> 172.21.15.37:0/3900147169 conn(0x7f94e00fe110 msgr2=0x7f94e00fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 shutdown_connections 2024-05-09T00:51:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:30.717+0000 7f94e580d700 1 -- 172.21.15.37:0/3900147169 wait complete. 2024-05-09T00:51:31.475 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-09T00:51:31.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-09T00:51:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:51:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:31 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3900147169' entity='client.admin' 2024-05-09T00:51:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:51:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:51:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.261+0000 7f146e643700 1 -- 172.21.15.37:0/4178658392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 msgr2=0x7f1468102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.261+0000 7f146e643700 1 --2- 172.21.15.37:0/4178658392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468102ef0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1458009910 tx=0x7f1458009c20 comp rx=0 tx=0).stop 2024-05-09T00:51:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.261+0000 7f146e643700 1 -- 172.21.15.37:0/4178658392 shutdown_connections 2024-05-09T00:51:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.261+0000 7f146e643700 1 --2- 172.21.15.37:0/4178658392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468102ef0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.261+0000 7f146e643700 1 -- 172.21.15.37:0/4178658392 >> 172.21.15.37:0/4178658392 conn(0x7f14680fe140 msgr2=0x7f14681005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.262+0000 7f146e643700 1 -- 172.21.15.37:0/4178658392 shutdown_connections 2024-05-09T00:51:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.262+0000 7f146e643700 1 -- 172.21.15.37:0/4178658392 wait complete. 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.262+0000 7f146e643700 1 Processor -- start 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.262+0000 7f146e643700 1 -- start start 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f146e643700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f146e643700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1468108aa0 con 0x7f1468102ae0 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f1467fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f1467fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53030/0 (socket says 172.21.15.37:53030) 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f1467fff700 1 -- 172.21.15.37:0/3724977182 learned_addr learned my addr 172.21.15.37:0/3724977182 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f1467fff700 1 -- 172.21.15.37:0/3724977182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1468198b40 con 0x7f1468102ae0 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f1467fff700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468198600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14580057d0 tx=0x7f1458005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f1465ffb700 1 -- 172.21.15.37:0/3724977182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1458027070 con 0x7f1468102ae0 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1468198dd0 con 0x7f1468102ae0 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.263+0000 7f1465ffb700 1 -- 172.21.15.37:0/3724977182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f145800be10 con 0x7f1468102ae0 2024-05-09T00:51:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.264+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146819b9e0 con 0x7f1468102ae0 2024-05-09T00:51:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.264+0000 7f1465ffb700 1 -- 172.21.15.37:0/3724977182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1458022dd0 con 0x7f1468102ae0 2024-05-09T00:51:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.264+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1468109220 con 0x7f1468102ae0 2024-05-09T00:51:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.265+0000 7f1465ffb700 1 -- 172.21.15.37:0/3724977182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f145802a070 con 0x7f1468102ae0 2024-05-09T00:51:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.265+0000 7f1465ffb700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f145403e4c0 0x7f14540409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.265+0000 7f1465ffb700 1 -- 172.21.15.37:0/3724977182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f145801e030 con 0x7f1468102ae0 2024-05-09T00:51:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.265+0000 7f145ffff700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f145403e4c0 0x7f14540409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.265+0000 7f145ffff700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f145403e4c0 0x7f14540409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1450006fd0 tx=0x7f1450006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.270+0000 7f1465ffb700 1 -- 172.21.15.37:0/3724977182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1458013070 con 0x7f1468102ae0 2024-05-09T00:51:33.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.490+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f146802e700 con 0x7f145403e4c0 2024-05-09T00:51:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.494+0000 7f1465ffb700 1 -- 172.21.15.37:0/3724977182 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f146802e700 con 0x7f145403e4c0 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f145403e4c0 msgr2=0x7f14540409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f145403e4c0 0x7f14540409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1450006fd0 tx=0x7f1450006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 msgr2=0x7f1468198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468198600 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f14580057d0 tx=0x7f1458005800 comp rx=0 tx=0).stop 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 shutdown_connections 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f145403e4c0 0x7f14540409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 --2- 172.21.15.37:0/3724977182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1468102ae0 0x7f1468198600 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.496+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 >> 172.21.15.37:0/3724977182 conn(0x7f14680fe140 msgr2=0x7f14680fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.497+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 shutdown_connections 2024-05-09T00:51:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:33.497+0000 7f146e643700 1 -- 172.21.15.37:0/3724977182 wait complete. 2024-05-09T00:51:34.229 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2024-05-09T00:51:34.229 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:51:34.230 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2024-05-09T00:51:34.248 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:51:34.248 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:51:34.305 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2024-05-09T00:51:34.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch host add smithi136 2024-05-09T00:51:34.558 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: Updating smithi037:/etc/ceph/ceph.conf 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: Updating smithi037:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:51:34.819 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:34 smithi037 ceph-mon[30122]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:51:35.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:35 smithi037 ceph-mon[30122]: Updating smithi037:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:51:35.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:35 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:35.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:35 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:35.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:35 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.149+0000 7f8d9242e700 1 -- 172.21.15.37:0/928609645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 msgr2=0x7f8d8c105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.149+0000 7f8d9242e700 1 --2- 172.21.15.37:0/928609645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c105190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009910 tx=0x7f8d7c009c20 comp rx=0 tx=0).stop 2024-05-09T00:51:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.149+0000 7f8d9242e700 1 -- 172.21.15.37:0/928609645 shutdown_connections 2024-05-09T00:51:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.149+0000 7f8d9242e700 1 --2- 172.21.15.37:0/928609645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c105190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.149+0000 7f8d9242e700 1 -- 172.21.15.37:0/928609645 >> 172.21.15.37:0/928609645 conn(0x7f8d8c0fe5b0 msgr2=0x7f8d8c100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.149+0000 7f8d9242e700 1 -- 172.21.15.37:0/928609645 shutdown_connections 2024-05-09T00:51:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.149+0000 7f8d9242e700 1 -- 172.21.15.37:0/928609645 wait complete. 2024-05-09T00:51:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.150+0000 7f8d9242e700 1 Processor -- start 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.150+0000 7f8d9242e700 1 -- start start 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.150+0000 7f8d9242e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.150+0000 7f8d9242e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c10e170 con 0x7f8d8c104d80 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c19f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53050/0 (socket says 172.21.15.37:53050) 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d8bfff700 1 -- 172.21.15.37:0/2680134987 learned_addr learned my addr 172.21.15.37:0/2680134987 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d8bfff700 1 -- 172.21.15.37:0/2680134987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c19fb40 con 0x7f8d8c104d80 2024-05-09T00:51:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d8bfff700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c19f600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006010 tx=0x7f8d7c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d897fa700 1 -- 172.21.15.37:0/2680134987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c026070 con 0x7f8d8c104d80 2024-05-09T00:51:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d897fa700 1 -- 172.21.15.37:0/2680134987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7c00bc00 con 0x7f8d8c104d80 2024-05-09T00:51:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c19fdd0 con 0x7f8d8c104d80 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d897fa700 1 -- 172.21.15.37:0/2680134987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d7c003910 con 0x7f8d8c104d80 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.151+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c199840 con 0x7f8d8c104d80 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.152+0000 7f8d897fa700 1 -- 172.21.15.37:0/2680134987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8d7c029070 con 0x7f8d8c104d80 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.152+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8c06c3c0 con 0x7f8d8c104d80 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.153+0000 7f8d897fa700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d7403e570 0x7f8d74040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.153+0000 7f8d897fa700 1 -- 172.21.15.37:0/2680134987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8d7c01e070 con 0x7f8d8c104d80 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.153+0000 7f8d8b7fe700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d7403e570 0x7f8d74040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.153+0000 7f8d8b7fe700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d7403e570 0x7f8d74040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d80006fd0 tx=0x7f8d80006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:36.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.158+0000 7f8d897fa700 1 -- 172.21.15.37:0/2680134987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8d7c013070 con 0x7f8d8c104d80 2024-05-09T00:51:36.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:36.378+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}) -- 0x7f8d8c19ad50 con 0x7f8d7403e570 2024-05-09T00:51:37.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:37 smithi037 ceph-mon[30122]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:37.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:37 smithi037 ceph-mon[30122]: Deploying cephadm binary to smithi136 2024-05-09T00:51:40.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:39 smithi037 ceph-mon[30122]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:40.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.682+0000 7f8d897fa700 1 -- 172.21.15.37:0/2680134987 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8d8c19ad50 con 0x7f8d7403e570 2024-05-09T00:51:40.683 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi136' with addr '172.21.15.136' 2024-05-09T00:51:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.684+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d7403e570 msgr2=0x7f8d74040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.684+0000 7f8d9242e700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d7403e570 0x7f8d74040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d80006fd0 tx=0x7f8d80006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.684+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 msgr2=0x7f8d8c19f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.684+0000 7f8d9242e700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c19f600 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c006010 tx=0x7f8d7c005780 comp rx=0 tx=0).stop 2024-05-09T00:51:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.685+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 shutdown_connections 2024-05-09T00:51:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.685+0000 7f8d9242e700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d7403e570 0x7f8d74040a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.685+0000 7f8d9242e700 1 --2- 172.21.15.37:0/2680134987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c104d80 0x7f8d8c19f600 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.685+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 >> 172.21.15.37:0/2680134987 conn(0x7f8d8c0fe5b0 msgr2=0x7f8d8c105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.685+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 shutdown_connections 2024-05-09T00:51:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:40.685+0000 7f8d9242e700 1 -- 172.21.15.37:0/2680134987 wait complete. 2024-05-09T00:51:41.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-09T00:51:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:51:41.931 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:41.932 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:41 smithi037 ceph-mon[30122]: Added host smithi136 2024-05-09T00:51:41.932 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:51:41.932 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:41 smithi037 ceph-mon[30122]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:41.932 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:42.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:42 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.961+0000 7ff27e2f5700 1 -- 172.21.15.37:0/3662683797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 msgr2=0x7ff2781041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.961+0000 7ff27e2f5700 1 --2- 172.21.15.37:0/3662683797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff2781041e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff268009910 tx=0x7ff268009c20 comp rx=0 tx=0).stop 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.961+0000 7ff27e2f5700 1 -- 172.21.15.37:0/3662683797 shutdown_connections 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.961+0000 7ff27e2f5700 1 --2- 172.21.15.37:0/3662683797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff2781041e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.961+0000 7ff27e2f5700 1 -- 172.21.15.37:0/3662683797 >> 172.21.15.37:0/3662683797 conn(0x7ff2780ff660 msgr2=0x7ff278101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.961+0000 7ff27e2f5700 1 -- 172.21.15.37:0/3662683797 shutdown_connections 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.961+0000 7ff27e2f5700 1 -- 172.21.15.37:0/3662683797 wait complete. 2024-05-09T00:51:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.962+0000 7ff27e2f5700 1 Processor -- start 2024-05-09T00:51:42.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.962+0000 7ff27e2f5700 1 -- start start 2024-05-09T00:51:42.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.962+0000 7ff27e2f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff278075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:42.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.962+0000 7ff27e2f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff27810e0c0 con 0x7ff278103dd0 2024-05-09T00:51:42.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff277fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff278075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:42.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff277fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff278075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56202/0 (socket says 172.21.15.37:56202) 2024-05-09T00:51:42.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff277fff700 1 -- 172.21.15.37:0/518564530 learned_addr learned my addr 172.21.15.37:0/518564530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:42.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff277fff700 1 -- 172.21.15.37:0/518564530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff278077910 con 0x7ff278103dd0 2024-05-09T00:51:42.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff277fff700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff278075ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff2680056d0 tx=0x7ff2680057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff275ffb700 1 -- 172.21.15.37:0/518564530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff268026070 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff278076000 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff275ffb700 1 -- 172.21.15.37:0/518564530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff26800bba0 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff275ffb700 1 -- 172.21.15.37:0/518564530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff268003920 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.963+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2780764c0 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.964+0000 7ff275ffb700 1 -- 172.21.15.37:0/518564530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff268029070 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.964+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff278105280 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.964+0000 7ff275ffb700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff26403e510 0x7ff264040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.965+0000 7ff275ffb700 1 -- 172.21.15.37:0/518564530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff26801e070 con 0x7ff278103dd0 2024-05-09T00:51:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.965+0000 7ff26ffff700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff26403e510 0x7ff264040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:42.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.965+0000 7ff26ffff700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff26403e510 0x7ff264040a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff260006fd0 tx=0x7ff260006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:42.970+0000 7ff275ffb700 1 -- 172.21.15.37:0/518564530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff268013070 con 0x7ff278103dd0 2024-05-09T00:51:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.192+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff278077090 con 0x7ff26403e510 2024-05-09T00:51:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.194+0000 7ff275ffb700 1 -- 172.21.15.37:0/518564530 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7ff278077090 con 0x7ff26403e510 2024-05-09T00:51:43.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:43.195 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2024-05-09T00:51:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.196+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff26403e510 msgr2=0x7ff264040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.196+0000 7ff27e2f5700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff26403e510 0x7ff264040a20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff260006fd0 tx=0x7ff260006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.196+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 msgr2=0x7ff278075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.196+0000 7ff27e2f5700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff278075ac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff2680056d0 tx=0x7ff2680057b0 comp rx=0 tx=0).stop 2024-05-09T00:51:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.197+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 shutdown_connections 2024-05-09T00:51:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.197+0000 7ff27e2f5700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff26403e510 0x7ff264040a20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.197+0000 7ff27e2f5700 1 --2- 172.21.15.37:0/518564530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff278103dd0 0x7ff278075ac0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.197+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 >> 172.21.15.37:0/518564530 conn(0x7ff2780ff660 msgr2=0x7ff278109900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.197+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 shutdown_connections 2024-05-09T00:51:43.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:43.197+0000 7ff27e2f5700 1 -- 172.21.15.37:0/518564530 wait complete. 2024-05-09T00:51:43.844 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi151 2024-05-09T00:51:43.844 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:51:43.844 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.conf 2024-05-09T00:51:43.862 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:51:43.862 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:51:43.919 INFO:tasks.cephadm:Adding host smithi151 to orchestrator... 2024-05-09T00:51:43.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch host add smithi151 2024-05-09T00:51:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:51:44.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:43 smithi037 ceph-mon[30122]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:44.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:43 smithi037 ceph-mon[30122]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:51:44.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:45.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.719+0000 7f725bce2700 1 -- 172.21.15.37:0/1844673897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 msgr2=0x7f7254108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:45.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.719+0000 7f725bce2700 1 --2- 172.21.15.37:0/1844673897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f7254108e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7250009910 tx=0x7f7250009c20 comp rx=0 tx=0).stop 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.719+0000 7f725bce2700 1 -- 172.21.15.37:0/1844673897 shutdown_connections 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.719+0000 7f725bce2700 1 --2- 172.21.15.37:0/1844673897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f7254108e80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.719+0000 7f725bce2700 1 -- 172.21.15.37:0/1844673897 >> 172.21.15.37:0/1844673897 conn(0x7f72540fe5a0 msgr2=0x7f72541009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.719+0000 7f725bce2700 1 -- 172.21.15.37:0/1844673897 shutdown_connections 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.719+0000 7f725bce2700 1 -- 172.21.15.37:0/1844673897 wait complete. 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.720+0000 7f725bce2700 1 Processor -- start 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.720+0000 7f725bce2700 1 -- start start 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.720+0000 7f725bce2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f72541a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.720+0000 7f725bce2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f725410cfc0 con 0x7f7254108a70 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.720+0000 7f7259a7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f72541a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.720+0000 7f7259a7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f72541a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56214/0 (socket says 172.21.15.37:56214) 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.720+0000 7f7259a7e700 1 -- 172.21.15.37:0/4242985293 learned_addr learned my addr 172.21.15.37:0/4242985293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.721+0000 7f7259a7e700 1 -- 172.21.15.37:0/4242985293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72541a1c80 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.721+0000 7f7259a7e700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f72541a1740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f72500056d0 tx=0x7f72500057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.721+0000 7f7246ffd700 1 -- 172.21.15.37:0/4242985293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7250027070 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.721+0000 7f7246ffd700 1 -- 172.21.15.37:0/4242985293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f725000be10 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.721+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72541a1f70 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.721+0000 7f7246ffd700 1 -- 172.21.15.37:0/4242985293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7250022d20 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.721+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725419b960 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.722+0000 7f7246ffd700 1 -- 172.21.15.37:0/4242985293 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f725002a070 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.722+0000 7f7246ffd700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f724003e570 0x7f7240040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.722+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7254104180 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.722+0000 7f7246ffd700 1 -- 172.21.15.37:0/4242985293 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f725001e030 con 0x7f7254108a70 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.722+0000 7f725927d700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f724003e570 0x7f7240040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.723+0000 7f725927d700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f724003e570 0x7f7240040a80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7248006fd0 tx=0x7f7248006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.728+0000 7f7246ffd700 1 -- 172.21.15.37:0/4242985293 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7250013070 con 0x7f7254108a70 2024-05-09T00:51:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:45.951+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}) -- 0x7f725419ce90 con 0x7f724003e570 2024-05-09T00:51:45.952 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:45 smithi037 ceph-mon[30122]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:51:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:51:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:47 smithi037 ceph-mon[30122]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-09T00:51:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:47 smithi037 ceph-mon[30122]: Deploying cephadm binary to smithi151 2024-05-09T00:51:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:47 smithi037 ceph-mon[30122]: Updating smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:51:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:47 smithi037 ceph-mon[30122]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:47 smithi037 ceph-mon[30122]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:51:50.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:49 smithi037 ceph-mon[30122]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:50.303 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi151' with addr '172.21.15.151' 2024-05-09T00:51:50.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.301+0000 7f7246ffd700 1 -- 172.21.15.37:0/4242985293 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f725419ce90 con 0x7f724003e570 2024-05-09T00:51:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f724003e570 msgr2=0x7f7240040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f724003e570 0x7f7240040a80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7248006fd0 tx=0x7f7248006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 msgr2=0x7f72541a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f72541a1740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f72500056d0 tx=0x7f72500057b0 comp rx=0 tx=0).stop 2024-05-09T00:51:50.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 shutdown_connections 2024-05-09T00:51:50.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f724003e570 0x7f7240040a80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:50.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 --2- 172.21.15.37:0/4242985293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7254108a70 0x7f72541a1740 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:50.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 >> 172.21.15.37:0/4242985293 conn(0x7f72540fe5a0 msgr2=0x7f7254104540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:50.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 shutdown_connections 2024-05-09T00:51:50.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:50.304+0000 7f725bce2700 1 -- 172.21.15.37:0/4242985293 wait complete. 2024-05-09T00:51:50.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-09T00:51:51.152 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:51:51.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:50 smithi037 ceph-mon[30122]: Updating smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:51:51.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:51.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:51.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:51.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:51.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:51:51.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:51.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:51 smithi037 ceph-mon[30122]: Added host smithi151 2024-05-09T00:51:51.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:51 smithi037 ceph-mon[30122]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:51.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:52.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.813+0000 7fda7d822700 1 -- 172.21.15.37:0/3707866704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 msgr2=0x7fda781050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.813+0000 7fda7d822700 1 --2- 172.21.15.37:0/3707866704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda781050d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fda6800b0a0 tx=0x7fda6800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.813+0000 7fda7d822700 1 -- 172.21.15.37:0/3707866704 shutdown_connections 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.813+0000 7fda7d822700 1 --2- 172.21.15.37:0/3707866704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda781050d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.813+0000 7fda7d822700 1 -- 172.21.15.37:0/3707866704 >> 172.21.15.37:0/3707866704 conn(0x7fda780fe590 msgr2=0x7fda781009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.813+0000 7fda7d822700 1 -- 172.21.15.37:0/3707866704 shutdown_connections 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.813+0000 7fda7d822700 1 -- 172.21.15.37:0/3707866704 wait complete. 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.814+0000 7fda7d822700 1 Processor -- start 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.814+0000 7fda7d822700 1 -- start start 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda7d822700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda7819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda7d822700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda7810e120 con 0x7fda78104cc0 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda76ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda7819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda76ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda7819f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47710/0 (socket says 172.21.15.37:47710) 2024-05-09T00:51:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda76ffd700 1 -- 172.21.15.37:0/2835768218 learned_addr learned my addr 172.21.15.37:0/2835768218 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda76ffd700 1 -- 172.21.15.37:0/2835768218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7819fb00 con 0x7fda78104cc0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda76ffd700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda7819f5c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda6800b830 tx=0x7fda68009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda7c820700 1 -- 172.21.15.37:0/2835768218 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda68021020 con 0x7fda78104cc0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda7c820700 1 -- 172.21.15.37:0/2835768218 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda68007a80 con 0x7fda78104cc0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda7c820700 1 -- 172.21.15.37:0/2835768218 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda68017040 con 0x7fda78104cc0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.815+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7819fd90 con 0x7fda78104cc0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.816+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda78199750 con 0x7fda78104cc0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.816+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda7806c440 con 0x7fda78104cc0 2024-05-09T00:51:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.816+0000 7fda7c820700 1 -- 172.21.15.37:0/2835768218 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fda68024020 con 0x7fda78104cc0 2024-05-09T00:51:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.817+0000 7fda7c820700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda6003e570 0x7fda60040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.817+0000 7fda7c820700 1 -- 172.21.15.37:0/2835768218 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fda6800f050 con 0x7fda78104cc0 2024-05-09T00:51:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.817+0000 7fda767fc700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda6003e570 0x7fda60040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.817+0000 7fda767fc700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda6003e570 0x7fda60040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006fd0 tx=0x7fda6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:52.822+0000 7fda7c820700 1 -- 172.21.15.37:0/2835768218 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fda6802b020 con 0x7fda78104cc0 2024-05-09T00:51:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.042+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda7819ac60 con 0x7fda6003e570 2024-05-09T00:51:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.043+0000 7fda7c820700 1 -- 172.21.15.37:0/2835768218 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fda7819ac60 con 0x7fda6003e570 2024-05-09T00:51:53.044 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:51:53.044 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}, {"addr": "172.21.15.151", "hostname": "smithi151", "labels": [], "status": ""}] 2024-05-09T00:51:53.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda6003e570 msgr2=0x7fda60040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:53.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda6003e570 0x7fda60040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda6c006fd0 tx=0x7fda6c006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:53.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 msgr2=0x7fda7819f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:53.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda7819f5c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda6800b830 tx=0x7fda68009790 comp rx=0 tx=0).stop 2024-05-09T00:51:53.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 shutdown_connections 2024-05-09T00:51:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda6003e570 0x7fda60040a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 --2- 172.21.15.37:0/2835768218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda78104cc0 0x7fda7819f5c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 >> 172.21.15.37:0/2835768218 conn(0x7fda780fe590 msgr2=0x7fda78105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 shutdown_connections 2024-05-09T00:51:53.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:53.045+0000 7fda7d822700 1 -- 172.21.15.37:0/2835768218 wait complete. 2024-05-09T00:51:53.627 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-09T00:51:53.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-09T00:51:53.871 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:51:54.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:53 smithi037 ceph-mon[30122]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:54.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:54.218 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:53 smithi037 ceph-mon[30122]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.315+0000 7fd17c196700 1 -- 172.21.15.37:0/699977829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 msgr2=0x7fd174104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.315+0000 7fd17c196700 1 --2- 172.21.15.37:0/699977829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174104200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd170009910 tx=0x7fd170009c20 comp rx=0 tx=0).stop 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.315+0000 7fd17c196700 1 -- 172.21.15.37:0/699977829 shutdown_connections 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.315+0000 7fd17c196700 1 --2- 172.21.15.37:0/699977829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174104200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.315+0000 7fd17c196700 1 -- 172.21.15.37:0/699977829 >> 172.21.15.37:0/699977829 conn(0x7fd1740ff6a0 msgr2=0x7fd174101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.316+0000 7fd17c196700 1 -- 172.21.15.37:0/699977829 shutdown_connections 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.316+0000 7fd17c196700 1 -- 172.21.15.37:0/699977829 wait complete. 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.316+0000 7fd17c196700 1 Processor -- start 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.316+0000 7fd17c196700 1 -- start start 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd17c196700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd17c196700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd17410e0e0 con 0x7fd174103df0 2024-05-09T00:51:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd179f32700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd179f32700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47716/0 (socket says 172.21.15.37:47716) 2024-05-09T00:51:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd179f32700 1 -- 172.21.15.37:0/976829446 learned_addr learned my addr 172.21.15.37:0/976829446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:51:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd179f32700 1 -- 172.21.15.37:0/976829446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd174077910 con 0x7fd174103df0 2024-05-09T00:51:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd179f32700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174075ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd1700056d0 tx=0x7fd1700057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd16affd700 1 -- 172.21.15.37:0/976829446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd170026070 con 0x7fd174103df0 2024-05-09T00:51:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd16affd700 1 -- 172.21.15.37:0/976829446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd17000bba0 con 0x7fd174103df0 2024-05-09T00:51:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd16affd700 1 -- 172.21.15.37:0/976829446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd170003920 con 0x7fd174103df0 2024-05-09T00:51:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.317+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd174076000 con 0x7fd174103df0 2024-05-09T00:51:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.318+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1740764c0 con 0x7fd174103df0 2024-05-09T00:51:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.318+0000 7fd16affd700 1 -- 172.21.15.37:0/976829446 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd170029070 con 0x7fd174103df0 2024-05-09T00:51:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.319+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1741052a0 con 0x7fd174103df0 2024-05-09T00:51:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.319+0000 7fd16affd700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd16003e570 0x7fd160040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.319+0000 7fd16affd700 1 -- 172.21.15.37:0/976829446 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd17001e070 con 0x7fd174103df0 2024-05-09T00:51:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.319+0000 7fd179731700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd16003e570 0x7fd160040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.319+0000 7fd179731700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd16003e570 0x7fd160040a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd164006fd0 tx=0x7fd164006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:55.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.324+0000 7fd16affd700 1 -- 172.21.15.37:0/976829446 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd170013070 con 0x7fd174103df0 2024-05-09T00:51:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.546+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd174077020 con 0x7fd174103df0 2024-05-09T00:51:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.932+0000 7fd16affd700 1 -- 172.21.15.37:0/976829446 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fd170015350 con 0x7fd174103df0 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd16003e570 msgr2=0x7fd160040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd16003e570 0x7fd160040a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd164006fd0 tx=0x7fd164006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 msgr2=0x7fd174075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174075ac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd1700056d0 tx=0x7fd1700057b0 comp rx=0 tx=0).stop 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 shutdown_connections 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd16003e570 0x7fd160040a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 --2- 172.21.15.37:0/976829446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd174103df0 0x7fd174075ac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 >> 172.21.15.37:0/976829446 conn(0x7fd1740ff6a0 msgr2=0x7fd174101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 shutdown_connections 2024-05-09T00:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:51:55.935+0000 7fd17c196700 1 -- 172.21.15.37:0/976829446 wait complete. 2024-05-09T00:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-05-09T00:51:56.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:55 smithi037 ceph-mon[30122]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:55 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/976829446' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-09T00:51:56.614 INFO:tasks.cephadm:Adding mon.a on smithi037 2024-05-09T00:51:56.615 INFO:tasks.cephadm:Adding mon.b on smithi136 2024-05-09T00:51:56.615 INFO:tasks.cephadm:Adding mon.c on smithi151 2024-05-09T00:51:56.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi037:172.21.15.37=a;smithi136:172.21.15.136=b;smithi151:172.21.15.151=c' 2024-05-09T00:51:56.856 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:51:57.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/976829446' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-09T00:51:57.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T00:51:57.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:57.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: Updating smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:51:57.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:57.226 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:57.226 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:58.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.333+0000 7ff4d56eb700 1 -- 172.21.15.151:0/125604214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 msgr2=0x7ff4d0105130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:58.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.333+0000 7ff4d56eb700 1 --2- 172.21.15.151:0/125604214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d0105130 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000b0a0 tx=0x7ff4c000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:51:58.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.333+0000 7ff4d56eb700 1 -- 172.21.15.151:0/125604214 shutdown_connections 2024-05-09T00:51:58.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.333+0000 7ff4d56eb700 1 --2- 172.21.15.151:0/125604214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d0105130 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:58.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.333+0000 7ff4d56eb700 1 -- 172.21.15.151:0/125604214 >> 172.21.15.151:0/125604214 conn(0x7ff4d00fe5b0 msgr2=0x7ff4d0100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:58.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.334+0000 7ff4d56eb700 1 -- 172.21.15.151:0/125604214 shutdown_connections 2024-05-09T00:51:58.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.334+0000 7ff4d56eb700 1 -- 172.21.15.151:0/125604214 wait complete. 2024-05-09T00:51:58.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.334+0000 7ff4d56eb700 1 Processor -- start 2024-05-09T00:51:58.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.334+0000 7ff4d56eb700 1 -- start start 2024-05-09T00:51:58.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.335+0000 7ff4d56eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:58.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.335+0000 7ff4d56eb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d010e0c0 con 0x7ff4d0104d20 2024-05-09T00:51:58.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.335+0000 7ff4ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:58.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.336+0000 7ff4ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.151:55884/0 (socket says 172.21.15.151:55884) 2024-05-09T00:51:58.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.336+0000 7ff4ceffd700 1 -- 172.21.15.151:0/1740529692 learned_addr learned my addr 172.21.15.151:0/1740529692 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:51:58.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.336+0000 7ff4ceffd700 1 -- 172.21.15.151:0/1740529692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d019fa70 con 0x7ff4d0104d20 2024-05-09T00:51:58.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.336+0000 7ff4ceffd700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d019f530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d010 tx=0x7ff4c0003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:58.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.337+0000 7ff4c7fff700 1 -- 172.21.15.151:0/1740529692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c0021020 con 0x7ff4d0104d20 2024-05-09T00:51:58.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.337+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d019fd00 con 0x7ff4d0104d20 2024-05-09T00:51:58.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.337+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d01996c0 con 0x7ff4d0104d20 2024-05-09T00:51:58.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.337+0000 7ff4c7fff700 1 -- 172.21.15.151:0/1740529692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4c00044b0 con 0x7ff4d0104d20 2024-05-09T00:51:58.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.337+0000 7ff4c7fff700 1 -- 172.21.15.151:0/1740529692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4c0017040 con 0x7ff4d0104d20 2024-05-09T00:51:58.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.338+0000 7ff4c7fff700 1 -- 172.21.15.151:0/1740529692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff4c0024020 con 0x7ff4d0104d20 2024-05-09T00:51:58.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.338+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d006c100 con 0x7ff4d0104d20 2024-05-09T00:51:58.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.338+0000 7ff4c7fff700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4bc03e5c0 0x7ff4bc040ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:51:58.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.338+0000 7ff4c7fff700 1 -- 172.21.15.151:0/1740529692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff4c000f050 con 0x7ff4d0104d20 2024-05-09T00:51:58.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.338+0000 7ff4ce7fc700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4bc03e5c0 0x7ff4bc040ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:51:58.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.339+0000 7ff4ce7fc700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4bc03e5c0 0x7ff4bc040ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8006fd0 tx=0x7ff4b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:51:58.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.345+0000 7ff4c7fff700 1 -- 172.21.15.151:0/1740529692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff4c002b030 con 0x7ff4d0104d20 2024-05-09T00:51:58.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:58 smithi037 ceph-mon[30122]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:51:58.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:58 smithi037 ceph-mon[30122]: Updating smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:51:58.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:58 smithi037 ceph-mon[30122]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:51:58.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.560+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi136:172.21.15.136=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}) -- 0x7ff4d019abd0 con 0x7ff4bc03e5c0 2024-05-09T00:51:58.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.567+0000 7ff4c7fff700 1 -- 172.21.15.151:0/1740529692 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff4d019abd0 con 0x7ff4bc03e5c0 2024-05-09T00:51:58.568 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mon update... 2024-05-09T00:51:58.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4bc03e5c0 msgr2=0x7ff4bc040ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:58.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4bc03e5c0 0x7ff4bc040ad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8006fd0 tx=0x7ff4b8006e40 comp rx=0 tx=0).stop 2024-05-09T00:51:58.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 msgr2=0x7ff4d019f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:51:58.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d019f530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000d010 tx=0x7ff4c0003ce0 comp rx=0 tx=0).stop 2024-05-09T00:51:58.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 shutdown_connections 2024-05-09T00:51:58.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4bc03e5c0 0x7ff4bc040ad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:58.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 --2- 172.21.15.151:0/1740529692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d0104d20 0x7ff4d019f530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:51:58.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.569+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 >> 172.21.15.151:0/1740529692 conn(0x7ff4d00fe5b0 msgr2=0x7ff4d0105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:51:58.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.570+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 shutdown_connections 2024-05-09T00:51:58.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:51:58.570+0000 7ff4d56eb700 1 -- 172.21.15.151:0/1740529692 wait complete. 2024-05-09T00:51:59.146 DEBUG:teuthology.orchestra.run.smithi136:mon.b> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.b.service 2024-05-09T00:51:59.149 DEBUG:teuthology.orchestra.run.smithi151:mon.c> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.c.service 2024-05-09T00:51:59.151 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-09T00:51:59.152 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T00:51:59.879 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:51:59.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi136:172.21.15.136=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi136:172.21.15.136=b;smithi151:172.21.15.151=c;count:3 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: Deploying daemon mon.c on smithi151 2024-05-09T00:51:59.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:51:59 smithi037 ceph-mon[30122]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:01 smithi037 ceph-mon[30122]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.040+0000 7ff6f19ac700 1 -- 172.21.15.151:0/1866740104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 msgr2=0x7ff6ec102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.040+0000 7ff6f19ac700 1 --2- 172.21.15.151:0/1866740104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec102720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009910 tx=0x7ff6e0009c20 comp rx=0 tx=0).stop 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.040+0000 7ff6f19ac700 1 -- 172.21.15.151:0/1866740104 shutdown_connections 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.040+0000 7ff6f19ac700 1 --2- 172.21.15.151:0/1866740104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec102720 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.040+0000 7ff6f19ac700 1 -- 172.21.15.151:0/1866740104 >> 172.21.15.151:0/1866740104 conn(0x7ff6ec0fde30 msgr2=0x7ff6ec100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.040+0000 7ff6f19ac700 1 -- 172.21.15.151:0/1866740104 shutdown_connections 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.040+0000 7ff6f19ac700 1 -- 172.21.15.151:0/1866740104 wait complete. 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.041+0000 7ff6f19ac700 1 Processor -- start 2024-05-09T00:52:03.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.041+0000 7ff6f19ac700 1 -- start start 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.042+0000 7ff6f19ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.042+0000 7ff6f19ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec10e0c0 con 0x7ff6ec102310 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.042+0000 7ff6eaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.042+0000 7ff6eaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec19f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.151:53328/0 (socket says 172.21.15.151:53328) 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.042+0000 7ff6eaffd700 1 -- 172.21.15.151:0/2381668860 learned_addr learned my addr 172.21.15.151:0/2381668860 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.043+0000 7ff6eaffd700 1 -- 172.21.15.151:0/2381668860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec19fb10 con 0x7ff6ec102310 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.043+0000 7ff6eaffd700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec19f5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00056d0 tx=0x7ff6e00057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.043+0000 7ff6f09aa700 1 -- 172.21.15.151:0/2381668860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e0027070 con 0x7ff6ec102310 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.043+0000 7ff6f09aa700 1 -- 172.21.15.151:0/2381668860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6e000be10 con 0x7ff6ec102310 2024-05-09T00:52:03.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.043+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec19fe00 con 0x7ff6ec102310 2024-05-09T00:52:03.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.043+0000 7ff6f09aa700 1 -- 172.21.15.151:0/2381668860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6e0022d20 con 0x7ff6ec102310 2024-05-09T00:52:03.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.043+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec199810 con 0x7ff6ec102310 2024-05-09T00:52:03.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.044+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec1053a0 con 0x7ff6ec102310 2024-05-09T00:52:03.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.044+0000 7ff6f09aa700 1 -- 172.21.15.151:0/2381668860 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff6e002a070 con 0x7ff6ec102310 2024-05-09T00:52:03.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.045+0000 7ff6f09aa700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6d403e510 0x7ff6d4040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:03.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.045+0000 7ff6f09aa700 1 -- 172.21.15.151:0/2381668860 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff6e001e030 con 0x7ff6ec102310 2024-05-09T00:52:03.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.046+0000 7ff6ea7fc700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6d403e510 0x7ff6d4040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:03.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.048+0000 7ff6ea7fc700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6d403e510 0x7ff6d4040a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc006fd0 tx=0x7ff6dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:03.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.051+0000 7ff6f09aa700 1 -- 172.21.15.151:0/2381668860 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff6e0013070 con 0x7ff6ec102310 2024-05-09T00:52:03.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.345+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff6ec19ad20 con 0x7ff6ec102310 2024-05-09T00:52:03.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.347+0000 7ff6f09aa700 1 -- 172.21.15.151:0/2381668860 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7ff6e0031090 con 0x7ff6ec102310 2024-05-09T00:52:03.347 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:52:03.347 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","modified":"2024-05-09T00:50:18.107396Z","created":"2024-05-09T00:50:18.107396Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T00:52:03.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6d403e510 msgr2=0x7ff6d4040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:03.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6d403e510 0x7ff6d4040a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc006fd0 tx=0x7ff6dc006e40 comp rx=0 tx=0).stop 2024-05-09T00:52:03.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 msgr2=0x7ff6ec19f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec19f5d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00056d0 tx=0x7ff6e00057b0 comp rx=0 tx=0).stop 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 shutdown_connections 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6d403e510 0x7ff6d4040a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 --2- 172.21.15.151:0/2381668860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6ec102310 0x7ff6ec19f5d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 >> 172.21.15.151:0/2381668860 conn(0x7ff6ec0fde30 msgr2=0x7ff6ec1057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 shutdown_connections 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:03.349+0000 7ff6f19ac700 1 -- 172.21.15.151:0/2381668860 wait complete. 2024-05-09T00:52:03.351 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 1 2024-05-09T00:52:05.013 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-09T00:52:05.013 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T00:52:05.256 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:52:08.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:52:08.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: mon.a calling monitor election 2024-05-09T00:52:08.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:08.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: mon.c calling monitor election 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: monmap epoch 2 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: last_changed 2024-05-09T00:52:03.438508+0000 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: created 2024-05-09T00:50:18.107396+0000 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: min_mon_release 19 (squid) 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: election_strategy: 1 2024-05-09T00:52:08.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: fsmap 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: mgrmap e13: x(active, since 49s) 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: overall HEALTH_OK 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:08.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:08.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.732+0000 7f39fddf0700 1 -- 172.21.15.151:0/2229822181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 msgr2=0x7f39e0005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.732+0000 7f39fddf0700 1 --2- 172.21.15.151:0/2229822181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 0x7f39e0005aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f39f8103b70 tx=0x7f39e800feb0 comp rx=0 tx=0).stop 2024-05-09T00:52:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.732+0000 7f39fddf0700 1 -- 172.21.15.151:0/2229822181 shutdown_connections 2024-05-09T00:52:09.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.732+0000 7f39fddf0700 1 --2- 172.21.15.151:0/2229822181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 0x7f39e0005aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:09.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.732+0000 7f39fddf0700 1 -- 172.21.15.151:0/2229822181 >> 172.21.15.151:0/2229822181 conn(0x7f39f80ff7a0 msgr2=0x7f39f8101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:09.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.732+0000 7f39fddf0700 1 -- 172.21.15.151:0/2229822181 shutdown_connections 2024-05-09T00:52:09.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.732+0000 7f39fddf0700 1 -- 172.21.15.151:0/2229822181 wait complete. 2024-05-09T00:52:09.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.733+0000 7f39fddf0700 1 Processor -- start 2024-05-09T00:52:09.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39fddf0700 1 -- start start 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39fddf0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 0x7f39f8075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39fddf0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 0x7f39f8076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39fddf0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39f810bbf0 con 0x7f39e00035c0 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39fddf0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f39f810ba70 con 0x7f39f8076000 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 0x7f39f8076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 0x7f39f8076410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60578/0 (socket says 172.21.15.151:60578) 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f6ffd700 1 -- 172.21.15.151:0/3636648148 learned_addr learned my addr 172.21.15.151:0/3636648148 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f77fe700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 0x7f39f8075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f6ffd700 1 -- 172.21.15.151:0/3636648148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 msgr2=0x7f39f8076410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f6ffd700 1 -- 172.21.15.151:0/3636648148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 msgr2=0x7f39f8076410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f6ffd700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 0x7f39f8076410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.734+0000 7f39f6ffd700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 0x7f39f8076410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:52:09.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.735+0000 7f39f77fe700 1 -- 172.21.15.151:0/3636648148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 msgr2=0x7f39f8076410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:52:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.735+0000 7f39f77fe700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 0x7f39f8076410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.735+0000 7f39f77fe700 1 -- 172.21.15.151:0/3636648148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f80779f0 con 0x7f39e00035c0 2024-05-09T00:52:09.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.735+0000 7f39f77fe700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 0x7f39f8075ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39e8010010 tx=0x7f39e80050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.736+0000 7f39f4ff9700 1 -- 172.21.15.151:0/3636648148 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f39e8004aa0 con 0x7f39e00035c0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.736+0000 7f39f4ff9700 1 -- 172.21.15.151:0/3636648148 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39e8004030 con 0x7f39e00035c0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.736+0000 7f39f4ff9700 1 -- 172.21.15.151:0/3636648148 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f39e8011bd0 con 0x7f39e00035c0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.736+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f81a5ce0 con 0x7f39e00035c0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.736+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f81a61e0 con 0x7f39e00035c0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.737+0000 7f39f4ff9700 1 -- 172.21.15.151:0/3636648148 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f39e8023070 con 0x7f39e00035c0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.737+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f8105380 con 0x7f39e00035c0 2024-05-09T00:52:09.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.737+0000 7f39f4ff9700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f39e403e300 0x7f39e4040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:09.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.738+0000 7f39f4ff9700 1 -- 172.21.15.151:0/3636648148 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f39e8020050 con 0x7f39e00035c0 2024-05-09T00:52:09.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.738+0000 7f39f6ffd700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f39e403e300 0x7f39e4040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:09.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.738+0000 7f39f6ffd700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f39e403e300 0x7f39e4040810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39f8103230 tx=0x7f39ec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:09.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:09.744+0000 7f39f4ff9700 1 -- 172.21.15.151:0/3636648148 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f39e8028020 con 0x7f39e00035c0 2024-05-09T00:52:09.922 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:09 smithi151 ceph-mon[34780]: Deploying daemon mon.b on smithi136 2024-05-09T00:52:09.923 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:09 smithi151 ceph-mon[34780]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:09.923 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:09 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:09.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:09 smithi037 ceph-mon[30122]: Deploying daemon mon.b on smithi136 2024-05-09T00:52:09.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:09 smithi037 ceph-mon[30122]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:09.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:09 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:10.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.041+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f39f802e850 con 0x7f39e00035c0 2024-05-09T00:52:10.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.042+0000 7f39f4ff9700 1 -- 172.21.15.151:0/3636648148 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f39e80103d0 con 0x7f39e00035c0 2024-05-09T00:52:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:52:10.043 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","modified":"2024-05-09T00:52:03.438508Z","created":"2024-05-09T00:50:18.107396Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-09T00:52:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f39e403e300 msgr2=0x7f39e4040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f39e403e300 0x7f39e4040810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f39f8103230 tx=0x7f39ec008040 comp rx=0 tx=0).stop 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 msgr2=0x7f39f8075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 0x7f39f8075ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f39e8010010 tx=0x7f39e80050d0 comp rx=0 tx=0).stop 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 shutdown_connections 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f39e403e300 0x7f39e4040810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39e00035c0 0x7f39f8075ac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 --2- 172.21.15.151:0/3636648148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f8076000 0x7f39f8076410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 >> 172.21.15.151:0/3636648148 conn(0x7f39f80ff7a0 msgr2=0x7f39f81074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 shutdown_connections 2024-05-09T00:52:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:10.044+0000 7f39fddf0700 1 -- 172.21.15.151:0/3636648148 wait complete. 2024-05-09T00:52:10.047 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 2 2024-05-09T00:52:10.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:10 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/3636648148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:52:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:10 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/3636648148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:52:10.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:52:10 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:52:10.438+0000 7f8471f53700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T00:52:11.650 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-09T00:52:11.651 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T00:52:11.893 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:52:11.894 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:11 smithi136 systemd[1]: Starting Ceph mon.b for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:52:11.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:11 smithi037 ceph-mon[30122]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:11.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:11 smithi151 ceph-mon[34780]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.203 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 podman[34091]: 2024-05-09 00:52:11.994374929 +0000 UTC m=+0.020246468 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:52:12.203 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 podman[34091]: 2024-05-09 00:52:12.099024275 +0000 UTC m=+0.124895798 container create 8791a6ea5d272c87bdd29fd5f702c9140a66e0974e80b353efbcb3476da09ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 podman[34091]: 2024-05-09 00:52:12.265352467 +0000 UTC m=+0.291223989 container init 8791a6ea5d272c87bdd29fd5f702c9140a66e0974e80b353efbcb3476da09ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 podman[34091]: 2024-05-09 00:52:12.268274873 +0000 UTC m=+0.294146395 container start 8791a6ea5d272c87bdd29fd5f702c9140a66e0974e80b353efbcb3476da09ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev), process ceph-mon, pid 2 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pidfile_write: ignore empty --pid-file 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: load: jerasure load: lrc 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: RocksDB version: 7.9.2 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Git sha 0 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Compile date 2024-05-08 19:33:14 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: DB SUMMARY 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: DB Session ID: GFJ6EHU25SZERWUOIH7C 2024-05-09T00:52:12.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: CURRENT file: CURRENT 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.error_if_exists: 0 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.create_if_missing: 0 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.paranoid_checks: 1 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.env: 0x55b2edfda500 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.info_log: 0x55b2ef36e020 2024-05-09T00:52:12.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T00:52:12.458 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.statistics: (nil) 2024-05-09T00:52:12.458 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.use_fsync: 0 2024-05-09T00:52:12.458 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_log_file_size: 0 2024-05-09T00:52:12.458 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.allow_fallocate: 1 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.use_direct_reads: 0 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.db_log_dir: 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.wal_dir: 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T00:52:12.459 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.write_buffer_manager: 0x55b2ef2388c0 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T00:52:12.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.unordered_write: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.row_cache: None 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.wal_filter: None 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.two_write_queues: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.wal_compression: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.atomic_flush: 0 2024-05-09T00:52:12.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.log_readahead_size: 0 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_background_jobs: 2 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_background_compactions: -1 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_subcompactions: 1 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T00:52:12.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_open_files: -1 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_background_flushes: -1 2024-05-09T00:52:12.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Compression algorithms supported: 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kZSTD supported: 0 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kXpressCompression supported: 0 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kZlibCompression supported: 1 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kSnappyCompression supported: 1 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kLZ4Compression supported: 1 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: kBZip2Compression supported: 0 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T00:52:12.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.merge_operator: 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_filter: None 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b2ef36e1e0) 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: cache_index_and_filter_blocks: 1 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: pin_top_level_index_and_filter: 1 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_type: 0 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: data_block_index_type: 0 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_shortening: 1 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T00:52:12.465 INFO:journalctl@ceph.mon.b.smithi136.stdout: checksum: 4 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: no_block_cache: 0 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache: 0x55b2ef26b1f0 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_name: BinnedLRUCache 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_options: 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: capacity : 536870912 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: num_shard_bits : 4 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: strict_capacity_limit : 0 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: high_pri_pool_ratio: 0.000 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_compressed: (nil) 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: persistent_cache: (nil) 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_size: 4096 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_size_deviation: 10 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_restart_interval: 16 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_block_restart_interval: 1 2024-05-09T00:52:12.466 INFO:journalctl@ceph.mon.b.smithi136.stdout: metadata_block_size: 4096 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: partition_filters: 0 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_delta_encoding: 1 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: filter_policy: bloomfilter 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: whole_key_filtering: 1 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: verify_compression: 0 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: read_amp_bytes_per_bit: 0 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: format_version: 5 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: enable_index_compression: 1 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_align: 0 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: max_auto_readahead_size: 262144 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: prepopulate_block_cache: 0 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: initial_auto_readahead_size: 8192 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T00:52:12.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression: NoCompression 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.num_levels: 7 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T00:52:12.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T00:52:12.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T00:52:12.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T00:52:12.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T00:52:12.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T00:52:12.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T00:52:12.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T00:52:12.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T00:52:12.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T00:52:12.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T00:52:12.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T00:52:12.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T00:52:12.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T00:52:12.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T00:52:12.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.inplace_update_support: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.bloom_locality: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.max_successive_merges: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T00:52:12.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.ttl: 2592000 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.enable_blob_files: false 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.min_blob_size: 0 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T00:52:12.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: eb608532-6d8b-4f52-8a0c-16f5fc00aa5d 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715215932308996, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715215932309595, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715215932, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "eb608532-6d8b-4f52-8a0c-16f5fc00aa5d", "db_session_id": "GFJ6EHU25SZERWUOIH7C", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715215932309697, "job": 1, "event": "recovery_finished"} 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b2ef24fc00 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: DB pointer 0x55b2f4042000 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** DB Stats ** 2024-05-09T00:52:12.475 INFO:journalctl@ceph.mon.b.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:52:12.476 INFO:journalctl@ceph.mon.b.smithi136.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T00:52:12.477 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: Block cache BinnedLRUCache@0x55b2ef26b1f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: using public_addr v2:172.21.15.136:0/0 -> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: starting mon.b rank -1 at public addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] at bind addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:12.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(???) e0 preinit fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).mds e1 new map 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout: e1 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout: legacy client fscid: -1 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout: No filesystems configured 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T00:52:12.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:12.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Deploying cephadm binary to smithi151 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Added host smithi151 2024-05-09T00:52:12.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/976829446' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/976829446' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:12.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Updating smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi136:172.21.15.136=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi136:172.21.15.136=b;smithi151:172.21.15.151=c;count:3 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:12.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Deploying daemon mon.c on smithi151 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.a calling monitor election 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.c calling monitor election 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:12.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: monmap epoch 2 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: last_changed 2024-05-09T00:52:03.438508+0000 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: created 2024-05-09T00:50:18.107396+0000 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: min_mon_release 19 (squid) 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: election_strategy: 1 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: fsmap 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mgrmap e13: x(active, since 49s) 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: overall HEALTH_OK 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.485 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: Deploying daemon mon.b on smithi136 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/3636648148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 ceph-mon[34110]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 bash[34091]: 8791a6ea5d272c87bdd29fd5f702c9140a66e0974e80b353efbcb3476da09ea7 2024-05-09T00:52:12.486 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:12 smithi136 systemd[1]: Started Ceph mon.b for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:52:17.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.641+0000 7f21390f2700 1 -- 172.21.15.151:0/1741370740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 msgr2=0x7f2120005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:17.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.641+0000 7f21390f2700 1 --2- 172.21.15.151:0/1741370740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f2120005aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f213406b4d0 tx=0x7f212400fe60 comp rx=0 tx=0).stop 2024-05-09T00:52:17.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.641+0000 7f21390f2700 1 -- 172.21.15.151:0/1741370740 shutdown_connections 2024-05-09T00:52:17.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.641+0000 7f21390f2700 1 --2- 172.21.15.151:0/1741370740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f2120005aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:17.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.641+0000 7f21390f2700 1 -- 172.21.15.151:0/1741370740 >> 172.21.15.151:0/1741370740 conn(0x7f2134077e10 msgr2=0x7f2134078270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:17.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.641+0000 7f21390f2700 1 -- 172.21.15.151:0/1741370740 shutdown_connections 2024-05-09T00:52:17.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.641+0000 7f21390f2700 1 -- 172.21.15.151:0/1741370740 wait complete. 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.642+0000 7f21390f2700 1 Processor -- start 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f21390f2700 1 -- start start 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f21390f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f213419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f21390f2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 0x7f2134199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f21390f2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 0x7f213419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f21390f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f213410bcd0 con 0x7f21200035c0 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f21390f2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f213410bb50 con 0x7f213419a090 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f21390f2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f213410be50 con 0x7f213419ff00 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f2132d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f213419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f2132d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f213419f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.151:49102/0 (socket says 172.21.15.151:49102) 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f2132d9d700 1 -- 172.21.15.151:0/3226916775 learned_addr learned my addr 172.21.15.151:0/3226916775 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:52:17.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f213359e700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 0x7f213419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f212a59c700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 0x7f2134199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f213359e700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 msgr2=0x7f213419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f213359e700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 msgr2=0x7f213419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.643+0000 7f213359e700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 0x7f213419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f213359e700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 0x7f213419a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f212a59c700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 msgr2=0x7f2134199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f212a59c700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 msgr2=0x7f2134199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f212a59c700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 0x7f2134199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2132d9d700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 msgr2=0x7f2134199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f212a59c700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 0x7f2134199b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2132d9d700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 0x7f2134199b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2132d9d700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 msgr2=0x7f213419a4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2132d9d700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 0x7f213419a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:17.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2132d9d700 1 -- 172.21.15.151:0/3226916775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21341a6770 con 0x7f21200035c0 2024-05-09T00:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2132d9d700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f213419f9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2124010010 tx=0x7f2124003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2130d99700 1 -- 172.21.15.151:0/3226916775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212402b020 con 0x7f21200035c0 2024-05-09T00:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2130d99700 1 -- 172.21.15.151:0/3226916775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f212401d440 con 0x7f21200035c0 2024-05-09T00:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21341a6a00 con 0x7f21200035c0 2024-05-09T00:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f2130d99700 1 -- 172.21.15.151:0/3226916775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2124022040 con 0x7f21200035c0 2024-05-09T00:52:17.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.644+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21341a6f10 con 0x7f21200035c0 2024-05-09T00:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.645+0000 7f2130d99700 1 -- 172.21.15.151:0/3226916775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f212402e020 con 0x7f21200035c0 2024-05-09T00:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.646+0000 7f2130d99700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f211403e9a0 0x7f2114040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.646+0000 7f2130d99700 1 -- 172.21.15.151:0/3226916775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2124056080 con 0x7f21200035c0 2024-05-09T00:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.646+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2134105490 con 0x7f21200035c0 2024-05-09T00:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.646+0000 7f212a59c700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f211403e9a0 0x7f2114040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:17.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.646+0000 7f212a59c700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f211403e9a0 0x7f2114040eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f213419b280 tx=0x7f211c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:17.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.651+0000 7f2130d99700 1 -- 172.21.15.151:0/3226916775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2124035020 con 0x7f21200035c0 2024-05-09T00:52:17.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:52:17.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: mon.a calling monitor election 2024-05-09T00:52:17.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: mon.c calling monitor election 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: mon.b calling monitor election 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: monmap epoch 3 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: last_changed 2024-05-09T00:52:12.342633+0000 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: created 2024-05-09T00:50:18.107396+0000 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: min_mon_release 19 (squid) 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: election_strategy: 1 2024-05-09T00:52:17.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: fsmap 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: mgrmap e13: x(active, since 58s) 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: overall HEALTH_OK 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:17.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:17.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:52:17.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: mon.a calling monitor election 2024-05-09T00:52:17.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:17.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: mon.c calling monitor election 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: mon.b calling monitor election 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.729 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-09T00:52:17.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: monmap epoch 3 2024-05-09T00:52:17.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:17.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: last_changed 2024-05-09T00:52:12.342633+0000 2024-05-09T00:52:17.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: created 2024-05-09T00:50:18.107396+0000 2024-05-09T00:52:17.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: min_mon_release 19 (squid) 2024-05-09T00:52:17.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: election_strategy: 1 2024-05-09T00:52:17.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: fsmap 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: mgrmap e13: x(active, since 58s) 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: overall HEALTH_OK 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:17.731 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: mon.a calling monitor election 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: mon.c calling monitor election 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: mon.b calling monitor election 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: monmap epoch 3 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: last_changed 2024-05-09T00:52:12.342633+0000 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: created 2024-05-09T00:50:18.107396+0000 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: min_mon_release 19 (squid) 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: election_strategy: 1 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-09T00:52:17.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-09T00:52:17.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-09T00:52:17.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: fsmap 2024-05-09T00:52:17.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T00:52:17.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: mgrmap e13: x(active, since 58s) 2024-05-09T00:52:17.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: overall HEALTH_OK 2024-05-09T00:52:17.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:17.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:17.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.960+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f21341a70e0 con 0x7f21200035c0 2024-05-09T00:52:17.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.960+0000 7f2130d99700 1 -- 172.21.15.151:0/3226916775 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f2124026e80 con 0x7f21200035c0 2024-05-09T00:52:17.962 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-09T00:52:17.962 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":3,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","modified":"2024-05-09T00:52:12.342633Z","created":"2024-05-09T00:50:18.107396Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f211403e9a0 msgr2=0x7f2114040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f211403e9a0 0x7f2114040eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f213419b280 tx=0x7f211c008040 comp rx=0 tx=0).stop 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 msgr2=0x7f213419f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f213419f9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2124010010 tx=0x7f2124003d20 comp rx=0 tx=0).stop 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 shutdown_connections 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f211403e9a0 0x7f2114040eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f213419a090 0x7f213419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:17.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21200035c0 0x7f213419f9c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:17.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 --2- 172.21.15.151:0/3226916775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f213419ff00 0x7f2134199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:17.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 >> 172.21.15.151:0/3226916775 conn(0x7f2134077e10 msgr2=0x7f21341002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:17.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 shutdown_connections 2024-05-09T00:52:17.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:17.963+0000 7f21390f2700 1 -- 172.21.15.151:0/3226916775 wait complete. 2024-05-09T00:52:17.965 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 3 2024-05-09T00:52:18.524 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:18.524 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:18.524 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:18.524 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:18 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/3226916775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:52:18.524 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:18.557 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-09T00:52:18.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-09T00:52:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:18 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/3226916775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:52:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:18 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/3226916775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T00:52:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:52:18.821 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:52:19.724 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:52:19 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:52:19.341+0000 7f8471f53700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T00:52:20.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: Updating smithi037:/etc/ceph/ceph.conf 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-09T00:52:20.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:19 smithi037 ceph-mon[30122]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: Updating smithi037:/etc/ceph/ceph.conf 2024-05-09T00:52:20.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-09T00:52:20.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:19 smithi136 ceph-mon[34110]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: Updating smithi037:/etc/ceph/ceph.conf 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-09T00:52:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:19 smithi151 ceph-mon[34780]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-09T00:52:20.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.507+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/227091714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a84103dd0 msgr2=0x7f5a841041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.507+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/227091714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a84103dd0 0x7f5a841041e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009910 tx=0x7f5a80009c20 comp rx=0 tx=0).stop 2024-05-09T00:52:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.507+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/227091714 shutdown_connections 2024-05-09T00:52:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.507+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/227091714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a84103dd0 0x7f5a841041e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.507+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/227091714 >> 172.21.15.37:0/227091714 conn(0x7f5a840ff660 msgr2=0x7f5a84101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.507+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/227091714 shutdown_connections 2024-05-09T00:52:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.507+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/227091714 wait complete. 2024-05-09T00:52:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 Processor -- start 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 -- start start 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a84103dd0 0x7f5a8419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a8419fdc0 0x7f5a84199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8419a030 0x7f5a8419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8410e0c0 con 0x7f5a8419a030 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8410df40 con 0x7f5a84103dd0 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8c4ba700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8410e240 con 0x7f5a8419fdc0 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8aa57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8419a030 0x7f5a8419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8aa57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8419a030 0x7f5a8419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48608/0 (socket says 172.21.15.37:48608) 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.508+0000 7f5a8aa57700 1 -- 172.21.15.37:0/4228796917 learned_addr learned my addr 172.21.15.37:0/4228796917 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:52:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a89a55700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a8419fdc0 0x7f5a84199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8a256700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a84103dd0 0x7f5a8419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8aa57700 1 -- 172.21.15.37:0/4228796917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a8419fdc0 msgr2=0x7f5a84199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8aa57700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a8419fdc0 0x7f5a84199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8aa57700 1 -- 172.21.15.37:0/4228796917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a84103dd0 msgr2=0x7f5a8419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8aa57700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a84103dd0 0x7f5a8419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8aa57700 1 -- 172.21.15.37:0/4228796917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a841a6710 con 0x7f5a8419a030 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a89a55700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a8419fdc0 0x7f5a84199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8a256700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a84103dd0 0x7f5a8419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8aa57700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8419a030 0x7f5a8419a440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00ba50 tx=0x7f5a7c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a7b7fe700 1 -- 172.21.15.37:0/4228796917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c019070 con 0x7f5a8419a030 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a7b7fe700 1 -- 172.21.15.37:0/4228796917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a7c00cde0 con 0x7f5a8419a030 2024-05-09T00:52:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a841a69a0 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.509+0000 7f5a7b7fe700 1 -- 172.21.15.37:0/4228796917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c007350 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.510+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a841a6eb0 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.510+0000 7f5a7b7fe700 1 -- 172.21.15.37:0/4228796917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5a7c01c070 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.511+0000 7f5a7b7fe700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a7003e9a0 0x7f5a70040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.511+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a84064e20 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.511+0000 7f5a7b7fe700 1 -- 172.21.15.37:0/4228796917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5a7c00cb30 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.511+0000 7f5a8a256700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a7003e9a0 0x7f5a70040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.511+0000 7f5a8a256700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a7003e9a0 0x7f5a70040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a80005e00 tx=0x7f5a8001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.521+0000 7f5a7b7fe700 1 -- 172.21.15.37:0/4228796917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5a7c00c930 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.740+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5a841a7140 con 0x7f5a8419a030 2024-05-09T00:52:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.740+0000 7f5a7b7fe700 1 -- 172.21.15.37:0/4228796917 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f5a7c0420c0 con 0x7f5a8419a030 2024-05-09T00:52:20.923 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:20.923 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-05-09T00:52:20.923 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T00:52:20.923 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a7003e9a0 msgr2=0x7f5a70040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a7003e9a0 0x7f5a70040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a80005e00 tx=0x7f5a8001a040 comp rx=0 tx=0).stop 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8419a030 msgr2=0x7f5a8419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8419a030 0x7f5a8419a440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00ba50 tx=0x7f5a7c00bd60 comp rx=0 tx=0).stop 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 shutdown_connections 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a7003e9a0 0x7f5a70040eb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8419a030 0x7f5a8419a440 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a84103dd0 0x7f5a8419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 --2- 172.21.15.37:0/4228796917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a8419fdc0 0x7f5a84199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 >> 172.21.15.37:0/4228796917 conn(0x7f5a840ff660 msgr2=0x7f5a8410b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 shutdown_connections 2024-05-09T00:52:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:20.743+0000 7f5a8c4ba700 1 -- 172.21.15.37:0/4228796917 wait complete. 2024-05-09T00:52:21.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: Updating smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: Updating smithi037:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: Updating smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: Reconfiguring mon.a (unknown last config time)... 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: Reconfiguring daemon mon.a on smithi037 2024-05-09T00:52:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:20 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4228796917' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: Updating smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: Updating smithi037:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: Updating smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: Reconfiguring mon.a (unknown last config time)... 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: Reconfiguring daemon mon.a on smithi037 2024-05-09T00:52:21.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:20 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4228796917' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:21.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: Updating smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: Updating smithi037:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: Updating smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:52:21.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: Reconfiguring mon.a (unknown last config time)... 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: Reconfiguring daemon mon.a on smithi037 2024-05-09T00:52:21.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:20 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4228796917' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:21.776 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-09T00:52:21.776 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:52:21.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T00:52:21.807 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:52:21.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:52:21.876 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:52:21.876 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T00:52:21.910 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:52:21.910 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:52:21.976 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:52:21.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T00:52:22.007 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:52:22.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:52:22.075 INFO:tasks.cephadm:Adding mgr.x on smithi037 2024-05-09T00:52:22.075 INFO:tasks.cephadm:Adding mgr.y on smithi136 2024-05-09T00:52:22.075 INFO:tasks.cephadm:Adding mgr.z on smithi151 2024-05-09T00:52:22.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi037=x;smithi136=y;smithi151=z' 2024-05-09T00:52:22.132 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:22 smithi037 ceph-mon[30122]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:22.348 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:52:22.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:22 smithi136 ceph-mon[34110]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:22.470 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:22 smithi151 ceph-mon[34780]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:23 smithi136 ceph-mon[34110]: Reconfiguring mon.b (monmap changed)... 2024-05-09T00:52:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:23 smithi136 ceph-mon[34110]: Reconfiguring daemon mon.b on smithi136 2024-05-09T00:52:23.453 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:23.453 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:23.453 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:23 smithi151 ceph-mon[34780]: Reconfiguring mon.b (monmap changed)... 2024-05-09T00:52:23.453 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:23.453 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:23.454 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:23.454 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:23 smithi151 ceph-mon[34780]: Reconfiguring daemon mon.b on smithi136 2024-05-09T00:52:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:23 smithi037 ceph-mon[30122]: Reconfiguring mon.b (monmap changed)... 2024-05-09T00:52:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:23 smithi037 ceph-mon[30122]: Reconfiguring daemon mon.b on smithi136 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 -- 172.21.15.151:0/765456962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5968102c10 msgr2=0x7f5968103020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 --2- 172.21.15.151:0/765456962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5968102c10 0x7f5968103020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5964009910 tx=0x7f5964009c20 comp rx=0 tx=0).stop 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 -- 172.21.15.151:0/765456962 shutdown_connections 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 --2- 172.21.15.151:0/765456962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5968102c10 0x7f5968103020 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 -- 172.21.15.151:0/765456962 >> 172.21.15.151:0/765456962 conn(0x7f59680fe250 msgr2=0x7f5968100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 -- 172.21.15.151:0/765456962 shutdown_connections 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 -- 172.21.15.151:0/765456962 wait complete. 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 Processor -- start 2024-05-09T00:52:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.768+0000 7f596fc83700 1 -- start start 2024-05-09T00:52:23.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596fc83700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5968102c10 0x7f596806c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596fc83700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f596819c730 0x7f596819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596fc83700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596819f090 0x7f59681a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596fc83700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5968108bd0 con 0x7f596819f090 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596fc83700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5968108a50 con 0x7f596819c730 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596fc83700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5968108d50 con 0x7f5968102c10 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5968102c10 0x7f596806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5968102c10 0x7f596806c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47856/0 (socket says 172.21.15.151:47856) 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 -- 172.21.15.151:0/3956498289 learned_addr learned my addr 172.21.15.151:0/3956498289 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596d21e700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f596819c730 0x7f596819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596e220700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596819f090 0x7f59681a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 -- 172.21.15.151:0/3956498289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f596819c730 msgr2=0x7f596819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f596819c730 0x7f596819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 -- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596819f090 msgr2=0x7f59681a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:23.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596819f090 0x7f59681a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:23.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.769+0000 7f596da1f700 1 -- 172.21.15.151:0/3956498289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59681a1d00 con 0x7f5968102c10 2024-05-09T00:52:23.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.770+0000 7f596da1f700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5968102c10 0x7f596806c740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5964005850 tx=0x7f5964004ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:23.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.770+0000 7f595affd700 1 -- 172.21.15.151:0/3956498289 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964026070 con 0x7f5968102c10 2024-05-09T00:52:23.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.770+0000 7f595affd700 1 -- 172.21.15.151:0/3956498289 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f596400b750 con 0x7f5968102c10 2024-05-09T00:52:23.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.770+0000 7f595affd700 1 -- 172.21.15.151:0/3956498289 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640038e0 con 0x7f5968102c10 2024-05-09T00:52:23.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.770+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59681a1f90 con 0x7f5968102c10 2024-05-09T00:52:23.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.770+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59681a2460 con 0x7f5968102c10 2024-05-09T00:52:23.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.771+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59681a2660 con 0x7f5968102c10 2024-05-09T00:52:23.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.771+0000 7f595affd700 1 -- 172.21.15.151:0/3956498289 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5964029070 con 0x7f5968102c10 2024-05-09T00:52:23.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.771+0000 7f595affd700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f595403e9a0 0x7f5954040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:23.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.771+0000 7f595affd700 1 -- 172.21.15.151:0/3956498289 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f59640534f0 con 0x7f5968102c10 2024-05-09T00:52:23.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.772+0000 7f596d21e700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f595403e9a0 0x7f5954040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:23.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.772+0000 7f596d21e700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f595403e9a0 0x7f5954040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f596806c0f0 tx=0x7f595c009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:23.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:23.777+0000 7f595affd700 1 -- 172.21.15.151:0/3956498289 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5964013070 con 0x7f5968102c10 2024-05-09T00:52:24.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.001+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi136=y;smithi151=z", "target": ["mon-mgr", ""]}) -- 0x7f5968100070 con 0x7f595403e9a0 2024-05-09T00:52:24.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.008+0000 7f595affd700 1 -- 172.21.15.151:0/3956498289 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5968100070 con 0x7f595403e9a0 2024-05-09T00:52:24.010 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mgr update... 2024-05-09T00:52:24.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f595403e9a0 msgr2=0x7f5954040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:24.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f595403e9a0 0x7f5954040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f596806c0f0 tx=0x7f595c009210 comp rx=0 tx=0).stop 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5968102c10 msgr2=0x7f596806c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5968102c10 0x7f596806c740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5964005850 tx=0x7f5964004ed0 comp rx=0 tx=0).stop 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 shutdown_connections 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f595403e9a0 0x7f5954040eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596819f090 0x7f59681a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5968102c10 0x7f596806c740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 --2- 172.21.15.151:0/3956498289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f596819c730 0x7f596819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 >> 172.21.15.151:0/3956498289 conn(0x7f59680fe250 msgr2=0x7f59680ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 shutdown_connections 2024-05-09T00:52:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:52:24.011+0000 7f596fc83700 1 -- 172.21.15.151:0/3956498289 wait complete. 2024-05-09T00:52:24.429 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:24 smithi151 ceph-mon[34780]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:24.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:24.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:24.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:24.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:24 smithi037 ceph-mon[30122]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:24 smithi136 ceph-mon[34110]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T00:52:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T00:52:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:25.197 DEBUG:teuthology.orchestra.run.smithi136:mgr.y> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.y.service 2024-05-09T00:52:25.199 DEBUG:teuthology.orchestra.run.smithi151:mgr.z> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.z.service 2024-05-09T00:52:25.201 INFO:tasks.cephadm:Deploying OSDs... 2024-05-09T00:52:25.202 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:52:25.202 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T00:52:25.225 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T00:52:25.226 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-05-09T00:52:25.282 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T00:52:25.282 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-09T00:52:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-09 00:51:29.115819763 +0000 2024-05-09T00:52:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-09 00:46:17.672722336 +0000 2024-05-09T00:52:25.283 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-09 00:46:17.672722336 +0000 2024-05-09T00:52:25.283 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-09 00:46:17.672722336 +0000 2024-05-09T00:52:25.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T00:52:25.352 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-09T00:52:25.352 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-09T00:52:25.352 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000222965 s, 2.3 MB/s 2024-05-09T00:52:25.353 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T00:52:25.413 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-05-09T00:52:25.471 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-09 00:51:29.150819309 +0000 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-09 00:46:18.032717691 +0000 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-09 00:46:18.032717691 +0000 2024-05-09T00:52:25.472 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-09 00:46:18.032717691 +0000 2024-05-09T00:52:25.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T00:52:25.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:25 smithi037 ceph-mon[30122]: Reconfiguring mon.c (monmap changed)... 2024-05-09T00:52:25.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:25 smithi037 ceph-mon[30122]: Reconfiguring daemon mon.c on smithi151 2024-05-09T00:52:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:25 smithi037 ceph-mon[30122]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi136=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:25 smithi037 ceph-mon[30122]: Saving service mgr spec with placement smithi037=x;smithi136=y;smithi151=z;count:3 2024-05-09T00:52:25.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:25 smithi151 ceph-mon[34780]: Reconfiguring mon.c (monmap changed)... 2024-05-09T00:52:25.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:25 smithi151 ceph-mon[34780]: Reconfiguring daemon mon.c on smithi151 2024-05-09T00:52:25.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:25 smithi151 ceph-mon[34780]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi136=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:25.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:25 smithi151 ceph-mon[34780]: Saving service mgr spec with placement smithi037=x;smithi136=y;smithi151=z;count:3 2024-05-09T00:52:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-09T00:52:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-09T00:52:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000187291 s, 2.7 MB/s 2024-05-09T00:52:25.501 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T00:52:25.558 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-05-09T00:52:25.615 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-09 00:51:29.183818881 +0000 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-09 00:46:18.385713136 +0000 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-09 00:46:18.385713136 +0000 2024-05-09T00:52:25.616 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-09 00:46:18.385713136 +0000 2024-05-09T00:52:25.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T00:52:25.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:25 smithi136 ceph-mon[34110]: Reconfiguring mon.c (monmap changed)... 2024-05-09T00:52:25.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:25 smithi136 ceph-mon[34110]: Reconfiguring daemon mon.c on smithi151 2024-05-09T00:52:25.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:25 smithi136 ceph-mon[34110]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi136=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:25.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:25 smithi136 ceph-mon[34110]: Saving service mgr spec with placement smithi037=x;smithi136=y;smithi151=z;count:3 2024-05-09T00:52:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-09T00:52:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-09T00:52:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000180454 s, 2.8 MB/s 2024-05-09T00:52:25.682 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T00:52:25.739 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-05-09T00:52:25.800 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T00:52:25.801 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:25.801 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-09T00:52:25.801 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:25.802 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:25.802 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-09 00:51:29.218818428 +0000 2024-05-09T00:52:25.803 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-09 00:46:18.738708581 +0000 2024-05-09T00:52:25.803 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-09 00:46:18.738708581 +0000 2024-05-09T00:52:25.803 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-09 00:46:18.738708581 +0000 2024-05-09T00:52:25.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T00:52:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-09T00:52:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-09T00:52:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000190878 s, 2.7 MB/s 2024-05-09T00:52:25.868 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T00:52:25.925 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-09T00:52:25.925 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T00:52:25.944 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T00:52:25.944 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-09 00:52:11.776105561 +0000 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-09 00:46:26.659561553 +0000 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-09 00:46:26.659561553 +0000 2024-05-09T00:52:26.003 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-09 00:46:26.659561553 +0000 2024-05-09T00:52:26.004 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T00:52:26.070 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-09T00:52:26.071 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-09T00:52:26.071 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000222302 s, 2.3 MB/s 2024-05-09T00:52:26.072 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T00:52:26.130 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-05-09T00:52:26.187 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T00:52:26.187 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:26.187 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-09T00:52:26.187 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:26.187 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:26.187 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-09 00:52:11.777105538 +0000 2024-05-09T00:52:26.188 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-09 00:46:27.030552747 +0000 2024-05-09T00:52:26.188 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-09 00:46:27.030552747 +0000 2024-05-09T00:52:26.188 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-09 00:46:27.030552747 +0000 2024-05-09T00:52:26.188 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T00:52:26.252 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-09T00:52:26.252 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-09T00:52:26.252 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000218763 s, 2.3 MB/s 2024-05-09T00:52:26.253 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T00:52:26.311 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-05-09T00:52:26.367 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-09 00:52:11.777105538 +0000 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-09 00:46:27.395544083 +0000 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-09 00:46:27.395544083 +0000 2024-05-09T00:52:26.368 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-09 00:46:27.395544083 +0000 2024-05-09T00:52:26.368 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T00:52:26.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:26 smithi136 ceph-mon[34110]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:26 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:26 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:26 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:26.401 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-09T00:52:26.401 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-09T00:52:26.401 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.0002195 s, 2.3 MB/s 2024-05-09T00:52:26.402 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T00:52:26.459 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-05-09T00:52:26.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:26 smithi037 ceph-mon[30122]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:26.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:26 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:26.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:26 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:26.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:26 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:26 smithi151 ceph-mon[34780]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:26 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:26 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:26 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:26.514 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T00:52:26.514 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:26.515 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-09T00:52:26.515 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:26.515 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:26.515 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-09 00:52:11.777105538 +0000 2024-05-09T00:52:26.515 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-09 00:46:27.752535609 +0000 2024-05-09T00:52:26.515 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-09 00:46:27.752535609 +0000 2024-05-09T00:52:26.515 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-09 00:46:27.752535609 +0000 2024-05-09T00:52:26.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T00:52:26.578 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-09T00:52:26.578 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-09T00:52:26.578 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000232958 s, 2.2 MB/s 2024-05-09T00:52:26.580 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T00:52:26.636 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-09T00:52:26.636 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T00:52:26.651 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T00:52:26.652 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-05-09T00:52:26.708 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T00:52:26.708 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:26.708 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-09T00:52:26.708 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:26.709 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:26.709 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-09 00:52:02.168038174 +0000 2024-05-09T00:52:26.709 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-09 00:46:28.474876971 +0000 2024-05-09T00:52:26.709 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-09 00:46:28.474876971 +0000 2024-05-09T00:52:26.709 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-09 00:46:28.474876971 +0000 2024-05-09T00:52:26.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T00:52:26.772 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-09T00:52:26.772 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-09T00:52:26.772 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000268311 s, 1.9 MB/s 2024-05-09T00:52:26.773 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T00:52:26.830 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-05-09T00:52:26.885 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T00:52:26.885 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:26.885 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-09T00:52:26.886 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:26.886 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:26.886 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-09 00:52:02.169038162 +0000 2024-05-09T00:52:26.886 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-09 00:46:28.823872755 +0000 2024-05-09T00:52:26.886 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-09 00:46:28.823872755 +0000 2024-05-09T00:52:26.886 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-09 00:46:28.823872755 +0000 2024-05-09T00:52:26.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T00:52:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-09T00:52:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-09T00:52:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000245425 s, 2.1 MB/s 2024-05-09T00:52:26.949 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T00:52:27.007 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-09 00:52:02.169038162 +0000 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-09 00:46:29.168868587 +0000 2024-05-09T00:52:27.062 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-09 00:46:29.168868587 +0000 2024-05-09T00:52:27.063 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-09 00:46:29.168868587 +0000 2024-05-09T00:52:27.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T00:52:27.126 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-09T00:52:27.126 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-09T00:52:27.126 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000175637 s, 2.9 MB/s 2024-05-09T00:52:27.127 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T00:52:27.182 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-05-09T00:52:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T00:52:27.238 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T00:52:27.238 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-09T00:52:27.238 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:52:27.238 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T00:52:27.238 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-09 00:52:02.170038150 +0000 2024-05-09T00:52:27.239 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-09 00:46:29.511864443 +0000 2024-05-09T00:52:27.239 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-09 00:46:29.511864443 +0000 2024-05-09T00:52:27.239 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-09 00:46:29.511864443 +0000 2024-05-09T00:52:27.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T00:52:27.300 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-09T00:52:27.300 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-09T00:52:27.300 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000194289 s, 2.6 MB/s 2024-05-09T00:52:27.302 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T00:52:27.358 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-05-09T00:52:27.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:27 smithi037 ceph-mon[30122]: Deploying daemon mgr.z on smithi151 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:27.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:27 smithi151 ceph-mon[34780]: Deploying daemon mgr.z on smithi151 2024-05-09T00:52:27.613 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:27 smithi136 ceph-mon[34110]: Deploying daemon mgr.z on smithi151 2024-05-09T00:52:28.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:28 smithi151 ceph-mon[34780]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:28.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:28 smithi037 ceph-mon[30122]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:28 smithi136 ceph-mon[34110]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:28.975 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:28 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:28.831+0000 7f60e2f97200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:52:29.428 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:29.016+0000 7f60e2f97200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:52:29.429 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:29.119+0000 7f60e2f97200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:52:29.429 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:29.427+0000 7f60e2f97200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:52:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T00:52:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T00:52:29.684 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-05-09T00:52:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-05-09T00:52:29.684 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126058 s, 832 MB/s 2024-05-09T00:52:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-05-09T00:52:29.724 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:29.511+0000 7f60e2f97200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:52:29.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:29.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:29.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:29.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:29.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:29.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T00:52:29.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:29.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:29.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:29 smithi037 ceph-mon[30122]: Deploying daemon mgr.y on smithi136 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:30.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:29 smithi151 ceph-mon[34780]: Deploying daemon mgr.y on smithi136 2024-05-09T00:52:30.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:30.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:29 smithi136 ceph-mon[34110]: Deploying daemon mgr.y on smithi136 2024-05-09T00:52:30.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-05-09T00:52:30.674 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:52:31.077 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:30.763+0000 7f60e2f97200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:52:31.078 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:30.938+0000 7f60e2f97200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:52:31.082 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:30 smithi136 systemd[1]: Starting Ceph mgr.y for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:52:31.359 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 podman[35486]: 2024-05-09 00:52:30.984830936 +0000 UTC m=+0.018115101 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:52:31.360 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 podman[35486]: 2024-05-09 00:52:31.104508509 +0000 UTC m=+0.137792673 container create 70b7d49e8a7e57b1dd847c89c9e118871aec6fcbde5aff975e39dad05ff32c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0) 2024-05-09T00:52:31.360 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 podman[35486]: 2024-05-09 00:52:31.321532598 +0000 UTC m=+0.354816763 container init 70b7d49e8a7e57b1dd847c89c9e118871aec6fcbde5aff975e39dad05ff32c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-09T00:52:31.360 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 podman[35486]: 2024-05-09 00:52:31.324355668 +0000 UTC m=+0.357639842 container start 70b7d49e8a7e57b1dd847c89c9e118871aec6fcbde5aff975e39dad05ff32c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-09T00:52:31.403 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:31.115+0000 7f60e2f97200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:52:31.403 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:31.401+0000 7f60e2f97200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:52:31.628 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 ceph-mgr[35505]: -- 172.21.15.136:0/4108459930 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c02c0205a0 con 0x55c030daa480 2024-05-09T00:52:31.628 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 bash[35486]: 70b7d49e8a7e57b1dd847c89c9e118871aec6fcbde5aff975e39dad05ff32c4d 2024-05-09T00:52:31.628 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 systemd[1]: Started Ceph mgr.y for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:52:31.628 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:31.496+0000 7fdfd5a57200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:52:31.701 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:31.494+0000 7f60e2f97200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:52:31.701 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:31.700+0000 7f60e2f97200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:52:31.975 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:31.903+0000 7f60e2f97200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:52:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:31 smithi151 ceph-mon[34780]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:32.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:31 smithi037 ceph-mon[30122]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:32.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:32.117 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:31 smithi136 ceph-mon[34110]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:32.117 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.118 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.118 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.118 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:32.118 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:32.118 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:31.684+0000 7fdfd5a57200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:52:32.118 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:31 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:31.790+0000 7fdfd5a57200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:52:32.118 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:32.117+0000 7fdfd5a57200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 -- 172.21.15.37:0/2920894220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103db0 msgr2=0x7fe04c10b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 --2- 172.21.15.37:0/2920894220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103db0 0x7fe04c10b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe04400b0a0 tx=0x7fe04400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 -- 172.21.15.37:0/2920894220 shutdown_connections 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 --2- 172.21.15.37:0/2920894220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103db0 0x7fe04c10b6c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 --2- 172.21.15.37:0/2920894220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04c104750 0x7fe04c104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 --2- 172.21.15.37:0/2920894220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe04c103460 0x7fe04c103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 -- 172.21.15.37:0/2920894220 >> 172.21.15.37:0/2920894220 conn(0x7fe04c0fe020 msgr2=0x7fe04c1004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 -- 172.21.15.37:0/2920894220 shutdown_connections 2024-05-09T00:52:32.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 -- 172.21.15.37:0/2920894220 wait complete. 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.256+0000 7fe051941700 1 Processor -- start 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe051941700 1 -- start start 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe051941700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103460 0x7fe04c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe051941700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04c103db0 0x7fe04c19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe051941700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe04c104750 0x7fe04c1a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe051941700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c10ecc0 con 0x7fe04c103460 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe051941700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c10eb40 con 0x7fe04c103db0 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe051941700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c10ee40 con 0x7fe04c104750 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103460 0x7fe04c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:32.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103460 0x7fe04c19a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47174/0 (socket says 172.21.15.37:47174) 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 -- 172.21.15.37:0/4056707685 learned_addr learned my addr 172.21.15.37:0/4056707685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04b7fe700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe04c104750 0x7fe04c1a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04a7fc700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04c103db0 0x7fe04c19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 -- 172.21.15.37:0/4056707685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe04c104750 msgr2=0x7fe04c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe04c104750 0x7fe04c1a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 -- 172.21.15.37:0/4056707685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04c103db0 msgr2=0x7fe04c19ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04c103db0 0x7fe04c19ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 -- 172.21.15.37:0/4056707685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c1a23b0 con 0x7fe04c103460 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.257+0000 7fe04affd700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103460 0x7fe04c19a8e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00d980 tx=0x7fe03c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.258+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c017070 con 0x7fe04c103460 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.258+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe03c00fd40 con 0x7fe04c103460 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.258+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c1a26a0 con 0x7fe04c103460 2024-05-09T00:52:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.258+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00e3b0 con 0x7fe04c103460 2024-05-09T00:52:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.258+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1a2c30 con 0x7fe04c103460 2024-05-09T00:52:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.259+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fe03c00e550 con 0x7fe04c103460 2024-05-09T00:52:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.259+0000 7fe05093f700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe03403e750 0x7fe034040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.259+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c0512c0 con 0x7fe04c103460 2024-05-09T00:52:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.259+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe03c053260 con 0x7fe04c103460 2024-05-09T00:52:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.259+0000 7fe04a7fc700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe03403e750 0x7fe034040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.260+0000 7fe04a7fc700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe03403e750 0x7fe034040c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe04c19b990 tx=0x7fe04000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.265+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe03c01ed50 con 0x7fe04c103460 2024-05-09T00:52:32.378 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:32.212+0000 7fdfd5a57200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:52:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:32.487+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe04c100000 con 0x7fe03403e750 2024-05-09T00:52:32.724 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:32.543+0000 7f60e2f97200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:52:33.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:52:33.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:52:33.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:33.133 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:52:33.133 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:52:33.133 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:33.216 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:32.769+0000 7f60e2f97200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T00:52:33.216 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:52:33.216 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:52:33.216 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:33.475 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:33 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:33.215+0000 7f60e2f97200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:52:33.475 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:33 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:33.311+0000 7f60e2f97200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:52:33.820 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:33 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:33.482+0000 7fdfd5a57200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:52:33.820 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:33 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:33.650+0000 7fdfd5a57200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:52:33.821 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:33 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:33.819+0000 7fdfd5a57200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:52:33.975 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:33 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:33.678+0000 7f60e2f97200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:52:34.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: Reconfiguring mgr.x (unknown last config time)... 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:34.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: Reconfiguring daemon mgr.x on smithi037 2024-05-09T00:52:34.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: Reconfiguring mgr.x (unknown last config time)... 2024-05-09T00:52:34.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:34.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:34.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:34.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: Reconfiguring daemon mgr.x on smithi037 2024-05-09T00:52:34.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.225 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:34.031+0000 7f60e2f97200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:52:34.225 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:34.124+0000 7f60e2f97200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:52:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:52:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: Reconfiguring mgr.x (unknown last config time)... 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: Reconfiguring daemon mgr.x on smithi037 2024-05-09T00:52:34.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:34.378 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:34 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:34.102+0000 7fdfd5a57200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:52:34.378 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:34 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:34.192+0000 7fdfd5a57200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:52:34.725 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:34.365+0000 7f60e2f97200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:52:34.725 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:34.498+0000 7f60e2f97200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:52:34.725 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:34.593+0000 7f60e2f97200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:52:34.877 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:34 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:34.394+0000 7fdfd5a57200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:52:34.878 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:34 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:34.582+0000 7fdfd5a57200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:52:35.224 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:34.918+0000 7f60e2f97200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:52:35.225 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:35.009+0000 7f60e2f97200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:52:35.628 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:35 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:35.173+0000 7fdfd5a57200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:52:35.628 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:35 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:35.389+0000 7fdfd5a57200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T00:52:35.975 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:35.611+0000 7f60e2f97200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:52:35.975 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 00:52:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z[36629]: 2024-05-09T00:52:35.827+0000 7f60e2f97200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:52:36.128 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:35 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:35.806+0000 7fdfd5a57200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:52:36.128 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:35 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:35.900+0000 7fdfd5a57200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:52:36.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:36.353+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7fe03c022d10 con 0x7fe04c103460 2024-05-09T00:52:36.616 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:36 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:36.266+0000 7fdfd5a57200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:36 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:36.615+0000 7fdfd5a57200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: Standby manager daemon z started 2024-05-09T00:52:36.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T00:52:36.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:52:36.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T00:52:36.618 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:36 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:52:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:36.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:36.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:36.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: Standby manager daemon z started 2024-05-09T00:52:36.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T00:52:36.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:52:36.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T00:52:36.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:36 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:52:36.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:36.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: Standby manager daemon z started 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T00:52:36.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:36 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.151:0/2279259836' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:52:36.877 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:36 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:36.706+0000 7fdfd5a57200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:52:37.378 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:36 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:36.945+0000 7fdfd5a57200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:52:37.378 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:37 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:37.074+0000 7fdfd5a57200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:52:37.378 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:37 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:37.167+0000 7fdfd5a57200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2810973233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c"}]: dispatch 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2810973233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c"}]': finished 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: osdmap e5: 1 total, 0 up, 1 in 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:37.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:37 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/857371776' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-0/activate.monmap"}]: dispatch 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2810973233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c"}]: dispatch 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2810973233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c"}]': finished 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: osdmap e5: 1 total, 0 up, 1 in 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:37.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:37 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/857371776' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-0/activate.monmap"}]: dispatch 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:37 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:37.493+0000 7fdfd5a57200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:37 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:37.584+0000 7fdfd5a57200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: mgrmap e14: x(active, since 77s), standbys: z 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2810973233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c"}]: dispatch 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2810973233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c"}]': finished 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: osdmap e5: 1 total, 0 up, 1 in 2024-05-09T00:52:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:37.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:37.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:37 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/857371776' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-0/activate.monmap"}]: dispatch 2024-05-09T00:52:38.538 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:38 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:38.179+0000 7fdfd5a57200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:52:38.538 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 00:52:38 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y[35501]: 2024-05-09T00:52:38.390+0000 7fdfd5a57200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:52:38.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:38.550+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fe03c020cc0 con 0x7fe04c103460 2024-05-09T00:52:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:38 smithi136 ceph-mon[34110]: Standby manager daemon y started 2024-05-09T00:52:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:38 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T00:52:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:38 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:52:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:38 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T00:52:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:38 smithi136 ceph-mon[34110]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:52:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:38 smithi037 ceph-mon[30122]: Standby manager daemon y started 2024-05-09T00:52:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:38 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T00:52:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:38 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:52:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:38 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T00:52:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:38 smithi037 ceph-mon[30122]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:52:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:38 smithi151 ceph-mon[34780]: Standby manager daemon y started 2024-05-09T00:52:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:38 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T00:52:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:38 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:52:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:38 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T00:52:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:38 smithi151 ceph-mon[34780]: from='mgr.? 172.21.15.136:0/141239559' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:52:39.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:39 smithi136 ceph-mon[34110]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-05-09T00:52:39.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:39 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T00:52:39.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:39 smithi136 ceph-mon[34110]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:39 smithi037 ceph-mon[30122]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-05-09T00:52:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:39 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T00:52:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:39 smithi037 ceph-mon[30122]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:39.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:39 smithi151 ceph-mon[34780]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-05-09T00:52:39.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:39 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T00:52:39.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:39 smithi151 ceph-mon[34780]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:42.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:41 smithi136 ceph-mon[34110]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:42.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:41 smithi037 ceph-mon[30122]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:42.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:41 smithi151 ceph-mon[34780]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:43.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:43 smithi037 ceph-mon[30122]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:44.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:43 smithi136 ceph-mon[34110]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:44.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:43 smithi151 ceph-mon[34780]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:45.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:52:45.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:45.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:44 smithi136 ceph-mon[34110]: Deploying daemon osd.0 on smithi037 2024-05-09T00:52:45.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:52:45.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:45.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:44 smithi037 ceph-mon[30122]: Deploying daemon osd.0 on smithi037 2024-05-09T00:52:45.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T00:52:45.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:45.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:44 smithi151 ceph-mon[34780]: Deploying daemon osd.0 on smithi037 2024-05-09T00:52:46.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:45 smithi037 ceph-mon[30122]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:46.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:45 smithi136 ceph-mon[34110]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:46.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:45 smithi151 ceph-mon[34780]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:48.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:47 smithi136 ceph-mon[34110]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:47 smithi037 ceph-mon[30122]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:48.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:47 smithi151 ceph-mon[34780]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:49.940 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:49 smithi037 ceph-mon[30122]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:49.940 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:49.940 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:49.941 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:50.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:49 smithi136 ceph-mon[34110]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:50.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:50.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:50.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:50.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:49 smithi151 ceph-mon[34780]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:50.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:50.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:50.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:51.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:51 smithi037 ceph-mon[30122]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:52.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:51 smithi151 ceph-mon[34780]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:52.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:51 smithi136 ceph-mon[34110]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:53.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.246+0000 7fe05093f700 1 -- 172.21.15.37:0/4056707685 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe04c100000 con 0x7fe03403e750 2024-05-09T00:52:53.247 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-05-09T00:52:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe03403e750 msgr2=0x7fe034040c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe03403e750 0x7fe034040c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe04c19b990 tx=0x7fe04000a380 comp rx=0 tx=0).stop 2024-05-09T00:52:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103460 msgr2=0x7fe04c19a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103460 0x7fe04c19a8e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00d980 tx=0x7fe03c00dc90 comp rx=0 tx=0).stop 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 shutdown_connections 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe03403e750 0x7fe034040c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe04c104750 0x7fe04c1a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe04c103460 0x7fe04c19a8e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 --2- 172.21.15.37:0/4056707685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe04c103db0 0x7fe04c19ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.248+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 >> 172.21.15.37:0/4056707685 conn(0x7fe04c0fe020 msgr2=0x7fe04c0ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.249+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 shutdown_connections 2024-05-09T00:52:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:52:53.249+0000 7fe051941700 1 -- 172.21.15.37:0/4056707685 wait complete. 2024-05-09T00:52:53.899 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:53.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:53 smithi037 ceph-mon[30122]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T00:52:53.926 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.0.service 2024-05-09T00:52:53.928 INFO:tasks.cephadm:Deploying osd.1 on smithi136 with /dev/vg_nvme/lv_4... 2024-05-09T00:52:53.928 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:53 smithi136 ceph-mon[34110]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T00:52:54.171 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:52:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:54.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:54.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:54.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:52:54.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:53 smithi151 ceph-mon[34780]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T00:52:55.488 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:55 smithi136 ceph-mon[34110]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T00:52:55.488 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:55 smithi136 ceph-mon[34110]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T00:52:55.488 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:55 smithi136 ceph-mon[34110]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:52:55.488 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:55 smithi037 ceph-mon[30122]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T00:52:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:55 smithi037 ceph-mon[30122]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T00:52:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:55 smithi037 ceph-mon[30122]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:52:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:55 smithi151 ceph-mon[34780]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T00:52:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:55 smithi151 ceph-mon[34780]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T00:52:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:55 smithi151 ceph-mon[34780]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:52:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.041 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T00:52:56.042 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T00:52:56.042 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-09T00:52:56.042 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-09T00:52:56.042 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0077316 s, 1.4 GB/s 2024-05-09T00:52:56.042 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-09T00:52:56.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:56 smithi037 ceph-mon[30122]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:56.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:56 smithi037 ceph-mon[30122]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:52:56.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:56 smithi037 ceph-mon[30122]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T00:52:56.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:56 smithi037 ceph-mon[30122]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' 2024-05-09T00:52:56.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.475 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:52:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0[42653]: 2024-05-09T00:52:56.200+0000 7fb4453e1700 -1 osd.0 0 waiting for initial osdmap 2024-05-09T00:52:56.475 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:52:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0[42653]: 2024-05-09T00:52:56.227+0000 7fb43d18e700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:52:56.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:56 smithi136 ceph-mon[34110]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:56.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:56 smithi136 ceph-mon[34110]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:52:56.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:56 smithi136 ceph-mon[34110]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T00:52:56.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:56 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:56 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:56 smithi136 ceph-mon[34110]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' 2024-05-09T00:52:56.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:56 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.623 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2024-05-09T00:52:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:56 smithi151 ceph-mon[34780]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:56 smithi151 ceph-mon[34780]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:52:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:56 smithi151 ceph-mon[34780]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T00:52:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:56 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:56 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:56 smithi151 ceph-mon[34780]: from='osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504]' entity='osd.0' 2024-05-09T00:52:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:56 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:56.863 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:52:57.609 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:52:57.609 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:52:57.609 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.609 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.609 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:52:57.609 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.610 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:57.610 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:57.610 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.610 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] boot 2024-05-09T00:52:57.610 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: osdmap e8: 1 total, 1 up, 1 in 2024-05-09T00:52:57.610 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] boot 2024-05-09T00:52:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: osdmap e8: 1 total, 1 up, 1 in 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:52:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:52:57.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: osd.0 [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] boot 2024-05-09T00:52:57.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: osdmap e8: 1 total, 1 up, 1 in 2024-05-09T00:52:57.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:52:58.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 -- 172.21.15.136:0/237267679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f81054a0 msgr2=0x7f95f81058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:58.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 --2- 172.21.15.136:0/237267679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f81054a0 0x7f95f81058b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009990 tx=0x7f95ec009ca0 comp rx=0 tx=0).stop 2024-05-09T00:52:58.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 -- 172.21.15.136:0/237267679 shutdown_connections 2024-05-09T00:52:58.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 --2- 172.21.15.136:0/237267679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f8105e40 0x7f95f810c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:58.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 --2- 172.21.15.136:0/237267679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f8104370 0x7f95f8104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:58.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 --2- 172.21.15.136:0/237267679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f81054a0 0x7f95f81058b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:58.336 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 -- 172.21.15.136:0/237267679 >> 172.21.15.136:0/237267679 conn(0x7f95f80ff9d0 msgr2=0x7f95f8101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:52:58.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 -- 172.21.15.136:0/237267679 shutdown_connections 2024-05-09T00:52:58.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.335+0000 7f95fe165700 1 -- 172.21.15.136:0/237267679 wait complete. 2024-05-09T00:52:58.337 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 Processor -- start 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 -- start start 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f8104370 0x7f95f819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f81054a0 0x7f95f819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f8105e40 0x7f95f81a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95f810fe30 con 0x7f95f8105e40 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95f810fcb0 con 0x7f95f8104370 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95fe165700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95f810ffb0 con 0x7f95f81054a0 2024-05-09T00:52:58.339 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f8104370 0x7f95f819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f8104370 0x7f95f819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53272/0 (socket says 172.21.15.136:53272) 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 -- 172.21.15.136:0/2585980848 learned_addr learned my addr 172.21.15.136:0/2585980848 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f6ffd700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f81054a0 0x7f95f819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 -- 172.21.15.136:0/2585980848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f81054a0 msgr2=0x7f95f819aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f81054a0 0x7f95f819aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 -- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f8105e40 msgr2=0x7f95f81a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f7fff700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f8105e40 0x7f95f81a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f8105e40 0x7f95f81a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.336+0000 7f95f77fe700 1 -- 172.21.15.136:0/2585980848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81a24d0 con 0x7f95f8104370 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.337+0000 7f95f77fe700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f8104370 0x7f95f819a970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95e800d950 tx=0x7f95e800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.337+0000 7f95f4ff9700 1 -- 172.21.15.136:0/2585980848 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8017070 con 0x7f95f8104370 2024-05-09T00:52:58.340 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.337+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81a27c0 con 0x7f95f8104370 2024-05-09T00:52:58.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.337+0000 7f95f4ff9700 1 -- 172.21.15.136:0/2585980848 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e800de30 con 0x7f95f8104370 2024-05-09T00:52:58.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.337+0000 7f95f4ff9700 1 -- 172.21.15.136:0/2585980848 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8003b10 con 0x7f95f8104370 2024-05-09T00:52:58.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.337+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81a2d00 con 0x7f95f8104370 2024-05-09T00:52:58.341 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.338+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f80512c0 con 0x7f95f8104370 2024-05-09T00:52:58.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.339+0000 7f95f4ff9700 1 -- 172.21.15.136:0/2585980848 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f95e8003cb0 con 0x7f95f8104370 2024-05-09T00:52:58.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.340+0000 7f95f4ff9700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95e00b27f0 0x7f95e00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:52:58.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.340+0000 7f95f4ff9700 1 -- 172.21.15.136:0/2585980848 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f95e80e0b90 con 0x7f95f8104370 2024-05-09T00:52:58.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.340+0000 7f95f6ffd700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95e00b27f0 0x7f95e00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:52:58.342 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.341+0000 7f95f6ffd700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95e00b27f0 0x7f95e00b4d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95ec006010 tx=0x7f95ec003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:52:58.344 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.344+0000 7f95f4ff9700 1 -- 172.21.15.136:0/2585980848 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f95e8020030 con 0x7f95f8104370 2024-05-09T00:52:58.555 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:52:58.555+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f95f8063c00 con 0x7f95e00b27f0 2024-05-09T00:52:58.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:58 smithi136 ceph-mon[34110]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:58.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:58 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi037 2024-05-09T00:52:58.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:58 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi037 to 17093M 2024-05-09T00:52:58.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:58 smithi151 ceph-mon[34780]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:58.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:58 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi037 2024-05-09T00:52:58.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:58 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi037 to 17093M 2024-05-09T00:52:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:58 smithi037 ceph-mon[30122]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T00:52:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:58 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi037 2024-05-09T00:52:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:58 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi037 to 17093M 2024-05-09T00:52:59.432 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:59 smithi136 ceph-mon[34110]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T00:52:59.432 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:52:59.432 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:52:59.432 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:52:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:59 smithi037 ceph-mon[30122]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T00:52:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:52:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:52:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:52:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:52:59.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:59 smithi151 ceph-mon[34780]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T00:52:59.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:52:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:52:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:52:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:00.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:00 smithi136 ceph-mon[34110]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:00.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:00 smithi136 ceph-mon[34110]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:00 smithi037 ceph-mon[30122]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:00 smithi037 ceph-mon[30122]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:00.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:00 smithi151 ceph-mon[34780]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:00.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:00 smithi151 ceph-mon[34780]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:01 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/2053255678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]: dispatch 2024-05-09T00:53:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:01 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]: dispatch 2024-05-09T00:53:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:01 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]': finished 2024-05-09T00:53:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:01 smithi136 ceph-mon[34110]: osdmap e10: 2 total, 1 up, 2 in 2024-05-09T00:53:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:01 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/2053255678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]: dispatch 2024-05-09T00:53:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:01 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]: dispatch 2024-05-09T00:53:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:01 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]': finished 2024-05-09T00:53:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:01 smithi037 ceph-mon[30122]: osdmap e10: 2 total, 1 up, 2 in 2024-05-09T00:53:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:01.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:01 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/2053255678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]: dispatch 2024-05-09T00:53:01.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:01 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]: dispatch 2024-05-09T00:53:01.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:01 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95653797-b846-453e-8884-1f30a924c060"}]': finished 2024-05-09T00:53:01.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:01 smithi151 ceph-mon[34780]: osdmap e10: 2 total, 1 up, 2 in 2024-05-09T00:53:01.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:02 smithi136 ceph-mon[34110]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:02 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/2891510961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-1/activate.monmap"}]: dispatch 2024-05-09T00:53:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:02 smithi037 ceph-mon[30122]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:02 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/2891510961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-1/activate.monmap"}]: dispatch 2024-05-09T00:53:02.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:02 smithi151 ceph-mon[34780]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:02.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:02 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/2891510961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-1/activate.monmap"}]: dispatch 2024-05-09T00:53:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:04 smithi136 ceph-mon[34110]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:04 smithi037 ceph-mon[30122]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:04 smithi151 ceph-mon[34780]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:05.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:05 smithi136 ceph-mon[34110]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:05 smithi037 ceph-mon[30122]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:05 smithi151 ceph-mon[34780]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:08.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:07 smithi136 ceph-mon[34110]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:08.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:07 smithi037 ceph-mon[30122]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:08.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:07 smithi151 ceph-mon[34780]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:09.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:53:09.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:09.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:53:09.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:09.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T00:53:09.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:09.904 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:09 smithi136 ceph-mon[34110]: Deploying daemon osd.1 on smithi136 2024-05-09T00:53:09.905 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:09 smithi136 ceph-mon[34110]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:10.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:09 smithi037 ceph-mon[30122]: Deploying daemon osd.1 on smithi136 2024-05-09T00:53:10.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:09 smithi037 ceph-mon[30122]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:10.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:09 smithi151 ceph-mon[34780]: Deploying daemon osd.1 on smithi136 2024-05-09T00:53:10.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:09 smithi151 ceph-mon[34780]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:12.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:11 smithi136 ceph-mon[34110]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:11 smithi037 ceph-mon[30122]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:12.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:11 smithi151 ceph-mon[34780]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:14.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:13 smithi136 ceph-mon[34110]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:14.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:13 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:14.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:13 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:14.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:13 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:13 smithi037 ceph-mon[30122]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:13 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:13 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:13 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:14.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:13 smithi151 ceph-mon[34780]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:14.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:13 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:13 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:13 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:16.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:15 smithi136 ceph-mon[34110]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:16.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:15 smithi037 ceph-mon[30122]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:16.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:15 smithi151 ceph-mon[34780]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:17.019 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.019 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.019 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:17.019 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:17.019 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.143 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.143 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.143 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:17.143 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:17.143 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:17.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:17.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.374 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.373+0000 7f95f4ff9700 1 -- 172.21.15.136:0/2585980848 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f95f8063c00 con 0x7f95e00b27f0 2024-05-09T00:53:17.374 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 1 on host 'smithi136' 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95e00b27f0 msgr2=0x7f95e00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95e00b27f0 0x7f95e00b4d00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95ec006010 tx=0x7f95ec003860 comp rx=0 tx=0).stop 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f8104370 msgr2=0x7f95f819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f8104370 0x7f95f819a970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f95e800d950 tx=0x7f95e800dd10 comp rx=0 tx=0).stop 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 shutdown_connections 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95e00b27f0 0x7f95e00b4d00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f8105e40 0x7f95f81a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95f8104370 0x7f95f819a970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:17.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 --2- 172.21.15.136:0/2585980848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f81054a0 0x7f95f819aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:17.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 >> 172.21.15.136:0/2585980848 conn(0x7f95f80ff9d0 msgr2=0x7f95f81086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:53:17.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 shutdown_connections 2024-05-09T00:53:17.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:53:17.376+0000 7f95fe165700 1 -- 172.21.15.136:0/2585980848 wait complete. 2024-05-09T00:53:17.956 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:17 smithi136 ceph-mon[34110]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:17.956 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:17.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:17.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:17 smithi136 ceph-mon[34110]: from='osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:53:17.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:17 smithi136 ceph-mon[34110]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:53:17.958 DEBUG:teuthology.orchestra.run.smithi136:osd.1> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.1.service 2024-05-09T00:53:17.961 INFO:tasks.cephadm:Deploying osd.2 on smithi151 with /dev/vg_nvme/lv_4... 2024-05-09T00:53:17.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T00:53:18.206 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:53:18.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:17 smithi037 ceph-mon[30122]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:18.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:18.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:18.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:18.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:17 smithi037 ceph-mon[30122]: from='osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:53:18.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:17 smithi037 ceph-mon[30122]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:53:18.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:17 smithi151 ceph-mon[34780]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:18.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:18.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:18.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:18.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:17 smithi151 ceph-mon[34780]: from='osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:53:18.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:17 smithi151 ceph-mon[34780]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T00:53:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:19 smithi136 ceph-mon[34110]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T00:53:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:19 smithi136 ceph-mon[34110]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T00:53:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:19 smithi136 ceph-mon[34110]: from='osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:53:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:19 smithi136 ceph-mon[34110]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:53:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:19 smithi136 ceph-mon[34110]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:19.629 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1[38695]: 2024-05-09T00:53:19.350+0000 7fa31250b700 -1 osd.1 0 waiting for initial osdmap 2024-05-09T00:53:19.629 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1[38695]: 2024-05-09T00:53:19.355+0000 7fa30e2c0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:53:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:19 smithi037 ceph-mon[30122]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T00:53:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:19 smithi037 ceph-mon[30122]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T00:53:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:19 smithi037 ceph-mon[30122]: from='osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:53:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:19 smithi037 ceph-mon[30122]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:53:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:19 smithi037 ceph-mon[30122]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:19 smithi151 ceph-mon[34780]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T00:53:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:19 smithi151 ceph-mon[34780]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T00:53:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:19 smithi151 ceph-mon[34780]: from='osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:53:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:19 smithi151 ceph-mon[34780]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:53:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:19 smithi151 ceph-mon[34780]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T00:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T00:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-09T00:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-09T00:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113973 s, 920 MB/s 2024-05-09T00:53:19.883 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-09T00:53:20.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:20 smithi151 ceph-mon[34780]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:53:20.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:20 smithi151 ceph-mon[34780]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T00:53:20.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:20.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:20.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_4 2024-05-09T00:53:20.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:20 smithi136 ceph-mon[34110]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:53:20.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:20 smithi136 ceph-mon[34110]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T00:53:20.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:20.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:20.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:20 smithi037 ceph-mon[30122]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:53:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:20 smithi037 ceph-mon[30122]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T00:53:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:20.728 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] boot 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: osdmap e13: 2 total, 2 up, 2 in 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi136 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:53:21.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi136 to 17088M 2024-05-09T00:53:21.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:21.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:21.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:21 smithi136 ceph-mon[34110]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] boot 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: osdmap e13: 2 total, 2 up, 2 in 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi136 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi136 to 17088M 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:21 smithi037 ceph-mon[30122]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: osd.1 [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] boot 2024-05-09T00:53:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: osdmap e13: 2 total, 2 up, 2 in 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi136 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi136 to 17088M 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:21.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:21 smithi151 ceph-mon[34780]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 -- 172.21.15.151:0/3061599239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f498410a150 msgr2=0x7f498410c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3061599239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f498410a150 0x7f498410c570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f497c00b0a0 tx=0x7f497c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 -- 172.21.15.151:0/3061599239 shutdown_connections 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3061599239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f498410a150 0x7f498410c570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3061599239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4984102670 0x7f4984102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3061599239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49841077f0 0x7f4984109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 -- 172.21.15.151:0/3061599239 >> 172.21.15.151:0/3061599239 conn(0x7f49840fe010 msgr2=0x7f49841004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 -- 172.21.15.151:0/3061599239 shutdown_connections 2024-05-09T00:53:22.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.173+0000 7f498b1bf700 1 -- 172.21.15.151:0/3061599239 wait complete. 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 Processor -- start 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 -- start start 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4984102670 0x7f498419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49841077f0 0x7f498419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f498410a150 0x7f49841a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f498410fd90 con 0x7f4984102670 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f498410fc10 con 0x7f498410a150 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498b1bf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f498410ff10 con 0x7f49841077f0 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f4983fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49841077f0 0x7f498419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f4983fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49841077f0 0x7f498419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60226/0 (socket says 172.21.15.151:60226) 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f4983fff700 1 -- 172.21.15.151:0/3508389262 learned_addr learned my addr 172.21.15.151:0/3508389262 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f4988f5b700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4984102670 0x7f498419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.174+0000 7f498975c700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f498410a150 0x7f49841a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:22.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4983fff700 1 -- 172.21.15.151:0/3508389262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f498410a150 msgr2=0x7f49841a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4983fff700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f498410a150 0x7f49841a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4983fff700 1 -- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4984102670 msgr2=0x7f498419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4983fff700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4984102670 0x7f498419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4983fff700 1 -- 172.21.15.151:0/3508389262 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49841a2410 con 0x7f49841077f0 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4988f5b700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4984102670 0x7f498419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4983fff700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49841077f0 0x7f498419adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f497000d950 tx=0x7f497000dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4981ffb700 1 -- 172.21.15.151:0/3508389262 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970016070 con 0x7f49841077f0 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49841a2700 con 0x7f49841077f0 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4981ffb700 1 -- 172.21.15.151:0/3508389262 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4970010460 con 0x7f49841077f0 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f4981ffb700 1 -- 172.21.15.151:0/3508389262 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497000f620 con 0x7f49841077f0 2024-05-09T00:53:22.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.175+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49841a2c40 con 0x7f49841077f0 2024-05-09T00:53:22.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.176+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49840512c0 con 0x7f49841077f0 2024-05-09T00:53:22.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.177+0000 7f4981ffb700 1 -- 172.21.15.151:0/3508389262 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f4970019070 con 0x7f49841077f0 2024-05-09T00:53:22.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.178+0000 7f4981ffb700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49740b27f0 0x7f49740b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:22.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.178+0000 7f4981ffb700 1 -- 172.21.15.151:0/3508389262 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f49700e0640 con 0x7f49841077f0 2024-05-09T00:53:22.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.178+0000 7f4988f5b700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49740b27f0 0x7f49740b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:22.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.179+0000 7f4988f5b700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49740b27f0 0x7f49740b4d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4978005950 tx=0x7f4978005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:53:22.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.183+0000 7f4981ffb700 1 -- 172.21.15.151:0/3508389262 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f49700a9bb0 con 0x7f49841077f0 2024-05-09T00:53:22.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:22.393+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4984063c00 con 0x7f49740b27f0 2024-05-09T00:53:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:22 smithi151 ceph-mon[34780]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T00:53:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:53:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:53:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:22.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:22 smithi037 ceph-mon[30122]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T00:53:22.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:53:22.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:53:22.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:23.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:22 smithi136 ceph-mon[34110]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T00:53:23.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:53:23.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:53:23.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:23.906 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:23 smithi151 ceph-mon[34780]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:23.906 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:23 smithi151 ceph-mon[34780]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:23.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:23 smithi037 ceph-mon[30122]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:23 smithi037 ceph-mon[30122]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:24.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:23 smithi136 ceph-mon[34110]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:24.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:23 smithi136 ceph-mon[34110]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:26.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:25 smithi037 ceph-mon[30122]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:26.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:25 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/1312321047' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]: dispatch 2024-05-09T00:53:26.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:25 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]: dispatch 2024-05-09T00:53:26.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:25 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]': finished 2024-05-09T00:53:26.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:25 smithi037 ceph-mon[30122]: osdmap e15: 3 total, 2 up, 3 in 2024-05-09T00:53:26.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:25 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/3193689020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-2/activate.monmap"}]: dispatch 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:25 smithi151 ceph-mon[34780]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:25 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/1312321047' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]: dispatch 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:25 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]: dispatch 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:25 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]': finished 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:25 smithi151 ceph-mon[34780]: osdmap e15: 3 total, 2 up, 3 in 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:25 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/3193689020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-2/activate.monmap"}]: dispatch 2024-05-09T00:53:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:25 smithi136 ceph-mon[34110]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:25 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/1312321047' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]: dispatch 2024-05-09T00:53:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:25 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]: dispatch 2024-05-09T00:53:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:25 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39dfb29d-97a5-43c3-b38c-72d80c4f6a3d"}]': finished 2024-05-09T00:53:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:25 smithi136 ceph-mon[34110]: osdmap e15: 3 total, 2 up, 3 in 2024-05-09T00:53:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:25 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/3193689020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-2/activate.monmap"}]: dispatch 2024-05-09T00:53:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:27 smithi037 ceph-mon[30122]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:27 smithi151 ceph-mon[34780]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:27 smithi136 ceph-mon[34110]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:29.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:29 smithi151 ceph-mon[34780]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:30.180 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:29 smithi136 ceph-mon[34110]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:29 smithi037 ceph-mon[30122]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:31 smithi151 ceph-mon[34780]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:31 smithi037 ceph-mon[30122]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:31 smithi136 ceph-mon[34110]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:33.161 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:53:33.161 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:33.161 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:32 smithi151 ceph-mon[34780]: Deploying daemon osd.2 on smithi151 2024-05-09T00:53:33.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:53:33.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:33.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:32 smithi037 ceph-mon[30122]: Deploying daemon osd.2 on smithi151 2024-05-09T00:53:33.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T00:53:33.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:33.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:32 smithi136 ceph-mon[34110]: Deploying daemon osd.2 on smithi151 2024-05-09T00:53:34.158 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:33 smithi151 ceph-mon[34780]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:34.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:33 smithi037 ceph-mon[30122]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:33 smithi136 ceph-mon[34110]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:36.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:35 smithi037 ceph-mon[30122]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:36.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:35 smithi151 ceph-mon[34780]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:35 smithi136 ceph-mon[34110]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:37 smithi037 ceph-mon[30122]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:38.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:37 smithi151 ceph-mon[34780]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:38.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:38.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:38.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:38.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:37 smithi136 ceph-mon[34110]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:38.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:38.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:38.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:40.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:39 smithi151 ceph-mon[34780]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:40.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:39 smithi037 ceph-mon[30122]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:40.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:39 smithi136 ceph-mon[34110]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:40.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.959+0000 7f4981ffb700 1 -- 172.21.15.151:0/3508389262 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4984063c00 con 0x7f49740b27f0 2024-05-09T00:53:40.961 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 2 on host 'smithi151' 2024-05-09T00:53:40.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49740b27f0 msgr2=0x7f49740b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49740b27f0 0x7f49740b4d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4978005950 tx=0x7f4978005f50 comp rx=0 tx=0).stop 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49841077f0 msgr2=0x7f498419adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49841077f0 0x7f498419adf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f497000d950 tx=0x7f497000dd10 comp rx=0 tx=0).stop 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 shutdown_connections 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49740b27f0 0x7f49740b4d00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f498410a150 0x7f49841a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4984102670 0x7f498419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 --2- 172.21.15.151:0/3508389262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49841077f0 0x7f498419adf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 >> 172.21.15.151:0/3508389262 conn(0x7f49840fe010 msgr2=0x7f4984108650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 shutdown_connections 2024-05-09T00:53:40.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:53:40.962+0000 7f498b1bf700 1 -- 172.21.15.151:0/3508389262 wait complete. 2024-05-09T00:53:41.558 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.558 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.558 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:41.558 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:41.558 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.558 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:41.559 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.559 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.559 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:41.590 DEBUG:teuthology.orchestra.run.smithi151:osd.2> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.2.service 2024-05-09T00:53:41.593 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_3... 2024-05-09T00:53:41.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T00:53:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:41.852 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:53:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:41.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:53:42.710 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:42 smithi151 ceph-mon[34780]: from='osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:53:42.710 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:42 smithi151 ceph-mon[34780]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:53:42.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:42 smithi037 ceph-mon[30122]: from='osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:53:42.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:42 smithi037 ceph-mon[30122]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:53:42.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:42 smithi136 ceph-mon[34110]: from='osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:53:42.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:42 smithi136 ceph-mon[34110]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: from='osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T00:53:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: from='osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T00:53:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T00:53:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T00:53:43.729 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-05-09T00:53:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-05-09T00:53:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127677 s, 821 MB/s 2024-05-09T00:53:43.729 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 2024-05-09T00:53:43.729 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: from='osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: pgmap v78: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T00:53:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:44.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-05-09T00:53:44.577 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='osd.2 ' entity='osd.2' 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='osd.2 ' entity='osd.2' 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:44.726 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:44 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2[39903]: 2024-05-09T00:53:44.344+0000 7fc517dc0700 -1 osd.2 0 waiting for initial osdmap 2024-05-09T00:53:44.726 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:44 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2[39903]: 2024-05-09T00:53:44.503+0000 7fc50fb6d700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='osd.2 ' entity='osd.2' 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:45.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:45 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:53:45.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:45 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:53:45.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:45 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi151 2024-05-09T00:53:45.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:45 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi151 to 17088M 2024-05-09T00:53:45.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:45 smithi037 ceph-mon[30122]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:45.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:45 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:45 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:53:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:45 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:53:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:45 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi151 2024-05-09T00:53:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:45 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi151 to 17088M 2024-05-09T00:53:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:45 smithi151 ceph-mon[34780]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:45 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:45.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:45 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:53:45.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:45 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:53:45.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:45 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi151 2024-05-09T00:53:45.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:45 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi151 to 17088M 2024-05-09T00:53:45.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:45 smithi136 ceph-mon[34110]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-09T00:53:45.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:45 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 -- 172.21.15.37:0/3000314921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3981077b0 msgr2=0x7fd398109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 --2- 172.21.15.37:0/3000314921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3981077b0 0x7fd398109bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd388009990 tx=0x7fd388009ca0 comp rx=0 tx=0).stop 2024-05-09T00:53:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 -- 172.21.15.37:0/3000314921 shutdown_connections 2024-05-09T00:53:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 --2- 172.21.15.37:0/3000314921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39810a110 0x7fd39810c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 --2- 172.21.15.37:0/3000314921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd398104e50 0x7fd398107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 --2- 172.21.15.37:0/3000314921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3981077b0 0x7fd398109bd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 -- 172.21.15.37:0/3000314921 >> 172.21.15.37:0/3000314921 conn(0x7fd3980fe890 msgr2=0x7fd398100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:53:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 -- 172.21.15.37:0/3000314921 shutdown_connections 2024-05-09T00:53:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.161+0000 7fd39fecf700 1 -- 172.21.15.37:0/3000314921 wait complete. 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.162+0000 7fd39fecf700 1 Processor -- start 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.162+0000 7fd39fecf700 1 -- start start 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.162+0000 7fd39fecf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd398104e50 0x7fd39819a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.162+0000 7fd39fecf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3981077b0 0x7fd39819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.162+0000 7fd39fecf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39810a110 0x7fd3981a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39fecf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd39810fdb0 con 0x7fd398104e50 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39fecf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd39810fc30 con 0x7fd39810a110 2024-05-09T00:53:46.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd398104e50 0x7fd39819a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39fecf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd39810ff30 con 0x7fd3981077b0 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd398104e50 0x7fd39819a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57024/0 (socket says 172.21.15.37:57024) 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 -- 172.21.15.37:0/1795666085 learned_addr learned my addr 172.21.15.37:0/1795666085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39d46a700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3981077b0 0x7fd39819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 -- 172.21.15.37:0/1795666085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3981077b0 msgr2=0x7fd39819ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3981077b0 0x7fd39819ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39e46c700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39810a110 0x7fd3981a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 -- 172.21.15.37:0/1795666085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39810a110 msgr2=0x7fd3981a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39810a110 0x7fd3981a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 -- 172.21.15.37:0/1795666085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3981a2450 con 0x7fd398104e50 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39d46a700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3981077b0 0x7fd39819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39e46c700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39810a110 0x7fd3981a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39dc6b700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd398104e50 0x7fd39819a8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d980 tx=0x7fd39400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:53:46.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394017070 con 0x7fd398104e50 2024-05-09T00:53:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd394010460 con 0x7fd398104e50 2024-05-09T00:53:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3981a2740 con 0x7fd398104e50 2024-05-09T00:53:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39400de60 con 0x7fd398104e50 2024-05-09T00:53:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.163+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3981a2cd0 con 0x7fd398104e50 2024-05-09T00:53:46.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.164+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3980512c0 con 0x7fd398104e50 2024-05-09T00:53:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.167+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fd394010610 con 0x7fd398104e50 2024-05-09T00:53:46.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.168+0000 7fd38effd700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd3840b2870 0x7fd3840b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:53:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.168+0000 7fd39d46a700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd3840b2870 0x7fd3840b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:53:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.168+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fd3940e0780 con 0x7fd398104e50 2024-05-09T00:53:46.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.168+0000 7fd39d46a700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd3840b2870 0x7fd3840b4d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b2e0 tx=0x7fd38800b680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:53:46.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.172+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd3940a9ab0 con 0x7fd398104e50 2024-05-09T00:53:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:46.394+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd398063c00 con 0x7fd3840b2870 2024-05-09T00:53:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:46 smithi037 ceph-mon[30122]: osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] boot 2024-05-09T00:53:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:46 smithi037 ceph-mon[30122]: osdmap e18: 3 total, 3 up, 3 in 2024-05-09T00:53:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:53:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:53:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:46.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:46 smithi151 ceph-mon[34780]: osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] boot 2024-05-09T00:53:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:46 smithi151 ceph-mon[34780]: osdmap e18: 3 total, 3 up, 3 in 2024-05-09T00:53:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:53:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:53:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:46 smithi136 ceph-mon[34110]: osd.2 [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] boot 2024-05-09T00:53:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:46 smithi136 ceph-mon[34110]: osdmap e18: 3 total, 3 up, 3 in 2024-05-09T00:53:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:53:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:53:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:53:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:47.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:47 smithi037 ceph-mon[30122]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:47.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:47 smithi037 ceph-mon[30122]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T00:53:47.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:47 smithi037 ceph-mon[30122]: pgmap v83: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:47.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:53:47.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:47 smithi151 ceph-mon[34780]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:47.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:47 smithi151 ceph-mon[34780]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T00:53:47.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:47 smithi151 ceph-mon[34780]: pgmap v83: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:47.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:53:47.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:47 smithi136 ceph-mon[34110]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:53:47.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:47 smithi136 ceph-mon[34110]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T00:53:47.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:47 smithi136 ceph-mon[34110]: pgmap v83: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:47.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:53:48.538 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-09T00:53:48.538 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 ceph-mon[30122]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T00:53:48.538 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:53:48.786 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-09T00:53:48.786 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 ceph-mon[34780]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T00:53:48.786 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:53:48.786 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43543]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:53:48.786 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43543]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.786 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43543]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.787 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43543]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:48.787 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43546]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:53:48.787 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43546]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.787 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43546]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.787 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43546]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:48.824 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-09T00:53:48.824 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 ceph-mon[34110]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T00:53:48.824 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:53:48.824 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42824]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:53:48.825 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42824]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.825 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42824]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.825 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42824]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:48.825 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42827]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:53:48.825 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42827]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.825 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42827]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.825 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42827]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:48.974 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47056]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:53:48.974 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47056]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.974 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47056]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.974 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47056]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:48.974 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47059]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:53:48.974 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47059]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.974 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47059]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.975 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47059]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47076]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47076]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47076]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47076]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47080]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47080]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47080]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:48.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:48 smithi037 sudo[47080]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:49.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42830]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:53:49.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:49.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42830]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:49.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42830]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:49.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42833]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:53:49.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42833]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:49.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42833]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:49.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:48 smithi136 sudo[42833]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43549]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43549]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43549]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43549]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43552]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43552]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43552]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:53:49.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:48 smithi151 sudo[43552]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:53:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:53:49.744+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd3940a5640 con 0x7fd398104e50 2024-05-09T00:53:49.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:53:49.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T00:53:49.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.746 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:49.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/584510084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b9c00e5-3ca7-4e87-9977-a03a58a8d469"}]: dispatch 2024-05-09T00:53:49.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/584510084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b9c00e5-3ca7-4e87-9977-a03a58a8d469"}]': finished 2024-05-09T00:53:49.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: osdmap e22: 4 total, 3 up, 4 in 2024-05-09T00:53:49.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:53:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:53:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T00:53:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/584510084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b9c00e5-3ca7-4e87-9977-a03a58a8d469"}]: dispatch 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/584510084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b9c00e5-3ca7-4e87-9977-a03a58a8d469"}]': finished 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: osdmap e22: 4 total, 3 up, 4 in 2024-05-09T00:53:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:53:49.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:53:49.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T00:53:49.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: pgmap v86: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/584510084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b9c00e5-3ca7-4e87-9977-a03a58a8d469"}]: dispatch 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/584510084' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b9c00e5-3ca7-4e87-9977-a03a58a8d469"}]': finished 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: osdmap e22: 4 total, 3 up, 4 in 2024-05-09T00:53:49.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:53:51.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:50 smithi136 ceph-mon[34110]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-09T00:53:51.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:50 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1128714101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-3/activate.monmap"}]: dispatch 2024-05-09T00:53:51.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:50 smithi037 ceph-mon[30122]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-09T00:53:51.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:50 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1128714101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-3/activate.monmap"}]: dispatch 2024-05-09T00:53:51.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:50 smithi151 ceph-mon[34780]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-09T00:53:51.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:50 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1128714101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-3/activate.monmap"}]: dispatch 2024-05-09T00:53:52.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:51 smithi136 ceph-mon[34110]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:51 smithi037 ceph-mon[30122]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:52.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:51 smithi151 ceph-mon[34780]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:54.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:53 smithi136 ceph-mon[34110]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:54.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:53 smithi037 ceph-mon[30122]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:54.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:53 smithi151 ceph-mon[34780]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:56.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:55 smithi136 ceph-mon[34110]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:55 smithi037 ceph-mon[30122]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:56.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:55 smithi151 ceph-mon[34780]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:57.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:53:57.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:57.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:56 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:53:57.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:56 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:56 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T00:53:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:56 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:53:58.141 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:57 smithi151 ceph-mon[34780]: Deploying daemon osd.3 on smithi037 2024-05-09T00:53:58.141 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:57 smithi151 ceph-mon[34780]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:58.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:57 smithi037 ceph-mon[30122]: Deploying daemon osd.3 on smithi037 2024-05-09T00:53:58.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:57 smithi037 ceph-mon[30122]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:53:58.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:57 smithi136 ceph-mon[34110]: Deploying daemon osd.3 on smithi037 2024-05-09T00:53:58.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:57 smithi136 ceph-mon[34110]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:00.180 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:53:59 smithi136 ceph-mon[34110]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:00.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:53:59 smithi037 ceph-mon[30122]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:00.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:53:59 smithi151 ceph-mon[34780]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:01 smithi136 ceph-mon[34110]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:01 smithi037 ceph-mon[30122]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:02.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:01 smithi151 ceph-mon[34780]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:03 smithi136 ceph-mon[34110]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:03 smithi037 ceph-mon[30122]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:03.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:03.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:03.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:03.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:03 smithi151 ceph-mon[34780]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:06.266 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2024-05-09T00:54:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.265+0000 7fd38effd700 1 -- 172.21.15.37:0/1795666085 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd398063c00 con 0x7fd3840b2870 2024-05-09T00:54:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd3840b2870 msgr2=0x7fd3840b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd3840b2870 0x7fd3840b4d80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd38800b2e0 tx=0x7fd38800b680 comp rx=0 tx=0).stop 2024-05-09T00:54:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd398104e50 msgr2=0x7fd39819a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd398104e50 0x7fd39819a8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d980 tx=0x7fd39400dd40 comp rx=0 tx=0).stop 2024-05-09T00:54:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 shutdown_connections 2024-05-09T00:54:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd3840b2870 0x7fd3840b4d80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd39810a110 0x7fd3981a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd398104e50 0x7fd39819a8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 --2- 172.21.15.37:0/1795666085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3981077b0 0x7fd39819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 >> 172.21.15.37:0/1795666085 conn(0x7fd3980fe890 msgr2=0x7fd398105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:54:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 shutdown_connections 2024-05-09T00:54:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:54:06.269+0000 7fd39fecf700 1 -- 172.21.15.37:0/1795666085 wait complete. 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:54:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:06 smithi037 ceph-mon[30122]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:06.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:54:06.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:06 smithi136 ceph-mon[34110]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:54:06.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:06 smithi151 ceph-mon[34780]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T00:54:06.859 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.3.service 2024-05-09T00:54:06.861 INFO:tasks.cephadm:Deploying osd.4 on smithi136 with /dev/vg_nvme/lv_3... 2024-05-09T00:54:06.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T00:54:07.106 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:54:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:08 smithi136 ceph-mon[34110]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:08 smithi136 ceph-mon[34110]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T00:54:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:08 smithi136 ceph-mon[34110]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T00:54:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:08 smithi136 ceph-mon[34110]: from='osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:54:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:08 smithi136 ceph-mon[34110]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:54:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:08 smithi037 ceph-mon[30122]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:08 smithi037 ceph-mon[30122]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T00:54:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:08 smithi037 ceph-mon[30122]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T00:54:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:08 smithi037 ceph-mon[30122]: from='osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:54:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:08 smithi037 ceph-mon[30122]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:54:08.475 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 00:54:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T00:54:08.226+0000 7f35ec87c700 -1 osd.3 0 waiting for initial osdmap 2024-05-09T00:54:08.475 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 00:54:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T00:54:08.235+0000 7f35e8631700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:54:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:08 smithi151 ceph-mon[34780]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:08 smithi151 ceph-mon[34780]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T00:54:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:08 smithi151 ceph-mon[34780]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T00:54:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:08 smithi151 ceph-mon[34780]: from='osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:54:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:08 smithi151 ceph-mon[34780]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:54:09.012 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T00:54:09.012 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T00:54:09.012 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-09T00:54:09.012 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-09T00:54:09.012 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101877 s, 1.0 GB/s 2024-05-09T00:54:09.012 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-09T00:54:09.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:09 smithi037 ceph-mon[30122]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:54:09.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:09 smithi037 ceph-mon[30122]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T00:54:09.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:09 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:09 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:09 smithi037 ceph-mon[30122]: osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] boot 2024-05-09T00:54:09.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:09 smithi037 ceph-mon[30122]: osdmap e25: 4 total, 4 up, 4 in 2024-05-09T00:54:09.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:09 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:09 smithi136 ceph-mon[34110]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:54:09.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:09 smithi136 ceph-mon[34110]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T00:54:09.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:09 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:09 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:09 smithi136 ceph-mon[34110]: osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] boot 2024-05-09T00:54:09.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:09 smithi136 ceph-mon[34110]: osdmap e25: 4 total, 4 up, 4 in 2024-05-09T00:54:09.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:09 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2024-05-09T00:54:09.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:09 smithi151 ceph-mon[34780]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:54:09.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:09 smithi151 ceph-mon[34780]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T00:54:09.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:09 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:09 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:09 smithi151 ceph-mon[34780]: osd.3 [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] boot 2024-05-09T00:54:09.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:09 smithi151 ceph-mon[34780]: osdmap e25: 4 total, 4 up, 4 in 2024-05-09T00:54:09.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:09 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:54:09.852 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.586 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:10.587 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:10.587 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:10.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:10.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:10.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:10.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:10.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:11.294 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.293+0000 7f81fa382700 1 -- 172.21.15.136:0/1021778156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4103ae0 msgr2=0x7f81f4103ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.293+0000 7f81fa382700 1 --2- 172.21.15.136:0/1021778156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4103ae0 0x7f81f4103ef0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009990 tx=0x7f81e8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.293+0000 7f81fa382700 1 -- 172.21.15.136:0/1021778156 shutdown_connections 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.293+0000 7f81fa382700 1 --2- 172.21.15.136:0/1021778156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81f4104480 0x7f81f410ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.293+0000 7f81fa382700 1 --2- 172.21.15.136:0/1021778156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f41029b0 0x7f81f4102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.293+0000 7f81fa382700 1 --2- 172.21.15.136:0/1021778156 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4103ae0 0x7f81f4103ef0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.293+0000 7f81fa382700 1 -- 172.21.15.136:0/1021778156 >> 172.21.15.136:0/1021778156 conn(0x7f81f40fe010 msgr2=0x7f81f41004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.294+0000 7f81fa382700 1 -- 172.21.15.136:0/1021778156 shutdown_connections 2024-05-09T00:54:11.295 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.294+0000 7f81fa382700 1 -- 172.21.15.136:0/1021778156 wait complete. 2024-05-09T00:54:11.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.294+0000 7f81fa382700 1 Processor -- start 2024-05-09T00:54:11.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.294+0000 7f81fa382700 1 -- start start 2024-05-09T00:54:11.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f41029b0 0x7f81f40ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:11.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81f4103ae0 0x7f81f419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:11.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4104480 0x7f81f41a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:11.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81f410e420 con 0x7f81f41029b0 2024-05-09T00:54:11.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81f410e2a0 con 0x7f81f4104480 2024-05-09T00:54:11.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f81f410e5a0 con 0x7f81f4103ae0 2024-05-09T00:54:11.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4104480 0x7f81f41a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4104480 0x7f81f41a1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:50636/0 (socket says 172.21.15.136:50636) 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 -- 172.21.15.136:0/3096987299 learned_addr learned my addr 172.21.15.136:0/3096987299 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f3fff700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f41029b0 0x7f81f40ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f37fe700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81f4103ae0 0x7f81f419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 -- 172.21.15.136:0/3096987299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81f4103ae0 msgr2=0x7f81f419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81f4103ae0 0x7f81f419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 -- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f41029b0 msgr2=0x7f81f40ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f41029b0 0x7f81f40ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 -- 172.21.15.136:0/3096987299 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f41a2420 con 0x7f81f4104480 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f37fe700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81f4103ae0 0x7f81f419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:54:11.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f891f700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4104480 0x7f81f41a1c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007d70 tx=0x7f81ec00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:54:11.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f17fa700 1 -- 172.21.15.136:0/3096987299 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec016020 con 0x7f81f4104480 2024-05-09T00:54:11.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f41a2710 con 0x7f81f4104480 2024-05-09T00:54:11.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f17fa700 1 -- 172.21.15.136:0/3096987299 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81ec00ad40 con 0x7f81f4104480 2024-05-09T00:54:11.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81f17fa700 1 -- 172.21.15.136:0/3096987299 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec0115e0 con 0x7f81f4104480 2024-05-09T00:54:11.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.295+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f41a2c00 con 0x7f81f4104480 2024-05-09T00:54:11.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.296+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f40512c0 con 0x7f81f4104480 2024-05-09T00:54:11.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.298+0000 7f81f17fa700 1 -- 172.21.15.136:0/3096987299 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f81ec019020 con 0x7f81f4104480 2024-05-09T00:54:11.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.299+0000 7f81f17fa700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81dc0b2880 0x7f81dc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:11.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.299+0000 7f81f17fa700 1 -- 172.21.15.136:0/3096987299 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7f81ec0e1500 con 0x7f81f4104480 2024-05-09T00:54:11.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.299+0000 7f81f3fff700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81dc0b2880 0x7f81dc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:11.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.300+0000 7f81f3fff700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81dc0b2880 0x7f81dc0b4d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81f41039e0 tx=0x7f81e400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:54:11.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.303+0000 7f81f17fa700 1 -- 172.21.15.136:0/3096987299 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f81ec020020 con 0x7f81f4104480 2024-05-09T00:54:11.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:11 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi037 2024-05-09T00:54:11.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:11 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi037 to 8546M 2024-05-09T00:54:11.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:11 smithi136 ceph-mon[34110]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T00:54:11.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:11.515+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f81f4063c00 con 0x7f81dc0b2880 2024-05-09T00:54:11.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:11 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi037 2024-05-09T00:54:11.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:11 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi037 to 8546M 2024-05-09T00:54:11.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:11 smithi037 ceph-mon[30122]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T00:54:11.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:11 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi037 2024-05-09T00:54:11.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:11 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi037 to 8546M 2024-05-09T00:54:11.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:11 smithi151 ceph-mon[34780]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T00:54:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:12 smithi136 ceph-mon[34110]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:54:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:54:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:12 smithi037 ceph-mon[30122]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:12 smithi151 ceph-mon[34780]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:54:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:13.372 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:13 smithi136 ceph-mon[34110]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:54:13.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:13 smithi037 ceph-mon[30122]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:54:13.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:13 smithi151 ceph-mon[34780]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:54:14.609 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:14 smithi136 ceph-mon[34110]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-05-09T00:54:14.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:14 smithi037 ceph-mon[30122]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-05-09T00:54:14.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:14 smithi151 ceph-mon[34780]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-05-09T00:54:15.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:15 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/1099339264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]: dispatch 2024-05-09T00:54:15.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:15 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]: dispatch 2024-05-09T00:54:15.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:15 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]': finished 2024-05-09T00:54:15.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:15 smithi136 ceph-mon[34110]: osdmap e28: 5 total, 4 up, 5 in 2024-05-09T00:54:15.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:15 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:15.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:15 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/1218736678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-4/activate.monmap"}]: dispatch 2024-05-09T00:54:15.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:15 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/1099339264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]: dispatch 2024-05-09T00:54:15.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:15 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]: dispatch 2024-05-09T00:54:15.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:15 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]': finished 2024-05-09T00:54:15.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:15 smithi037 ceph-mon[30122]: osdmap e28: 5 total, 4 up, 5 in 2024-05-09T00:54:15.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:15 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:15.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:15 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/1218736678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-4/activate.monmap"}]: dispatch 2024-05-09T00:54:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:15 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/1099339264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]: dispatch 2024-05-09T00:54:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:15 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]: dispatch 2024-05-09T00:54:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:15 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e49af9f-a958-439e-8a9a-a1e4a4f0417b"}]': finished 2024-05-09T00:54:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:15 smithi151 ceph-mon[34780]: osdmap e28: 5 total, 4 up, 5 in 2024-05-09T00:54:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:15 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:15 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/1218736678' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-4/activate.monmap"}]: dispatch 2024-05-09T00:54:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:16 smithi136 ceph-mon[34110]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T00:54:16.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:16 smithi037 ceph-mon[30122]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T00:54:16.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:16 smithi151 ceph-mon[34780]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T00:54:18.543 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:18 smithi136 ceph-mon[34110]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-09T00:54:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:18 smithi037 ceph-mon[30122]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-09T00:54:18.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:18 smithi151 ceph-mon[34780]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-09T00:54:20.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:20 smithi136 ceph-mon[34110]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-09T00:54:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:20 smithi037 ceph-mon[30122]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-09T00:54:20.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:20 smithi151 ceph-mon[34780]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-09T00:54:22.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:22 smithi136 ceph-mon[34110]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:54:22.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:54:22.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:22 smithi037 ceph-mon[30122]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:54:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:54:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:22.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:22 smithi151 ceph-mon[34780]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:54:22.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T00:54:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:23.622 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:23 smithi136 ceph-mon[34110]: Deploying daemon osd.4 on smithi136 2024-05-09T00:54:23.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:23 smithi037 ceph-mon[30122]: Deploying daemon osd.4 on smithi136 2024-05-09T00:54:23.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:23 smithi151 ceph-mon[34780]: Deploying daemon osd.4 on smithi136 2024-05-09T00:54:24.498 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:24 smithi136 ceph-mon[34110]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:24 smithi037 ceph-mon[30122]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:24.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:24 smithi151 ceph-mon[34780]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:26.423 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:26 smithi136 ceph-mon[34110]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:26.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:26 smithi037 ceph-mon[30122]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:26.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:26 smithi151 ceph-mon[34780]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:28.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:27 smithi136 ceph-mon[34110]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:28.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:28.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:28.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:27 smithi037 ceph-mon[30122]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:28.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:27 smithi151 ceph-mon[34780]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:28.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:29 smithi037 ceph-mon[30122]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:29 smithi151 ceph-mon[34780]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:29 smithi136 ceph-mon[34110]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:30.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:30.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:30.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:30.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.733+0000 7f81f17fa700 1 -- 172.21.15.136:0/3096987299 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f81f4063c00 con 0x7f81dc0b2880 2024-05-09T00:54:30.734 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 4 on host 'smithi136' 2024-05-09T00:54:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81dc0b2880 msgr2=0x7f81dc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81dc0b2880 0x7f81dc0b4d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81f41039e0 tx=0x7f81e400a380 comp rx=0 tx=0).stop 2024-05-09T00:54:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4104480 msgr2=0x7f81f41a1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4104480 0x7f81f41a1c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f81ec007d70 tx=0x7f81ec00a340 comp rx=0 tx=0).stop 2024-05-09T00:54:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 shutdown_connections 2024-05-09T00:54:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81dc0b2880 0x7f81dc0b4d90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:30.737 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f4104480 0x7f81f41a1c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f41029b0 0x7f81f40ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 --2- 172.21.15.136:0/3096987299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81f4103ae0 0x7f81f419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 >> 172.21.15.136:0/3096987299 conn(0x7f81f40fe010 msgr2=0x7f81f4107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:54:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 shutdown_connections 2024-05-09T00:54:30.738 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:54:30.736+0000 7f81fa382700 1 -- 172.21.15.136:0/3096987299 wait complete. 2024-05-09T00:54:31.295 DEBUG:teuthology.orchestra.run.smithi136:osd.4> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.4.service 2024-05-09T00:54:31.297 INFO:tasks.cephadm:Deploying osd.5 on smithi151 with /dev/vg_nvme/lv_3... 2024-05-09T00:54:31.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T00:54:31.543 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:54:31.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:31.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:31.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:31.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:31 smithi136 ceph-mon[34110]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:31.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:31 smithi136 ceph-mon[34110]: from='osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:54:31.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:31 smithi136 ceph-mon[34110]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:54:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:31 smithi037 ceph-mon[30122]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:31 smithi037 ceph-mon[30122]: from='osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:54:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:31 smithi037 ceph-mon[30122]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:54:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:31 smithi151 ceph-mon[34780]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:31 smithi151 ceph-mon[34780]: from='osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:54:31.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:31 smithi151 ceph-mon[34780]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T00:54:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:32 smithi136 ceph-mon[34110]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T00:54:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:32 smithi136 ceph-mon[34110]: osdmap e29: 5 total, 4 up, 5 in 2024-05-09T00:54:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:32 smithi136 ceph-mon[34110]: from='osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:54:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:32 smithi136 ceph-mon[34110]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:54:32.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:32 smithi037 ceph-mon[30122]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T00:54:32.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:32 smithi037 ceph-mon[30122]: osdmap e29: 5 total, 4 up, 5 in 2024-05-09T00:54:32.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:32.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:32 smithi037 ceph-mon[30122]: from='osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:54:32.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:32 smithi037 ceph-mon[30122]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:54:32.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:32 smithi151 ceph-mon[34780]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T00:54:32.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:32 smithi151 ceph-mon[34780]: osdmap e29: 5 total, 4 up, 5 in 2024-05-09T00:54:32.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:32.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:32 smithi151 ceph-mon[34780]: from='osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:54:32.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:32 smithi151 ceph-mon[34780]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:54:33.535 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T00:54:33.535 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T00:54:33.535 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-09T00:54:33.535 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-09T00:54:33.535 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.012888 s, 814 MB/s 2024-05-09T00:54:33.536 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-09T00:54:33.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:33 smithi136 ceph-mon[34110]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:54:33.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:33 smithi136 ceph-mon[34110]: osdmap e30: 5 total, 4 up, 5 in 2024-05-09T00:54:33.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:33.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:33.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:33 smithi136 ceph-mon[34110]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:33.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:33 smithi136 ceph-mon[34110]: from='osd.4 ' entity='osd.4' 2024-05-09T00:54:33.865 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 00:54:33 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4[45640]: 2024-05-09T00:54:33.482+0000 7f7d92a58700 -1 osd.4 0 waiting for initial osdmap 2024-05-09T00:54:33.865 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 00:54:33 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4[45640]: 2024-05-09T00:54:33.535+0000 7f7d8a805700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:54:33.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:33 smithi151 ceph-mon[34780]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:54:33.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:33 smithi151 ceph-mon[34780]: osdmap e30: 5 total, 4 up, 5 in 2024-05-09T00:54:33.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:33.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:33.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:33 smithi151 ceph-mon[34780]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:33.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:33 smithi151 ceph-mon[34780]: from='osd.4 ' entity='osd.4' 2024-05-09T00:54:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:33 smithi037 ceph-mon[30122]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:54:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:33 smithi037 ceph-mon[30122]: osdmap e30: 5 total, 4 up, 5 in 2024-05-09T00:54:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:33 smithi037 ceph-mon[30122]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-09T00:54:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:33 smithi037 ceph-mon[30122]: from='osd.4 ' entity='osd.4' 2024-05-09T00:54:34.131 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_3 2024-05-09T00:54:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:54:34.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:54:34.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:54:34.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:34.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi136 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi136 to 8544M 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] boot 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: osdmap e31: 5 total, 5 up, 5 in 2024-05-09T00:54:34.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi136 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi136 to 8544M 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:34.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:34.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] boot 2024-05-09T00:54:34.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: osdmap e31: 5 total, 5 up, 5 in 2024-05-09T00:54:34.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi136 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:35.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi136 to 8544M 2024-05-09T00:54:35.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:35.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:35.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:35.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:35.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: osd.4 [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] boot 2024-05-09T00:54:35.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: osdmap e31: 5 total, 5 up, 5 in 2024-05-09T00:54:35.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:54:35.896 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:35 smithi151 ceph-mon[34780]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 -- 172.21.15.151:0/3371348664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44104730 msgr2=0x7fba44104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 --2- 172.21.15.151:0/3371348664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44104730 0x7fba44104b40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fba34009990 tx=0x7fba34009ca0 comp rx=0 tx=0).stop 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 -- 172.21.15.151:0/3371348664 shutdown_connections 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 --2- 172.21.15.151:0/3371348664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba44105080 0x7fba4410b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 --2- 172.21.15.151:0/3371348664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba44103830 0x7fba44103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 --2- 172.21.15.151:0/3371348664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44104730 0x7fba44104b40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 -- 172.21.15.151:0/3371348664 >> 172.21.15.151:0/3371348664 conn(0x7fba440fe020 msgr2=0x7fba441004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 -- 172.21.15.151:0/3371348664 shutdown_connections 2024-05-09T00:54:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.935+0000 7fba4c720700 1 -- 172.21.15.151:0/3371348664 wait complete. 2024-05-09T00:54:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.936+0000 7fba4c720700 1 Processor -- start 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.936+0000 7fba4c720700 1 -- start start 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.936+0000 7fba4c720700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba44103830 0x7fba44199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.936+0000 7fba4c720700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba44104730 0x7fba4419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.936+0000 7fba4c720700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44105080 0x7fba441a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4c720700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410ef80 con 0x7fba44104730 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4c720700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410ee00 con 0x7fba44103830 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4c720700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fba4410f100 con 0x7fba44105080 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44105080 0x7fba441a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44105080 0x7fba441a0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34780/0 (socket says 172.21.15.151:34780) 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 -- 172.21.15.151:0/867217606 learned_addr learned my addr 172.21.15.151:0/867217606 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba49cbb700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba44104730 0x7fba4419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4a4bc700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba44103830 0x7fba44199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 -- 172.21.15.151:0/867217606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba44103830 msgr2=0x7fba44199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba44103830 0x7fba44199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 -- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba44104730 msgr2=0x7fba4419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba44104730 0x7fba4419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 -- 172.21.15.151:0/867217606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba441a1620 con 0x7fba44105080 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4acbd700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44105080 0x7fba441a0fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007920 tx=0x7fba3c007c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba3b7fe700 1 -- 172.21.15.151:0/867217606 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c019020 con 0x7fba44105080 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba441024f0 con 0x7fba44105080 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba3b7fe700 1 -- 172.21.15.151:0/867217606 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba3c004ce0 con 0x7fba44105080 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.937+0000 7fba3b7fe700 1 -- 172.21.15.151:0/867217606 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c00a440 con 0x7fba44105080 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.938+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba44102a30 con 0x7fba44105080 2024-05-09T00:54:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.938+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba440512c0 con 0x7fba44105080 2024-05-09T00:54:35.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.940+0000 7fba3b7fe700 1 -- 172.21.15.151:0/867217606 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fba3c004e90 con 0x7fba44105080 2024-05-09T00:54:35.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.941+0000 7fba3b7fe700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba300b2880 0x7fba300b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:54:35.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.941+0000 7fba3b7fe700 1 -- 172.21.15.151:0/867217606 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7fba3c0e2ac0 con 0x7fba44105080 2024-05-09T00:54:35.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.941+0000 7fba4a4bc700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba300b2880 0x7fba300b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:54:35.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.941+0000 7fba4a4bc700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba300b2880 0x7fba300b4d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba441046c0 tx=0x7fba4000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:54:35.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:35.945+0000 7fba3b7fe700 1 -- 172.21.15.151:0/867217606 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba3c023020 con 0x7fba44105080 2024-05-09T00:54:35.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:35 smithi037 ceph-mon[30122]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:36.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:35 smithi136 ceph-mon[34110]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:36.154+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fba4410a4f0 con 0x7fba300b2880 2024-05-09T00:54:36.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:36 smithi151 ceph-mon[34780]: osdmap e32: 5 total, 5 up, 5 in 2024-05-09T00:54:36.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:36 smithi151 ceph-mon[34780]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:54:36.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:54:36.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:54:36.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:36.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:36 smithi037 ceph-mon[30122]: osdmap e32: 5 total, 5 up, 5 in 2024-05-09T00:54:36.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:36 smithi037 ceph-mon[30122]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:54:36.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:54:36.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:54:36.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:37.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:36 smithi136 ceph-mon[34110]: osdmap e32: 5 total, 5 up, 5 in 2024-05-09T00:54:37.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:36 smithi136 ceph-mon[34110]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:54:37.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:54:37.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:54:37.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:37.846 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:37 smithi151 ceph-mon[34780]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:38.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:37 smithi136 ceph-mon[34110]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:37 smithi037 ceph-mon[30122]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:39.112 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:38 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/3700039920' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]: dispatch 2024-05-09T00:54:39.112 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:38 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]: dispatch 2024-05-09T00:54:39.112 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:38 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]': finished 2024-05-09T00:54:39.112 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:38 smithi151 ceph-mon[34780]: osdmap e33: 6 total, 5 up, 6 in 2024-05-09T00:54:39.112 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:38 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:39.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:38 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/3700039920' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]: dispatch 2024-05-09T00:54:39.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:38 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]: dispatch 2024-05-09T00:54:39.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:38 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]': finished 2024-05-09T00:54:39.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:38 smithi136 ceph-mon[34110]: osdmap e33: 6 total, 5 up, 6 in 2024-05-09T00:54:39.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:38 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:39.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:38 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/3700039920' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]: dispatch 2024-05-09T00:54:39.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:38 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]: dispatch 2024-05-09T00:54:39.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:38 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c"}]': finished 2024-05-09T00:54:39.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:38 smithi037 ceph-mon[30122]: osdmap e33: 6 total, 5 up, 6 in 2024-05-09T00:54:39.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:38 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:40.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:39 smithi136 ceph-mon[34110]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:40.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:39 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/3762813963' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-5/activate.monmap"}]: dispatch 2024-05-09T00:54:40.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:39 smithi037 ceph-mon[30122]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:40.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:39 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/3762813963' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-5/activate.monmap"}]: dispatch 2024-05-09T00:54:40.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:39 smithi151 ceph-mon[34780]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:40.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:39 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/3762813963' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-5/activate.monmap"}]: dispatch 2024-05-09T00:54:42.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:41 smithi037 ceph-mon[30122]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:42.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:41 smithi151 ceph-mon[34780]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:42.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:41 smithi136 ceph-mon[34110]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:44.137 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:43 smithi151 ceph-mon[34780]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:44.226 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:43 smithi037 ceph-mon[30122]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:43 smithi136 ceph-mon[34110]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:46.121 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:45 smithi151 ceph-mon[34780]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:46.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:45 smithi037 ceph-mon[30122]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:46.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:45 smithi136 ceph-mon[34110]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:47.049 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:54:47.049 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:47.049 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:46 smithi151 ceph-mon[34780]: Deploying daemon osd.5 on smithi151 2024-05-09T00:54:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:54:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:47.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:46 smithi037 ceph-mon[30122]: Deploying daemon osd.5 on smithi151 2024-05-09T00:54:47.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T00:54:47.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:47.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:46 smithi136 ceph-mon[34110]: Deploying daemon osd.5 on smithi151 2024-05-09T00:54:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:47 smithi037 ceph-mon[30122]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:48.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:47 smithi151 ceph-mon[34780]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:48.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:47 smithi136 ceph-mon[34110]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:50.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:49 smithi037 ceph-mon[30122]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:50.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:49 smithi151 ceph-mon[34780]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:50.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:49 smithi136 ceph-mon[34110]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:52.222 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:51 smithi151 ceph-mon[34780]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:52.222 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:51 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:52.222 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:51 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:52.222 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:51 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:51 smithi037 ceph-mon[30122]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:51 smithi136 ceph-mon[34110]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:51 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:51 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:51 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:53.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:53 smithi151 ceph-mon[34780]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:53 smithi037 ceph-mon[30122]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:54.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:53 smithi136 ceph-mon[34110]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:55.172 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 5 on host 'smithi151' 2024-05-09T00:54:55.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.170+0000 7fba3b7fe700 1 -- 172.21.15.151:0/867217606 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fba4410a4f0 con 0x7fba300b2880 2024-05-09T00:54:55.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba300b2880 msgr2=0x7fba300b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba300b2880 0x7fba300b4d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba441046c0 tx=0x7fba4000d040 comp rx=0 tx=0).stop 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44105080 msgr2=0x7fba441a0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44105080 0x7fba441a0fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fba3c007920 tx=0x7fba3c007c30 comp rx=0 tx=0).stop 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 shutdown_connections 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba300b2880 0x7fba300b4d90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba44105080 0x7fba441a0fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba44103830 0x7fba44199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 --2- 172.21.15.151:0/867217606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba44104730 0x7fba4419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 >> 172.21.15.151:0/867217606 conn(0x7fba440fe020 msgr2=0x7fba44107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 shutdown_connections 2024-05-09T00:54:55.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:54:55.173+0000 7fba4c720700 1 -- 172.21.15.151:0/867217606 wait complete. 2024-05-09T00:54:55.457 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:55.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:55.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:54:55.792 DEBUG:teuthology.orchestra.run.smithi151:osd.5> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.5.service 2024-05-09T00:54:55.795 INFO:tasks.cephadm:Deploying osd.6 on smithi037 with /dev/vg_nvme/lv_2... 2024-05-09T00:54:55.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T00:54:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:54:56.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:56 smithi037 ceph-mon[30122]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:56.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:56 smithi037 ceph-mon[30122]: from='osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:54:56.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:56 smithi037 ceph-mon[30122]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:54:56.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:56 smithi151 ceph-mon[34780]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:56 smithi151 ceph-mon[34780]: from='osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:54:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:56 smithi151 ceph-mon[34780]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:54:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:56 smithi136 ceph-mon[34110]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:56 smithi136 ceph-mon[34110]: from='osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:54:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:56 smithi136 ceph-mon[34110]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T00:54:57.286 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:57 smithi151 ceph-mon[34780]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T00:54:57.286 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:57 smithi151 ceph-mon[34780]: osdmap e34: 6 total, 5 up, 6 in 2024-05-09T00:54:57.287 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:57.287 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:57 smithi151 ceph-mon[34780]: from='osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:54:57.287 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:57 smithi151 ceph-mon[34780]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:54:57.287 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 00:54:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T00:54:57.270+0000 7f0836475700 -1 osd.5 0 waiting for initial osdmap 2024-05-09T00:54:57.287 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 00:54:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T00:54:57.277+0000 7f083222a700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:54:57.526 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:57 smithi037 ceph-mon[30122]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T00:54:57.526 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:57 smithi037 ceph-mon[30122]: osdmap e34: 6 total, 5 up, 6 in 2024-05-09T00:54:57.526 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:57.526 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:57 smithi037 ceph-mon[30122]: from='osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:54:57.526 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:57 smithi037 ceph-mon[30122]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:54:57.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:57 smithi136 ceph-mon[34110]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T00:54:57.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:57 smithi136 ceph-mon[34110]: osdmap e34: 6 total, 5 up, 6 in 2024-05-09T00:54:57.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:57.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:57 smithi136 ceph-mon[34110]: from='osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:54:57.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:57 smithi136 ceph-mon[34110]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:54:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T00:54:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T00:54:58.381 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-05-09T00:54:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-05-09T00:54:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113332 s, 925 MB/s 2024-05-09T00:54:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-05-09T00:54:58.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:58 smithi151 ceph-mon[34780]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:58.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:58 smithi151 ceph-mon[34780]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:54:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:58 smithi151 ceph-mon[34780]: osdmap e35: 6 total, 5 up, 6 in 2024-05-09T00:54:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:58.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:58 smithi136 ceph-mon[34110]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:58.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:58 smithi136 ceph-mon[34110]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:54:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:58 smithi136 ceph-mon[34110]: osdmap e35: 6 total, 5 up, 6 in 2024-05-09T00:54:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:58.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:58 smithi037 ceph-mon[30122]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-09T00:54:58.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:58 smithi037 ceph-mon[30122]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:54:58.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:58 smithi037 ceph-mon[30122]: osdmap e35: 6 total, 5 up, 6 in 2024-05-09T00:54:58.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:58.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:59.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] boot 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: osdmap e36: 6 total, 6 up, 6 in 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: osdmap e37: 6 total, 6 up, 6 in 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:59.277 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:59.278 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:54:59.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:59.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:59.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:54:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] boot 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: osdmap e36: 6 total, 6 up, 6 in 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: osdmap e37: 6 total, 6 up, 6 in 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:59.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:59.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:59.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:59.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:54:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: osd.5 [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] boot 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: osdmap e36: 6 total, 6 up, 6 in 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: osdmap e37: 6 total, 6 up, 6 in 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:59.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:54:59.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:54:59.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:54:59.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:54:59.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:54:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:00.529 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:00 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi151 2024-05-09T00:55:00.529 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:00 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi151 to 8544M 2024-05-09T00:55:00.529 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:00 smithi136 ceph-mon[34110]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:00.529 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:00 smithi136 ceph-mon[34110]: osdmap e38: 6 total, 6 up, 6 in 2024-05-09T00:55:00.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:00 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi151 2024-05-09T00:55:00.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:00 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi151 to 8544M 2024-05-09T00:55:00.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:00 smithi037 ceph-mon[30122]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:00.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:00 smithi037 ceph-mon[30122]: osdmap e38: 6 total, 6 up, 6 in 2024-05-09T00:55:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:00 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi151 2024-05-09T00:55:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:00 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi151 to 8544M 2024-05-09T00:55:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:00 smithi151 ceph-mon[34780]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:00 smithi151 ceph-mon[34780]: osdmap e38: 6 total, 6 up, 6 in 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 -- 172.21.15.37:0/2324938695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548104360 msgr2=0x7fe548104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 --2- 172.21.15.37:0/2324938695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548104360 0x7fe548104770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe538009990 tx=0x7fe538009ca0 comp rx=0 tx=0).stop 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 -- 172.21.15.37:0/2324938695 shutdown_connections 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 --2- 172.21.15.37:0/2324938695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe548105e30 0x7fe54810c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 --2- 172.21.15.37:0/2324938695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548104360 0x7fe548104770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 --2- 172.21.15.37:0/2324938695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe548105490 0x7fe5481058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 -- 172.21.15.37:0/2324938695 >> 172.21.15.37:0/2324938695 conn(0x7fe5480ff9c0 msgr2=0x7fe548101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:55:00.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 -- 172.21.15.37:0/2324938695 shutdown_connections 2024-05-09T00:55:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.870+0000 7fe54d23b700 1 -- 172.21.15.37:0/2324938695 wait complete. 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 Processor -- start 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 -- start start 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe548104360 0x7fe54819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548105490 0x7fe54819af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe548105e30 0x7fe5481a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe54810fdc0 con 0x7fe548105490 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe54810fc40 con 0x7fe548105e30 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54d23b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe54810ff40 con 0x7fe548104360 2024-05-09T00:55:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548105490 0x7fe54819af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548105490 0x7fe54819af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47118/0 (socket says 172.21.15.37:47118) 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54659c700 1 -- 172.21.15.37:0/971433827 learned_addr learned my addr 172.21.15.37:0/971433827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe54759e700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe548105e30 0x7fe5481a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.871+0000 7fe546d9d700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe548104360 0x7fe54819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54659c700 1 -- 172.21.15.37:0/971433827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe548104360 msgr2=0x7fe54819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54659c700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe548104360 0x7fe54819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54659c700 1 -- 172.21.15.37:0/971433827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe548105e30 msgr2=0x7fe5481a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54659c700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe548105e30 0x7fe5481a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54659c700 1 -- 172.21.15.37:0/971433827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5481a2530 con 0x7fe548105490 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54659c700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548105490 0x7fe54819af10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00d980 tx=0x7fe53c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe52ffff700 1 -- 172.21.15.37:0/971433827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c017070 con 0x7fe548105490 2024-05-09T00:55:00.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe548075a50 con 0x7fe548105490 2024-05-09T00:55:00.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe52ffff700 1 -- 172.21.15.37:0/971433827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe53c005020 con 0x7fe548105490 2024-05-09T00:55:00.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe52ffff700 1 -- 172.21.15.37:0/971433827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00fa10 con 0x7fe548105490 2024-05-09T00:55:00.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.872+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe548075f40 con 0x7fe548105490 2024-05-09T00:55:00.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.873+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5480512c0 con 0x7fe548105490 2024-05-09T00:55:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.875+0000 7fe52ffff700 1 -- 172.21.15.37:0/971433827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe53c004a30 con 0x7fe548105490 2024-05-09T00:55:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.876+0000 7fe52ffff700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5300b2880 0x7fe5300b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.876+0000 7fe546d9d700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5300b2880 0x7fe5300b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.876+0000 7fe52ffff700 1 -- 172.21.15.37:0/971433827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4533+0+0 (secure 0 0 0) 0x7fe53c0e1620 con 0x7fe548105490 2024-05-09T00:55:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.876+0000 7fe546d9d700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5300b2880 0x7fe5300b4d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5380038a0 tx=0x7fe53801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:55:00.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:00.879+0000 7fe52ffff700 1 -- 172.21.15.37:0/971433827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe53c020020 con 0x7fe548105490 2024-05-09T00:55:01.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:01.103+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe548063c00 con 0x7fe5300b2880 2024-05-09T00:55:01.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:01.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:01.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:01.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:01.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:01.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:02.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:02 smithi037 ceph-mon[30122]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:02.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:02 smithi037 ceph-mon[30122]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:02.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:02 smithi151 ceph-mon[34780]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:02.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:02 smithi151 ceph-mon[34780]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:02.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:02 smithi136 ceph-mon[34110]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:02 smithi136 ceph-mon[34110]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:04.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:04 smithi136 ceph-mon[34110]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-09T00:55:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:04 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/437258930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "658cbbc1-8426-41a3-81f2-604aad93fc5c"}]: dispatch 2024-05-09T00:55:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:04 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/437258930' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "658cbbc1-8426-41a3-81f2-604aad93fc5c"}]': finished 2024-05-09T00:55:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:04 smithi136 ceph-mon[34110]: osdmap e39: 7 total, 6 up, 7 in 2024-05-09T00:55:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:04 smithi037 ceph-mon[30122]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-09T00:55:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:04 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/437258930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "658cbbc1-8426-41a3-81f2-604aad93fc5c"}]: dispatch 2024-05-09T00:55:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:04 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/437258930' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "658cbbc1-8426-41a3-81f2-604aad93fc5c"}]': finished 2024-05-09T00:55:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:04 smithi037 ceph-mon[30122]: osdmap e39: 7 total, 6 up, 7 in 2024-05-09T00:55:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:04 smithi151 ceph-mon[34780]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-09T00:55:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:04 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/437258930' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "658cbbc1-8426-41a3-81f2-604aad93fc5c"}]: dispatch 2024-05-09T00:55:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:04 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/437258930' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "658cbbc1-8426-41a3-81f2-604aad93fc5c"}]': finished 2024-05-09T00:55:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:04 smithi151 ceph-mon[34780]: osdmap e39: 7 total, 6 up, 7 in 2024-05-09T00:55:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:05.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:05 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2740441966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-6/activate.monmap"}]: dispatch 2024-05-09T00:55:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:05 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2740441966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-6/activate.monmap"}]: dispatch 2024-05-09T00:55:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:05 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2740441966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-6/activate.monmap"}]: dispatch 2024-05-09T00:55:06.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:06 smithi136 ceph-mon[34110]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-09T00:55:06.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:06 smithi037 ceph-mon[30122]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-09T00:55:06.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:06 smithi151 ceph-mon[34780]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-09T00:55:08.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:08 smithi037 ceph-mon[30122]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:55:08.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:08 smithi136 ceph-mon[34110]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:55:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:08 smithi151 ceph-mon[34780]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:55:10.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:10 smithi037 ceph-mon[30122]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-09T00:55:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:10 smithi136 ceph-mon[34110]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-09T00:55:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:10 smithi151 ceph-mon[34780]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-09T00:55:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:12 smithi037 ceph-mon[30122]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:55:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-09T00:55:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:12 smithi151 ceph-mon[34780]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:55:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-09T00:55:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:12 smithi136 ceph-mon[34110]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:55:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-09T00:55:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:13.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:13 smithi136 ceph-mon[34110]: Deploying daemon osd.6 on smithi037 2024-05-09T00:55:13.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:13 smithi037 ceph-mon[30122]: Deploying daemon osd.6 on smithi037 2024-05-09T00:55:13.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:13 smithi151 ceph-mon[34780]: Deploying daemon osd.6 on smithi037 2024-05-09T00:55:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:14 smithi136 ceph-mon[34110]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:14.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:14 smithi037 ceph-mon[30122]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:14.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:14 smithi151 ceph-mon[34780]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:16.623 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:16 smithi037 ceph-mon[30122]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:16.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:16 smithi136 ceph-mon[34110]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:16.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:16 smithi151 ceph-mon[34780]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:18 smithi037 ceph-mon[30122]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:18.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:18 smithi151 ceph-mon[34780]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:18.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:18.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:18.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:18 smithi136 ceph-mon[34110]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:20.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:20 smithi037 ceph-mon[30122]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:20.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:20 smithi151 ceph-mon[34780]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:20.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:20 smithi136 ceph-mon[34110]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:21.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.421+0000 7fe52ffff700 1 -- 172.21.15.37:0/971433827 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe548063c00 con 0x7fe5300b2880 2024-05-09T00:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 6 on host 'smithi037' 2024-05-09T00:55:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5300b2880 msgr2=0x7fe5300b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5300b2880 0x7fe5300b4d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5380038a0 tx=0x7fe53801a040 comp rx=0 tx=0).stop 2024-05-09T00:55:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548105490 msgr2=0x7fe54819af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548105490 0x7fe54819af10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00d980 tx=0x7fe53c00dc90 comp rx=0 tx=0).stop 2024-05-09T00:55:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 shutdown_connections 2024-05-09T00:55:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5300b2880 0x7fe5300b4d90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe548105e30 0x7fe5481a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe548104360 0x7fe54819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 --2- 172.21.15.37:0/971433827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe548105490 0x7fe54819af10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 >> 172.21.15.37:0/971433827 conn(0x7fe5480ff9c0 msgr2=0x7fe548108730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:55:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 shutdown_connections 2024-05-09T00:55:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:55:21.425+0000 7fe54d23b700 1 -- 172.21.15.37:0/971433827 wait complete. 2024-05-09T00:55:21.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:21.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:21.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:21 smithi037 ceph-mon[30122]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:21.617 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:21 smithi037 ceph-mon[30122]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-09T00:55:21.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:21 smithi136 ceph-mon[34110]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:21.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:21 smithi136 ceph-mon[34110]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-09T00:55:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:21 smithi151 ceph-mon[34780]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:21 smithi151 ceph-mon[34780]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-09T00:55:22.107 DEBUG:teuthology.orchestra.run.smithi037:osd.6> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.6.service 2024-05-09T00:55:22.109 INFO:tasks.cephadm:Deploying osd.7 on smithi136 with /dev/vg_nvme/lv_2... 2024-05-09T00:55:22.109 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T00:55:22.356 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:55:22.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:22 smithi136 ceph-mon[34110]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-09T00:55:22.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:22 smithi136 ceph-mon[34110]: osdmap e40: 7 total, 6 up, 7 in 2024-05-09T00:55:22.479 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:22 smithi136 ceph-mon[34110]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:55:22.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:22.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:22.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:22.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:22 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:22.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:22 smithi037 ceph-mon[30122]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-09T00:55:22.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:22 smithi037 ceph-mon[30122]: osdmap e40: 7 total, 6 up, 7 in 2024-05-09T00:55:22.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:22 smithi037 ceph-mon[30122]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:55:22.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:22.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:22.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:22.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:22 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:22 smithi151 ceph-mon[34780]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-09T00:55:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:22 smithi151 ceph-mon[34780]: osdmap e40: 7 total, 6 up, 7 in 2024-05-09T00:55:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:22 smithi151 ceph-mon[34780]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:55:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:22 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:23 smithi037 ceph-mon[30122]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:55:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:23 smithi037 ceph-mon[30122]: osdmap e41: 7 total, 6 up, 7 in 2024-05-09T00:55:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:23 smithi037 ceph-mon[30122]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:23.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:23 smithi037 ceph-mon[30122]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' 2024-05-09T00:55:23.565 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.565 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 00:55:23 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T00:55:23.307+0000 7f1ac4cf7700 -1 osd.6 0 waiting for initial osdmap 2024-05-09T00:55:23.565 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 00:55:23 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T00:55:23.397+0000 7f1abcaa4700 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:55:23.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:23 smithi136 ceph-mon[34110]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:55:23.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:23 smithi136 ceph-mon[34110]: osdmap e41: 7 total, 6 up, 7 in 2024-05-09T00:55:23.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:23 smithi136 ceph-mon[34110]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:23.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:23 smithi136 ceph-mon[34110]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' 2024-05-09T00:55:23.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:23 smithi151 ceph-mon[34780]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:55:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:23 smithi151 ceph-mon[34780]: osdmap e41: 7 total, 6 up, 7 in 2024-05-09T00:55:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:23 smithi151 ceph-mon[34780]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:23 smithi151 ceph-mon[34780]: from='osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898]' entity='osd.6' 2024-05-09T00:55:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:24.156 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T00:55:24.156 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T00:55:24.156 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-09T00:55:24.156 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-09T00:55:24.156 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00966809 s, 1.1 GB/s 2024-05-09T00:55:24.156 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-09T00:55:24.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:24 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:55:24.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:24 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:55:24.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:24 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:55:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:24 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:55:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:24 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:55:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:24 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:55:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:24.749 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2024-05-09T00:55:25.000 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] boot 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: osdmap e42: 7 total, 7 up, 7 in 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi037 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi037 to 5697M 2024-05-09T00:55:25.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:25.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:25.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:25 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] boot 2024-05-09T00:55:25.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: osdmap e42: 7 total, 7 up, 7 in 2024-05-09T00:55:25.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:25.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:25.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi037 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi037 to 5697M 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:25.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:25 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.817 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: osd.6 [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] boot 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: osdmap e42: 7 total, 7 up, 7 in 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi037 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi037 to 5697M 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:25.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:25.819 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:25 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:26.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:26 smithi136 ceph-mon[34110]: osdmap e43: 7 total, 7 up, 7 in 2024-05-09T00:55:26.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 -- 172.21.15.136:0/555537206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105e20 msgr2=0x7fa25010c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:26.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 --2- 172.21.15.136:0/555537206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105e20 0x7fa25010c6d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa24800b0a0 tx=0x7fa24800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:55:26.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 -- 172.21.15.136:0/555537206 shutdown_connections 2024-05-09T00:55:26.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 --2- 172.21.15.136:0/555537206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105e20 0x7fa25010c6d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:26.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 --2- 172.21.15.136:0/555537206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa250104350 0x7fa250104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:26.560 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 --2- 172.21.15.136:0/555537206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250105480 0x7fa250105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:26.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 -- 172.21.15.136:0/555537206 >> 172.21.15.136:0/555537206 conn(0x7fa2500ff990 msgr2=0x7fa250101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:55:26.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 -- 172.21.15.136:0/555537206 shutdown_connections 2024-05-09T00:55:26.561 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.559+0000 7fa254bb1700 1 -- 172.21.15.136:0/555537206 wait complete. 2024-05-09T00:55:26.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 Processor -- start 2024-05-09T00:55:26.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 -- start start 2024-05-09T00:55:26.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa250104350 0x7fa25019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:26.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105480 0x7fa25019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:26.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250105e20 0x7fa2501a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:26.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa25010fe30 con 0x7fa250105e20 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa25010fcb0 con 0x7fa250105480 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.560+0000 7fa254bb1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa25010ffb0 con 0x7fa250104350 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105480 0x7fa25019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105480 0x7fa25019ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:41542/0 (socket says 172.21.15.136:41542) 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 -- 172.21.15.136:0/2045443897 learned_addr learned my addr 172.21.15.136:0/2045443897 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24e59c700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa250104350 0x7fa25019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24ed9d700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250105e20 0x7fa2501a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 -- 172.21.15.136:0/2045443897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa250104350 msgr2=0x7fa25019a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa250104350 0x7fa25019a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 -- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250105e20 msgr2=0x7fa2501a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:26.564 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250105e20 0x7fa2501a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 -- 172.21.15.136:0/2045443897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2501a2470 con 0x7fa250105480 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24e59c700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa250104350 0x7fa25019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24ed9d700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250105e20 0x7fa2501a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa24dd9b700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105480 0x7fa25019ae50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b530 tx=0x7fa24000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa2477fe700 1 -- 172.21.15.136:0/2045443897 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240015020 con 0x7fa250105480 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2501a2760 con 0x7fa250105480 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa2477fe700 1 -- 172.21.15.136:0/2045443897 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa240011ce0 con 0x7fa250105480 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa2477fe700 1 -- 172.21.15.136:0/2045443897 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240010d20 con 0x7fa250105480 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.561+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2501a2cf0 con 0x7fa250105480 2024-05-09T00:55:26.565 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.563+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2500512c0 con 0x7fa250105480 2024-05-09T00:55:26.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.564+0000 7fa2477fe700 1 -- 172.21.15.136:0/2045443897 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa240018020 con 0x7fa250105480 2024-05-09T00:55:26.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.564+0000 7fa2477fe700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa23c0b2880 0x7fa23c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:26.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.565+0000 7fa2477fe700 1 -- 172.21.15.136:0/2045443897 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7fa2400e0d40 con 0x7fa250105480 2024-05-09T00:55:26.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.565+0000 7fa24e59c700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa23c0b2880 0x7fa23c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:26.566 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.565+0000 7fa24e59c700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa23c0b2880 0x7fa23c0b4d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa250105380 tx=0x7fa23800b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:55:26.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.569+0000 7fa2477fe700 1 -- 172.21.15.136:0/2045443897 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa24001f020 con 0x7fa250105480 2024-05-09T00:55:26.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:26 smithi037 ceph-mon[30122]: osdmap e43: 7 total, 7 up, 7 in 2024-05-09T00:55:26.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:26 smithi151 ceph-mon[34780]: osdmap e43: 7 total, 7 up, 7 in 2024-05-09T00:55:26.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:26.777+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa250063c00 con 0x7fa23c0b2880 2024-05-09T00:55:27.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:27 smithi037 ceph-mon[30122]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:27.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:27.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:27.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:27.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:27 smithi037 ceph-mon[30122]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:27 smithi151 ceph-mon[34780]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:27 smithi151 ceph-mon[34780]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:27.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:27 smithi136 ceph-mon[34110]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:27.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:27.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:27.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:27.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:27 smithi136 ceph-mon[34110]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:29 smithi037 ceph-mon[30122]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:29 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/2059208962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]: dispatch 2024-05-09T00:55:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:29 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]: dispatch 2024-05-09T00:55:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:29 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]': finished 2024-05-09T00:55:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:29 smithi037 ceph-mon[30122]: osdmap e44: 8 total, 7 up, 8 in 2024-05-09T00:55:30.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:29 smithi151 ceph-mon[34780]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:29 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/2059208962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]: dispatch 2024-05-09T00:55:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:29 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]: dispatch 2024-05-09T00:55:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:29 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]': finished 2024-05-09T00:55:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:29 smithi151 ceph-mon[34780]: osdmap e44: 8 total, 7 up, 8 in 2024-05-09T00:55:30.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:29 smithi136 ceph-mon[34110]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:29 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/2059208962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]: dispatch 2024-05-09T00:55:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:29 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]: dispatch 2024-05-09T00:55:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:29 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a968a66d-5c3c-45eb-ba5b-40014fd1e831"}]': finished 2024-05-09T00:55:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:29 smithi136 ceph-mon[34110]: osdmap e44: 8 total, 7 up, 8 in 2024-05-09T00:55:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:31.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:30 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/556958345' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-7/activate.monmap"}]: dispatch 2024-05-09T00:55:31.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:30 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/556958345' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-7/activate.monmap"}]: dispatch 2024-05-09T00:55:31.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:30 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/556958345' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-7/activate.monmap"}]: dispatch 2024-05-09T00:55:31.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:31 smithi037 ceph-mon[30122]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:32.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:31 smithi151 ceph-mon[34780]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:32.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:31 smithi136 ceph-mon[34110]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:34.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:33 smithi136 ceph-mon[34110]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:34.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:33 smithi037 ceph-mon[30122]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:34.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:33 smithi151 ceph-mon[34780]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:36.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:35 smithi136 ceph-mon[34110]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:36.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:35 smithi037 ceph-mon[30122]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:36.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:35 smithi151 ceph-mon[34780]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:38.023 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:37 smithi136 ceph-mon[34110]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:38.024 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-09T00:55:38.024 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:38.024 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:37 smithi136 ceph-mon[34110]: Deploying daemon osd.7 on smithi136 2024-05-09T00:55:38.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:37 smithi037 ceph-mon[30122]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-09T00:55:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:38.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:37 smithi037 ceph-mon[30122]: Deploying daemon osd.7 on smithi136 2024-05-09T00:55:38.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:37 smithi151 ceph-mon[34780]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:38.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-09T00:55:38.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:38.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:37 smithi151 ceph-mon[34780]: Deploying daemon osd.7 on smithi136 2024-05-09T00:55:40.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:39 smithi037 ceph-mon[30122]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:40.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:39 smithi151 ceph-mon[34780]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:40.266 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:39 smithi136 ceph-mon[34110]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:42.007 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:41 smithi136 ceph-mon[34110]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:42.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:41 smithi037 ceph-mon[30122]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:42.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:41 smithi151 ceph-mon[34780]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:43.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:43 smithi136 ceph-mon[34110]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:43.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:43.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:43.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:43.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:43 smithi037 ceph-mon[30122]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:43.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:43.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:43.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:43.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:43 smithi151 ceph-mon[34780]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:46.147 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.147+0000 7fa2477fe700 1 -- 172.21.15.136:0/2045443897 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa250063c00 con 0x7fa23c0b2880 2024-05-09T00:55:46.148 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 7 on host 'smithi136' 2024-05-09T00:55:46.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.149+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa23c0b2880 msgr2=0x7fa23c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:46.150 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.149+0000 7fa254bb1700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa23c0b2880 0x7fa23c0b4d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa250105380 tx=0x7fa23800b670 comp rx=0 tx=0).stop 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105480 msgr2=0x7fa25019ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105480 0x7fa25019ae50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b530 tx=0x7fa24000b8f0 comp rx=0 tx=0).stop 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 shutdown_connections 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa23c0b2880 0x7fa23c0b4d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa250105e20 0x7fa2501a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa250104350 0x7fa25019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 --2- 172.21.15.136:0/2045443897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa250105480 0x7fa25019ae50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 >> 172.21.15.136:0/2045443897 conn(0x7fa2500ff990 msgr2=0x7fa2501086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 shutdown_connections 2024-05-09T00:55:46.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:55:46.150+0000 7fa254bb1700 1 -- 172.21.15.136:0/2045443897 wait complete. 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:46.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:55:46.755 DEBUG:teuthology.orchestra.run.smithi136:osd.7> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.7.service 2024-05-09T00:55:46.759 INFO:tasks.cephadm:Deploying osd.8 on smithi151 with /dev/vg_nvme/lv_2... 2024-05-09T00:55:46.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T00:55:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:55:47.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:47 smithi136 ceph-mon[34110]: from='osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T00:55:47.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:47 smithi136 ceph-mon[34110]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T00:55:47.445 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:47 smithi151 ceph-mon[34780]: from='osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T00:55:47.445 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:47 smithi151 ceph-mon[34780]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T00:55:47.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:47 smithi037 ceph-mon[30122]: from='osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T00:55:47.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:47 smithi037 ceph-mon[30122]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T00:55:48.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:48 smithi151 ceph-mon[34780]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:48.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:48 smithi151 ceph-mon[34780]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T00:55:48.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:48 smithi151 ceph-mon[34780]: osdmap e45: 8 total, 7 up, 8 in 2024-05-09T00:55:48.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:48 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:48.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:48 smithi151 ceph-mon[34780]: from='osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:55:48.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:48 smithi151 ceph-mon[34780]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:55:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:48 smithi037 ceph-mon[30122]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:48 smithi037 ceph-mon[30122]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T00:55:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:48 smithi037 ceph-mon[30122]: osdmap e45: 8 total, 7 up, 8 in 2024-05-09T00:55:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:48 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:48.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:48 smithi037 ceph-mon[30122]: from='osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:55:48.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:48 smithi037 ceph-mon[30122]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:55:48.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:48 smithi136 ceph-mon[34110]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:48 smithi136 ceph-mon[34110]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T00:55:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:48 smithi136 ceph-mon[34110]: osdmap e45: 8 total, 7 up, 8 in 2024-05-09T00:55:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:48 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:48 smithi136 ceph-mon[34110]: from='osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:55:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:48 smithi136 ceph-mon[34110]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:55:48.628 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 00:55:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T00:55:48.280+0000 7f715bf57700 -1 osd.7 0 waiting for initial osdmap 2024-05-09T00:55:48.628 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 00:55:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T00:55:48.294+0000 7f7157d0c700 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:55:48.980 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T00:55:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T00:55:48.981 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-09T00:55:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-09T00:55:48.981 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113758 s, 922 MB/s 2024-05-09T00:55:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-09T00:55:49.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:49 smithi151 ceph-mon[34780]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:55:49.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:49 smithi151 ceph-mon[34780]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T00:55:49.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:49 smithi151 ceph-mon[34780]: osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] boot 2024-05-09T00:55:49.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:49 smithi151 ceph-mon[34780]: osdmap e47: 8 total, 8 up, 8 in 2024-05-09T00:55:49.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_2 2024-05-09T00:55:49.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:49 smithi136 ceph-mon[34110]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:55:49.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:49 smithi136 ceph-mon[34110]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T00:55:49.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:49 smithi136 ceph-mon[34110]: osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] boot 2024-05-09T00:55:49.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:49 smithi136 ceph-mon[34110]: osdmap e47: 8 total, 8 up, 8 in 2024-05-09T00:55:49.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.637 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:49 smithi037 ceph-mon[30122]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:55:49.637 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:49 smithi037 ceph-mon[30122]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T00:55:49.637 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.637 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.638 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:49 smithi037 ceph-mon[30122]: osd.7 [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] boot 2024-05-09T00:55:49.638 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:49 smithi037 ceph-mon[30122]: osdmap e47: 8 total, 8 up, 8 in 2024-05-09T00:55:49.638 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:55:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:55:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:55:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:55:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: osdmap e48: 8 total, 8 up, 8 in 2024-05-09T00:55:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:55:50.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:55:50.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:50.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: osdmap e48: 8 total, 8 up, 8 in 2024-05-09T00:55:50.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:50.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:50.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: pgmap v172: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: osdmap e48: 8 total, 8 up, 8 in 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:55:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:55:51.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.420+0000 7f07357c5700 1 -- 172.21.15.151:0/2398943195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730104340 msgr2=0x7f0730104750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.420+0000 7f07357c5700 1 --2- 172.21.15.151:0/2398943195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730104340 0x7f0730104750 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0724009990 tx=0x7f0724009ca0 comp rx=0 tx=0).stop 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 -- 172.21.15.151:0/2398943195 shutdown_connections 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 --2- 172.21.15.151:0/2398943195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730105e10 0x7f073010c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 --2- 172.21.15.151:0/2398943195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730104340 0x7f0730104750 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 --2- 172.21.15.151:0/2398943195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730105470 0x7f0730105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 -- 172.21.15.151:0/2398943195 >> 172.21.15.151:0/2398943195 conn(0x7f07300ff9c0 msgr2=0x7f0730101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 -- 172.21.15.151:0/2398943195 shutdown_connections 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 -- 172.21.15.151:0/2398943195 wait complete. 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 Processor -- start 2024-05-09T00:55:51.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.421+0000 7f07357c5700 1 -- start start 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f07357c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730104340 0x7f073019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f07357c5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730105470 0x7f073019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f07357c5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730105e10 0x7f07301a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f07357c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f073010fdb0 con 0x7f0730104340 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f07357c5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f073010fc30 con 0x7f0730105e10 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f07357c5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f073010ff30 con 0x7f0730105470 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730105470 0x7f073019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730105470 0x7f073019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39038/0 (socket says 172.21.15.151:39038) 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 -- 172.21.15.151:0/4250948404 learned_addr learned my addr 172.21.15.151:0/4250948404 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072f7fe700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730105e10 0x7f07301a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 -- 172.21.15.151:0/4250948404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730105e10 msgr2=0x7f07301a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730105e10 0x7f07301a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 -- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730104340 msgr2=0x7f073019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730104340 0x7f073019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 -- 172.21.15.151:0/4250948404 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07301a2450 con 0x7f0730105470 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f072e7fc700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730105470 0x7f073019aec0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f072000d980 tx=0x7f072000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f0717fff700 1 -- 172.21.15.151:0/4250948404 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720017070 con 0x7f0730105470 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0730075a50 con 0x7f0730105470 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f0717fff700 1 -- 172.21.15.151:0/4250948404 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0720005020 con 0x7f0730105470 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.422+0000 7f0717fff700 1 -- 172.21.15.151:0/4250948404 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720009b50 con 0x7f0730105470 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.423+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0730075f90 con 0x7f0730105470 2024-05-09T00:55:51.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.424+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07300512c0 con 0x7f0730105470 2024-05-09T00:55:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.425+0000 7f0717fff700 1 -- 172.21.15.151:0/4250948404 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f07200051d0 con 0x7f0730105470 2024-05-09T00:55:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.425+0000 7f0717fff700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07180b2880 0x7f07180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:55:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.426+0000 7f0717fff700 1 -- 172.21.15.151:0/4250948404 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5397+0+0 (secure 0 0 0) 0x7f07200e15e0 con 0x7f0730105470 2024-05-09T00:55:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.426+0000 7f072effd700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07180b2880 0x7f07180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:55:51.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.426+0000 7f072effd700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07180b2880 0x7f07180b4d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f072400b5c0 tx=0x7f0724003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:55:51.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.431+0000 7f0717fff700 1 -- 172.21.15.151:0/4250948404 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0720020020 con 0x7f0730105470 2024-05-09T00:55:51.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:51 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi136 2024-05-09T00:55:51.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:51 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi136 to 5696M 2024-05-09T00:55:51.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:51 smithi151 ceph-mon[34780]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T00:55:51.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:51 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi136 2024-05-09T00:55:51.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:51 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi136 to 5696M 2024-05-09T00:55:51.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:51 smithi136 ceph-mon[34110]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T00:55:51.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:55:51.641+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0730063c00 con 0x7f07180b2880 2024-05-09T00:55:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:51 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi136 2024-05-09T00:55:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:51 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi136 to 5696M 2024-05-09T00:55:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:51 smithi037 ceph-mon[30122]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T00:55:52.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:52 smithi151 ceph-mon[34780]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:55:52.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:52 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:52.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:52 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:52.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:52 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:52.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:52 smithi136 ceph-mon[34110]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:55:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:52 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:52 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:52 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:52 smithi037 ceph-mon[30122]: pgmap v175: 1 pgs: 1 unknown; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:55:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:52 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:55:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:52 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:55:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:52 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:55:53.473 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:53 smithi151 ceph-mon[34780]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:53.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:53 smithi136 ceph-mon[34110]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:53.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:53 smithi037 ceph-mon[30122]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:55:54.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:54 smithi136 ceph-mon[34110]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:55:54.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:54 smithi037 ceph-mon[30122]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:55:54.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:54 smithi151 ceph-mon[34780]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:55:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:55 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/566800513' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]: dispatch 2024-05-09T00:55:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:55 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]: dispatch 2024-05-09T00:55:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:55 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]': finished 2024-05-09T00:55:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:55 smithi136 ceph-mon[34110]: osdmap e50: 9 total, 8 up, 9 in 2024-05-09T00:55:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:55:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:55 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/3936042801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-8/activate.monmap"}]: dispatch 2024-05-09T00:55:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:55 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/566800513' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]: dispatch 2024-05-09T00:55:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:55 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]: dispatch 2024-05-09T00:55:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:55 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]': finished 2024-05-09T00:55:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:55 smithi037 ceph-mon[30122]: osdmap e50: 9 total, 8 up, 9 in 2024-05-09T00:55:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:55:55.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:55 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/3936042801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-8/activate.monmap"}]: dispatch 2024-05-09T00:55:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:55 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/566800513' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]: dispatch 2024-05-09T00:55:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:55 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]: dispatch 2024-05-09T00:55:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:55 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4beeb243-ed25-40a3-9aac-04a7d79e74d5"}]': finished 2024-05-09T00:55:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:55 smithi151 ceph-mon[34780]: osdmap e50: 9 total, 8 up, 9 in 2024-05-09T00:55:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:55:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:55 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/3936042801' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-8/activate.monmap"}]: dispatch 2024-05-09T00:55:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:56 smithi136 ceph-mon[34110]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-09T00:55:56.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:56 smithi037 ceph-mon[30122]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-09T00:55:56.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:56 smithi151 ceph-mon[34780]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-09T00:55:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:55:58 smithi136 ceph-mon[34110]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-05-09T00:55:58.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:55:58 smithi151 ceph-mon[34780]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-05-09T00:55:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:55:58 smithi037 ceph-mon[30122]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 156 KiB/s, 0 objects/s recovering 2024-05-09T00:56:00.461 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:00 smithi151 ceph-mon[34780]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-05-09T00:56:00.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:00 smithi136 ceph-mon[34110]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-05-09T00:56:00.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:00 smithi037 ceph-mon[30122]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-05-09T00:56:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:02 smithi136 ceph-mon[34110]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:56:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:02 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T00:56:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:02 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:02.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:02 smithi151 ceph-mon[34780]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:56:02.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:02 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T00:56:02.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:02 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:02 smithi037 ceph-mon[30122]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:56:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:02 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T00:56:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:02 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:03.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:03 smithi151 ceph-mon[34780]: Deploying daemon osd.8 on smithi151 2024-05-09T00:56:03.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:03 smithi136 ceph-mon[34110]: Deploying daemon osd.8 on smithi151 2024-05-09T00:56:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:03 smithi037 ceph-mon[30122]: Deploying daemon osd.8 on smithi151 2024-05-09T00:56:04.514 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:04 smithi151 ceph-mon[34780]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:56:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:04 smithi136 ceph-mon[34110]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:56:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:04 smithi037 ceph-mon[30122]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:56:06.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:06 smithi151 ceph-mon[34780]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:06 smithi136 ceph-mon[34110]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:06 smithi037 ceph-mon[30122]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:08.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:08 smithi151 ceph-mon[34780]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:08.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:08.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:08.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:08 smithi037 ceph-mon[30122]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:08 smithi136 ceph-mon[34110]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:10 smithi037 ceph-mon[30122]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:10 smithi151 ceph-mon[34780]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:10 smithi136 ceph-mon[34110]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:11.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.010+0000 7f0717fff700 1 -- 172.21.15.151:0/4250948404 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0730063c00 con 0x7f07180b2880 2024-05-09T00:56:11.014 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 8 on host 'smithi151' 2024-05-09T00:56:11.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.012+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07180b2880 msgr2=0x7f07180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:11.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07180b2880 0x7f07180b4d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f072400b5c0 tx=0x7f0724003860 comp rx=0 tx=0).stop 2024-05-09T00:56:11.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730105470 msgr2=0x7f073019aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:11.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730105470 0x7f073019aec0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f072000d980 tx=0x7f072000dc90 comp rx=0 tx=0).stop 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 shutdown_connections 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07180b2880 0x7f07180b4d90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730105e10 0x7f07301a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730104340 0x7f073019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 --2- 172.21.15.151:0/4250948404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730105470 0x7f073019aec0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 >> 172.21.15.151:0/4250948404 conn(0x7f07300ff9c0 msgr2=0x7f07301086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 shutdown_connections 2024-05-09T00:56:11.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:56:11.013+0000 7f07357c5700 1 -- 172.21.15.151:0/4250948404 wait complete. 2024-05-09T00:56:11.629 DEBUG:teuthology.orchestra.run.smithi151:osd.8> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.8.service 2024-05-09T00:56:11.631 INFO:tasks.cephadm:Deploying osd.9 on smithi037 with /dev/vg_nvme/lv_1... 2024-05-09T00:56:11.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T00:56:11.893 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:56:12.156 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:11 smithi151 ceph-mon[34780]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:12.156 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:11 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:12.156 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:11 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:12.156 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:11 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:12.156 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:11 smithi151 ceph-mon[34780]: from='osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:56:12.156 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:11 smithi151 ceph-mon[34780]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:56:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:11 smithi037 ceph-mon[30122]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:11 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:11 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:11 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:11 smithi037 ceph-mon[30122]: from='osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:56:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:11 smithi037 ceph-mon[30122]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:56:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:11 smithi136 ceph-mon[34110]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:11 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:11 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:11 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:11 smithi136 ceph-mon[34110]: from='osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:56:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:11 smithi136 ceph-mon[34110]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:56:13.034 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:12 smithi151 ceph-mon[34780]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T00:56:13.035 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:12 smithi151 ceph-mon[34780]: osdmap e51: 9 total, 8 up, 9 in 2024-05-09T00:56:13.035 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:13.035 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:12 smithi151 ceph-mon[34780]: from='osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:56:13.035 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:12 smithi151 ceph-mon[34780]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:56:13.235 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:12 smithi037 ceph-mon[30122]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T00:56:13.235 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:12 smithi037 ceph-mon[30122]: osdmap e51: 9 total, 8 up, 9 in 2024-05-09T00:56:13.235 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:13.235 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:12 smithi037 ceph-mon[30122]: from='osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:56:13.235 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:12 smithi037 ceph-mon[30122]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:56:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:12 smithi136 ceph-mon[34110]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T00:56:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:12 smithi136 ceph-mon[34110]: osdmap e51: 9 total, 8 up, 9 in 2024-05-09T00:56:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:12 smithi136 ceph-mon[34110]: from='osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:56:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:12 smithi136 ceph-mon[34110]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:56:13.916 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T00:56:13.916 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T00:56:13.917 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-05-09T00:56:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-05-09T00:56:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113756 s, 922 MB/s 2024-05-09T00:56:13.917 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 2024-05-09T00:56:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:13 smithi037 ceph-mon[30122]: from='osd.8 ' entity='osd.8' 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:13 smithi151 ceph-mon[34780]: from='osd.8 ' entity='osd.8' 2024-05-09T00:56:14.226 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 00:56:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T00:56:13.896+0000 7f6560723700 -1 osd.8 0 waiting for initial osdmap 2024-05-09T00:56:14.226 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 00:56:14 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T00:56:14.003+0000 7f6557ccf700 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:13 smithi136 ceph-mon[34110]: from='osd.8 ' entity='osd.8' 2024-05-09T00:56:14.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-05-09T00:56:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:56:15.129 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:56:15.129 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:56:15.129 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:15.129 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] boot 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: osdmap e54: 9 total, 9 up, 9 in 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:15.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:14 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] boot 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: osdmap e54: 9 total, 9 up, 9 in 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:15.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:15.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:14 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: osd.8 [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] boot 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: osdmap e54: 9 total, 9 up, 9 in 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:15.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:15.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:15.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:15.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:14 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:16.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:15 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi151 2024-05-09T00:56:16.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:15 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi151 to 5696M 2024-05-09T00:56:16.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:15 smithi037 ceph-mon[30122]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:16.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:15 smithi037 ceph-mon[30122]: osdmap e55: 9 total, 9 up, 9 in 2024-05-09T00:56:16.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:15 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi151 2024-05-09T00:56:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:15 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi151 to 5696M 2024-05-09T00:56:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:15 smithi136 ceph-mon[34110]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:15 smithi136 ceph-mon[34110]: osdmap e55: 9 total, 9 up, 9 in 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.423+0000 7f522f34a700 1 -- 172.21.15.37:0/1665223223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228103250 msgr2=0x7f5228103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.423+0000 7f522f34a700 1 --2- 172.21.15.37:0/1665223223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228103250 0x7f5228103660 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5224009990 tx=0x7f5224009ca0 comp rx=0 tx=0).stop 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.423+0000 7f522f34a700 1 -- 172.21.15.37:0/1665223223 shutdown_connections 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.424+0000 7f522f34a700 1 --2- 172.21.15.37:0/1665223223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5228104d20 0x7f522810b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.424+0000 7f522f34a700 1 --2- 172.21.15.37:0/1665223223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228103250 0x7f5228103660 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.424+0000 7f522f34a700 1 --2- 172.21.15.37:0/1665223223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5228104380 0x7f5228104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.424+0000 7f522f34a700 1 -- 172.21.15.37:0/1665223223 >> 172.21.15.37:0/1665223223 conn(0x7f52280fe890 msgr2=0x7f5228100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.424+0000 7f522f34a700 1 -- 172.21.15.37:0/1665223223 shutdown_connections 2024-05-09T00:56:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.424+0000 7f522f34a700 1 -- 172.21.15.37:0/1665223223 wait complete. 2024-05-09T00:56:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 Processor -- start 2024-05-09T00:56:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 -- start start 2024-05-09T00:56:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5228103250 0x7f522819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228104380 0x7f522819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5228104d20 0x7f52281a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f522810ed10 con 0x7f5228104380 2024-05-09T00:56:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f522810eb90 con 0x7f5228104d20 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522f34a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f522810ee90 con 0x7f5228103250 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522c8e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228104380 0x7f522819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522c8e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228104380 0x7f522819af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49328/0 (socket says 172.21.15.37:49328) 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522c8e5700 1 -- 172.21.15.37:0/2927218115 learned_addr learned my addr 172.21.15.37:0/2927218115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522d8e7700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5228104d20 0x7f52281a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.425+0000 7f522d0e6700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5228103250 0x7f522819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522c8e5700 1 -- 172.21.15.37:0/2927218115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5228103250 msgr2=0x7f522819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522c8e5700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5228103250 0x7f522819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522c8e5700 1 -- 172.21.15.37:0/2927218115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5228104d20 msgr2=0x7f52281a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522c8e5700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5228104d20 0x7f52281a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522c8e5700 1 -- 172.21.15.37:0/2927218115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52281a24c0 con 0x7f5228104380 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522c8e5700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228104380 0x7f522819af30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f521800b530 tx=0x7f521800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f521e7fc700 1 -- 172.21.15.37:0/2927218115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218015020 con 0x7f5228104380 2024-05-09T00:56:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52281a27b0 con 0x7f5228104380 2024-05-09T00:56:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f521e7fc700 1 -- 172.21.15.37:0/2927218115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5218011ce0 con 0x7f5228104380 2024-05-09T00:56:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52281a2dc0 con 0x7f5228104380 2024-05-09T00:56:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.426+0000 7f521e7fc700 1 -- 172.21.15.37:0/2927218115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218010e40 con 0x7f5228104380 2024-05-09T00:56:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.427+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f520c005360 con 0x7f5228104380 2024-05-09T00:56:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.429+0000 7f521e7fc700 1 -- 172.21.15.37:0/2927218115 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5218018020 con 0x7f5228104380 2024-05-09T00:56:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.430+0000 7f521e7fc700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f52140b2880 0x7f52140b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.430+0000 7f522d0e6700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f52140b2880 0x7f52140b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.430+0000 7f521e7fc700 1 -- 172.21.15.37:0/2927218115 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5829+0+0 (secure 0 0 0) 0x7f52180e1560 con 0x7f5228104380 2024-05-09T00:56:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.430+0000 7f522d0e6700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f52140b2880 0x7f52140b4d90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52240038a0 tx=0x7f522401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:56:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.434+0000 7f521e7fc700 1 -- 172.21.15.37:0/2927218115 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f521801f020 con 0x7f5228104380 2024-05-09T00:56:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:15 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi151 2024-05-09T00:56:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:15 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi151 to 5696M 2024-05-09T00:56:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:15 smithi151 ceph-mon[34780]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:56:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:15 smithi151 ceph-mon[34780]: osdmap e55: 9 total, 9 up, 9 in 2024-05-09T00:56:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:16.658+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f520c000bf0 con 0x7f52140b2880 2024-05-09T00:56:17.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:17 smithi037 ceph-mon[30122]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T00:56:17.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:17 smithi037 ceph-mon[30122]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:56:17.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:56:17.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:56:17.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:17 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:17.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:17 smithi037 ceph-mon[30122]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:17 smithi136 ceph-mon[34110]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T00:56:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:17 smithi136 ceph-mon[34110]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:56:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:56:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:56:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:17 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:17.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:17 smithi136 ceph-mon[34110]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:17.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:17 smithi151 ceph-mon[34780]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T00:56:17.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:17 smithi151 ceph-mon[34780]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:56:17.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:56:17.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:56:17.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:17 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:17.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:17 smithi151 ceph-mon[34780]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:19.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:19 smithi037 ceph-mon[30122]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:19.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:19 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1555753592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b819cc6-32b0-4abb-80a3-cd74996b94ca"}]: dispatch 2024-05-09T00:56:19.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:19 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1555753592' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b819cc6-32b0-4abb-80a3-cd74996b94ca"}]': finished 2024-05-09T00:56:19.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:19 smithi037 ceph-mon[30122]: osdmap e57: 10 total, 9 up, 10 in 2024-05-09T00:56:19.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:19 smithi151 ceph-mon[34780]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:19 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1555753592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b819cc6-32b0-4abb-80a3-cd74996b94ca"}]: dispatch 2024-05-09T00:56:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:19 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1555753592' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b819cc6-32b0-4abb-80a3-cd74996b94ca"}]': finished 2024-05-09T00:56:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:19 smithi151 ceph-mon[34780]: osdmap e57: 10 total, 9 up, 10 in 2024-05-09T00:56:20.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:20.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:19 smithi136 ceph-mon[34110]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:19 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1555753592' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b819cc6-32b0-4abb-80a3-cd74996b94ca"}]: dispatch 2024-05-09T00:56:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:19 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1555753592' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b819cc6-32b0-4abb-80a3-cd74996b94ca"}]': finished 2024-05-09T00:56:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:19 smithi136 ceph-mon[34110]: osdmap e57: 10 total, 9 up, 10 in 2024-05-09T00:56:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:21.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:20 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3122602942' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-9/activate.monmap"}]: dispatch 2024-05-09T00:56:21.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:20 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3122602942' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-9/activate.monmap"}]: dispatch 2024-05-09T00:56:21.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:20 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3122602942' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-9/activate.monmap"}]: dispatch 2024-05-09T00:56:22.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:21 smithi037 ceph-mon[30122]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T00:56:22.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:21 smithi151 ceph-mon[34780]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T00:56:22.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:21 smithi136 ceph-mon[34110]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T00:56:24.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:23 smithi037 ceph-mon[30122]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-09T00:56:24.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:23 smithi151 ceph-mon[34780]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-09T00:56:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:23 smithi136 ceph-mon[34110]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-09T00:56:26.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:25 smithi037 ceph-mon[30122]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-09T00:56:26.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:25 smithi151 ceph-mon[34780]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-09T00:56:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:25 smithi136 ceph-mon[34110]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-09T00:56:28.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:27 smithi037 ceph-mon[30122]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:56:28.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T00:56:28.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:28.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:27 smithi151 ceph-mon[34780]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:56:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T00:56:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:27 smithi136 ceph-mon[34110]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:56:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T00:56:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:29.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:28 smithi037 ceph-mon[30122]: Deploying daemon osd.9 on smithi037 2024-05-09T00:56:29.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:28 smithi151 ceph-mon[34780]: Deploying daemon osd.9 on smithi037 2024-05-09T00:56:29.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:28 smithi136 ceph-mon[34110]: Deploying daemon osd.9 on smithi037 2024-05-09T00:56:30.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:29 smithi037 ceph-mon[30122]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:56:30.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:29 smithi151 ceph-mon[34780]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:56:30.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:29 smithi136 ceph-mon[34110]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:56:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:31 smithi037 ceph-mon[30122]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:32.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:31 smithi151 ceph-mon[34780]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:31 smithi136 ceph-mon[34110]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:34.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:33 smithi037 ceph-mon[30122]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:34.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:34.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:34.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:34.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:33 smithi151 ceph-mon[34780]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:33 smithi136 ceph-mon[34110]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:36.041 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:35 smithi037 ceph-mon[30122]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:36.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:35 smithi151 ceph-mon[34780]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:35 smithi136 ceph-mon[34110]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:37.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.332+0000 7f521e7fc700 1 -- 172.21.15.37:0/2927218115 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f520c000bf0 con 0x7f52140b2880 2024-05-09T00:56:37.333 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 9 on host 'smithi037' 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f52140b2880 msgr2=0x7f52140b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f52140b2880 0x7f52140b4d90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52240038a0 tx=0x7f522401a040 comp rx=0 tx=0).stop 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228104380 msgr2=0x7f522819af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228104380 0x7f522819af30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f521800b530 tx=0x7f521800b840 comp rx=0 tx=0).stop 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 shutdown_connections 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f52140b2880 0x7f52140b4d90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5228104d20 0x7f52281a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5228103250 0x7f522819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 --2- 172.21.15.37:0/2927218115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5228104380 0x7f522819af30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 >> 172.21.15.37:0/2927218115 conn(0x7f52280fe890 msgr2=0x7f5228100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 shutdown_connections 2024-05-09T00:56:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:56:37.335+0000 7f522f34a700 1 -- 172.21.15.37:0/2927218115 wait complete. 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:37.636 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:37 smithi037 ceph-mon[30122]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:37 smithi151 ceph-mon[34780]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:37.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:37 smithi136 ceph-mon[34110]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T00:56:38.008 DEBUG:teuthology.orchestra.run.smithi037:osd.9> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.9.service 2024-05-09T00:56:38.010 INFO:tasks.cephadm:Deploying osd.10 on smithi136 with /dev/vg_nvme/lv_1... 2024-05-09T00:56:38.010 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T00:56:38.257 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:56:39.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:39 smithi037 ceph-mon[30122]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T00:56:39.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:39 smithi037 ceph-mon[30122]: osdmap e58: 10 total, 9 up, 10 in 2024-05-09T00:56:39.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:39 smithi037 ceph-mon[30122]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:56:39.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:39 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:39.354 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 00:56:39 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T00:56:39.335+0000 7fcd074e8700 -1 osd.9 0 waiting for initial osdmap 2024-05-09T00:56:39.354 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 00:56:39 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T00:56:39.352+0000 7fcd0329d700 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:56:39.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:39 smithi136 ceph-mon[34110]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T00:56:39.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:39 smithi136 ceph-mon[34110]: osdmap e58: 10 total, 9 up, 10 in 2024-05-09T00:56:39.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:39 smithi136 ceph-mon[34110]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:56:39.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:39 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:39 smithi151 ceph-mon[34780]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T00:56:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:39 smithi151 ceph-mon[34780]: osdmap e58: 10 total, 9 up, 10 in 2024-05-09T00:56:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:39 smithi151 ceph-mon[34780]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-05-09T00:56:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:39 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:40.065 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T00:56:40.065 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T00:56:40.066 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-09T00:56:40.066 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-09T00:56:40.066 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00925758 s, 1.1 GB/s 2024-05-09T00:56:40.066 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-09T00:56:40.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:40 smithi037 ceph-mon[30122]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:40.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:40 smithi037 ceph-mon[30122]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:56:40.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:40 smithi037 ceph-mon[30122]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T00:56:40.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:40 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:40.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:40 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:40.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:40 smithi136 ceph-mon[34110]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:40.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:40 smithi136 ceph-mon[34110]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:56:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:40 smithi136 ceph-mon[34110]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T00:56:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:40 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:40 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:40 smithi151 ceph-mon[34780]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:40 smithi151 ceph-mon[34780]: from='osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-05-09T00:56:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:40 smithi151 ceph-mon[34780]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T00:56:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:40 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:40 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:40.755 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_1 2024-05-09T00:56:41.002 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:56:41.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:56:41.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:56:41.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:41.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] boot 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: osdmap e60: 10 total, 10 up, 10 in 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi037 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi037 to 4273M 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:41.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:56:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:56:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] boot 2024-05-09T00:56:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: osdmap e60: 10 total, 10 up, 10 in 2024-05-09T00:56:41.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi037 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi037 to 4273M 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:41.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: osd.9 [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] boot 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: osdmap e60: 10 total, 10 up, 10 in 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi037 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi037 to 4273M 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:56:41.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:42.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 -- 172.21.15.136:0/1102175514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1029e0 msgr2=0x7f47ac102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:42.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 --2- 172.21.15.136:0/1102175514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1029e0 0x7f47ac102df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f479c009990 tx=0x7f479c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 -- 172.21.15.136:0/1102175514 shutdown_connections 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 --2- 172.21.15.136:0/1102175514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47ac1044b0 0x7f47ac10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 --2- 172.21.15.136:0/1102175514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1029e0 0x7f47ac102df0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 --2- 172.21.15.136:0/1102175514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47ac103b10 0x7f47ac103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 -- 172.21.15.136:0/1102175514 >> 172.21.15.136:0/1102175514 conn(0x7f47ac0fe000 msgr2=0x7f47ac1004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 -- 172.21.15.136:0/1102175514 shutdown_connections 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.483+0000 7f47b326f700 1 -- 172.21.15.136:0/1102175514 wait complete. 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 Processor -- start 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 -- start start 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47ac1029e0 0x7f47ac0ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47ac103b10 0x7f47ac19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1044b0 0x7f47ac1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:42.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac10e420 con 0x7f47ac1029e0 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac10e2a0 con 0x7f47ac1044b0 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b326f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac10e5a0 con 0x7f47ac103b10 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b180c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1044b0 0x7f47ac1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b100b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47ac1029e0 0x7f47ac0ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b180c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1044b0 0x7f47ac1a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56140/0 (socket says 172.21.15.136:56140) 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b100b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47ac1029e0 0x7f47ac0ffea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.136:38014/0 (socket says 172.21.15.136:38014) 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.484+0000 7f47b180c700 1 -- 172.21.15.136:0/3469992210 learned_addr learned my addr 172.21.15.136:0/3469992210 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b080a700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47ac103b10 0x7f47ac19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b180c700 1 -- 172.21.15.136:0/3469992210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47ac103b10 msgr2=0x7f47ac19f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b180c700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47ac103b10 0x7f47ac19f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b180c700 1 -- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47ac1029e0 msgr2=0x7f47ac0ffea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b180c700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47ac1029e0 0x7f47ac0ffea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b180c700 1 -- 172.21.15.136:0/3469992210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac1a2460 con 0x7f47ac1044b0 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b180c700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1044b0 0x7f47ac1a1cc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47a400caf0 tx=0x7f47a400ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:56:42.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47aa7fc700 1 -- 172.21.15.136:0/3469992210 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4016020 con 0x7f47ac1044b0 2024-05-09T00:56:42.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ac1a2750 con 0x7f47ac1044b0 2024-05-09T00:56:42.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47aa7fc700 1 -- 172.21.15.136:0/3469992210 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47a400ae50 con 0x7f47ac1044b0 2024-05-09T00:56:42.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47aa7fc700 1 -- 172.21.15.136:0/3469992210 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4011380 con 0x7f47ac1044b0 2024-05-09T00:56:42.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.485+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ac1a2c90 con 0x7f47ac1044b0 2024-05-09T00:56:42.488 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.486+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ac0512c0 con 0x7f47ac1044b0 2024-05-09T00:56:42.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.488+0000 7f47aa7fc700 1 -- 172.21.15.136:0/3469992210 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f47a4019020 con 0x7f47ac1044b0 2024-05-09T00:56:42.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.489+0000 7f47aa7fc700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47940b2880 0x7f47940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:56:42.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.489+0000 7f47aa7fc700 1 -- 172.21.15.136:0/3469992210 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6261+0+0 (secure 0 0 0) 0x7f47a40e1bb0 con 0x7f47ac1044b0 2024-05-09T00:56:42.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.489+0000 7f47b100b700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47940b2880 0x7f47940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:56:42.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.490+0000 7f47b100b700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47940b2880 0x7f47940b4d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f479c0038a0 tx=0x7f479c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:56:42.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.493+0000 7f47aa7fc700 1 -- 172.21.15.136:0/3469992210 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f47a4020020 con 0x7f47ac1044b0 2024-05-09T00:56:42.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:42 smithi136 ceph-mon[34110]: osdmap e61: 10 total, 10 up, 10 in 2024-05-09T00:56:42.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:56:42.706+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f47ac063c00 con 0x7f47940b2880 2024-05-09T00:56:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:42 smithi037 ceph-mon[30122]: osdmap e61: 10 total, 10 up, 10 in 2024-05-09T00:56:42.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:42 smithi151 ceph-mon[34780]: osdmap e61: 10 total, 10 up, 10 in 2024-05-09T00:56:43.577 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:43 smithi136 ceph-mon[34110]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:56:43.578 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:56:43.578 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:56:43.578 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:43.578 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:43 smithi136 ceph-mon[34110]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:43 smithi037 ceph-mon[30122]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:56:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:56:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:56:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:43 smithi037 ceph-mon[30122]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:43 smithi151 ceph-mon[34780]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:56:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:56:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:56:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:43 smithi151 ceph-mon[34780]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:46.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:45 smithi136 ceph-mon[34110]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:46.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:45 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/2443681953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]: dispatch 2024-05-09T00:56:46.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:45 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]: dispatch 2024-05-09T00:56:46.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:45 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]': finished 2024-05-09T00:56:46.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:45 smithi136 ceph-mon[34110]: osdmap e62: 11 total, 10 up, 11 in 2024-05-09T00:56:46.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:45 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:56:46.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:45 smithi037 ceph-mon[30122]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:46.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:45 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/2443681953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]: dispatch 2024-05-09T00:56:46.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:45 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]: dispatch 2024-05-09T00:56:46.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:45 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]': finished 2024-05-09T00:56:46.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:45 smithi037 ceph-mon[30122]: osdmap e62: 11 total, 10 up, 11 in 2024-05-09T00:56:46.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:45 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:56:46.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:45 smithi151 ceph-mon[34780]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:46.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:45 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/2443681953' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]: dispatch 2024-05-09T00:56:46.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:45 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]: dispatch 2024-05-09T00:56:46.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:45 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "38839342-1039-4594-aa73-8ed002d99e65"}]': finished 2024-05-09T00:56:46.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:45 smithi151 ceph-mon[34780]: osdmap e62: 11 total, 10 up, 11 in 2024-05-09T00:56:46.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:45 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:56:47.226 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:46 smithi037 ceph-mon[30122]: from='client.? 172.21.15.136:0/2685254817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-10/activate.monmap"}]: dispatch 2024-05-09T00:56:47.421 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:46 smithi136 ceph-mon[34110]: from='client.? 172.21.15.136:0/2685254817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-10/activate.monmap"}]: dispatch 2024-05-09T00:56:47.421 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:46 smithi151 ceph-mon[34780]: from='client.? 172.21.15.136:0/2685254817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-10/activate.monmap"}]: dispatch 2024-05-09T00:56:48.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:47 smithi037 ceph-mon[30122]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:48.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:47 smithi151 ceph-mon[34780]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:48.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:47 smithi136 ceph-mon[34110]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:50.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:49 smithi037 ceph-mon[30122]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:50.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:49 smithi151 ceph-mon[34780]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:50.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:49 smithi136 ceph-mon[34110]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:51 smithi037 ceph-mon[30122]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:52.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:51 smithi151 ceph-mon[34780]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:51 smithi136 ceph-mon[34110]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:53 smithi037 ceph-mon[30122]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T00:56:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:53 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:53 smithi037 ceph-mon[30122]: Deploying daemon osd.10 on smithi136 2024-05-09T00:56:54.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:53 smithi151 ceph-mon[34780]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T00:56:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:53 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:53 smithi151 ceph-mon[34780]: Deploying daemon osd.10 on smithi136 2024-05-09T00:56:54.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:53 smithi136 ceph-mon[34110]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:54.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T00:56:54.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:53 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:56:54.294 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:53 smithi136 ceph-mon[34110]: Deploying daemon osd.10 on smithi136 2024-05-09T00:56:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:55 smithi037 ceph-mon[30122]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:56.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:55 smithi151 ceph-mon[34780]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:56.265 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:55 smithi136 ceph-mon[34110]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:58.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:57 smithi136 ceph-mon[34110]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:58.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:57 smithi037 ceph-mon[30122]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:58.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:57 smithi151 ceph-mon[34780]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:56:59 smithi136 ceph-mon[34110]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:59.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:59.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:59.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:59.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:56:59 smithi037 ceph-mon[30122]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:56:59.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:59.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:56:59.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:56:59.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:56:59 smithi151 ceph-mon[34780]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:02.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:01 smithi136 ceph-mon[34110]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:02.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:02.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:02.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:01 smithi037 ceph-mon[30122]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:01 smithi151 ceph-mon[34780]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:02.425 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 10 on host 'smithi136' 2024-05-09T00:57:02.426 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.424+0000 7f47aa7fc700 1 -- 172.21.15.136:0/3469992210 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f47ac063c00 con 0x7f47940b2880 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47940b2880 msgr2=0x7f47940b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47940b2880 0x7f47940b4d90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f479c0038a0 tx=0x7f479c01a040 comp rx=0 tx=0).stop 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1044b0 msgr2=0x7f47ac1a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1044b0 0x7f47ac1a1cc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47a400caf0 tx=0x7f47a400ce00 comp rx=0 tx=0).stop 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 shutdown_connections 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47940b2880 0x7f47940b4d90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47ac1044b0 0x7f47ac1a1cc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:02.428 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47ac1029e0 0x7f47ac0ffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:02.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 --2- 172.21.15.136:0/3469992210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47ac103b10 0x7f47ac19f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:02.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 >> 172.21.15.136:0/3469992210 conn(0x7f47ac0fe000 msgr2=0x7f47ac107770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:02.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 shutdown_connections 2024-05-09T00:57:02.429 INFO:teuthology.orchestra.run.smithi136.stderr:2024-05-09T00:57:02.427+0000 7f47b326f700 1 -- 172.21.15.136:0/3469992210 wait complete. 2024-05-09T00:57:03.047 DEBUG:teuthology.orchestra.run.smithi136:osd.10> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.10.service 2024-05-09T00:57:03.050 INFO:tasks.cephadm:Deploying osd.11 on smithi151 with /dev/vg_nvme/lv_1... 2024-05-09T00:57:03.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T00:57:03.297 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:57:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:03 smithi136 ceph-mon[34110]: from='osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:57:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:03 smithi136 ceph-mon[34110]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:57:03.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:03 smithi136 ceph-mon[34110]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:03.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:03.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:03.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:03.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:03 smithi151 ceph-mon[34780]: from='osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:57:03.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:03 smithi151 ceph-mon[34780]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:57:03.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:03 smithi151 ceph-mon[34780]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:03 smithi037 ceph-mon[30122]: from='osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:57:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:03 smithi037 ceph-mon[30122]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:57:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:03 smithi037 ceph-mon[30122]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:04.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:04 smithi136 ceph-mon[34110]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T00:57:04.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:04 smithi136 ceph-mon[34110]: from='osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:57:04.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:04 smithi136 ceph-mon[34110]: osdmap e63: 11 total, 10 up, 11 in 2024-05-09T00:57:04.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:04.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:04 smithi136 ceph-mon[34110]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:57:04.509 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 00:57:04 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T00:57:04.389+0000 7faf2d337700 -1 osd.10 0 waiting for initial osdmap 2024-05-09T00:57:04.509 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 00:57:04 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T00:57:04.407+0000 7faf290ec700 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:57:04.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:04 smithi151 ceph-mon[34780]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T00:57:04.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:04 smithi151 ceph-mon[34780]: from='osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:57:04.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:04 smithi151 ceph-mon[34780]: osdmap e63: 11 total, 10 up, 11 in 2024-05-09T00:57:04.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:04.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:04 smithi151 ceph-mon[34780]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:57:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:04 smithi037 ceph-mon[30122]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T00:57:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:04 smithi037 ceph-mon[30122]: from='osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:57:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:04 smithi037 ceph-mon[30122]: osdmap e63: 11 total, 10 up, 11 in 2024-05-09T00:57:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:04 smithi037 ceph-mon[30122]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-09T00:57:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T00:57:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T00:57:05.213 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-09T00:57:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-09T00:57:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113627 s, 923 MB/s 2024-05-09T00:57:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-09T00:57:05.503 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:05 smithi136 ceph-mon[34110]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:57:05.503 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:05 smithi136 ceph-mon[34110]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T00:57:05.503 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:05.503 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:05.503 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:05 smithi136 ceph-mon[34110]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:05.503 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:05 smithi136 ceph-mon[34110]: osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] boot 2024-05-09T00:57:05.514 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:05 smithi151 ceph-mon[34780]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:57:05.514 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:05 smithi151 ceph-mon[34780]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T00:57:05.514 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:05.514 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:05.514 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:05 smithi151 ceph-mon[34780]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:05.514 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:05 smithi151 ceph-mon[34780]: osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] boot 2024-05-09T00:57:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:05 smithi037 ceph-mon[30122]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-09T00:57:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:05 smithi037 ceph-mon[30122]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T00:57:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:05 smithi037 ceph-mon[30122]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:57:05.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:05 smithi037 ceph-mon[30122]: osd.10 [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] boot 2024-05-09T00:57:05.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_1 2024-05-09T00:57:06.152 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:57:06.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: osdmap e65: 11 total, 11 up, 11 in 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi136 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi136 to 4272M 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:06.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:06 smithi151 ceph-mon[34780]: osdmap e66: 11 total, 11 up, 11 in 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: osdmap e65: 11 total, 11 up, 11 in 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi136 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi136 to 4272M 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:06 smithi037 ceph-mon[30122]: osdmap e66: 11 total, 11 up, 11 in 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: osdmap e65: 11 total, 11 up, 11 in 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi136 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi136 to 4272M 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:06.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:06 smithi136 ceph-mon[34110]: osdmap e66: 11 total, 11 up, 11 in 2024-05-09T00:57:07.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:07 smithi151 ceph-mon[34780]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:07.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:07 smithi151 ceph-mon[34780]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T00:57:07.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:07 smithi037 ceph-mon[30122]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:07.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:07 smithi037 ceph-mon[30122]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T00:57:07.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2885887342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41049e0 msgr2=0x7fe7a410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:07.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2885887342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41049e0 0x7fe7a410c6f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00b0a0 tx=0x7fe79c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:57:07.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2885887342 shutdown_connections 2024-05-09T00:57:07.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2885887342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41049e0 0x7fe7a410c6f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:07.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2885887342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a41059b0 0x7fe7a4105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:07.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2885887342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a4103f60 0x7fe7a4104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:07.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2885887342 >> 172.21.15.151:0/2885887342 conn(0x7fe7a40ff9d0 msgr2=0x7fe7a4101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:07.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2885887342 shutdown_connections 2024-05-09T00:57:07.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.739+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2885887342 wait complete. 2024-05-09T00:57:07.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 Processor -- start 2024-05-09T00:57:07.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 -- start start 2024-05-09T00:57:07.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a4103f60 0x7fe7a419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:07.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a41049e0 0x7fe7a419aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:07.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41059b0 0x7fe7a41a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:07.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a410fef0 con 0x7fe7a41049e0 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a410fd70 con 0x7fe7a4103f60 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7ac5f0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a4110070 con 0x7fe7a41059b0 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41059b0 0x7fe7a41a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41059b0 0x7fe7a41a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55456/0 (socket says 172.21.15.151:55456) 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 -- 172.21.15.151:0/2870855168 learned_addr learned my addr 172.21.15.151:0/2870855168 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aa38c700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a4103f60 0x7fe7a419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 -- 172.21.15.151:0/2870855168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a4103f60 msgr2=0x7fe7a419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a4103f60 0x7fe7a419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7a9b8b700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a41049e0 0x7fe7a419aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 -- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a41049e0 msgr2=0x7fe7a419aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:07.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a41049e0 0x7fe7a419aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:07.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 -- 172.21.15.151:0/2870855168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a41a24e0 con 0x7fe7a41059b0 2024-05-09T00:57:07.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aa38c700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a4103f60 0x7fe7a419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:57:07.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.740+0000 7fe7aab8d700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41059b0 0x7fe7a41a1e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00b070 tx=0x7fe79c004ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:07.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.741+0000 7fe79b7fe700 1 -- 172.21.15.151:0/2870855168 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c021070 con 0x7fe7a41059b0 2024-05-09T00:57:07.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.741+0000 7fe79b7fe700 1 -- 172.21.15.151:0/2870855168 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe79c01d900 con 0x7fe7a41059b0 2024-05-09T00:57:07.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.741+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a41a2770 con 0x7fe7a41059b0 2024-05-09T00:57:07.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.741+0000 7fe79b7fe700 1 -- 172.21.15.151:0/2870855168 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c005390 con 0x7fe7a41059b0 2024-05-09T00:57:07.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.741+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a41a2d00 con 0x7fe7a41059b0 2024-05-09T00:57:07.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.742+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a40512c0 con 0x7fe7a41059b0 2024-05-09T00:57:07.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.744+0000 7fe79b7fe700 1 -- 172.21.15.151:0/2870855168 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe79c024070 con 0x7fe7a41059b0 2024-05-09T00:57:07.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.745+0000 7fe79b7fe700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7900b2900 0x7fe7900b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:07.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.745+0000 7fe79b7fe700 1 -- 172.21.15.151:0/2870855168 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6694+0+0 (secure 0 0 0) 0x7fe79c00f020 con 0x7fe7a41059b0 2024-05-09T00:57:07.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.745+0000 7fe7aa38c700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7900b2900 0x7fe7900b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:07.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.745+0000 7fe7aa38c700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7900b2900 0x7fe7900b4e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005fd0 tx=0x7fe7a0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.748+0000 7fe79b7fe700 1 -- 172.21.15.151:0/2870855168 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe79c02b020 con 0x7fe7a41059b0 2024-05-09T00:57:07.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:07 smithi136 ceph-mon[34110]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:07.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:07 smithi136 ceph-mon[34110]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T00:57:07.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:07.961+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe7a402ea10 con 0x7fe7900b2900 2024-05-09T00:57:08.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:08 smithi151 ceph-mon[34780]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:57:08.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:57:08.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:57:08.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:08 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:08.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:08 smithi037 ceph-mon[30122]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:57:08.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:57:08.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:57:08.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:08 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:08 smithi136 ceph-mon[34110]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:57:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:57:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:57:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:08 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:09.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:09 smithi151 ceph-mon[34780]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:09.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:09 smithi037 ceph-mon[30122]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:09.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:09 smithi136 ceph-mon[34110]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:11.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:10 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/858565810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]: dispatch 2024-05-09T00:57:11.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:10 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]: dispatch 2024-05-09T00:57:11.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:10 smithi151 ceph-mon[34780]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]': finished 2024-05-09T00:57:11.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:10 smithi151 ceph-mon[34780]: osdmap e68: 12 total, 11 up, 12 in 2024-05-09T00:57:11.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:11.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:10 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/858565810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]: dispatch 2024-05-09T00:57:11.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:10 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]: dispatch 2024-05-09T00:57:11.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:10 smithi136 ceph-mon[34110]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]': finished 2024-05-09T00:57:11.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:10 smithi136 ceph-mon[34110]: osdmap e68: 12 total, 11 up, 12 in 2024-05-09T00:57:11.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:10 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/858565810' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]: dispatch 2024-05-09T00:57:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:10 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]: dispatch 2024-05-09T00:57:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:10 smithi037 ceph-mon[30122]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6"}]': finished 2024-05-09T00:57:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:10 smithi037 ceph-mon[30122]: osdmap e68: 12 total, 11 up, 12 in 2024-05-09T00:57:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:12.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:11 smithi136 ceph-mon[34110]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-09T00:57:12.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:11 smithi136 ceph-mon[34110]: from='client.? 172.21.15.151:0/2142498303' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-11/activate.monmap"}]: dispatch 2024-05-09T00:57:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:11 smithi037 ceph-mon[30122]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-09T00:57:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:11 smithi037 ceph-mon[30122]: from='client.? 172.21.15.151:0/2142498303' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-11/activate.monmap"}]: dispatch 2024-05-09T00:57:12.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:11 smithi151 ceph-mon[34780]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-09T00:57:12.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:11 smithi151 ceph-mon[34780]: from='client.? 172.21.15.151:0/2142498303' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-11/activate.monmap"}]: dispatch 2024-05-09T00:57:14.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:13 smithi037 ceph-mon[30122]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-05-09T00:57:14.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:13 smithi151 ceph-mon[34780]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-05-09T00:57:14.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:13 smithi136 ceph-mon[34110]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-05-09T00:57:16.185 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:15 smithi151 ceph-mon[34780]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:57:16.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:15 smithi037 ceph-mon[30122]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:57:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:15 smithi136 ceph-mon[34110]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:57:18.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:17 smithi037 ceph-mon[30122]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-09T00:57:18.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:17 smithi151 ceph-mon[34780]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-09T00:57:18.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:17 smithi136 ceph-mon[34110]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-09T00:57:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T00:57:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:18 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:19.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:18 smithi037 ceph-mon[30122]: Deploying daemon osd.11 on smithi151 2024-05-09T00:57:19.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T00:57:19.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:18 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:19.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:18 smithi151 ceph-mon[34780]: Deploying daemon osd.11 on smithi151 2024-05-09T00:57:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T00:57:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:18 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:18 smithi136 ceph-mon[34110]: Deploying daemon osd.11 on smithi151 2024-05-09T00:57:20.196 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:19 smithi151 ceph-mon[34780]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:57:20.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:19 smithi037 ceph-mon[30122]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:57:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:19 smithi136 ceph-mon[34110]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T00:57:22.147 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:21 smithi151 ceph-mon[34780]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:22.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:21 smithi037 ceph-mon[30122]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:22.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:21 smithi136 ceph-mon[34110]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:24.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:23 smithi037 ceph-mon[30122]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:24.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:23 smithi151 ceph-mon[34780]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:24.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:23 smithi136 ceph-mon[34110]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:25.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:25.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:25.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:25.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:25.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:26.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:25 smithi151 ceph-mon[34780]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:26.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:25 smithi136 ceph-mon[34110]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:26.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:25 smithi037 ceph-mon[30122]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:27.987 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 11 on host 'smithi151' 2024-05-09T00:57:27.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.986+0000 7fe79b7fe700 1 -- 172.21.15.151:0/2870855168 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe7a402ea10 con 0x7fe7900b2900 2024-05-09T00:57:27.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7900b2900 msgr2=0x7fe7900b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:27.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7900b2900 0x7fe7900b4e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005fd0 tx=0x7fe7a0005dc0 comp rx=0 tx=0).stop 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41059b0 msgr2=0x7fe7a41a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41059b0 0x7fe7a41a1e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00b070 tx=0x7fe79c004ef0 comp rx=0 tx=0).stop 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 shutdown_connections 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7900b2900 0x7fe7900b4e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7a41059b0 0x7fe7a41a1e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7a4103f60 0x7fe7a419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 --2- 172.21.15.151:0/2870855168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7a41049e0 0x7fe7a419aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 >> 172.21.15.151:0/2870855168 conn(0x7fe7a40ff9d0 msgr2=0x7fe7a41086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 shutdown_connections 2024-05-09T00:57:27.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:27.989+0000 7fe7ac5f0700 1 -- 172.21.15.151:0/2870855168 wait complete. 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: from='osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:57:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:27 smithi037 ceph-mon[30122]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: from='osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:57:28.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:27 smithi151 ceph-mon[34780]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: from='osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:57:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:27 smithi136 ceph-mon[34110]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:57:28.628 DEBUG:teuthology.orchestra.run.smithi151:osd.11> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.11.service 2024-05-09T00:57:28.631 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-09T00:57:28.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T00:57:28.897 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: osdmap e69: 12 total, 11 up, 12 in 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: from='osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:57:29.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:28 smithi037 ceph-mon[30122]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: osdmap e69: 12 total, 11 up, 12 in 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: from='osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:57:29.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:28 smithi151 ceph-mon[34780]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:57:29.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T00:57:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: osdmap e69: 12 total, 11 up, 12 in 2024-05-09T00:57:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: from='osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:57:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:28 smithi136 ceph-mon[34110]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-09T00:57:30.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:29 smithi151 ceph-mon[34780]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:30.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:29 smithi151 ceph-mon[34780]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:57:30.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:29 smithi151 ceph-mon[34780]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T00:57:30.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:30.052 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:30.053 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:29 smithi151 ceph-mon[34780]: from='osd.11 ' entity='osd.11' 2024-05-09T00:57:30.053 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 00:57:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T00:57:29.939+0000 7f076bcd0700 -1 osd.11 0 waiting for initial osdmap 2024-05-09T00:57:30.275 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:29 smithi037 ceph-mon[30122]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:30.275 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:29 smithi037 ceph-mon[30122]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:57:30.275 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:29 smithi037 ceph-mon[30122]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T00:57:30.275 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:30.275 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:30.275 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:29 smithi037 ceph-mon[30122]: from='osd.11 ' entity='osd.11' 2024-05-09T00:57:30.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:29 smithi136 ceph-mon[34110]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:30.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:29 smithi136 ceph-mon[34110]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-09T00:57:30.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:29 smithi136 ceph-mon[34110]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T00:57:30.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:30.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:30.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:29 smithi136 ceph-mon[34110]: from='osd.11 ' entity='osd.11' 2024-05-09T00:57:30.475 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 00:57:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T00:57:30.082+0000 7f0763a7d700 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:57:30.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.667+0000 7f04b5c6c700 1 -- 172.21.15.37:0/661249922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0104380 msgr2=0x7f04b0104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:30.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.667+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/661249922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0104380 0x7f04b0104790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009990 tx=0x7f04a4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.667+0000 7f04b5c6c700 1 -- 172.21.15.37:0/661249922 shutdown_connections 2024-05-09T00:57:30.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.667+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/661249922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b0104d20 0x7f04b010b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.667+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/661249922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b0103250 0x7f04b0103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.667+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/661249922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0104380 0x7f04b0104790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.667+0000 7f04b5c6c700 1 -- 172.21.15.37:0/661249922 >> 172.21.15.37:0/661249922 conn(0x7f04b00fe890 msgr2=0x7f04b0100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:30.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.668+0000 7f04b5c6c700 1 -- 172.21.15.37:0/661249922 shutdown_connections 2024-05-09T00:57:30.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.668+0000 7f04b5c6c700 1 -- 172.21.15.37:0/661249922 wait complete. 2024-05-09T00:57:30.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.668+0000 7f04b5c6c700 1 Processor -- start 2024-05-09T00:57:30.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.668+0000 7f04b5c6c700 1 -- start start 2024-05-09T00:57:30.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04b5c6c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0103250 0x7f04b0199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:30.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04b5c6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b0104380 0x7f04b0199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:30.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04b5c6c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b0104d20 0x7f04b01a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04b5c6c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04b010ed10 con 0x7f04b0103250 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04b5c6c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04b010eb90 con 0x7f04b0104380 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04b5c6c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04b010ee90 con 0x7f04b0104d20 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0103250 0x7f04b0199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0103250 0x7f04b0199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55330/0 (socket says 172.21.15.37:55330) 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 -- 172.21.15.37:0/1162607717 learned_addr learned my addr 172.21.15.37:0/1162607717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04affff700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b0104d20 0x7f04b01a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 -- 172.21.15.37:0/1162607717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b0104d20 msgr2=0x7f04b01a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b0104d20 0x7f04b01a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 -- 172.21.15.37:0/1162607717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b0104380 msgr2=0x7f04b0199d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b0104380 0x7f04b0199d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 -- 172.21.15.37:0/1162607717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b00759f0 con 0x7f04b0103250 2024-05-09T00:57:30.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.669+0000 7f04af7fe700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0103250 0x7f04b0199820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04a000d950 tx=0x7f04a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:30.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.670+0000 7f04acff9700 1 -- 172.21.15.37:0/1162607717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0016070 con 0x7f04b0103250 2024-05-09T00:57:30.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.670+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b0075ce0 con 0x7f04b0103250 2024-05-09T00:57:30.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.670+0000 7f04acff9700 1 -- 172.21.15.37:0/1162607717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04a000be00 con 0x7f04b0103250 2024-05-09T00:57:30.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.670+0000 7f04acff9700 1 -- 172.21.15.37:0/1162607717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a000f3c0 con 0x7f04b0103250 2024-05-09T00:57:30.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.670+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b0076220 con 0x7f04b0103250 2024-05-09T00:57:30.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.671+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b00512c0 con 0x7f04b0103250 2024-05-09T00:57:30.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.672+0000 7f04acff9700 1 -- 172.21.15.37:0/1162607717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f04a0019070 con 0x7f04b0103250 2024-05-09T00:57:30.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.673+0000 7f04acff9700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04980b2880 0x7f04980b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:30.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.673+0000 7f04aeffd700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04980b2880 0x7f04980b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:30.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.673+0000 7f04acff9700 1 -- 172.21.15.37:0/1162607717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6847+0+0 (secure 0 0 0) 0x7f04a00e1b60 con 0x7f04b0103250 2024-05-09T00:57:30.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.673+0000 7f04aeffd700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04980b2880 0x7f04980b4d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04a400b5c0 tx=0x7f04a4003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:30.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.678+0000 7f04acff9700 1 -- 172.21.15.37:0/1162607717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f04a0020020 con 0x7f04b0103250 2024-05-09T00:57:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.891+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f04b00764d0 con 0x7f04b0103250 2024-05-09T00:57:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.891+0000 7f04acff9700 1 -- 172.21.15.37:0/1162607717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f04a00a9e40 con 0x7f04b0103250 2024-05-09T00:57:30.891 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04980b2880 msgr2=0x7f04980b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04980b2880 0x7f04980b4d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f04a400b5c0 tx=0x7f04a4003860 comp rx=0 tx=0).stop 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0103250 msgr2=0x7f04b0199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0103250 0x7f04b0199820 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04a000d950 tx=0x7f04a000dc60 comp rx=0 tx=0).stop 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 shutdown_connections 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04980b2880 0x7f04980b4d90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b0104d20 0x7f04b01a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b0103250 0x7f04b0199820 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 --2- 172.21.15.37:0/1162607717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b0104380 0x7f04b0199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 >> 172.21.15.37:0/1162607717 conn(0x7f04b00fe890 msgr2=0x7f04b01075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 shutdown_connections 2024-05-09T00:57:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:30.894+0000 7f04b5c6c700 1 -- 172.21.15.37:0/1162607717 wait complete. 2024-05-09T00:57:31.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:31 smithi037 ceph-mon[30122]: purged_snaps scrub starts 2024-05-09T00:57:31.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:31 smithi037 ceph-mon[30122]: purged_snaps scrub ok 2024-05-09T00:57:31.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:31.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:31 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1162607717' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:57:31.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:31 smithi151 ceph-mon[34780]: purged_snaps scrub starts 2024-05-09T00:57:31.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:31 smithi151 ceph-mon[34780]: purged_snaps scrub ok 2024-05-09T00:57:31.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:31.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:31 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1162607717' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:57:31.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:31 smithi136 ceph-mon[34110]: purged_snaps scrub starts 2024-05-09T00:57:31.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:31 smithi136 ceph-mon[34110]: purged_snaps scrub ok 2024-05-09T00:57:31.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:31.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:31 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1162607717' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:57:31.647 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1715216225,"num_in_osds":12,"osd_in_since":1715216230,"num_remapped_pgs":0} 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] boot 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: osdmap e71: 12 total, 12 up, 12 in 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:32.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:32.225 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:32 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] boot 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: osdmap e71: 12 total, 12 up, 12 in 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:32.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:32.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:32 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: osd.11 [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] boot 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: osdmap e71: 12 total, 12 up, 12 in 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:57:32.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:32.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:32.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:32 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:32.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T00:57:32.903 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:57:33.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:33 smithi037 ceph-mon[30122]: Detected new or changed devices on smithi151 2024-05-09T00:57:33.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:33 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi151 to 4272M 2024-05-09T00:57:33.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:33 smithi037 ceph-mon[30122]: osdmap e72: 12 total, 12 up, 12 in 2024-05-09T00:57:33.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:33 smithi136 ceph-mon[34110]: Detected new or changed devices on smithi151 2024-05-09T00:57:33.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:33 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi151 to 4272M 2024-05-09T00:57:33.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:33 smithi136 ceph-mon[34110]: osdmap e72: 12 total, 12 up, 12 in 2024-05-09T00:57:33.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:33 smithi151 ceph-mon[34780]: Detected new or changed devices on smithi151 2024-05-09T00:57:33.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:33 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi151 to 4272M 2024-05-09T00:57:33.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:33 smithi151 ceph-mon[34780]: osdmap e72: 12 total, 12 up, 12 in 2024-05-09T00:57:34.362 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:34 smithi037 ceph-mon[30122]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:34.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:34 smithi136 ceph-mon[34110]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:34.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:34 smithi151 ceph-mon[34780]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.650+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3581172899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78103240 msgr2=0x7f2c78103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.650+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3581172899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78103240 0x7f2c78103650 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009990 tx=0x7f2c6c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.650+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3581172899 shutdown_connections 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.650+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3581172899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c78104d10 0x7f2c7810b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.650+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3581172899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78103240 0x7f2c78103650 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.650+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3581172899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c78104370 0x7f2c78104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.651+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3581172899 >> 172.21.15.37:0/3581172899 conn(0x7f2c780fe880 msgr2=0x7f2c78100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.651+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3581172899 shutdown_connections 2024-05-09T00:57:34.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.651+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3581172899 wait complete. 2024-05-09T00:57:34.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 Processor -- start 2024-05-09T00:57:34.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 -- start start 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c78103240 0x7f2c7819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78104370 0x7f2c7819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c78104d10 0x7f2c781a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7810ed00 con 0x7f2c78104370 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7810eb80 con 0x7f2c78103240 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7ed41700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7810ee80 con 0x7f2c78104d10 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c77fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78104370 0x7f2c7819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c77fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78104370 0x7f2c7819d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42114/0 (socket says 172.21.15.37:42114) 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c77fff700 1 -- 172.21.15.37:0/3974855564 learned_addr learned my addr 172.21.15.37:0/3974855564 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7cadd700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c78103240 0x7f2c7819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c7d2de700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c78104d10 0x7f2c781a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:34.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c77fff700 1 -- 172.21.15.37:0/3974855564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c78104d10 msgr2=0x7f2c781a40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c77fff700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c78104d10 0x7f2c781a40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c77fff700 1 -- 172.21.15.37:0/3974855564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c78103240 msgr2=0x7f2c7819cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.652+0000 7f2c77fff700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c78103240 0x7f2c7819cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c77fff700 1 -- 172.21.15.37:0/3974855564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c781a47c0 con 0x7f2c78104370 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c7cadd700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c78103240 0x7f2c7819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c7d2de700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c78104d10 0x7f2c781a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c77fff700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78104370 0x7f2c7819d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400b530 tx=0x7f2c6400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c75ffb700 1 -- 172.21.15.37:0/3974855564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64015020 con 0x7f2c78104370 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c75ffb700 1 -- 172.21.15.37:0/3974855564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c64011ce0 con 0x7f2c78104370 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c781a4ab0 con 0x7f2c78104370 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c75ffb700 1 -- 172.21.15.37:0/3974855564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64010d20 con 0x7f2c78104370 2024-05-09T00:57:34.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.653+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c781a5040 con 0x7f2c78104370 2024-05-09T00:57:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.655+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c780512c0 con 0x7f2c78104370 2024-05-09T00:57:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.656+0000 7f2c75ffb700 1 -- 172.21.15.37:0/3974855564 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2c64018020 con 0x7f2c78104370 2024-05-09T00:57:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.656+0000 7f2c75ffb700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c680b2900 0x7f2c680b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.657+0000 7f2c75ffb700 1 -- 172.21.15.37:0/3974855564 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f2c640e1540 con 0x7f2c78104370 2024-05-09T00:57:34.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.657+0000 7f2c7cadd700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c680b2900 0x7f2c680b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:34.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.657+0000 7f2c7cadd700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c680b2900 0x7f2c680b4e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c006010 tx=0x7f2c6c005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:34.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.661+0000 7f2c75ffb700 1 -- 172.21.15.37:0/3974855564 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2c6401f020 con 0x7f2c78104370 2024-05-09T00:57:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.877+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2c781a5450 con 0x7f2c78104370 2024-05-09T00:57:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.877+0000 7f2c75ffb700 1 -- 172.21.15.37:0/3974855564 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f2c640a9700 con 0x7f2c78104370 2024-05-09T00:57:34.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c680b2900 msgr2=0x7f2c680b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c680b2900 0x7f2c680b4e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c006010 tx=0x7f2c6c005a90 comp rx=0 tx=0).stop 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78104370 msgr2=0x7f2c7819d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78104370 0x7f2c7819d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400b530 tx=0x7f2c6400b8f0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 shutdown_connections 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c680b2900 0x7f2c680b4e10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c78104d10 0x7f2c781a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c78103240 0x7f2c7819cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 --2- 172.21.15.37:0/3974855564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c78104370 0x7f2c7819d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 >> 172.21.15.37:0/3974855564 conn(0x7f2c780fe880 msgr2=0x7f2c78100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 shutdown_connections 2024-05-09T00:57:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:34.880+0000 7f2c7ed41700 1 -- 172.21.15.37:0/3974855564 wait complete. 2024-05-09T00:57:35.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:35 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3974855564' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:57:35.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:35 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3974855564' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:57:35.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:35 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3974855564' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:57:35.647 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1715216250,"num_in_osds":12,"osd_in_since":1715216230,"num_remapped_pgs":0} 2024-05-09T00:57:35.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:57:35.899 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:57:36.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:36 smithi037 ceph-mon[30122]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:36 smithi136 ceph-mon[34110]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:36.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:36 smithi151 ceph-mon[34780]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:37.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 -- 172.21.15.37:0/1357319578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8701045e0 msgr2=0x7fc8701049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:37.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1357319578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8701045e0 0x7fc8701049f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00b0d0 tx=0x7fc86c00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 -- 172.21.15.37:0/1357319578 shutdown_connections 2024-05-09T00:57:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1357319578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc870109860 0x7fc8701111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1357319578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8701045e0 0x7fc8701049f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1357319578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc870108f10 0x7fc870109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 -- 172.21.15.37:0/1357319578 >> 172.21.15.37:0/1357319578 conn(0x7fc8700ffed0 msgr2=0x7fc870102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 -- 172.21.15.37:0/1357319578 shutdown_connections 2024-05-09T00:57:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.449+0000 7fc877ffc700 1 -- 172.21.15.37:0/1357319578 wait complete. 2024-05-09T00:57:37.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.450+0000 7fc877ffc700 1 Processor -- start 2024-05-09T00:57:37.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.450+0000 7fc877ffc700 1 -- start start 2024-05-09T00:57:37.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.450+0000 7fc877ffc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8701045e0 0x7fc87019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:37.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc877ffc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc870108f10 0x7fc87019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:37.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc877ffc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc870109860 0x7fc87019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:37.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc877ffc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8701144e0 con 0x7fc870109860 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc877ffc700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc870114360 con 0x7fc870108f10 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc877ffc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc870114660 con 0x7fc8701045e0 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc870109860 0x7fc87019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc875d98700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8701045e0 0x7fc87019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc870109860 0x7fc87019f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42128/0 (socket says 172.21.15.37:42128) 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 -- 172.21.15.37:0/1074307287 learned_addr learned my addr 172.21.15.37:0/1074307287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc875597700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc870108f10 0x7fc87019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 -- 172.21.15.37:0/1074307287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8701045e0 msgr2=0x7fc87019ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8701045e0 0x7fc87019ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 -- 172.21.15.37:0/1074307287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc870108f10 msgr2=0x7fc87019b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc870108f10 0x7fc87019b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 -- 172.21.15.37:0/1074307287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87019fd00 con 0x7fc870109860 2024-05-09T00:57:37.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc875597700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc870108f10 0x7fc87019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:57:37.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc876599700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc870109860 0x7fc87019f660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc86800d980 tx=0x7fc86800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:37.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc866ffd700 1 -- 172.21.15.37:0/1074307287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868017070 con 0x7fc870109860 2024-05-09T00:57:37.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc866ffd700 1 -- 172.21.15.37:0/1074307287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc868005020 con 0x7fc870109860 2024-05-09T00:57:37.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc866ffd700 1 -- 172.21.15.37:0/1074307287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8680099b0 con 0x7fc870109860 2024-05-09T00:57:37.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.451+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87019fff0 con 0x7fc870109860 2024-05-09T00:57:37.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.452+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8701a7910 con 0x7fc870109860 2024-05-09T00:57:37.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.453+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8700512c0 con 0x7fc870109860 2024-05-09T00:57:37.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.454+0000 7fc866ffd700 1 -- 172.21.15.37:0/1074307287 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc868009b70 con 0x7fc870109860 2024-05-09T00:57:37.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.455+0000 7fc866ffd700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc85c0b2900 0x7fc85c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:37.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.455+0000 7fc875d98700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc85c0b2900 0x7fc85c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:37.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.455+0000 7fc866ffd700 1 -- 172.21.15.37:0/1074307287 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fc8680e1f90 con 0x7fc870109860 2024-05-09T00:57:37.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.456+0000 7fc875d98700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc85c0b2900 0x7fc85c0b4e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009900 tx=0x7fc86c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:37.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.459+0000 7fc866ffd700 1 -- 172.21.15.37:0/1074307287 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc868020020 con 0x7fc870109860 2024-05-09T00:57:37.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.675+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc87002e5f0 con 0x7fc870109860 2024-05-09T00:57:37.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.676+0000 7fc866ffd700 1 -- 172.21.15.37:0/1074307287 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18431 (secure 0 0 0) 0x7fc8680aa1d0 con 0x7fc870109860 2024-05-09T00:57:37.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:57:37.677 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:57:32.651361+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:57:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc85c0b2900 msgr2=0x7fc85c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc85c0b2900 0x7fc85c0b4e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009900 tx=0x7fc86c00b040 comp rx=0 tx=0).stop 2024-05-09T00:57:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc870109860 msgr2=0x7fc87019f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc870109860 0x7fc87019f660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc86800d980 tx=0x7fc86800dc90 comp rx=0 tx=0).stop 2024-05-09T00:57:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 shutdown_connections 2024-05-09T00:57:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc85c0b2900 0x7fc85c0b4e10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc870109860 0x7fc87019f660 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8701045e0 0x7fc87019ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 --2- 172.21.15.37:0/1074307287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc870108f10 0x7fc87019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:37.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 >> 172.21.15.37:0/1074307287 conn(0x7fc8700ffed0 msgr2=0x7fc8701086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:37.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 shutdown_connections 2024-05-09T00:57:37.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:37.678+0000 7fc877ffc700 1 -- 172.21.15.37:0/1074307287 wait complete. 2024-05-09T00:57:38.255 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:38 smithi037 ceph-mon[30122]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:38.255 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:38 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1074307287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:57:38.285 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T00:53:46.888552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:57:38.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-09T00:57:38.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:38 smithi136 ceph-mon[34110]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:38.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:38 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1074307287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:57:38.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:38 smithi151 ceph-mon[34780]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:38.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:38 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1074307287' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:57:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:57:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 -- 172.21.15.37:0/3046880507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4075d30 msgr2=0x7f0fa4076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 --2- 172.21.15.37:0/3046880507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4075d30 0x7f0fa4076140 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400b0a0 tx=0x7f0f9400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 -- 172.21.15.37:0/3046880507 shutdown_connections 2024-05-09T00:57:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 --2- 172.21.15.37:0/3046880507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa4110ba0 0x7f0fa4113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 --2- 172.21.15.37:0/3046880507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4075d30 0x7f0fa4076140 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 --2- 172.21.15.37:0/3046880507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa4076680 0x7f0fa4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 -- 172.21.15.37:0/3046880507 >> 172.21.15.37:0/3046880507 conn(0x7f0fa40fffe0 msgr2=0x7f0fa4102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:40.169 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:40 smithi037 ceph-mon[30122]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 -- 172.21.15.37:0/3046880507 shutdown_connections 2024-05-09T00:57:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.167+0000 7f0fab49e700 1 -- 172.21.15.37:0/3046880507 wait complete. 2024-05-09T00:57:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.168+0000 7f0fab49e700 1 Processor -- start 2024-05-09T00:57:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.168+0000 7f0fab49e700 1 -- start start 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fab49e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa4075d30 0x7f0fa419d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fab49e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4076680 0x7f0fa419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fab49e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa4110ba0 0x7f0fa41a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fab49e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa4116710 con 0x7f0fa4076680 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fab49e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa4116590 con 0x7f0fa4110ba0 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fab49e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa4116890 con 0x7f0fa4075d30 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4076680 0x7f0fa419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa923a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa4075d30 0x7f0fa419d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4076680 0x7f0fa419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42144/0 (socket says 172.21.15.37:42144) 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa923a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa4075d30 0x7f0fa419d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37336/0 (socket says 172.21.15.37:37336) 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 -- 172.21.15.37:0/4111755222 learned_addr learned my addr 172.21.15.37:0/4111755222 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa9a3b700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa4110ba0 0x7f0fa41a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 -- 172.21.15.37:0/4111755222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa4075d30 msgr2=0x7f0fa419d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa4075d30 0x7f0fa419d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 -- 172.21.15.37:0/4111755222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa4110ba0 msgr2=0x7f0fa41a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa4110ba0 0x7f0fa41a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa8a39700 1 -- 172.21.15.37:0/4111755222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa41a1f30 con 0x7f0fa4076680 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.169+0000 7f0fa9a3b700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa4110ba0 0x7f0fa41a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.170+0000 7f0fa8a39700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4076680 0x7f0fa419d600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800b530 tx=0x7f0f9800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.170+0000 7f0fa27fc700 1 -- 172.21.15.37:0/4111755222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98015020 con 0x7f0fa4076680 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.170+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa41a2220 con 0x7f0fa4076680 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.170+0000 7f0fa27fc700 1 -- 172.21.15.37:0/4111755222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f98011ce0 con 0x7f0fa4076680 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.170+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa41a9b40 con 0x7f0fa4076680 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.170+0000 7f0fa27fc700 1 -- 172.21.15.37:0/4111755222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98010e40 con 0x7f0fa4076680 2024-05-09T00:57:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.171+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa40512c0 con 0x7f0fa4076680 2024-05-09T00:57:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.173+0000 7f0fa27fc700 1 -- 172.21.15.37:0/4111755222 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0f98018020 con 0x7f0fa4076680 2024-05-09T00:57:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.173+0000 7f0fa27fc700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.174+0000 7f0fa923a700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.174+0000 7f0fa27fc700 1 -- 172.21.15.37:0/4111755222 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f0f980e1af0 con 0x7f0fa4076680 2024-05-09T00:57:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.174+0000 7f0fa923a700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009900 tx=0x7f0f9400b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.177+0000 7f0fa27fc700 1 -- 172.21.15.37:0/4111755222 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0f9801f020 con 0x7f0fa4076680 2024-05-09T00:57:40.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:40 smithi136 ceph-mon[34110]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.388+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0fa41a9d70 con 0x7f0fa4076680 2024-05-09T00:57:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.388+0000 7f0fa27fc700 1 -- 172.21.15.37:0/4111755222 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f0f980a9cb0 con 0x7f0fa4076680 2024-05-09T00:57:40.389 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f8c0b2900 msgr2=0x7f0f8c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009900 tx=0x7f0f9400b7b0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4076680 msgr2=0x7f0fa419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4076680 0x7f0fa419d600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800b530 tx=0x7f0f9800b840 comp rx=0 tx=0).stop 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 shutdown_connections 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f8c0b2900 0x7f0f8c0b4e10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0fa4110ba0 0x7f0fa41a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa4075d30 0x7f0fa419d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 --2- 172.21.15.37:0/4111755222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa4076680 0x7f0fa419d600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 >> 172.21.15.37:0/4111755222 conn(0x7f0fa40fffe0 msgr2=0x7f0fa4101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 shutdown_connections 2024-05-09T00:57:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:40.391+0000 7f0fab49e700 1 -- 172.21.15.37:0/4111755222 wait complete. 2024-05-09T00:57:40.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:40 smithi151 ceph-mon[34780]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:41.083 INFO:tasks.cephadm:Adding mds.a on smithi037 2024-05-09T00:57:41.083 INFO:tasks.cephadm:Adding mds.d on smithi037 2024-05-09T00:57:41.083 INFO:tasks.cephadm:Adding mds.g on smithi037 2024-05-09T00:57:41.083 INFO:tasks.cephadm:Adding mds.j on smithi037 2024-05-09T00:57:41.083 INFO:tasks.cephadm:Adding mds.b on smithi136 2024-05-09T00:57:41.083 INFO:tasks.cephadm:Adding mds.e on smithi136 2024-05-09T00:57:41.084 INFO:tasks.cephadm:Adding mds.h on smithi136 2024-05-09T00:57:41.084 INFO:tasks.cephadm:Adding mds.k on smithi136 2024-05-09T00:57:41.084 INFO:tasks.cephadm:Adding mds.c on smithi151 2024-05-09T00:57:41.084 INFO:tasks.cephadm:Adding mds.f on smithi151 2024-05-09T00:57:41.084 INFO:tasks.cephadm:Adding mds.i on smithi151 2024-05-09T00:57:41.084 INFO:tasks.cephadm:Adding mds.l on smithi151 2024-05-09T00:57:41.084 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l' 2024-05-09T00:57:41.332 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:57:41.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:41 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4111755222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:57:41.454 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:41 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4111755222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:57:41.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:41 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4111755222' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:57:42.343 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:42 smithi151 ceph-mon[34780]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:42.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:42 smithi136 ceph-mon[34110]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:42.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:42 smithi037 ceph-mon[30122]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:42.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 -- 172.21.15.151:0/225595744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1059b0 msgr2=0x7f59ec105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:42.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 --2- 172.21.15.151:0/225595744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1059b0 0x7f59ec105dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00b0a0 tx=0x7f59dc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:57:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 -- 172.21.15.151:0/225595744 shutdown_connections 2024-05-09T00:57:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 --2- 172.21.15.151:0/225595744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec1049e0 0x7f59ec10c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 --2- 172.21.15.151:0/225595744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1059b0 0x7f59ec105dc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 --2- 172.21.15.151:0/225595744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59ec103f60 0x7f59ec104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 -- 172.21.15.151:0/225595744 >> 172.21.15.151:0/225595744 conn(0x7f59ec0ff9d0 msgr2=0x7f59ec101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 -- 172.21.15.151:0/225595744 shutdown_connections 2024-05-09T00:57:42.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.843+0000 7f59f222d700 1 -- 172.21.15.151:0/225595744 wait complete. 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 Processor -- start 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 -- start start 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec103f60 0x7f59ec078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1049e0 0x7f59ec076c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59ec1059b0 0x7f59ec077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec10ff20 con 0x7f59ec103f60 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec10fda0 con 0x7f59ec1059b0 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59f222d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec1100a0 con 0x7f59ec1049e0 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59eaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1049e0 0x7f59ec076c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:42.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59eaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1049e0 0x7f59ec076c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46192/0 (socket says 172.21.15.151:46192) 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59eaffd700 1 -- 172.21.15.151:0/17349623 learned_addr learned my addr 172.21.15.151:0/17349623 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59eb7fe700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec103f60 0x7f59ec078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59ebfff700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59ec1059b0 0x7f59ec077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59eaffd700 1 -- 172.21.15.151:0/17349623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59ec1059b0 msgr2=0x7f59ec077160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.844+0000 7f59eaffd700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59ec1059b0 0x7f59ec077160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59eaffd700 1 -- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec103f60 msgr2=0x7f59ec078570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59eaffd700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec103f60 0x7f59ec078570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59eaffd700 1 -- 172.21.15.151:0/17349623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec077830 con 0x7f59ec1049e0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59eaffd700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1049e0 0x7f59ec076c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c9b0 tx=0x7f59d400ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59e8ff9700 1 -- 172.21.15.151:0/17349623 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4007b00 con 0x7f59ec1049e0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec1a4bf0 con 0x7f59ec1049e0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59e8ff9700 1 -- 172.21.15.151:0/17349623 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59d400ce50 con 0x7f59ec1049e0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59e8ff9700 1 -- 172.21.15.151:0/17349623 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4018660 con 0x7f59ec1049e0 2024-05-09T00:57:42.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.845+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec1a5040 con 0x7f59ec1049e0 2024-05-09T00:57:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.846+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec0512c0 con 0x7f59ec1049e0 2024-05-09T00:57:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.847+0000 7f59e8ff9700 1 -- 172.21.15.151:0/17349623 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f59d400f450 con 0x7f59ec1049e0 2024-05-09T00:57:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.848+0000 7f59e8ff9700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59d80b2880 0x7f59d80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.848+0000 7f59e8ff9700 1 -- 172.21.15.151:0/17349623 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f59d40e1f50 con 0x7f59ec1049e0 2024-05-09T00:57:42.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.848+0000 7f59eb7fe700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59d80b2880 0x7f59d80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:42.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.849+0000 7f59eb7fe700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59d80b2880 0x7f59d80b4d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009fd0 tx=0x7f59dc00b7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:42.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:42.852+0000 7f59e8ff9700 1 -- 172.21.15.151:0/17349623 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f59d4014030 con 0x7f59ec1049e0 2024-05-09T00:57:43.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.068+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}) -- 0x7f59ec063e00 con 0x7f59d80b2880 2024-05-09T00:57:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.077+0000 7f59e8ff9700 1 -- 172.21.15.151:0/17349623 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f59ec063e00 con 0x7f59d80b2880 2024-05-09T00:57:43.078 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mds.all update... 2024-05-09T00:57:43.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59d80b2880 msgr2=0x7f59d80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:43.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59d80b2880 0x7f59d80b4d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009fd0 tx=0x7f59dc00b7f0 comp rx=0 tx=0).stop 2024-05-09T00:57:43.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1049e0 msgr2=0x7f59ec076c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:43.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1049e0 0x7f59ec076c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c9b0 tx=0x7f59d400ccc0 comp rx=0 tx=0).stop 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 shutdown_connections 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59d80b2880 0x7f59d80b4d90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59ec1059b0 0x7f59ec077160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59ec103f60 0x7f59ec078570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 --2- 172.21.15.151:0/17349623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59ec1049e0 0x7f59ec076c20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 >> 172.21.15.151:0/17349623 conn(0x7f59ec0ff9d0 msgr2=0x7f59ec1086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 shutdown_connections 2024-05-09T00:57:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-09T00:57:43.079+0000 7f59f222d700 1 -- 172.21.15.151:0/17349623 wait complete. 2024-05-09T00:57:43.742 DEBUG:teuthology.orchestra.run.smithi037:mds.a> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.a.service 2024-05-09T00:57:43.746 DEBUG:teuthology.orchestra.run.smithi037:mds.d> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.d.service 2024-05-09T00:57:43.789 DEBUG:teuthology.orchestra.run.smithi037:mds.g> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.g.service 2024-05-09T00:57:43.834 DEBUG:teuthology.orchestra.run.smithi037:mds.j> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.j.service 2024-05-09T00:57:43.876 DEBUG:teuthology.orchestra.run.smithi136:mds.b> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.b.service 2024-05-09T00:57:43.879 DEBUG:teuthology.orchestra.run.smithi136:mds.e> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.e.service 2024-05-09T00:57:43.921 DEBUG:teuthology.orchestra.run.smithi136:mds.h> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.h.service 2024-05-09T00:57:43.964 DEBUG:teuthology.orchestra.run.smithi136:mds.k> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.k.service 2024-05-09T00:57:44.007 DEBUG:teuthology.orchestra.run.smithi151:mds.c> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.c.service 2024-05-09T00:57:44.009 DEBUG:teuthology.orchestra.run.smithi151:mds.f> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.f.service 2024-05-09T00:57:44.052 DEBUG:teuthology.orchestra.run.smithi151:mds.i> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.i.service 2024-05-09T00:57:44.095 DEBUG:teuthology.orchestra.run.smithi151:mds.l> sudo journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.l.service 2024-05-09T00:57:44.137 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-09T00:57:44.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:44.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:57:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:57:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-09T00:57:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:57:44.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:44.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:44.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:44.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:45.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:45 smithi151 ceph-mon[34780]: Deploying daemon mds.l on smithi151 2024-05-09T00:57:45.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:45 smithi136 ceph-mon[34110]: Deploying daemon mds.l on smithi151 2024-05-09T00:57:45.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:45 smithi037 ceph-mon[30122]: Deploying daemon mds.l on smithi151 2024-05-09T00:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2353656798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 msgr2=0x7f6dd0108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2353656798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd0108220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40099c0 tx=0x7f6dc4009cd0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2353656798 shutdown_connections 2024-05-09T00:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2353656798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dd0108760 0x7f6dd01100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2353656798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd01034e0 0x7f6dd01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2353656798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd0108220 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2353656798 >> 172.21.15.37:0/2353656798 conn(0x7f6dd00fef30 msgr2=0x7f6dd0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2353656798 shutdown_connections 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.065+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2353656798 wait complete. 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 Processor -- start 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 -- start start 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dd01034e0 0x7f6dd019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd0108760 0x7f6dd019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113390 con 0x7f6dd0107e10 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113210 con 0x7f6dd01034e0 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dd5e8b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113510 con 0x7f6dd0108760 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd019c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34830/0 (socket says 172.21.15.37:34830) 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dceffd700 1 -- 172.21.15.37:0/2505896423 learned_addr learned my addr 172.21.15.37:0/2505896423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:57:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dcffff700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd0108760 0x7f6dd019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.066+0000 7f6dcf7fe700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dd01034e0 0x7f6dd019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dceffd700 1 -- 172.21.15.37:0/2505896423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd0108760 msgr2=0x7f6dd019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dceffd700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd0108760 0x7f6dd019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dceffd700 1 -- 172.21.15.37:0/2505896423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dd01034e0 msgr2=0x7f6dd019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dceffd700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dd01034e0 0x7f6dd019bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dceffd700 1 -- 172.21.15.37:0/2505896423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd01a7100 con 0x7f6dd0107e10 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dceffd700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd019c2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40045e0 tx=0x7f6dc4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dccff9700 1 -- 172.21.15.37:0/2505896423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4026070 con 0x7f6dd0107e10 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dccff9700 1 -- 172.21.15.37:0/2505896423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc400f460 con 0x7f6dd0107e10 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd01a7390 con 0x7f6dd0107e10 2024-05-09T00:57:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dccff9700 1 -- 172.21.15.37:0/2505896423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4009e60 con 0x7f6dd0107e10 2024-05-09T00:57:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.067+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd01a7840 con 0x7f6dd0107e10 2024-05-09T00:57:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.068+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd00512c0 con 0x7f6dd0107e10 2024-05-09T00:57:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.071+0000 7f6dccff9700 1 -- 172.21.15.37:0/2505896423 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6dc4029070 con 0x7f6dd0107e10 2024-05-09T00:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.071+0000 7f6dccff9700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6db80b2900 0x7f6db80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.071+0000 7f6dcf7fe700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6db80b2900 0x7f6db80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.071+0000 7f6dccff9700 1 -- 172.21.15.37:0/2505896423 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f6dc40e2970 con 0x7f6dd0107e10 2024-05-09T00:57:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.072+0000 7f6dcf7fe700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6db80b2900 0x7f6db80b4e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009bf0 tx=0x7f6dc0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.075+0000 7f6dccff9700 1 -- 172.21.15.37:0/2505896423 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6dc4030080 con 0x7f6dd0107e10 2024-05-09T00:57:46.084 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:46 smithi151 ceph-mon[34780]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.334+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6dd002e5f0 con 0x7f6dd0107e10 2024-05-09T00:57:46.335 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:46 smithi037 ceph-mon[30122]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.335+0000 7f6dccff9700 1 -- 172.21.15.37:0/2505896423 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f6dc4013070 con 0x7f6dd0107e10 2024-05-09T00:57:46.336 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:57:46.336 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-09T00:57:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6db80b2900 msgr2=0x7f6db80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6db80b2900 0x7f6db80b4e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009bf0 tx=0x7f6dc0009260 comp rx=0 tx=0).stop 2024-05-09T00:57:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 msgr2=0x7f6dd019c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd019c2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40045e0 tx=0x7f6dc4004610 comp rx=0 tx=0).stop 2024-05-09T00:57:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 shutdown_connections 2024-05-09T00:57:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6db80b2900 0x7f6db80b4e10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd0108760 0x7f6dd019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dd01034e0 0x7f6dd019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 --2- 172.21.15.37:0/2505896423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd0107e10 0x7f6dd019c2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 >> 172.21.15.37:0/2505896423 conn(0x7f6dd00fef30 msgr2=0x7f6dd01096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 shutdown_connections 2024-05-09T00:57:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:46.337+0000 7f6dd5e8b700 1 -- 172.21.15.37:0/2505896423 wait complete. 2024-05-09T00:57:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 1 2024-05-09T00:57:46.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:46 smithi136 ceph-mon[34110]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:46.724 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 00:57:46 smithi151 systemd[1]: Started Ceph mds.l for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:57:47.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2505896423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6832/1277029223,v1:172.21.15.151:6833/1277029223] up:boot 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: fsmap 1 up:standby 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:47.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2505896423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6832/1277029223,v1:172.21.15.151:6833/1277029223] up:boot 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: fsmap 1 up:standby 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2505896423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6832/1277029223,v1:172.21.15.151:6833/1277029223] up:boot 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: fsmap 1 up:standby 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:47.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:48.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:48 smithi136 ceph-mon[34110]: Deploying daemon mds.k on smithi136 2024-05-09T00:57:48.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:48 smithi136 ceph-mon[34110]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:48.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:48 smithi037 ceph-mon[30122]: Deploying daemon mds.k on smithi136 2024-05-09T00:57:48.431 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:48 smithi037 ceph-mon[30122]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:48.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:48 smithi151 ceph-mon[34780]: Deploying daemon mds.k on smithi136 2024-05-09T00:57:48.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:48 smithi151 ceph-mon[34780]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:48.878 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:48 smithi136 systemd[1]: Starting Ceph mds.k for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:57:49.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:57:49.172 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:48 smithi136 podman[63613]: 2024-05-09 00:57:48.794661487 +0000 UTC m=+0.018291541 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:57:49.172 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:48 smithi136 podman[63613]: 2024-05-09 00:57:48.916735104 +0000 UTC m=+0.140365200 container create 2617c853fb144b86fb3115964ddeb8ae74f22e615ac429eb922109dad5f2d55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0) 2024-05-09T00:57:49.172 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:49 smithi136 podman[63613]: 2024-05-09 00:57:49.135679984 +0000 UTC m=+0.359310038 container init 2617c853fb144b86fb3115964ddeb8ae74f22e615ac429eb922109dad5f2d55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-09T00:57:49.172 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:49 smithi136 podman[63613]: 2024-05-09 00:57:49.138340085 +0000 UTC m=+0.361970140 container start 2617c853fb144b86fb3115964ddeb8ae74f22e615ac429eb922109dad5f2d55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T00:57:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:57:49.627 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:49 smithi136 ceph-mds[63632]: -- 172.21.15.136:0/590801379 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5637f522ba40 con 0x5637f5273180 2024-05-09T00:57:49.628 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:49 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k[63628]: starting mds.k at 2024-05-09T00:57:49.628 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:49 smithi136 bash[63613]: 2617c853fb144b86fb3115964ddeb8ae74f22e615ac429eb922109dad5f2d55d 2024-05-09T00:57:49.628 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 00:57:49 smithi136 systemd[1]: Started Ceph mds.k for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:57:50.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:50.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: Deploying daemon mds.j on smithi037 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6832/3863179212,v1:172.21.15.136:6833/3863179212] up:boot 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: fsmap 2 up:standby 2024-05-09T00:57:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:57:50.526 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: Deploying daemon mds.j on smithi037 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6832/3863179212,v1:172.21.15.136:6833/3863179212] up:boot 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: fsmap 2 up:standby 2024-05-09T00:57:50.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:57:50.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: Deploying daemon mds.j on smithi037 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6832/3863179212,v1:172.21.15.136:6833/3863179212] up:boot 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: fsmap 2 up:standby 2024-05-09T00:57:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 -- 172.21.15.37:0/2872398950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4108740 msgr2=0x7fe2d41100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 --2- 172.21.15.37:0/2872398950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4108740 0x7fe2d41100a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009fc0 tx=0x7fe2cc00b330 comp rx=0 tx=0).stop 2024-05-09T00:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 -- 172.21.15.37:0/2872398950 shutdown_connections 2024-05-09T00:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 --2- 172.21.15.37:0/2872398950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4108740 0x7fe2d41100a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 --2- 172.21.15.37:0/2872398950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2d41034c0 0x7fe2d41038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 --2- 172.21.15.37:0/2872398950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2d4107df0 0x7fe2d4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 -- 172.21.15.37:0/2872398950 >> 172.21.15.37:0/2872398950 conn(0x7fe2d40fedf0 msgr2=0x7fe2d4101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 -- 172.21.15.37:0/2872398950 shutdown_connections 2024-05-09T00:57:51.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.154+0000 7fe2da503700 1 -- 172.21.15.37:0/2872398950 wait complete. 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.155+0000 7fe2da503700 1 Processor -- start 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.155+0000 7fe2da503700 1 -- start start 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.155+0000 7fe2da503700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2d41034c0 0x7fe2d419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.155+0000 7fe2da503700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4107df0 0x7fe2d419c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2da503700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2d4108740 0x7fe2d419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2da503700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4113370 con 0x7fe2d4107df0 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2da503700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41131f0 con 0x7fe2d41034c0 2024-05-09T00:57:51.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2da503700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41134f0 con 0x7fe2d4108740 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4107df0 0x7fe2d419c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4107df0 0x7fe2d419c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34860/0 (socket says 172.21.15.37:34860) 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 -- 172.21.15.37:0/3909728424 learned_addr learned my addr 172.21.15.37:0/3909728424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d3fff700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2d41034c0 0x7fe2d419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d8aa0700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2d4108740 0x7fe2d419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 -- 172.21.15.37:0/3909728424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2d4108740 msgr2=0x7fe2d419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2d4108740 0x7fe2d419c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 -- 172.21.15.37:0/3909728424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2d41034c0 msgr2=0x7fe2d419bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2d41034c0 0x7fe2d419bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 -- 172.21.15.37:0/3909728424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d41a6f60 con 0x7fe2d4107df0 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d3fff700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2d41034c0 0x7fe2d419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d37fe700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4107df0 0x7fe2d419c150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800e970 tx=0x7fe2c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:51.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d17fa700 1 -- 172.21.15.37:0/3909728424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8004a30 con 0x7fe2d4107df0 2024-05-09T00:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d41a7250 con 0x7fe2d4107df0 2024-05-09T00:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d17fa700 1 -- 172.21.15.37:0/3909728424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2c800cc90 con 0x7fe2d4107df0 2024-05-09T00:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.156+0000 7fe2d17fa700 1 -- 172.21.15.37:0/3909728424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8005610 con 0x7fe2d4107df0 2024-05-09T00:57:51.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.157+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d41a7790 con 0x7fe2d4107df0 2024-05-09T00:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.158+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d40512c0 con 0x7fe2d4107df0 2024-05-09T00:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.159+0000 7fe2d17fa700 1 -- 172.21.15.37:0/3909728424 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe2c800c7e0 con 0x7fe2d4107df0 2024-05-09T00:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.160+0000 7fe2d17fa700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2bc0b2880 0x7fe2bc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.160+0000 7fe2d3fff700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2bc0b2880 0x7fe2bc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.160+0000 7fe2d17fa700 1 -- 172.21.15.37:0/3909728424 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fe2c80e1f30 con 0x7fe2d4107df0 2024-05-09T00:57:51.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.160+0000 7fe2d3fff700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2bc0b2880 0x7fe2bc0b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009750 tx=0x7fe2c4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.165+0000 7fe2d17fa700 1 -- 172.21.15.37:0/3909728424 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2c80aa050 con 0x7fe2d4107df0 2024-05-09T00:57:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.429+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2d4075fe0 con 0x7fe2d4107df0 2024-05-09T00:57:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.429+0000 7fe2d17fa700 1 -- 172.21.15.37:0/3909728424 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7fe2c80a9950 con 0x7fe2d4107df0 2024-05-09T00:57:51.430 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:57:51.431 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2bc0b2880 msgr2=0x7fe2bc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2bc0b2880 0x7fe2bc0b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009750 tx=0x7fe2c4009310 comp rx=0 tx=0).stop 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4107df0 msgr2=0x7fe2d419c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4107df0 0x7fe2d419c150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800e970 tx=0x7fe2c800ec80 comp rx=0 tx=0).stop 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 shutdown_connections 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2bc0b2880 0x7fe2bc0b4d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2d4108740 0x7fe2d419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2d41034c0 0x7fe2d419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 --2- 172.21.15.37:0/3909728424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d4107df0 0x7fe2d419c150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 >> 172.21.15.37:0/3909728424 conn(0x7fe2d40fedf0 msgr2=0x7fe2d4107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:51.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 shutdown_connections 2024-05-09T00:57:51.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:51.432+0000 7fe2da503700 1 -- 172.21.15.37:0/3909728424 wait complete. 2024-05-09T00:57:51.434 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2024-05-09T00:57:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:52 smithi136 ceph-mon[34110]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:52 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3909728424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:52.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:52 smithi037 ceph-mon[30122]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:52.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:52 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3909728424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:52.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:52 smithi151 ceph-mon[34780]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:52.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:52 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3909728424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:53.474 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 systemd[1]: Starting Ceph mds.j for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:57:53.814 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 podman[68421]: 2024-05-09 00:57:53.464725683 +0000 UTC m=+0.018464893 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:57:53.814 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 podman[68421]: 2024-05-09 00:57:53.573880238 +0000 UTC m=+0.127619494 container create 68d994b4b6f84dc8dd3b6523550a9aaac1a9750d4ce8ff2952362fd91b3eaeb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5) 2024-05-09T00:57:53.814 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 podman[68421]: 2024-05-09 00:57:53.776110051 +0000 UTC m=+0.329849268 container init 68d994b4b6f84dc8dd3b6523550a9aaac1a9750d4ce8ff2952362fd91b3eaeb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T00:57:53.814 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 podman[68421]: 2024-05-09 00:57:53.779032018 +0000 UTC m=+0.332771227 container start 68d994b4b6f84dc8dd3b6523550a9aaac1a9750d4ce8ff2952362fd91b3eaeb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-09T00:57:53.814 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 ceph-mds[68440]: -- 172.21.15.37:0/3986623163 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55855407ba40 con 0x5585540c3180 2024-05-09T00:57:54.224 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j[68436]: starting mds.j at 2024-05-09T00:57:54.224 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 bash[68421]: 68d994b4b6f84dc8dd3b6523550a9aaac1a9750d4ce8ff2952362fd91b3eaeb7 2024-05-09T00:57:54.224 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 00:57:53 smithi037 systemd[1]: Started Ceph mds.j for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:57:54.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:57:54.627 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:54 smithi037 ceph-mon[30122]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:54.627 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.628 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.628 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.628 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:54.628 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:54.628 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:54 smithi136 ceph-mon[34110]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:54.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:54.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:54.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:54 smithi151 ceph-mon[34780]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:55.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:55 smithi037 ceph-mon[30122]: Deploying daemon mds.d on smithi037 2024-05-09T00:57:55.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:55 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.37:6834/2528930406,v1:172.21.15.37:6835/2528930406] up:boot 2024-05-09T00:57:55.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:55 smithi037 ceph-mon[30122]: fsmap 3 up:standby 2024-05-09T00:57:55.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:57:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:55 smithi136 ceph-mon[34110]: Deploying daemon mds.d on smithi037 2024-05-09T00:57:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:55 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.37:6834/2528930406,v1:172.21.15.37:6835/2528930406] up:boot 2024-05-09T00:57:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:55 smithi136 ceph-mon[34110]: fsmap 3 up:standby 2024-05-09T00:57:55.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:57:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:57:55.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:55 smithi151 ceph-mon[34780]: Deploying daemon mds.d on smithi037 2024-05-09T00:57:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:55 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.37:6834/2528930406,v1:172.21.15.37:6835/2528930406] up:boot 2024-05-09T00:57:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:55 smithi151 ceph-mon[34780]: fsmap 3 up:standby 2024-05-09T00:57:55.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:57:56.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:56 smithi037 ceph-mon[30122]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:56 smithi136 ceph-mon[34110]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:56.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:56 smithi151 ceph-mon[34780]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:57.474 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 00:57:57 smithi037 podman[68846]: 2024-05-09 00:57:57.385777884 +0000 UTC m=+0.140351849 container create 5ceb014e1213b670cdee1f2802e005925545d652b3af203ee92efb891c195be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS) 2024-05-09T00:57:57.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.727+0000 7fda27bfe700 1 -- 172.21.15.37:0/2735676472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda201034c0 msgr2=0x7fda201038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.727+0000 7fda27bfe700 1 --2- 172.21.15.37:0/2735676472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda201034c0 0x7fda201038d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00b0d0 tx=0x7fda1c00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.727+0000 7fda27bfe700 1 -- 172.21.15.37:0/2735676472 shutdown_connections 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.727+0000 7fda27bfe700 1 --2- 172.21.15.37:0/2735676472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda20108740 0x7fda201100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.728+0000 7fda27bfe700 1 --2- 172.21.15.37:0/2735676472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda201034c0 0x7fda201038d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.728+0000 7fda27bfe700 1 --2- 172.21.15.37:0/2735676472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda20107df0 0x7fda20108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.728+0000 7fda27bfe700 1 -- 172.21.15.37:0/2735676472 >> 172.21.15.37:0/2735676472 conn(0x7fda200fedc0 msgr2=0x7fda201011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.728+0000 7fda27bfe700 1 -- 172.21.15.37:0/2735676472 shutdown_connections 2024-05-09T00:57:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.728+0000 7fda27bfe700 1 -- 172.21.15.37:0/2735676472 wait complete. 2024-05-09T00:57:57.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.728+0000 7fda27bfe700 1 Processor -- start 2024-05-09T00:57:57.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.728+0000 7fda27bfe700 1 -- start start 2024-05-09T00:57:57.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda27bfe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda201034c0 0x7fda2019ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:57.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda27bfe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda20107df0 0x7fda2019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:57.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda27bfe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda20108740 0x7fda2019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda27bfe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda201133c0 con 0x7fda20108740 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda27bfe700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fda20113240 con 0x7fda20107df0 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda27bfe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fda20113540 con 0x7fda201034c0 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda20108740 0x7fda2019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda20108740 0x7fda2019f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55502/0 (socket says 172.21.15.37:55502) 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 -- 172.21.15.37:0/52635924 learned_addr learned my addr 172.21.15.37:0/52635924 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2599a700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda201034c0 0x7fda2019ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda25199700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda20107df0 0x7fda2019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 -- 172.21.15.37:0/52635924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda201034c0 msgr2=0x7fda2019ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda201034c0 0x7fda2019ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 -- 172.21.15.37:0/52635924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda20107df0 msgr2=0x7fda2019b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda20107df0 0x7fda2019b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 -- 172.21.15.37:0/52635924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2019fc40 con 0x7fda20108740 2024-05-09T00:57:57.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda25199700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda20107df0 0x7fda2019b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:57:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.729+0000 7fda2619b700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda20108740 0x7fda2019f650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c900 tx=0x7fda1800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.730+0000 7fda16ffd700 1 -- 172.21.15.37:0/52635924 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18007b00 con 0x7fda20108740 2024-05-09T00:57:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.730+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2019ff30 con 0x7fda20108740 2024-05-09T00:57:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.730+0000 7fda16ffd700 1 -- 172.21.15.37:0/52635924 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda1800ce50 con 0x7fda20108740 2024-05-09T00:57:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.730+0000 7fda16ffd700 1 -- 172.21.15.37:0/52635924 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18018660 con 0x7fda20108740 2024-05-09T00:57:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.730+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda201a0470 con 0x7fda20108740 2024-05-09T00:57:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.731+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda200512c0 con 0x7fda20108740 2024-05-09T00:57:57.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.732+0000 7fda16ffd700 1 -- 172.21.15.37:0/52635924 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fda1800f450 con 0x7fda20108740 2024-05-09T00:57:57.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.733+0000 7fda16ffd700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda0c0b2880 0x7fda0c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:57:57.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.733+0000 7fda2599a700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda0c0b2880 0x7fda0c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:57:57.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.733+0000 7fda16ffd700 1 -- 172.21.15.37:0/52635924 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fda180e1c70 con 0x7fda20108740 2024-05-09T00:57:57.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.734+0000 7fda2599a700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda0c0b2880 0x7fda0c0b4d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009900 tx=0x7fda1c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:57:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:57.737+0000 7fda16ffd700 1 -- 172.21.15.37:0/52635924 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fda18014030 con 0x7fda20108740 2024-05-09T00:57:58.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.002+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda2002e5f0 con 0x7fda20108740 2024-05-09T00:57:58.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.003+0000 7fda16ffd700 1 -- 172.21.15.37:0/52635924 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7fda180a9ec0 con 0x7fda20108740 2024-05-09T00:57:58.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:57:58.004 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-09T00:57:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda0c0b2880 msgr2=0x7fda0c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda0c0b2880 0x7fda0c0b4d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda1c009900 tx=0x7fda1c00b040 comp rx=0 tx=0).stop 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda20108740 msgr2=0x7fda2019f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda20108740 0x7fda2019f650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c900 tx=0x7fda1800cc10 comp rx=0 tx=0).stop 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 shutdown_connections 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fda0c0b2880 0x7fda0c0b4d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda20108740 0x7fda2019f650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda201034c0 0x7fda2019ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 --2- 172.21.15.37:0/52635924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda20107df0 0x7fda2019b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.005+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 >> 172.21.15.37:0/52635924 conn(0x7fda200fedc0 msgr2=0x7fda2006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.006+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 shutdown_connections 2024-05-09T00:57:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:57:58.006+0000 7fda27bfe700 1 -- 172.21.15.37:0/52635924 wait complete. 2024-05-09T00:57:58.008 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 4 2024-05-09T00:57:58.224 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 00:57:57 smithi037 podman[68846]: 2024-05-09 00:57:57.855751502 +0000 UTC m=+0.610325466 container init 5ceb014e1213b670cdee1f2802e005925545d652b3af203ee92efb891c195be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T00:57:58.224 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 00:57:57 smithi037 podman[68846]: 2024-05-09 00:57:57.859087539 +0000 UTC m=+0.613661504 container start 5ceb014e1213b670cdee1f2802e005925545d652b3af203ee92efb891c195be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-09T00:57:58.224 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 00:57:57 smithi037 ceph-mds[68891]: -- 172.21.15.37:0/2159155308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c528d9a40 con 0x556c52921180 2024-05-09T00:57:58.225 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 00:57:57 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d[68865]: starting mds.d at 2024-05-09T00:57:58.225 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 00:57:57 smithi037 bash[68846]: 5ceb014e1213b670cdee1f2802e005925545d652b3af203ee92efb891c195be4 2024-05-09T00:57:58.225 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 00:57:57 smithi037 systemd[1]: Started Ceph mds.d for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/52635924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:58.543 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/52635924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:58.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:58.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/52635924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:57:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:57:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:59 smithi136 ceph-mon[34110]: Deploying daemon mds.e on smithi136 2024-05-09T00:57:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:59 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.37:6836/1940552634,v1:172.21.15.37:6837/1940552634] up:boot 2024-05-09T00:57:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:59 smithi136 ceph-mon[34110]: fsmap 4 up:standby 2024-05-09T00:57:59.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:57:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:57:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:59 smithi037 ceph-mon[30122]: Deploying daemon mds.e on smithi136 2024-05-09T00:57:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:59 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.37:6836/1940552634,v1:172.21.15.37:6837/1940552634] up:boot 2024-05-09T00:57:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:59 smithi037 ceph-mon[30122]: fsmap 4 up:standby 2024-05-09T00:57:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:57:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:57:59.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:59 smithi151 ceph-mon[34780]: Deploying daemon mds.e on smithi136 2024-05-09T00:57:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:59 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.37:6836/1940552634,v1:172.21.15.37:6837/1940552634] up:boot 2024-05-09T00:57:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:59 smithi151 ceph-mon[34780]: fsmap 4 up:standby 2024-05-09T00:57:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:57:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:58:00.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:00 smithi136 ceph-mon[34110]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:00.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:58:00.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:00 smithi037 ceph-mon[30122]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:00 smithi151 ceph-mon[34780]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:00.759 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 00:58:00 smithi136 ceph-mds[63958]: -- 172.21.15.136:0/199074081 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556699bc7a40 con 0x556699c0fa80 2024-05-09T00:58:00.759 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 00:58:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e[63954]: starting mds.e at 2024-05-09T00:58:00.802 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:01.128 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 00:58:00 smithi136 bash[63939]: 7db6c509525b6ab3bc1a6d6bdffcb5f14161a42bc63b7326240c9f3ce4cb7fbf 2024-05-09T00:58:01.128 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 00:58:00 smithi136 systemd[1]: Started Ceph mds.e for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:02.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:02.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: Deploying daemon mds.f on smithi151 2024-05-09T00:58:02.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] up:boot 2024-05-09T00:58:02.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: fsmap 5 up:standby 2024-05-09T00:58:02.129 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:58:02.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:02.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.182 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:02.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:02.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:02.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: Deploying daemon mds.f on smithi151 2024-05-09T00:58:02.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] up:boot 2024-05-09T00:58:02.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: fsmap 5 up:standby 2024-05-09T00:58:02.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: Deploying daemon mds.f on smithi151 2024-05-09T00:58:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] up:boot 2024-05-09T00:58:02.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: fsmap 5 up:standby 2024-05-09T00:58:02.226 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:58:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 -- 172.21.15.37:0/3020870310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c109850 msgr2=0x7fe95c1111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 --2- 172.21.15.37:0/3020870310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c109850 0x7fe95c1111b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe9540099c0 tx=0x7fe954009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 -- 172.21.15.37:0/3020870310 shutdown_connections 2024-05-09T00:58:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 --2- 172.21.15.37:0/3020870310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c109850 0x7fe95c1111b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 --2- 172.21.15.37:0/3020870310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe95c1045d0 0x7fe95c1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 --2- 172.21.15.37:0/3020870310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe95c108f00 0x7fe95c109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 -- 172.21.15.37:0/3020870310 >> 172.21.15.37:0/3020870310 conn(0x7fe95c0ffea0 msgr2=0x7fe95c1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 -- 172.21.15.37:0/3020870310 shutdown_connections 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.534+0000 7fe9613a5700 1 -- 172.21.15.37:0/3020870310 wait complete. 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.535+0000 7fe9613a5700 1 Processor -- start 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.535+0000 7fe9613a5700 1 -- start start 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.535+0000 7fe9613a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe95c1045d0 0x7fe95c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.535+0000 7fe9613a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c108f00 0x7fe95c19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.535+0000 7fe9613a5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe95c109850 0x7fe95c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9613a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c114480 con 0x7fe95c108f00 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9613a5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c114300 con 0x7fe95c1045d0 2024-05-09T00:58:02.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9613a5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c114600 con 0x7fe95c109850 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c108f00 0x7fe95c19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c108f00 0x7fe95c19b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54418/0 (socket says 172.21.15.37:54418) 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 -- 172.21.15.37:0/1353223814 learned_addr learned my addr 172.21.15.37:0/1353223814 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe95affd700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe95c1045d0 0x7fe95c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe95b7fe700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe95c109850 0x7fe95c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 -- 172.21.15.37:0/1353223814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe95c109850 msgr2=0x7fe95c19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe95c109850 0x7fe95c19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 -- 172.21.15.37:0/1353223814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe95c1045d0 msgr2=0x7fe95c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe95c1045d0 0x7fe95c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 -- 172.21.15.37:0/1353223814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c19fcc0 con 0x7fe95c108f00 2024-05-09T00:58:02.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9527fc700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c108f00 0x7fe95c19b390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe94400d980 tx=0x7fe94400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe958ff9700 1 -- 172.21.15.37:0/1353223814 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944017070 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c19ffb0 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe958ff9700 1 -- 172.21.15.37:0/1353223814 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe94400fd40 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe958ff9700 1 -- 172.21.15.37:0/1353223814 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94400e3b0 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.536+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c1a78d0 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.538+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95c0512c0 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.539+0000 7fe958ff9700 1 -- 172.21.15.37:0/1353223814 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe944010610 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.540+0000 7fe958ff9700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe9480b2880 0x7fe9480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.540+0000 7fe95affd700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe9480b2880 0x7fe9480b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.540+0000 7fe958ff9700 1 -- 172.21.15.37:0/1353223814 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fe9440e1730 con 0x7fe95c108f00 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.541+0000 7fe95affd700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe9480b2880 0x7fe9480b4d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00f540 tx=0x7fe94c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:02.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.544+0000 7fe958ff9700 1 -- 172.21.15.37:0/1353223814 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe9440a98f0 con 0x7fe95c108f00 2024-05-09T00:58:02.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.806+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe95c02e5f0 con 0x7fe95c108f00 2024-05-09T00:58:02.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.806+0000 7fe958ff9700 1 -- 172.21.15.37:0/1353223814 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7fe9440a91f0 con 0x7fe95c108f00 2024-05-09T00:58:02.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-09T00:58:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe9480b2880 msgr2=0x7fe9480b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe9480b2880 0x7fe9480b4d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00f540 tx=0x7fe94c00b040 comp rx=0 tx=0).stop 2024-05-09T00:58:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c108f00 msgr2=0x7fe95c19b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c108f00 0x7fe95c19b390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe94400d980 tx=0x7fe94400dc90 comp rx=0 tx=0).stop 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 shutdown_connections 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe9480b2880 0x7fe9480b4d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe95c109850 0x7fe95c19f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe95c1045d0 0x7fe95c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 --2- 172.21.15.37:0/1353223814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c108f00 0x7fe95c19b390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.809+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 >> 172.21.15.37:0/1353223814 conn(0x7fe95c0ffea0 msgr2=0x7fe95c108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.810+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 shutdown_connections 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:02.810+0000 7fe9613a5700 1 -- 172.21.15.37:0/1353223814 wait complete. 2024-05-09T00:58:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2024-05-09T00:58:03.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:02 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1353223814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:03.154 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:02 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1353223814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:03.154 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:02 smithi151 systemd[1]: Starting Ceph mds.f for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:58:03.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:02 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1353223814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:03.456 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 podman[65488]: 2024-05-09 00:58:03.153724636 +0000 UTC m=+0.114518630 container create 2544b0495f1a84b259aa9a6bcd340f35c7a99a643cf407440552f951315d8c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-09T00:58:03.456 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 podman[65488]: 2024-05-09 00:58:03.057501853 +0000 UTC m=+0.018295826 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:58:03.456 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 podman[65488]: 2024-05-09 00:58:03.35584753 +0000 UTC m=+0.316641482 container init 2544b0495f1a84b259aa9a6bcd340f35c7a99a643cf407440552f951315d8c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-09T00:58:03.456 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 podman[65488]: 2024-05-09 00:58:03.359543274 +0000 UTC m=+0.320337227 container start 2544b0495f1a84b259aa9a6bcd340f35c7a99a643cf407440552f951315d8c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T00:58:03.456 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mds[65508]: -- 172.21.15.151:0/2913577443 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56206e0b1a40 con 0x56206e0f9180 2024-05-09T00:58:03.456 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f[65503]: starting mds.f at 2024-05-09T00:58:03.456 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 bash[65488]: 2544b0495f1a84b259aa9a6bcd340f35c7a99a643cf407440552f951315d8c11 2024-05-09T00:58:03.724 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 00:58:03 smithi151 systemd[1]: Started Ceph mds.f for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:04.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:03 smithi136 ceph-mon[34110]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:04.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:04.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:04.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:04.209 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mon[34780]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:04.209 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.209 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.209 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.209 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:04.209 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:04.209 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:04.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:03 smithi037 ceph-mon[30122]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:04.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:04.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:04.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:04.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:05.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:04 smithi136 ceph-mon[34110]: Deploying daemon mds.c on smithi151 2024-05-09T00:58:05.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:04 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6834/1211505643,v1:172.21.15.151:6835/1211505643] up:boot 2024-05-09T00:58:05.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:04 smithi136 ceph-mon[34110]: fsmap 6 up:standby 2024-05-09T00:58:05.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:58:05.179 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:04 smithi151 ceph-mon[34780]: Deploying daemon mds.c on smithi151 2024-05-09T00:58:05.179 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:04 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6834/1211505643,v1:172.21.15.151:6835/1211505643] up:boot 2024-05-09T00:58:05.180 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:04 smithi151 ceph-mon[34780]: fsmap 6 up:standby 2024-05-09T00:58:05.180 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:58:05.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:04 smithi037 ceph-mon[30122]: Deploying daemon mds.c on smithi151 2024-05-09T00:58:05.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:04 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6834/1211505643,v1:172.21.15.151:6835/1211505643] up:boot 2024-05-09T00:58:05.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:04 smithi037 ceph-mon[30122]: fsmap 6 up:standby 2024-05-09T00:58:05.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:58:05.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:58:05.725 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:05 smithi151 systemd[1]: Starting Ceph mds.c for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:58:05.753 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:06.126 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:05 smithi037 ceph-mon[30122]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:06.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:05 smithi136 ceph-mon[34110]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:06.176 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:05 smithi151 ceph-mon[34780]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:06.176 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:05 smithi151 podman[65806]: 2024-05-09 00:58:05.77982142 +0000 UTC m=+0.018079735 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:58:06.176 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:05 smithi151 podman[65806]: 2024-05-09 00:58:05.89074428 +0000 UTC m=+0.129002565 container create 119ac92182b3fa20c821d0af178832d841bd4975a7214ed0637889cf19aa5f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T00:58:06.475 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:06 smithi151 podman[65806]: 2024-05-09 00:58:06.176420804 +0000 UTC m=+0.414679096 container init 119ac92182b3fa20c821d0af178832d841bd4975a7214ed0637889cf19aa5f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-09T00:58:06.475 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:06 smithi151 podman[65806]: 2024-05-09 00:58:06.179026533 +0000 UTC m=+0.417284826 container start 119ac92182b3fa20c821d0af178832d841bd4975a7214ed0637889cf19aa5f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-09T00:58:06.475 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:06 smithi151 ceph-mds[65825]: -- 172.21.15.151:0/2608394622 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f05cdffa40 con 0x55f05ce47180 2024-05-09T00:58:06.475 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:06 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c[65821]: starting mds.c at 2024-05-09T00:58:06.475 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:06 smithi151 bash[65806]: 119ac92182b3fa20c821d0af178832d841bd4975a7214ed0637889cf19aa5f0b 2024-05-09T00:58:06.475 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 00:58:06 smithi151 systemd[1]: Started Ceph mds.c for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 -- 172.21.15.37:0/1168012371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658109850 msgr2=0x7f86581111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 --2- 172.21.15.37:0/1168012371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658109850 0x7f86581111b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f865000b0d0 tx=0x7f865000b3e0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 -- 172.21.15.37:0/1168012371 shutdown_connections 2024-05-09T00:58:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 --2- 172.21.15.37:0/1168012371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8658109850 0x7f86581111b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 --2- 172.21.15.37:0/1168012371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86581045d0 0x7f86581049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 --2- 172.21.15.37:0/1168012371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8658108f00 0x7f8658109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 -- 172.21.15.37:0/1168012371 >> 172.21.15.37:0/1168012371 conn(0x7f86580ffea0 msgr2=0x7f86581022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 -- 172.21.15.37:0/1168012371 shutdown_connections 2024-05-09T00:58:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.280+0000 7f865d6a3700 1 -- 172.21.15.37:0/1168012371 wait complete. 2024-05-09T00:58:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 Processor -- start 2024-05-09T00:58:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 -- start start 2024-05-09T00:58:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86581045d0 0x7f865819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8658108f00 0x7f865819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8658109850 0x7f865819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8658114480 con 0x7f86581045d0 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8658114300 con 0x7f8658108f00 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f865d6a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8658114600 con 0x7f8658109850 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f8656ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86581045d0 0x7f865819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f8656ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86581045d0 0x7f865819ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54442/0 (socket says 172.21.15.37:54442) 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.281+0000 7f8656ffd700 1 -- 172.21.15.37:0/2923125671 learned_addr learned my addr 172.21.15.37:0/2923125671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f8656ffd700 1 -- 172.21.15.37:0/2923125671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8658109850 msgr2=0x7f865819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8658109850 0x7f865819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f8656ffd700 1 -- 172.21.15.37:0/2923125671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8658108f00 msgr2=0x7f865819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8658108f00 0x7f865819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f8656ffd700 1 -- 172.21.15.37:0/2923125671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865819fc60 con 0x7f86581045d0 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f8656ffd700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86581045d0 0x7f865819ad90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f864800d950 tx=0x7f864800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f863ffff700 1 -- 172.21.15.37:0/2923125671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648016070 con 0x7f86581045d0 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f863ffff700 1 -- 172.21.15.37:0/2923125671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8648010460 con 0x7f86581045d0 2024-05-09T00:58:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865819ff50 con 0x7f86581045d0 2024-05-09T00:58:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f863ffff700 1 -- 172.21.15.37:0/2923125671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864800f620 con 0x7f86581045d0 2024-05-09T00:58:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.282+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86581a7870 con 0x7f86581045d0 2024-05-09T00:58:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.283+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86580512c0 con 0x7f86581045d0 2024-05-09T00:58:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.285+0000 7f863ffff700 1 -- 172.21.15.37:0/2923125671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8648019070 con 0x7f86581045d0 2024-05-09T00:58:07.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.286+0000 7f863ffff700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f86400b2880 0x7f86400b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:07.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.286+0000 7f86567fc700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f86400b2880 0x7f86400b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:07.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.286+0000 7f863ffff700 1 -- 172.21.15.37:0/2923125671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f86480e19e0 con 0x7f86581045d0 2024-05-09T00:58:07.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.286+0000 7f86567fc700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f86400b2880 0x7f86400b4d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8658107cb0 tx=0x7f864c009620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:07.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.289+0000 7f863ffff700 1 -- 172.21.15.37:0/2923125671 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f86480a9ba0 con 0x7f86581045d0 2024-05-09T00:58:07.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: Deploying daemon mds.h on smithi136 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] up:boot 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: fsmap 7 up:standby 2024-05-09T00:58:07.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:07 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:58:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.553+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f865802e5f0 con 0x7f86581045d0 2024-05-09T00:58:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.554+0000 7f863ffff700 1 -- 172.21.15.37:0/2923125671 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6355 (secure 0 0 0) 0x7f86480a94a0 con 0x7f86581045d0 2024-05-09T00:58:07.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:07.555 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f86400b2880 msgr2=0x7f86400b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f86400b2880 0x7f86400b4d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8658107cb0 tx=0x7f864c009620 comp rx=0 tx=0).stop 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86581045d0 msgr2=0x7f865819ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86581045d0 0x7f865819ad90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f864800d950 tx=0x7f864800dd10 comp rx=0 tx=0).stop 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 shutdown_connections 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f86400b2880 0x7f86400b4d90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8658109850 0x7f865819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86581045d0 0x7f865819ad90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 --2- 172.21.15.37:0/2923125671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8658108f00 0x7f865819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 >> 172.21.15.37:0/2923125671 conn(0x7f86580ffea0 msgr2=0x7f8658108670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:07.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 shutdown_connections 2024-05-09T00:58:07.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:07.556+0000 7f865d6a3700 1 -- 172.21.15.37:0/2923125671 wait complete. 2024-05-09T00:58:07.558 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-09T00:58:07.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: Deploying daemon mds.h on smithi136 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] up:boot 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: fsmap 7 up:standby 2024-05-09T00:58:07.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:07 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: Deploying daemon mds.h on smithi136 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] up:boot 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: fsmap 7 up:standby 2024-05-09T00:58:07.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:07 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:58:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:08 smithi037 ceph-mon[30122]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:08 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2923125671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:08.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:08 smithi136 ceph-mon[34110]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:08.623 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:08 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2923125671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:08.623 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 systemd[1]: Starting Ceph mds.h for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:58:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:08 smithi151 ceph-mon[34780]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:08 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2923125671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:08.878 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 podman[64263]: 2024-05-09 00:58:08.525706531 +0000 UTC m=+0.018334239 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:58:08.878 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 podman[64263]: 2024-05-09 00:58:08.653248579 +0000 UTC m=+0.145876274 container create 641f714e6c2a28499ca950f4c388ed481006649b0b934551398051cde1573a8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-09T00:58:08.878 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 podman[64263]: 2024-05-09 00:58:08.866847719 +0000 UTC m=+0.359475414 container init 641f714e6c2a28499ca950f4c388ed481006649b0b934551398051cde1573a8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T00:58:08.878 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 podman[64263]: 2024-05-09 00:58:08.869465306 +0000 UTC m=+0.362093007 container start 641f714e6c2a28499ca950f4c388ed481006649b0b934551398051cde1573a8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-09T00:58:09.377 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 ceph-mds[64282]: -- 172.21.15.136:0/170846986 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f18c5ba40 con 0x560f18ca3a80 2024-05-09T00:58:09.378 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h[64278]: starting mds.h at 2024-05-09T00:58:09.378 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 bash[64263]: 641f714e6c2a28499ca950f4c388ed481006649b0b934551398051cde1573a8a 2024-05-09T00:58:09.378 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 00:58:08 smithi136 systemd[1]: Started Ceph mds.h for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:10.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:58:10.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: Deploying daemon mds.i on smithi151 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] up:boot 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: fsmap 8 up:standby 2024-05-09T00:58:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:10 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: Deploying daemon mds.i on smithi151 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] up:boot 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: fsmap 8 up:standby 2024-05-09T00:58:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:10 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: Deploying daemon mds.i on smithi151 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] up:boot 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: fsmap 8 up:standby 2024-05-09T00:58:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:10 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:58:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:11.225 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 systemd[1]: Starting Ceph mds.i for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:58:11.604 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 podman[66107]: 2024-05-09 00:58:11.257009551 +0000 UTC m=+0.018064129 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:58:11.604 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 podman[66107]: 2024-05-09 00:58:11.369858169 +0000 UTC m=+0.130912746 container create 103667fe17a0f293c5e0d5dd3df1de9b3dc15266bdb0da2455801c62a112a71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-05-09T00:58:11.605 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 podman[66107]: 2024-05-09 00:58:11.604926995 +0000 UTC m=+0.365981573 container init 103667fe17a0f293c5e0d5dd3df1de9b3dc15266bdb0da2455801c62a112a71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-09T00:58:11.975 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 podman[66107]: 2024-05-09 00:58:11.607825163 +0000 UTC m=+0.368879741 container start 103667fe17a0f293c5e0d5dd3df1de9b3dc15266bdb0da2455801c62a112a71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507) 2024-05-09T00:58:11.975 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 ceph-mds[66126]: -- 172.21.15.151:0/1012212746 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55956b67fa40 con 0x55956b6c7a80 2024-05-09T00:58:11.975 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i[66122]: starting mds.i at 2024-05-09T00:58:11.975 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 bash[66107]: 103667fe17a0f293c5e0d5dd3df1de9b3dc15266bdb0da2455801c62a112a71e 2024-05-09T00:58:11.975 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 00:58:11 smithi151 systemd[1]: Started Ceph mds.i for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:12.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 -- 172.21.15.37:0/4173319029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710107df0 msgr2=0x7f7710108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:12.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 --2- 172.21.15.37:0/4173319029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710107df0 0x7f7710108200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f76f80099c0 tx=0x7f76f8009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 -- 172.21.15.37:0/4173319029 shutdown_connections 2024-05-09T00:58:12.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 --2- 172.21.15.37:0/4173319029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7710108740 0x7f77101100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 --2- 172.21.15.37:0/4173319029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77101034c0 0x7f77101038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 --2- 172.21.15.37:0/4173319029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710107df0 0x7f7710108200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 -- 172.21.15.37:0/4173319029 >> 172.21.15.37:0/4173319029 conn(0x7f77100fedf0 msgr2=0x7f7710101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:12.118 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:12 smithi037 ceph-mon[30122]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:12.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:12.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:12.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:12 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:12.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 -- 172.21.15.37:0/4173319029 shutdown_connections 2024-05-09T00:58:12.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.117+0000 7f7715e84700 1 -- 172.21.15.37:0/4173319029 wait complete. 2024-05-09T00:58:12.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 Processor -- start 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 -- start start 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77101034c0 0x7f771019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7710107df0 0x7f771019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710108740 0x7f771019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7710113350 con 0x7f7710108740 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77101131d0 con 0x7f77101034c0 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7715e84700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f77101134d0 con 0x7f7710107df0 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f770ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710108740 0x7f771019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f770ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710108740 0x7f771019f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38462/0 (socket says 172.21.15.37:38462) 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f770ffff700 1 -- 172.21.15.37:0/3237947774 learned_addr learned my addr 172.21.15.37:0/3237947774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.118+0000 7f7706ffd700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7710107df0 0x7f771019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770ffff700 1 -- 172.21.15.37:0/3237947774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7710107df0 msgr2=0x7f771019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770ffff700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7710107df0 0x7f771019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770ffff700 1 -- 172.21.15.37:0/3237947774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77101034c0 msgr2=0x7f771019ae10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:58:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770ffff700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77101034c0 0x7f771019ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770ffff700 1 -- 172.21.15.37:0/3237947774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771019fc30 con 0x7f7710108740 2024-05-09T00:58:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770ffff700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710108740 0x7f771019f640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7708007ee0 tx=0x7f770800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770d7fa700 1 -- 172.21.15.37:0/3237947774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770800dbd0 con 0x7f7710108740 2024-05-09T00:58:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770d7fa700 1 -- 172.21.15.37:0/3237947774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f770800dd70 con 0x7f7710108740 2024-05-09T00:58:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771019ff20 con 0x7f7710108740 2024-05-09T00:58:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.119+0000 7f770d7fa700 1 -- 172.21.15.37:0/3237947774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708005990 con 0x7f7710108740 2024-05-09T00:58:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.120+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77101a0430 con 0x7f7710108740 2024-05-09T00:58:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.121+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77100512c0 con 0x7f7710108740 2024-05-09T00:58:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.122+0000 7f770d7fa700 1 -- 172.21.15.37:0/3237947774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f770801a020 con 0x7f7710108740 2024-05-09T00:58:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.123+0000 7f770d7fa700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f76fc0b2900 0x7f76fc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.123+0000 7f770f7fe700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f76fc0b2900 0x7f76fc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.123+0000 7f770d7fa700 1 -- 172.21.15.37:0/3237947774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f77080e1430 con 0x7f7710108740 2024-05-09T00:58:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.124+0000 7f770f7fe700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f76fc0b2900 0x7f76fc0b4e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f770000a9b0 tx=0x7f7700005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.128+0000 7f770d7fa700 1 -- 172.21.15.37:0/3237947774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7708010070 con 0x7f7710108740 2024-05-09T00:58:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:12 smithi136 ceph-mon[34110]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:12 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.393+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f771002e5f0 con 0x7f7710108740 2024-05-09T00:58:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.394+0000 7f770d7fa700 1 -- 172.21.15.37:0/3237947774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8013 (secure 0 0 0) 0x7f77080a95f0 con 0x7f7710108740 2024-05-09T00:58:12.395 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:12.395 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-09T00:58:12.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.396+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f76fc0b2900 msgr2=0x7f76fc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:12.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.396+0000 7f7715e84700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f76fc0b2900 0x7f76fc0b4e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f770000a9b0 tx=0x7f7700005c90 comp rx=0 tx=0).stop 2024-05-09T00:58:12.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.396+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710108740 msgr2=0x7f771019f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:12.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.396+0000 7f7715e84700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710108740 0x7f771019f640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7708007ee0 tx=0x7f770800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 shutdown_connections 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f76fc0b2900 0x7f76fc0b4e10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7710108740 0x7f771019f640 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77101034c0 0x7f771019ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 --2- 172.21.15.37:0/3237947774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7710107df0 0x7f771019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 >> 172.21.15.37:0/3237947774 conn(0x7f77100fedf0 msgr2=0x7f7710075d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 shutdown_connections 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:12.397+0000 7f7715e84700 1 -- 172.21.15.37:0/3237947774 wait complete. 2024-05-09T00:58:12.398 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 10 2024-05-09T00:58:12.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:12 smithi151 ceph-mon[34780]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:12 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:13.339 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:13 smithi037 ceph-mon[30122]: Deploying daemon mds.g on smithi037 2024-05-09T00:58:13.339 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:13 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] up:boot 2024-05-09T00:58:13.339 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:13 smithi037 ceph-mon[30122]: fsmap 9 up:standby 2024-05-09T00:58:13.339 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:13 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:58:13.339 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:13 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3237947774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:13.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:13 smithi136 ceph-mon[34110]: Deploying daemon mds.g on smithi037 2024-05-09T00:58:13.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:13 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] up:boot 2024-05-09T00:58:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:13 smithi136 ceph-mon[34110]: fsmap 9 up:standby 2024-05-09T00:58:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:13 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:58:13.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:13 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3237947774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:13.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:13 smithi151 ceph-mon[34780]: Deploying daemon mds.g on smithi037 2024-05-09T00:58:13.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:13 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] up:boot 2024-05-09T00:58:13.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:13 smithi151 ceph-mon[34780]: fsmap 9 up:standby 2024-05-09T00:58:13.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:13 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:58:13.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:13 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3237947774' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:14.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:14 smithi037 ceph-mon[30122]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:14.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:14 smithi136 ceph-mon[34110]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:14.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:14 smithi151 ceph-mon[34780]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:14.724 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:14 smithi037 systemd[1]: Starting Ceph mds.g for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:58:15.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:58:15.063 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:14 smithi037 podman[69688]: 2024-05-09 00:58:14.733784435 +0000 UTC m=+0.018496146 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:58:15.063 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:14 smithi037 podman[69688]: 2024-05-09 00:58:14.835925417 +0000 UTC m=+0.120637151 container create 0e97b0a8939505ee62e8d27de827b35b144542f0a2122af076e158524e09a8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T00:58:15.063 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:15 smithi037 podman[69688]: 2024-05-09 00:58:15.063348262 +0000 UTC m=+0.348059959 container init 0e97b0a8939505ee62e8d27de827b35b144542f0a2122af076e158524e09a8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507) 2024-05-09T00:58:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:15.462 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:15 smithi037 podman[69688]: 2024-05-09 00:58:15.067386181 +0000 UTC m=+0.352097873 container start 0e97b0a8939505ee62e8d27de827b35b144542f0a2122af076e158524e09a8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-09T00:58:15.462 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:15 smithi037 ceph-mds[69712]: -- 172.21.15.37:0/451304905 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556ab091a40 con 0x5556ab0d9600 2024-05-09T00:58:15.463 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:15 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g[69704]: starting mds.g at 2024-05-09T00:58:15.463 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:15 smithi037 bash[69688]: 0e97b0a8939505ee62e8d27de827b35b144542f0a2122af076e158524e09a8f1 2024-05-09T00:58:15.463 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 00:58:15 smithi037 systemd[1]: Started Ceph mds.g for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: Deploying daemon mds.a on smithi037 2024-05-09T00:58:16.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.37:6838/752211904,v1:172.21.15.37:6839/752211904] up:boot 2024-05-09T00:58:16.471 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: fsmap 10 up:standby 2024-05-09T00:58:16.471 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:16 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:58:16.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: Deploying daemon mds.a on smithi037 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.37:6838/752211904,v1:172.21.15.37:6839/752211904] up:boot 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: fsmap 10 up:standby 2024-05-09T00:58:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:16 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: Deploying daemon mds.a on smithi037 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.37:6838/752211904,v1:172.21.15.37:6839/752211904] up:boot 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: fsmap 10 up:standby 2024-05-09T00:58:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:16 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 -- 172.21.15.37:0/1753465114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 msgr2=0x7f0f30111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 --2- 172.21.15.37:0/1753465114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f30111170 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009990 tx=0x7f0f28009ca0 comp rx=0 tx=0).stop 2024-05-09T00:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 -- 172.21.15.37:0/1753465114 shutdown_connections 2024-05-09T00:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 --2- 172.21.15.37:0/1753465114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f30111170 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 --2- 172.21.15.37:0/1753465114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f30109300 0x7f0f30109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 --2- 172.21.15.37:0/1753465114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f30102790 0x7f0f30102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 -- 172.21.15.37:0/1753465114 >> 172.21.15.37:0/1753465114 conn(0x7f0f300fe4e0 msgr2=0x7f0f30100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:16.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 -- 172.21.15.37:0/1753465114 shutdown_connections 2024-05-09T00:58:16.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.913+0000 7f0f35c64700 1 -- 172.21.15.37:0/1753465114 wait complete. 2024-05-09T00:58:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 Processor -- start 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 -- start start 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f30102790 0x7f0f3019ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f3019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f30109300 0x7f0f3019f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f301145a0 con 0x7f0f301030e0 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30114420 con 0x7f0f30102790 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.914+0000 7f0f35c64700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30114720 con 0x7f0f30109300 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f3019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f3019b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38504/0 (socket says 172.21.15.37:38504) 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 -- 172.21.15.37:0/3481656761 learned_addr learned my addr 172.21.15.37:0/3481656761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2f7fe700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f30102790 0x7f0f3019ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2ffff700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f30109300 0x7f0f3019f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 -- 172.21.15.37:0/3481656761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f30109300 msgr2=0x7f0f3019f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f30109300 0x7f0f3019f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 -- 172.21.15.37:0/3481656761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f30102790 msgr2=0x7f0f3019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f30102790 0x7f0f3019ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 -- 172.21.15.37:0/3481656761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3019fd20 con 0x7f0f301030e0 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2effd700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f3019b3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e970 tx=0x7f0f1800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2cff9700 1 -- 172.21.15.37:0/3481656761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1800cbd0 con 0x7f0f301030e0 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2cff9700 1 -- 172.21.15.37:0/3481656761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f1800cd70 con 0x7f0f301030e0 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f301a0010 con 0x7f0f301030e0 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.915+0000 7f0f2cff9700 1 -- 172.21.15.37:0/3481656761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18005680 con 0x7f0f301030e0 2024-05-09T00:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.916+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f301a7930 con 0x7f0f301030e0 2024-05-09T00:58:16.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.916+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f300512c0 con 0x7f0f301030e0 2024-05-09T00:58:16.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.918+0000 7f0f2cff9700 1 -- 172.21.15.37:0/3481656761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0f18004750 con 0x7f0f301030e0 2024-05-09T00:58:16.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.919+0000 7f0f2cff9700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f1c0b2880 0x7f0f1c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.919+0000 7f0f2f7fe700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f1c0b2880 0x7f0f1c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.919+0000 7f0f2cff9700 1 -- 172.21.15.37:0/3481656761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f0f180e21e0 con 0x7f0f301030e0 2024-05-09T00:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.919+0000 7f0f2f7fe700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f1c0b2880 0x7f0f1c0b4d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0f3006ca90 tx=0x7f0f2000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:16.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:16.922+0000 7f0f2cff9700 1 -- 172.21.15.37:0/3481656761 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0f18054df0 con 0x7f0f301030e0 2024-05-09T00:58:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.187+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f3019c1b0 con 0x7f0f301030e0 2024-05-09T00:58:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.187+0000 7f0f2cff9700 1 -- 172.21.15.37:0/3481656761 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8836 (secure 0 0 0) 0x7f0f180aa3a0 con 0x7f0f301030e0 2024-05-09T00:58:17.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:17.189 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14547,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f1c0b2880 msgr2=0x7f0f1c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f1c0b2880 0x7f0f1c0b4d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0f3006ca90 tx=0x7f0f2000b040 comp rx=0 tx=0).stop 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 msgr2=0x7f0f3019b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f3019b3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f1800e970 tx=0x7f0f1800ec80 comp rx=0 tx=0).stop 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 shutdown_connections 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0f1c0b2880 0x7f0f1c0b4d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f30109300 0x7f0f3019f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f30102790 0x7f0f3019ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 --2- 172.21.15.37:0/3481656761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f301030e0 0x7f0f3019b3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 >> 172.21.15.37:0/3481656761 conn(0x7f0f300fe4e0 msgr2=0x7f0f30107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 shutdown_connections 2024-05-09T00:58:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:17.190+0000 7f0f35c64700 1 -- 172.21.15.37:0/3481656761 wait complete. 2024-05-09T00:58:17.192 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 11 2024-05-09T00:58:17.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:17 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3481656761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:17.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:17 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3481656761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:17 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3481656761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:18 smithi037 ceph-mon[30122]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:18.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:18 smithi151 ceph-mon[34780]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:18 smithi136 ceph-mon[34110]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:19.474 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 systemd[1]: Starting Ceph mds.a for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:58:19.785 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 podman[70157]: 2024-05-09 00:58:19.414357588 +0000 UTC m=+0.018589107 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:58:19.785 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 podman[70157]: 2024-05-09 00:58:19.527651719 +0000 UTC m=+0.131883238 container create cb18d56c95e14158b726a2441f96ea3c0427712720617221c34d8d155ae9727d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T00:58:19.785 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 podman[70157]: 2024-05-09 00:58:19.746867106 +0000 UTC m=+0.351098624 container init cb18d56c95e14158b726a2441f96ea3c0427712720617221c34d8d155ae9727d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-09T00:58:19.785 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 podman[70157]: 2024-05-09 00:58:19.750644682 +0000 UTC m=+0.354876203 container start cb18d56c95e14158b726a2441f96ea3c0427712720617221c34d8d155ae9727d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-05-09T00:58:19.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:58:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:20.224 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 ceph-mds[70177]: -- 172.21.15.37:0/4170217672 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f789811a40 con 0x55f789859a80 2024-05-09T00:58:20.224 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a[70173]: starting mds.a at 2024-05-09T00:58:20.224 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 bash[70157]: cb18d56c95e14158b726a2441f96ea3c0427712720617221c34d8d155ae9727d 2024-05-09T00:58:20.224 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 00:58:19 smithi037 systemd[1]: Started Ceph mds.a for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:20.492 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:20 smithi037 ceph-mon[30122]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:20.492 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.492 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.492 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.492 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:20.492 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:20.492 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:20.564 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:20 smithi136 ceph-mon[34110]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:20.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:20.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:20.565 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:20 smithi151 ceph-mon[34780]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:58:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:58:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:21.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:21 smithi136 ceph-mon[34110]: Deploying daemon mds.b on smithi136 2024-05-09T00:58:21.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:21 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.37:6840/828379246,v1:172.21.15.37:6841/828379246] up:boot 2024-05-09T00:58:21.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:21 smithi136 ceph-mon[34110]: fsmap 11 up:standby 2024-05-09T00:58:21.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:21 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:58:21.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:21 smithi037 ceph-mon[30122]: Deploying daemon mds.b on smithi136 2024-05-09T00:58:21.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:21 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.37:6840/828379246,v1:172.21.15.37:6841/828379246] up:boot 2024-05-09T00:58:21.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:21 smithi037 ceph-mon[30122]: fsmap 11 up:standby 2024-05-09T00:58:21.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:21 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:58:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:21 smithi151 ceph-mon[34780]: Deploying daemon mds.b on smithi136 2024-05-09T00:58:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:21 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.37:6840/828379246,v1:172.21.15.37:6841/828379246] up:boot 2024-05-09T00:58:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:21 smithi151 ceph-mon[34780]: fsmap 11 up:standby 2024-05-09T00:58:21.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:21 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:58:21.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.931+0000 7fed62248700 1 -- 172.21.15.37:0/1448545411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c107df0 msgr2=0x7fed5c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.931+0000 7fed62248700 1 --2- 172.21.15.37:0/1448545411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c107df0 0x7fed5c108200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fed500099c0 tx=0x7fed50009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 -- 172.21.15.37:0/1448545411 shutdown_connections 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 --2- 172.21.15.37:0/1448545411 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed5c108740 0x7fed5c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 --2- 172.21.15.37:0/1448545411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed5c1034c0 0x7fed5c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 --2- 172.21.15.37:0/1448545411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c107df0 0x7fed5c108200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 -- 172.21.15.37:0/1448545411 >> 172.21.15.37:0/1448545411 conn(0x7fed5c0fedf0 msgr2=0x7fed5c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 -- 172.21.15.37:0/1448545411 shutdown_connections 2024-05-09T00:58:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 -- 172.21.15.37:0/1448545411 wait complete. 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.932+0000 7fed62248700 1 Processor -- start 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed62248700 1 -- start start 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed62248700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c1034c0 0x7fed5c199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed62248700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed5c107df0 0x7fed5c19a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed62248700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed5c108740 0x7fed5c19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed62248700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c113350 con 0x7fed5c1034c0 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed62248700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c1131d0 con 0x7fed5c107df0 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed62248700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fed5c1134d0 con 0x7fed5c108740 2024-05-09T00:58:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed5b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c1034c0 0x7fed5c199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed5b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c1034c0 0x7fed5c199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58708/0 (socket says 172.21.15.37:58708) 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed5b7fe700 1 -- 172.21.15.37:0/1414573244 learned_addr learned my addr 172.21.15.37:0/1414573244 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed5affd700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed5c107df0 0x7fed5c19a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.933+0000 7fed5bfff700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed5c108740 0x7fed5c19e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed5b7fe700 1 -- 172.21.15.37:0/1414573244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed5c108740 msgr2=0x7fed5c19e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed5b7fe700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed5c108740 0x7fed5c19e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed5b7fe700 1 -- 172.21.15.37:0/1414573244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed5c107df0 msgr2=0x7fed5c19a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed5b7fe700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed5c107df0 0x7fed5c19a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed5b7fe700 1 -- 172.21.15.37:0/1414573244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5c19ec10 con 0x7fed5c1034c0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed5b7fe700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c1034c0 0x7fed5c199d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007f10 tx=0x7fed4c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed58ff9700 1 -- 172.21.15.37:0/1414573244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00ddd0 con 0x7fed5c1034c0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5c19ef00 con 0x7fed5c1034c0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed58ff9700 1 -- 172.21.15.37:0/1414573244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed4c004bb0 con 0x7fed5c1034c0 2024-05-09T00:58:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed58ff9700 1 -- 172.21.15.37:0/1414573244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0046a0 con 0x7fed5c1034c0 2024-05-09T00:58:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.934+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed5c1a6820 con 0x7fed5c1034c0 2024-05-09T00:58:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.935+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed5c0512c0 con 0x7fed5c1034c0 2024-05-09T00:58:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.936+0000 7fed58ff9700 1 -- 172.21.15.37:0/1414573244 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fed4c01c020 con 0x7fed5c1034c0 2024-05-09T00:58:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.938+0000 7fed58ff9700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fed440b2880 0x7fed440b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.938+0000 7fed5affd700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fed440b2880 0x7fed440b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.938+0000 7fed58ff9700 1 -- 172.21.15.37:0/1414573244 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fed4c0e2050 con 0x7fed5c1034c0 2024-05-09T00:58:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.938+0000 7fed5affd700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fed440b2880 0x7fed440b4d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed50000c00 tx=0x7fed5001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:21.942+0000 7fed58ff9700 1 -- 172.21.15.37:0/1414573244 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fed4c023030 con 0x7fed5c1034c0 2024-05-09T00:58:22.128 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:21 smithi136 systemd[1]: Starting Ceph mds.b for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T00:58:22.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.202+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed5c02e5f0 con 0x7fed5c1034c0 2024-05-09T00:58:22.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.203+0000 7fed58ff9700 1 -- 172.21.15.37:0/1414573244 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9659 (secure 0 0 0) 0x7fed4c010070 con 0x7fed5c1034c0 2024-05-09T00:58:22.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:22.204 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14547,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-09T00:58:22.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fed440b2880 msgr2=0x7fed440b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:22.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fed440b2880 0x7fed440b4d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed50000c00 tx=0x7fed5001a040 comp rx=0 tx=0).stop 2024-05-09T00:58:22.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c1034c0 msgr2=0x7fed5c199d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:22.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c1034c0 0x7fed5c199d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007f10 tx=0x7fed4c00d3b0 comp rx=0 tx=0).stop 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 shutdown_connections 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fed440b2880 0x7fed440b4d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed5c108740 0x7fed5c19e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c1034c0 0x7fed5c199d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 --2- 172.21.15.37:0/1414573244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fed5c107df0 0x7fed5c19a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.205+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 >> 172.21.15.37:0/1414573244 conn(0x7fed5c0fedf0 msgr2=0x7fed5c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.206+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 shutdown_connections 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:22.206+0000 7fed62248700 1 -- 172.21.15.37:0/1414573244 wait complete. 2024-05-09T00:58:22.207 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 12 2024-05-09T00:58:22.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:22 smithi037 ceph-mon[30122]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:22.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:22 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1414573244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:22.494 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:22 smithi136 ceph-mon[34110]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:22.494 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:22 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1414573244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:22.495 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 podman[64567]: 2024-05-09 00:58:22.110464572 +0000 UTC m=+0.018258705 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T00:58:22.495 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 podman[64567]: 2024-05-09 00:58:22.208783304 +0000 UTC m=+0.116577412 container create cf0016c1dfa57755e6a219a8cdc818a168df0d8e661a865746b2cbfbcead7f47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T00:58:22.495 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 podman[64567]: 2024-05-09 00:58:22.403241864 +0000 UTC m=+0.311035969 container init cf0016c1dfa57755e6a219a8cdc818a168df0d8e661a865746b2cbfbcead7f47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-09T00:58:22.495 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 podman[64567]: 2024-05-09 00:58:22.405921652 +0000 UTC m=+0.313715766 container start cf0016c1dfa57755e6a219a8cdc818a168df0d8e661a865746b2cbfbcead7f47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True) 2024-05-09T00:58:22.495 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 ceph-mds[64586]: -- 172.21.15.136:0/288358302 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556c303da40 con 0x5556c3085a80 2024-05-09T00:58:22.495 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: starting mds.b at 2024-05-09T00:58:22.495 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 bash[64567]: cf0016c1dfa57755e6a219a8cdc818a168df0d8e661a865746b2cbfbcead7f47 2024-05-09T00:58:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:22 smithi151 ceph-mon[34780]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:22 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1414573244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:22.877 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:22 smithi136 systemd[1]: Started Ceph mds.b for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] up:boot 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: fsmap 12 up:standby 2024-05-09T00:58:23.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:23 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] up:boot 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: fsmap 12 up:standby 2024-05-09T00:58:23.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:23 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] up:boot 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: fsmap 12 up:standby 2024-05-09T00:58:23.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:23 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:58:24.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:58:25.095 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:24 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:58:25.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:24 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:58:25.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:25.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:24 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:58:26.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:25 smithi136 ceph-mon[34110]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:26.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:25 smithi037 ceph-mon[30122]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:26.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:25 smithi151 ceph-mon[34780]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 -- 172.21.15.37:0/3492828701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 msgr2=0x7fcbe01100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 --2- 172.21.15.37:0/3492828701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe01100c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800b0d0 tx=0x7fcbd800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 -- 172.21.15.37:0/3492828701 shutdown_connections 2024-05-09T00:58:27.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 --2- 172.21.15.37:0/3492828701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe01100c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 --2- 172.21.15.37:0/3492828701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbe01034e0 0x7fcbe01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 --2- 172.21.15.37:0/3492828701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe0107e10 0x7fcbe0108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 -- 172.21.15.37:0/3492828701 >> 172.21.15.37:0/3492828701 conn(0x7fcbe00fef30 msgr2=0x7fcbe0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 -- 172.21.15.37:0/3492828701 shutdown_connections 2024-05-09T00:58:27.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.337+0000 7fcbe4876700 1 -- 172.21.15.37:0/3492828701 wait complete. 2024-05-09T00:58:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 Processor -- start 2024-05-09T00:58:27.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 -- start start 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbe01034e0 0x7fcbe019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe0107e10 0x7fcbe019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0113390 con 0x7fcbe0108760 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0113210 con 0x7fcbe0107e10 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbe4876700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0113510 con 0x7fcbe01034e0 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbded9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbded9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58720/0 (socket says 172.21.15.37:58720) 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbded9d700 1 -- 172.21.15.37:0/4179694245 learned_addr learned my addr 172.21.15.37:0/4179694245 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.338+0000 7fcbddd9b700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe0107e10 0x7fcbe019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbde59c700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbe01034e0 0x7fcbe019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbded9d700 1 -- 172.21.15.37:0/4179694245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbe01034e0 msgr2=0x7fcbe019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbded9d700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbe01034e0 0x7fcbe019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbded9d700 1 -- 172.21.15.37:0/4179694245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe0107e10 msgr2=0x7fcbe019c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbded9d700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe0107e10 0x7fcbe019c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbded9d700 1 -- 172.21.15.37:0/4179694245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe01a6f20 con 0x7fcbe0108760 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbddd9b700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe0107e10 0x7fcbe019c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbde59c700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbe01034e0 0x7fcbe019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbded9d700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe019c670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80095c0 tx=0x7fcbd8007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbd77fe700 1 -- 172.21.15.37:0/4179694245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd801f070 con 0x7fcbe0108760 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbd77fe700 1 -- 172.21.15.37:0/4179694245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbd8003c00 con 0x7fcbe0108760 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe01a71b0 con 0x7fcbe0108760 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbd77fe700 1 -- 172.21.15.37:0/4179694245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd801b6a0 con 0x7fcbe0108760 2024-05-09T00:58:27.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.339+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe01a7600 con 0x7fcbe0108760 2024-05-09T00:58:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.341+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe00512c0 con 0x7fcbe0108760 2024-05-09T00:58:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.343+0000 7fcbd77fe700 1 -- 172.21.15.37:0/4179694245 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fcbd8022070 con 0x7fcbe0108760 2024-05-09T00:58:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.344+0000 7fcbd77fe700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcbcc0b2880 0x7fcbcc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.344+0000 7fcbd77fe700 1 -- 172.21.15.37:0/4179694245 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fcbd800f020 con 0x7fcbe0108760 2024-05-09T00:58:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.344+0000 7fcbde59c700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcbcc0b2880 0x7fcbcc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.345+0000 7fcbde59c700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcbcc0b2880 0x7fcbcc0b4d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8005950 tx=0x7fcbc80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.350+0000 7fcbd77fe700 1 -- 172.21.15.37:0/4179694245 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcbd8029020 con 0x7fcbe0108760 2024-05-09T00:58:27.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:27 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:27 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.628+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbe002e7b0 con 0x7fcbe0108760 2024-05-09T00:58:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.629+0000 7fcbd77fe700 1 -- 172.21.15.37:0/4179694245 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10485 (secure 0 0 0) 0x7fcbd80ab260 con 0x7fcbe0108760 2024-05-09T00:58:27.630 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:27.630 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14547,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24400,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24454,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24491,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-09T00:58:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.631+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcbcc0b2880 msgr2=0x7fcbcc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.631+0000 7fcbe4876700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcbcc0b2880 0x7fcbcc0b4d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8005950 tx=0x7fcbc80058e0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.631+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 msgr2=0x7fcbe019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.631+0000 7fcbe4876700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe019c670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80095c0 tx=0x7fcbd8007a20 comp rx=0 tx=0).stop 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 shutdown_connections 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcbcc0b2880 0x7fcbcc0b4d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe0108760 0x7fcbe019c670 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbe01034e0 0x7fcbe019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 --2- 172.21.15.37:0/4179694245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbe0107e10 0x7fcbe019c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 >> 172.21.15.37:0/4179694245 conn(0x7fcbe00fef30 msgr2=0x7fcbe0107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 shutdown_connections 2024-05-09T00:58:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:27.632+0000 7fcbe4876700 1 -- 172.21.15.37:0/4179694245 wait complete. 2024-05-09T00:58:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2024-05-09T00:58:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:27 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:28.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-09T00:58:28.543 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:28 smithi136 ceph-mon[34110]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:28 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4179694245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:28 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:28 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:28 smithi037 ceph-mon[30122]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:28.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:28 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4179694245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:28 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:28.667 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:28 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:28.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:28 smithi151 ceph-mon[34780]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:28 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4179694245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:58:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:28 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:28 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:58:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:58:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:29.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:58:29.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:58:29.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:58:30.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 -- 172.21.15.37:0/3762209164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd874109850 msgr2=0x7fd8741111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:30.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 --2- 172.21.15.37:0/3762209164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd874109850 0x7fd8741111b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0099c0 tx=0x7fd86c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 -- 172.21.15.37:0/3762209164 shutdown_connections 2024-05-09T00:58:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 --2- 172.21.15.37:0/3762209164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd874109850 0x7fd8741111b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 --2- 172.21.15.37:0/3762209164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8741045d0 0x7fd8741049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 --2- 172.21.15.37:0/3762209164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd874108f00 0x7fd874109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 -- 172.21.15.37:0/3762209164 >> 172.21.15.37:0/3762209164 conn(0x7fd8740ffea0 msgr2=0x7fd8741022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 -- 172.21.15.37:0/3762209164 shutdown_connections 2024-05-09T00:58:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.068+0000 7fd879522700 1 -- 172.21.15.37:0/3762209164 wait complete. 2024-05-09T00:58:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 Processor -- start 2024-05-09T00:58:30.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 -- start start 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8741045d0 0x7fd87419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd874108f00 0x7fd87419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd874109850 0x7fd87419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd874114480 con 0x7fd8741045d0 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd874114300 con 0x7fd874109850 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd879522700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd874114600 con 0x7fd874108f00 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd872ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8741045d0 0x7fd87419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd872ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8741045d0 0x7fd87419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58748/0 (socket says 172.21.15.37:58748) 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.069+0000 7fd872ffd700 1 -- 172.21.15.37:0/1589047143 learned_addr learned my addr 172.21.15.37:0/1589047143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd8727fc700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd874108f00 0x7fd87419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd8737fe700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd874109850 0x7fd87419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd872ffd700 1 -- 172.21.15.37:0/1589047143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd874108f00 msgr2=0x7fd87419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:30.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd872ffd700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd874108f00 0x7fd87419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd872ffd700 1 -- 172.21.15.37:0/1589047143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd874109850 msgr2=0x7fd87419f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd872ffd700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd874109850 0x7fd87419f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd872ffd700 1 -- 172.21.15.37:0/1589047143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87419fc10 con 0x7fd8741045d0 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd872ffd700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8741045d0 0x7fd87419adf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd8640060b0 tx=0x7fd86400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd86bfff700 1 -- 172.21.15.37:0/1589047143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86401a070 con 0x7fd8741045d0 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87419ff00 con 0x7fd8741045d0 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd86bfff700 1 -- 172.21.15.37:0/1589047143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd86400dd20 con 0x7fd8741045d0 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd86bfff700 1 -- 172.21.15.37:0/1589047143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864014600 con 0x7fd8741045d0 2024-05-09T00:58:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.070+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8741a0440 con 0x7fd8741045d0 2024-05-09T00:58:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.072+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8740512c0 con 0x7fd8741045d0 2024-05-09T00:58:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.073+0000 7fd86bfff700 1 -- 172.21.15.37:0/1589047143 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd86401d070 con 0x7fd8741045d0 2024-05-09T00:58:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.074+0000 7fd86bfff700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8600b2880 0x7fd8600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.074+0000 7fd8727fc700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8600b2880 0x7fd8600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:30.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.074+0000 7fd86bfff700 1 -- 172.21.15.37:0/1589047143 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fd8640e1550 con 0x7fd8741045d0 2024-05-09T00:58:30.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.074+0000 7fd8727fc700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8600b2880 0x7fd8600b4d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd874103910 tx=0x7fd85c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:30.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.079+0000 7fd86bfff700 1 -- 172.21.15.37:0/1589047143 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd864010070 con 0x7fd8741045d0 2024-05-09T00:58:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.293+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd87419c150 con 0x7fd8741045d0 2024-05-09T00:58:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.294+0000 7fd86bfff700 1 -- 172.21.15.37:0/1589047143 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7fd8640a9710 con 0x7fd8741045d0 2024-05-09T00:58:30.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:30.295 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-09T00:58:30.295 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T00:58:30.295 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-09T00:58:30.295 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-09T00:58:30.295 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T00:58:30.295 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-09T00:58:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8600b2880 msgr2=0x7fd8600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8600b2880 0x7fd8600b4d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd874103910 tx=0x7fd85c00a380 comp rx=0 tx=0).stop 2024-05-09T00:58:30.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8741045d0 msgr2=0x7fd87419adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8741045d0 0x7fd87419adf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd8640060b0 tx=0x7fd86400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 shutdown_connections 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8600b2880 0x7fd8600b4d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd874109850 0x7fd87419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8741045d0 0x7fd87419adf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 --2- 172.21.15.37:0/1589047143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd874108f00 0x7fd87419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.296+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 >> 172.21.15.37:0/1589047143 conn(0x7fd8740ffea0 msgr2=0x7fd874108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.297+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 shutdown_connections 2024-05-09T00:58:30.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:30.297+0000 7fd879522700 1 -- 172.21.15.37:0/1589047143 wait complete. 2024-05-09T00:58:30.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:30 smithi037 ceph-mon[30122]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:30.552 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:30 smithi136 ceph-mon[34110]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:30.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:30 smithi151 ceph-mon[34780]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:30.937 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T00:58:30.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T00:58:31.195 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:31.559 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:31 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1589047143' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T00:58:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:31 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1589047143' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T00:58:31.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:31 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1589047143' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T00:58:32.397 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:32 smithi037 ceph-mon[30122]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:32 smithi151 ceph-mon[34780]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:32.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:32 smithi136 ceph-mon[34110]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 -- 172.21.15.37:0/634181382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c103310 msgr2=0x7f8b2c10f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 --2- 172.21.15.37:0/634181382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c103310 0x7f8b2c10f890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400c210 tx=0x7f8b2400c520 comp rx=0 tx=0).stop 2024-05-09T00:58:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 -- 172.21.15.37:0/634181382 shutdown_connections 2024-05-09T00:58:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 --2- 172.21.15.37:0/634181382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c103310 0x7f8b2c10f890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 --2- 172.21.15.37:0/634181382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b2c1089f0 0x7f8b2c108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 --2- 172.21.15.37:0/634181382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 0x7f8b2c102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:32.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 -- 172.21.15.37:0/634181382 >> 172.21.15.37:0/634181382 conn(0x7f8b2c0fe540 msgr2=0x7f8b2c100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 -- 172.21.15.37:0/634181382 shutdown_connections 2024-05-09T00:58:32.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.953+0000 7f8b321b3700 1 -- 172.21.15.37:0/634181382 wait complete. 2024-05-09T00:58:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.954+0000 7f8b321b3700 1 Processor -- start 2024-05-09T00:58:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.954+0000 7f8b321b3700 1 -- start start 2024-05-09T00:58:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b321b3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 0x7f8b2c19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b321b3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b2c103310 0x7f8b2c19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b321b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c1089f0 0x7f8b2c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b321b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c1122e0 con 0x7f8b2c1089f0 2024-05-09T00:58:32.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b321b3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c112160 con 0x7f8b2c103310 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b321b3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c112460 con 0x7f8b2c1029c0 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 0x7f8b2c19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c1089f0 0x7f8b2c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 0x7f8b2c19adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54126/0 (socket says 172.21.15.37:54126) 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 -- 172.21.15.37:0/4171636273 learned_addr learned my addr 172.21.15.37:0/4171636273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2affd700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b2c103310 0x7f8b2c19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 -- 172.21.15.37:0/4171636273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b2c103310 msgr2=0x7f8b2c19b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b2c103310 0x7f8b2c19b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 -- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c1089f0 msgr2=0x7f8b2c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c1089f0 0x7f8b2c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 -- 172.21.15.37:0/4171636273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c19fc90 con 0x7f8b2c1029c0 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2bfff700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c1089f0 0x7f8b2c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:58:32.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.955+0000 7f8b2b7fe700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 0x7f8b2c19adc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00d950 tx=0x7f8b1c00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:32.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.956+0000 7f8b28ff9700 1 -- 172.21.15.37:0/4171636273 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c016070 con 0x7f8b2c1029c0 2024-05-09T00:58:32.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.956+0000 7f8b28ff9700 1 -- 172.21.15.37:0/4171636273 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b1c004830 con 0x7f8b2c1029c0 2024-05-09T00:58:32.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.956+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c19ff80 con 0x7f8b2c1029c0 2024-05-09T00:58:32.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.956+0000 7f8b28ff9700 1 -- 172.21.15.37:0/4171636273 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c005520 con 0x7f8b2c1029c0 2024-05-09T00:58:32.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.956+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c1a78a0 con 0x7f8b2c1029c0 2024-05-09T00:58:32.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.957+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2c0512c0 con 0x7f8b2c1029c0 2024-05-09T00:58:32.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.959+0000 7f8b28ff9700 1 -- 172.21.15.37:0/4171636273 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8b1c004220 con 0x7f8b2c1029c0 2024-05-09T00:58:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.959+0000 7f8b28ff9700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8b140b2880 0x7f8b140b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.960+0000 7f8b2affd700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8b140b2880 0x7f8b140b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.960+0000 7f8b28ff9700 1 -- 172.21.15.37:0/4171636273 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f8b1c0e2090 con 0x7f8b2c1029c0 2024-05-09T00:58:32.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.960+0000 7f8b2affd700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8b140b2880 0x7f8b140b4d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c1073a0 tx=0x7f8b20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:32.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:32.967+0000 7f8b28ff9700 1 -- 172.21.15.37:0/4171636273 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8b1c01f020 con 0x7f8b2c1029c0 2024-05-09T00:58:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.181+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8b2c02e5f0 con 0x7f8b2c1029c0 2024-05-09T00:58:33.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.315+0000 7f8b28ff9700 1 -- 172.21.15.37:0/4171636273 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7f8b1c0aa1f0 con 0x7f8b2c1029c0 2024-05-09T00:58:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8b140b2880 msgr2=0x7f8b140b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8b140b2880 0x7f8b140b4d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c1073a0 tx=0x7f8b20009260 comp rx=0 tx=0).stop 2024-05-09T00:58:33.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 msgr2=0x7f8b2c19adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 0x7f8b2c19adc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00d950 tx=0x7f8b1c00dc60 comp rx=0 tx=0).stop 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 shutdown_connections 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8b140b2880 0x7f8b140b4d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c1089f0 0x7f8b2c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b2c1029c0 0x7f8b2c19adc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 --2- 172.21.15.37:0/4171636273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b2c103310 0x7f8b2c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 >> 172.21.15.37:0/4171636273 conn(0x7f8b2c0fe540 msgr2=0x7f8b2c100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.319+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 shutdown_connections 2024-05-09T00:58:33.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:33.320+0000 7f8b321b3700 1 -- 172.21.15.37:0/4171636273 wait complete. 2024-05-09T00:58:33.322 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-09T00:58:33.621 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:33 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4171636273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:58:33.621 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:33 smithi037 ceph-mon[30122]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:58:33.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:33 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4171636273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:58:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:33 smithi136 ceph-mon[34110]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:58:33.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:33 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4171636273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:58:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:33 smithi151 ceph-mon[34780]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:58:33.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T00:58:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:34.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:34 smithi037 ceph-mon[30122]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:34.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:34 smithi037 ceph-mon[30122]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T00:58:34.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:34 smithi037 ceph-mon[30122]: osdmap e73: 12 total, 12 up, 12 in 2024-05-09T00:58:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:34 smithi136 ceph-mon[34110]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:34 smithi136 ceph-mon[34110]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T00:58:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:34 smithi136 ceph-mon[34110]: osdmap e73: 12 total, 12 up, 12 in 2024-05-09T00:58:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:34 smithi151 ceph-mon[34780]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:34 smithi151 ceph-mon[34780]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T00:58:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:34 smithi151 ceph-mon[34780]: osdmap e73: 12 total, 12 up, 12 in 2024-05-09T00:58:35.621 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:35 smithi037 ceph-mon[30122]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T00:58:35.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:35 smithi136 ceph-mon[34110]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T00:58:35.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:35 smithi151 ceph-mon[34780]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T00:58:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 -- 172.21.15.37:0/3413656769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9750105e00 msgr2=0x7f975010e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:35.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 --2- 172.21.15.37:0/3413656769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9750105e00 0x7f975010e350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9744009990 tx=0x7f9744009ca0 comp rx=0 tx=0).stop 2024-05-09T00:58:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 -- 172.21.15.37:0/3413656769 shutdown_connections 2024-05-09T00:58:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 --2- 172.21.15.37:0/3413656769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975010e920 0x7f9750110e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 --2- 172.21.15.37:0/3413656769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97501054b0 0x7f97501058c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 --2- 172.21.15.37:0/3413656769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9750105e00 0x7f975010e350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 -- 172.21.15.37:0/3413656769 >> 172.21.15.37:0/3413656769 conn(0x7f9750079e10 msgr2=0x7f975007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 -- 172.21.15.37:0/3413656769 shutdown_connections 2024-05-09T00:58:35.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.835+0000 7f97548a2700 1 -- 172.21.15.37:0/3413656769 wait complete. 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.836+0000 7f97548a2700 1 Processor -- start 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.836+0000 7f97548a2700 1 -- start start 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.836+0000 7f97548a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97501054b0 0x7f975019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f97548a2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9750105e00 0x7f975019b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f97548a2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975010e920 0x7f975019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f97548a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9750114480 con 0x7f97501054b0 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f97548a2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9750114300 con 0x7f9750105e00 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f97548a2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9750114600 con 0x7f975010e920 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97501054b0 0x7f975019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97501054b0 0x7f975019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34392/0 (socket says 172.21.15.37:34392) 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 -- 172.21.15.37:0/929950395 learned_addr learned my addr 172.21.15.37:0/929950395 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974dd9b700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9750105e00 0x7f975019b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 -- 172.21.15.37:0/929950395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975010e920 msgr2=0x7f975019f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975010e920 0x7f975019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 -- 172.21.15.37:0/929950395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9750105e00 msgr2=0x7f975019b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9750105e00 0x7f975019b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 -- 172.21.15.37:0/929950395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975019fce0 con 0x7f97501054b0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974dd9b700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9750105e00 0x7f975019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f974e59c700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97501054b0 0x7f975019ae10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f974000eb30 tx=0x7f974000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f973f7fe700 1 -- 172.21.15.37:0/929950395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974000cd40 con 0x7f97501054b0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f973f7fe700 1 -- 172.21.15.37:0/929950395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97400044d0 con 0x7f97501054b0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975019ffd0 con 0x7f97501054b0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f973f7fe700 1 -- 172.21.15.37:0/929950395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740010430 con 0x7f97501054b0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.837+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97501a78f0 con 0x7f97501054b0 2024-05-09T00:58:35.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.838+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97500512c0 con 0x7f97501054b0 2024-05-09T00:58:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.841+0000 7f973f7fe700 1 -- 172.21.15.37:0/929950395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9740004000 con 0x7f97501054b0 2024-05-09T00:58:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.842+0000 7f973f7fe700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97380b2900 0x7f97380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.842+0000 7f974dd9b700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97380b2900 0x7f97380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.842+0000 7f973f7fe700 1 -- 172.21.15.37:0/929950395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7f97400e2470 con 0x7f97501054b0 2024-05-09T00:58:35.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.842+0000 7f974dd9b700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97380b2900 0x7f97380b4e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9744006010 tx=0x7f974400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:35.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:35.846+0000 7f973f7fe700 1 -- 172.21.15.37:0/929950395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9740054df0 con 0x7f97501054b0 2024-05-09T00:58:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.063+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f975002e5f0 con 0x7f97501054b0 2024-05-09T00:58:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.334+0000 7f973f7fe700 1 -- 172.21.15.37:0/929950395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7f97400042f0 con 0x7f97501054b0 2024-05-09T00:58:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97380b2900 msgr2=0x7f97380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97380b2900 0x7f97380b4e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9744006010 tx=0x7f974400b260 comp rx=0 tx=0).stop 2024-05-09T00:58:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97501054b0 msgr2=0x7f975019ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:36.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97501054b0 0x7f975019ae10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f974000eb30 tx=0x7f974000eef0 comp rx=0 tx=0).stop 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 shutdown_connections 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97380b2900 0x7f97380b4e10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f975010e920 0x7f975019f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97501054b0 0x7f975019ae10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 --2- 172.21.15.37:0/929950395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9750105e00 0x7f975019b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.337+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 >> 172.21.15.37:0/929950395 conn(0x7f9750079e10 msgr2=0x7f9750100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.338+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 shutdown_connections 2024-05-09T00:58:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:36.338+0000 7f97548a2700 1 -- 172.21.15.37:0/929950395 wait complete. 2024-05-09T00:58:36.340 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-09T00:58:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:36 smithi136 ceph-mon[34110]: pgmap v282: 33 pgs: 1 creating+activating, 5 creating+peering, 24 unknown, 3 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:36 smithi136 ceph-mon[34110]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T00:58:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:36 smithi136 ceph-mon[34110]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T00:58:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:36 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/929950395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T00:58:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:36 smithi037 ceph-mon[30122]: pgmap v282: 33 pgs: 1 creating+activating, 5 creating+peering, 24 unknown, 3 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:36 smithi037 ceph-mon[30122]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T00:58:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:36 smithi037 ceph-mon[30122]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T00:58:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:36 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/929950395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T00:58:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:36 smithi151 ceph-mon[34780]: pgmap v282: 33 pgs: 1 creating+activating, 5 creating+peering, 24 unknown, 3 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:36 smithi151 ceph-mon[34780]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T00:58:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:36 smithi151 ceph-mon[34780]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T00:58:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:36 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/929950395' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T00:58:37.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T00:58:37.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:37 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/929950395' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T00:58:37.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:37 smithi037 ceph-mon[30122]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T00:58:37.534 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:37.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:37 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/929950395' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T00:58:37.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:37 smithi136 ceph-mon[34110]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T00:58:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:37 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/929950395' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T00:58:37.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:37 smithi151 ceph-mon[34780]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T00:58:38.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:38 smithi037 ceph-mon[30122]: pgmap v285: 97 pgs: 1 creating+activating, 17 creating+peering, 57 unknown, 22 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:38.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:38 smithi037 ceph-mon[30122]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T00:58:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:38 smithi136 ceph-mon[34110]: pgmap v285: 97 pgs: 1 creating+activating, 17 creating+peering, 57 unknown, 22 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:38 smithi136 ceph-mon[34110]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T00:58:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:38 smithi151 ceph-mon[34780]: pgmap v285: 97 pgs: 1 creating+activating, 17 creating+peering, 57 unknown, 22 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:38 smithi151 ceph-mon[34780]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3773458339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a8108740 msgr2=0x7fc5a81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3773458339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a8108740 0x7fc5a81100a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000b0d0 tx=0x7fc5a000b3e0 comp rx=0 tx=0).stop 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3773458339 shutdown_connections 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3773458339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a8108740 0x7fc5a81100a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3773458339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5a81034c0 0x7fc5a81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3773458339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5a8107df0 0x7fc5a8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3773458339 >> 172.21.15.37:0/3773458339 conn(0x7fc5a80fedf0 msgr2=0x7fc5a8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3773458339 shutdown_connections 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.297+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3773458339 wait complete. 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 Processor -- start 2024-05-09T00:58:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 -- start start 2024-05-09T00:58:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a81034c0 0x7fc5a819ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5a8107df0 0x7fc5a819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5a8108740 0x7fc5a819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a81133e0 con 0x7fc5a81034c0 2024-05-09T00:58:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a8113260 con 0x7fc5a8108740 2024-05-09T00:58:39.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5ad4a0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a8113560 con 0x7fc5a8107df0 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.298+0000 7fc5a6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a81034c0 0x7fc5a819ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a81034c0 0x7fc5a819ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34408/0 (socket says 172.21.15.37:34408) 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 -- 172.21.15.37:0/3737464781 learned_addr learned my addr 172.21.15.37:0/3737464781 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a77fe700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5a8108740 0x7fc5a819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a67fc700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5a8107df0 0x7fc5a819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 -- 172.21.15.37:0/3737464781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5a8107df0 msgr2=0x7fc5a819b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5a8107df0 0x7fc5a819b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 -- 172.21.15.37:0/3737464781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5a8108740 msgr2=0x7fc5a819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5a8108740 0x7fc5a819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 -- 172.21.15.37:0/3737464781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a819fcf0 con 0x7fc5a81034c0 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a67fc700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5a8107df0 0x7fc5a819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5a6ffd700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a81034c0 0x7fc5a819ae20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c920 tx=0x7fc59800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc58ffff700 1 -- 172.21.15.37:0/3737464781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598007b00 con 0x7fc5a81034c0 2024-05-09T00:58:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a819ffe0 con 0x7fc5a81034c0 2024-05-09T00:58:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc58ffff700 1 -- 172.21.15.37:0/3737464781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc598004ce0 con 0x7fc5a81034c0 2024-05-09T00:58:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc58ffff700 1 -- 172.21.15.37:0/3737464781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598005500 con 0x7fc5a81034c0 2024-05-09T00:58:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.299+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a81a7900 con 0x7fc5a81034c0 2024-05-09T00:58:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.301+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a80512c0 con 0x7fc5a81034c0 2024-05-09T00:58:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.302+0000 7fc58ffff700 1 -- 172.21.15.37:0/3737464781 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc598007ca0 con 0x7fc5a81034c0 2024-05-09T00:58:39.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.303+0000 7fc58ffff700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5900b2880 0x7fc5900b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:39.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.303+0000 7fc5a67fc700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5900b2880 0x7fc5900b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:39.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.303+0000 7fc58ffff700 1 -- 172.21.15.37:0/3737464781 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7fc5980e1ca0 con 0x7fc5a81034c0 2024-05-09T00:58:39.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.304+0000 7fc5a67fc700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5900b2880 0x7fc5900b4d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8109830 tx=0x7fc59c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:39.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.308+0000 7fc58ffff700 1 -- 172.21.15.37:0/3737464781 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc598014030 con 0x7fc5a81034c0 2024-05-09T00:58:39.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:39 smithi037 ceph-mon[30122]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T00:58:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:39.581+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc5a802e5f0 con 0x7fc5a81034c0 2024-05-09T00:58:39.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:39 smithi136 ceph-mon[34110]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T00:58:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:39 smithi151 ceph-mon[34780]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T00:58:40.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.356+0000 7fc58ffff700 1 -- 172.21.15.37:0/3737464781 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc5980a9ad0 con 0x7fc5a81034c0 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5900b2880 msgr2=0x7fc5900b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5900b2880 0x7fc5900b4d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8109830 tx=0x7fc59c008040 comp rx=0 tx=0).stop 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a81034c0 msgr2=0x7fc5a819ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a81034c0 0x7fc5a819ae20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c920 tx=0x7fc59800cc30 comp rx=0 tx=0).stop 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 shutdown_connections 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5900b2880 0x7fc5900b4d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5a8108740 0x7fc5a819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5a81034c0 0x7fc5a819ae20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:40.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 --2- 172.21.15.37:0/3737464781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5a8107df0 0x7fc5a819b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 >> 172.21.15.37:0/3737464781 conn(0x7fc5a80fedf0 msgr2=0x7fc5a8075d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 shutdown_connections 2024-05-09T00:58:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:40.360+0000 7fc5ad4a0700 1 -- 172.21.15.37:0/3737464781 wait complete. 2024-05-09T00:58:40.362 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T00:58:40.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:40 smithi136 ceph-mon[34110]: pgmap v288: 97 pgs: 1 creating+activating, 32 creating+peering, 32 unknown, 32 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:40 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3737464781' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T00:58:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:40 smithi136 ceph-mon[34110]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T00:58:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:40 smithi037 ceph-mon[30122]: pgmap v288: 97 pgs: 1 creating+activating, 32 creating+peering, 32 unknown, 32 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:40 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3737464781' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T00:58:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:40 smithi037 ceph-mon[30122]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T00:58:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:40 smithi151 ceph-mon[34780]: pgmap v288: 97 pgs: 1 creating+activating, 32 creating+peering, 32 unknown, 32 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:58:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:40 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3737464781' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T00:58:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:40 smithi151 ceph-mon[34780]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T00:58:41.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:58:41.418 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:41.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:41 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3737464781' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T00:58:41.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:41 smithi037 ceph-mon[30122]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T00:58:41.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:41 smithi037 ceph-mon[30122]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T00:58:41.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:41 smithi037 ceph-mon[30122]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T00:58:41.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:41 smithi037 ceph-mon[30122]: pgmap v290: 97 pgs: 27 creating+peering, 70 active+clean; 578 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 675 B/s wr, 1 op/s 2024-05-09T00:58:41.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:41 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3737464781' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T00:58:41.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:41 smithi136 ceph-mon[34110]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T00:58:41.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:41 smithi136 ceph-mon[34110]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T00:58:41.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:41 smithi136 ceph-mon[34110]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T00:58:41.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:41 smithi136 ceph-mon[34110]: pgmap v290: 97 pgs: 27 creating+peering, 70 active+clean; 578 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 675 B/s wr, 1 op/s 2024-05-09T00:58:41.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:41 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3737464781' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T00:58:41.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:41 smithi151 ceph-mon[34780]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T00:58:41.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:41 smithi151 ceph-mon[34780]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T00:58:41.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:41 smithi151 ceph-mon[34780]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T00:58:41.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:41 smithi151 ceph-mon[34780]: pgmap v290: 97 pgs: 27 creating+peering, 70 active+clean; 578 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 675 B/s wr, 1 op/s 2024-05-09T00:58:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:42 smithi037 ceph-mon[30122]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-09T00:58:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:42 smithi037 ceph-mon[30122]: Cluster is now healthy 2024-05-09T00:58:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:42 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] up:active 2024-05-09T00:58:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:42 smithi037 ceph-mon[30122]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:42.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:42 smithi037 ceph-mon[30122]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:42 smithi136 ceph-mon[34110]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-09T00:58:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:42 smithi136 ceph-mon[34110]: Cluster is now healthy 2024-05-09T00:58:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:42 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] up:active 2024-05-09T00:58:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:42 smithi136 ceph-mon[34110]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:42 smithi136 ceph-mon[34110]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:42.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:42 smithi151 ceph-mon[34780]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-09T00:58:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:42 smithi151 ceph-mon[34780]: Cluster is now healthy 2024-05-09T00:58:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:42 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] up:active 2024-05-09T00:58:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:42 smithi151 ceph-mon[34780]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:42 smithi151 ceph-mon[34780]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 -- 172.21.15.37:0/2538872217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10103540 msgr2=0x7fba10103950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 --2- 172.21.15.37:0/2538872217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10103540 0x7fba10103950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba000099c0 tx=0x7fba00009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 -- 172.21.15.37:0/2538872217 shutdown_connections 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 --2- 172.21.15.37:0/2538872217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10108770 0x7fba101100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 --2- 172.21.15.37:0/2538872217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10103540 0x7fba10103950 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 --2- 172.21.15.37:0/2538872217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba10107e20 0x7fba10108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 -- 172.21.15.37:0/2538872217 >> 172.21.15.37:0/2538872217 conn(0x7fba10078e50 msgr2=0x7fba10079290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:43.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 -- 172.21.15.37:0/2538872217 shutdown_connections 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.300+0000 7fba148b1700 1 -- 172.21.15.37:0/2538872217 wait complete. 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 Processor -- start 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 -- start start 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10103540 0x7fba1019bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10107e20 0x7fba1019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba10108770 0x7fba1019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba101133a0 con 0x7fba10107e20 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fba10113220 con 0x7fba10103540 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba148b1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fba10113520 con 0x7fba10108770 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba0e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10103540 0x7fba1019bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba05d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10107e20 0x7fba1019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba0e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10103540 0x7fba1019bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:54834/0 (socket says 172.21.15.37:54834) 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba05d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10107e20 0x7fba1019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51098/0 (socket says 172.21.15.37:51098) 2024-05-09T00:58:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba0e59c700 1 -- 172.21.15.37:0/2730498293 learned_addr learned my addr 172.21.15.37:0/2730498293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.301+0000 7fba0ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba10108770 0x7fba1019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba05d9b700 1 -- 172.21.15.37:0/2730498293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba10108770 msgr2=0x7fba1019c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba05d9b700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba10108770 0x7fba1019c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba05d9b700 1 -- 172.21.15.37:0/2730498293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10103540 msgr2=0x7fba1019bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba05d9b700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10103540 0x7fba1019bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba05d9b700 1 -- 172.21.15.37:0/2730498293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba101a6f60 con 0x7fba10107e20 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba0e59c700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10103540 0x7fba1019bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba05d9b700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10107e20 0x7fba1019c1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800c940 tx=0x7fb9f800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba07fff700 1 -- 172.21.15.37:0/2730498293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8004a30 con 0x7fba10107e20 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba101a7250 con 0x7fba10107e20 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba07fff700 1 -- 172.21.15.37:0/2730498293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9f80054d0 con 0x7fba10107e20 2024-05-09T00:58:43.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba07fff700 1 -- 172.21.15.37:0/2730498293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f800eb60 con 0x7fba10107e20 2024-05-09T00:58:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.302+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba101a77e0 con 0x7fba10107e20 2024-05-09T00:58:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.303+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba100512c0 con 0x7fba10107e20 2024-05-09T00:58:43.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.305+0000 7fba07fff700 1 -- 172.21.15.37:0/2730498293 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb9f800ed00 con 0x7fba10107e20 2024-05-09T00:58:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.306+0000 7fba07fff700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb9fc0b2880 0x7fb9fc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.306+0000 7fba0e59c700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb9fc0b2880 0x7fb9fc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.306+0000 7fba07fff700 1 -- 172.21.15.37:0/2730498293 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fb9f80e1e90 con 0x7fba10107e20 2024-05-09T00:58:43.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.307+0000 7fba0e59c700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb9fc0b2880 0x7fb9fc0b4d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fba00003800 tx=0x7fba0001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:43.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.310+0000 7fba07fff700 1 -- 172.21.15.37:0/2730498293 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb9f8014030 con 0x7fba10107e20 2024-05-09T00:58:43.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:43 smithi037 ceph-mon[30122]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-05-09T00:58:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.527+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba10076010 con 0x7fba10107e20 2024-05-09T00:58:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.529+0000 7fba07fff700 1 -- 172.21.15.37:0/2730498293 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22194 (secure 0 0 0) 0x7fba10076010 con 0x7fba10107e20 2024-05-09T00:58:43.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:43.530 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":79,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:58:39.583002+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:58:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb9fc0b2880 msgr2=0x7fb9fc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb9fc0b2880 0x7fb9fc0b4d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fba00003800 tx=0x7fba0001a040 comp rx=0 tx=0).stop 2024-05-09T00:58:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10107e20 msgr2=0x7fba1019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10107e20 0x7fba1019c1e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800c940 tx=0x7fb9f800cc50 comp rx=0 tx=0).stop 2024-05-09T00:58:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 shutdown_connections 2024-05-09T00:58:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb9fc0b2880 0x7fb9fc0b4d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba10108770 0x7fba1019c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba10103540 0x7fba1019bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 --2- 172.21.15.37:0/2730498293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba10107e20 0x7fba1019c1e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 >> 172.21.15.37:0/2730498293 conn(0x7fba10078e50 msgr2=0x7fba10100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 shutdown_connections 2024-05-09T00:58:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:43.531+0000 7fba148b1700 1 -- 172.21.15.37:0/2730498293 wait complete. 2024-05-09T00:58:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:43 smithi136 ceph-mon[34110]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-05-09T00:58:43.628 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T00:58:43.243+0000 7f55249d0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:58:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:43 smithi151 ceph-mon[34780]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 2 op/s 2024-05-09T00:58:44.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:58:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:44.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:44 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2730498293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:58:44.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:44 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2730498293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:58:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:44 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2730498293' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:58:45.701 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:45 smithi037 ceph-mon[30122]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-05-09T00:58:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:45 smithi151 ceph-mon[34780]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-05-09T00:58:45.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:45 smithi136 ceph-mon[34110]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 3 op/s 2024-05-09T00:58:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4149838831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0108740 msgr2=0x7f16a01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4149838831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0108740 0x7f16a01100a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f169800b0d0 tx=0x7f169800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4149838831 shutdown_connections 2024-05-09T00:58:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4149838831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0108740 0x7f16a01100a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4149838831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a01034c0 0x7f16a01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4149838831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16a0107df0 0x7f16a0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4149838831 >> 172.21.15.37:0/4149838831 conn(0x7f16a00fedc0 msgr2=0x7f16a01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4149838831 shutdown_connections 2024-05-09T00:58:46.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.232+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4149838831 wait complete. 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 Processor -- start 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 -- start start 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a01034c0 0x7f16a019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0107df0 0x7f16a019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16a0108740 0x7f16a0199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0113370 con 0x7f16a0107df0 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01131f0 con 0x7f16a0108740 2024-05-09T00:58:46.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f16a5f3f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01134f0 con 0x7f16a01034c0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.233+0000 7f169effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0107df0 0x7f16a019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0107df0 0x7f16a019fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51110/0 (socket says 172.21.15.37:51110) 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 -- 172.21.15.37:0/4102493633 learned_addr learned my addr 172.21.15.37:0/4102493633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169ffff700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16a0108740 0x7f16a0199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169f7fe700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a01034c0 0x7f16a019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 -- 172.21.15.37:0/4102493633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a01034c0 msgr2=0x7f16a019f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a01034c0 0x7f16a019f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 -- 172.21.15.37:0/4102493633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16a0108740 msgr2=0x7f16a0199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16a0108740 0x7f16a0199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 -- 172.21.15.37:0/4102493633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a019a1b0 con 0x7f16a0107df0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169effd700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0107df0 0x7f16a019fdf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f169000c8f0 tx=0x7f169000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169cff9700 1 -- 172.21.15.37:0/4102493633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900078d0 con 0x7f16a0107df0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169cff9700 1 -- 172.21.15.37:0/4102493633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f169000f450 con 0x7f16a0107df0 2024-05-09T00:58:46.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a019a4a0 con 0x7f16a0107df0 2024-05-09T00:58:46.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f169cff9700 1 -- 172.21.15.37:0/4102493633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690018660 con 0x7f16a0107df0 2024-05-09T00:58:46.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.234+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a01a6740 con 0x7f16a0107df0 2024-05-09T00:58:46.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.235+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a00512c0 con 0x7f16a0107df0 2024-05-09T00:58:46.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.237+0000 7f169cff9700 1 -- 172.21.15.37:0/4102493633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f169000f900 con 0x7f16a0107df0 2024-05-09T00:58:46.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.238+0000 7f169cff9700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f168c0b2900 0x7f168c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:46.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.238+0000 7f169f7fe700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f168c0b2900 0x7f168c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:46.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.238+0000 7f169cff9700 1 -- 172.21.15.37:0/4102493633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f16900e1f20 con 0x7f16a0107df0 2024-05-09T00:58:46.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.239+0000 7f169f7fe700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f168c0b2900 0x7f168c0b4e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1688005950 tx=0x7f168800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:46.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.242+0000 7f169cff9700 1 -- 172.21.15.37:0/4102493633 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1690014030 con 0x7f16a0107df0 2024-05-09T00:58:46.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.457+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16a019afc0 con 0x7f16a0107df0 2024-05-09T00:58:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.458+0000 7f169cff9700 1 -- 172.21.15.37:0/4102493633 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+22194 (secure 0 0 0) 0x7f16900a97b0 con 0x7f16a0107df0 2024-05-09T00:58:46.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:58:46.459 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":79,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:58:39.583002+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f168c0b2900 msgr2=0x7f168c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f168c0b2900 0x7f168c0b4e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1688005950 tx=0x7f168800a300 comp rx=0 tx=0).stop 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0107df0 msgr2=0x7f16a019fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0107df0 0x7f16a019fdf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f169000c8f0 tx=0x7f169000cc00 comp rx=0 tx=0).stop 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 shutdown_connections 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f168c0b2900 0x7f168c0b4e10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16a0108740 0x7f16a0199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16a01034c0 0x7f16a019f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 --2- 172.21.15.37:0/4102493633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16a0107df0 0x7f16a019fdf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 >> 172.21.15.37:0/4102493633 conn(0x7f16a00fedc0 msgr2=0x7f16a0107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 shutdown_connections 2024-05-09T00:58:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:46.461+0000 7f16a5f3f700 1 -- 172.21.15.37:0/4102493633 wait complete. 2024-05-09T00:58:46.815 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:46 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4102493633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:58:46.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:46 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4102493633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:58:46.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:46 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4102493633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:58:47.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-09T00:58:47.410 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:47.844 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:47 smithi037 ceph-mon[30122]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-09T00:58:47.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:47 smithi136 ceph-mon[34110]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-09T00:58:47.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:47 smithi151 ceph-mon[34780]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 -- 172.21.15.37:0/1498051062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 msgr2=0x7fb85c109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 --2- 172.21.15.37:0/1498051062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c109340 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0099c0 tx=0x7fb84c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 -- 172.21.15.37:0/1498051062 shutdown_connections 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 --2- 172.21.15.37:0/1498051062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85c109880 0x7fb85c1111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 --2- 172.21.15.37:0/1498051062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb85c104650 0x7fb85c104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 --2- 172.21.15.37:0/1498051062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c109340 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 -- 172.21.15.37:0/1498051062 >> 172.21.15.37:0/1498051062 conn(0x7fb85c079f00 msgr2=0x7fb85c07a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 -- 172.21.15.37:0/1498051062 shutdown_connections 2024-05-09T00:58:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.180+0000 7fb86435e700 1 -- 172.21.15.37:0/1498051062 wait complete. 2024-05-09T00:58:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.181+0000 7fb86435e700 1 Processor -- start 2024-05-09T00:58:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.181+0000 7fb86435e700 1 -- start start 2024-05-09T00:58:49.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb86435e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85c104650 0x7fb85c075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb86435e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb86435e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb85c109880 0x7fb85c076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb86435e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c114490 con 0x7fb85c108f30 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb86435e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c114310 con 0x7fb85c109880 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb86435e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c114610 con 0x7fb85c104650 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51128/0 (socket says 172.21.15.37:51128) 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 -- 172.21.15.37:0/1023133925 learned_addr learned my addr 172.21.15.37:0/1023133925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8620fa700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85c104650 0x7fb85c075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8628fb700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb85c109880 0x7fb85c076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 -- 172.21.15.37:0/1023133925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85c104650 msgr2=0x7fb85c075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85c104650 0x7fb85c075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 -- 172.21.15.37:0/1023133925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb85c109880 msgr2=0x7fb85c076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb85c109880 0x7fb85c076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 -- 172.21.15.37:0/1023133925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c1a91e0 con 0x7fb85c108f30 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8628fb700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb85c109880 0x7fb85c076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.182+0000 7fb8618f9700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c076000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006010 tx=0x7fb84c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.183+0000 7fb8537fe700 1 -- 172.21.15.37:0/1023133925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c027070 con 0x7fb85c108f30 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.183+0000 7fb8537fe700 1 -- 172.21.15.37:0/1023133925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb84c003f20 con 0x7fb85c108f30 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.183+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c1a9470 con 0x7fb85c108f30 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.183+0000 7fb8537fe700 1 -- 172.21.15.37:0/1023133925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c022cd0 con 0x7fb85c108f30 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.183+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c1a98c0 con 0x7fb85c108f30 2024-05-09T00:58:49.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.184+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85c0512c0 con 0x7fb85c108f30 2024-05-09T00:58:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.185+0000 7fb8537fe700 1 -- 172.21.15.37:0/1023133925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb84c02a070 con 0x7fb85c108f30 2024-05-09T00:58:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.186+0000 7fb8537fe700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb8480b2880 0x7fb8480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.186+0000 7fb8620fa700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb8480b2880 0x7fb8480b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.186+0000 7fb8537fe700 1 -- 172.21.15.37:0/1023133925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fb84c0e3410 con 0x7fb85c108f30 2024-05-09T00:58:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.186+0000 7fb8620fa700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb8480b2880 0x7fb8480b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb858005950 tx=0x7fb85800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:49.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.189+0000 7fb8537fe700 1 -- 172.21.15.37:0/1023133925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb84c031080 con 0x7fb85c108f30 2024-05-09T00:58:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.456+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb85c02e5f0 con 0x7fb85c108f30 2024-05-09T00:58:49.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.938+0000 7fb8537fe700 1 -- 172.21.15.37:0/1023133925 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fb84c013070 con 0x7fb85c108f30 2024-05-09T00:58:49.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.940+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb8480b2880 msgr2=0x7fb8480b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:49.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.940+0000 7fb86435e700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb8480b2880 0x7fb8480b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb858005950 tx=0x7fb85800b410 comp rx=0 tx=0).stop 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.940+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 msgr2=0x7fb85c076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.940+0000 7fb86435e700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c076000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb84c006010 tx=0x7fb84c0047b0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 shutdown_connections 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb8480b2880 0x7fb8480b4d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb85c109880 0x7fb85c076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85c104650 0x7fb85c075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 --2- 172.21.15.37:0/1023133925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c108f30 0x7fb85c076000 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 >> 172.21.15.37:0/1023133925 conn(0x7fb85c079f00 msgr2=0x7fb85c102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 shutdown_connections 2024-05-09T00:58:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:49.941+0000 7fb86435e700 1 -- 172.21.15.37:0/1023133925 wait complete. 2024-05-09T00:58:50.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:49 smithi037 ceph-mon[30122]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-09T00:58:50.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:49 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1023133925' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T00:58:50.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:49 smithi151 ceph-mon[34780]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-09T00:58:50.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:49 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1023133925' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T00:58:50.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:49 smithi136 ceph-mon[34110]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-09T00:58:50.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:49 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1023133925' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T00:58:50.592 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-09T00:58:50.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-09T00:58:50.856 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:51.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:50 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1023133925' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T00:58:51.466 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:50 smithi037 ceph-mon[30122]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:51.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:50 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1023133925' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T00:58:51.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:50 smithi136 ceph-mon[34110]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:51.467 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:50 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1023133925' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T00:58:51.467 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:50 smithi151 ceph-mon[34780]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:51 smithi037 ceph-mon[30122]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-09T00:58:52.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:51 smithi151 ceph-mon[34780]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-09T00:58:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:51 smithi136 ceph-mon[34110]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-09T00:58:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 -- 172.21.15.37:0/3292882173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418108f20 msgr2=0x7f7418109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 --2- 172.21.15.37:0/3292882173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418108f20 0x7f7418109330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f74000099c0 tx=0x7f7400009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 -- 172.21.15.37:0/3292882173 shutdown_connections 2024-05-09T00:58:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 --2- 172.21.15.37:0/3292882173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7418109870 0x7f74181111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 --2- 172.21.15.37:0/3292882173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74181045f0 0x7f7418104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 --2- 172.21.15.37:0/3292882173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418108f20 0x7f7418109330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 -- 172.21.15.37:0/3292882173 >> 172.21.15.37:0/3292882173 conn(0x7f7418100040 msgr2=0x7f7418102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 -- 172.21.15.37:0/3292882173 shutdown_connections 2024-05-09T00:58:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.589+0000 7f741ea5c700 1 -- 172.21.15.37:0/3292882173 wait complete. 2024-05-09T00:58:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.590+0000 7f741ea5c700 1 Processor -- start 2024-05-09T00:58:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.590+0000 7f741ea5c700 1 -- start start 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741ea5c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74181045f0 0x7f741819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741ea5c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7418108f20 0x7f741819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741ea5c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418109870 0x7f741819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741ea5c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7418114480 con 0x7f7418109870 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741ea5c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7418114300 con 0x7f7418108f20 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741ea5c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7418114600 con 0x7f74181045f0 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418109870 0x7f741819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418109870 0x7f741819f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52024/0 (socket says 172.21.15.37:52024) 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 -- 172.21.15.37:0/2514387202 learned_addr learned my addr 172.21.15.37:0/2514387202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f7417fff700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74181045f0 0x7f741819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f740ffff700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7418108f20 0x7f741819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 -- 172.21.15.37:0/2514387202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74181045f0 msgr2=0x7f741819ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74181045f0 0x7f741819ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 -- 172.21.15.37:0/2514387202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7418108f20 msgr2=0x7f741819b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7418108f20 0x7f741819b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f741cff9700 1 -- 172.21.15.37:0/2514387202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741819fd00 con 0x7f7418109870 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.591+0000 7f740ffff700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7418108f20 0x7f741819b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.592+0000 7f741cff9700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418109870 0x7f741819f660 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7410007ee0 tx=0x7f741000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.592+0000 7f7415ffb700 1 -- 172.21.15.37:0/2514387202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741000dbd0 con 0x7f7418109870 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.592+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741819fff0 con 0x7f7418109870 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.592+0000 7f7415ffb700 1 -- 172.21.15.37:0/2514387202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f741000dd70 con 0x7f7418109870 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.592+0000 7f7415ffb700 1 -- 172.21.15.37:0/2514387202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410005990 con 0x7f7418109870 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.592+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74181a7910 con 0x7f7418109870 2024-05-09T00:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.593+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74180512c0 con 0x7f7418109870 2024-05-09T00:58:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.595+0000 7f7415ffb700 1 -- 172.21.15.37:0/2514387202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f741001a020 con 0x7f7418109870 2024-05-09T00:58:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.595+0000 7f7415ffb700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f74040b2880 0x7f74040b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.595+0000 7f7417fff700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f74040b2880 0x7f74040b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:52.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.595+0000 7f7415ffb700 1 -- 172.21.15.37:0/2514387202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f74100e1fa0 con 0x7f7418109870 2024-05-09T00:58:52.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.596+0000 7f7417fff700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f74040b2880 0x7f74040b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7408005fd0 tx=0x7f740800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:52.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.599+0000 7f7415ffb700 1 -- 172.21.15.37:0/2514387202 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7410010070 con 0x7f7418109870 2024-05-09T00:58:52.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.857+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f741802e5f0 con 0x7f7418109870 2024-05-09T00:58:52.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.959+0000 7f7415ffb700 1 -- 172.21.15.37:0/2514387202 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f74100a9e10 con 0x7f7418109870 2024-05-09T00:58:52.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f74040b2880 msgr2=0x7f74040b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:52.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f74040b2880 0x7f74040b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7408005fd0 tx=0x7f740800a560 comp rx=0 tx=0).stop 2024-05-09T00:58:52.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418109870 msgr2=0x7f741819f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418109870 0x7f741819f660 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7410007ee0 tx=0x7f741000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 shutdown_connections 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f74040b2880 0x7f74040b4d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7418109870 0x7f741819f660 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74181045f0 0x7f741819ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 --2- 172.21.15.37:0/2514387202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7418108f20 0x7f741819b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 >> 172.21.15.37:0/2514387202 conn(0x7f7418100040 msgr2=0x7f7418108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.962+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 shutdown_connections 2024-05-09T00:58:52.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:52.963+0000 7f741ea5c700 1 -- 172.21.15.37:0/2514387202 wait complete. 2024-05-09T00:58:53.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:52 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2514387202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-09T00:58:53.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:52 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2514387202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-09T00:58:53.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:52 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2514387202' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-09T00:58:53.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-09T00:58:53.935 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:53 smithi037 ceph-mon[30122]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 2 op/s 2024-05-09T00:58:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:53 smithi037 ceph-mon[30122]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:58:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:53 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2514387202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-09T00:58:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:53 smithi037 ceph-mon[30122]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T00:58:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:53 smithi037 ceph-mon[30122]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:53 smithi037 ceph-mon[30122]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-09T00:58:54.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:53 smithi037 ceph-mon[30122]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-09T00:58:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:53 smithi151 ceph-mon[34780]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 2 op/s 2024-05-09T00:58:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:53 smithi151 ceph-mon[34780]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:58:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:53 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2514387202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-09T00:58:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:53 smithi151 ceph-mon[34780]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T00:58:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:53 smithi151 ceph-mon[34780]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:53 smithi151 ceph-mon[34780]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-09T00:58:54.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:53 smithi151 ceph-mon[34780]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-09T00:58:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:53 smithi136 ceph-mon[34110]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 2 op/s 2024-05-09T00:58:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:53 smithi136 ceph-mon[34110]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:58:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:53 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2514387202' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-09T00:58:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:53 smithi136 ceph-mon[34110]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T00:58:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:53 smithi136 ceph-mon[34110]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:58:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:53 smithi136 ceph-mon[34110]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-09T00:58:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:53 smithi136 ceph-mon[34110]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-09T00:58:55.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:54 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] up:active 2024-05-09T00:58:55.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:54 smithi037 ceph-mon[30122]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T00:58:55.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:54 smithi037 ceph-mon[30122]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-09T00:58:55.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:54 smithi037 ceph-mon[30122]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-09T00:58:55.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:54 smithi037 ceph-mon[30122]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-09T00:58:55.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:54 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] up:active 2024-05-09T00:58:55.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:54 smithi151 ceph-mon[34780]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T00:58:55.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:54 smithi151 ceph-mon[34780]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-09T00:58:55.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:54 smithi151 ceph-mon[34780]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-09T00:58:55.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:54 smithi151 ceph-mon[34780]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-09T00:58:55.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:54 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] up:active 2024-05-09T00:58:55.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:54 smithi136 ceph-mon[34110]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T00:58:55.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:54 smithi136 ceph-mon[34110]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-09T00:58:55.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:54 smithi136 ceph-mon[34110]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-05-09T00:58:55.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:54 smithi136 ceph-mon[34110]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-05-09T00:58:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 -- 172.21.15.37:0/2087428018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c108d30 msgr2=0x7f333c109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 --2- 172.21.15.37:0/2087428018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c108d30 0x7f333c109140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f332c0099c0 tx=0x7f332c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 -- 172.21.15.37:0/2087428018 shutdown_connections 2024-05-09T00:58:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 --2- 172.21.15.37:0/2087428018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333c109680 0x7f333c110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 --2- 172.21.15.37:0/2087428018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 0x7f333c104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 --2- 172.21.15.37:0/2087428018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c108d30 0x7f333c109140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 -- 172.21.15.37:0/2087428018 >> 172.21.15.37:0/2087428018 conn(0x7f333c079d10 msgr2=0x7f333c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 -- 172.21.15.37:0/2087428018 shutdown_connections 2024-05-09T00:58:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.675+0000 7f33427a0700 1 -- 172.21.15.37:0/2087428018 wait complete. 2024-05-09T00:58:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 Processor -- start 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 -- start start 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 0x7f333c1a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333c108d30 0x7f333c1a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c109680 0x7f333c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f333c114300 con 0x7f333c109680 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f333c114180 con 0x7f333c104400 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f33427a0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f333c114480 con 0x7f333c108d30 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f334179e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 0x7f333c1a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f334179e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 0x7f333c1a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44918/0 (socket says 172.21.15.37:44918) 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f334179e700 1 -- 172.21.15.37:0/1119601574 learned_addr learned my addr 172.21.15.37:0/1119601574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.676+0000 7f3340f9d700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333c108d30 0x7f333c1a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.677+0000 7f3341f9f700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c109680 0x7f333c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.677+0000 7f334179e700 1 -- 172.21.15.37:0/1119601574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333c108d30 msgr2=0x7f333c1a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.677+0000 7f334179e700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333c108d30 0x7f333c1a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.677+0000 7f334179e700 1 -- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c109680 msgr2=0x7f333c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.677+0000 7f334179e700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c109680 0x7f333c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.677+0000 7f334179e700 1 -- 172.21.15.37:0/1119601574 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c19b170 con 0x7f333c104400 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.677+0000 7f334179e700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 0x7f333c1a08a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f333800d950 tx=0x7f333800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.678+0000 7f33327fc700 1 -- 172.21.15.37:0/1119601574 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338016070 con 0x7f333c104400 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.678+0000 7f33327fc700 1 -- 172.21.15.37:0/1119601574 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f333800fd40 con 0x7f333c104400 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.678+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c19b460 con 0x7f333c104400 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.678+0000 7f33327fc700 1 -- 172.21.15.37:0/1119601574 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333800e3b0 con 0x7f333c104400 2024-05-09T00:58:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.678+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c1a7730 con 0x7f333c104400 2024-05-09T00:58:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.679+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f333c0512c0 con 0x7f333c104400 2024-05-09T00:58:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.681+0000 7f33327fc700 1 -- 172.21.15.37:0/1119601574 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3338019070 con 0x7f333c104400 2024-05-09T00:58:55.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.682+0000 7f33327fc700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33280b2880 0x7f33280b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:55.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.682+0000 7f3340f9d700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33280b2880 0x7f33280b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:55.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.682+0000 7f33327fc700 1 -- 172.21.15.37:0/1119601574 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f33380e1f70 con 0x7f333c104400 2024-05-09T00:58:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.682+0000 7f3340f9d700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33280b2880 0x7f33280b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f332c006010 tx=0x7f332c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:55.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.685+0000 7f33327fc700 1 -- 172.21.15.37:0/1119601574 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f33380a9d40 con 0x7f333c104400 2024-05-09T00:58:55.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.948+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f333c02e5f0 con 0x7f333c104400 2024-05-09T00:58:55.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.991+0000 7f33327fc700 1 -- 172.21.15.37:0/1119601574 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f33380a9640 con 0x7f333c104400 2024-05-09T00:58:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33280b2880 msgr2=0x7f33280b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33280b2880 0x7f33280b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f332c006010 tx=0x7f332c000bc0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 msgr2=0x7f333c1a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 0x7f333c1a08a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f333800d950 tx=0x7f333800dc60 comp rx=0 tx=0).stop 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 shutdown_connections 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33280b2880 0x7f33280b4d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f333c109680 0x7f333c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f333c104400 0x7f333c1a08a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 --2- 172.21.15.37:0/1119601574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333c108d30 0x7f333c1a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 >> 172.21.15.37:0/1119601574 conn(0x7f333c079d10 msgr2=0x7f333c101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.994+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 shutdown_connections 2024-05-09T00:58:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:55.995+0000 7f33427a0700 1 -- 172.21.15.37:0/1119601574 wait complete. 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 4 op/s 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] up:active 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1119601574' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:58:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:55 smithi037 ceph-mon[30122]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 4 op/s 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] up:active 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1119601574' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:58:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:55 smithi136 ceph-mon[34110]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:58:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 4 op/s 2024-05-09T00:58:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] up:active 2024-05-09T00:58:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-09T00:58:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-05-09T00:58:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-05-09T00:58:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-05-09T00:58:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1119601574' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:58:56.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:55 smithi151 ceph-mon[34780]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:58:56.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-09T00:58:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:58:57.279 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T00:58:57.279 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] up:active 2024-05-09T00:58:57.279 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-09T00:58:57.279 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:58:57.279 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: Cluster is now healthy 2024-05-09T00:58:57.279 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-05-09T00:58:57.280 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-09T00:58:57.280 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:56 smithi037 ceph-mon[30122]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] up:active 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: Cluster is now healthy 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-09T00:58:57.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:56 smithi136 ceph-mon[34110]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] up:active 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: Cluster is now healthy 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 8 up:standby 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-09T00:58:57.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:56 smithi151 ceph-mon[34780]: daemon mds.c is now active in filesystem cephfs as rank 4 2024-05-09T00:58:58.258 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:57 smithi037 ceph-mon[30122]: pgmap v298: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 10 op/s 2024-05-09T00:58:58.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:57 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] up:active 2024-05-09T00:58:58.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:57 smithi037 ceph-mon[30122]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-09T00:58:58.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:57 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T00:58:58.378 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 00:58:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T00:58:58.245+0000 7f55249d0700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-09T00:58:58.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:57 smithi136 ceph-mon[34110]: pgmap v298: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 10 op/s 2024-05-09T00:58:58.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:57 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] up:active 2024-05-09T00:58:58.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:57 smithi136 ceph-mon[34110]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-09T00:58:58.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:57 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T00:58:58.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:57 smithi151 ceph-mon[34780]: pgmap v298: 97 pgs: 97 active+clean; 582 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 10 op/s 2024-05-09T00:58:58.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:57 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] up:active 2024-05-09T00:58:58.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:57 smithi151 ceph-mon[34780]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-09T00:58:58.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:57 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T00:58:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 -- 172.21.15.37:0/3257084451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 msgr2=0x7f3dbc108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/3257084451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc108200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3db00099c0 tx=0x7f3db0009cd0 comp rx=0 tx=0).stop 2024-05-09T00:58:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 -- 172.21.15.37:0/3257084451 shutdown_connections 2024-05-09T00:58:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/3257084451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dbc108740 0x7f3dbc1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/3257084451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dbc1034c0 0x7f3dbc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/3257084451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc108200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 -- 172.21.15.37:0/3257084451 >> 172.21.15.37:0/3257084451 conn(0x7f3dbc0fedf0 msgr2=0x7f3dbc101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 -- 172.21.15.37:0/3257084451 shutdown_connections 2024-05-09T00:58:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.653+0000 7f3dc0b72700 1 -- 172.21.15.37:0/3257084451 wait complete. 2024-05-09T00:58:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 Processor -- start 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 -- start start 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dbc1034c0 0x7f3dbc0ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc0ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dbc108740 0x7f3dbc0ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc113350 con 0x7f3dbc107df0 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc1131d0 con 0x7f3dbc108740 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3dc0b72700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc1134d0 con 0x7f3dbc1034c0 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.654+0000 7f3db9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc0ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc0ff810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52062/0 (socket says 172.21.15.37:52062) 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 -- 172.21.15.37:0/4264673363 learned_addr learned my addr 172.21.15.37:0/4264673363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3dbad9d700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dbc108740 0x7f3dbc0ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3dba59c700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dbc1034c0 0x7f3dbc0ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 -- 172.21.15.37:0/4264673363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dbc1034c0 msgr2=0x7f3dbc0ff2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dbc1034c0 0x7f3dbc0ff2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 -- 172.21.15.37:0/4264673363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dbc108740 msgr2=0x7f3dbc0ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dbc108740 0x7f3dbc0ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 -- 172.21.15.37:0/4264673363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc1a91d0 con 0x7f3dbc107df0 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3db9d9b700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc0ff810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3db00098e0 tx=0x7f3db00057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3dab7fe700 1 -- 172.21.15.37:0/4264673363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0027070 con 0x7f3dbc107df0 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc1a9460 con 0x7f3dbc107df0 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3dab7fe700 1 -- 172.21.15.37:0/4264673363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3db0003f20 con 0x7f3dbc107df0 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3dab7fe700 1 -- 172.21.15.37:0/4264673363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0022c70 con 0x7f3dbc107df0 2024-05-09T00:58:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.655+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc1a98b0 con 0x7f3dbc107df0 2024-05-09T00:58:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.656+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc0512c0 con 0x7f3dbc107df0 2024-05-09T00:58:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.658+0000 7f3dab7fe700 1 -- 172.21.15.37:0/4264673363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3db002a070 con 0x7f3dbc107df0 2024-05-09T00:58:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.659+0000 7f3dab7fe700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3da40b2880 0x7f3da40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:58:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.659+0000 7f3dba59c700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3da40b2880 0x7f3da40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:58:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.659+0000 7f3dab7fe700 1 -- 172.21.15.37:0/4264673363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f3db00e3720 con 0x7f3dbc107df0 2024-05-09T00:58:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.660+0000 7f3dba59c700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3da40b2880 0x7f3da40b4d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3dac007be0 tx=0x7f3dac0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:58:58.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.663+0000 7f3dab7fe700 1 -- 172.21.15.37:0/4264673363 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3db0031080 con 0x7f3dbc107df0 2024-05-09T00:58:58.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:58.932+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f3dbc02e7b0 con 0x7f3dbc107df0 2024-05-09T00:58:59.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.005+0000 7f3dab7fe700 1 -- 172.21.15.37:0/4264673363 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f3db0013070 con 0x7f3dbc107df0 2024-05-09T00:58:59.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3da40b2880 msgr2=0x7f3da40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:59.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3da40b2880 0x7f3da40b4d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3dac007be0 tx=0x7f3dac0073d0 comp rx=0 tx=0).stop 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 msgr2=0x7f3dbc0ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc0ff810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3db00098e0 tx=0x7f3db00057c0 comp rx=0 tx=0).stop 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 shutdown_connections 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3da40b2880 0x7f3da40b4d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dbc108740 0x7f3dbc0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dbc1034c0 0x7f3dbc0ff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 --2- 172.21.15.37:0/4264673363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc107df0 0x7f3dbc0ff810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 >> 172.21.15.37:0/4264673363 conn(0x7f3dbc0fedf0 msgr2=0x7f3dbc075cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 shutdown_connections 2024-05-09T00:58:59.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:58:59.008+0000 7f3dc0b72700 1 -- 172.21.15.37:0/4264673363 wait complete. 2024-05-09T00:58:59.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:58:58 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4264673363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T00:58:59.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:58:59 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4264673363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T00:58:59.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:58:59 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4264673363' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T00:58:59.701 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-09T00:58:59.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-09T00:58:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:00.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:00 smithi136 ceph-mon[34110]: pgmap v299: 97 pgs: 97 active+clean; 583 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-05-09T00:59:00.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:00 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4264673363' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T00:59:00.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:00 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T00:59:00.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:00 smithi037 ceph-mon[30122]: pgmap v299: 97 pgs: 97 active+clean; 583 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-05-09T00:59:00.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:00 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4264673363' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T00:59:00.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:00 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T00:59:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:00 smithi151 ceph-mon[34780]: pgmap v299: 97 pgs: 97 active+clean; 583 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.0 KiB/s wr, 10 op/s 2024-05-09T00:59:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:00 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4264673363' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T00:59:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:00 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 -- 172.21.15.37:0/576432857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964109850 msgr2=0x7fb9641111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 --2- 172.21.15.37:0/576432857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964109850 0x7fb9641111b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00b0d0 tx=0x7fb95c00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 -- 172.21.15.37:0/576432857 shutdown_connections 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 --2- 172.21.15.37:0/576432857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964109850 0x7fb9641111b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 --2- 172.21.15.37:0/576432857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb964102ae0 0x7fb964102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 --2- 172.21.15.37:0/576432857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb964108f00 0x7fb964109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 -- 172.21.15.37:0/576432857 >> 172.21.15.37:0/576432857 conn(0x7fb9640fe520 msgr2=0x7fb964100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 -- 172.21.15.37:0/576432857 shutdown_connections 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.473+0000 7fb96a771700 1 -- 172.21.15.37:0/576432857 wait complete. 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.474+0000 7fb96a771700 1 Processor -- start 2024-05-09T00:59:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.474+0000 7fb96a771700 1 -- start start 2024-05-09T00:59:01.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.474+0000 7fb96a771700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb964102ae0 0x7fb96419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:01.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb96a771700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964108f00 0x7fb96419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:01.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb96a771700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb964109850 0x7fb96419f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:01.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb96a771700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb964114570 con 0x7fb964108f00 2024-05-09T00:59:01.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb96a771700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb9641143f0 con 0x7fb964102ae0 2024-05-09T00:59:01.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb96a771700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb9641146f0 con 0x7fb964109850 2024-05-09T00:59:01.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964108f00 0x7fb96419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964108f00 0x7fb96419b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52086/0 (socket says 172.21.15.37:52086) 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 -- 172.21.15.37:0/3896435847 learned_addr learned my addr 172.21.15.37:0/3896435847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb963fff700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb964102ae0 0x7fb96419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb968d0e700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb964109850 0x7fb96419f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 -- 172.21.15.37:0/3896435847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb964109850 msgr2=0x7fb96419f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb964109850 0x7fb96419f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 -- 172.21.15.37:0/3896435847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb964102ae0 msgr2=0x7fb96419af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb964102ae0 0x7fb96419af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 -- 172.21.15.37:0/3896435847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96419fdf0 con 0x7fb964108f00 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9637fe700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964108f00 0x7fb96419b4c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb95800b500 tx=0x7fb95800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9617fa700 1 -- 172.21.15.37:0/3896435847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958015020 con 0x7fb964108f00 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb9617fa700 1 -- 172.21.15.37:0/3896435847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb958011ce0 con 0x7fb964108f00 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.475+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9641a00e0 con 0x7fb964108f00 2024-05-09T00:59:01.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.476+0000 7fb9617fa700 1 -- 172.21.15.37:0/3896435847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958010cb0 con 0x7fb964108f00 2024-05-09T00:59:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.476+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9641a7a00 con 0x7fb964108f00 2024-05-09T00:59:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.476+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9640512c0 con 0x7fb964108f00 2024-05-09T00:59:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.478+0000 7fb9617fa700 1 -- 172.21.15.37:0/3896435847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb958018020 con 0x7fb964108f00 2024-05-09T00:59:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.479+0000 7fb9617fa700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb94c0b2880 0x7fb94c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.479+0000 7fb9617fa700 1 -- 172.21.15.37:0/3896435847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fb9580e1d40 con 0x7fb964108f00 2024-05-09T00:59:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.479+0000 7fb963fff700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb94c0b2880 0x7fb94c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.480+0000 7fb963fff700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb94c0b2880 0x7fb94c0b4d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb954009a10 tx=0x7fb954009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:01.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.483+0000 7fb9617fa700 1 -- 172.21.15.37:0/3896435847 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb95801f020 con 0x7fb964108f00 2024-05-09T00:59:01.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.729+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb96419c280 con 0x7fb94c0b2880 2024-05-09T00:59:01.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.760+0000 7fb9617fa700 1 -- 172.21.15.37:0/3896435847 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb96419c280 con 0x7fb94c0b2880 2024-05-09T00:59:01.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb94c0b2880 msgr2=0x7fb94c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:01.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb94c0b2880 0x7fb94c0b4d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb954009a10 tx=0x7fb954009190 comp rx=0 tx=0).stop 2024-05-09T00:59:01.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964108f00 msgr2=0x7fb96419b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:01.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964108f00 0x7fb96419b4c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb95800b500 tx=0x7fb95800b810 comp rx=0 tx=0).stop 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 shutdown_connections 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb94c0b2880 0x7fb94c0b4d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb964109850 0x7fb96419f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb964102ae0 0x7fb96419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 --2- 172.21.15.37:0/3896435847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964108f00 0x7fb96419b4c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 >> 172.21.15.37:0/3896435847 conn(0x7fb9640fe520 msgr2=0x7fb96410a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.762+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 shutdown_connections 2024-05-09T00:59:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:01.763+0000 7fb96a771700 1 -- 172.21.15.37:0/3896435847 wait complete. 2024-05-09T00:59:02.019 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:59:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:59:01.734+0000 7f840d5ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:59:02.019 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:59:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:59:01.734+0000 7f840d5ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:59:02.019 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:59:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:59:01.734+0000 7f840d5ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:59:02.019 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:59:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:59:01.734+0000 7f840d5ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:59:02.019 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 00:59:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x[30352]: 2024-05-09T00:59:01.734+0000 7f840d5ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:59:02.277 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:02 smithi151 ceph-mon[34780]: pgmap v300: 97 pgs: 97 active+clean; 584 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-09T00:59:02.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:02 smithi136 ceph-mon[34110]: pgmap v300: 97 pgs: 97 active+clean; 584 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-09T00:59:02.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:02 smithi037 ceph-mon[30122]: pgmap v300: 97 pgs: 97 active+clean; 584 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-09T00:59:02.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-09T00:59:02.884 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:03.335 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:03 smithi037 ceph-mon[30122]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:03.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:03 smithi136 ceph-mon[34110]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:03.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:03 smithi151 ceph-mon[34780]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:04.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:04 smithi037 ceph-mon[30122]: pgmap v301: 97 pgs: 97 active+clean; 584 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-09T00:59:04.368 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:04 smithi037 ceph-mon[30122]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-09T00:59:04.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:04 smithi136 ceph-mon[34110]: pgmap v301: 97 pgs: 97 active+clean; 584 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-09T00:59:04.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:04 smithi136 ceph-mon[34110]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-09T00:59:04.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:04 smithi151 ceph-mon[34780]: pgmap v301: 97 pgs: 97 active+clean; 584 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-09T00:59:04.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:04 smithi151 ceph-mon[34780]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-09T00:59:04.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.630+0000 7fa603edb700 1 -- 172.21.15.37:0/3169721265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 msgr2=0x7fa5fc104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.630+0000 7fa603edb700 1 --2- 172.21.15.37:0/3169721265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc104a60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400b0d0 tx=0x7fa5f400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.630+0000 7fa603edb700 1 -- 172.21.15.37:0/3169721265 shutdown_connections 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.630+0000 7fa603edb700 1 --2- 172.21.15.37:0/3169721265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5fc109880 0x7fa5fc1111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.630+0000 7fa603edb700 1 --2- 172.21.15.37:0/3169721265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc104a60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.630+0000 7fa603edb700 1 --2- 172.21.15.37:0/3169721265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5fc108f30 0x7fa5fc109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.630+0000 7fa603edb700 1 -- 172.21.15.37:0/3169721265 >> 172.21.15.37:0/3169721265 conn(0x7fa5fc079f00 msgr2=0x7fa5fc07a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.631+0000 7fa603edb700 1 -- 172.21.15.37:0/3169721265 shutdown_connections 2024-05-09T00:59:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.631+0000 7fa603edb700 1 -- 172.21.15.37:0/3169721265 wait complete. 2024-05-09T00:59:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.631+0000 7fa603edb700 1 Processor -- start 2024-05-09T00:59:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.631+0000 7fa603edb700 1 -- start start 2024-05-09T00:59:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa603edb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa603edb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5fc108f30 0x7fa5fc076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa603edb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5fc109880 0x7fa5fc076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa603edb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc114520 con 0x7fa5fc104650 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa603edb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1143a0 con 0x7fa5fc109880 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa603edb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc1146a0 con 0x7fa5fc108f30 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48910/0 (socket says 172.21.15.37:48910) 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 -- 172.21.15.37:0/3000281093 learned_addr learned my addr 172.21.15.37:0/3000281093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601476700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5fc108f30 0x7fa5fc076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 -- 172.21.15.37:0/3000281093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5fc108f30 msgr2=0x7fa5fc076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5fc108f30 0x7fa5fc076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 -- 172.21.15.37:0/3000281093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5fc109880 msgr2=0x7fa5fc076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5fc109880 0x7fa5fc076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 -- 172.21.15.37:0/3000281093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc1a9270 con 0x7fa5fc104650 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.632+0000 7fa601c77700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc075ac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400d010 tx=0x7fa5f4007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.633+0000 7fa5faffd700 1 -- 172.21.15.37:0/3000281093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f401f070 con 0x7fa5fc104650 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.633+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc1a9500 con 0x7fa5fc104650 2024-05-09T00:59:04.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.633+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc1a99b0 con 0x7fa5fc104650 2024-05-09T00:59:04.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.633+0000 7fa5faffd700 1 -- 172.21.15.37:0/3000281093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5f4003c00 con 0x7fa5fc104650 2024-05-09T00:59:04.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.633+0000 7fa5faffd700 1 -- 172.21.15.37:0/3000281093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f401b6a0 con 0x7fa5fc104650 2024-05-09T00:59:04.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.634+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e8005330 con 0x7fa5fc104650 2024-05-09T00:59:04.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.635+0000 7fa5faffd700 1 -- 172.21.15.37:0/3000281093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa5f4022070 con 0x7fa5fc104650 2024-05-09T00:59:04.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.636+0000 7fa5faffd700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e40b2990 0x7fa5e40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:04.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.636+0000 7fa601476700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e40b2990 0x7fa5e40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:04.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.636+0000 7fa5faffd700 1 -- 172.21.15.37:0/3000281093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fa5f400f020 con 0x7fa5fc104650 2024-05-09T00:59:04.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.637+0000 7fa601476700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e40b2990 0x7fa5e40b4ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:04.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.640+0000 7fa5faffd700 1 -- 172.21.15.37:0/3000281093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa5f4029020 con 0x7fa5fc104650 2024-05-09T00:59:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.888+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa5e8000bc0 con 0x7fa5e40b2990 2024-05-09T00:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.918+0000 7fa5faffd700 1 -- 172.21.15.37:0/3000281093 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa5e8000bc0 con 0x7fa5e40b2990 2024-05-09T00:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e40b2990 msgr2=0x7fa5e40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e40b2990 0x7fa5e40b4ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0006fd0 tx=0x7fa5f0008040 comp rx=0 tx=0).stop 2024-05-09T00:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 msgr2=0x7fa5fc075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc075ac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5f400d010 tx=0x7fa5f4007ad0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 shutdown_connections 2024-05-09T00:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e40b2990 0x7fa5e40b4ea0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5fc109880 0x7fa5fc076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5fc104650 0x7fa5fc075ac0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 --2- 172.21.15.37:0/3000281093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5fc108f30 0x7fa5fc076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 >> 172.21.15.37:0/3000281093 conn(0x7fa5fc079f00 msgr2=0x7fa5fc102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.920+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 shutdown_connections 2024-05-09T00:59:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:04.921+0000 7fa603edb700 1 -- 172.21.15.37:0/3000281093 wait complete. 2024-05-09T00:59:05.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-09T00:59:05.906 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:06.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:06 smithi037 ceph-mon[30122]: pgmap v302: 97 pgs: 97 active+clean; 585 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.1 KiB/s wr, 20 op/s 2024-05-09T00:59:06.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:06 smithi037 ceph-mon[30122]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:06.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:06 smithi136 ceph-mon[34110]: pgmap v302: 97 pgs: 97 active+clean; 585 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.1 KiB/s wr, 20 op/s 2024-05-09T00:59:06.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:06 smithi136 ceph-mon[34110]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:06.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:06 smithi151 ceph-mon[34780]: pgmap v302: 97 pgs: 97 active+clean; 585 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.1 KiB/s wr, 20 op/s 2024-05-09T00:59:06.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:06 smithi151 ceph-mon[34780]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 -- 172.21.15.37:0/3165939032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5001034e0 msgr2=0x7fd5001038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 --2- 172.21.15.37:0/3165939032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5001034e0 0x7fd5001038f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00099c0 tx=0x7fd4f0009cd0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 -- 172.21.15.37:0/3165939032 shutdown_connections 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 --2- 172.21.15.37:0/3165939032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd500108760 0x7fd5001100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 --2- 172.21.15.37:0/3165939032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5001034e0 0x7fd5001038f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 --2- 172.21.15.37:0/3165939032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd500107e10 0x7fd500108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 -- 172.21.15.37:0/3165939032 >> 172.21.15.37:0/3165939032 conn(0x7fd5000fef50 msgr2=0x7fd500101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 -- 172.21.15.37:0/3165939032 shutdown_connections 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.696+0000 7fd505026700 1 -- 172.21.15.37:0/3165939032 wait complete. 2024-05-09T00:59:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.697+0000 7fd505026700 1 Processor -- start 2024-05-09T00:59:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.697+0000 7fd505026700 1 -- start start 2024-05-09T00:59:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.697+0000 7fd505026700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5001034e0 0x7fd500199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd505026700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd500107e10 0x7fd50019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd505026700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd500108760 0x7fd50019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd505026700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd500113390 con 0x7fd500107e10 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd505026700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd500113210 con 0x7fd500108760 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd505026700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd500113510 con 0x7fd5001034e0 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd500107e10 0x7fd50019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd500107e10 0x7fd50019a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48934/0 (socket says 172.21.15.37:48934) 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 -- 172.21.15.37:0/599897485 learned_addr learned my addr 172.21.15.37:0/599897485 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4ff59e700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd500108760 0x7fd50019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fed9d700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5001034e0 0x7fd500199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 -- 172.21.15.37:0/599897485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5001034e0 msgr2=0x7fd500199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5001034e0 0x7fd500199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 -- 172.21.15.37:0/599897485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd500108760 msgr2=0x7fd50019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd500108760 0x7fd50019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 -- 172.21.15.37:0/599897485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50019ec50 con 0x7fd500107e10 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4ff59e700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd500108760 0x7fd50019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4fe59c700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd500107e10 0x7fd50019a320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400d980 tx=0x7fd4f400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4e7fff700 1 -- 172.21.15.37:0/599897485 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4017070 con 0x7fd500107e10 2024-05-09T00:59:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50019ef40 con 0x7fd500107e10 2024-05-09T00:59:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.698+0000 7fd4e7fff700 1 -- 172.21.15.37:0/599897485 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f4010460 con 0x7fd500107e10 2024-05-09T00:59:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.699+0000 7fd4e7fff700 1 -- 172.21.15.37:0/599897485 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400de60 con 0x7fd500107e10 2024-05-09T00:59:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.699+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5001a6860 con 0x7fd500107e10 2024-05-09T00:59:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.700+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5000512c0 con 0x7fd500107e10 2024-05-09T00:59:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.701+0000 7fd4e7fff700 1 -- 172.21.15.37:0/599897485 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd4f4010610 con 0x7fd500107e10 2024-05-09T00:59:07.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.702+0000 7fd4e7fff700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4e80b2910 0x7fd4e80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:07.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.702+0000 7fd4fed9d700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4e80b2910 0x7fd4e80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:07.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.702+0000 7fd4e7fff700 1 -- 172.21.15.37:0/599897485 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fd4f40e1e90 con 0x7fd500107e10 2024-05-09T00:59:07.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.703+0000 7fd4fed9d700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4e80b2910 0x7fd4e80b4e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0003800 tx=0x7fd4f001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:07.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.706+0000 7fd4e7fff700 1 -- 172.21.15.37:0/599897485 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd4f40a9b00 con 0x7fd500107e10 2024-05-09T00:59:07.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.956+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd50019b0e0 con 0x7fd4e80b2910 2024-05-09T00:59:07.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.961+0000 7fd4e7fff700 1 -- 172.21.15.37:0/599897485 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd50019b0e0 con 0x7fd4e80b2910 2024-05-09T00:59:07.962 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_0/a07a5cc0-1e5f-44b6-90cd-16d48ba5e4ae 2024-05-09T00:59:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4e80b2910 msgr2=0x7fd4e80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4e80b2910 0x7fd4e80b4e20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0003800 tx=0x7fd4f001a040 comp rx=0 tx=0).stop 2024-05-09T00:59:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd500107e10 msgr2=0x7fd50019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:07.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd500107e10 0x7fd50019a320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400d980 tx=0x7fd4f400dd40 comp rx=0 tx=0).stop 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 shutdown_connections 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4e80b2910 0x7fd4e80b4e20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd500108760 0x7fd50019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5001034e0 0x7fd500199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 --2- 172.21.15.37:0/599897485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd500107e10 0x7fd50019a320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.963+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 >> 172.21.15.37:0/599897485 conn(0x7fd5000fef50 msgr2=0x7fd500107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.964+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 shutdown_connections 2024-05-09T00:59:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:07.964+0000 7fd505026700 1 -- 172.21.15.37:0/599897485 wait complete. 2024-05-09T00:59:08.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:08 smithi037 ceph-mon[30122]: pgmap v303: 97 pgs: 97 active+clean; 605 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 22 op/s 2024-05-09T00:59:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:08 smithi136 ceph-mon[34110]: pgmap v303: 97 pgs: 97 active+clean; 605 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 22 op/s 2024-05-09T00:59:08.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:08 smithi151 ceph-mon[34780]: pgmap v303: 97 pgs: 97 active+clean; 605 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.3 KiB/s wr, 22 op/s 2024-05-09T00:59:08.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-09T00:59:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:09.350 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:09 smithi037 ceph-mon[30122]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:09.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:09 smithi136 ceph-mon[34110]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:09.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:09 smithi151 ceph-mon[34780]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:10.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:10 smithi037 ceph-mon[30122]: pgmap v304: 97 pgs: 97 active+clean; 605 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-09T00:59:10.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:10 smithi136 ceph-mon[34110]: pgmap v304: 97 pgs: 97 active+clean; 605 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-09T00:59:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:10 smithi151 ceph-mon[34780]: pgmap v304: 97 pgs: 97 active+clean; 605 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-09T00:59:10.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 -- 172.21.15.37:0/30454101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe650107df0 msgr2=0x7fe650108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:10.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 --2- 172.21.15.37:0/30454101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe650107df0 0x7fe650108200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0099c0 tx=0x7fe63c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:59:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 -- 172.21.15.37:0/30454101 shutdown_connections 2024-05-09T00:59:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 --2- 172.21.15.37:0/30454101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe650108740 0x7fe6501100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 --2- 172.21.15.37:0/30454101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6501034c0 0x7fe6501038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 --2- 172.21.15.37:0/30454101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe650107df0 0x7fe650108200 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 -- 172.21.15.37:0/30454101 >> 172.21.15.37:0/30454101 conn(0x7fe6500fedc0 msgr2=0x7fe6501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 -- 172.21.15.37:0/30454101 shutdown_connections 2024-05-09T00:59:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.721+0000 7fe656dbf700 1 -- 172.21.15.37:0/30454101 wait complete. 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.722+0000 7fe656dbf700 1 Processor -- start 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.722+0000 7fe656dbf700 1 -- start start 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe656dbf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6501034c0 0x7fe65019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe656dbf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe650107df0 0x7fe65019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe656dbf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe650108740 0x7fe65019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe656dbf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe650114480 con 0x7fe6501034c0 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe656dbf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe650114300 con 0x7fe650108740 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe656dbf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe650114600 con 0x7fe650107df0 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6501034c0 0x7fe65019add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6501034c0 0x7fe65019add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48950/0 (socket says 172.21.15.37:48950) 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 -- 172.21.15.37:0/520146014 learned_addr learned my addr 172.21.15.37:0/520146014 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe64ffff700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe650107df0 0x7fe65019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 -- 172.21.15.37:0/520146014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe650107df0 msgr2=0x7fe65019b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe65535c700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe650108740 0x7fe65019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe650107df0 0x7fe65019b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 -- 172.21.15.37:0/520146014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe650108740 msgr2=0x7fe65019f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe650108740 0x7fe65019f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 -- 172.21.15.37:0/520146014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65019fca0 con 0x7fe6501034c0 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe64ffff700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe650107df0 0x7fe65019b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.723+0000 7fe654b5b700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6501034c0 0x7fe65019add0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe64400d950 tx=0x7fe64400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.724+0000 7fe64dffb700 1 -- 172.21.15.37:0/520146014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe644016070 con 0x7fe6501034c0 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.724+0000 7fe64dffb700 1 -- 172.21.15.37:0/520146014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe644010460 con 0x7fe6501034c0 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.724+0000 7fe64dffb700 1 -- 172.21.15.37:0/520146014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64400f620 con 0x7fe6501034c0 2024-05-09T00:59:10.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.724+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65019ff90 con 0x7fe6501034c0 2024-05-09T00:59:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.724+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6501a78b0 con 0x7fe6501034c0 2024-05-09T00:59:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.725+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6500512c0 con 0x7fe6501034c0 2024-05-09T00:59:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.726+0000 7fe64dffb700 1 -- 172.21.15.37:0/520146014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe644019070 con 0x7fe6501034c0 2024-05-09T00:59:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.727+0000 7fe64dffb700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6400b2910 0x7fe6400b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.727+0000 7fe64ffff700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6400b2910 0x7fe6400b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.727+0000 7fe64dffb700 1 -- 172.21.15.37:0/520146014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7fe6440e1eb0 con 0x7fe6501034c0 2024-05-09T00:59:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.727+0000 7fe64ffff700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6400b2910 0x7fe6400b4e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe63c006010 tx=0x7fe63c005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:10.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.732+0000 7fe64dffb700 1 -- 172.21.15.37:0/520146014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe6440a9c20 con 0x7fe6501034c0 2024-05-09T00:59:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:10.979+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe650063c00 con 0x7fe6400b2910 2024-05-09T00:59:11.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.008+0000 7fe64dffb700 1 -- 172.21.15.37:0/520146014 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe650063c00 con 0x7fe6400b2910 2024-05-09T00:59:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6400b2910 msgr2=0x7fe6400b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6400b2910 0x7fe6400b4e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe63c006010 tx=0x7fe63c005ea0 comp rx=0 tx=0).stop 2024-05-09T00:59:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6501034c0 msgr2=0x7fe65019add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6501034c0 0x7fe65019add0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe64400d950 tx=0x7fe64400dd10 comp rx=0 tx=0).stop 2024-05-09T00:59:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 shutdown_connections 2024-05-09T00:59:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6400b2910 0x7fe6400b4e20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe650108740 0x7fe65019f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6501034c0 0x7fe65019add0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 --2- 172.21.15.37:0/520146014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe650107df0 0x7fe65019b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 >> 172.21.15.37:0/520146014 conn(0x7fe6500fedc0 msgr2=0x7fe6501096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 shutdown_connections 2024-05-09T00:59:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:11.011+0000 7fe656dbf700 1 -- 172.21.15.37:0/520146014 wait complete. 2024-05-09T00:59:11.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-09T00:59:11.997 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:12.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:12 smithi037 ceph-mon[30122]: pgmap v305: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 KiB/s wr, 18 op/s 2024-05-09T00:59:12.293 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:12 smithi037 ceph-mon[30122]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:12 smithi136 ceph-mon[34110]: pgmap v305: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 KiB/s wr, 18 op/s 2024-05-09T00:59:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:12 smithi136 ceph-mon[34110]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:12 smithi151 ceph-mon[34780]: pgmap v305: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.9 KiB/s wr, 18 op/s 2024-05-09T00:59:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:12 smithi151 ceph-mon[34780]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.585+0000 7f9cf6530700 1 -- 172.21.15.37:0/2920388957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0108740 msgr2=0x7f9cf01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.585+0000 7f9cf6530700 1 --2- 172.21.15.37:0/2920388957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0108740 0x7f9cf01100a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800b0d0 tx=0x7f9ce800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.585+0000 7f9cf6530700 1 -- 172.21.15.37:0/2920388957 shutdown_connections 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.585+0000 7f9cf6530700 1 --2- 172.21.15.37:0/2920388957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0108740 0x7f9cf01100a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.585+0000 7f9cf6530700 1 --2- 172.21.15.37:0/2920388957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cf01034c0 0x7f9cf01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.585+0000 7f9cf6530700 1 --2- 172.21.15.37:0/2920388957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cf0107df0 0x7f9cf0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.585+0000 7f9cf6530700 1 -- 172.21.15.37:0/2920388957 >> 172.21.15.37:0/2920388957 conn(0x7f9cf00fedf0 msgr2=0x7f9cf0101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.586+0000 7f9cf6530700 1 -- 172.21.15.37:0/2920388957 shutdown_connections 2024-05-09T00:59:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.586+0000 7f9cf6530700 1 -- 172.21.15.37:0/2920388957 wait complete. 2024-05-09T00:59:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 Processor -- start 2024-05-09T00:59:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 -- start start 2024-05-09T00:59:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cf01034c0 0x7f9cf0199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0107df0 0x7f9cf0199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cf0108740 0x7f9cf019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf0113370 con 0x7f9cf0107df0 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01131f0 con 0x7f9cf0108740 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf6530700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf01134f0 con 0x7f9cf01034c0 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9ce7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0107df0 0x7f9cf0199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9ce7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0107df0 0x7f9cf0199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44040/0 (socket says 172.21.15.37:44040) 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9ce7fff700 1 -- 172.21.15.37:0/3745124432 learned_addr learned my addr 172.21.15.37:0/3745124432 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9ceffff700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cf01034c0 0x7f9cf0199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.587+0000 7f9cf4acd700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cf0108740 0x7f9cf019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9ce7fff700 1 -- 172.21.15.37:0/3745124432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cf01034c0 msgr2=0x7f9cf0199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9ce7fff700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cf01034c0 0x7f9cf0199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9ce7fff700 1 -- 172.21.15.37:0/3745124432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cf0108740 msgr2=0x7f9cf019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9ce7fff700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cf0108740 0x7f9cf019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9ce7fff700 1 -- 172.21.15.37:0/3745124432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf01a9120 con 0x7f9cf0107df0 2024-05-09T00:59:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9ce7fff700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0107df0 0x7f9cf0199f60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d980 tx=0x7f9cd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9cedffb700 1 -- 172.21.15.37:0/3745124432 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8017070 con 0x7f9cf0107df0 2024-05-09T00:59:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9cedffb700 1 -- 172.21.15.37:0/3745124432 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd8009de0 con 0x7f9cf0107df0 2024-05-09T00:59:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf01a9410 con 0x7f9cf0107df0 2024-05-09T00:59:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9cedffb700 1 -- 172.21.15.37:0/3745124432 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800f3c0 con 0x7f9cf0107df0 2024-05-09T00:59:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.588+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf01a99a0 con 0x7f9cf0107df0 2024-05-09T00:59:13.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.589+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf0104970 con 0x7f9cf0107df0 2024-05-09T00:59:13.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.591+0000 7f9cedffb700 1 -- 172.21.15.37:0/3745124432 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9cd8009930 con 0x7f9cf0107df0 2024-05-09T00:59:13.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.592+0000 7f9cedffb700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cdc0b2990 0x7f9cdc0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:13.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.592+0000 7f9ceffff700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cdc0b2990 0x7f9cdc0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:13.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.592+0000 7f9cedffb700 1 -- 172.21.15.37:0/3745124432 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f9cd80e1d00 con 0x7f9cf0107df0 2024-05-09T00:59:13.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.592+0000 7f9ceffff700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cdc0b2990 0x7f9cdc0b4ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0005950 tx=0x7f9ce000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.595+0000 7f9cedffb700 1 -- 172.21.15.37:0/3745124432 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9cd80a99f0 con 0x7f9cf0107df0 2024-05-09T00:59:13.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.844+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f9cf0063c00 con 0x7f9cdc0b2990 2024-05-09T00:59:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.850+0000 7f9cedffb700 1 -- 172.21.15.37:0/3745124432 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9cf0063c00 con 0x7f9cdc0b2990 2024-05-09T00:59:13.850 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cdc0b2990 msgr2=0x7f9cdc0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cdc0b2990 0x7f9cdc0b4ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0005950 tx=0x7f9ce000b410 comp rx=0 tx=0).stop 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0107df0 msgr2=0x7f9cf0199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0107df0 0x7f9cf0199f60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d980 tx=0x7f9cd800dc90 comp rx=0 tx=0).stop 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 shutdown_connections 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cdc0b2990 0x7f9cdc0b4ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9cf0108740 0x7f9cf019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cf01034c0 0x7f9cf0199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 --2- 172.21.15.37:0/3745124432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf0107df0 0x7f9cf0199f60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 >> 172.21.15.37:0/3745124432 conn(0x7f9cf00fedf0 msgr2=0x7f9cf0107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 shutdown_connections 2024-05-09T00:59:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:13.852+0000 7f9cf6530700 1 -- 172.21.15.37:0/3745124432 wait complete. 2024-05-09T00:59:14.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:14 smithi037 ceph-mon[30122]: pgmap v306: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-09T00:59:14.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:14 smithi136 ceph-mon[34110]: pgmap v306: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-09T00:59:14.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:14 smithi151 ceph-mon[34780]: pgmap v306: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-09T00:59:14.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T00:59:14.768 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:15.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:15 smithi037 ceph-mon[30122]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:15.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:15 smithi136 ceph-mon[34110]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:15.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:15 smithi151 ceph-mon[34780]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:59:16.161 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:16 smithi037 ceph-mon[30122]: pgmap v307: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-05-09T00:59:16.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:16 smithi136 ceph-mon[34110]: pgmap v307: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 -- 172.21.15.37:0/388912787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 msgr2=0x7f2a94110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 --2- 172.21.15.37:0/388912787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a94110e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00b0a0 tx=0x7f2a8c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 -- 172.21.15.37:0/388912787 shutdown_connections 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 --2- 172.21.15.37:0/388912787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a94110e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 --2- 172.21.15.37:0/388912787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a94105500 0x7f2a94105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 --2- 172.21.15.37:0/388912787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105e50 0x7f2a9410e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 -- 172.21.15.37:0/388912787 >> 172.21.15.37:0/388912787 conn(0x7f2a940fef30 msgr2=0x7f2a94101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 -- 172.21.15.37:0/388912787 shutdown_connections 2024-05-09T00:59:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.390+0000 7f2a99801700 1 -- 172.21.15.37:0/388912787 wait complete. 2024-05-09T00:59:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.391+0000 7f2a99801700 1 Processor -- start 2024-05-09T00:59:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.391+0000 7f2a99801700 1 -- start start 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a99801700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105500 0x7f2a9419adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a99801700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a94105e50 0x7f2a9419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a99801700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a9419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a99801700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a94114460 con 0x7f2a9410e930 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a99801700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941142e0 con 0x7f2a94105e50 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a99801700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941145e0 con 0x7f2a94105500 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a9419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a92ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105500 0x7f2a9419adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a92ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105500 0x7f2a9419adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:50576/0 (socket says 172.21.15.37:50576) 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a9419f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44056/0 (socket says 172.21.15.37:44056) 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a92ffd700 1 -- 172.21.15.37:0/2514381470 learned_addr learned my addr 172.21.15.37:0/2514381470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a8a7fc700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a94105e50 0x7f2a9419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 -- 172.21.15.37:0/2514381470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105500 msgr2=0x7f2a9419adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105500 0x7f2a9419adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 -- 172.21.15.37:0/2514381470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a94105e50 msgr2=0x7f2a9419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a94105e50 0x7f2a9419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 -- 172.21.15.37:0/2514381470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9419fc80 con 0x7f2a9410e930 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a92ffd700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105500 0x7f2a9419adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.392+0000 7f2a937fe700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a9419f5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00b070 tx=0x7f2a8c004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.393+0000 7f2a90ff9700 1 -- 172.21.15.37:0/2514381470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c021070 con 0x7f2a9410e930 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.393+0000 7f2a90ff9700 1 -- 172.21.15.37:0/2514381470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a8c007b80 con 0x7f2a9410e930 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.393+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9419ff10 con 0x7f2a9410e930 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.393+0000 7f2a90ff9700 1 -- 172.21.15.37:0/2514381470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c005040 con 0x7f2a9410e930 2024-05-09T00:59:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.393+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a941a7890 con 0x7f2a9410e930 2024-05-09T00:59:16.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.394+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a940512c0 con 0x7f2a9410e930 2024-05-09T00:59:16.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.395+0000 7f2a90ff9700 1 -- 172.21.15.37:0/2514381470 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2a8c024070 con 0x7f2a9410e930 2024-05-09T00:59:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.397+0000 7f2a90ff9700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a800b2990 0x7f2a800b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.397+0000 7f2a92ffd700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a800b2990 0x7f2a800b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.397+0000 7f2a90ff9700 1 -- 172.21.15.37:0/2514381470 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7979+0+0 (secure 0 0 0) 0x7f2a8c00f020 con 0x7f2a9410e930 2024-05-09T00:59:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.397+0000 7f2a92ffd700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a800b2990 0x7f2a800b4ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a84005950 tx=0x7f2a8400b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:16.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.401+0000 7f2a90ff9700 1 -- 172.21.15.37:0/2514381470 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2a8c02b020 con 0x7f2a9410e930 2024-05-09T00:59:16.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:16 smithi151 ceph-mon[34780]: pgmap v307: 97 pgs: 97 active+clean; 611 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-05-09T00:59:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.661+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a9402e5f0 con 0x7f2a9410e930 2024-05-09T00:59:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.662+0000 7f2a90ff9700 1 -- 172.21.15.37:0/2514381470 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f2a8c0ab4a0 con 0x7f2a9410e930 2024-05-09T00:59:16.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:59:16.663 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T00:58:58.933698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a800b2990 msgr2=0x7f2a800b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a800b2990 0x7f2a800b4ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a84005950 tx=0x7f2a8400b500 comp rx=0 tx=0).stop 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 msgr2=0x7f2a9419f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a9419f5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00b070 tx=0x7f2a8c004ce0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 shutdown_connections 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a800b2990 0x7f2a800b4ea0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9410e930 0x7f2a9419f5e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a94105500 0x7f2a9419adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 --2- 172.21.15.37:0/2514381470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a94105e50 0x7f2a9419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 >> 172.21.15.37:0/2514381470 conn(0x7f2a940fef30 msgr2=0x7f2a940ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 shutdown_connections 2024-05-09T00:59:16.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:16.665+0000 7f2a99801700 1 -- 172.21.15.37:0/2514381470 wait complete. 2024-05-09T00:59:16.667 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-09T00:59:17.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:17 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2514381470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:59:17.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:59:17.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:17 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2514381470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:59:17.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:17 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2514381470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:59:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:18.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:18 smithi136 ceph-mon[34110]: pgmap v308: 97 pgs: 97 active+clean; 633 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-05-09T00:59:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:18 smithi037 ceph-mon[30122]: pgmap v308: 97 pgs: 97 active+clean; 633 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-05-09T00:59:18.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:18 smithi151 ceph-mon[34780]: pgmap v308: 97 pgs: 97 active+clean; 633 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-05-09T00:59:19.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-09T00:59:19.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-09T00:59:19.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-09T00:59:19.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-09T00:59:19.293 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-05-09T00:59:19.293 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:19 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 -- 172.21.15.37:0/1052372351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808107e30 msgr2=0x7f0808108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 --2- 172.21.15.37:0/1052372351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808107e30 0x7f0808108240 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f07f40099c0 tx=0x7f07f4009cd0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 -- 172.21.15.37:0/1052372351 shutdown_connections 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 --2- 172.21.15.37:0/1052372351 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0808108780 0x7f08081100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 --2- 172.21.15.37:0/1052372351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0808103550 0x7f0808103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 --2- 172.21.15.37:0/1052372351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808107e30 0x7f0808108240 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 -- 172.21.15.37:0/1052372351 >> 172.21.15.37:0/1052372351 conn(0x7f0808078e00 msgr2=0x7f0808079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 -- 172.21.15.37:0/1052372351 shutdown_connections 2024-05-09T00:59:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.319+0000 7f080eea4700 1 -- 172.21.15.37:0/1052372351 wait complete. 2024-05-09T00:59:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 Processor -- start 2024-05-09T00:59:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 -- start start 2024-05-09T00:59:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0808103550 0x7f0808104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0808107e30 0x7f0808105410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808108780 0x7f0808105950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0808113400 con 0x7f0808108780 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0808113280 con 0x7f0808103550 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080eea4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0808113580 con 0x7f0808107e30 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808108780 0x7f0808105950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808108780 0x7f0808105950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44084/0 (socket says 172.21.15.37:44084) 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 -- 172.21.15.37:0/26671252 learned_addr learned my addr 172.21.15.37:0/26671252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f0807fff700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0808107e30 0x7f0808105410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080cc40700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0808103550 0x7f0808104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 -- 172.21.15.37:0/26671252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0808107e30 msgr2=0x7f0808105410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0808107e30 0x7f0808105410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 -- 172.21.15.37:0/26671252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0808103550 msgr2=0x7f0808104ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0808103550 0x7f0808104ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.320+0000 7f080d441700 1 -- 172.21.15.37:0/26671252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08081a9220 con 0x7f0808108780 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.321+0000 7f080d441700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808108780 0x7f0808105950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f080000b970 tx=0x7f080000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.321+0000 7f0805ffb700 1 -- 172.21.15.37:0/26671252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800019070 con 0x7f0808108780 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.321+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08081a9510 con 0x7f0808108780 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.321+0000 7f0805ffb700 1 -- 172.21.15.37:0/26671252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f080000cde0 con 0x7f0808108780 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.321+0000 7f0805ffb700 1 -- 172.21.15.37:0/26671252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800007370 con 0x7f0808108780 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.321+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081a9a20 con 0x7f0808108780 2024-05-09T00:59:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.322+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08080512c0 con 0x7f0808108780 2024-05-09T00:59:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.325+0000 7f0805ffb700 1 -- 172.21.15.37:0/26671252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f080001c070 con 0x7f0808108780 2024-05-09T00:59:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.325+0000 7f0805ffb700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07f80b2910 0x7f07f80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.325+0000 7f080cc40700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07f80b2910 0x7f07f80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.325+0000 7f0805ffb700 1 -- 172.21.15.37:0/26671252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8153+0+0 (secure 0 0 0) 0x7f08000e1df0 con 0x7f0808108780 2024-05-09T00:59:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.326+0000 7f080cc40700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07f80b2910 0x7f07f80b4e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f07fc005950 tx=0x7f07fc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:19.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.329+0000 7f0805ffb700 1 -- 172.21.15.37:0/26671252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0800023070 con 0x7f0808108780 2024-05-09T00:59:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-09T00:59:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-09T00:59:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-09T00:59:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-09T00:59:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-05-09T00:59:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:19 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-09T00:59:19.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-09T00:59:19.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-05-09T00:59:19.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-09T00:59:19.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-09T00:59:19.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-05-09T00:59:19.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:19 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-09T00:59:19.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.545+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0808106400 con 0x7f0808108780 2024-05-09T00:59:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.546+0000 7f0805ffb700 1 -- 172.21.15.37:0/26671252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22534 (secure 0 0 0) 0x7f08000a9bc0 con 0x7f0808108780 2024-05-09T00:59:19.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:59:19.547 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":80,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:19.061579+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:59:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07f80b2910 msgr2=0x7f07f80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07f80b2910 0x7f07f80b4e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f07fc005950 tx=0x7f07fc0058e0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808108780 msgr2=0x7f0808105950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808108780 0x7f0808105950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f080000b970 tx=0x7f080000bc80 comp rx=0 tx=0).stop 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 shutdown_connections 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07f80b2910 0x7f07f80b4e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0808108780 0x7f0808105950 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0808103550 0x7f0808104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 --2- 172.21.15.37:0/26671252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0808107e30 0x7f0808105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 >> 172.21.15.37:0/26671252 conn(0x7f0808078e00 msgr2=0x7f0808075d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 shutdown_connections 2024-05-09T00:59:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:19.549+0000 7f080eea4700 1 -- 172.21.15.37:0/26671252 wait complete. 2024-05-09T00:59:20.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: pgmap v309: 97 pgs: 97 active+clean; 633 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T00:59:20.122 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:20 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/26671252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:20.151 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T00:59:20.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T00:59:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: pgmap v309: 97 pgs: 97 active+clean; 633 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-09T00:59:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-09T00:59:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-09T00:59:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-09T00:59:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-09T00:59:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-05-09T00:59:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-09T00:59:20.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T00:59:20.379 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:20 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/26671252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:20.414 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: pgmap v309: 97 pgs: 97 active+clean; 633 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T00:59:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:20 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/26671252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:21.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:21 smithi136 ceph-mon[34110]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T00:59:21.438 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:21 smithi037 ceph-mon[30122]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T00:59:21.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:21 smithi151 ceph-mon[34780]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T00:59:21.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 -- 172.21.15.37:0/3577384234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df4109860 msgr2=0x7f9df41111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3577384234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df4109860 0x7f9df41111c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00b0d0 tx=0x7f9dec00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 -- 172.21.15.37:0/3577384234 shutdown_connections 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3577384234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df4109860 0x7f9df41111c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3577384234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df41045e0 0x7f9df41049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3577384234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9df4108f10 0x7f9df4109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 -- 172.21.15.37:0/3577384234 >> 172.21.15.37:0/3577384234 conn(0x7f9df40ffed0 msgr2=0x7f9df4102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 -- 172.21.15.37:0/3577384234 shutdown_connections 2024-05-09T00:59:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.956+0000 7f9df8a68700 1 -- 172.21.15.37:0/3577384234 wait complete. 2024-05-09T00:59:22.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:22 smithi136 ceph-mon[34110]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-05-09T00:59:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.957+0000 7f9df8a68700 1 Processor -- start 2024-05-09T00:59:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.957+0000 7f9df8a68700 1 -- start start 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.957+0000 7f9df8a68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df41045e0 0x7f9df419ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df8a68700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df4108f10 0x7f9df419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df8a68700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9df4109860 0x7f9df419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df8a68700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4114490 con 0x7f9df41045e0 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df8a68700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4114310 con 0x7f9df4108f10 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df8a68700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4114610 con 0x7f9df4109860 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df41045e0 0x7f9df419ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df41045e0 0x7f9df419ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46752/0 (socket says 172.21.15.37:46752) 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 -- 172.21.15.37:0/3130526257 learned_addr learned my addr 172.21.15.37:0/3130526257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df2d9d700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9df4109860 0x7f9df419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 -- 172.21.15.37:0/3130526257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9df4109860 msgr2=0x7f9df419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9df4109860 0x7f9df419f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 -- 172.21.15.37:0/3130526257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df4108f10 msgr2=0x7f9df419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df4108f10 0x7f9df419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 -- 172.21.15.37:0/3130526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df419fcb0 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df259c700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df41045e0 0x7f9df419ade0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9de400e9a0 tx=0x7f9de400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9de37fe700 1 -- 172.21.15.37:0/3130526257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de400cbd0 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9de37fe700 1 -- 172.21.15.37:0/3130526257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9de400cd70 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df419ffa0 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9de37fe700 1 -- 172.21.15.37:0/3130526257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4018680 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.958+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df41a78c0 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.960+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df40512c0 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.961+0000 7f9de37fe700 1 -- 172.21.15.37:0/3130526257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9de4010970 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.962+0000 7f9de37fe700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9ddc0b2910 0x7f9ddc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.962+0000 7f9df1d9b700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9ddc0b2910 0x7f9ddc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.962+0000 7f9de37fe700 1 -- 172.21.15.37:0/3130526257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9de40e2bc0 con 0x7f9df41045e0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.963+0000 7f9df1d9b700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9ddc0b2910 0x7f9ddc0b4e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9df4107ce0 tx=0x7f9de8009620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:21.966+0000 7f9de37fe700 1 -- 172.21.15.37:0/3130526257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9de40aa780 con 0x7f9df41045e0 2024-05-09T00:59:22.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.177+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9df419c140 con 0x7f9ddc0b2910 2024-05-09T00:59:22.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.185+0000 7f9de37fe700 1 -- 172.21.15.37:0/3130526257 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258692 (secure 0 0 0) 0x7f9df419c140 con 0x7f9ddc0b2910 2024-05-09T00:59:22.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9ddc0b2910 msgr2=0x7f9ddc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9ddc0b2910 0x7f9ddc0b4e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9df4107ce0 tx=0x7f9de8009620 comp rx=0 tx=0).stop 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df41045e0 msgr2=0x7f9df419ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df41045e0 0x7f9df419ade0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9de400e9a0 tx=0x7f9de400ed60 comp rx=0 tx=0).stop 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 shutdown_connections 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9ddc0b2910 0x7f9ddc0b4e20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9df4109860 0x7f9df419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df41045e0 0x7f9df419ade0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 --2- 172.21.15.37:0/3130526257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df4108f10 0x7f9df419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:22.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 >> 172.21.15.37:0/3130526257 conn(0x7f9df40ffed0 msgr2=0x7f9df4108680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:22.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 shutdown_connections 2024-05-09T00:59:22.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:22.188+0000 7f9df8a68700 1 -- 172.21.15.37:0/3130526257 wait complete. 2024-05-09T00:59:22.426 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-09T00:59:22.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:22 smithi037 ceph-mon[30122]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-05-09T00:59:22.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:22 smithi151 ceph-mon[34780]: pgmap v312: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-05-09T00:59:22.931 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-05-09T00:59:20.892432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653896,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":344,"num_read_kb":270,"num_write":365,"num_write_kb":2283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382264,"kb_used_data":12292,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559560,"statfs":{"total":1151940427776,"available":1151548989440,"internally_reserved":0,"allocated":12587008,"data_stored":6947733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28124,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":74,"num_write":18,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002163"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.375483+0000","last_change":"2024-05-09T00:58:37.371502+0000","last_active":"2024-05-09T00:58:40.375483+0000","last_peered":"2024-05-09T00:58:40.375483+0000","last_clean":"2024-05-09T00:58:40.375483+0000","last_became_active":"2024-05-09T00:58:37.371172+0000","last_became_peered":"2024-05-09T00:58:37.371172+0000","last_unstale":"2024-05-09T00:58:40.375483+0000","last_undegraded":"2024-05-09T00:58:40.375483+0000","last_fullsized":"2024-05-09T00:58:40.375483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:37.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.370219+0000","last_change":"2024-05-09T00:58:37.362831+0000","last_active":"2024-05-09T00:58:40.370219+0000","last_peered":"2024-05-09T00:58:40.370219+0000","last_clean":"2024-05-09T00:58:40.370219+0000","last_became_active":"2024-05-09T00:58:37.362063+0000","last_became_peered":"2024-05-09T00:58:37.362063+0000","last_unstale":"2024-05-09T00:58:40.370219+0000","last_undegraded":"2024-05-09T00:58:40.370219+0000","last_fullsized":"2024-05-09T00:58:40.370219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:01.222962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.368463+0000","last_change":"2024-05-09T00:58:37.369903+0000","last_active":"2024-05-09T00:58:40.368463+0000","last_peered":"2024-05-09T00:58:40.368463+0000","last_clean":"2024-05-09T00:58:40.368463+0000","last_became_active":"2024-05-09T00:58:37.366215+0000","last_became_peered":"2024-05-09T00:58:37.366215+0000","last_unstale":"2024-05-09T00:58:40.368463+0000","last_undegraded":"2024-05-09T00:58:40.368463+0000","last_fullsized":"2024-05-09T00:58:40.368463+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:47.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075575+0000","last_change":"2024-05-09T00:58:37.358878+0000","last_active":"2024-05-09T00:59:19.075575+0000","last_peered":"2024-05-09T00:59:19.075575+0000","last_clean":"2024-05-09T00:59:19.075575+0000","last_became_active":"2024-05-09T00:58:37.358516+0000","last_became_peered":"2024-05-09T00:58:37.358516+0000","last_unstale":"2024-05-09T00:59:19.075575+0000","last_undegraded":"2024-05-09T00:59:19.075575+0000","last_fullsized":"2024-05-09T00:59:19.075575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075386+0000","last_change":"2024-05-09T00:58:37.358196+0000","last_active":"2024-05-09T00:59:19.075386+0000","last_peered":"2024-05-09T00:59:19.075386+0000","last_clean":"2024-05-09T00:59:19.075386+0000","last_became_active":"2024-05-09T00:58:37.357840+0000","last_became_peered":"2024-05-09T00:58:37.357840+0000","last_unstale":"2024-05-09T00:59:19.075386+0000","last_undegraded":"2024-05-09T00:59:19.075386+0000","last_fullsized":"2024-05-09T00:59:19.075386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:58.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074601+0000","last_change":"2024-05-09T00:58:37.364523+0000","last_active":"2024-05-09T00:59:20.074601+0000","last_peered":"2024-05-09T00:59:20.074601+0000","last_clean":"2024-05-09T00:59:20.074601+0000","last_became_active":"2024-05-09T00:58:37.364172+0000","last_became_peered":"2024-05-09T00:58:37.364172+0000","last_unstale":"2024-05-09T00:59:20.074601+0000","last_undegraded":"2024-05-09T00:59:20.074601+0000","last_fullsized":"2024-05-09T00:59:20.074601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:36.872701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074576+0000","last_change":"2024-05-09T00:58:37.371226+0000","last_active":"2024-05-09T00:59:19.074576+0000","last_peered":"2024-05-09T00:59:19.074576+0000","last_clean":"2024-05-09T00:59:19.074576+0000","last_became_active":"2024-05-09T00:58:37.370647+0000","last_became_peered":"2024-05-09T00:58:37.370647+0000","last_unstale":"2024-05-09T00:59:19.074576+0000","last_undegraded":"2024-05-09T00:59:19.074576+0000","last_fullsized":"2024-05-09T00:59:19.074576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:46.350845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074711+0000","last_change":"2024-05-09T00:58:37.362487+0000","last_active":"2024-05-09T00:59:19.074711+0000","last_peered":"2024-05-09T00:59:19.074711+0000","last_clean":"2024-05-09T00:59:19.074711+0000","last_became_active":"2024-05-09T00:58:37.361454+0000","last_became_peered":"2024-05-09T00:58:37.361454+0000","last_unstale":"2024-05-09T00:59:19.074711+0000","last_undegraded":"2024-05-09T00:59:19.074711+0000","last_fullsized":"2024-05-09T00:59:19.074711+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:36.930754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.360906+0000","last_change":"2024-05-09T00:58:37.370069+0000","last_active":"2024-05-09T00:58:40.360906+0000","last_peered":"2024-05-09T00:58:40.360906+0000","last_clean":"2024-05-09T00:58:40.360906+0000","last_became_active":"2024-05-09T00:58:37.369634+0000","last_became_peered":"2024-05-09T00:58:37.369634+0000","last_unstale":"2024-05-09T00:58:40.360906+0000","last_undegraded":"2024-05-09T00:58:40.360906+0000","last_fullsized":"2024-05-09T00:58:40.360906+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:22.424919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074722+0000","last_change":"2024-05-09T00:58:37.365066+0000","last_active":"2024-05-09T00:59:20.074722+0000","last_peered":"2024-05-09T00:59:20.074722+0000","last_clean":"2024-05-09T00:59:20.074722+0000","last_became_active":"2024-05-09T00:58:37.364638+0000","last_became_peered":"2024-05-09T00:58:37.364638+0000","last_unstale":"2024-05-09T00:59:20.074722+0000","last_undegraded":"2024-05-09T00:59:20.074722+0000","last_fullsized":"2024-05-09T00:59:20.074722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:14.706123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074761+0000","last_change":"2024-05-09T00:58:37.366880+0000","last_active":"2024-05-09T00:59:19.074761+0000","last_peered":"2024-05-09T00:59:19.074761+0000","last_clean":"2024-05-09T00:59:19.074761+0000","last_became_active":"2024-05-09T00:58:37.366510+0000","last_became_peered":"2024-05-09T00:58:37.366510+0000","last_unstale":"2024-05-09T00:59:19.074761+0000","last_undegraded":"2024-05-09T00:59:19.074761+0000","last_fullsized":"2024-05-09T00:59:19.074761+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:36.968096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075436+0000","last_change":"2024-05-09T00:58:37.363258+0000","last_active":"2024-05-09T00:59:19.075436+0000","last_peered":"2024-05-09T00:59:19.075436+0000","last_clean":"2024-05-09T00:59:19.075436+0000","last_became_active":"2024-05-09T00:58:37.362791+0000","last_became_peered":"2024-05-09T00:58:37.362791+0000","last_unstale":"2024-05-09T00:59:19.075436+0000","last_undegraded":"2024-05-09T00:59:19.075436+0000","last_fullsized":"2024-05-09T00:59:19.075436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:03.341731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073290+0000","last_change":"2024-05-09T00:58:37.371276+0000","last_active":"2024-05-09T00:59:20.073290+0000","last_peered":"2024-05-09T00:59:20.073290+0000","last_clean":"2024-05-09T00:59:20.073290+0000","last_became_active":"2024-05-09T00:58:37.370881+0000","last_became_peered":"2024-05-09T00:58:37.370881+0000","last_unstale":"2024-05-09T00:59:20.073290+0000","last_undegraded":"2024-05-09T00:59:20.073290+0000","last_fullsized":"2024-05-09T00:59:20.073290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:14.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.367859+0000","last_change":"2024-05-09T00:58:37.361394+0000","last_active":"2024-05-09T00:58:40.367859+0000","last_peered":"2024-05-09T00:58:40.367859+0000","last_clean":"2024-05-09T00:58:40.367859+0000","last_became_active":"2024-05-09T00:58:37.360669+0000","last_became_peered":"2024-05-09T00:58:37.360669+0000","last_unstale":"2024-05-09T00:58:40.367859+0000","last_undegraded":"2024-05-09T00:58:40.367859+0000","last_fullsized":"2024-05-09T00:58:40.367859+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.110889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.367849+0000","last_change":"2024-05-09T00:58:37.371900+0000","last_active":"2024-05-09T00:58:40.367849+0000","last_peered":"2024-05-09T00:58:40.367849+0000","last_clean":"2024-05-09T00:58:40.367849+0000","last_became_active":"2024-05-09T00:58:37.368608+0000","last_became_peered":"2024-05-09T00:58:37.368608+0000","last_unstale":"2024-05-09T00:58:40.367849+0000","last_undegraded":"2024-05-09T00:58:40.367849+0000","last_fullsized":"2024-05-09T00:58:40.367849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:17.673058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.361222+0000","last_change":"2024-05-09T00:58:37.372717+0000","last_active":"2024-05-09T00:58:40.361222+0000","last_peered":"2024-05-09T00:58:40.361222+0000","last_clean":"2024-05-09T00:58:40.361222+0000","last_became_active":"2024-05-09T00:58:37.372376+0000","last_became_peered":"2024-05-09T00:58:37.372376+0000","last_unstale":"2024-05-09T00:58:40.361222+0000","last_undegraded":"2024-05-09T00:58:40.361222+0000","last_fullsized":"2024-05-09T00:58:40.361222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:51.092242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.375708+0000","last_change":"2024-05-09T00:58:37.373971+0000","last_active":"2024-05-09T00:58:40.375708+0000","last_peered":"2024-05-09T00:58:40.375708+0000","last_clean":"2024-05-09T00:58:40.375708+0000","last_became_active":"2024-05-09T00:58:37.373620+0000","last_became_peered":"2024-05-09T00:58:37.373620+0000","last_unstale":"2024-05-09T00:58:40.375708+0000","last_undegraded":"2024-05-09T00:58:40.375708+0000","last_fullsized":"2024-05-09T00:58:40.375708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.070455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.374227+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T00:58:40.374227+0000","last_peered":"2024-05-09T00:58:40.374227+0000","last_clean":"2024-05-09T00:58:40.374227+0000","last_became_active":"2024-05-09T00:58:37.367820+0000","last_became_peered":"2024-05-09T00:58:37.367820+0000","last_unstale":"2024-05-09T00:58:40.374227+0000","last_undegraded":"2024-05-09T00:58:40.374227+0000","last_fullsized":"2024-05-09T00:58:40.374227+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:45.207654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.370283+0000","last_change":"2024-05-09T00:58:37.358736+0000","last_active":"2024-05-09T00:58:40.370283+0000","last_peered":"2024-05-09T00:58:40.370283+0000","last_clean":"2024-05-09T00:58:40.370283+0000","last_became_active":"2024-05-09T00:58:37.358354+0000","last_became_peered":"2024-05-09T00:58:37.358354+0000","last_unstale":"2024-05-09T00:58:40.370283+0000","last_undegraded":"2024-05-09T00:58:40.370283+0000","last_fullsized":"2024-05-09T00:58:40.370283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:51.084484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:59:15.036878+0000","last_change":"2024-05-09T00:58:34.333847+0000","last_active":"2024-05-09T00:59:15.036878+0000","last_peered":"2024-05-09T00:59:15.036878+0000","last_clean":"2024-05-09T00:59:15.036878+0000","last_became_active":"2024-05-09T00:58:34.333479+0000","last_became_peered":"2024-05-09T00:58:34.333479+0000","last_unstale":"2024-05-09T00:59:15.036878+0000","last_undegraded":"2024-05-09T00:59:15.036878+0000","last_fullsized":"2024-05-09T00:59:15.036878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:53.709034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.076280+0000","last_change":"2024-05-09T00:58:37.367327+0000","last_active":"2024-05-09T00:59:19.076280+0000","last_peered":"2024-05-09T00:59:19.076280+0000","last_clean":"2024-05-09T00:59:19.076280+0000","last_became_active":"2024-05-09T00:58:37.366973+0000","last_became_peered":"2024-05-09T00:58:37.366973+0000","last_unstale":"2024-05-09T00:59:19.076280+0000","last_undegraded":"2024-05-09T00:59:19.076280+0000","last_fullsized":"2024-05-09T00:59:19.076280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:10.610274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.076507+0000","last_change":"2024-05-09T00:58:34.821107+0000","last_active":"2024-05-09T00:59:19.076507+0000","last_peered":"2024-05-09T00:59:19.076507+0000","last_clean":"2024-05-09T00:59:19.076507+0000","last_became_active":"2024-05-09T00:58:34.820737+0000","last_became_peered":"2024-05-09T00:58:34.820737+0000","last_unstale":"2024-05-09T00:59:19.076507+0000","last_undegraded":"2024-05-09T00:59:19.076507+0000","last_fullsized":"2024-05-09T00:59:19.076507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:45.450781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.368263+0000","last_change":"2024-05-09T00:58:37.363559+0000","last_active":"2024-05-09T00:58:40.368263+0000","last_peered":"2024-05-09T00:58:40.368263+0000","last_clean":"2024-05-09T00:58:40.368263+0000","last_became_active":"2024-05-09T00:58:37.358299+0000","last_became_peered":"2024-05-09T00:58:37.358299+0000","last_unstale":"2024-05-09T00:58:40.368263+0000","last_undegraded":"2024-05-09T00:58:40.368263+0000","last_fullsized":"2024-05-09T00:58:40.368263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:15.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075249+0000","last_change":"2024-05-09T00:58:34.333154+0000","last_active":"2024-05-09T00:59:19.075249+0000","last_peered":"2024-05-09T00:59:19.075249+0000","last_clean":"2024-05-09T00:59:19.075249+0000","last_became_active":"2024-05-09T00:58:34.332469+0000","last_became_peered":"2024-05-09T00:58:34.332469+0000","last_unstale":"2024-05-09T00:59:19.075249+0000","last_undegraded":"2024-05-09T00:59:19.075249+0000","last_fullsized":"2024-05-09T00:59:19.075249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:56.343377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.360679+0000","last_change":"2024-05-09T00:58:37.361595+0000","last_active":"2024-05-09T00:58:40.360679+0000","last_peered":"2024-05-09T00:58:40.360679+0000","last_clean":"2024-05-09T00:58:40.360679+0000","last_became_active":"2024-05-09T00:58:37.361239+0000","last_became_peered":"2024-05-09T00:58:37.361239+0000","last_unstale":"2024-05-09T00:58:40.360679+0000","last_undegraded":"2024-05-09T00:58:40.360679+0000","last_fullsized":"2024-05-09T00:58:40.360679+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:24.526487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074945+0000","last_change":"2024-05-09T00:58:34.331974+0000","last_active":"2024-05-09T00:59:19.074945+0000","last_peered":"2024-05-09T00:59:19.074945+0000","last_clean":"2024-05-09T00:59:19.074945+0000","last_became_active":"2024-05-09T00:58:34.331460+0000","last_became_peered":"2024-05-09T00:58:34.331460+0000","last_unstale":"2024-05-09T00:59:19.074945+0000","last_undegraded":"2024-05-09T00:59:19.074945+0000","last_fullsized":"2024-05-09T00:59:19.074945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:17.746247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.373424+0000","last_change":"2024-05-09T00:58:37.370155+0000","last_active":"2024-05-09T00:58:40.373424+0000","last_peered":"2024-05-09T00:58:40.373424+0000","last_clean":"2024-05-09T00:58:40.373424+0000","last_became_active":"2024-05-09T00:58:37.369351+0000","last_became_peered":"2024-05-09T00:58:37.369351+0000","last_unstale":"2024-05-09T00:58:40.373424+0000","last_undegraded":"2024-05-09T00:58:40.373424+0000","last_fullsized":"2024-05-09T00:58:40.373424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:57.494715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:59:17.041819+0000","last_change":"2024-05-09T00:58:34.332532+0000","last_active":"2024-05-09T00:59:17.041819+0000","last_peered":"2024-05-09T00:59:17.041819+0000","last_clean":"2024-05-09T00:59:17.041819+0000","last_became_active":"2024-05-09T00:58:34.332202+0000","last_became_peered":"2024-05-09T00:58:34.332202+0000","last_unstale":"2024-05-09T00:59:17.041819+0000","last_undegraded":"2024-05-09T00:59:17.041819+0000","last_fullsized":"2024-05-09T00:59:17.041819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:17.561374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074558+0000","last_change":"2024-05-09T00:58:37.360504+0000","last_active":"2024-05-09T00:59:19.074558+0000","last_peered":"2024-05-09T00:59:19.074558+0000","last_clean":"2024-05-09T00:59:19.074558+0000","last_became_active":"2024-05-09T00:58:37.360078+0000","last_became_peered":"2024-05-09T00:58:37.360078+0000","last_unstale":"2024-05-09T00:59:19.074558+0000","last_undegraded":"2024-05-09T00:59:19.074558+0000","last_fullsized":"2024-05-09T00:59:19.074558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:19.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074437+0000","last_change":"2024-05-09T00:58:34.333762+0000","last_active":"2024-05-09T00:59:20.074437+0000","last_peered":"2024-05-09T00:59:20.074437+0000","last_clean":"2024-05-09T00:59:20.074437+0000","last_became_active":"2024-05-09T00:58:34.333376+0000","last_became_peered":"2024-05-09T00:58:34.333376+0000","last_unstale":"2024-05-09T00:59:20.074437+0000","last_undegraded":"2024-05-09T00:59:20.074437+0000","last_fullsized":"2024-05-09T00:59:20.074437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:58.027982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.373170+0000","last_change":"2024-05-09T00:58:37.363901+0000","last_active":"2024-05-09T00:58:40.373170+0000","last_peered":"2024-05-09T00:58:40.373170+0000","last_clean":"2024-05-09T00:58:40.373170+0000","last_became_active":"2024-05-09T00:58:37.363488+0000","last_became_peered":"2024-05-09T00:58:37.363488+0000","last_unstale":"2024-05-09T00:58:40.373170+0000","last_undegraded":"2024-05-09T00:58:40.373170+0000","last_fullsized":"2024-05-09T00:58:40.373170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:13.484840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072992+0000","last_change":"2024-05-09T00:58:34.332308+0000","last_active":"2024-05-09T00:59:20.072992+0000","last_peered":"2024-05-09T00:59:20.072992+0000","last_clean":"2024-05-09T00:59:20.072992+0000","last_became_active":"2024-05-09T00:58:34.331154+0000","last_became_peered":"2024-05-09T00:58:34.331154+0000","last_unstale":"2024-05-09T00:59:20.072992+0000","last_undegraded":"2024-05-09T00:59:20.072992+0000","last_fullsized":"2024-05-09T00:59:20.072992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.781375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074626+0000","last_change":"2024-05-09T00:58:37.368925+0000","last_active":"2024-05-09T00:59:19.074626+0000","last_peered":"2024-05-09T00:59:19.074626+0000","last_clean":"2024-05-09T00:59:19.074626+0000","last_became_active":"2024-05-09T00:58:37.368586+0000","last_became_peered":"2024-05-09T00:58:37.368586+0000","last_unstale":"2024-05-09T00:59:19.074626+0000","last_undegraded":"2024-05-09T00:59:19.074626+0000","last_fullsized":"2024-05-09T00:59:19.074626+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:57.248832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:56.003688+0000","last_change":"2024-05-09T00:58:34.334356+0000","last_active":"2024-05-09T00:58:56.003688+0000","last_peered":"2024-05-09T00:58:56.003688+0000","last_clean":"2024-05-09T00:58:56.003688+0000","last_became_active":"2024-05-09T00:58:34.333993+0000","last_became_peered":"2024-05-09T00:58:34.333993+0000","last_unstale":"2024-05-09T00:58:56.003688+0000","last_undegraded":"2024-05-09T00:58:56.003688+0000","last_fullsized":"2024-05-09T00:58:56.003688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:19.793851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.373699+0000","last_change":"2024-05-09T00:58:37.360565+0000","last_active":"2024-05-09T00:58:40.373699+0000","last_peered":"2024-05-09T00:58:40.373699+0000","last_clean":"2024-05-09T00:58:40.373699+0000","last_became_active":"2024-05-09T00:58:37.360215+0000","last_became_peered":"2024-05-09T00:58:37.360215+0000","last_unstale":"2024-05-09T00:58:40.373699+0000","last_undegraded":"2024-05-09T00:58:40.373699+0000","last_fullsized":"2024-05-09T00:58:40.373699+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:12.877333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074529+0000","last_change":"2024-05-09T00:58:34.332654+0000","last_active":"2024-05-09T00:59:20.074529+0000","last_peered":"2024-05-09T00:59:20.074529+0000","last_clean":"2024-05-09T00:59:20.074529+0000","last_became_active":"2024-05-09T00:58:34.331915+0000","last_became_peered":"2024-05-09T00:58:34.331915+0000","last_unstale":"2024-05-09T00:59:20.074529+0000","last_undegraded":"2024-05-09T00:59:20.074529+0000","last_fullsized":"2024-05-09T00:59:20.074529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:47.521158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.360954+0000","last_change":"2024-05-09T00:58:37.364248+0000","last_active":"2024-05-09T00:58:40.360954+0000","last_peered":"2024-05-09T00:58:40.360954+0000","last_clean":"2024-05-09T00:58:40.360954+0000","last_became_active":"2024-05-09T00:58:37.363872+0000","last_became_peered":"2024-05-09T00:58:37.363872+0000","last_unstale":"2024-05-09T00:58:40.360954+0000","last_undegraded":"2024-05-09T00:58:40.360954+0000","last_fullsized":"2024-05-09T00:58:40.360954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074947+0000","last_change":"2024-05-09T00:58:34.331157+0000","last_active":"2024-05-09T00:59:19.074947+0000","last_peered":"2024-05-09T00:59:19.074947+0000","last_clean":"2024-05-09T00:59:19.074947+0000","last_became_active":"2024-05-09T00:58:34.330151+0000","last_became_peered":"2024-05-09T00:58:34.330151+0000","last_unstale":"2024-05-09T00:59:19.074947+0000","last_undegraded":"2024-05-09T00:59:19.074947+0000","last_fullsized":"2024-05-09T00:59:19.074947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:07.777304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.368502+0000","last_change":"2024-05-09T00:58:37.369357+0000","last_active":"2024-05-09T00:58:40.368502+0000","last_peered":"2024-05-09T00:58:40.368502+0000","last_clean":"2024-05-09T00:58:40.368502+0000","last_became_active":"2024-05-09T00:58:37.368994+0000","last_became_peered":"2024-05-09T00:58:37.368994+0000","last_unstale":"2024-05-09T00:58:40.368502+0000","last_undegraded":"2024-05-09T00:58:40.368502+0000","last_fullsized":"2024-05-09T00:58:40.368502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:54.995817+0000","last_change":"2024-05-09T00:58:34.822508+0000","last_active":"2024-05-09T00:58:54.995817+0000","last_peered":"2024-05-09T00:58:54.995817+0000","last_clean":"2024-05-09T00:58:54.995817+0000","last_became_active":"2024-05-09T00:58:34.821765+0000","last_became_peered":"2024-05-09T00:58:34.821765+0000","last_unstale":"2024-05-09T00:58:54.995817+0000","last_undegraded":"2024-05-09T00:58:54.995817+0000","last_fullsized":"2024-05-09T00:58:54.995817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:56.931158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.360959+0000","last_change":"2024-05-09T00:58:37.362739+0000","last_active":"2024-05-09T00:58:40.360959+0000","last_peered":"2024-05-09T00:58:40.360959+0000","last_clean":"2024-05-09T00:58:40.360959+0000","last_became_active":"2024-05-09T00:58:37.362395+0000","last_became_peered":"2024-05-09T00:58:37.362395+0000","last_unstale":"2024-05-09T00:58:40.360959+0000","last_undegraded":"2024-05-09T00:58:40.360959+0000","last_fullsized":"2024-05-09T00:58:40.360959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:51.380197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'30","reported_seq":112,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074313+0000","last_change":"2024-05-09T00:58:34.336548+0000","last_active":"2024-05-09T00:59:20.074313+0000","last_peered":"2024-05-09T00:59:20.074313+0000","last_clean":"2024-05-09T00:59:20.074313+0000","last_became_active":"2024-05-09T00:58:34.335792+0000","last_became_peered":"2024-05-09T00:58:34.335792+0000","last_unstale":"2024-05-09T00:59:20.074313+0000","last_undegraded":"2024-05-09T00:59:20.074313+0000","last_fullsized":"2024-05-09T00:59:20.074313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:37.996544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56090,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":82,"num_write":32,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074919+0000","last_change":"2024-05-09T00:58:37.365468+0000","last_active":"2024-05-09T00:59:19.074919+0000","last_peered":"2024-05-09T00:59:19.074919+0000","last_clean":"2024-05-09T00:59:19.074919+0000","last_became_active":"2024-05-09T00:58:37.365085+0000","last_became_peered":"2024-05-09T00:58:37.365085+0000","last_unstale":"2024-05-09T00:59:19.074919+0000","last_undegraded":"2024-05-09T00:59:19.074919+0000","last_fullsized":"2024-05-09T00:59:19.074919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:06.836757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:57.008424+0000","last_change":"2024-05-09T00:58:34.331174+0000","last_active":"2024-05-09T00:58:57.008424+0000","last_peered":"2024-05-09T00:58:57.008424+0000","last_clean":"2024-05-09T00:58:57.008424+0000","last_became_active":"2024-05-09T00:58:34.330871+0000","last_became_peered":"2024-05-09T00:58:34.330871+0000","last_unstale":"2024-05-09T00:58:57.008424+0000","last_undegraded":"2024-05-09T00:58:57.008424+0000","last_fullsized":"2024-05-09T00:58:57.008424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:21:47.840730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072952+0000","last_change":"2024-05-09T00:58:37.367821+0000","last_active":"2024-05-09T00:59:20.072952+0000","last_peered":"2024-05-09T00:59:20.072952+0000","last_clean":"2024-05-09T00:59:20.072952+0000","last_became_active":"2024-05-09T00:58:37.367495+0000","last_became_peered":"2024-05-09T00:58:37.367495+0000","last_unstale":"2024-05-09T00:59:20.072952+0000","last_undegraded":"2024-05-09T00:59:20.072952+0000","last_fullsized":"2024-05-09T00:59:20.072952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:08.285301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:56.003884+0000","last_change":"2024-05-09T00:58:34.334381+0000","last_active":"2024-05-09T00:58:56.003884+0000","last_peered":"2024-05-09T00:58:56.003884+0000","last_clean":"2024-05-09T00:58:56.003884+0000","last_became_active":"2024-05-09T00:58:34.333948+0000","last_became_peered":"2024-05-09T00:58:34.333948+0000","last_unstale":"2024-05-09T00:58:56.003884+0000","last_undegraded":"2024-05-09T00:58:56.003884+0000","last_fullsized":"2024-05-09T00:58:56.003884+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:05.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":79,"state":"peering","last_fresh":"2024-05-09T00:58:40.369987+0000","last_change":"2024-05-09T00:59:19.074793+0000","last_active":"2024-05-09T00:59:19.074793+0000","last_peered":"2024-05-09T00:58:40.369987+0000","last_clean":"2024-05-09T00:58:40.369987+0000","last_became_active":"2024-05-09T00:58:37.363016+0000","last_became_peered":"2024-05-09T00:58:37.363016+0000","last_unstale":"2024-05-09T00:58:40.369987+0000","last_undegraded":"2024-05-09T00:58:40.369987+0000","last_fullsized":"2024-05-09T00:58:40.369987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,6,9],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'6","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.076333+0000","last_change":"2024-05-09T00:58:34.335831+0000","last_active":"2024-05-09T00:59:19.076333+0000","last_peered":"2024-05-09T00:59:19.076333+0000","last_clean":"2024-05-09T00:59:19.076333+0000","last_became_active":"2024-05-09T00:58:34.334950+0000","last_became_peered":"2024-05-09T00:58:34.334950+0000","last_unstale":"2024-05-09T00:59:19.076333+0000","last_undegraded":"2024-05-09T00:59:19.076333+0000","last_fullsized":"2024-05-09T00:59:19.076333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:05.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074226+0000","last_change":"2024-05-09T00:58:37.373115+0000","last_active":"2024-05-09T00:59:19.074226+0000","last_peered":"2024-05-09T00:59:19.074226+0000","last_clean":"2024-05-09T00:59:19.074226+0000","last_became_active":"2024-05-09T00:58:37.369976+0000","last_became_peered":"2024-05-09T00:58:37.369976+0000","last_unstale":"2024-05-09T00:59:19.074226+0000","last_undegraded":"2024-05-09T00:59:19.074226+0000","last_fullsized":"2024-05-09T00:59:19.074226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:40.439954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:56.005268+0000","last_change":"2024-05-09T00:58:34.822400+0000","last_active":"2024-05-09T00:58:56.005268+0000","last_peered":"2024-05-09T00:58:56.005268+0000","last_clean":"2024-05-09T00:58:56.005268+0000","last_became_active":"2024-05-09T00:58:34.821764+0000","last_became_peered":"2024-05-09T00:58:34.821764+0000","last_unstale":"2024-05-09T00:58:56.005268+0000","last_undegraded":"2024-05-09T00:58:56.005268+0000","last_fullsized":"2024-05-09T00:58:56.005268+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:41.442333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.372094+0000","last_change":"2024-05-09T00:58:37.358827+0000","last_active":"2024-05-09T00:58:40.372094+0000","last_peered":"2024-05-09T00:58:40.372094+0000","last_clean":"2024-05-09T00:58:40.372094+0000","last_became_active":"2024-05-09T00:58:37.358068+0000","last_became_peered":"2024-05-09T00:58:37.358068+0000","last_unstale":"2024-05-09T00:58:40.372094+0000","last_undegraded":"2024-05-09T00:58:40.372094+0000","last_fullsized":"2024-05-09T00:58:40.372094+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:29.007199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075626+0000","last_change":"2024-05-09T00:58:34.331661+0000","last_active":"2024-05-09T00:59:19.075626+0000","last_peered":"2024-05-09T00:59:19.075626+0000","last_clean":"2024-05-09T00:59:19.075626+0000","last_became_active":"2024-05-09T00:58:34.331271+0000","last_became_peered":"2024-05-09T00:58:34.331271+0000","last_unstale":"2024-05-09T00:59:19.075626+0000","last_undegraded":"2024-05-09T00:59:19.075626+0000","last_fullsized":"2024-05-09T00:59:19.075626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:10.130811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.375549+0000","last_change":"2024-05-09T00:58:37.367367+0000","last_active":"2024-05-09T00:58:40.375549+0000","last_peered":"2024-05-09T00:58:40.375549+0000","last_clean":"2024-05-09T00:58:40.375549+0000","last_became_active":"2024-05-09T00:58:37.366927+0000","last_became_peered":"2024-05-09T00:58:37.366927+0000","last_unstale":"2024-05-09T00:58:40.375549+0000","last_undegraded":"2024-05-09T00:58:40.375549+0000","last_fullsized":"2024-05-09T00:58:40.375549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:31.066913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.374048+0000","last_change":"2024-05-09T00:58:34.821956+0000","last_active":"2024-05-09T00:58:40.374048+0000","last_peered":"2024-05-09T00:58:40.374048+0000","last_clean":"2024-05-09T00:58:40.374048+0000","last_became_active":"2024-05-09T00:58:34.821570+0000","last_became_peered":"2024-05-09T00:58:34.821570+0000","last_unstale":"2024-05-09T00:58:40.374048+0000","last_undegraded":"2024-05-09T00:58:40.374048+0000","last_fullsized":"2024-05-09T00:58:40.374048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:45.027927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074275+0000","last_change":"2024-05-09T00:58:37.361646+0000","last_active":"2024-05-09T00:59:20.074275+0000","last_peered":"2024-05-09T00:59:20.074275+0000","last_clean":"2024-05-09T00:59:20.074275+0000","last_became_active":"2024-05-09T00:58:37.360216+0000","last_became_peered":"2024-05-09T00:58:37.360216+0000","last_unstale":"2024-05-09T00:59:20.074275+0000","last_undegraded":"2024-05-09T00:59:20.074275+0000","last_fullsized":"2024-05-09T00:59:20.074275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:13.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'5","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075070+0000","last_change":"2024-05-09T00:58:34.330657+0000","last_active":"2024-05-09T00:59:19.075070+0000","last_peered":"2024-05-09T00:59:19.075070+0000","last_clean":"2024-05-09T00:59:19.075070+0000","last_became_active":"2024-05-09T00:58:34.330235+0000","last_became_peered":"2024-05-09T00:58:34.330235+0000","last_unstale":"2024-05-09T00:59:19.075070+0000","last_undegraded":"2024-05-09T00:59:19.075070+0000","last_fullsized":"2024-05-09T00:59:19.075070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:21.647916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074324+0000","last_change":"2024-05-09T00:58:37.361155+0000","last_active":"2024-05-09T00:59:20.074324+0000","last_peered":"2024-05-09T00:59:20.074324+0000","last_clean":"2024-05-09T00:59:20.074324+0000","last_became_active":"2024-05-09T00:58:37.360653+0000","last_became_peered":"2024-05-09T00:58:37.360653+0000","last_unstale":"2024-05-09T00:59:20.074324+0000","last_undegraded":"2024-05-09T00:59:20.074324+0000","last_fullsized":"2024-05-09T00:59:20.074324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:49.473522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.372747+0000","last_change":"2024-05-09T00:58:37.367592+0000","last_active":"2024-05-09T00:58:40.372747+0000","last_peered":"2024-05-09T00:58:40.372747+0000","last_clean":"2024-05-09T00:58:40.372747+0000","last_became_active":"2024-05-09T00:58:37.366365+0000","last_became_peered":"2024-05-09T00:58:37.366365+0000","last_unstale":"2024-05-09T00:58:40.372747+0000","last_undegraded":"2024-05-09T00:58:40.372747+0000","last_fullsized":"2024-05-09T00:58:40.372747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:37.279269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072844+0000","last_change":"2024-05-09T00:58:34.821092+0000","last_active":"2024-05-09T00:59:20.072844+0000","last_peered":"2024-05-09T00:59:20.072844+0000","last_clean":"2024-05-09T00:59:20.072844+0000","last_became_active":"2024-05-09T00:58:34.820713+0000","last_became_peered":"2024-05-09T00:58:34.820713+0000","last_unstale":"2024-05-09T00:59:20.072844+0000","last_undegraded":"2024-05-09T00:59:20.072844+0000","last_fullsized":"2024-05-09T00:59:20.072844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:11.372613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075324+0000","last_change":"2024-05-09T00:58:37.364624+0000","last_active":"2024-05-09T00:59:19.075324+0000","last_peered":"2024-05-09T00:59:19.075324+0000","last_clean":"2024-05-09T00:59:19.075324+0000","last_became_active":"2024-05-09T00:58:37.364013+0000","last_became_peered":"2024-05-09T00:58:37.364013+0000","last_unstale":"2024-05-09T00:59:19.075324+0000","last_undegraded":"2024-05-09T00:59:19.075324+0000","last_fullsized":"2024-05-09T00:59:19.075324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:14.205958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075829+0000","last_change":"2024-05-09T00:58:34.335364+0000","last_active":"2024-05-09T00:59:19.075829+0000","last_peered":"2024-05-09T00:59:19.075829+0000","last_clean":"2024-05-09T00:59:19.075829+0000","last_became_active":"2024-05-09T00:58:34.334965+0000","last_became_peered":"2024-05-09T00:58:34.334965+0000","last_unstale":"2024-05-09T00:59:19.075829+0000","last_undegraded":"2024-05-09T00:59:19.075829+0000","last_fullsized":"2024-05-09T00:59:19.075829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:50.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074361+0000","last_change":"2024-05-09T00:57:07.637377+0000","last_active":"2024-05-09T00:59:19.074361+0000","last_peered":"2024-05-09T00:59:19.074361+0000","last_clean":"2024-05-09T00:59:19.074361+0000","last_became_active":"2024-05-09T00:57:07.631727+0000","last_became_peered":"2024-05-09T00:57:07.631727+0000","last_unstale":"2024-05-09T00:59:19.074361+0000","last_undegraded":"2024-05-09T00:59:19.074361+0000","last_fullsized":"2024-05-09T00:59:19.074361+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_clean_scrub_stamp":"2024-05-09T00:53:47.457762+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:09.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.081462+0000","last_change":"2024-05-09T00:59:20.081462+0000","last_active":"2024-05-09T00:59:20.081462+0000","last_peered":"2024-05-09T00:59:20.081462+0000","last_clean":"2024-05-09T00:59:20.081462+0000","last_became_active":"2024-05-09T00:59:20.080955+0000","last_became_peered":"2024-05-09T00:59:20.080955+0000","last_unstale":"2024-05-09T00:59:20.081462+0000","last_undegraded":"2024-05-09T00:59:20.081462+0000","last_fullsized":"2024-05-09T00:59:20.081462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:11.106912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074500+0000","last_change":"2024-05-09T00:58:34.329694+0000","last_active":"2024-05-09T00:59:19.074500+0000","last_peered":"2024-05-09T00:59:19.074500+0000","last_clean":"2024-05-09T00:59:19.074500+0000","last_became_active":"2024-05-09T00:58:34.329267+0000","last_became_peered":"2024-05-09T00:58:34.329267+0000","last_unstale":"2024-05-09T00:59:19.074500+0000","last_undegraded":"2024-05-09T00:59:19.074500+0000","last_fullsized":"2024-05-09T00:59:19.074500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:28.060489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075040+0000","last_change":"2024-05-09T00:58:34.822706+0000","last_active":"2024-05-09T00:59:19.075040+0000","last_peered":"2024-05-09T00:59:19.075040+0000","last_clean":"2024-05-09T00:59:19.075040+0000","last_became_active":"2024-05-09T00:58:34.822223+0000","last_became_peered":"2024-05-09T00:58:34.822223+0000","last_unstale":"2024-05-09T00:59:19.075040+0000","last_undegraded":"2024-05-09T00:59:19.075040+0000","last_fullsized":"2024-05-09T00:59:19.075040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:47.378798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073442+0000","last_change":"2024-05-09T00:58:37.360600+0000","last_active":"2024-05-09T00:59:20.073442+0000","last_peered":"2024-05-09T00:59:20.073442+0000","last_clean":"2024-05-09T00:59:20.073442+0000","last_became_active":"2024-05-09T00:58:37.360265+0000","last_became_peered":"2024-05-09T00:58:37.360265+0000","last_unstale":"2024-05-09T00:59:20.073442+0000","last_undegraded":"2024-05-09T00:59:20.073442+0000","last_fullsized":"2024-05-09T00:59:20.073442+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:44.423709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'13","reported_seq":35,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:59:13.370215+0000","last_change":"2024-05-09T00:58:34.331544+0000","last_active":"2024-05-09T00:59:13.370215+0000","last_peered":"2024-05-09T00:59:13.370215+0000","last_clean":"2024-05-09T00:59:13.370215+0000","last_became_active":"2024-05-09T00:58:34.331147+0000","last_became_peered":"2024-05-09T00:58:34.331147+0000","last_unstale":"2024-05-09T00:59:13.370215+0000","last_undegraded":"2024-05-09T00:59:13.370215+0000","last_fullsized":"2024-05-09T00:59:13.370215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:27.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.076164+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T00:59:19.076164+0000","last_peered":"2024-05-09T00:59:19.076164+0000","last_clean":"2024-05-09T00:59:19.076164+0000","last_became_active":"2024-05-09T00:58:37.367875+0000","last_became_peered":"2024-05-09T00:58:37.367875+0000","last_unstale":"2024-05-09T00:59:19.076164+0000","last_undegraded":"2024-05-09T00:59:19.076164+0000","last_fullsized":"2024-05-09T00:59:19.076164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:45.800008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075465+0000","last_change":"2024-05-09T00:58:34.956500+0000","last_active":"2024-05-09T00:59:19.075465+0000","last_peered":"2024-05-09T00:59:19.075465+0000","last_clean":"2024-05-09T00:59:19.075465+0000","last_became_active":"2024-05-09T00:58:34.956108+0000","last_became_peered":"2024-05-09T00:58:34.956108+0000","last_unstale":"2024-05-09T00:59:19.075465+0000","last_undegraded":"2024-05-09T00:59:19.075465+0000","last_fullsized":"2024-05-09T00:59:19.075465+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:03.283325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.370445+0000","last_change":"2024-05-09T00:58:37.369174+0000","last_active":"2024-05-09T00:58:40.370445+0000","last_peered":"2024-05-09T00:58:40.370445+0000","last_clean":"2024-05-09T00:58:40.370445+0000","last_became_active":"2024-05-09T00:58:37.368650+0000","last_became_peered":"2024-05-09T00:58:37.368650+0000","last_unstale":"2024-05-09T00:58:40.370445+0000","last_undegraded":"2024-05-09T00:58:40.370445+0000","last_fullsized":"2024-05-09T00:58:40.370445+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:07.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:52.983704+0000","last_change":"2024-05-09T00:58:34.821742+0000","last_active":"2024-05-09T00:58:52.983704+0000","last_peered":"2024-05-09T00:58:52.983704+0000","last_clean":"2024-05-09T00:58:52.983704+0000","last_became_active":"2024-05-09T00:58:34.821290+0000","last_became_peered":"2024-05-09T00:58:34.821290+0000","last_unstale":"2024-05-09T00:58:52.983704+0000","last_undegraded":"2024-05-09T00:58:52.983704+0000","last_fullsized":"2024-05-09T00:58:52.983704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:18.735763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074462+0000","last_change":"2024-05-09T00:58:37.361727+0000","last_active":"2024-05-09T00:59:19.074462+0000","last_peered":"2024-05-09T00:59:19.074462+0000","last_clean":"2024-05-09T00:59:19.074462+0000","last_became_active":"2024-05-09T00:58:37.361351+0000","last_became_peered":"2024-05-09T00:58:37.361351+0000","last_unstale":"2024-05-09T00:59:19.074462+0000","last_undegraded":"2024-05-09T00:59:19.074462+0000","last_fullsized":"2024-05-09T00:59:19.074462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:14.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074818+0000","last_change":"2024-05-09T00:58:34.330578+0000","last_active":"2024-05-09T00:59:19.074818+0000","last_peered":"2024-05-09T00:59:19.074818+0000","last_clean":"2024-05-09T00:59:19.074818+0000","last_became_active":"2024-05-09T00:58:34.330273+0000","last_became_peered":"2024-05-09T00:58:34.330273+0000","last_unstale":"2024-05-09T00:59:19.074818+0000","last_undegraded":"2024-05-09T00:59:19.074818+0000","last_fullsized":"2024-05-09T00:59:19.074818+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:45.795771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.376040+0000","last_change":"2024-05-09T00:58:37.371323+0000","last_active":"2024-05-09T00:58:40.376040+0000","last_peered":"2024-05-09T00:58:40.376040+0000","last_clean":"2024-05-09T00:58:40.376040+0000","last_became_active":"2024-05-09T00:58:37.370942+0000","last_became_peered":"2024-05-09T00:58:37.370942+0000","last_unstale":"2024-05-09T00:58:40.376040+0000","last_undegraded":"2024-05-09T00:58:40.376040+0000","last_fullsized":"2024-05-09T00:58:40.376040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:57.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:54.995783+0000","last_change":"2024-05-09T00:58:34.328709+0000","last_active":"2024-05-09T00:58:54.995783+0000","last_peered":"2024-05-09T00:58:54.995783+0000","last_clean":"2024-05-09T00:58:54.995783+0000","last_became_active":"2024-05-09T00:58:34.328350+0000","last_became_peered":"2024-05-09T00:58:34.328350+0000","last_unstale":"2024-05-09T00:58:54.995783+0000","last_undegraded":"2024-05-09T00:58:54.995783+0000","last_fullsized":"2024-05-09T00:58:54.995783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:03.071552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075800+0000","last_change":"2024-05-09T00:58:37.361319+0000","last_active":"2024-05-09T00:59:19.075800+0000","last_peered":"2024-05-09T00:59:19.075800+0000","last_clean":"2024-05-09T00:59:19.075800+0000","last_became_active":"2024-05-09T00:58:37.360703+0000","last_became_peered":"2024-05-09T00:58:37.360703+0000","last_unstale":"2024-05-09T00:59:19.075800+0000","last_undegraded":"2024-05-09T00:59:19.075800+0000","last_fullsized":"2024-05-09T00:59:19.075800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:24.202453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074886+0000","last_change":"2024-05-09T00:58:34.333394+0000","last_active":"2024-05-09T00:59:19.074886+0000","last_peered":"2024-05-09T00:59:19.074886+0000","last_clean":"2024-05-09T00:59:19.074886+0000","last_became_active":"2024-05-09T00:58:34.332902+0000","last_became_peered":"2024-05-09T00:58:34.332902+0000","last_unstale":"2024-05-09T00:59:19.074886+0000","last_undegraded":"2024-05-09T00:59:19.074886+0000","last_fullsized":"2024-05-09T00:59:19.074886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:38.301831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075230+0000","last_change":"2024-05-09T00:58:37.366963+0000","last_active":"2024-05-09T00:59:19.075230+0000","last_peered":"2024-05-09T00:59:19.075230+0000","last_clean":"2024-05-09T00:59:19.075230+0000","last_became_active":"2024-05-09T00:58:37.366591+0000","last_became_peered":"2024-05-09T00:58:37.366591+0000","last_unstale":"2024-05-09T00:59:19.075230+0000","last_undegraded":"2024-05-09T00:59:19.075230+0000","last_fullsized":"2024-05-09T00:59:19.075230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:44.894281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'6","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:59:15.038555+0000","last_change":"2024-05-09T00:58:34.956368+0000","last_active":"2024-05-09T00:59:15.038555+0000","last_peered":"2024-05-09T00:59:15.038555+0000","last_clean":"2024-05-09T00:59:15.038555+0000","last_became_active":"2024-05-09T00:58:34.955888+0000","last_became_peered":"2024-05-09T00:58:34.955888+0000","last_unstale":"2024-05-09T00:59:15.038555+0000","last_undegraded":"2024-05-09T00:59:15.038555+0000","last_fullsized":"2024-05-09T00:59:15.038555+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:15.884435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074897+0000","last_change":"2024-05-09T00:58:37.368150+0000","last_active":"2024-05-09T00:59:19.074897+0000","last_peered":"2024-05-09T00:59:19.074897+0000","last_clean":"2024-05-09T00:59:19.074897+0000","last_became_active":"2024-05-09T00:58:37.367800+0000","last_became_peered":"2024-05-09T00:58:37.367800+0000","last_unstale":"2024-05-09T00:59:19.074897+0000","last_undegraded":"2024-05-09T00:59:19.074897+0000","last_fullsized":"2024-05-09T00:59:19.074897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:20.791816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:56.003536+0000","last_change":"2024-05-09T00:58:34.329311+0000","last_active":"2024-05-09T00:58:56.003536+0000","last_peered":"2024-05-09T00:58:56.003536+0000","last_clean":"2024-05-09T00:58:56.003536+0000","last_became_active":"2024-05-09T00:58:34.328841+0000","last_became_peered":"2024-05-09T00:58:34.328841+0000","last_unstale":"2024-05-09T00:58:56.003536+0000","last_undegraded":"2024-05-09T00:58:56.003536+0000","last_fullsized":"2024-05-09T00:58:56.003536+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074641+0000","last_change":"2024-05-09T00:58:37.369498+0000","last_active":"2024-05-09T00:59:19.074641+0000","last_peered":"2024-05-09T00:59:19.074641+0000","last_clean":"2024-05-09T00:59:19.074641+0000","last_became_active":"2024-05-09T00:58:37.369166+0000","last_became_peered":"2024-05-09T00:58:37.369166+0000","last_unstale":"2024-05-09T00:59:19.074641+0000","last_undegraded":"2024-05-09T00:59:19.074641+0000","last_fullsized":"2024-05-09T00:59:19.074641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:56.411666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073056+0000","last_change":"2024-05-09T00:58:34.328756+0000","last_active":"2024-05-09T00:59:20.073056+0000","last_peered":"2024-05-09T00:59:20.073056+0000","last_clean":"2024-05-09T00:59:20.073056+0000","last_became_active":"2024-05-09T00:58:34.328381+0000","last_became_peered":"2024-05-09T00:58:34.328381+0000","last_unstale":"2024-05-09T00:59:20.073056+0000","last_undegraded":"2024-05-09T00:59:20.073056+0000","last_fullsized":"2024-05-09T00:59:20.073056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:26.558360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075310+0000","last_change":"2024-05-09T00:58:37.369557+0000","last_active":"2024-05-09T00:59:19.075310+0000","last_peered":"2024-05-09T00:59:19.075310+0000","last_clean":"2024-05-09T00:59:19.075310+0000","last_became_active":"2024-05-09T00:58:37.369225+0000","last_became_peered":"2024-05-09T00:58:37.369225+0000","last_unstale":"2024-05-09T00:59:19.075310+0000","last_undegraded":"2024-05-09T00:59:19.075310+0000","last_fullsized":"2024-05-09T00:59:19.075310+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:21.761421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.376208+0000","last_change":"2024-05-09T00:58:37.369919+0000","last_active":"2024-05-09T00:58:40.376208+0000","last_peered":"2024-05-09T00:58:40.376208+0000","last_clean":"2024-05-09T00:58:40.376208+0000","last_became_active":"2024-05-09T00:58:37.369507+0000","last_became_peered":"2024-05-09T00:58:37.369507+0000","last_unstale":"2024-05-09T00:58:40.376208+0000","last_undegraded":"2024-05-09T00:58:40.376208+0000","last_fullsized":"2024-05-09T00:58:40.376208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.294074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.369208+0000","last_change":"2024-05-09T00:58:37.363775+0000","last_active":"2024-05-09T00:58:40.369208+0000","last_peered":"2024-05-09T00:58:40.369208+0000","last_clean":"2024-05-09T00:58:40.369208+0000","last_became_active":"2024-05-09T00:58:37.363394+0000","last_became_peered":"2024-05-09T00:58:37.363394+0000","last_unstale":"2024-05-09T00:58:40.369208+0000","last_undegraded":"2024-05-09T00:58:40.369208+0000","last_fullsized":"2024-05-09T00:58:40.369208+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.156009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.368888+0000","last_change":"2024-05-09T00:58:37.357699+0000","last_active":"2024-05-09T00:58:40.368888+0000","last_peered":"2024-05-09T00:58:40.368888+0000","last_clean":"2024-05-09T00:58:40.368888+0000","last_became_active":"2024-05-09T00:58:37.357356+0000","last_became_peered":"2024-05-09T00:58:37.357356+0000","last_unstale":"2024-05-09T00:58:40.368888+0000","last_undegraded":"2024-05-09T00:58:40.368888+0000","last_fullsized":"2024-05-09T00:58:40.368888+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:14.861644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.368443+0000","last_change":"2024-05-09T00:58:37.369419+0000","last_active":"2024-05-09T00:58:40.368443+0000","last_peered":"2024-05-09T00:58:40.368443+0000","last_clean":"2024-05-09T00:58:40.368443+0000","last_became_active":"2024-05-09T00:58:37.363949+0000","last_became_peered":"2024-05-09T00:58:37.363949+0000","last_unstale":"2024-05-09T00:58:40.368443+0000","last_undegraded":"2024-05-09T00:58:40.368443+0000","last_fullsized":"2024-05-09T00:58:40.368443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:04.081713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073514+0000","last_change":"2024-05-09T00:58:37.373651+0000","last_active":"2024-05-09T00:59:20.073514+0000","last_peered":"2024-05-09T00:59:20.073514+0000","last_clean":"2024-05-09T00:59:20.073514+0000","last_became_active":"2024-05-09T00:58:37.373257+0000","last_became_peered":"2024-05-09T00:58:37.373257+0000","last_unstale":"2024-05-09T00:59:20.073514+0000","last_undegraded":"2024-05-09T00:59:20.073514+0000","last_fullsized":"2024-05-09T00:59:20.073514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:27.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.376080+0000","last_change":"2024-05-09T00:58:37.367666+0000","last_active":"2024-05-09T00:58:40.376080+0000","last_peered":"2024-05-09T00:58:40.376080+0000","last_clean":"2024-05-09T00:58:40.376080+0000","last_became_active":"2024-05-09T00:58:37.366869+0000","last_became_peered":"2024-05-09T00:58:37.366869+0000","last_unstale":"2024-05-09T00:58:40.376080+0000","last_undegraded":"2024-05-09T00:58:40.376080+0000","last_fullsized":"2024-05-09T00:58:40.376080+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:07.952594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.369844+0000","last_change":"2024-05-09T00:58:37.362205+0000","last_active":"2024-05-09T00:58:40.369844+0000","last_peered":"2024-05-09T00:58:40.369844+0000","last_clean":"2024-05-09T00:58:40.369844+0000","last_became_active":"2024-05-09T00:58:37.361704+0000","last_became_peered":"2024-05-09T00:58:37.361704+0000","last_unstale":"2024-05-09T00:58:40.369844+0000","last_undegraded":"2024-05-09T00:58:40.369844+0000","last_fullsized":"2024-05-09T00:58:40.369844+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:34.334593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.076059+0000","last_change":"2024-05-09T00:58:37.367143+0000","last_active":"2024-05-09T00:59:19.076059+0000","last_peered":"2024-05-09T00:59:19.076059+0000","last_clean":"2024-05-09T00:59:19.076059+0000","last_became_active":"2024-05-09T00:58:37.364364+0000","last_became_peered":"2024-05-09T00:58:37.364364+0000","last_unstale":"2024-05-09T00:59:19.076059+0000","last_undegraded":"2024-05-09T00:59:19.076059+0000","last_fullsized":"2024-05-09T00:59:19.076059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:55.154458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.372327+0000","last_change":"2024-05-09T00:58:37.365757+0000","last_active":"2024-05-09T00:58:40.372327+0000","last_peered":"2024-05-09T00:58:40.372327+0000","last_clean":"2024-05-09T00:58:40.372327+0000","last_became_active":"2024-05-09T00:58:37.365408+0000","last_became_peered":"2024-05-09T00:58:37.365408+0000","last_unstale":"2024-05-09T00:58:40.372327+0000","last_undegraded":"2024-05-09T00:58:40.372327+0000","last_fullsized":"2024-05-09T00:58:40.372327+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074627+0000","last_change":"2024-05-09T00:58:37.366954+0000","last_active":"2024-05-09T00:59:19.074627+0000","last_peered":"2024-05-09T00:59:19.074627+0000","last_clean":"2024-05-09T00:59:19.074627+0000","last_became_active":"2024-05-09T00:58:37.364361+0000","last_became_peered":"2024-05-09T00:58:37.364361+0000","last_unstale":"2024-05-09T00:59:19.074627+0000","last_undegraded":"2024-05-09T00:59:19.074627+0000","last_fullsized":"2024-05-09T00:59:19.074627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:31.248873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.361273+0000","last_change":"2024-05-09T00:58:37.368467+0000","last_active":"2024-05-09T00:58:40.361273+0000","last_peered":"2024-05-09T00:58:40.361273+0000","last_clean":"2024-05-09T00:58:40.361273+0000","last_became_active":"2024-05-09T00:58:37.368104+0000","last_became_peered":"2024-05-09T00:58:37.368104+0000","last_unstale":"2024-05-09T00:58:40.361273+0000","last_undegraded":"2024-05-09T00:58:40.361273+0000","last_fullsized":"2024-05-09T00:58:40.361273+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073225+0000","last_change":"2024-05-09T00:58:37.366897+0000","last_active":"2024-05-09T00:59:20.073225+0000","last_peered":"2024-05-09T00:59:20.073225+0000","last_clean":"2024-05-09T00:59:20.073225+0000","last_became_active":"2024-05-09T00:58:37.366555+0000","last_became_peered":"2024-05-09T00:58:37.366555+0000","last_unstale":"2024-05-09T00:59:20.073225+0000","last_undegraded":"2024-05-09T00:59:20.073225+0000","last_fullsized":"2024-05-09T00:59:20.073225+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.394191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:58:40.375135+0000","last_change":"2024-05-09T00:58:37.358875+0000","last_active":"2024-05-09T00:58:40.375135+0000","last_peered":"2024-05-09T00:58:40.375135+0000","last_clean":"2024-05-09T00:58:40.375135+0000","last_became_active":"2024-05-09T00:58:37.358505+0000","last_became_peered":"2024-05-09T00:58:37.358505+0000","last_unstale":"2024-05-09T00:58:40.375135+0000","last_undegraded":"2024-05-09T00:58:40.375135+0000","last_fullsized":"2024-05-09T00:58:40.375135+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:15.268147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63294,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":268,"num_read_kb":206,"num_write":240,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":179092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678041,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":860160,"data_stored":414433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874269,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1556480,"data_stored":1061552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037794,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":413972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":892928,"data_stored":422877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1490944,"data_stored":1015395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":880640,"data_stored":422216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":465297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":888832,"data_stored":415419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":942080,"data_stored":465908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":422041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":880640,"data_stored":422468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1490944,"data_stored":1006155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":53058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:59:22.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T00:59:23.197 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:23.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:23 smithi037 ceph-mon[30122]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:59:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:23 smithi136 ceph-mon[34110]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:59:23.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:23 smithi151 ceph-mon[34780]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:59:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:24 smithi136 ceph-mon[34110]: pgmap v313: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:24 smithi037 ceph-mon[30122]: pgmap v313: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:24.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:24 smithi151 ceph-mon[34780]: pgmap v313: 97 pgs: 1 peering, 96 active+clean; 639 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.2 KiB/s wr, 13 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:24.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 -- 172.21.15.37:0/1576898208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460107e30 msgr2=0x7fd460108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:24.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 --2- 172.21.15.37:0/1576898208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460107e30 0x7fd460108240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4480099c0 tx=0x7fd448009cd0 comp rx=0 tx=0).stop 2024-05-09T00:59:24.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 -- 172.21.15.37:0/1576898208 shutdown_connections 2024-05-09T00:59:24.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 --2- 172.21.15.37:0/1576898208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd460108780 0x7fd4601100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:24.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 --2- 172.21.15.37:0/1576898208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd460103550 0x7fd460103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:24.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 --2- 172.21.15.37:0/1576898208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460107e30 0x7fd460108240 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:24.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 -- 172.21.15.37:0/1576898208 >> 172.21.15.37:0/1576898208 conn(0x7fd460078e00 msgr2=0x7fd460079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:24.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 -- 172.21.15.37:0/1576898208 shutdown_connections 2024-05-09T00:59:24.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.912+0000 7fd4651d7700 1 -- 172.21.15.37:0/1576898208 wait complete. 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.913+0000 7fd4651d7700 1 Processor -- start 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.913+0000 7fd4651d7700 1 -- start start 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd4651d7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd460103550 0x7fd46019af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd4651d7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd460107e30 0x7fd46019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd4651d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460108780 0x7fd46019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd4651d7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd460114580 con 0x7fd460108780 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd4651d7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd460114400 con 0x7fd460107e30 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd4651d7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd460114700 con 0x7fd460103550 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460108780 0x7fd46019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460108780 0x7fd46019f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46756/0 (socket says 172.21.15.37:46756) 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 -- 172.21.15.37:0/4179295267 learned_addr learned my addr 172.21.15.37:0/4179295267 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:24.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45e59c700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd460107e30 0x7fd46019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45ed9d700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd460103550 0x7fd46019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 -- 172.21.15.37:0/4179295267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd460103550 msgr2=0x7fd46019af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd460103550 0x7fd46019af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 -- 172.21.15.37:0/4179295267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd460107e30 msgr2=0x7fd46019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd460107e30 0x7fd46019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 -- 172.21.15.37:0/4179295267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46019fe00 con 0x7fd460108780 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.914+0000 7fd45f59e700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460108780 0x7fd46019f760 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd45800b970 tx=0x7fd45800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.915+0000 7fd457fff700 1 -- 172.21.15.37:0/4179295267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458019070 con 0x7fd460108780 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.915+0000 7fd457fff700 1 -- 172.21.15.37:0/4179295267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd45800cde0 con 0x7fd460108780 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.915+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4601a00f0 con 0x7fd460108780 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.915+0000 7fd457fff700 1 -- 172.21.15.37:0/4179295267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458007370 con 0x7fd460108780 2024-05-09T00:59:24.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.915+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4601a7a10 con 0x7fd460108780 2024-05-09T00:59:24.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.916+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4601049b0 con 0x7fd460108780 2024-05-09T00:59:24.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.918+0000 7fd457fff700 1 -- 172.21.15.37:0/4179295267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd45801c070 con 0x7fd460108780 2024-05-09T00:59:24.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.919+0000 7fd457fff700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd44c0b2910 0x7fd44c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:24.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.919+0000 7fd45ed9d700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd44c0b2910 0x7fd44c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:24.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.919+0000 7fd457fff700 1 -- 172.21.15.37:0/4179295267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd4580e1ef0 con 0x7fd460108780 2024-05-09T00:59:24.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.920+0000 7fd45ed9d700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd44c0b2910 0x7fd44c0b4e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd450006fd0 tx=0x7fd450008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:24.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:24.923+0000 7fd457fff700 1 -- 172.21.15.37:0/4179295267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd458023070 con 0x7fd460108780 2024-05-09T00:59:25.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.134+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd46019c290 con 0x7fd44c0b2910 2024-05-09T00:59:25.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.143+0000 7fd457fff700 1 -- 172.21.15.37:0/4179295267 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258743 (secure 0 0 0) 0x7fd46019c290 con 0x7fd44c0b2910 2024-05-09T00:59:25.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:59:25.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd44c0b2910 msgr2=0x7fd44c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:25.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd44c0b2910 0x7fd44c0b4e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd450006fd0 tx=0x7fd450008040 comp rx=0 tx=0).stop 2024-05-09T00:59:25.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460108780 msgr2=0x7fd46019f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460108780 0x7fd46019f760 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd45800b970 tx=0x7fd45800bc80 comp rx=0 tx=0).stop 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 shutdown_connections 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd44c0b2910 0x7fd44c0b4e20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd460108780 0x7fd46019f760 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd460103550 0x7fd46019af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 --2- 172.21.15.37:0/4179295267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd460107e30 0x7fd46019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.146+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 >> 172.21.15.37:0/4179295267 conn(0x7fd460078e00 msgr2=0x7fd460100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.147+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 shutdown_connections 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:25.147+0000 7fd4651d7700 1 -- 172.21.15.37:0/4179295267 wait complete. 2024-05-09T00:59:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-09T00:59:25.774 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-05-09T00:59:24.893499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653896,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":368,"num_read_kb":274,"num_write":369,"num_write_kb":2283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":287,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382496,"kb_used_data":12488,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559328,"statfs":{"total":1151940427776,"available":1151548751872,"internally_reserved":0,"allocated":12787712,"data_stored":7085334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5395,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002026"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074322+0000","last_change":"2024-05-09T00:58:37.371502+0000","last_active":"2024-05-09T00:59:20.074322+0000","last_peered":"2024-05-09T00:59:20.074322+0000","last_clean":"2024-05-09T00:59:20.074322+0000","last_became_active":"2024-05-09T00:58:37.371172+0000","last_became_peered":"2024-05-09T00:58:37.371172+0000","last_unstale":"2024-05-09T00:59:20.074322+0000","last_undegraded":"2024-05-09T00:59:20.074322+0000","last_fullsized":"2024-05-09T00:59:20.074322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:37.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077052+0000","last_change":"2024-05-09T00:58:37.362831+0000","last_active":"2024-05-09T00:59:20.077052+0000","last_peered":"2024-05-09T00:59:20.077052+0000","last_clean":"2024-05-09T00:59:20.077052+0000","last_became_active":"2024-05-09T00:58:37.362063+0000","last_became_peered":"2024-05-09T00:58:37.362063+0000","last_unstale":"2024-05-09T00:59:20.077052+0000","last_undegraded":"2024-05-09T00:59:20.077052+0000","last_fullsized":"2024-05-09T00:59:20.077052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:01.222962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076657+0000","last_change":"2024-05-09T00:58:37.369903+0000","last_active":"2024-05-09T00:59:20.076657+0000","last_peered":"2024-05-09T00:59:20.076657+0000","last_clean":"2024-05-09T00:59:20.076657+0000","last_became_active":"2024-05-09T00:58:37.366215+0000","last_became_peered":"2024-05-09T00:58:37.366215+0000","last_unstale":"2024-05-09T00:59:20.076657+0000","last_undegraded":"2024-05-09T00:59:20.076657+0000","last_fullsized":"2024-05-09T00:59:20.076657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:47.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348586+0000","last_change":"2024-05-09T00:58:37.358878+0000","last_active":"2024-05-09T00:59:20.348586+0000","last_peered":"2024-05-09T00:59:20.348586+0000","last_clean":"2024-05-09T00:59:20.348586+0000","last_became_active":"2024-05-09T00:58:37.358516+0000","last_became_peered":"2024-05-09T00:58:37.358516+0000","last_unstale":"2024-05-09T00:59:20.348586+0000","last_undegraded":"2024-05-09T00:59:20.348586+0000","last_fullsized":"2024-05-09T00:59:20.348586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075386+0000","last_change":"2024-05-09T00:58:37.358196+0000","last_active":"2024-05-09T00:59:19.075386+0000","last_peered":"2024-05-09T00:59:19.075386+0000","last_clean":"2024-05-09T00:59:19.075386+0000","last_became_active":"2024-05-09T00:58:37.357840+0000","last_became_peered":"2024-05-09T00:58:37.357840+0000","last_unstale":"2024-05-09T00:59:19.075386+0000","last_undegraded":"2024-05-09T00:59:19.075386+0000","last_fullsized":"2024-05-09T00:59:19.075386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:58.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074601+0000","last_change":"2024-05-09T00:58:37.364523+0000","last_active":"2024-05-09T00:59:20.074601+0000","last_peered":"2024-05-09T00:59:20.074601+0000","last_clean":"2024-05-09T00:59:20.074601+0000","last_became_active":"2024-05-09T00:58:37.364172+0000","last_became_peered":"2024-05-09T00:58:37.364172+0000","last_unstale":"2024-05-09T00:59:20.074601+0000","last_undegraded":"2024-05-09T00:59:20.074601+0000","last_fullsized":"2024-05-09T00:59:20.074601+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:36.872701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075057+0000","last_change":"2024-05-09T00:58:37.371226+0000","last_active":"2024-05-09T00:59:20.075057+0000","last_peered":"2024-05-09T00:59:20.075057+0000","last_clean":"2024-05-09T00:59:20.075057+0000","last_became_active":"2024-05-09T00:58:37.370647+0000","last_became_peered":"2024-05-09T00:58:37.370647+0000","last_unstale":"2024-05-09T00:59:20.075057+0000","last_undegraded":"2024-05-09T00:59:20.075057+0000","last_fullsized":"2024-05-09T00:59:20.075057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:46.350845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077267+0000","last_change":"2024-05-09T00:58:37.362487+0000","last_active":"2024-05-09T00:59:20.077267+0000","last_peered":"2024-05-09T00:59:20.077267+0000","last_clean":"2024-05-09T00:59:20.077267+0000","last_became_active":"2024-05-09T00:58:37.361454+0000","last_became_peered":"2024-05-09T00:58:37.361454+0000","last_unstale":"2024-05-09T00:59:20.077267+0000","last_undegraded":"2024-05-09T00:59:20.077267+0000","last_fullsized":"2024-05-09T00:59:20.077267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:36.930754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.088494+0000","last_change":"2024-05-09T00:58:37.370069+0000","last_active":"2024-05-09T00:59:20.088494+0000","last_peered":"2024-05-09T00:59:20.088494+0000","last_clean":"2024-05-09T00:59:20.088494+0000","last_became_active":"2024-05-09T00:58:37.369634+0000","last_became_peered":"2024-05-09T00:58:37.369634+0000","last_unstale":"2024-05-09T00:59:20.088494+0000","last_undegraded":"2024-05-09T00:59:20.088494+0000","last_fullsized":"2024-05-09T00:59:20.088494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:22.424919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074722+0000","last_change":"2024-05-09T00:58:37.365066+0000","last_active":"2024-05-09T00:59:20.074722+0000","last_peered":"2024-05-09T00:59:20.074722+0000","last_clean":"2024-05-09T00:59:20.074722+0000","last_became_active":"2024-05-09T00:58:37.364638+0000","last_became_peered":"2024-05-09T00:58:37.364638+0000","last_unstale":"2024-05-09T00:59:20.074722+0000","last_undegraded":"2024-05-09T00:59:20.074722+0000","last_fullsized":"2024-05-09T00:59:20.074722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:14.706123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075243+0000","last_change":"2024-05-09T00:58:37.366880+0000","last_active":"2024-05-09T00:59:20.075243+0000","last_peered":"2024-05-09T00:59:20.075243+0000","last_clean":"2024-05-09T00:59:20.075243+0000","last_became_active":"2024-05-09T00:58:37.366510+0000","last_became_peered":"2024-05-09T00:58:37.366510+0000","last_unstale":"2024-05-09T00:59:20.075243+0000","last_undegraded":"2024-05-09T00:59:20.075243+0000","last_fullsized":"2024-05-09T00:59:20.075243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:36.968096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348499+0000","last_change":"2024-05-09T00:58:37.363258+0000","last_active":"2024-05-09T00:59:20.348499+0000","last_peered":"2024-05-09T00:59:20.348499+0000","last_clean":"2024-05-09T00:59:20.348499+0000","last_became_active":"2024-05-09T00:58:37.362791+0000","last_became_peered":"2024-05-09T00:58:37.362791+0000","last_unstale":"2024-05-09T00:59:20.348499+0000","last_undegraded":"2024-05-09T00:59:20.348499+0000","last_fullsized":"2024-05-09T00:59:20.348499+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:03.341731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073290+0000","last_change":"2024-05-09T00:58:37.371276+0000","last_active":"2024-05-09T00:59:20.073290+0000","last_peered":"2024-05-09T00:59:20.073290+0000","last_clean":"2024-05-09T00:59:20.073290+0000","last_became_active":"2024-05-09T00:58:37.370881+0000","last_became_peered":"2024-05-09T00:58:37.370881+0000","last_unstale":"2024-05-09T00:59:20.073290+0000","last_undegraded":"2024-05-09T00:59:20.073290+0000","last_fullsized":"2024-05-09T00:59:20.073290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:14.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076417+0000","last_change":"2024-05-09T00:58:37.361394+0000","last_active":"2024-05-09T00:59:20.076417+0000","last_peered":"2024-05-09T00:59:20.076417+0000","last_clean":"2024-05-09T00:59:20.076417+0000","last_became_active":"2024-05-09T00:58:37.360669+0000","last_became_peered":"2024-05-09T00:58:37.360669+0000","last_unstale":"2024-05-09T00:59:20.076417+0000","last_undegraded":"2024-05-09T00:59:20.076417+0000","last_fullsized":"2024-05-09T00:59:20.076417+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.110889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076389+0000","last_change":"2024-05-09T00:58:37.371900+0000","last_active":"2024-05-09T00:59:20.076389+0000","last_peered":"2024-05-09T00:59:20.076389+0000","last_clean":"2024-05-09T00:59:20.076389+0000","last_became_active":"2024-05-09T00:58:37.368608+0000","last_became_peered":"2024-05-09T00:58:37.368608+0000","last_unstale":"2024-05-09T00:59:20.076389+0000","last_undegraded":"2024-05-09T00:59:20.076389+0000","last_fullsized":"2024-05-09T00:59:20.076389+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:17.673058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.087820+0000","last_change":"2024-05-09T00:58:37.372717+0000","last_active":"2024-05-09T00:59:20.087820+0000","last_peered":"2024-05-09T00:59:20.087820+0000","last_clean":"2024-05-09T00:59:20.087820+0000","last_became_active":"2024-05-09T00:58:37.372376+0000","last_became_peered":"2024-05-09T00:58:37.372376+0000","last_unstale":"2024-05-09T00:59:20.087820+0000","last_undegraded":"2024-05-09T00:59:20.087820+0000","last_fullsized":"2024-05-09T00:59:20.087820+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:51.092242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074473+0000","last_change":"2024-05-09T00:58:37.373971+0000","last_active":"2024-05-09T00:59:20.074473+0000","last_peered":"2024-05-09T00:59:20.074473+0000","last_clean":"2024-05-09T00:59:20.074473+0000","last_became_active":"2024-05-09T00:58:37.373620+0000","last_became_peered":"2024-05-09T00:58:37.373620+0000","last_unstale":"2024-05-09T00:59:20.074473+0000","last_undegraded":"2024-05-09T00:59:20.074473+0000","last_fullsized":"2024-05-09T00:59:20.074473+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.070455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078116+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T00:59:20.078116+0000","last_peered":"2024-05-09T00:59:20.078116+0000","last_clean":"2024-05-09T00:59:20.078116+0000","last_became_active":"2024-05-09T00:58:37.367820+0000","last_became_peered":"2024-05-09T00:58:37.367820+0000","last_unstale":"2024-05-09T00:59:20.078116+0000","last_undegraded":"2024-05-09T00:59:20.078116+0000","last_fullsized":"2024-05-09T00:59:20.078116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:45.207654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077518+0000","last_change":"2024-05-09T00:58:37.358736+0000","last_active":"2024-05-09T00:59:20.077518+0000","last_peered":"2024-05-09T00:59:20.077518+0000","last_clean":"2024-05-09T00:59:20.077518+0000","last_became_active":"2024-05-09T00:58:37.358354+0000","last_became_peered":"2024-05-09T00:58:37.358354+0000","last_unstale":"2024-05-09T00:59:20.077518+0000","last_undegraded":"2024-05-09T00:59:20.077518+0000","last_fullsized":"2024-05-09T00:59:20.077518+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:51.084484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078326+0000","last_change":"2024-05-09T00:58:34.333847+0000","last_active":"2024-05-09T00:59:20.078326+0000","last_peered":"2024-05-09T00:59:20.078326+0000","last_clean":"2024-05-09T00:59:20.078326+0000","last_became_active":"2024-05-09T00:58:34.333479+0000","last_became_peered":"2024-05-09T00:58:34.333479+0000","last_unstale":"2024-05-09T00:59:20.078326+0000","last_undegraded":"2024-05-09T00:59:20.078326+0000","last_fullsized":"2024-05-09T00:59:20.078326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:53.709034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077855+0000","last_change":"2024-05-09T00:58:37.367327+0000","last_active":"2024-05-09T00:59:20.077855+0000","last_peered":"2024-05-09T00:59:20.077855+0000","last_clean":"2024-05-09T00:59:20.077855+0000","last_became_active":"2024-05-09T00:58:37.366973+0000","last_became_peered":"2024-05-09T00:58:37.366973+0000","last_unstale":"2024-05-09T00:59:20.077855+0000","last_undegraded":"2024-05-09T00:59:20.077855+0000","last_fullsized":"2024-05-09T00:59:20.077855+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:10.610274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078226+0000","last_change":"2024-05-09T00:58:34.821107+0000","last_active":"2024-05-09T00:59:20.078226+0000","last_peered":"2024-05-09T00:59:20.078226+0000","last_clean":"2024-05-09T00:59:20.078226+0000","last_became_active":"2024-05-09T00:58:34.820737+0000","last_became_peered":"2024-05-09T00:58:34.820737+0000","last_unstale":"2024-05-09T00:59:20.078226+0000","last_undegraded":"2024-05-09T00:59:20.078226+0000","last_fullsized":"2024-05-09T00:59:20.078226+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:45.450781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077076+0000","last_change":"2024-05-09T00:58:37.363559+0000","last_active":"2024-05-09T00:59:20.077076+0000","last_peered":"2024-05-09T00:59:20.077076+0000","last_clean":"2024-05-09T00:59:20.077076+0000","last_became_active":"2024-05-09T00:58:37.358299+0000","last_became_peered":"2024-05-09T00:58:37.358299+0000","last_unstale":"2024-05-09T00:59:20.077076+0000","last_undegraded":"2024-05-09T00:59:20.077076+0000","last_fullsized":"2024-05-09T00:59:20.077076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:15.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075249+0000","last_change":"2024-05-09T00:58:34.333154+0000","last_active":"2024-05-09T00:59:19.075249+0000","last_peered":"2024-05-09T00:59:19.075249+0000","last_clean":"2024-05-09T00:59:19.075249+0000","last_became_active":"2024-05-09T00:58:34.332469+0000","last_became_peered":"2024-05-09T00:58:34.332469+0000","last_unstale":"2024-05-09T00:59:19.075249+0000","last_undegraded":"2024-05-09T00:59:19.075249+0000","last_fullsized":"2024-05-09T00:59:19.075249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:56.343377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.088028+0000","last_change":"2024-05-09T00:58:37.361595+0000","last_active":"2024-05-09T00:59:20.088028+0000","last_peered":"2024-05-09T00:59:20.088028+0000","last_clean":"2024-05-09T00:59:20.088028+0000","last_became_active":"2024-05-09T00:58:37.361239+0000","last_became_peered":"2024-05-09T00:58:37.361239+0000","last_unstale":"2024-05-09T00:59:20.088028+0000","last_undegraded":"2024-05-09T00:59:20.088028+0000","last_fullsized":"2024-05-09T00:59:20.088028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:24.526487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074945+0000","last_change":"2024-05-09T00:58:34.331974+0000","last_active":"2024-05-09T00:59:19.074945+0000","last_peered":"2024-05-09T00:59:19.074945+0000","last_clean":"2024-05-09T00:59:19.074945+0000","last_became_active":"2024-05-09T00:58:34.331460+0000","last_became_peered":"2024-05-09T00:58:34.331460+0000","last_unstale":"2024-05-09T00:59:19.074945+0000","last_undegraded":"2024-05-09T00:59:19.074945+0000","last_fullsized":"2024-05-09T00:59:19.074945+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:17.746247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079767+0000","last_change":"2024-05-09T00:58:37.370155+0000","last_active":"2024-05-09T00:59:20.079767+0000","last_peered":"2024-05-09T00:59:20.079767+0000","last_clean":"2024-05-09T00:59:20.079767+0000","last_became_active":"2024-05-09T00:58:37.369351+0000","last_became_peered":"2024-05-09T00:58:37.369351+0000","last_unstale":"2024-05-09T00:59:20.079767+0000","last_undegraded":"2024-05-09T00:59:20.079767+0000","last_fullsized":"2024-05-09T00:59:20.079767+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:57.494715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:22.049160+0000","last_change":"2024-05-09T00:58:34.332532+0000","last_active":"2024-05-09T00:59:22.049160+0000","last_peered":"2024-05-09T00:59:22.049160+0000","last_clean":"2024-05-09T00:59:22.049160+0000","last_became_active":"2024-05-09T00:58:34.332202+0000","last_became_peered":"2024-05-09T00:58:34.332202+0000","last_unstale":"2024-05-09T00:59:22.049160+0000","last_undegraded":"2024-05-09T00:59:22.049160+0000","last_fullsized":"2024-05-09T00:59:22.049160+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:17.561374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074558+0000","last_change":"2024-05-09T00:58:37.360504+0000","last_active":"2024-05-09T00:59:19.074558+0000","last_peered":"2024-05-09T00:59:19.074558+0000","last_clean":"2024-05-09T00:59:19.074558+0000","last_became_active":"2024-05-09T00:58:37.360078+0000","last_became_peered":"2024-05-09T00:58:37.360078+0000","last_unstale":"2024-05-09T00:59:19.074558+0000","last_undegraded":"2024-05-09T00:59:19.074558+0000","last_fullsized":"2024-05-09T00:59:19.074558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:19.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074437+0000","last_change":"2024-05-09T00:58:34.333762+0000","last_active":"2024-05-09T00:59:20.074437+0000","last_peered":"2024-05-09T00:59:20.074437+0000","last_clean":"2024-05-09T00:59:20.074437+0000","last_became_active":"2024-05-09T00:58:34.333376+0000","last_became_peered":"2024-05-09T00:58:34.333376+0000","last_unstale":"2024-05-09T00:59:20.074437+0000","last_undegraded":"2024-05-09T00:59:20.074437+0000","last_fullsized":"2024-05-09T00:59:20.074437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:58.027982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.081897+0000","last_change":"2024-05-09T00:59:20.081897+0000","last_active":"2024-05-09T00:59:20.081897+0000","last_peered":"2024-05-09T00:59:20.081897+0000","last_clean":"2024-05-09T00:59:20.081897+0000","last_became_active":"2024-05-09T00:59:20.081446+0000","last_became_peered":"2024-05-09T00:59:20.081446+0000","last_unstale":"2024-05-09T00:59:20.081897+0000","last_undegraded":"2024-05-09T00:59:20.081897+0000","last_fullsized":"2024-05-09T00:59:20.081897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:58.471576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072992+0000","last_change":"2024-05-09T00:58:34.332308+0000","last_active":"2024-05-09T00:59:20.072992+0000","last_peered":"2024-05-09T00:59:20.072992+0000","last_clean":"2024-05-09T00:59:20.072992+0000","last_became_active":"2024-05-09T00:58:34.331154+0000","last_became_peered":"2024-05-09T00:58:34.331154+0000","last_unstale":"2024-05-09T00:59:20.072992+0000","last_undegraded":"2024-05-09T00:59:20.072992+0000","last_fullsized":"2024-05-09T00:59:20.072992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.781375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076893+0000","last_change":"2024-05-09T00:58:37.368925+0000","last_active":"2024-05-09T00:59:20.076893+0000","last_peered":"2024-05-09T00:59:20.076893+0000","last_clean":"2024-05-09T00:59:20.076893+0000","last_became_active":"2024-05-09T00:58:37.368586+0000","last_became_peered":"2024-05-09T00:58:37.368586+0000","last_unstale":"2024-05-09T00:59:20.076893+0000","last_undegraded":"2024-05-09T00:59:20.076893+0000","last_fullsized":"2024-05-09T00:59:20.076893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:57.248832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078023+0000","last_change":"2024-05-09T00:58:34.334356+0000","last_active":"2024-05-09T00:59:20.078023+0000","last_peered":"2024-05-09T00:59:20.078023+0000","last_clean":"2024-05-09T00:59:20.078023+0000","last_became_active":"2024-05-09T00:58:34.333993+0000","last_became_peered":"2024-05-09T00:58:34.333993+0000","last_unstale":"2024-05-09T00:59:20.078023+0000","last_undegraded":"2024-05-09T00:59:20.078023+0000","last_fullsized":"2024-05-09T00:59:20.078023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:19.793851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077542+0000","last_change":"2024-05-09T00:58:37.360565+0000","last_active":"2024-05-09T00:59:20.077542+0000","last_peered":"2024-05-09T00:59:20.077542+0000","last_clean":"2024-05-09T00:59:20.077542+0000","last_became_active":"2024-05-09T00:58:37.360215+0000","last_became_peered":"2024-05-09T00:58:37.360215+0000","last_unstale":"2024-05-09T00:59:20.077542+0000","last_undegraded":"2024-05-09T00:59:20.077542+0000","last_fullsized":"2024-05-09T00:59:20.077542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:12.877333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'4","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074529+0000","last_change":"2024-05-09T00:58:34.332654+0000","last_active":"2024-05-09T00:59:20.074529+0000","last_peered":"2024-05-09T00:59:20.074529+0000","last_clean":"2024-05-09T00:59:20.074529+0000","last_became_active":"2024-05-09T00:58:34.331915+0000","last_became_peered":"2024-05-09T00:58:34.331915+0000","last_unstale":"2024-05-09T00:59:20.074529+0000","last_undegraded":"2024-05-09T00:59:20.074529+0000","last_fullsized":"2024-05-09T00:59:20.074529+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:47.521158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.088457+0000","last_change":"2024-05-09T00:58:37.364248+0000","last_active":"2024-05-09T00:59:20.088457+0000","last_peered":"2024-05-09T00:59:20.088457+0000","last_clean":"2024-05-09T00:59:20.088457+0000","last_became_active":"2024-05-09T00:58:37.363872+0000","last_became_peered":"2024-05-09T00:58:37.363872+0000","last_unstale":"2024-05-09T00:59:20.088457+0000","last_undegraded":"2024-05-09T00:59:20.088457+0000","last_fullsized":"2024-05-09T00:59:20.088457+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075486+0000","last_change":"2024-05-09T00:58:34.331157+0000","last_active":"2024-05-09T00:59:20.075486+0000","last_peered":"2024-05-09T00:59:20.075486+0000","last_clean":"2024-05-09T00:59:20.075486+0000","last_became_active":"2024-05-09T00:58:34.330151+0000","last_became_peered":"2024-05-09T00:58:34.330151+0000","last_unstale":"2024-05-09T00:59:20.075486+0000","last_undegraded":"2024-05-09T00:59:20.075486+0000","last_fullsized":"2024-05-09T00:59:20.075486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:07.777304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077146+0000","last_change":"2024-05-09T00:58:37.369357+0000","last_active":"2024-05-09T00:59:20.077146+0000","last_peered":"2024-05-09T00:59:20.077146+0000","last_clean":"2024-05-09T00:59:20.077146+0000","last_became_active":"2024-05-09T00:58:37.368994+0000","last_became_peered":"2024-05-09T00:58:37.368994+0000","last_unstale":"2024-05-09T00:59:20.077146+0000","last_undegraded":"2024-05-09T00:59:20.077146+0000","last_fullsized":"2024-05-09T00:59:20.077146+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079900+0000","last_change":"2024-05-09T00:58:34.822508+0000","last_active":"2024-05-09T00:59:20.079900+0000","last_peered":"2024-05-09T00:59:20.079900+0000","last_clean":"2024-05-09T00:59:20.079900+0000","last_became_active":"2024-05-09T00:58:34.821765+0000","last_became_peered":"2024-05-09T00:58:34.821765+0000","last_unstale":"2024-05-09T00:59:20.079900+0000","last_undegraded":"2024-05-09T00:59:20.079900+0000","last_fullsized":"2024-05-09T00:59:20.079900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:56.931158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.088045+0000","last_change":"2024-05-09T00:58:37.362739+0000","last_active":"2024-05-09T00:59:20.088045+0000","last_peered":"2024-05-09T00:59:20.088045+0000","last_clean":"2024-05-09T00:59:20.088045+0000","last_became_active":"2024-05-09T00:58:37.362395+0000","last_became_peered":"2024-05-09T00:58:37.362395+0000","last_unstale":"2024-05-09T00:59:20.088045+0000","last_undegraded":"2024-05-09T00:59:20.088045+0000","last_fullsized":"2024-05-09T00:59:20.088045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:51.380197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'30","reported_seq":112,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074313+0000","last_change":"2024-05-09T00:58:34.336548+0000","last_active":"2024-05-09T00:59:20.074313+0000","last_peered":"2024-05-09T00:59:20.074313+0000","last_clean":"2024-05-09T00:59:20.074313+0000","last_became_active":"2024-05-09T00:58:34.335792+0000","last_became_peered":"2024-05-09T00:58:34.335792+0000","last_unstale":"2024-05-09T00:59:20.074313+0000","last_undegraded":"2024-05-09T00:59:20.074313+0000","last_fullsized":"2024-05-09T00:59:20.074313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:37.996544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56090,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":56,"num_read_kb":82,"num_write":32,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074919+0000","last_change":"2024-05-09T00:58:37.365468+0000","last_active":"2024-05-09T00:59:19.074919+0000","last_peered":"2024-05-09T00:59:19.074919+0000","last_clean":"2024-05-09T00:59:19.074919+0000","last_became_active":"2024-05-09T00:58:37.365085+0000","last_became_peered":"2024-05-09T00:58:37.365085+0000","last_unstale":"2024-05-09T00:59:19.074919+0000","last_undegraded":"2024-05-09T00:59:19.074919+0000","last_fullsized":"2024-05-09T00:59:19.074919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:06.836757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077180+0000","last_change":"2024-05-09T00:58:34.331174+0000","last_active":"2024-05-09T00:59:20.077180+0000","last_peered":"2024-05-09T00:59:20.077180+0000","last_clean":"2024-05-09T00:59:20.077180+0000","last_became_active":"2024-05-09T00:58:34.330871+0000","last_became_peered":"2024-05-09T00:58:34.330871+0000","last_unstale":"2024-05-09T00:59:20.077180+0000","last_undegraded":"2024-05-09T00:59:20.077180+0000","last_fullsized":"2024-05-09T00:59:20.077180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:21:47.840730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072952+0000","last_change":"2024-05-09T00:58:37.367821+0000","last_active":"2024-05-09T00:59:20.072952+0000","last_peered":"2024-05-09T00:59:20.072952+0000","last_clean":"2024-05-09T00:59:20.072952+0000","last_became_active":"2024-05-09T00:58:37.367495+0000","last_became_peered":"2024-05-09T00:58:37.367495+0000","last_unstale":"2024-05-09T00:59:20.072952+0000","last_undegraded":"2024-05-09T00:59:20.072952+0000","last_fullsized":"2024-05-09T00:59:20.072952+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:08.285301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078474+0000","last_change":"2024-05-09T00:58:34.334381+0000","last_active":"2024-05-09T00:59:20.078474+0000","last_peered":"2024-05-09T00:59:20.078474+0000","last_clean":"2024-05-09T00:59:20.078474+0000","last_became_active":"2024-05-09T00:58:34.333948+0000","last_became_peered":"2024-05-09T00:58:34.333948+0000","last_unstale":"2024-05-09T00:59:20.078474+0000","last_undegraded":"2024-05-09T00:59:20.078474+0000","last_fullsized":"2024-05-09T00:59:20.078474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:05.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079435+0000","last_change":"2024-05-09T00:59:20.079435+0000","last_active":"2024-05-09T00:59:20.079435+0000","last_peered":"2024-05-09T00:59:20.079435+0000","last_clean":"2024-05-09T00:59:20.079435+0000","last_became_active":"2024-05-09T00:59:20.079110+0000","last_became_peered":"2024-05-09T00:59:20.079110+0000","last_unstale":"2024-05-09T00:59:20.079435+0000","last_undegraded":"2024-05-09T00:59:20.079435+0000","last_fullsized":"2024-05-09T00:59:20.079435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:31.449360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'6","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:23.056917+0000","last_change":"2024-05-09T00:58:34.335831+0000","last_active":"2024-05-09T00:59:23.056917+0000","last_peered":"2024-05-09T00:59:23.056917+0000","last_clean":"2024-05-09T00:59:23.056917+0000","last_became_active":"2024-05-09T00:58:34.334950+0000","last_became_peered":"2024-05-09T00:58:34.334950+0000","last_unstale":"2024-05-09T00:59:23.056917+0000","last_undegraded":"2024-05-09T00:59:23.056917+0000","last_fullsized":"2024-05-09T00:59:23.056917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:05.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074983+0000","last_change":"2024-05-09T00:58:37.373115+0000","last_active":"2024-05-09T00:59:20.074983+0000","last_peered":"2024-05-09T00:59:20.074983+0000","last_clean":"2024-05-09T00:59:20.074983+0000","last_became_active":"2024-05-09T00:58:37.369976+0000","last_became_peered":"2024-05-09T00:58:37.369976+0000","last_unstale":"2024-05-09T00:59:20.074983+0000","last_undegraded":"2024-05-09T00:59:20.074983+0000","last_fullsized":"2024-05-09T00:59:20.074983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:40.439954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.096415+0000","last_change":"2024-05-09T00:59:20.095889+0000","last_active":"2024-05-09T00:59:20.096415+0000","last_peered":"2024-05-09T00:59:20.096415+0000","last_clean":"2024-05-09T00:59:20.096415+0000","last_became_active":"2024-05-09T00:59:20.078865+0000","last_became_peered":"2024-05-09T00:59:20.078865+0000","last_unstale":"2024-05-09T00:59:20.096415+0000","last_undegraded":"2024-05-09T00:59:20.096415+0000","last_fullsized":"2024-05-09T00:59:20.096415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.470868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.350420+0000","last_change":"2024-05-09T00:59:20.349963+0000","last_active":"2024-05-09T00:59:20.350420+0000","last_peered":"2024-05-09T00:59:20.350420+0000","last_clean":"2024-05-09T00:59:20.350420+0000","last_became_active":"2024-05-09T00:59:20.349510+0000","last_became_peered":"2024-05-09T00:59:20.349510+0000","last_unstale":"2024-05-09T00:59:20.350420+0000","last_undegraded":"2024-05-09T00:59:20.350420+0000","last_fullsized":"2024-05-09T00:59:20.350420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:33.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075626+0000","last_change":"2024-05-09T00:58:34.331661+0000","last_active":"2024-05-09T00:59:19.075626+0000","last_peered":"2024-05-09T00:59:19.075626+0000","last_clean":"2024-05-09T00:59:19.075626+0000","last_became_active":"2024-05-09T00:58:34.331271+0000","last_became_peered":"2024-05-09T00:58:34.331271+0000","last_unstale":"2024-05-09T00:59:19.075626+0000","last_undegraded":"2024-05-09T00:59:19.075626+0000","last_fullsized":"2024-05-09T00:59:19.075626+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:10.130811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074060+0000","last_change":"2024-05-09T00:58:37.367367+0000","last_active":"2024-05-09T00:59:20.074060+0000","last_peered":"2024-05-09T00:59:20.074060+0000","last_clean":"2024-05-09T00:59:20.074060+0000","last_became_active":"2024-05-09T00:58:37.366927+0000","last_became_peered":"2024-05-09T00:58:37.366927+0000","last_unstale":"2024-05-09T00:59:20.074060+0000","last_undegraded":"2024-05-09T00:59:20.074060+0000","last_fullsized":"2024-05-09T00:59:20.074060+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:31.066913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077749+0000","last_change":"2024-05-09T00:58:34.821956+0000","last_active":"2024-05-09T00:59:20.077749+0000","last_peered":"2024-05-09T00:59:20.077749+0000","last_clean":"2024-05-09T00:59:20.077749+0000","last_became_active":"2024-05-09T00:58:34.821570+0000","last_became_peered":"2024-05-09T00:58:34.821570+0000","last_unstale":"2024-05-09T00:59:20.077749+0000","last_undegraded":"2024-05-09T00:59:20.077749+0000","last_fullsized":"2024-05-09T00:59:20.077749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:45.027927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074275+0000","last_change":"2024-05-09T00:58:37.361646+0000","last_active":"2024-05-09T00:59:20.074275+0000","last_peered":"2024-05-09T00:59:20.074275+0000","last_clean":"2024-05-09T00:59:20.074275+0000","last_became_active":"2024-05-09T00:58:37.360216+0000","last_became_peered":"2024-05-09T00:58:37.360216+0000","last_unstale":"2024-05-09T00:59:20.074275+0000","last_undegraded":"2024-05-09T00:59:20.074275+0000","last_fullsized":"2024-05-09T00:59:20.074275+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:13.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'5","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:23.049738+0000","last_change":"2024-05-09T00:58:34.330657+0000","last_active":"2024-05-09T00:59:23.049738+0000","last_peered":"2024-05-09T00:59:23.049738+0000","last_clean":"2024-05-09T00:59:23.049738+0000","last_became_active":"2024-05-09T00:58:34.330235+0000","last_became_peered":"2024-05-09T00:58:34.330235+0000","last_unstale":"2024-05-09T00:59:23.049738+0000","last_undegraded":"2024-05-09T00:59:23.049738+0000","last_fullsized":"2024-05-09T00:59:23.049738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:21.647916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074324+0000","last_change":"2024-05-09T00:58:37.361155+0000","last_active":"2024-05-09T00:59:20.074324+0000","last_peered":"2024-05-09T00:59:20.074324+0000","last_clean":"2024-05-09T00:59:20.074324+0000","last_became_active":"2024-05-09T00:58:37.360653+0000","last_became_peered":"2024-05-09T00:58:37.360653+0000","last_unstale":"2024-05-09T00:59:20.074324+0000","last_undegraded":"2024-05-09T00:59:20.074324+0000","last_fullsized":"2024-05-09T00:59:20.074324+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:49.473522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078319+0000","last_change":"2024-05-09T00:58:37.367592+0000","last_active":"2024-05-09T00:59:20.078319+0000","last_peered":"2024-05-09T00:59:20.078319+0000","last_clean":"2024-05-09T00:59:20.078319+0000","last_became_active":"2024-05-09T00:58:37.366365+0000","last_became_peered":"2024-05-09T00:58:37.366365+0000","last_unstale":"2024-05-09T00:59:20.078319+0000","last_undegraded":"2024-05-09T00:59:20.078319+0000","last_fullsized":"2024-05-09T00:59:20.078319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:37.279269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'5","reported_seq":56,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072844+0000","last_change":"2024-05-09T00:58:34.821092+0000","last_active":"2024-05-09T00:59:20.072844+0000","last_peered":"2024-05-09T00:59:20.072844+0000","last_clean":"2024-05-09T00:59:20.072844+0000","last_became_active":"2024-05-09T00:58:34.820713+0000","last_became_peered":"2024-05-09T00:58:34.820713+0000","last_unstale":"2024-05-09T00:59:20.072844+0000","last_undegraded":"2024-05-09T00:59:20.072844+0000","last_fullsized":"2024-05-09T00:59:20.072844+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:11.372613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077610+0000","last_change":"2024-05-09T00:58:37.364624+0000","last_active":"2024-05-09T00:59:20.077610+0000","last_peered":"2024-05-09T00:59:20.077610+0000","last_clean":"2024-05-09T00:59:20.077610+0000","last_became_active":"2024-05-09T00:58:37.364013+0000","last_became_peered":"2024-05-09T00:58:37.364013+0000","last_unstale":"2024-05-09T00:59:20.077610+0000","last_undegraded":"2024-05-09T00:59:20.077610+0000","last_fullsized":"2024-05-09T00:59:20.077610+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:14.205958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.349071+0000","last_change":"2024-05-09T00:58:34.335364+0000","last_active":"2024-05-09T00:59:20.349071+0000","last_peered":"2024-05-09T00:59:20.349071+0000","last_clean":"2024-05-09T00:59:20.349071+0000","last_became_active":"2024-05-09T00:58:34.334965+0000","last_became_peered":"2024-05-09T00:58:34.334965+0000","last_unstale":"2024-05-09T00:59:20.349071+0000","last_undegraded":"2024-05-09T00:59:20.349071+0000","last_fullsized":"2024-05-09T00:59:20.349071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:50.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075153+0000","last_change":"2024-05-09T00:57:07.637377+0000","last_active":"2024-05-09T00:59:20.075153+0000","last_peered":"2024-05-09T00:59:20.075153+0000","last_clean":"2024-05-09T00:59:20.075153+0000","last_became_active":"2024-05-09T00:57:07.631727+0000","last_became_peered":"2024-05-09T00:57:07.631727+0000","last_unstale":"2024-05-09T00:59:20.075153+0000","last_undegraded":"2024-05-09T00:59:20.075153+0000","last_fullsized":"2024-05-09T00:59:20.075153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_clean_scrub_stamp":"2024-05-09T00:53:47.457762+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:09.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.081462+0000","last_change":"2024-05-09T00:59:20.081462+0000","last_active":"2024-05-09T00:59:20.081462+0000","last_peered":"2024-05-09T00:59:20.081462+0000","last_clean":"2024-05-09T00:59:20.081462+0000","last_became_active":"2024-05-09T00:59:20.080955+0000","last_became_peered":"2024-05-09T00:59:20.080955+0000","last_unstale":"2024-05-09T00:59:20.081462+0000","last_undegraded":"2024-05-09T00:59:20.081462+0000","last_fullsized":"2024-05-09T00:59:20.081462+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:11.106912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075354+0000","last_change":"2024-05-09T00:58:34.329694+0000","last_active":"2024-05-09T00:59:20.075354+0000","last_peered":"2024-05-09T00:59:20.075354+0000","last_clean":"2024-05-09T00:59:20.075354+0000","last_became_active":"2024-05-09T00:58:34.329267+0000","last_became_peered":"2024-05-09T00:58:34.329267+0000","last_unstale":"2024-05-09T00:59:20.075354+0000","last_undegraded":"2024-05-09T00:59:20.075354+0000","last_fullsized":"2024-05-09T00:59:20.075354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:28.060489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.075040+0000","last_change":"2024-05-09T00:58:34.822706+0000","last_active":"2024-05-09T00:59:19.075040+0000","last_peered":"2024-05-09T00:59:19.075040+0000","last_clean":"2024-05-09T00:59:19.075040+0000","last_became_active":"2024-05-09T00:58:34.822223+0000","last_became_peered":"2024-05-09T00:58:34.822223+0000","last_unstale":"2024-05-09T00:59:19.075040+0000","last_undegraded":"2024-05-09T00:59:19.075040+0000","last_fullsized":"2024-05-09T00:59:19.075040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:47.378798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073442+0000","last_change":"2024-05-09T00:58:37.360600+0000","last_active":"2024-05-09T00:59:20.073442+0000","last_peered":"2024-05-09T00:59:20.073442+0000","last_clean":"2024-05-09T00:59:20.073442+0000","last_became_active":"2024-05-09T00:58:37.360265+0000","last_became_peered":"2024-05-09T00:58:37.360265+0000","last_unstale":"2024-05-09T00:59:20.073442+0000","last_undegraded":"2024-05-09T00:59:20.073442+0000","last_fullsized":"2024-05-09T00:59:20.073442+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:44.423709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'15","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078026+0000","last_change":"2024-05-09T00:58:34.331544+0000","last_active":"2024-05-09T00:59:20.078026+0000","last_peered":"2024-05-09T00:59:20.078026+0000","last_clean":"2024-05-09T00:59:20.078026+0000","last_became_active":"2024-05-09T00:58:34.331147+0000","last_became_peered":"2024-05-09T00:58:34.331147+0000","last_unstale":"2024-05-09T00:59:20.078026+0000","last_undegraded":"2024-05-09T00:59:20.078026+0000","last_fullsized":"2024-05-09T00:59:20.078026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:27.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078472+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T00:59:20.078472+0000","last_peered":"2024-05-09T00:59:20.078472+0000","last_clean":"2024-05-09T00:59:20.078472+0000","last_became_active":"2024-05-09T00:58:37.367875+0000","last_became_peered":"2024-05-09T00:58:37.367875+0000","last_unstale":"2024-05-09T00:59:20.078472+0000","last_undegraded":"2024-05-09T00:59:20.078472+0000","last_fullsized":"2024-05-09T00:59:20.078472+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:45.800008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348673+0000","last_change":"2024-05-09T00:58:34.956500+0000","last_active":"2024-05-09T00:59:20.348673+0000","last_peered":"2024-05-09T00:59:20.348673+0000","last_clean":"2024-05-09T00:59:20.348673+0000","last_became_active":"2024-05-09T00:58:34.956108+0000","last_became_peered":"2024-05-09T00:58:34.956108+0000","last_unstale":"2024-05-09T00:59:20.348673+0000","last_undegraded":"2024-05-09T00:59:20.348673+0000","last_fullsized":"2024-05-09T00:59:20.348673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:03.283325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077126+0000","last_change":"2024-05-09T00:58:37.369174+0000","last_active":"2024-05-09T00:59:20.077126+0000","last_peered":"2024-05-09T00:59:20.077126+0000","last_clean":"2024-05-09T00:59:20.077126+0000","last_became_active":"2024-05-09T00:58:37.368650+0000","last_became_peered":"2024-05-09T00:58:37.368650+0000","last_unstale":"2024-05-09T00:59:20.077126+0000","last_undegraded":"2024-05-09T00:59:20.077126+0000","last_fullsized":"2024-05-09T00:59:20.077126+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:07.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.087845+0000","last_change":"2024-05-09T00:58:34.821742+0000","last_active":"2024-05-09T00:59:20.087845+0000","last_peered":"2024-05-09T00:59:20.087845+0000","last_clean":"2024-05-09T00:59:20.087845+0000","last_became_active":"2024-05-09T00:58:34.821290+0000","last_became_peered":"2024-05-09T00:58:34.821290+0000","last_unstale":"2024-05-09T00:59:20.087845+0000","last_undegraded":"2024-05-09T00:59:20.087845+0000","last_fullsized":"2024-05-09T00:59:20.087845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:18.735763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074462+0000","last_change":"2024-05-09T00:58:37.361727+0000","last_active":"2024-05-09T00:59:19.074462+0000","last_peered":"2024-05-09T00:59:19.074462+0000","last_clean":"2024-05-09T00:59:19.074462+0000","last_became_active":"2024-05-09T00:58:37.361351+0000","last_became_peered":"2024-05-09T00:58:37.361351+0000","last_unstale":"2024-05-09T00:59:19.074462+0000","last_undegraded":"2024-05-09T00:59:19.074462+0000","last_fullsized":"2024-05-09T00:59:19.074462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:14.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077882+0000","last_change":"2024-05-09T00:58:34.330578+0000","last_active":"2024-05-09T00:59:20.077882+0000","last_peered":"2024-05-09T00:59:20.077882+0000","last_clean":"2024-05-09T00:59:20.077882+0000","last_became_active":"2024-05-09T00:58:34.330273+0000","last_became_peered":"2024-05-09T00:58:34.330273+0000","last_unstale":"2024-05-09T00:59:20.077882+0000","last_undegraded":"2024-05-09T00:59:20.077882+0000","last_fullsized":"2024-05-09T00:59:20.077882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:45.795771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073978+0000","last_change":"2024-05-09T00:58:37.371323+0000","last_active":"2024-05-09T00:59:20.073978+0000","last_peered":"2024-05-09T00:59:20.073978+0000","last_clean":"2024-05-09T00:59:20.073978+0000","last_became_active":"2024-05-09T00:58:37.370942+0000","last_became_peered":"2024-05-09T00:58:37.370942+0000","last_unstale":"2024-05-09T00:59:20.073978+0000","last_undegraded":"2024-05-09T00:59:20.073978+0000","last_fullsized":"2024-05-09T00:59:20.073978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:57.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.100103+0000","last_change":"2024-05-09T00:59:20.099633+0000","last_active":"2024-05-09T00:59:20.100103+0000","last_peered":"2024-05-09T00:59:20.100103+0000","last_clean":"2024-05-09T00:59:20.100103+0000","last_became_active":"2024-05-09T00:59:20.080964+0000","last_became_peered":"2024-05-09T00:59:20.080964+0000","last_unstale":"2024-05-09T00:59:20.100103+0000","last_undegraded":"2024-05-09T00:59:20.100103+0000","last_fullsized":"2024-05-09T00:59:20.100103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:53.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078200+0000","last_change":"2024-05-09T00:58:37.361319+0000","last_active":"2024-05-09T00:59:20.078200+0000","last_peered":"2024-05-09T00:59:20.078200+0000","last_clean":"2024-05-09T00:59:20.078200+0000","last_became_active":"2024-05-09T00:58:37.360703+0000","last_became_peered":"2024-05-09T00:58:37.360703+0000","last_unstale":"2024-05-09T00:59:20.078200+0000","last_undegraded":"2024-05-09T00:59:20.078200+0000","last_fullsized":"2024-05-09T00:59:20.078200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:24.202453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-09T00:59:19.074886+0000","last_change":"2024-05-09T00:58:34.333394+0000","last_active":"2024-05-09T00:59:19.074886+0000","last_peered":"2024-05-09T00:59:19.074886+0000","last_clean":"2024-05-09T00:59:19.074886+0000","last_became_active":"2024-05-09T00:58:34.332902+0000","last_became_peered":"2024-05-09T00:58:34.332902+0000","last_unstale":"2024-05-09T00:59:19.074886+0000","last_undegraded":"2024-05-09T00:59:19.074886+0000","last_fullsized":"2024-05-09T00:59:19.074886+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:38.301831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075594+0000","last_change":"2024-05-09T00:58:37.366963+0000","last_active":"2024-05-09T00:59:20.075594+0000","last_peered":"2024-05-09T00:59:20.075594+0000","last_clean":"2024-05-09T00:59:20.075594+0000","last_became_active":"2024-05-09T00:58:37.366591+0000","last_became_peered":"2024-05-09T00:58:37.366591+0000","last_unstale":"2024-05-09T00:59:20.075594+0000","last_undegraded":"2024-05-09T00:59:20.075594+0000","last_fullsized":"2024-05-09T00:59:20.075594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:44.894281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'6","reported_seq":60,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079667+0000","last_change":"2024-05-09T00:58:34.956368+0000","last_active":"2024-05-09T00:59:20.079667+0000","last_peered":"2024-05-09T00:59:20.079667+0000","last_clean":"2024-05-09T00:59:20.079667+0000","last_became_active":"2024-05-09T00:58:34.955888+0000","last_became_peered":"2024-05-09T00:58:34.955888+0000","last_unstale":"2024-05-09T00:59:20.079667+0000","last_undegraded":"2024-05-09T00:59:20.079667+0000","last_fullsized":"2024-05-09T00:59:20.079667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:15.884435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075442+0000","last_change":"2024-05-09T00:58:37.368150+0000","last_active":"2024-05-09T00:59:20.075442+0000","last_peered":"2024-05-09T00:59:20.075442+0000","last_clean":"2024-05-09T00:59:20.075442+0000","last_became_active":"2024-05-09T00:58:37.367800+0000","last_became_peered":"2024-05-09T00:58:37.367800+0000","last_unstale":"2024-05-09T00:59:20.075442+0000","last_undegraded":"2024-05-09T00:59:20.075442+0000","last_fullsized":"2024-05-09T00:59:20.075442+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:20.791816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079953+0000","last_change":"2024-05-09T00:58:34.329311+0000","last_active":"2024-05-09T00:59:20.079953+0000","last_peered":"2024-05-09T00:59:20.079953+0000","last_clean":"2024-05-09T00:59:20.079953+0000","last_became_active":"2024-05-09T00:58:34.328841+0000","last_became_peered":"2024-05-09T00:58:34.328841+0000","last_unstale":"2024-05-09T00:59:20.079953+0000","last_undegraded":"2024-05-09T00:59:20.079953+0000","last_fullsized":"2024-05-09T00:59:20.079953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075257+0000","last_change":"2024-05-09T00:58:37.369498+0000","last_active":"2024-05-09T00:59:20.075257+0000","last_peered":"2024-05-09T00:59:20.075257+0000","last_clean":"2024-05-09T00:59:20.075257+0000","last_became_active":"2024-05-09T00:58:37.369166+0000","last_became_peered":"2024-05-09T00:58:37.369166+0000","last_unstale":"2024-05-09T00:59:20.075257+0000","last_undegraded":"2024-05-09T00:59:20.075257+0000","last_fullsized":"2024-05-09T00:59:20.075257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:56.411666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073056+0000","last_change":"2024-05-09T00:58:34.328756+0000","last_active":"2024-05-09T00:59:20.073056+0000","last_peered":"2024-05-09T00:59:20.073056+0000","last_clean":"2024-05-09T00:59:20.073056+0000","last_became_active":"2024-05-09T00:58:34.328381+0000","last_became_peered":"2024-05-09T00:58:34.328381+0000","last_unstale":"2024-05-09T00:59:20.073056+0000","last_undegraded":"2024-05-09T00:59:20.073056+0000","last_fullsized":"2024-05-09T00:59:20.073056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:26.558360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075797+0000","last_change":"2024-05-09T00:58:37.369557+0000","last_active":"2024-05-09T00:59:20.075797+0000","last_peered":"2024-05-09T00:59:20.075797+0000","last_clean":"2024-05-09T00:59:20.075797+0000","last_became_active":"2024-05-09T00:58:37.369225+0000","last_became_peered":"2024-05-09T00:58:37.369225+0000","last_unstale":"2024-05-09T00:59:20.075797+0000","last_undegraded":"2024-05-09T00:59:20.075797+0000","last_fullsized":"2024-05-09T00:59:20.075797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:21.761421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074202+0000","last_change":"2024-05-09T00:58:37.369919+0000","last_active":"2024-05-09T00:59:20.074202+0000","last_peered":"2024-05-09T00:59:20.074202+0000","last_clean":"2024-05-09T00:59:20.074202+0000","last_became_active":"2024-05-09T00:58:37.369507+0000","last_became_peered":"2024-05-09T00:58:37.369507+0000","last_unstale":"2024-05-09T00:59:20.074202+0000","last_undegraded":"2024-05-09T00:59:20.074202+0000","last_fullsized":"2024-05-09T00:59:20.074202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.294074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078525+0000","last_change":"2024-05-09T00:58:37.363775+0000","last_active":"2024-05-09T00:59:20.078525+0000","last_peered":"2024-05-09T00:59:20.078525+0000","last_clean":"2024-05-09T00:59:20.078525+0000","last_became_active":"2024-05-09T00:58:37.363394+0000","last_became_peered":"2024-05-09T00:58:37.363394+0000","last_unstale":"2024-05-09T00:59:20.078525+0000","last_undegraded":"2024-05-09T00:59:20.078525+0000","last_fullsized":"2024-05-09T00:59:20.078525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.156009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076743+0000","last_change":"2024-05-09T00:58:37.357699+0000","last_active":"2024-05-09T00:59:20.076743+0000","last_peered":"2024-05-09T00:59:20.076743+0000","last_clean":"2024-05-09T00:59:20.076743+0000","last_became_active":"2024-05-09T00:58:37.357356+0000","last_became_peered":"2024-05-09T00:58:37.357356+0000","last_unstale":"2024-05-09T00:59:20.076743+0000","last_undegraded":"2024-05-09T00:59:20.076743+0000","last_fullsized":"2024-05-09T00:59:20.076743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:14.861644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076533+0000","last_change":"2024-05-09T00:58:37.369419+0000","last_active":"2024-05-09T00:59:20.076533+0000","last_peered":"2024-05-09T00:59:20.076533+0000","last_clean":"2024-05-09T00:59:20.076533+0000","last_became_active":"2024-05-09T00:58:37.363949+0000","last_became_peered":"2024-05-09T00:58:37.363949+0000","last_unstale":"2024-05-09T00:59:20.076533+0000","last_undegraded":"2024-05-09T00:59:20.076533+0000","last_fullsized":"2024-05-09T00:59:20.076533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:04.081713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073514+0000","last_change":"2024-05-09T00:58:37.373651+0000","last_active":"2024-05-09T00:59:20.073514+0000","last_peered":"2024-05-09T00:59:20.073514+0000","last_clean":"2024-05-09T00:59:20.073514+0000","last_became_active":"2024-05-09T00:58:37.373257+0000","last_became_peered":"2024-05-09T00:58:37.373257+0000","last_unstale":"2024-05-09T00:59:20.073514+0000","last_undegraded":"2024-05-09T00:59:20.073514+0000","last_fullsized":"2024-05-09T00:59:20.073514+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:27.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074200+0000","last_change":"2024-05-09T00:58:37.367666+0000","last_active":"2024-05-09T00:59:20.074200+0000","last_peered":"2024-05-09T00:59:20.074200+0000","last_clean":"2024-05-09T00:59:20.074200+0000","last_became_active":"2024-05-09T00:58:37.366869+0000","last_became_peered":"2024-05-09T00:58:37.366869+0000","last_unstale":"2024-05-09T00:59:20.074200+0000","last_undegraded":"2024-05-09T00:59:20.074200+0000","last_fullsized":"2024-05-09T00:59:20.074200+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:07.952594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078990+0000","last_change":"2024-05-09T00:58:37.362205+0000","last_active":"2024-05-09T00:59:20.078990+0000","last_peered":"2024-05-09T00:59:20.078990+0000","last_clean":"2024-05-09T00:59:20.078990+0000","last_became_active":"2024-05-09T00:58:37.361704+0000","last_became_peered":"2024-05-09T00:58:37.361704+0000","last_unstale":"2024-05-09T00:59:20.078990+0000","last_undegraded":"2024-05-09T00:59:20.078990+0000","last_fullsized":"2024-05-09T00:59:20.078990+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:34.334593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078234+0000","last_change":"2024-05-09T00:58:37.367143+0000","last_active":"2024-05-09T00:59:20.078234+0000","last_peered":"2024-05-09T00:59:20.078234+0000","last_clean":"2024-05-09T00:59:20.078234+0000","last_became_active":"2024-05-09T00:58:37.364364+0000","last_became_peered":"2024-05-09T00:58:37.364364+0000","last_unstale":"2024-05-09T00:59:20.078234+0000","last_undegraded":"2024-05-09T00:59:20.078234+0000","last_fullsized":"2024-05-09T00:59:20.078234+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:55.154458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078043+0000","last_change":"2024-05-09T00:58:37.365757+0000","last_active":"2024-05-09T00:59:20.078043+0000","last_peered":"2024-05-09T00:59:20.078043+0000","last_clean":"2024-05-09T00:59:20.078043+0000","last_became_active":"2024-05-09T00:58:37.365408+0000","last_became_peered":"2024-05-09T00:58:37.365408+0000","last_unstale":"2024-05-09T00:59:20.078043+0000","last_undegraded":"2024-05-09T00:59:20.078043+0000","last_fullsized":"2024-05-09T00:59:20.078043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077798+0000","last_change":"2024-05-09T00:58:37.366954+0000","last_active":"2024-05-09T00:59:20.077798+0000","last_peered":"2024-05-09T00:59:20.077798+0000","last_clean":"2024-05-09T00:59:20.077798+0000","last_became_active":"2024-05-09T00:58:37.364361+0000","last_became_peered":"2024-05-09T00:58:37.364361+0000","last_unstale":"2024-05-09T00:59:20.077798+0000","last_undegraded":"2024-05-09T00:59:20.077798+0000","last_fullsized":"2024-05-09T00:59:20.077798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:31.248873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.088114+0000","last_change":"2024-05-09T00:58:37.368467+0000","last_active":"2024-05-09T00:59:20.088114+0000","last_peered":"2024-05-09T00:59:20.088114+0000","last_clean":"2024-05-09T00:59:20.088114+0000","last_became_active":"2024-05-09T00:58:37.368104+0000","last_became_peered":"2024-05-09T00:58:37.368104+0000","last_unstale":"2024-05-09T00:59:20.088114+0000","last_undegraded":"2024-05-09T00:59:20.088114+0000","last_fullsized":"2024-05-09T00:59:20.088114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073225+0000","last_change":"2024-05-09T00:58:37.366897+0000","last_active":"2024-05-09T00:59:20.073225+0000","last_peered":"2024-05-09T00:59:20.073225+0000","last_clean":"2024-05-09T00:59:20.073225+0000","last_became_active":"2024-05-09T00:58:37.366555+0000","last_became_peered":"2024-05-09T00:58:37.366555+0000","last_unstale":"2024-05-09T00:59:20.073225+0000","last_undegraded":"2024-05-09T00:59:20.073225+0000","last_fullsized":"2024-05-09T00:59:20.073225+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.394191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074030+0000","last_change":"2024-05-09T00:58:37.358875+0000","last_active":"2024-05-09T00:59:20.074030+0000","last_peered":"2024-05-09T00:59:20.074030+0000","last_clean":"2024-05-09T00:59:20.074030+0000","last_became_active":"2024-05-09T00:58:37.358505+0000","last_became_peered":"2024-05-09T00:58:37.358505+0000","last_unstale":"2024-05-09T00:59:20.074030+0000","last_undegraded":"2024-05-09T00:59:20.074030+0000","last_fullsized":"2024-05-09T00:59:20.074030+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:15.268147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63294,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":292,"num_read_kb":210,"num_write":244,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":189994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678042,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":431465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874269,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28536,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716616,"statfs":{"total":95995035648,"available":95965814784,"internally_reserved":0,"allocated":1556480,"data_stored":1061552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037795,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":430892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234024,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":892928,"data_stored":422877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1503232,"data_stored":1023788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":880640,"data_stored":422216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":487612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":913408,"data_stored":432339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":488223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":909312,"data_stored":430434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36216,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708936,"statfs":{"total":95995035648,"available":95957950464,"internally_reserved":0,"allocated":892928,"data_stored":430861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1023075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:59:25.777 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T00:59:25.778 INFO:tasks.cephadm:Setting up client nodes... 2024-05-09T00:59:25.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T00:59:26.035 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:26 smithi136 ceph-mon[34110]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:26 smithi136 ceph-mon[34110]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:59:26.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:26 smithi037 ceph-mon[30122]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:26.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:26 smithi037 ceph-mon[30122]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:59:26.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:26 smithi151 ceph-mon[34780]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 8 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:26 smithi151 ceph-mon[34780]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:59:27.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 -- 172.21.15.37:0/2276015550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0104360 msgr2=0x7f16f0104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 --2- 172.21.15.37:0/2276015550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0104360 0x7f16f0104770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009990 tx=0x7f16e0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 -- 172.21.15.37:0/2276015550 shutdown_connections 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 --2- 172.21.15.37:0/2276015550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16f0105e30 0x7f16f010c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 --2- 172.21.15.37:0/2276015550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0104360 0x7f16f0104770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 --2- 172.21.15.37:0/2276015550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16f0105490 0x7f16f01058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 -- 172.21.15.37:0/2276015550 >> 172.21.15.37:0/2276015550 conn(0x7f16f00ff9c0 msgr2=0x7f16f0101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 -- 172.21.15.37:0/2276015550 shutdown_connections 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.599+0000 7f16f683c700 1 -- 172.21.15.37:0/2276015550 wait complete. 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 Processor -- start 2024-05-09T00:59:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 -- start start 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16f0104360 0x7f16f019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0105490 0x7f16f019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16f0105e30 0x7f16f01a4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16f010fe20 con 0x7f16f0105490 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f16f010fca0 con 0x7f16f0104360 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f683c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f16f010ffa0 con 0x7f16f0105e30 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16ef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0105490 0x7f16f019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16ef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0105490 0x7f16f019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46778/0 (socket says 172.21.15.37:46778) 2024-05-09T00:59:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16ef7fe700 1 -- 172.21.15.37:0/3531699916 learned_addr learned my addr 172.21.15.37:0/3531699916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16f4dd9700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16f0105e30 0x7f16f01a4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.600+0000 7f16effff700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16f0104360 0x7f16f019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ef7fe700 1 -- 172.21.15.37:0/3531699916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16f0105e30 msgr2=0x7f16f01a4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ef7fe700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16f0105e30 0x7f16f01a4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ef7fe700 1 -- 172.21.15.37:0/3531699916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16f0104360 msgr2=0x7f16f019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ef7fe700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16f0104360 0x7f16f019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ef7fe700 1 -- 172.21.15.37:0/3531699916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f01a4670 con 0x7f16f0105490 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ef7fe700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0105490 0x7f16f019d0e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f16e400b530 tx=0x7f16e400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ed7fa700 1 -- 172.21.15.37:0/3531699916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4015020 con 0x7f16f0105490 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ed7fa700 1 -- 172.21.15.37:0/3531699916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e4011ce0 con 0x7f16f0105490 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f01a4960 con 0x7f16f0105490 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16ed7fa700 1 -- 172.21.15.37:0/3531699916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4010e40 con 0x7f16f0105490 2024-05-09T00:59:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.601+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f01a4f20 con 0x7f16f0105490 2024-05-09T00:59:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.603+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f00512c0 con 0x7f16f0105490 2024-05-09T00:59:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.604+0000 7f16ed7fa700 1 -- 172.21.15.37:0/3531699916 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f16e4018020 con 0x7f16f0105490 2024-05-09T00:59:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.605+0000 7f16ed7fa700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f16d80b2910 0x7f16d80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.605+0000 7f16effff700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f16d80b2910 0x7f16d80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.605+0000 7f16ed7fa700 1 -- 172.21.15.37:0/3531699916 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f16e40e1ac0 con 0x7f16f0105490 2024-05-09T00:59:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.606+0000 7f16effff700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f16d80b2910 0x7f16d80b4e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16e00038a0 tx=0x7f16e001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.610+0000 7f16ed7fa700 1 -- 172.21.15.37:0/3531699916 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f16e401f020 con 0x7f16f0105490 2024-05-09T00:59:27.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.915+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f16f01a5290 con 0x7f16f0105490 2024-05-09T00:59:27.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.918+0000 7f16ed7fa700 1 -- 172.21.15.37:0/3531699916 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f16e40a9790 con 0x7f16f0105490 2024-05-09T00:59:27.919 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-09T00:59:27.919 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDvHzxm3PuuNhAAKDaNTQPAWKWmwZ7y854/yA== 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f16d80b2910 msgr2=0x7f16d80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f16d80b2910 0x7f16d80b4e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16e00038a0 tx=0x7f16e001a040 comp rx=0 tx=0).stop 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0105490 msgr2=0x7f16f019d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0105490 0x7f16f019d0e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f16e400b530 tx=0x7f16e400b840 comp rx=0 tx=0).stop 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 shutdown_connections 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f16d80b2910 0x7f16d80b4e20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16f0105e30 0x7f16f01a4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16f0104360 0x7f16f019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 --2- 172.21.15.37:0/3531699916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16f0105490 0x7f16f019d0e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 >> 172.21.15.37:0/3531699916 conn(0x7f16f00ff9c0 msgr2=0x7f16f00759f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 shutdown_connections 2024-05-09T00:59:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:27.922+0000 7f16f683c700 1 -- 172.21.15.37:0/3531699916 wait complete. 2024-05-09T00:59:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:28 smithi037 ceph-mon[30122]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:28 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3531699916' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:59:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:28 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3531699916' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:59:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:28 smithi136 ceph-mon[34110]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:28 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3531699916' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:59:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:28 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3531699916' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:59:28.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:28 smithi151 ceph-mon[34780]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s; 13 B/s, 1 objects/s recovering 2024-05-09T00:59:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:28 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3531699916' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:59:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:28 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3531699916' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:59:28.569 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T00:59:28.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-09T00:59:28.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T00:59:28.609 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T00:59:28.609 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-09T00:59:28.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-09T00:59:28.912 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:29.287 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:29 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:59:29.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:29 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:59:29.472 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:29 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:59:30.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:30 smithi037 ceph-mon[30122]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 11 B/s, 1 objects/s recovering 2024-05-09T00:59:30.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:30 smithi136 ceph-mon[34110]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 11 B/s, 1 objects/s recovering 2024-05-09T00:59:30.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:30 smithi151 ceph-mon[34780]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 KiB/s wr, 11 op/s; 11 B/s, 1 objects/s recovering 2024-05-09T00:59:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.549+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/893889980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 msgr2=0x7ff4e8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.549+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/893889980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e8104a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80099c0 tx=0x7ff4d8009cd0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.549+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/893889980 shutdown_connections 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.549+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/893889980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4e8109870 0x7ff4e81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.549+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/893889980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e8104a00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.549+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/893889980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8108f20 0x7ff4e8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.549+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/893889980 >> 172.21.15.37:0/893889980 conn(0x7ff4e80fffe0 msgr2=0x7ff4e8102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.550+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/893889980 shutdown_connections 2024-05-09T00:59:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.550+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/893889980 wait complete. 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.550+0000 7ff4ee8ac700 1 Processor -- start 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.550+0000 7ff4ee8ac700 1 -- start start 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4ee8ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e819ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4ee8ac700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8108f20 0x7ff4e819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4ee8ac700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4e8109870 0x7ff4e819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4ee8ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81144a0 con 0x7ff4e81045f0 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4ee8ac700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8114320 con 0x7ff4e8109870 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4ee8ac700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8114620 con 0x7ff4e8108f20 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e819ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e819ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46790/0 (socket says 172.21.15.37:46790) 2024-05-09T00:59:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 -- 172.21.15.37:0/1642410493 learned_addr learned my addr 172.21.15.37:0/1642410493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4dffff700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8108f20 0x7ff4e819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4ece49700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4e8109870 0x7ff4e819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 -- 172.21.15.37:0/1642410493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8108f20 msgr2=0x7ff4e819b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8108f20 0x7ff4e819b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 -- 172.21.15.37:0/1642410493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4e8109870 msgr2=0x7ff4e819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4e8109870 0x7ff4e819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 -- 172.21.15.37:0/1642410493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e819fcf0 con 0x7ff4e81045f0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.551+0000 7ff4e7fff700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e819ae70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8006010 tx=0x7ff4d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.552+0000 7ff4e5ffb700 1 -- 172.21.15.37:0/1642410493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8026070 con 0x7ff4e81045f0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.552+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e819ff80 con 0x7ff4e81045f0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.552+0000 7ff4e5ffb700 1 -- 172.21.15.37:0/1642410493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d8004630 con 0x7ff4e81045f0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.552+0000 7ff4e5ffb700 1 -- 172.21.15.37:0/1642410493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d800fb20 con 0x7ff4e81045f0 2024-05-09T00:59:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.552+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e81a7900 con 0x7ff4e81045f0 2024-05-09T00:59:30.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.553+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e8105aa0 con 0x7ff4e81045f0 2024-05-09T00:59:30.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.554+0000 7ff4e5ffb700 1 -- 172.21.15.37:0/1642410493 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff4d8029070 con 0x7ff4e81045f0 2024-05-09T00:59:30.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.555+0000 7ff4e5ffb700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4d40b2990 0x7ff4d40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:30.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.555+0000 7ff4dffff700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4d40b2990 0x7ff4d40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:30.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.555+0000 7ff4e5ffb700 1 -- 172.21.15.37:0/1642410493 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff4d80e2920 con 0x7ff4e81045f0 2024-05-09T00:59:30.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.556+0000 7ff4dffff700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4d40b2990 0x7ff4d40b4ea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8103510 tx=0x7ff4d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.560+0000 7ff4e5ffb700 1 -- 172.21.15.37:0/1642410493 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff4d805edf0 con 0x7ff4e81045f0 2024-05-09T00:59:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.841+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff4e819c180 con 0x7ff4e81045f0 2024-05-09T00:59:30.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.847+0000 7ff4e5ffb700 1 -- 172.21.15.37:0/1642410493 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288646 (secure 0 0 0) 0x7ff4d8013070 con 0x7ff4e81045f0 2024-05-09T00:59:30.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:59:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4d40b2990 msgr2=0x7ff4d40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4d40b2990 0x7ff4d40b4ea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8103510 tx=0x7ff4d0009260 comp rx=0 tx=0).stop 2024-05-09T00:59:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 msgr2=0x7ff4e819ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e819ae70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8006010 tx=0x7ff4d8004270 comp rx=0 tx=0).stop 2024-05-09T00:59:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 shutdown_connections 2024-05-09T00:59:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff4d40b2990 0x7ff4d40b4ea0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff4e8109870 0x7ff4e819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e81045f0 0x7ff4e819ae70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 --2- 172.21.15.37:0/1642410493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8108f20 0x7ff4e819b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:30.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.850+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 >> 172.21.15.37:0/1642410493 conn(0x7ff4e80fffe0 msgr2=0x7ff4e8108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:30.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.851+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 shutdown_connections 2024-05-09T00:59:30.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:30.851+0000 7ff4ee8ac700 1 -- 172.21.15.37:0/1642410493 wait complete. 2024-05-09T00:59:31.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:31 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:31 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1642410493' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:59:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:31 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:31 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1642410493' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:59:31.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:31 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:31.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:31 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1642410493' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:59:31.933 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":2764436863},{"type":"v1","addr":"172.21.15.37:6801","nonce":2764436863}]},"active_addr":"172.21.15.37:6801/2764436863","active_change":"2024-05-09T00:51:18.788795+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3076343336}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1589009487}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":325439124}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3704275929}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1656584440}]}]} 2024-05-09T00:59:31.940 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-09T00:59:31.940 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-09T00:59:31.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:59:32.236 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:32 smithi151 ceph-mon[34780]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s; 10 B/s, 0 objects/s recovering 2024-05-09T00:59:32.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:32 smithi136 ceph-mon[34110]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s; 10 B/s, 0 objects/s recovering 2024-05-09T00:59:32.695 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:32 smithi037 ceph-mon[30122]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.2 KiB/s wr, 12 op/s; 10 B/s, 0 objects/s recovering 2024-05-09T00:59:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 -- 172.21.15.37:0/16920943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec0108740 msgr2=0x7fcec01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 --2- 172.21.15.37:0/16920943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec0108740 0x7fcec01100a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fceb800b0d0 tx=0x7fceb800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 -- 172.21.15.37:0/16920943 shutdown_connections 2024-05-09T00:59:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 --2- 172.21.15.37:0/16920943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec0108740 0x7fcec01100a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 --2- 172.21.15.37:0/16920943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec01034c0 0x7fcec01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 --2- 172.21.15.37:0/16920943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcec0107df0 0x7fcec0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 -- 172.21.15.37:0/16920943 >> 172.21.15.37:0/16920943 conn(0x7fcec00fedf0 msgr2=0x7fcec0101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 -- 172.21.15.37:0/16920943 shutdown_connections 2024-05-09T00:59:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.044+0000 7fcec5d30700 1 -- 172.21.15.37:0/16920943 wait complete. 2024-05-09T00:59:34.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 Processor -- start 2024-05-09T00:59:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 -- start start 2024-05-09T00:59:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec01034c0 0x7fcec019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec0107df0 0x7fcec019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcec0108740 0x7fcec019f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0113370 con 0x7fcec01034c0 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01131f0 con 0x7fcec0107df0 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcec5d30700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01134f0 con 0x7fcec0108740 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec01034c0 0x7fcec019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcebf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec01034c0 0x7fcec019aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57008/0 (socket says 172.21.15.37:57008) 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcebf7fe700 1 -- 172.21.15.37:0/1786176985 learned_addr learned my addr 172.21.15.37:0/1786176985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcebffff700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcec0108740 0x7fcec019f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.045+0000 7fcebeffd700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec0107df0 0x7fcec019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebf7fe700 1 -- 172.21.15.37:0/1786176985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcec0108740 msgr2=0x7fcec019f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebf7fe700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcec0108740 0x7fcec019f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebf7fe700 1 -- 172.21.15.37:0/1786176985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec0107df0 msgr2=0x7fcec019b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebf7fe700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec0107df0 0x7fcec019b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebf7fe700 1 -- 172.21.15.37:0/1786176985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec019fda0 con 0x7fcec01034c0 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebeffd700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec0107df0 0x7fcec019b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebf7fe700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec01034c0 0x7fcec019aed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcea800d950 tx=0x7fcea800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebcff9700 1 -- 172.21.15.37:0/1786176985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8016070 con 0x7fcec01034c0 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebcff9700 1 -- 172.21.15.37:0/1786176985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcea8009df0 con 0x7fcec01034c0 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec01a0090 con 0x7fcec01034c0 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcebcff9700 1 -- 172.21.15.37:0/1786176985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea800f3c0 con 0x7fcec01034c0 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.046+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01a79b0 con 0x7fcec01034c0 2024-05-09T00:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.047+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec00512c0 con 0x7fcec01034c0 2024-05-09T00:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.049+0000 7fcebcff9700 1 -- 172.21.15.37:0/1786176985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fcea8019070 con 0x7fcec01034c0 2024-05-09T00:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.049+0000 7fcebcff9700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fceac0b2910 0x7fceac0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.050+0000 7fcebeffd700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fceac0b2910 0x7fceac0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.050+0000 7fcebcff9700 1 -- 172.21.15.37:0/1786176985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcea80e1ec0 con 0x7fcec01034c0 2024-05-09T00:59:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.050+0000 7fcebeffd700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fceac0b2910 0x7fceac0b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcec0109900 tx=0x7fceb0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.054+0000 7fcebcff9700 1 -- 172.21.15.37:0/1786176985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcea80a9b80 con 0x7fcec01034c0 2024-05-09T00:59:34.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:33 smithi037 ceph-mon[30122]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-05-09T00:59:34.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:59:34.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:59:34.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:33 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:33 smithi151 ceph-mon[34780]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-05-09T00:59:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:59:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:59:34.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:33 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.268+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcec019c230 con 0x7fcec01034c0 2024-05-09T00:59:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.270+0000 7fcebcff9700 1 -- 172.21.15.37:0/1786176985 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7fcea80a9480 con 0x7fcec01034c0 2024-05-09T00:59:34.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:59:34.271 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:59:34.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fceac0b2910 msgr2=0x7fceac0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:34.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fceac0b2910 0x7fceac0b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcec0109900 tx=0x7fceb0009260 comp rx=0 tx=0).stop 2024-05-09T00:59:34.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec01034c0 msgr2=0x7fcec019aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:34.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec01034c0 0x7fcec019aed0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcea800d950 tx=0x7fcea800dc60 comp rx=0 tx=0).stop 2024-05-09T00:59:34.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 shutdown_connections 2024-05-09T00:59:34.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fceac0b2910 0x7fceac0b4e20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcec0108740 0x7fcec019f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcec01034c0 0x7fcec019aed0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 --2- 172.21.15.37:0/1786176985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcec0107df0 0x7fcec019b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 >> 172.21.15.37:0/1786176985 conn(0x7fcec00fedf0 msgr2=0x7fcec0075d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 shutdown_connections 2024-05-09T00:59:34.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:34.272+0000 7fcec5d30700 1 -- 172.21.15.37:0/1786176985 wait complete. 2024-05-09T00:59:34.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:33 smithi136 ceph-mon[34110]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-05-09T00:59:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:59:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:59:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:33 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T00:59:34.913 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-09T00:59:34.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:59:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:35.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:34 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1786176985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:35.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:34 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1786176985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:35.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:34 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1786176985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:36.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:35 smithi037 ceph-mon[30122]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-09T00:59:36.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:35 smithi151 ceph-mon[34780]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-09T00:59:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:35 smithi136 ceph-mon[34110]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-09T00:59:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 -- 172.21.15.37:0/834710244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 msgr2=0x7f9e60103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 --2- 172.21.15.37:0/834710244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e60103f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e500099c0 tx=0x7f9e50009cd0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 -- 172.21.15.37:0/834710244 shutdown_connections 2024-05-09T00:59:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 --2- 172.21.15.37:0/834710244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e601087a0 0x7f9e60110140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 --2- 172.21.15.37:0/834710244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e60103f40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 --2- 172.21.15.37:0/834710244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e60107e50 0x7f9e60108260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 -- 172.21.15.37:0/834710244 >> 172.21.15.37:0/834710244 conn(0x7f9e600fe520 msgr2=0x7f9e60100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:36.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 -- 172.21.15.37:0/834710244 shutdown_connections 2024-05-09T00:59:36.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.731+0000 7f9e64926700 1 -- 172.21.15.37:0/834710244 wait complete. 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 Processor -- start 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 -- start start 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e6019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e60107e50 0x7f9e6019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e601087a0 0x7f9e601a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60113410 con 0x7f9e60103b30 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60113290 con 0x7f9e601087a0 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e64926700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60113590 con 0x7f9e60107e50 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e6019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e6019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57020/0 (socket says 172.21.15.37:57020) 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 -- 172.21.15.37:0/646524823 learned_addr learned my addr 172.21.15.37:0/646524823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5dd9b700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e60107e50 0x7f9e6019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5ed9d700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e601087a0 0x7f9e601a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 -- 172.21.15.37:0/646524823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e60107e50 msgr2=0x7f9e6019c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e60107e50 0x7f9e6019c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 -- 172.21.15.37:0/646524823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e601087a0 msgr2=0x7f9e601a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e601087a0 0x7f9e601a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.733+0000 7f9e5e59c700 1 -- 172.21.15.37:0/646524823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6019caa0 con 0x7f9e60103b30 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.734+0000 7f9e5e59c700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e6019bcb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000b580 tx=0x7f9e500047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.734+0000 7f9e4f7fe700 1 -- 172.21.15.37:0/646524823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50027070 con 0x7f9e60103b30 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.734+0000 7f9e4f7fe700 1 -- 172.21.15.37:0/646524823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e50004020 con 0x7f9e60103b30 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.734+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e601a7330 con 0x7f9e60103b30 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.734+0000 7f9e4f7fe700 1 -- 172.21.15.37:0/646524823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50022e30 con 0x7f9e60103b30 2024-05-09T00:59:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.734+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e601a7780 con 0x7f9e60103b30 2024-05-09T00:59:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.735+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6010b7c0 con 0x7f9e60103b30 2024-05-09T00:59:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.737+0000 7f9e4f7fe700 1 -- 172.21.15.37:0/646524823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9e50022590 con 0x7f9e60103b30 2024-05-09T00:59:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.738+0000 7f9e4f7fe700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9e480b2910 0x7f9e480b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.738+0000 7f9e4f7fe700 1 -- 172.21.15.37:0/646524823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9e500e33b0 con 0x7f9e60103b30 2024-05-09T00:59:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.738+0000 7f9e5dd9b700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9e480b2910 0x7f9e480b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.739+0000 7f9e5dd9b700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9e480b2910 0x7f9e480b4e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e54005950 tx=0x7f9e540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.742+0000 7f9e4f7fe700 1 -- 172.21.15.37:0/646524823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9e50030080 con 0x7f9e60103b30 2024-05-09T00:59:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.959+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e6010b1a0 con 0x7f9e60103b30 2024-05-09T00:59:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.960+0000 7f9e4f7fe700 1 -- 172.21.15.37:0/646524823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7f9e50013070 con 0x7f9e60103b30 2024-05-09T00:59:36.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T00:59:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9e480b2910 msgr2=0x7f9e480b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9e480b2910 0x7f9e480b4e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e54005950 tx=0x7f9e540058e0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 msgr2=0x7f9e6019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e6019bcb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000b580 tx=0x7f9e500047b0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 shutdown_connections 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9e480b2910 0x7f9e480b4e20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e601087a0 0x7f9e601a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e60103b30 0x7f9e6019bcb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 --2- 172.21.15.37:0/646524823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e60107e50 0x7f9e6019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 >> 172.21.15.37:0/646524823 conn(0x7f9e600fe520 msgr2=0x7f9e601060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 shutdown_connections 2024-05-09T00:59:36.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:36.963+0000 7f9e64926700 1 -- 172.21.15.37:0/646524823 wait complete. 2024-05-09T00:59:37.313 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:37 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/646524823' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:37.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:37 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/646524823' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:37.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:37 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/646524823' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:59:37.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-09T00:59:37.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-09T00:59:37.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-09T00:59:37.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-09T00:59:37.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-09T00:59:37.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-09T00:59:37.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-09T00:59:37.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-09T00:59:37.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-09T00:59:37.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-09T00:59:37.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-09T00:59:37.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-09T00:59:38.348 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:38.350 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:38.373 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:38 smithi037 ceph-mon[30122]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-09T00:59:38.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:38 smithi136 ceph-mon[34110]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-09T00:59:38.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:38 smithi151 ceph-mon[34780]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-09T00:59:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:40.332 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:40 smithi037 ceph-mon[30122]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T00:59:40.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:40 smithi136 ceph-mon[34110]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T00:59:40.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:40 smithi151 ceph-mon[34780]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T00:59:40.973 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:40.973 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:40.974 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:40.994 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:41.742 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.955+0000 7fca68653700 1 -- 172.21.15.37:0/2700103063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 msgr2=0x7fca60102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.955+0000 7fca68653700 1 --2- 172.21.15.37:0/2700103063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 0x7fca60102720 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fca50009990 tx=0x7fca50009ca0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 -- 172.21.15.37:0/2700103063 shutdown_connections 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 --2- 172.21.15.37:0/2700103063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca60102c60 0x7fca60113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 --2- 172.21.15.37:0/2700103063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca60105080 0x7fca60105490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 --2- 172.21.15.37:0/2700103063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 0x7fca60102720 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 -- 172.21.15.37:0/2700103063 >> 172.21.15.37:0/2700103063 conn(0x7fca600fe0d0 msgr2=0x7fca601004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 -- 172.21.15.37:0/2700103063 shutdown_connections 2024-05-09T00:59:41.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 -- 172.21.15.37:0/2700103063 wait complete. 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 Processor -- start 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.956+0000 7fca68653700 1 -- start start 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca68653700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 0x7fca6019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca68653700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca60102c60 0x7fca6019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca68653700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca60105080 0x7fca601a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca68653700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca60116710 con 0x7fca60102310 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca68653700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fca60116590 con 0x7fca60102c60 2024-05-09T00:59:41.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca68653700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fca60116890 con 0x7fca60105080 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 0x7fca6019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 0x7fca6019d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34094/0 (socket says 172.21.15.37:34094) 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 -- 172.21.15.37:0/3459800464 learned_addr learned my addr 172.21.15.37:0/3459800464 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 -- 172.21.15.37:0/3459800464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca60105080 msgr2=0x7fca601a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca60105080 0x7fca601a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 -- 172.21.15.37:0/3459800464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca60102c60 msgr2=0x7fca6019d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca60102c60 0x7fca6019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 -- 172.21.15.37:0/3459800464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca601a1ea0 con 0x7fca60102310 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.957+0000 7fca663ef700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 0x7fca6019d080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c9e0 tx=0x7fca5c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.958+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c007aa0 con 0x7fca60102310 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.958+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca601a2190 con 0x7fca60102310 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.958+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca5c007c40 con 0x7fca60102310 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.958+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c018660 con 0x7fca60102310 2024-05-09T00:59:41.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.958+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca601a26d0 con 0x7fca60102310 2024-05-09T00:59:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.959+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca60063ed0 con 0x7fca60102310 2024-05-09T00:59:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.960+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fca5c018800 con 0x7fca60102310 2024-05-09T00:59:41.961 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.961+0000 7fca577fe700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fca4c0b2910 0x7fca4c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.961+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fca5c0e2830 con 0x7fca60102310 2024-05-09T00:59:41.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.961+0000 7fca65bee700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fca4c0b2910 0x7fca4c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.962+0000 7fca577fe700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] conn(0x7fca4c0bc3a0 0x7fca4c0be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.962+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 --> [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca5c015e70 con 0x7fca4c0bc3a0 2024-05-09T00:59:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.962+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fca5c0e2d10 con 0x7fca60102310 2024-05-09T00:59:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.962+0000 7fca66bf0700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] conn(0x7fca4c0bc3a0 0x7fca4c0be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.962+0000 7fca65bee700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fca4c0b2910 0x7fca4c0b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fca500098e0 tx=0x7fca50005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.962+0000 7fca66bf0700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] conn(0x7fca4c0bc3a0 0x7fca4c0be890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:41.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.963+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== osd.3 v2:172.21.15.37:6810/1053835571 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca5c015e70 con 0x7fca4c0bc3a0 2024-05-09T00:59:41.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.986+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 --> [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca60064300 con 0x7fca4c0bc3a0 2024-05-09T00:59:41.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca577fe700 1 -- 172.21.15.37:0/3459800464 <== osd.3 v2:172.21.15.37:6810/1053835571 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca60064300 con 0x7fca4c0bc3a0 2024-05-09T00:59:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] conn(0x7fca4c0bc3a0 msgr2=0x7fca4c0be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] conn(0x7fca4c0bc3a0 0x7fca4c0be890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fca4c0b2910 msgr2=0x7fca4c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fca4c0b2910 0x7fca4c0b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fca500098e0 tx=0x7fca50005fb0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 msgr2=0x7fca6019d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:41.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 --2- 172.21.15.37:0/3459800464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca60102310 0x7fca6019d080 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c9e0 tx=0x7fca5c00cda0 comp rx=0 tx=0).stop 2024-05-09T00:59:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca66bf0700 1 -- 172.21.15.37:0/3459800464 reap_dead start 2024-05-09T00:59:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 shutdown_connections 2024-05-09T00:59:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 >> 172.21.15.37:0/3459800464 conn(0x7fca600fe0d0 msgr2=0x7fca600ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 shutdown_connections 2024-05-09T00:59:41.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:41.987+0000 7fca68653700 1 -- 172.21.15.37:0/3459800464 wait complete. 2024-05-09T00:59:42.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:42 smithi037 ceph-mon[30122]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T00:59:42.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:42 smithi136 ceph-mon[34110]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T00:59:42.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:42 smithi151 ceph-mon[34780]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T00:59:44.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:44 smithi037 ceph-mon[30122]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T00:59:44.346 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:44 smithi151 ceph-mon[34780]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T00:59:44.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:44 smithi136 ceph-mon[34110]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T00:59:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.411+0000 7fd5ddc93700 1 -- 172.21.15.37:0/3443654391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d81034c0 msgr2=0x7fd5d81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.411+0000 7fd5ddc93700 1 --2- 172.21.15.37:0/3443654391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d81034c0 0x7fd5d81038d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800b0d0 tx=0x7fd5c800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.411+0000 7fd5ddc93700 1 -- 172.21.15.37:0/3443654391 shutdown_connections 2024-05-09T00:59:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.411+0000 7fd5ddc93700 1 --2- 172.21.15.37:0/3443654391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8108740 0x7fd5d81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.411+0000 7fd5ddc93700 1 --2- 172.21.15.37:0/3443654391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d81034c0 0x7fd5d81038d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.412+0000 7fd5ddc93700 1 --2- 172.21.15.37:0/3443654391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5d8107df0 0x7fd5d8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.412+0000 7fd5ddc93700 1 -- 172.21.15.37:0/3443654391 >> 172.21.15.37:0/3443654391 conn(0x7fd5d80fedf0 msgr2=0x7fd5d8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.412+0000 7fd5ddc93700 1 -- 172.21.15.37:0/3443654391 shutdown_connections 2024-05-09T00:59:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.412+0000 7fd5ddc93700 1 -- 172.21.15.37:0/3443654391 wait complete. 2024-05-09T00:59:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.412+0000 7fd5ddc93700 1 Processor -- start 2024-05-09T00:59:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5ddc93700 1 -- start start 2024-05-09T00:59:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5ddc93700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5d81034c0 0x7fd5d819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5ddc93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8107df0 0x7fd5d819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5ddc93700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8108740 0x7fd5d819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5ddc93700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d81133c0 con 0x7fd5d8107df0 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5ddc93700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8113240 con 0x7fd5d81034c0 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5ddc93700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d8113540 con 0x7fd5d8108740 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8107df0 0x7fd5d819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8107df0 0x7fd5d819c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34106/0 (socket says 172.21.15.37:34106) 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 -- 172.21.15.37:0/656735083 learned_addr learned my addr 172.21.15.37:0/656735083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d7fff700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8108740 0x7fd5d819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d77fe700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5d81034c0 0x7fd5d819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 -- 172.21.15.37:0/656735083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8108740 msgr2=0x7fd5d819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5d8108740 0x7fd5d819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 -- 172.21.15.37:0/656735083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5d81034c0 msgr2=0x7fd5d819bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5d81034c0 0x7fd5d819bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.413+0000 7fd5d6ffd700 1 -- 172.21.15.37:0/656735083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d81a70d0 con 0x7fd5d8107df0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.414+0000 7fd5d6ffd700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8107df0 0x7fd5d819c2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000d950 tx=0x7fd5c000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.414+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0016070 con 0x7fd5d8107df0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.414+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d81a73c0 con 0x7fd5d8107df0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.414+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5c0004830 con 0x7fd5d8107df0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.414+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0005420 con 0x7fd5d8107df0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.414+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d81a7950 con 0x7fd5d8107df0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.415+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd5d8063ed0 con 0x7fd5d8107df0 2024-05-09T00:59:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.417+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd5c00055e0 con 0x7fd5d8107df0 2024-05-09T00:59:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.417+0000 7fd5d4ff9700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5c40b2910 0x7fd5c40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.417+0000 7fd5d77fe700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5c40b2910 0x7fd5c40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.418+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd5c00e26a0 con 0x7fd5d8107df0 2024-05-09T00:59:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.418+0000 7fd5d4ff9700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] conn(0x7fd5c40bc3a0 0x7fd5c40be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.418+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 --> [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5c0001d30 con 0x7fd5c40bc3a0 2024-05-09T00:59:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.418+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fd5c00e2b80 con 0x7fd5d8107df0 2024-05-09T00:59:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.418+0000 7fd5d7fff700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] conn(0x7fd5c40bc3a0 0x7fd5c40be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.418+0000 7fd5d77fe700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5c40b2910 0x7fd5c40b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009fd0 tx=0x7fd5c800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.418+0000 7fd5d7fff700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] conn(0x7fd5c40bc3a0 0x7fd5c40be890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.419+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== osd.9 v2:172.21.15.37:6826/479009325 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5c0001d30 con 0x7fd5c40bc3a0 2024-05-09T00:59:45.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.436+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 --> [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd5d8064300 con 0x7fd5c40bc3a0 2024-05-09T00:59:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.436+0000 7fd5d4ff9700 1 -- 172.21.15.37:0/656735083 <== osd.9 v2:172.21.15.37:6826/479009325 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd5d8064300 con 0x7fd5c40bc3a0 2024-05-09T00:59:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.436+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] conn(0x7fd5c40bc3a0 msgr2=0x7fd5c40be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.436+0000 7fd5ddc93700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] conn(0x7fd5c40bc3a0 0x7fd5c40be890 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5c40b2910 msgr2=0x7fd5c40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5c40b2910 0x7fd5c40b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009fd0 tx=0x7fd5c800b040 comp rx=0 tx=0).stop 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8107df0 msgr2=0x7fd5d819c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 --2- 172.21.15.37:0/656735083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5d8107df0 0x7fd5d819c2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000d950 tx=0x7fd5c000dc60 comp rx=0 tx=0).stop 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5d7fff700 1 -- 172.21.15.37:0/656735083 reap_dead start 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 shutdown_connections 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 >> 172.21.15.37:0/656735083 conn(0x7fd5d80fedf0 msgr2=0x7fd5d81096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 shutdown_connections 2024-05-09T00:59:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:45.437+0000 7fd5ddc93700 1 -- 172.21.15.37:0/656735083 wait complete. 2024-05-09T00:59:46.324 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:46 smithi037 ceph-mon[30122]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T00:59:46.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:46 smithi136 ceph-mon[34110]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T00:59:46.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:46 smithi151 ceph-mon[34780]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T00:59:48.212 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:48 smithi037 ceph-mon[30122]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T00:59:48.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:48 smithi136 ceph-mon[34110]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T00:59:48.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:48 smithi151 ceph-mon[34780]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T00:59:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:59:50.170 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:50 smithi037 ceph-mon[30122]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T00:59:50.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:50 smithi136 ceph-mon[34110]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T00:59:50.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:50 smithi151 ceph-mon[34780]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T00:59:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 -- 172.21.15.37:0/49008974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c1034e0 msgr2=0x7f418c1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 --2- 172.21.15.37:0/49008974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c1034e0 0x7f418c1038f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f41880099c0 tx=0x7f4188009cd0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 -- 172.21.15.37:0/49008974 shutdown_connections 2024-05-09T00:59:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 --2- 172.21.15.37:0/49008974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f418c108760 0x7f418c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 --2- 172.21.15.37:0/49008974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c1034e0 0x7f418c1038f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 --2- 172.21.15.37:0/49008974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c107e10 0x7f418c108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 -- 172.21.15.37:0/49008974 >> 172.21.15.37:0/49008974 conn(0x7f418c0fef30 msgr2=0x7f418c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 -- 172.21.15.37:0/49008974 shutdown_connections 2024-05-09T00:59:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.606+0000 7f41943ab700 1 -- 172.21.15.37:0/49008974 wait complete. 2024-05-09T00:59:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 Processor -- start 2024-05-09T00:59:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 -- start start 2024-05-09T00:59:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c1034e0 0x7f418c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c107e10 0x7f418c19c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f418c108760 0x7f418c19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f418c1133b0 con 0x7f418c107e10 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f418c113230 con 0x7f418c1034e0 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f41943ab700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f418c113530 con 0x7f418c108760 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f4191946700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c107e10 0x7f418c19c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f4191946700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c107e10 0x7f418c19c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39124/0 (socket says 172.21.15.37:39124) 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.607+0000 7f4191946700 1 -- 172.21.15.37:0/1791243360 learned_addr learned my addr 172.21.15.37:0/1791243360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4192147700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c1034e0 0x7f418c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4192948700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f418c108760 0x7f418c19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4191946700 1 -- 172.21.15.37:0/1791243360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f418c108760 msgr2=0x7f418c19c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4191946700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f418c108760 0x7f418c19c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4191946700 1 -- 172.21.15.37:0/1791243360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c1034e0 msgr2=0x7f418c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4191946700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f418c1034e0 0x7f418c19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4191946700 1 -- 172.21.15.37:0/1791243360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418c1a6fe0 con 0x7f418c107e10 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f4191946700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c107e10 0x7f418c19c1d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d980 tx=0x7f417c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c017070 con 0x7f418c107e10 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f417c00fd40 con 0x7f418c107e10 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418c1a72d0 con 0x7f418c107e10 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c00e3b0 con 0x7f418c107e10 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.608+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f418c1a7810 con 0x7f418c107e10 2024-05-09T00:59:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.609+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f418c063ed0 con 0x7f418c107e10 2024-05-09T00:59:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.611+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f417c010610 con 0x7f418c107e10 2024-05-09T00:59:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.612+0000 7f41837fe700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f41780b2910 0x7f41780b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.612+0000 7f4192147700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f41780b2910 0x7f41780b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.612+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f417c0e2140 con 0x7f418c107e10 2024-05-09T00:59:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.612+0000 7f41837fe700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] conn(0x7f41780bc3a0 0x7f41780be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.612+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 --> [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f417c016ec0 con 0x7f41780bc3a0 2024-05-09T00:59:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.612+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f417c0e2620 con 0x7f418c107e10 2024-05-09T00:59:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.612+0000 7f4192948700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] conn(0x7f41780bc3a0 0x7f41780be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.613+0000 7f4192147700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f41780b2910 0x7f41780b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4188009990 tx=0x7f41880036e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.613+0000 7f4192948700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] conn(0x7f41780bc3a0 0x7f41780be890 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.614+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== osd.0 v2:172.21.15.37:6802/3555372504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f417c016ec0 con 0x7f41780bc3a0 2024-05-09T00:59:51.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.632+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 --> [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f418c0642d0 con 0x7f41780bc3a0 2024-05-09T00:59:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.632+0000 7f41837fe700 1 -- 172.21.15.37:0/1791243360 <== osd.0 v2:172.21.15.37:6802/3555372504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f418c0642d0 con 0x7f41780bc3a0 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] conn(0x7f41780bc3a0 msgr2=0x7f41780be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] conn(0x7f41780bc3a0 0x7f41780be890 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f41780b2910 msgr2=0x7f41780b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f41780b2910 0x7f41780b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4188009990 tx=0x7f41880036e0 comp rx=0 tx=0).stop 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c107e10 msgr2=0x7f418c19c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 --2- 172.21.15.37:0/1791243360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f418c107e10 0x7f418c19c1d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f417c00d980 tx=0x7f417c00dc90 comp rx=0 tx=0).stop 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f4192948700 1 -- 172.21.15.37:0/1791243360 reap_dead start 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 shutdown_connections 2024-05-09T00:59:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 >> 172.21.15.37:0/1791243360 conn(0x7f418c0fef30 msgr2=0x7f418c107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 shutdown_connections 2024-05-09T00:59:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:51.633+0000 7f41943ab700 1 -- 172.21.15.37:0/1791243360 wait complete. 2024-05-09T00:59:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:52 smithi136 ceph-mon[34110]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T00:59:52.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:52 smithi037 ceph-mon[30122]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T00:59:52.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:52 smithi151 ceph-mon[34780]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 -- 172.21.15.37:0/2107078615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 msgr2=0x7f1f0c1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 --2- 172.21.15.37:0/2107078615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 0x7f1f0c1049f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b0d0 tx=0x7f1efc00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 -- 172.21.15.37:0/2107078615 shutdown_connections 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 --2- 172.21.15.37:0/2107078615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f0c109860 0x7f1f0c1111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 --2- 172.21.15.37:0/2107078615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 0x7f1f0c1049f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 --2- 172.21.15.37:0/2107078615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f0c108f10 0x7f1f0c109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 -- 172.21.15.37:0/2107078615 >> 172.21.15.37:0/2107078615 conn(0x7f1f0c0ffe70 msgr2=0x7f1f0c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 -- 172.21.15.37:0/2107078615 shutdown_connections 2024-05-09T00:59:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.524+0000 7f1f11081700 1 -- 172.21.15.37:0/2107078615 wait complete. 2024-05-09T00:59:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.525+0000 7f1f11081700 1 Processor -- start 2024-05-09T00:59:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.525+0000 7f1f11081700 1 -- start start 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f11081700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 0x7f1f0c19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f11081700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f0c108f10 0x7f1f0c19b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f11081700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f0c109860 0x7f1f0c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f11081700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c114490 con 0x7f1f0c1045e0 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f11081700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c114310 con 0x7f1f0c108f10 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f11081700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c114610 con 0x7f1f0c109860 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 0x7f1f0c19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 0x7f1f0c19ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39150/0 (socket says 172.21.15.37:39150) 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 -- 172.21.15.37:0/1048191327 learned_addr learned my addr 172.21.15.37:0/1048191327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0a59c700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f0c108f10 0x7f1f0c19b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0b59e700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f0c109860 0x7f1f0c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 -- 172.21.15.37:0/1048191327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f0c109860 msgr2=0x7f1f0c19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f0c109860 0x7f1f0c19f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 -- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f0c108f10 msgr2=0x7f1f0c19b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f0c108f10 0x7f1f0c19b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 -- 172.21.15.37:0/1048191327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c19fcb0 con 0x7f1f0c1045e0 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0b59e700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f0c109860 0x7f1f0c19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.526+0000 7f1f0ad9d700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 0x7f1f0c19ade0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00d010 tx=0x7f1efc007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.527+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc01f070 con 0x7f1f0c1045e0 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.527+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c19ff40 con 0x7f1f0c1045e0 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.527+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1efc003c00 con 0x7f1f0c1045e0 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.527+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc01b6a0 con 0x7f1f0c1045e0 2024-05-09T00:59:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.527+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c1a78c0 con 0x7f1f0c1045e0 2024-05-09T00:59:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.528+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f0c1a0470 con 0x7f1f0c1045e0 2024-05-09T00:59:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.530+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1efc022070 con 0x7f1f0c1045e0 2024-05-09T00:59:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.531+0000 7f1ef3fff700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1ef40b2910 0x7f1ef40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.531+0000 7f1f0a59c700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1ef40b2910 0x7f1ef40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.531+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1efc00f020 con 0x7f1f0c1045e0 2024-05-09T00:59:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.531+0000 7f1ef3fff700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] conn(0x7f1ef40bc3a0 0x7f1ef40be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.531+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 --> [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1efc0075c0 con 0x7f1ef40bc3a0 2024-05-09T00:59:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.531+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f1efc0e3c60 con 0x7f1f0c1045e0 2024-05-09T00:59:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.531+0000 7f1f0a59c700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1ef40b2910 0x7f1ef40b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f00005fd0 tx=0x7f1f0000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.532+0000 7f1f0b59e700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] conn(0x7f1ef40bc3a0 0x7f1ef40be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.532+0000 7f1f0b59e700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] conn(0x7f1ef40bc3a0 0x7f1ef40be890 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.533+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== osd.10 v2:172.21.15.136:6824/2664303650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1efc0075c0 con 0x7f1ef40bc3a0 2024-05-09T00:59:52.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.553+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 --> [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f0c0641a0 con 0x7f1ef40bc3a0 2024-05-09T00:59:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.553+0000 7f1ef3fff700 1 -- 172.21.15.37:0/1048191327 <== osd.10 v2:172.21.15.136:6824/2664303650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1f0c0641a0 con 0x7f1ef40bc3a0 2024-05-09T00:59:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] conn(0x7f1ef40bc3a0 msgr2=0x7f1ef40be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] conn(0x7f1ef40bc3a0 0x7f1ef40be890 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1ef40b2910 msgr2=0x7f1ef40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1ef40b2910 0x7f1ef40b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1f00005fd0 tx=0x7f1f0000a560 comp rx=0 tx=0).stop 2024-05-09T00:59:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 msgr2=0x7f1f0c19ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 --2- 172.21.15.37:0/1048191327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c1045e0 0x7f1f0c19ade0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00d010 tx=0x7f1efc007ad0 comp rx=0 tx=0).stop 2024-05-09T00:59:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f0b59e700 1 -- 172.21.15.37:0/1048191327 reap_dead start 2024-05-09T00:59:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 shutdown_connections 2024-05-09T00:59:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 >> 172.21.15.37:0/1048191327 conn(0x7f1f0c0ffe70 msgr2=0x7f1f0c102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 shutdown_connections 2024-05-09T00:59:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:52.554+0000 7f1f11081700 1 -- 172.21.15.37:0/1048191327 wait complete. 2024-05-09T00:59:52.951 INFO:teuthology.orchestra.run.smithi037.stdout:34359738454 2024-05-09T00:59:52.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.162+0000 7f5e6082f700 1 -- 172.21.15.37:0/4159779142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c108740 msgr2=0x7f5e5c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.162+0000 7f5e6082f700 1 --2- 172.21.15.37:0/4159779142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c108740 0x7f5e5c1100a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400b0d0 tx=0x7f5e5400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.163+0000 7f5e6082f700 1 -- 172.21.15.37:0/4159779142 shutdown_connections 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.163+0000 7f5e6082f700 1 --2- 172.21.15.37:0/4159779142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c108740 0x7f5e5c1100a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.163+0000 7f5e6082f700 1 --2- 172.21.15.37:0/4159779142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e5c1034c0 0x7f5e5c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.163+0000 7f5e6082f700 1 --2- 172.21.15.37:0/4159779142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c107df0 0x7f5e5c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.163+0000 7f5e6082f700 1 -- 172.21.15.37:0/4159779142 >> 172.21.15.37:0/4159779142 conn(0x7f5e5c0fedc0 msgr2=0x7f5e5c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.163+0000 7f5e6082f700 1 -- 172.21.15.37:0/4159779142 shutdown_connections 2024-05-09T00:59:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.163+0000 7f5e6082f700 1 -- 172.21.15.37:0/4159779142 wait complete. 2024-05-09T00:59:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 Processor -- start 2024-05-09T00:59:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 -- start start 2024-05-09T00:59:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c1034c0 0x7f5e5c19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c107df0 0x7f5e5c19d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e5c108740 0x7f5e5c1a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c113370 con 0x7f5e5c107df0 2024-05-09T00:59:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c1131f0 con 0x7f5e5c1034c0 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e6082f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5c1134f0 con 0x7f5e5c108740 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e59d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c107df0 0x7f5e5c19d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e59d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c107df0 0x7f5e5c19d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39156/0 (socket says 172.21.15.37:39156) 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e59d9b700 1 -- 172.21.15.37:0/3784823811 learned_addr learned my addr 172.21.15.37:0/3784823811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e5a59c700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c1034c0 0x7f5e5c19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.164+0000 7f5e5ad9d700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e5c108740 0x7f5e5c1a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e59d9b700 1 -- 172.21.15.37:0/3784823811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e5c108740 msgr2=0x7f5e5c1a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e59d9b700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e5c108740 0x7f5e5c1a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e59d9b700 1 -- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c1034c0 msgr2=0x7f5e5c19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e59d9b700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e5c1034c0 0x7f5e5c19cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e59d9b700 1 -- 172.21.15.37:0/3784823811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5c1a1e40 con 0x7f5e5c107df0 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e59d9b700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c107df0 0x7f5e5c19d510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400c8f0 tx=0x7f5e4400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44007940 con 0x7f5e5c107df0 2024-05-09T00:59:53.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e4400f450 con 0x7f5e5c107df0 2024-05-09T00:59:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5c1a2130 con 0x7f5e5c107df0 2024-05-09T00:59:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e44018660 con 0x7f5e5c107df0 2024-05-09T00:59:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.165+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5c1a9a50 con 0x7f5e5c107df0 2024-05-09T00:59:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.166+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e5c063f50 con 0x7f5e5c107df0 2024-05-09T00:59:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.168+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5e4400f890 con 0x7f5e5c107df0 2024-05-09T00:59:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.169+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e480b2910 0x7f5e480b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.169+0000 7f5e5a59c700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e480b2910 0x7f5e480b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.169+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5e440e2420 con 0x7f5e5c107df0 2024-05-09T00:59:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.169+0000 7f5e537fe700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] conn(0x7f5e480bc3a0 0x7f5e480be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.169+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 --> [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e4400a0a0 con 0x7f5e480bc3a0 2024-05-09T00:59:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.169+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f5e440e27d0 con 0x7f5e5c107df0 2024-05-09T00:59:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.170+0000 7f5e5a59c700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e480b2910 0x7f5e480b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005950 tx=0x7f5e4c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.170+0000 7f5e5ad9d700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] conn(0x7f5e480bc3a0 0x7f5e480be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.170+0000 7f5e5ad9d700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] conn(0x7f5e480bc3a0 0x7f5e480be890 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.171+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== osd.4 v2:172.21.15.136:6808/4131324959 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e4400a0a0 con 0x7f5e480bc3a0 2024-05-09T00:59:53.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.188+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 --> [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e5c064350 con 0x7f5e480bc3a0 2024-05-09T00:59:53.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e537fe700 1 -- 172.21.15.37:0/3784823811 <== osd.4 v2:172.21.15.136:6808/4131324959 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e5c064350 con 0x7f5e480bc3a0 2024-05-09T00:59:53.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] conn(0x7f5e480bc3a0 msgr2=0x7f5e480be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] conn(0x7f5e480bc3a0 0x7f5e480be890 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e480b2910 msgr2=0x7f5e480b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e480b2910 0x7f5e480b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c005950 tx=0x7f5e4c00a300 comp rx=0 tx=0).stop 2024-05-09T00:59:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c107df0 msgr2=0x7f5e5c19d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 --2- 172.21.15.37:0/3784823811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c107df0 0x7f5e5c19d510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400c8f0 tx=0x7f5e4400cc00 comp rx=0 tx=0).stop 2024-05-09T00:59:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e5ad9d700 1 -- 172.21.15.37:0/3784823811 reap_dead start 2024-05-09T00:59:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 shutdown_connections 2024-05-09T00:59:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 >> 172.21.15.37:0/3784823811 conn(0x7f5e5c0fedc0 msgr2=0x7f5e5c10fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 shutdown_connections 2024-05-09T00:59:53.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.189+0000 7f5e6082f700 1 -- 172.21.15.37:0/3784823811 wait complete. 2024-05-09T00:59:53.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 -- 172.21.15.37:0/3830912776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868102790 msgr2=0x7f6868102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 --2- 172.21.15.37:0/3830912776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868102790 0x7f6868102ba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6850009990 tx=0x7f6850009ca0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 -- 172.21.15.37:0/3830912776 shutdown_connections 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 --2- 172.21.15.37:0/3830912776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68681030e0 0x7f6868111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 --2- 172.21.15.37:0/3830912776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6868109300 0x7f6868109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 --2- 172.21.15.37:0/3830912776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868102790 0x7f6868102ba0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 -- 172.21.15.37:0/3830912776 >> 172.21.15.37:0/3830912776 conn(0x7f68680fe520 msgr2=0x7f6868100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 -- 172.21.15.37:0/3830912776 shutdown_connections 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.739+0000 7f686e623700 1 -- 172.21.15.37:0/3830912776 wait complete. 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 Processor -- start 2024-05-09T00:59:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 -- start start 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6868102790 0x7f6868103970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68681030e0 0x7f6868103eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868109300 0x7f68681043f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68681145a0 con 0x7f6868109300 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6868114420 con 0x7f6868102790 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686e623700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6868114720 con 0x7f68681030e0 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686cbc0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868109300 0x7f68681043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686cbc0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868109300 0x7f68681043f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39170/0 (socket says 172.21.15.37:39170) 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f686cbc0700 1 -- 172.21.15.37:0/689050201 learned_addr learned my addr 172.21.15.37:0/689050201 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f6867fff700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6868102790 0x7f6868103970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.740+0000 7f685ffff700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68681030e0 0x7f6868103eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686cbc0700 1 -- 172.21.15.37:0/689050201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68681030e0 msgr2=0x7f6868103eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686cbc0700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68681030e0 0x7f6868103eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686cbc0700 1 -- 172.21.15.37:0/689050201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6868102790 msgr2=0x7f6868103970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686cbc0700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6868102790 0x7f6868103970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686cbc0700 1 -- 172.21.15.37:0/689050201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68681a9330 con 0x7f6868109300 2024-05-09T00:59:53.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686cbc0700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868109300 0x7f68681043f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f686000ada0 tx=0x7f686000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860017020 con 0x7f6868109300 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68681a9620 con 0x7f6868109300 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f686000cd80 con 0x7f6868109300 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860005260 con 0x7f6868109300 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.741+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68681a9b30 con 0x7f6868109300 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.742+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6868063ed0 con 0x7f6868109300 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.744+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f686000a080 con 0x7f6868109300 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f6865ffb700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f68540b2910 0x7f68540b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f6867fff700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f68540b2910 0x7f68540b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f68600e2380 con 0x7f6868109300 2024-05-09T00:59:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f6865ffb700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] conn(0x7f68540bc3a0 0x7f68540be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 --> [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68540bef60 con 0x7f68540bc3a0 2024-05-09T00:59:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f68600e2860 con 0x7f6868109300 2024-05-09T00:59:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f685ffff700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] conn(0x7f68540bc3a0 0x7f68540be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f6867fff700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f68540b2910 0x7f68540b4e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f686806ca70 tx=0x7f685800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.745+0000 7f685ffff700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] conn(0x7f68540bc3a0 0x7f68540be890 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:53.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.746+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== osd.6 v2:172.21.15.37:6818/545144898 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68540bef60 con 0x7f68540bc3a0 2024-05-09T00:59:53.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 --> [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68680642d0 con 0x7f68540bc3a0 2024-05-09T00:59:53.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f6865ffb700 1 -- 172.21.15.37:0/689050201 <== osd.6 v2:172.21.15.37:6818/545144898 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f68680642d0 con 0x7f68540bc3a0 2024-05-09T00:59:53.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] conn(0x7f68540bc3a0 msgr2=0x7f68540be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] conn(0x7f68540bc3a0 0x7f68540be890 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:53.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f68540b2910 msgr2=0x7f68540b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f68540b2910 0x7f68540b4e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f686806ca70 tx=0x7f685800b410 comp rx=0 tx=0).stop 2024-05-09T00:59:53.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868109300 msgr2=0x7f68681043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:53.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 --2- 172.21.15.37:0/689050201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6868109300 0x7f68681043f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f686000ada0 tx=0x7f686000c330 comp rx=0 tx=0).stop 2024-05-09T00:59:53.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686cbc0700 1 -- 172.21.15.37:0/689050201 reap_dead start 2024-05-09T00:59:53.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 shutdown_connections 2024-05-09T00:59:53.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.763+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 >> 172.21.15.37:0/689050201 conn(0x7f68680fe520 msgr2=0x7f6868107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:53.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.764+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 shutdown_connections 2024-05-09T00:59:53.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:53.764+0000 7f686e623700 1 -- 172.21.15.37:0/689050201 wait complete. 2024-05-09T00:59:54.309 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:54 smithi037 ceph-mon[30122]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-05-09T00:59:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:54 smithi136 ceph-mon[34110]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-05-09T00:59:54.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:54 smithi151 ceph-mon[34780]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-05-09T00:59:54.721 INFO:teuthology.orchestra.run.smithi037.stdout:257698037800 2024-05-09T00:59:54.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-09T00:59:55.307 INFO:teuthology.orchestra.run.smithi037.stdout:107374182468 2024-05-09T00:59:55.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-09T00:59:55.667 INFO:teuthology.orchestra.run.smithi037.stdout:133143986243 2024-05-09T00:59:55.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-09T00:59:56.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:56 smithi037 ceph-mon[30122]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-09T00:59:56.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:56 smithi136 ceph-mon[34110]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-09T00:59:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:56 smithi151 ceph-mon[34780]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-09T00:59:56.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 -- 172.21.15.37:0/1438990516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 msgr2=0x7f3dac112fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 --2- 172.21.15.37:0/1438990516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 0x7f3dac112fe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3da400b0a0 tx=0x7f3da400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 -- 172.21.15.37:0/1438990516 shutdown_connections 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 --2- 172.21.15.37:0/1438990516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 0x7f3dac112fe0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 --2- 172.21.15.37:0/1438990516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dac105210 0x7f3dac102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 --2- 172.21.15.37:0/1438990516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dac105620 0x7f3dac102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 -- 172.21.15.37:0/1438990516 >> 172.21.15.37:0/1438990516 conn(0x7f3dac0fe4e0 msgr2=0x7f3dac100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 -- 172.21.15.37:0/1438990516 shutdown_connections 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.878+0000 7f3db21d4700 1 -- 172.21.15.37:0/1438990516 wait complete. 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 Processor -- start 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 -- start start 2024-05-09T00:59:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 0x7f3dac19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dac105210 0x7f3dac19d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dac105620 0x7f3dac1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac116680 con 0x7f3dac103360 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac116500 con 0x7f3dac105210 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3db21d4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac116800 con 0x7f3dac105620 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3dab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 0x7f3dac19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3dab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 0x7f3dac19cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39192/0 (socket says 172.21.15.37:39192) 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3dab7fe700 1 -- 172.21.15.37:0/3602037079 learned_addr learned my addr 172.21.15.37:0/3602037079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.879+0000 7f3dabfff700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dac105620 0x7f3dac1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3daaffd700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dac105210 0x7f3dac19d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3dab7fe700 1 -- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dac105620 msgr2=0x7f3dac1a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3dab7fe700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dac105620 0x7f3dac1a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3dab7fe700 1 -- 172.21.15.37:0/3602037079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dac105210 msgr2=0x7f3dac19d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3dab7fe700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dac105210 0x7f3dac19d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3dab7fe700 1 -- 172.21.15.37:0/3602037079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac1a1e10 con 0x7f3dac103360 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3dabfff700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dac105620 0x7f3dac1a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3dab7fe700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 0x7f3dac19cf90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c970 tx=0x7f3d9c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c004220 con 0x7f3dac103360 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac1a2100 con 0x7f3dac103360 2024-05-09T00:59:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d9c007d50 con 0x7f3dac103360 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c003cc0 con 0x7f3dac103360 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.880+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1a9a20 con 0x7f3dac103360 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.881+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3dac063f50 con 0x7f3dac103360 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.883+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3d9c0043c0 con 0x7f3dac103360 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.883+0000 7f3da8ff9700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d940b2910 0x7f3d940b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.884+0000 7f3daaffd700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d940b2910 0x7f3d940b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.884+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3d9c0e2490 con 0x7f3dac103360 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.884+0000 7f3da8ff9700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] conn(0x7f3d940bc3a0 0x7f3d940be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.884+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 --> [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d940bef60 con 0x7f3d940bc3a0 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.884+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f3d9c0e2970 con 0x7f3dac103360 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.884+0000 7f3daaffd700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d940b2910 0x7f3d940b4e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005950 tx=0x7f3da00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.884+0000 7f3dabfff700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] conn(0x7f3d940bc3a0 0x7f3d940be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.885+0000 7f3dabfff700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] conn(0x7f3d940bc3a0 0x7f3d940be890 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.886+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== osd.2 v2:172.21.15.151:6800/373949032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d940bef60 con 0x7f3d940bc3a0 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.903+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 --> [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3dac064350 con 0x7f3d940bc3a0 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.904+0000 7f3da8ff9700 1 -- 172.21.15.37:0/3602037079 <== osd.2 v2:172.21.15.151:6800/373949032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3dac064350 con 0x7f3d940bc3a0 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] conn(0x7f3d940bc3a0 msgr2=0x7f3d940be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] conn(0x7f3d940bc3a0 0x7f3d940be890 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d940b2910 msgr2=0x7f3d940b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d940b2910 0x7f3d940b4e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005950 tx=0x7f3da00058e0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 msgr2=0x7f3dac19cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 --2- 172.21.15.37:0/3602037079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac103360 0x7f3dac19cf90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c970 tx=0x7f3d9c00cd30 comp rx=0 tx=0).stop 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3dabfff700 1 -- 172.21.15.37:0/3602037079 reap_dead start 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 shutdown_connections 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 >> 172.21.15.37:0/3602037079 conn(0x7f3dac0fe4e0 msgr2=0x7f3dac0ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 shutdown_connections 2024-05-09T00:59:56.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:55.905+0000 7f3db21d4700 1 -- 172.21.15.37:0/3602037079 wait complete. 2024-05-09T00:59:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 -- 172.21.15.37:0/1972888335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c108740 msgr2=0x7f060c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 --2- 172.21.15.37:0/1972888335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c108740 0x7f060c1100a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f060400b0d0 tx=0x7f060400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 -- 172.21.15.37:0/1972888335 shutdown_connections 2024-05-09T00:59:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 --2- 172.21.15.37:0/1972888335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c108740 0x7f060c1100a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 --2- 172.21.15.37:0/1972888335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060c1034c0 0x7f060c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 --2- 172.21.15.37:0/1972888335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f060c107df0 0x7f060c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 -- 172.21.15.37:0/1972888335 >> 172.21.15.37:0/1972888335 conn(0x7f060c0fedf0 msgr2=0x7f060c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 -- 172.21.15.37:0/1972888335 shutdown_connections 2024-05-09T00:59:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.938+0000 7f061439a700 1 -- 172.21.15.37:0/1972888335 wait complete. 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 Processor -- start 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 -- start start 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c1034c0 0x7f060c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060c107df0 0x7f060c19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f060c108740 0x7f060c19c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f060c113460 con 0x7f060c1034c0 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1132e0 con 0x7f060c107df0 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.939+0000 7f061439a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1135e0 con 0x7f060c108740 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c1034c0 0x7f060c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c1034c0 0x7f060c19bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39210/0 (socket says 172.21.15.37:39210) 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 -- 172.21.15.37:0/3770297705 learned_addr learned my addr 172.21.15.37:0/3770297705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T00:59:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0611935700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060c107df0 0x7f060c19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612937700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f060c108740 0x7f060c19c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 -- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f060c108740 msgr2=0x7f060c19c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f060c108740 0x7f060c19c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 -- 172.21.15.37:0/3770297705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060c107df0 msgr2=0x7f060c19c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060c107df0 0x7f060c19c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 -- 172.21.15.37:0/3770297705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c1a70d0 con 0x7f060c1034c0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0611935700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f060c107df0 0x7f060c19c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f0612136700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c1034c0 0x7f060c19bd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f060800b530 tx=0x7f060800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608015020 con 0x7f060c1034c0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0608011ce0 con 0x7f060c1034c0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060c1a73c0 con 0x7f060c1034c0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608010d20 con 0x7f060c1034c0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.940+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060c1a7950 con 0x7f060c1034c0 2024-05-09T00:59:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.941+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f060c063ed0 con 0x7f060c1034c0 2024-05-09T00:59:56.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.943+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0608018020 con 0x7f060c1034c0 2024-05-09T00:59:56.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f06037fe700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f05f80b2990 0x7f05f80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f0611935700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f05f80b2990 0x7f05f80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f06080e2090 con 0x7f060c1034c0 2024-05-09T00:59:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f06037fe700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] conn(0x7f05f80bc420 0x7f05f80be910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:59:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 --> [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f060801be50 con 0x7f05f80bc420 2024-05-09T00:59:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f06080e2570 con 0x7f060c1034c0 2024-05-09T00:59:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f0611935700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f05f80b2990 0x7f05f80b4ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f060c106980 tx=0x7f05fc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.944+0000 7f0612937700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] conn(0x7f05f80bc420 0x7f05f80be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:59:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.945+0000 7f0612937700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] conn(0x7f05f80bc420 0x7f05f80be910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:59:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.946+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== osd.8 v2:172.21.15.151:6816/4201522027 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f060801be50 con 0x7f05f80bc420 2024-05-09T00:59:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.962+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 --> [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f060c0642d0 con 0x7f05f80bc420 2024-05-09T00:59:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f06037fe700 1 -- 172.21.15.37:0/3770297705 <== osd.8 v2:172.21.15.151:6816/4201522027 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f060c0642d0 con 0x7f05f80bc420 2024-05-09T00:59:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] conn(0x7f05f80bc420 msgr2=0x7f05f80be910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] conn(0x7f05f80bc420 0x7f05f80be910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f05f80b2990 msgr2=0x7f05f80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f05f80b2990 0x7f05f80b4ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f060c106980 tx=0x7f05fc008040 comp rx=0 tx=0).stop 2024-05-09T00:59:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c1034c0 msgr2=0x7f060c19bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:59:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 --2- 172.21.15.37:0/3770297705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060c1034c0 0x7f060c19bd80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f060800b530 tx=0x7f060800b8f0 comp rx=0 tx=0).stop 2024-05-09T00:59:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f0612937700 1 -- 172.21.15.37:0/3770297705 reap_dead start 2024-05-09T00:59:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 shutdown_connections 2024-05-09T00:59:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 >> 172.21.15.37:0/3770297705 conn(0x7f060c0fedf0 msgr2=0x7f060c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:59:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 shutdown_connections 2024-05-09T00:59:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T00:59:56.963+0000 7f061439a700 1 -- 172.21.15.37:0/3770297705 wait complete. 2024-05-09T00:59:58.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 00:59:58 smithi037 ceph-mon[30122]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T00:59:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:180388626490 2024-05-09T00:59:58.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-09T00:59:58.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 00:59:58 smithi136 ceph-mon[34110]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T00:59:58.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 00:59:58 smithi151 ceph-mon[34780]: pgmap v330: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T00:59:58.804 INFO:teuthology.orchestra.run.smithi037.stdout:279172874276 2024-05-09T00:59:58.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-09T00:59:59.179 INFO:teuthology.orchestra.run.smithi037.stdout:231928234032 2024-05-09T00:59:59.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-09T01:00:00.123 INFO:teuthology.orchestra.run.smithi037.stdout:77309411404 2024-05-09T01:00:00.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-09T01:00:00.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:00 smithi037 ceph-mon[30122]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:00.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:00 smithi037 ceph-mon[30122]: overall HEALTH_OK 2024-05-09T01:00:00.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:00 smithi136 ceph-mon[34110]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:00.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:00 smithi136 ceph-mon[34110]: overall HEALTH_OK 2024-05-09T01:00:00.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 -- 172.21.15.37:0/2450627278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928109850 msgr2=0x7f89281111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 --2- 172.21.15.37:0/2450627278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928109850 0x7f89281111b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f892000b0d0 tx=0x7f892000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 -- 172.21.15.37:0/2450627278 shutdown_connections 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 --2- 172.21.15.37:0/2450627278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928109850 0x7f89281111b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 --2- 172.21.15.37:0/2450627278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89281045d0 0x7f89281049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 --2- 172.21.15.37:0/2450627278 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8928108f00 0x7f8928109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 -- 172.21.15.37:0/2450627278 >> 172.21.15.37:0/2450627278 conn(0x7f89280ffee0 msgr2=0x7f8928102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 -- 172.21.15.37:0/2450627278 shutdown_connections 2024-05-09T01:00:00.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 -- 172.21.15.37:0/2450627278 wait complete. 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.448+0000 7f892e869700 1 Processor -- start 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892e869700 1 -- start start 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892e869700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89281045d0 0x7f892819adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892e869700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928108f00 0x7f892819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892e869700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8928109850 0x7f892819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892e869700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8928114480 con 0x7f8928108f00 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892e869700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8928114300 con 0x7f89281045d0 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892e869700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8928114600 con 0x7f8928109850 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f89277fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928108f00 0x7f892819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f89277fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928108f00 0x7f892819b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39240/0 (socket says 172.21.15.37:39240) 2024-05-09T01:00:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f89277fe700 1 -- 172.21.15.37:0/964109538 learned_addr learned my addr 172.21.15.37:0/964109538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f892ce06700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8928109850 0x7f892819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.449+0000 7f8927fff700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89281045d0 0x7f892819adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89277fe700 1 -- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8928109850 msgr2=0x7f892819f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89277fe700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8928109850 0x7f892819f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89277fe700 1 -- 172.21.15.37:0/964109538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89281045d0 msgr2=0x7f892819adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89277fe700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f89281045d0 0x7f892819adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89277fe700 1 -- 172.21.15.37:0/964109538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892819fcc0 con 0x7f8928108f00 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89277fe700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928108f00 0x7f892819b390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f891000c8f0 tx=0x7f891000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100078d0 con 0x7f8928108f00 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f891000f450 con 0x7f8928108f00 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892819ffb0 con 0x7f8928108f00 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910018660 con 0x7f8928108f00 2024-05-09T01:00:00.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.450+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89281a78d0 con 0x7f8928108f00 2024-05-09T01:00:00.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.451+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8928063f50 con 0x7f8928108f00 2024-05-09T01:00:00.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.453+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f891000f900 con 0x7f8928108f00 2024-05-09T01:00:00.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.453+0000 7f89257fa700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89140b2990 0x7f89140b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.454+0000 7f8927fff700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89140b2990 0x7f89140b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.454+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f89100e2250 con 0x7f8928108f00 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.454+0000 7f89257fa700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] conn(0x7f89140bc420 0x7f89140be910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.454+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 --> [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8910015e70 con 0x7f89140bc420 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.454+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f89100e2730 con 0x7f8928108f00 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.454+0000 7f8927fff700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89140b2990 0x7f89140b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8918005950 tx=0x7f891800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.454+0000 7f892ce06700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] conn(0x7f89140bc420 0x7f89140be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.455+0000 7f892ce06700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] conn(0x7f89140bc420 0x7f89140be910 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:00.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.456+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== osd.5 v2:172.21.15.151:6808/1854577417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8910015e70 con 0x7f89140bc420 2024-05-09T01:00:00.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.472+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 --> [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8928064350 con 0x7f89140bc420 2024-05-09T01:00:00.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f89257fa700 1 -- 172.21.15.37:0/964109538 <== osd.5 v2:172.21.15.151:6808/1854577417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8928064350 con 0x7f89140bc420 2024-05-09T01:00:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] conn(0x7f89140bc420 msgr2=0x7f89140be910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] conn(0x7f89140bc420 0x7f89140be910 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89140b2990 msgr2=0x7f89140b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89140b2990 0x7f89140b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8918005950 tx=0x7f891800a300 comp rx=0 tx=0).stop 2024-05-09T01:00:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928108f00 msgr2=0x7f892819b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 --2- 172.21.15.37:0/964109538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8928108f00 0x7f892819b390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f891000c8f0 tx=0x7f891000cc00 comp rx=0 tx=0).stop 2024-05-09T01:00:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892ce06700 1 -- 172.21.15.37:0/964109538 reap_dead start 2024-05-09T01:00:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 shutdown_connections 2024-05-09T01:00:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 >> 172.21.15.37:0/964109538 conn(0x7f89280ffee0 msgr2=0x7f89281086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 shutdown_connections 2024-05-09T01:00:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.473+0000 7f892e869700 1 -- 172.21.15.37:0/964109538 wait complete. 2024-05-09T01:00:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:00 smithi151 ceph-mon[34780]: pgmap v331: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:00 smithi151 ceph-mon[34780]: overall HEALTH_OK 2024-05-09T01:00:00.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.653+0000 7fdde8da0700 1 -- 172.21.15.37:0/27297253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde41026c0 msgr2=0x7fdde4102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.653+0000 7fdde8da0700 1 --2- 172.21.15.37:0/27297253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde41026c0 0x7fdde4102ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009990 tx=0x7fddcc009ca0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 -- 172.21.15.37:0/27297253 shutdown_connections 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 --2- 172.21.15.37:0/27297253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdde4103010 0x7fdde4110fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 --2- 172.21.15.37:0/27297253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde4109120 0x7fdde4109530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 --2- 172.21.15.37:0/27297253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde41026c0 0x7fdde4102ad0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 -- 172.21.15.37:0/27297253 >> 172.21.15.37:0/27297253 conn(0x7fdde4078370 msgr2=0x7fdde40787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 -- 172.21.15.37:0/27297253 shutdown_connections 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 -- 172.21.15.37:0/27297253 wait complete. 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 Processor -- start 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.654+0000 7fdde8da0700 1 -- start start 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde8da0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdde41026c0 0x7fdde41038a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde8da0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde4103010 0x7fdde4103de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde8da0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde4109120 0x7fdde4104320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde8da0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdde4114430 con 0x7fdde4109120 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde8da0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41142b0 con 0x7fdde41026c0 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde8da0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41145b0 con 0x7fdde4103010 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde4109120 0x7fdde4104320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde4109120 0x7fdde4104320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39262/0 (socket says 172.21.15.37:39262) 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 -- 172.21.15.37:0/2345161914 learned_addr learned my addr 172.21.15.37:0/2345161914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde37fe700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdde41026c0 0x7fdde41038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdddbfff700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde4103010 0x7fdde4103de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 -- 172.21.15.37:0/2345161914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde4103010 msgr2=0x7fdde4103de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdde4103010 0x7fdde4103de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 -- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdde41026c0 msgr2=0x7fdde41038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdde41026c0 0x7fdde41038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde3fff700 1 -- 172.21.15.37:0/2345161914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde41a90a0 con 0x7fdde4109120 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.655+0000 7fdde37fe700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdde41026c0 0x7fdde41038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.656+0000 7fdde3fff700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde4109120 0x7fdde4104320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00ada0 tx=0x7fdddc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.656+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc017020 con 0x7fdde4109120 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.656+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde41a9390 con 0x7fdde4109120 2024-05-09T01:00:00.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.656+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdddc00ce30 con 0x7fdde4109120 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.656+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0054a0 con 0x7fdde4109120 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.656+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde41a98d0 con 0x7fdde4109120 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.657+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdde4063ed0 con 0x7fdde4109120 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.658+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fdddc00c980 con 0x7fdde4109120 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.659+0000 7fdde17fa700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fddd00b2910 0x7fddd00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.659+0000 7fdde37fe700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fddd00b2910 0x7fddd00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.659+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdddc0e24c0 con 0x7fdde4109120 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.659+0000 7fdde17fa700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] conn(0x7fddd00bc3a0 0x7fddd00be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.659+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 --> [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdddc022e50 con 0x7fddd00bc3a0 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.659+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdddc0e29a0 con 0x7fdde4109120 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.660+0000 7fdde37fe700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fddd00b2910 0x7fddd00b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fddd4005fd0 tx=0x7fddd4005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.660+0000 7fdddbfff700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] conn(0x7fddd00bc3a0 0x7fddd00be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.660+0000 7fdddbfff700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] conn(0x7fddd00bc3a0 0x7fddd00be890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.661+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== osd.7 v2:172.21.15.136:6816/3759016475 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdddc022e50 con 0x7fddd00bc3a0 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 --> [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdde40642d0 con 0x7fddd00bc3a0 2024-05-09T01:00:00.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde17fa700 1 -- 172.21.15.37:0/2345161914 <== osd.7 v2:172.21.15.136:6816/3759016475 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdde40642d0 con 0x7fddd00bc3a0 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] conn(0x7fddd00bc3a0 msgr2=0x7fddd00be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde8da0700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] conn(0x7fddd00bc3a0 0x7fddd00be890 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fddd00b2910 msgr2=0x7fddd00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde8da0700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fddd00b2910 0x7fddd00b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fddd4005fd0 tx=0x7fddd4005db0 comp rx=0 tx=0).stop 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde4109120 msgr2=0x7fdde4104320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde8da0700 1 --2- 172.21.15.37:0/2345161914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde4109120 0x7fdde4104320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00ada0 tx=0x7fdddc00c330 comp rx=0 tx=0).stop 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.678+0000 7fdde3fff700 1 -- 172.21.15.37:0/2345161914 reap_dead start 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.679+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 shutdown_connections 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.679+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 >> 172.21.15.37:0/2345161914 conn(0x7fdde4078370 msgr2=0x7fdde40ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.679+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 shutdown_connections 2024-05-09T01:00:00.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:00.679+0000 7fdde8da0700 1 -- 172.21.15.37:0/2345161914 wait complete. 2024-05-09T01:00:01.555 INFO:teuthology.orchestra.run.smithi037.stdout:201863462965 2024-05-09T01:00:01.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-09T01:00:02.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:02 smithi136 ceph-mon[34110]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:02.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:02 smithi037 ceph-mon[30122]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:02.411 INFO:teuthology.orchestra.run.smithi037.stdout:154618822718 2024-05-09T01:00:02.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-09T01:00:02.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:02 smithi151 ceph-mon[34780]: pgmap v332: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:01.999+0000 7ff9b46c4700 1 -- 172.21.15.37:0/390652810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac108740 msgr2=0x7ff9ac1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:01.999+0000 7ff9b46c4700 1 --2- 172.21.15.37:0/390652810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac108740 0x7ff9ac1100a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400b0d0 tx=0x7ff9a400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 -- 172.21.15.37:0/390652810 shutdown_connections 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 --2- 172.21.15.37:0/390652810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac108740 0x7ff9ac1100a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 --2- 172.21.15.37:0/390652810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ac1034c0 0x7ff9ac1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 --2- 172.21.15.37:0/390652810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9ac107df0 0x7ff9ac108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 -- 172.21.15.37:0/390652810 >> 172.21.15.37:0/390652810 conn(0x7ff9ac0fedc0 msgr2=0x7ff9ac1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 -- 172.21.15.37:0/390652810 shutdown_connections 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 -- 172.21.15.37:0/390652810 wait complete. 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 Processor -- start 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.000+0000 7ff9b46c4700 1 -- start start 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b46c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac1034c0 0x7ff9ac19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b46c4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ac107df0 0x7ff9ac19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b46c4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9ac108740 0x7ff9ac19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b46c4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac113460 con 0x7ff9ac1034c0 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b46c4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac1132e0 con 0x7ff9ac107df0 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b46c4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac1135e0 con 0x7ff9ac108740 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac1034c0 0x7ff9ac19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac1034c0 0x7ff9ac19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39132/0 (socket says 172.21.15.37:39132) 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 -- 172.21.15.37:0/3839637602 learned_addr learned my addr 172.21.15.37:0/3839637602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2c61700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9ac108740 0x7ff9ac19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b1c5f700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ac107df0 0x7ff9ac19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 -- 172.21.15.37:0/3839637602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9ac108740 msgr2=0x7ff9ac19c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9ac108740 0x7ff9ac19c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 -- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ac107df0 msgr2=0x7ff9ac19c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9ac107df0 0x7ff9ac19c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 -- 172.21.15.37:0/3839637602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac1a70b0 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2c61700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9ac108740 0x7ff9ac19c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9b2460700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac1034c0 0x7ff9ac19bd60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800b530 tx=0x7ff9a800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.001+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8015020 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.002+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9a8011ce0 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.002+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac1a73a0 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.002+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8010d20 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.002+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac1a7930 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.002+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9ac063ed0 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.004+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff9a8018020 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.005+0000 7ff9a37fe700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9980b2990 0x7ff9980b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.005+0000 7ff9b1c5f700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9980b2990 0x7ff9980b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.005+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff9a80e2090 con 0x7ff9ac1034c0 2024-05-09T01:00:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.005+0000 7ff9a37fe700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] conn(0x7ff9980bc420 0x7ff9980be910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.005+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 --> [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9a801be50 con 0x7ff9980bc420 2024-05-09T01:00:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.005+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff9a80e2570 con 0x7ff9ac1034c0 2024-05-09T01:00:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.006+0000 7ff9b1c5f700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9980b2990 0x7ff9980b4ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff99c006fd0 tx=0x7ff99c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.006+0000 7ff9b2c61700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] conn(0x7ff9980bc420 0x7ff9980be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.006+0000 7ff9b2c61700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] conn(0x7ff9980bc420 0x7ff9980be910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.007+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== osd.1 v2:172.21.15.136:6800/368492738 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9a801be50 con 0x7ff9980bc420 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.024+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 --> [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff9ac0642d0 con 0x7ff9980bc420 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.024+0000 7ff9a37fe700 1 -- 172.21.15.37:0/3839637602 <== osd.1 v2:172.21.15.136:6800/368492738 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff9ac0642d0 con 0x7ff9980bc420 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] conn(0x7ff9980bc420 msgr2=0x7ff9980be910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] conn(0x7ff9980bc420 0x7ff9980be910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9980b2990 msgr2=0x7ff9980b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9980b2990 0x7ff9980b4ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff99c006fd0 tx=0x7ff99c008040 comp rx=0 tx=0).stop 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac1034c0 msgr2=0x7ff9ac19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 --2- 172.21.15.37:0/3839637602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ac1034c0 0x7ff9ac19bd60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800b530 tx=0x7ff9a800b8f0 comp rx=0 tx=0).stop 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b2c61700 1 -- 172.21.15.37:0/3839637602 reap_dead start 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 shutdown_connections 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 >> 172.21.15.37:0/3839637602 conn(0x7ff9ac0fedc0 msgr2=0x7ff9ac1096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 shutdown_connections 2024-05-09T01:00:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:02.025+0000 7ff9b46c4700 1 -- 172.21.15.37:0/3839637602 wait complete. 2024-05-09T01:00:03.125 INFO:teuthology.orchestra.run.smithi037.stdout:55834574932 2024-05-09T01:00:03.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 -- 172.21.15.37:0/3635608741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 msgr2=0x7f250410e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 --2- 172.21.15.37:0/3635608741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 0x7f250410e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009990 tx=0x7f24f8009ca0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 -- 172.21.15.37:0/3635608741 shutdown_connections 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 --2- 172.21.15.37:0/3635608741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f250410e8f0 0x7f2504110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 --2- 172.21.15.37:0/3635608741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2504105480 0x7f2504105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 --2- 172.21.15.37:0/3635608741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 0x7f250410e320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 -- 172.21.15.37:0/3635608741 >> 172.21.15.37:0/3635608741 conn(0x7f25040fef30 msgr2=0x7f2504101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 -- 172.21.15.37:0/3635608741 shutdown_connections 2024-05-09T01:00:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.358+0000 7f2508bc0700 1 -- 172.21.15.37:0/3635608741 wait complete. 2024-05-09T01:00:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 Processor -- start 2024-05-09T01:00:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 -- start start 2024-05-09T01:00:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2504105480 0x7f2504103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 0x7f25041036b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f250410e8f0 0x7f2504103bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2504114450 con 0x7f2504105dd0 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f25041142d0 con 0x7f2504105480 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2508bc0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f25041145d0 con 0x7f250410e8f0 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2501d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 0x7f25041036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2501d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 0x7f25041036b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39154/0 (socket says 172.21.15.37:39154) 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2501d9b700 1 -- 172.21.15.37:0/3879913605 learned_addr learned my addr 172.21.15.37:0/3879913605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.359+0000 7f2502d9d700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f250410e8f0 0x7f2504103bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f250259c700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2504105480 0x7f2504103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2501d9b700 1 -- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f250410e8f0 msgr2=0x7f2504103bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2501d9b700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f250410e8f0 0x7f2504103bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2501d9b700 1 -- 172.21.15.37:0/3879913605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2504105480 msgr2=0x7f2504103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2501d9b700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2504105480 0x7f2504103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2501d9b700 1 -- 172.21.15.37:0/3879913605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25041a91c0 con 0x7f2504105dd0 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2501d9b700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 0x7f25041036b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f24f8000c00 tx=0x7f24f80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8027070 con 0x7f2504105dd0 2024-05-09T01:00:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25041a9450 con 0x7f2504105dd0 2024-05-09T01:00:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24f8003f20 con 0x7f2504105dd0 2024-05-09T01:00:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25041a9900 con 0x7f2504105dd0 2024-05-09T01:00:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.360+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f8022ca0 con 0x7f2504105dd0 2024-05-09T01:00:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.361+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2504063ed0 con 0x7f2504105dd0 2024-05-09T01:00:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.363+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f24f802a070 con 0x7f2504105dd0 2024-05-09T01:00:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.364+0000 7f24f37fe700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f24ec0b2910 0x7f24ec0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.364+0000 7f250259c700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f24ec0b2910 0x7f24ec0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:03.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.364+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f24f80e3b20 con 0x7f2504105dd0 2024-05-09T01:00:03.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.364+0000 7f24f37fe700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] conn(0x7f24ec0bc3a0 0x7f24ec0be890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:03.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.364+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 --> [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24f80095d0 con 0x7f24ec0bc3a0 2024-05-09T01:00:03.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.364+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f24f80e3ed0 con 0x7f2504105dd0 2024-05-09T01:00:03.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.364+0000 7f250259c700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f24ec0b2910 0x7f24ec0b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005950 tx=0x7f24f400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:03.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.365+0000 7f2502d9d700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] conn(0x7f24ec0bc3a0 0x7f24ec0be890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:03.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.365+0000 7f2502d9d700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] conn(0x7f24ec0bc3a0 0x7f24ec0be890 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:03.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.366+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== osd.11 v2:172.21.15.151:6824/443816849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f24f80095d0 con 0x7f24ec0bc3a0 2024-05-09T01:00:03.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.383+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 --> [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25040642d0 con 0x7f24ec0bc3a0 2024-05-09T01:00:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f24f37fe700 1 -- 172.21.15.37:0/3879913605 <== osd.11 v2:172.21.15.151:6824/443816849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f25040642d0 con 0x7f24ec0bc3a0 2024-05-09T01:00:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] conn(0x7f24ec0bc3a0 msgr2=0x7f24ec0be890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] conn(0x7f24ec0bc3a0 0x7f24ec0be890 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f24ec0b2910 msgr2=0x7f24ec0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f24ec0b2910 0x7f24ec0b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24f4005950 tx=0x7f24f400a300 comp rx=0 tx=0).stop 2024-05-09T01:00:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 msgr2=0x7f25041036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 --2- 172.21.15.37:0/3879913605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504105dd0 0x7f25041036b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f24f8000c00 tx=0x7f24f80047b0 comp rx=0 tx=0).stop 2024-05-09T01:00:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2502d9d700 1 -- 172.21.15.37:0/3879913605 reap_dead start 2024-05-09T01:00:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 shutdown_connections 2024-05-09T01:00:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.384+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 >> 172.21.15.37:0/3879913605 conn(0x7f25040fef30 msgr2=0x7f25040ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.385+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 shutdown_connections 2024-05-09T01:00:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:03.385+0000 7f2508bc0700 1 -- 172.21.15.37:0/3879913605 wait complete. 2024-05-09T01:00:04.171 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:04.207 INFO:teuthology.orchestra.run.smithi037.stdout:304942678051 2024-05-09T01:00:04.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-09T01:00:04.341 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:04 smithi037 ceph-mon[30122]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:04.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:04 smithi136 ceph-mon[34110]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:04.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:04 smithi151 ceph-mon[34780]: pgmap v333: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:06.313 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:06 smithi037 ceph-mon[30122]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-09T01:00:06.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:06 smithi136 ceph-mon[34110]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-09T01:00:06.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:06 smithi151 ceph-mon[34780]: pgmap v334: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-09T01:00:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.472+0000 7fe2b7aed700 1 -- 172.21.15.37:0/758904288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 msgr2=0x7fe2b01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.472+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/758904288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b01100a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800b0d0 tx=0x7fe2a800b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.472+0000 7fe2b7aed700 1 -- 172.21.15.37:0/758904288 shutdown_connections 2024-05-09T01:00:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.472+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/758904288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b01100a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.472+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/758904288 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b01034c0 0x7fe2b01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.472+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/758904288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b0107df0 0x7fe2b0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.472+0000 7fe2b7aed700 1 -- 172.21.15.37:0/758904288 >> 172.21.15.37:0/758904288 conn(0x7fe2b00fedc0 msgr2=0x7fe2b01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.473+0000 7fe2b7aed700 1 -- 172.21.15.37:0/758904288 shutdown_connections 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.473+0000 7fe2b7aed700 1 -- 172.21.15.37:0/758904288 wait complete. 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.473+0000 7fe2b7aed700 1 Processor -- start 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.473+0000 7fe2b7aed700 1 -- start start 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b7aed700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b01034c0 0x7fe2b019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b7aed700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b0107df0 0x7fe2b019ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b7aed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b0199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b7aed700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b01133f0 con 0x7fe2b0108740 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b7aed700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b0113270 con 0x7fe2b01034c0 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b7aed700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b0113570 con 0x7fe2b0107df0 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b0199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b0199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39172/0 (socket says 172.21.15.37:39172) 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 -- 172.21.15.37:0/582839260 learned_addr learned my addr 172.21.15.37:0/582839260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b5889700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b01034c0 0x7fe2b019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b5088700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b0107df0 0x7fe2b019ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 -- 172.21.15.37:0/582839260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b0107df0 msgr2=0x7fe2b019ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b0107df0 0x7fe2b019ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 -- 172.21.15.37:0/582839260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b01034c0 msgr2=0x7fe2b019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b01034c0 0x7fe2b019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 -- 172.21.15.37:0/582839260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b019a280 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b5088700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b0107df0 0x7fe2b019ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b5889700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b01034c0 0x7fe2b019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b608a700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b0199b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80095c0 tx=0x7fe2a8007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2a6ffd700 1 -- 172.21.15.37:0/582839260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a801f070 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2a6ffd700 1 -- 172.21.15.37:0/582839260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2a8003c00 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b019a510 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.474+0000 7fe2a6ffd700 1 -- 172.21.15.37:0/582839260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a801b6a0 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.475+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b01a6770 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.476+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b019a9f0 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.477+0000 7fe2a6ffd700 1 -- 172.21.15.37:0/582839260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe2a8022070 con 0x7fe2b0108740 2024-05-09T01:00:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.478+0000 7fe2a6ffd700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe29c0b2910 0x7fe29c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.478+0000 7fe2b5889700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe29c0b2910 0x7fe29c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.478+0000 7fe2a6ffd700 1 -- 172.21.15.37:0/582839260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe2a800f020 con 0x7fe2b0108740 2024-05-09T01:00:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.479+0000 7fe2b5889700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe29c0b2910 0x7fe29c0b4e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac007900 tx=0x7fe2ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.481+0000 7fe2a6ffd700 1 -- 172.21.15.37:0/582839260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2a8029020 con 0x7fe2b0108740 2024-05-09T01:00:06.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.701+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe2b00512c0 con 0x7fe2b0108740 2024-05-09T01:00:06.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.701+0000 7fe2a6ffd700 1 -- 172.21.15.37:0/582839260 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe2a80ab7b0 con 0x7fe2b0108740 2024-05-09T01:00:06.701 INFO:teuthology.orchestra.run.smithi037.stdout:34359738457 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe29c0b2910 msgr2=0x7fe29c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe29c0b2910 0x7fe29c0b4e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac007900 tx=0x7fe2ac008040 comp rx=0 tx=0).stop 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 msgr2=0x7fe2b0199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b0199b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80095c0 tx=0x7fe2a8007ad0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 shutdown_connections 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe29c0b2910 0x7fe29c0b4e20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b0108740 0x7fe2b0199b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2b01034c0 0x7fe2b019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 --2- 172.21.15.37:0/582839260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b0107df0 0x7fe2b019ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 >> 172.21.15.37:0/582839260 conn(0x7fe2b00fedc0 msgr2=0x7fe2b0107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 shutdown_connections 2024-05-09T01:00:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:06.704+0000 7fe2b7aed700 1 -- 172.21.15.37:0/582839260 wait complete. 2024-05-09T01:00:07.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:07 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/582839260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T01:00:07.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:07 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/582839260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T01:00:07.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:07 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/582839260' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T01:00:07.617 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738454 got 34359738457 for osd.0 2024-05-09T01:00:07.617 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:08.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:08 smithi037 ceph-mon[30122]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-05-09T01:00:08.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:08 smithi136 ceph-mon[34110]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-05-09T01:00:08.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:08 smithi151 ceph-mon[34780]: pgmap v335: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-05-09T01:00:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:09.084 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:09.085 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:09.088 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:09.088 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:09.089 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:10.145 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:10 smithi037 ceph-mon[30122]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:10 smithi136 ceph-mon[34110]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:10.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:10 smithi151 ceph-mon[34780]: pgmap v336: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.330+0000 7fc42e499700 1 -- 172.21.15.37:0/2557015670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428107df0 msgr2=0x7fc428108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.330+0000 7fc42e499700 1 --2- 172.21.15.37:0/2557015670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428107df0 0x7fc428108200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc4100099c0 tx=0x7fc410009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 -- 172.21.15.37:0/2557015670 shutdown_connections 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 --2- 172.21.15.37:0/2557015670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc428108740 0x7fc4281100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 --2- 172.21.15.37:0/2557015670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4281034c0 0x7fc4281038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 --2- 172.21.15.37:0/2557015670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428107df0 0x7fc428108200 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 -- 172.21.15.37:0/2557015670 >> 172.21.15.37:0/2557015670 conn(0x7fc4280fedf0 msgr2=0x7fc428101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 -- 172.21.15.37:0/2557015670 shutdown_connections 2024-05-09T01:00:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 -- 172.21.15.37:0/2557015670 wait complete. 2024-05-09T01:00:11.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 Processor -- start 2024-05-09T01:00:11.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.331+0000 7fc42e499700 1 -- start start 2024-05-09T01:00:11.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42e499700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4281034c0 0x7fc42819ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:11.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42e499700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc428107df0 0x7fc42819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:11.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42e499700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428108740 0x7fc42819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:11.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42e499700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4281133c0 con 0x7fc428108740 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42e499700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc428113240 con 0x7fc428107df0 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42e499700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc428113540 con 0x7fc4281034c0 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428108740 0x7fc42819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428108740 0x7fc42819f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39180/0 (socket says 172.21.15.37:39180) 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 -- 172.21.15.37:0/1991201037 learned_addr learned my addr 172.21.15.37:0/1991201037 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc41ffff700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc428107df0 0x7fc42819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc427fff700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4281034c0 0x7fc42819ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 -- 172.21.15.37:0/1991201037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4281034c0 msgr2=0x7fc42819ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4281034c0 0x7fc42819ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 -- 172.21.15.37:0/1991201037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc428107df0 msgr2=0x7fc42819b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc428107df0 0x7fc42819b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 -- 172.21.15.37:0/1991201037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42819fd50 con 0x7fc428108740 2024-05-09T01:00:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.332+0000 7fc42ca36700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428108740 0x7fc42819f6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc42000b970 tx=0x7fc42000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.333+0000 7fc425ffb700 1 -- 172.21.15.37:0/1991201037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420019070 con 0x7fc428108740 2024-05-09T01:00:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.333+0000 7fc425ffb700 1 -- 172.21.15.37:0/1991201037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc42000cde0 con 0x7fc428108740 2024-05-09T01:00:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.333+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4281a0040 con 0x7fc428108740 2024-05-09T01:00:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.333+0000 7fc425ffb700 1 -- 172.21.15.37:0/1991201037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420007370 con 0x7fc428108740 2024-05-09T01:00:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.333+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4281a7960 con 0x7fc428108740 2024-05-09T01:00:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.334+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc428104970 con 0x7fc428108740 2024-05-09T01:00:11.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.335+0000 7fc425ffb700 1 -- 172.21.15.37:0/1991201037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc42001c070 con 0x7fc428108740 2024-05-09T01:00:11.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.336+0000 7fc425ffb700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc4140b2910 0x7fc4140b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:11.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.336+0000 7fc427fff700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc4140b2910 0x7fc4140b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:11.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.336+0000 7fc425ffb700 1 -- 172.21.15.37:0/1991201037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc4200e1df0 con 0x7fc428108740 2024-05-09T01:00:11.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.337+0000 7fc427fff700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc4140b2910 0x7fc4140b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc418005fd0 tx=0x7fc41800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:11.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.340+0000 7fc425ffb700 1 -- 172.21.15.37:0/1991201037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc420023070 con 0x7fc428108740 2024-05-09T01:00:11.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.555+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc42802e5f0 con 0x7fc428108740 2024-05-09T01:00:11.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.556+0000 7fc425ffb700 1 -- 172.21.15.37:0/1991201037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc4200a9bc0 con 0x7fc428108740 2024-05-09T01:00:11.557 INFO:teuthology.orchestra.run.smithi037.stdout:201863462967 2024-05-09T01:00:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc4140b2910 msgr2=0x7fc4140b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc4140b2910 0x7fc4140b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc418005fd0 tx=0x7fc41800a560 comp rx=0 tx=0).stop 2024-05-09T01:00:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428108740 msgr2=0x7fc42819f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428108740 0x7fc42819f6b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc42000b970 tx=0x7fc42000bc80 comp rx=0 tx=0).stop 2024-05-09T01:00:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 shutdown_connections 2024-05-09T01:00:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc4140b2910 0x7fc4140b4e20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc428108740 0x7fc42819f6b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4281034c0 0x7fc42819ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 --2- 172.21.15.37:0/1991201037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc428107df0 0x7fc42819b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 >> 172.21.15.37:0/1991201037 conn(0x7fc4280fedf0 msgr2=0x7fc428075d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 shutdown_connections 2024-05-09T01:00:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:11.558+0000 7fc42e499700 1 -- 172.21.15.37:0/1991201037 wait complete. 2024-05-09T01:00:12.129 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:12 smithi037 ceph-mon[30122]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:12.129 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:12 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1991201037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T01:00:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:12 smithi136 ceph-mon[34110]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:12 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1991201037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T01:00:12.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:12 smithi151 ceph-mon[34780]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:12 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1991201037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T01:00:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.674+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1664370898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 msgr2=0x7fd2d0108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.674+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1664370898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d0108200 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80099c0 tx=0x7fd2b8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.675+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1664370898 shutdown_connections 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.675+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1664370898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2d0108740 0x7fd2d01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.675+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1664370898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d01034c0 0x7fd2d01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.675+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1664370898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d0108200 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.675+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1664370898 >> 172.21.15.37:0/1664370898 conn(0x7fd2d00fedc0 msgr2=0x7fd2d01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.675+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1664370898 shutdown_connections 2024-05-09T01:00:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.675+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1664370898 wait complete. 2024-05-09T01:00:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 Processor -- start 2024-05-09T01:00:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 -- start start 2024-05-09T01:00:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2d01034c0 0x7fd2d019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0108740 0x7fd2d019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d01144c0 con 0x7fd2d0107df0 2024-05-09T01:00:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0114340 con 0x7fd2d01034c0 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d6d2f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0114640 con 0x7fd2d0108740 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d019b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42486/0 (socket says 172.21.15.37:42486) 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2cffff700 1 -- 172.21.15.37:0/1928289904 learned_addr learned my addr 172.21.15.37:0/1928289904 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d4acb700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2d01034c0 0x7fd2d019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.676+0000 7fd2d52cc700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0108740 0x7fd2d019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cffff700 1 -- 172.21.15.37:0/1928289904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0108740 msgr2=0x7fd2d019f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cffff700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0108740 0x7fd2d019f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cffff700 1 -- 172.21.15.37:0/1928289904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2d01034c0 msgr2=0x7fd2d019ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cffff700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2d01034c0 0x7fd2d019ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cffff700 1 -- 172.21.15.37:0/1928289904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d019fd00 con 0x7fd2d0107df0 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2d52cc700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0108740 0x7fd2d019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cffff700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d019b3d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006010 tx=0x7fd2b80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cdffb700 1 -- 172.21.15.37:0/1928289904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8027070 con 0x7fd2d0107df0 2024-05-09T01:00:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d019ff90 con 0x7fd2d0107df0 2024-05-09T01:00:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cdffb700 1 -- 172.21.15.37:0/1928289904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b8003f20 con 0x7fd2d0107df0 2024-05-09T01:00:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2cdffb700 1 -- 172.21.15.37:0/1928289904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8022cd0 con 0x7fd2d0107df0 2024-05-09T01:00:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.677+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d01a0470 con 0x7fd2d0107df0 2024-05-09T01:00:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.679+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d00512c0 con 0x7fd2d0107df0 2024-05-09T01:00:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.680+0000 7fd2cdffb700 1 -- 172.21.15.37:0/1928289904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd2b802a070 con 0x7fd2d0107df0 2024-05-09T01:00:12.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.681+0000 7fd2cdffb700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2bc0b2910 0x7fd2bc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:12.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.681+0000 7fd2d4acb700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2bc0b2910 0x7fd2bc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.681+0000 7fd2cdffb700 1 -- 172.21.15.37:0/1928289904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd2b80e3260 con 0x7fd2d0107df0 2024-05-09T01:00:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.681+0000 7fd2d4acb700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2bc0b2910 0x7fd2bc0b4e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009550 tx=0x7fd2c00091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.686+0000 7fd2cdffb700 1 -- 172.21.15.37:0/1928289904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2b8013070 con 0x7fd2d0107df0 2024-05-09T01:00:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.903+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd2d002e5f0 con 0x7fd2d0107df0 2024-05-09T01:00:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.904+0000 7fd2cdffb700 1 -- 172.21.15.37:0/1928289904 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd2b80aaeb0 con 0x7fd2d0107df0 2024-05-09T01:00:12.905 INFO:teuthology.orchestra.run.smithi037.stdout:107374182474 2024-05-09T01:00:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2bc0b2910 msgr2=0x7fd2bc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2bc0b2910 0x7fd2bc0b4e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009550 tx=0x7fd2c00091b0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 msgr2=0x7fd2d019b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d019b3d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006010 tx=0x7fd2b80047b0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 shutdown_connections 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2bc0b2910 0x7fd2bc0b4e20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0108740 0x7fd2d019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2d01034c0 0x7fd2d019ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 --2- 172.21.15.37:0/1928289904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2d0107df0 0x7fd2d019b3d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 >> 172.21.15.37:0/1928289904 conn(0x7fd2d00fedc0 msgr2=0x7fd2d0101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 shutdown_connections 2024-05-09T01:00:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:12.906+0000 7fd2d6d2f700 1 -- 172.21.15.37:0/1928289904 wait complete. 2024-05-09T01:00:13.170 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:13 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1928289904' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T01:00:13.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:13 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1928289904' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T01:00:13.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:13 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1928289904' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T01:00:14.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:14 smithi037 ceph-mon[30122]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-09T01:00:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:14 smithi136 ceph-mon[34110]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-09T01:00:14.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:14 smithi151 ceph-mon[34780]: pgmap v338: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/779752004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98108f00 msgr2=0x7f9b98109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/779752004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98108f00 0x7f9b98109310 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9b880099c0 tx=0x7f9b88009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/779752004 shutdown_connections 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/779752004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b98109850 0x7f9b981111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/779752004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b981045d0 0x7f9b981049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/779752004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98108f00 0x7f9b98109310 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/779752004 >> 172.21.15.37:0/779752004 conn(0x7f9b980ffea0 msgr2=0x7f9b981022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/779752004 shutdown_connections 2024-05-09T01:00:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.800+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/779752004 wait complete. 2024-05-09T01:00:15.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 Processor -- start 2024-05-09T01:00:15.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 -- start start 2024-05-09T01:00:15.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b981045d0 0x7f9b9819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:15.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b98108f00 0x7f9b9819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:15.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98109850 0x7f9b9819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98114480 con 0x7f9b98109850 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98114300 con 0x7f9b98108f00 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9f8fa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98114600 con 0x7f9b981045d0 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.801+0000 7f9b9de97700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98109850 0x7f9b9819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98109850 0x7f9b9819f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42514/0 (socket says 172.21.15.37:42514) 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 -- 172.21.15.37:0/889476859 learned_addr learned my addr 172.21.15.37:0/889476859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9d696700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b981045d0 0x7f9b9819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9ce95700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b98108f00 0x7f9b9819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 -- 172.21.15.37:0/889476859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b981045d0 msgr2=0x7f9b9819ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b981045d0 0x7f9b9819ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 -- 172.21.15.37:0/889476859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b98108f00 msgr2=0x7f9b9819b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b98108f00 0x7f9b9819b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 -- 172.21.15.37:0/889476859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9819fd60 con 0x7f9b98109850 2024-05-09T01:00:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9de97700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98109850 0x7f9b9819f6c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9b90007ee0 tx=0x7f9b9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b8e7fc700 1 -- 172.21.15.37:0/889476859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000dd20 con 0x7f9b98109850 2024-05-09T01:00:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b8e7fc700 1 -- 172.21.15.37:0/889476859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b90004020 con 0x7f9b98109850 2024-05-09T01:00:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b8e7fc700 1 -- 172.21.15.37:0/889476859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90015660 con 0x7f9b98109850 2024-05-09T01:00:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b981a0050 con 0x7f9b98109850 2024-05-09T01:00:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.802+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b981a7970 con 0x7f9b98109850 2024-05-09T01:00:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.803+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b98105a80 con 0x7f9b98109850 2024-05-09T01:00:15.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.806+0000 7f9b8e7fc700 1 -- 172.21.15.37:0/889476859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9b900041d0 con 0x7f9b98109850 2024-05-09T01:00:15.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.807+0000 7f9b8e7fc700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b840b2910 0x7f9b840b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:15.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.807+0000 7f9b9d696700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b840b2910 0x7f9b840b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:15.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.807+0000 7f9b8e7fc700 1 -- 172.21.15.37:0/889476859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9b900e24e0 con 0x7f9b98109850 2024-05-09T01:00:15.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.807+0000 7f9b9d696700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b840b2910 0x7f9b840b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009c60 tx=0x7f9b94009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:15.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:15.810+0000 7f9b8e7fc700 1 -- 172.21.15.37:0/889476859 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b90010070 con 0x7f9b98109850 2024-05-09T01:00:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.034+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9b9802e5f0 con 0x7f9b98109850 2024-05-09T01:00:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.035+0000 7f9b8e7fc700 1 -- 172.21.15.37:0/889476859 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9b900aa0a0 con 0x7f9b98109850 2024-05-09T01:00:16.036 INFO:teuthology.orchestra.run.smithi037.stdout:154618822721 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b840b2910 msgr2=0x7f9b840b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b840b2910 0x7f9b840b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009c60 tx=0x7f9b94009260 comp rx=0 tx=0).stop 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98109850 msgr2=0x7f9b9819f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98109850 0x7f9b9819f6c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9b90007ee0 tx=0x7f9b9000d3b0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 shutdown_connections 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b840b2910 0x7f9b840b4e20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b98109850 0x7f9b9819f6c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b981045d0 0x7f9b9819ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 --2- 172.21.15.37:0/889476859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b98108f00 0x7f9b9819b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 >> 172.21.15.37:0/889476859 conn(0x7f9b980ffea0 msgr2=0x7f9b981022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:16.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 shutdown_connections 2024-05-09T01:00:16.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.037+0000 7f9b9f8fa700 1 -- 172.21.15.37:0/889476859 wait complete. 2024-05-09T01:00:16.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:16 smithi037 ceph-mon[30122]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:16.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:16 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/889476859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T01:00:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:16 smithi136 ceph-mon[34110]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:16 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/889476859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T01:00:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:16 smithi151 ceph-mon[34780]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:16 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/889476859' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T01:00:16.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 -- 172.21.15.37:0/173650680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888109870 msgr2=0x7f08881111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:16.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 --2- 172.21.15.37:0/173650680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888109870 0x7f08881111d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f08800099c0 tx=0x7f0880009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 -- 172.21.15.37:0/173650680 shutdown_connections 2024-05-09T01:00:16.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 --2- 172.21.15.37:0/173650680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888109870 0x7f08881111d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 --2- 172.21.15.37:0/173650680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08881045f0 0x7f0888104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 --2- 172.21.15.37:0/173650680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0888108f20 0x7f0888109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 -- 172.21.15.37:0/173650680 >> 172.21.15.37:0/173650680 conn(0x7f0888100040 msgr2=0x7f0888102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 -- 172.21.15.37:0/173650680 shutdown_connections 2024-05-09T01:00:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.920+0000 7f088f0ac700 1 -- 172.21.15.37:0/173650680 wait complete. 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 Processor -- start 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 -- start start 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08881045f0 0x7f088819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888108f20 0x7f088819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0888109870 0x7f088819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08881144a0 con 0x7f0888108f20 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0888114320 con 0x7f08881045f0 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f088f0ac700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0888114620 con 0x7f0888109870 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.921+0000 7f0887fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888108f20 0x7f088819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888108f20 0x7f088819b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42538/0 (socket says 172.21.15.37:42538) 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 -- 172.21.15.37:0/547997655 learned_addr learned my addr 172.21.15.37:0/547997655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f088ce48700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08881045f0 0x7f088819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f088d649700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0888109870 0x7f088819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 -- 172.21.15.37:0/547997655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0888109870 msgr2=0x7f088819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0888109870 0x7f088819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 -- 172.21.15.37:0/547997655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08881045f0 msgr2=0x7f088819ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08881045f0 0x7f088819ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 -- 172.21.15.37:0/547997655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088819fc30 con 0x7f0888108f20 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f088d649700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0888109870 0x7f088819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0887fff700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888108f20 0x7f088819b3b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f087000c9e0 tx=0x7f087000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0885ffb700 1 -- 172.21.15.37:0/547997655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870007aa0 con 0x7f0888108f20 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0885ffb700 1 -- 172.21.15.37:0/547997655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0870007c40 con 0x7f0888108f20 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088819ff20 con 0x7f0888108f20 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.922+0000 7f0885ffb700 1 -- 172.21.15.37:0/547997655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870018660 con 0x7f0888108f20 2024-05-09T01:00:16.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.923+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08881a0460 con 0x7f0888108f20 2024-05-09T01:00:16.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.924+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08880512c0 con 0x7f0888108f20 2024-05-09T01:00:16.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.925+0000 7f0885ffb700 1 -- 172.21.15.37:0/547997655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0870018800 con 0x7f0888108f20 2024-05-09T01:00:16.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.926+0000 7f0885ffb700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f08740b2910 0x7f08740b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:16.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.926+0000 7f088ce48700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f08740b2910 0x7f08740b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:16.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.926+0000 7f0885ffb700 1 -- 172.21.15.37:0/547997655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f08700e22e0 con 0x7f0888108f20 2024-05-09T01:00:16.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.927+0000 7f088ce48700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f08740b2910 0x7f08740b4e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0878009550 tx=0x7f08780091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:16.931+0000 7f0885ffb700 1 -- 172.21.15.37:0/547997655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0870014030 con 0x7f0888108f20 2024-05-09T01:00:17.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.151+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f088819c170 con 0x7f0888108f20 2024-05-09T01:00:17.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.152+0000 7f0885ffb700 1 -- 172.21.15.37:0/547997655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f08700a9ea0 con 0x7f0888108f20 2024-05-09T01:00:17.153 INFO:teuthology.orchestra.run.smithi037.stdout:231928234036 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f08740b2910 msgr2=0x7f08740b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f08740b2910 0x7f08740b4e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0878009550 tx=0x7f08780091b0 comp rx=0 tx=0).stop 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888108f20 msgr2=0x7f088819b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888108f20 0x7f088819b3b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f087000c9e0 tx=0x7f087000ccf0 comp rx=0 tx=0).stop 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 shutdown_connections 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f08740b2910 0x7f08740b4e20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0888109870 0x7f088819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08881045f0 0x7f088819ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 --2- 172.21.15.37:0/547997655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888108f20 0x7f088819b3b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 >> 172.21.15.37:0/547997655 conn(0x7f0888100040 msgr2=0x7f0888108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 shutdown_connections 2024-05-09T01:00:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:17.155+0000 7f088f0ac700 1 -- 172.21.15.37:0/547997655 wait complete. 2024-05-09T01:00:17.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822718 got 154618822721 for osd.5 2024-05-09T01:00:17.413 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:18.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.157+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2912558113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 msgr2=0x7fdbc4104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.157+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2912558113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc4104a00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00099c0 tx=0x7fdbc0009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.157+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2912558113 shutdown_connections 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.157+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2912558113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc4109870 0x7fdbc41111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.157+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2912558113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc4104a00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.157+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2912558113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbc4108f20 0x7fdbc4109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.157+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2912558113 >> 172.21.15.37:0/2912558113 conn(0x7fdbc4100040 msgr2=0x7fdbc4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.158+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2912558113 shutdown_connections 2024-05-09T01:00:18.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.158+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2912558113 wait complete. 2024-05-09T01:00:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.158+0000 7fdbcb65f700 1 Processor -- start 2024-05-09T01:00:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.158+0000 7fdbcb65f700 1 -- start start 2024-05-09T01:00:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbcb65f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbcb65f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc4108f20 0x7fdbc419b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbcb65f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbc4109870 0x7fdbc419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbcb65f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc4114520 con 0x7fdbc41045f0 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbcb65f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc41143a0 con 0x7fdbc4108f20 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbcb65f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc41146a0 con 0x7fdbc4109870 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42558/0 (socket says 172.21.15.37:42558) 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 -- 172.21.15.37:0/2257098003 learned_addr learned my addr 172.21.15.37:0/2257098003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 -- 172.21.15.37:0/2257098003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbc4109870 msgr2=0x7fdbc419f720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbc4109870 0x7fdbc419f720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 -- 172.21.15.37:0/2257098003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc4108f20 msgr2=0x7fdbc419b490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc4108f20 0x7fdbc419b490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 -- 172.21.15.37:0/2257098003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc419fdc0 con 0x7fdbc41045f0 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.159+0000 7fdbc93fb700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc419aef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0006010 tx=0x7fdbc0004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.160+0000 7fdbba7fc700 1 -- 172.21.15.37:0/2257098003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0026070 con 0x7fdbc41045f0 2024-05-09T01:00:18.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.160+0000 7fdbba7fc700 1 -- 172.21.15.37:0/2257098003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbc000f460 con 0x7fdbc41045f0 2024-05-09T01:00:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.160+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc41a0050 con 0x7fdbc41045f0 2024-05-09T01:00:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.160+0000 7fdbba7fc700 1 -- 172.21.15.37:0/2257098003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0009e60 con 0x7fdbc41045f0 2024-05-09T01:00:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.160+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc41a0530 con 0x7fdbc41045f0 2024-05-09T01:00:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.161+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc40512c0 con 0x7fdbc41045f0 2024-05-09T01:00:18.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.162+0000 7fdbba7fc700 1 -- 172.21.15.37:0/2257098003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fdbc0029070 con 0x7fdbc41045f0 2024-05-09T01:00:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.163+0000 7fdbba7fc700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdbb00b2910 0x7fdbb00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.163+0000 7fdbc8bfa700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdbb00b2910 0x7fdbb00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:18.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.164+0000 7fdbba7fc700 1 -- 172.21.15.37:0/2257098003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdbc00e2e90 con 0x7fdbc41045f0 2024-05-09T01:00:18.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.164+0000 7fdbc8bfa700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdbb00b2910 0x7fdbb00b4e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4103650 tx=0x7fdbb4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:18.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.167+0000 7fdbba7fc700 1 -- 172.21.15.37:0/2257098003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdbc005edf0 con 0x7fdbc41045f0 2024-05-09T01:00:18.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:18 smithi037 ceph-mon[30122]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:18.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:18 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/547997655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T01:00:18.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:18 smithi136 ceph-mon[34110]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:18.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:18 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/547997655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T01:00:18.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.397+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdbc402e5f0 con 0x7fdbc41045f0 2024-05-09T01:00:18.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.398+0000 7fdbba7fc700 1 -- 172.21.15.37:0/2257098003 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdbc0013070 con 0x7fdbc41045f0 2024-05-09T01:00:18.399 INFO:teuthology.orchestra.run.smithi037.stdout:133143986248 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdbb00b2910 msgr2=0x7fdbb00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdbb00b2910 0x7fdbb00b4e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4103650 tx=0x7fdbb4009260 comp rx=0 tx=0).stop 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 msgr2=0x7fdbc419aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc419aef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0006010 tx=0x7fdbc0004690 comp rx=0 tx=0).stop 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 shutdown_connections 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdbb00b2910 0x7fdbb00b4e20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbc4109870 0x7fdbc419f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbc41045f0 0x7fdbc419aef0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 --2- 172.21.15.37:0/2257098003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdbc4108f20 0x7fdbc419b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 >> 172.21.15.37:0/2257098003 conn(0x7fdbc4100040 msgr2=0x7fdbc4108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:18.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 shutdown_connections 2024-05-09T01:00:18.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:18.400+0000 7fdbcb65f700 1 -- 172.21.15.37:0/2257098003 wait complete. 2024-05-09T01:00:18.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:18 smithi151 ceph-mon[34780]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:18.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:18 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/547997655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T01:00:19.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:19 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2257098003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T01:00:19.343 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986243 got 133143986248 for osd.4 2024-05-09T01:00:19.343 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:19.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:19 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2257098003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T01:00:19.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:19 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2257098003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T01:00:19.949 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182468 got 107374182474 for osd.3 2024-05-09T01:00:19.950 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:20.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:20 smithi037 ceph-mon[30122]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:20.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:20 smithi037 ceph-mon[30122]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-09T01:00:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:20.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:20 smithi136 ceph-mon[34110]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:20 smithi136 ceph-mon[34110]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-09T01:00:20.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:20 smithi151 ceph-mon[34780]: pgmap v341: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:20 smithi151 ceph-mon[34780]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-09T01:00:22.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:22 smithi136 ceph-mon[34110]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-09T01:00:22.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:22 smithi037 ceph-mon[30122]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-09T01:00:22.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:22 smithi151 ceph-mon[34780]: pgmap v342: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 511 B/s wr, 11 op/s 2024-05-09T01:00:22.924 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234032 got 231928234036 for osd.8 2024-05-09T01:00:22.924 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:23.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 -- 172.21.15.37:0/3579185841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824108740 msgr2=0x7f58241100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 --2- 172.21.15.37:0/3579185841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824108740 0x7f58241100a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f581c00b0d0 tx=0x7f581c00b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 -- 172.21.15.37:0/3579185841 shutdown_connections 2024-05-09T01:00:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 --2- 172.21.15.37:0/3579185841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824108740 0x7f58241100a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 --2- 172.21.15.37:0/3579185841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241034c0 0x7f58241038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 --2- 172.21.15.37:0/3579185841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824107df0 0x7f5824108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 -- 172.21.15.37:0/3579185841 >> 172.21.15.37:0/3579185841 conn(0x7f58240fedf0 msgr2=0x7f5824101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 -- 172.21.15.37:0/3579185841 shutdown_connections 2024-05-09T01:00:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.364+0000 7f582a2f5700 1 -- 172.21.15.37:0/3579185841 wait complete. 2024-05-09T01:00:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 Processor -- start 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 -- start start 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241034c0 0x7f58240ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824107df0 0x7f58240ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824108740 0x7f58240ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58241133c0 con 0x7f5824107df0 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5824113240 con 0x7f58241034c0 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.365+0000 7f582a2f5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5824113540 con 0x7f5824108740 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824107df0 0x7f58240ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824107df0 0x7f58240ff810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47382/0 (socket says 172.21.15.37:47382) 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 -- 172.21.15.37:0/538215526 learned_addr learned my addr 172.21.15.37:0/538215526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f5823fff700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241034c0 0x7f58240ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f5828892700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824108740 0x7f58240ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 -- 172.21.15.37:0/538215526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824108740 msgr2=0x7f58240ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824108740 0x7f58240ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 -- 172.21.15.37:0/538215526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241034c0 msgr2=0x7f58240ff2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241034c0 0x7f58240ff2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 -- 172.21.15.37:0/538215526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58241a90f0 con 0x7f5824107df0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f581bfff700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824107df0 0x7f58240ff810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f580c00d980 tx=0x7f580c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f5821ffb700 1 -- 172.21.15.37:0/538215526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c017070 con 0x7f5824107df0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58241a93e0 con 0x7f5824107df0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f5821ffb700 1 -- 172.21.15.37:0/538215526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f580c00fd40 con 0x7f5824107df0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f5821ffb700 1 -- 172.21.15.37:0/538215526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c00e3b0 con 0x7f5824107df0 2024-05-09T01:00:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.366+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58241a9920 con 0x7f5824107df0 2024-05-09T01:00:23.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.367+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58240512c0 con 0x7f5824107df0 2024-05-09T01:00:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.369+0000 7f5821ffb700 1 -- 172.21.15.37:0/538215526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f580c010610 con 0x7f5824107df0 2024-05-09T01:00:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.370+0000 7f5821ffb700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f58100b2880 0x7f58100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.370+0000 7f5823fff700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f58100b2880 0x7f58100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.370+0000 7f5821ffb700 1 -- 172.21.15.37:0/538215526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f580c0e1b70 con 0x7f5824107df0 2024-05-09T01:00:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.370+0000 7f5823fff700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f58100b2880 0x7f58100b4d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f581400ac50 tx=0x7f581400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.375+0000 7f5821ffb700 1 -- 172.21.15.37:0/538215526 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f580c0a9930 con 0x7f5824107df0 2024-05-09T01:00:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.596+0000 7fb76c44a700 1 -- 172.21.15.37:0/1359440213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 msgr2=0x7fb7641038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.596+0000 7fb76c44a700 1 --2- 172.21.15.37:0/1359440213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb7641038d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb7600099c0 tx=0x7fb760009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.596+0000 7fb76c44a700 1 -- 172.21.15.37:0/1359440213 shutdown_connections 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.596+0000 7fb76c44a700 1 --2- 172.21.15.37:0/1359440213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb764108740 0x7fb7641100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.596+0000 7fb76c44a700 1 --2- 172.21.15.37:0/1359440213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb7641038d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.596+0000 7fb76c44a700 1 --2- 172.21.15.37:0/1359440213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764107df0 0x7fb764108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.597+0000 7fb76c44a700 1 -- 172.21.15.37:0/1359440213 >> 172.21.15.37:0/1359440213 conn(0x7fb7640fedc0 msgr2=0x7fb7641011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.597+0000 7fb76c44a700 1 -- 172.21.15.37:0/1359440213 shutdown_connections 2024-05-09T01:00:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.597+0000 7fb76c44a700 1 -- 172.21.15.37:0/1359440213 wait complete. 2024-05-09T01:00:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 Processor -- start 2024-05-09T01:00:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 -- start start 2024-05-09T01:00:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb76419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb764107df0 0x7fb76419c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764108740 0x7fb7641a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb764113370 con 0x7fb7641034c0 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb7641131f0 con 0x7fb764108740 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76c44a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb7641134f0 con 0x7fb764107df0 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb76419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb76419bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47394/0 (socket says 172.21.15.37:47394) 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 -- 172.21.15.37:0/3420289433 learned_addr learned my addr 172.21.15.37:0/3420289433 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb7699e5700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb764107df0 0x7fb76419c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a9e7700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764108740 0x7fb7641a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 -- 172.21.15.37:0/3420289433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb764107df0 msgr2=0x7fb76419c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb764107df0 0x7fb76419c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 -- 172.21.15.37:0/3420289433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764108740 msgr2=0x7fb7641a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764108740 0x7fb7641a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.598+0000 7fb76a1e6700 1 -- 172.21.15.37:0/3420289433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76419ca20 con 0x7fb7641034c0 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.599+0000 7fb76a1e6700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb76419bc30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b580 tx=0x7fb7600047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.599+0000 7fb75b7fe700 1 -- 172.21.15.37:0/3420289433 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760027070 con 0x7fb7641034c0 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.599+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7641a72b0 con 0x7fb7641034c0 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.599+0000 7fb75b7fe700 1 -- 172.21.15.37:0/3420289433 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb760003f20 con 0x7fb7641034c0 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.599+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7641a7700 con 0x7fb7641034c0 2024-05-09T01:00:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.599+0000 7fb75b7fe700 1 -- 172.21.15.37:0/3420289433 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760022d70 con 0x7fb7641034c0 2024-05-09T01:00:23.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.600+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7640512c0 con 0x7fb7641034c0 2024-05-09T01:00:23.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.601+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f582402e5f0 con 0x7f5824107df0 2024-05-09T01:00:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.602+0000 7fb75b7fe700 1 -- 172.21.15.37:0/3420289433 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb760022500 con 0x7fb7641034c0 2024-05-09T01:00:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.602+0000 7fb75b7fe700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb7500b2900 0x7fb7500b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.603+0000 7fb7699e5700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb7500b2900 0x7fb7500b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.603+0000 7fb75b7fe700 1 -- 172.21.15.37:0/3420289433 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb7600e3120 con 0x7fb7641034c0 2024-05-09T01:00:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.603+0000 7fb7699e5700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb7500b2900 0x7fb7500b4e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb764106930 tx=0x7fb7540073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.606+0000 7f5821ffb700 1 -- 172.21.15.37:0/538215526 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f580c0a9230 con 0x7f5824107df0 2024-05-09T01:00:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.606+0000 7fb75b7fe700 1 -- 172.21.15.37:0/3420289433 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb760013070 con 0x7fb7641034c0 2024-05-09T01:00:23.608 INFO:teuthology.orchestra.run.smithi037.stdout:55834574936 2024-05-09T01:00:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f58100b2880 msgr2=0x7f58100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f58100b2880 0x7f58100b4d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f581400ac50 tx=0x7f581400a380 comp rx=0 tx=0).stop 2024-05-09T01:00:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824107df0 msgr2=0x7f58240ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824107df0 0x7f58240ff810 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f580c00d980 tx=0x7f580c00dc90 comp rx=0 tx=0).stop 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 shutdown_connections 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f58100b2880 0x7f58100b4d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5824108740 0x7f58240ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58241034c0 0x7f58240ff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 --2- 172.21.15.37:0/538215526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5824107df0 0x7f58240ff810 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 >> 172.21.15.37:0/538215526 conn(0x7f58240fedf0 msgr2=0x7f5824075c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 shutdown_connections 2024-05-09T01:00:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.609+0000 7f582a2f5700 1 -- 172.21.15.37:0/538215526 wait complete. 2024-05-09T01:00:23.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.827+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb76402e7b0 con 0x7fb7641034c0 2024-05-09T01:00:23.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.828+0000 7fb75b7fe700 1 -- 172.21.15.37:0/3420289433 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7600aaf70 con 0x7fb7641034c0 2024-05-09T01:00:23.829 INFO:teuthology.orchestra.run.smithi037.stdout:77309411410 2024-05-09T01:00:23.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb7500b2900 msgr2=0x7fb7500b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb7500b2900 0x7fb7500b4e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb764106930 tx=0x7fb7540073d0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 msgr2=0x7fb76419bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb76419bc30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb76000b580 tx=0x7fb7600047b0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 shutdown_connections 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb7500b2900 0x7fb7500b4e10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb764108740 0x7fb7641a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7641034c0 0x7fb76419bc30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 --2- 172.21.15.37:0/3420289433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb764107df0 0x7fb76419c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 >> 172.21.15.37:0/3420289433 conn(0x7fb7640fedc0 msgr2=0x7fb7641011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.830+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 shutdown_connections 2024-05-09T01:00:23.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:23.831+0000 7fb76c44a700 1 -- 172.21.15.37:0/3420289433 wait complete. 2024-05-09T01:00:24.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:24 smithi037 ceph-mon[30122]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-09T01:00:24.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:24 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/538215526' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T01:00:24.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:24 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3420289433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T01:00:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:24 smithi136 ceph-mon[34110]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-09T01:00:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:24 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/538215526' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T01:00:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:24 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3420289433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T01:00:24.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:24 smithi151 ceph-mon[34780]: pgmap v343: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-09T01:00:24.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:24 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/538215526' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T01:00:24.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:24 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3420289433' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T01:00:24.873 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411404 got 77309411410 for osd.2 2024-05-09T01:00:24.873 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 -- 172.21.15.37:0/1763247095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108970 msgr2=0x7fc7681102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 --2- 172.21.15.37:0/1763247095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108970 0x7fc7681102d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc76000b0d0 tx=0x7fc76000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 -- 172.21.15.37:0/1763247095 shutdown_connections 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 --2- 172.21.15.37:0/1763247095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108970 0x7fc7681102d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 --2- 172.21.15.37:0/1763247095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc768103c10 0x7fc768104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 --2- 172.21.15.37:0/1763247095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc768108020 0x7fc768108430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 -- 172.21.15.37:0/1763247095 >> 172.21.15.37:0/1763247095 conn(0x7fc7680fe4e0 msgr2=0x7fc768100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 -- 172.21.15.37:0/1763247095 shutdown_connections 2024-05-09T01:00:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.194+0000 7fc76e896700 1 -- 172.21.15.37:0/1763247095 wait complete. 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 Processor -- start 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 -- start start 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc768103c10 0x7fc76819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108020 0x7fc76819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc768108970 0x7fc76819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681135f0 con 0x7fc768108020 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc768113470 con 0x7fc768103c10 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76e896700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc768113770 con 0x7fc768108970 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc75ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108020 0x7fc76819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc75ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108020 0x7fc76819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47422/0 (socket says 172.21.15.37:47422) 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc75ffff700 1 -- 172.21.15.37:0/1751746903 learned_addr learned my addr 172.21.15.37:0/1751746903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc767fff700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc768103c10 0x7fc76819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.195+0000 7fc76ce33700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc768108970 0x7fc76819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc75ffff700 1 -- 172.21.15.37:0/1751746903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc768108970 msgr2=0x7fc76819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc75ffff700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc768108970 0x7fc76819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc75ffff700 1 -- 172.21.15.37:0/1751746903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc768103c10 msgr2=0x7fc76819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc75ffff700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc768103c10 0x7fc76819be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc75ffff700 1 -- 172.21.15.37:0/1751746903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7681a71c0 con 0x7fc768108020 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc75ffff700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108020 0x7fc76819c3b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc75000d980 tx=0x7fc75000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc765ffb700 1 -- 172.21.15.37:0/1751746903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750017070 con 0x7fc768108020 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc765ffb700 1 -- 172.21.15.37:0/1751746903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc75000fd40 con 0x7fc768108020 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc765ffb700 1 -- 172.21.15.37:0/1751746903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75000e3b0 con 0x7fc768108020 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7681a74b0 con 0x7fc768108020 2024-05-09T01:00:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.196+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7681a7a40 con 0x7fc768108020 2024-05-09T01:00:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.197+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7680512c0 con 0x7fc768108020 2024-05-09T01:00:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.200+0000 7fc765ffb700 1 -- 172.21.15.37:0/1751746903 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc750010610 con 0x7fc768108020 2024-05-09T01:00:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.200+0000 7fc765ffb700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7540b2900 0x7fc7540b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.201+0000 7fc767fff700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7540b2900 0x7fc7540b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.201+0000 7fc765ffb700 1 -- 172.21.15.37:0/1751746903 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc7500e1b00 con 0x7fc768108020 2024-05-09T01:00:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.201+0000 7fc767fff700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7540b2900 0x7fc7540b4e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc758005950 tx=0x7fc75800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:25.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.204+0000 7fc765ffb700 1 -- 172.21.15.37:0/1751746903 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc7500a9940 con 0x7fc768108020 2024-05-09T01:00:25.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.425+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc76806c120 con 0x7fc768108020 2024-05-09T01:00:25.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.425+0000 7fc765ffb700 1 -- 172.21.15.37:0/1751746903 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc7500a9240 con 0x7fc768108020 2024-05-09T01:00:25.426 INFO:teuthology.orchestra.run.smithi037.stdout:257698037808 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7540b2900 msgr2=0x7fc7540b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7540b2900 0x7fc7540b4e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc758005950 tx=0x7fc75800b410 comp rx=0 tx=0).stop 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108020 msgr2=0x7fc76819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108020 0x7fc76819c3b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc75000d980 tx=0x7fc75000dc90 comp rx=0 tx=0).stop 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 shutdown_connections 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7540b2900 0x7fc7540b4e10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc768108970 0x7fc76819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc768103c10 0x7fc76819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 --2- 172.21.15.37:0/1751746903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc768108020 0x7fc76819c3b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 >> 172.21.15.37:0/1751746903 conn(0x7fc7680fe4e0 msgr2=0x7fc768107740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 shutdown_connections 2024-05-09T01:00:25.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.428+0000 7fc76e896700 1 -- 172.21.15.37:0/1751746903 wait complete. 2024-05-09T01:00:26.056 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462965 got 201863462967 for osd.7 2024-05-09T01:00:26.057 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:26.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:26 smithi037 ceph-mon[30122]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-09T01:00:26.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:26 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1751746903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T01:00:26.131 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:26 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3120083791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T01:00:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:26 smithi136 ceph-mon[34110]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-09T01:00:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:26 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1751746903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T01:00:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:26 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3120083791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T01:00:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:26 smithi151 ceph-mon[34780]: pgmap v344: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-05-09T01:00:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:26 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1751746903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T01:00:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:26 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3120083791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.633+0000 7f54fbc99700 1 -- 172.21.15.37:0/2644841092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f41092d0 msgr2=0x7f54f41096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.633+0000 7f54fbc99700 1 --2- 172.21.15.37:0/2644841092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f41092d0 0x7f54f41096e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f54e8009990 tx=0x7f54e8009ca0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.633+0000 7f54fbc99700 1 -- 172.21.15.37:0/2644841092 shutdown_connections 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.633+0000 7f54fbc99700 1 --2- 172.21.15.37:0/2644841092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54f41031c0 0x7f54f4111160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.633+0000 7f54fbc99700 1 --2- 172.21.15.37:0/2644841092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f41092d0 0x7f54f41096e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.633+0000 7f54fbc99700 1 --2- 172.21.15.37:0/2644841092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f4102870 0x7f54f4102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.633+0000 7f54fbc99700 1 -- 172.21.15.37:0/2644841092 >> 172.21.15.37:0/2644841092 conn(0x7f54f40fe520 msgr2=0x7f54f4100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.634+0000 7f54fbc99700 1 -- 172.21.15.37:0/2644841092 shutdown_connections 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.634+0000 7f54fbc99700 1 -- 172.21.15.37:0/2644841092 wait complete. 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.634+0000 7f54fbc99700 1 Processor -- start 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.634+0000 7f54fbc99700 1 -- start start 2024-05-09T01:00:26.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.634+0000 7f54fbc99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f4102870 0x7f54f419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.634+0000 7f54fbc99700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54f41031c0 0x7f54f419b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54fbc99700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f41092d0 0x7f54f419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54fbc99700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54f41146b0 con 0x7f54f4102870 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54fbc99700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f54f4114530 con 0x7f54f41031c0 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54fbc99700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f54f4114830 con 0x7f54f41092d0 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f4102870 0x7f54f419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f4102870 0x7f54f419afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47442/0 (socket says 172.21.15.37:47442) 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 -- 172.21.15.37:0/3120083791 learned_addr learned my addr 172.21.15.37:0/3120083791 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:26.560 INFO:teuthology.orchestra.run.smithi037.stdout:180388626496 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9234700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54f41031c0 0x7f54f419b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54fa236700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f41092d0 0x7f54f419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 -- 172.21.15.37:0/3120083791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f41092d0 msgr2=0x7f54f419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f41092d0 0x7f54f419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 -- 172.21.15.37:0/3120083791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54f41031c0 msgr2=0x7f54f419b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54f41031c0 0x7f54f419b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 -- 172.21.15.37:0/3120083791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f419fe90 con 0x7f54f4102870 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54f9a35700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f4102870 0x7f54f419afc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f54e8000c00 tx=0x7f54e8003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54e6ffd700 1 -- 172.21.15.37:0/3120083791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8027070 con 0x7f54f4102870 2024-05-09T01:00:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54e6ffd700 1 -- 172.21.15.37:0/3120083791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e8004140 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54e6ffd700 1 -- 172.21.15.37:0/3120083791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e8022dc0 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.635+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f41a0120 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.636+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f41a0600 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.636+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f40512c0 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.638+0000 7f54e6ffd700 1 -- 172.21.15.37:0/3120083791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f54e802a070 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.639+0000 7f54e6ffd700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54e00b2880 0x7f54e00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.639+0000 7f54f9234700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54e00b2880 0x7f54e00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.639+0000 7f54e6ffd700 1 -- 172.21.15.37:0/3120083791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f54e80e3650 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.639+0000 7f54f9234700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54e00b2880 0x7f54e00b4d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54f0006fd0 tx=0x7f54f0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.642+0000 7f54e6ffd700 1 -- 172.21.15.37:0/3120083791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f54e8013070 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.858+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f54f402e5f0 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.859+0000 7f54e6ffd700 1 -- 172.21.15.37:0/3120083791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f54e80ab5c0 con 0x7f54f4102870 2024-05-09T01:00:26.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54e00b2880 msgr2=0x7f54e00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54e00b2880 0x7f54e00b4d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54f0006fd0 tx=0x7f54f0008040 comp rx=0 tx=0).stop 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f4102870 msgr2=0x7f54f419afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f4102870 0x7f54f419afc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f54e8000c00 tx=0x7f54e8003730 comp rx=0 tx=0).stop 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 shutdown_connections 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54e00b2880 0x7f54e00b4d90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54f41092d0 0x7f54f419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54f4102870 0x7f54f419afc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 --2- 172.21.15.37:0/3120083791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54f41031c0 0x7f54f419b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 >> 172.21.15.37:0/3120083791 conn(0x7f54f40fe520 msgr2=0x7f54f4100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 shutdown_connections 2024-05-09T01:00:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:25.861+0000 7f54fbc99700 1 -- 172.21.15.37:0/3120083791 wait complete. 2024-05-09T01:00:27.131 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626490 got 180388626496 for osd.6 2024-05-09T01:00:27.131 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:27.744 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574932 got 55834574936 for osd.1 2024-05-09T01:00:27.744 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/1458196183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8108740 msgr2=0x7f5db81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/1458196183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8108740 0x7f5db81100a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5db000b0d0 tx=0x7f5db000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/1458196183 shutdown_connections 2024-05-09T01:00:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/1458196183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8108740 0x7f5db81100a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/1458196183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db81034c0 0x7f5db81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/1458196183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5db8107df0 0x7f5db8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/1458196183 >> 172.21.15.37:0/1458196183 conn(0x7f5db80fedc0 msgr2=0x7f5db81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/1458196183 shutdown_connections 2024-05-09T01:00:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.218+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/1458196183 wait complete. 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.219+0000 7f5dbd1d2700 1 Processor -- start 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.219+0000 7f5dbd1d2700 1 -- start start 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dbd1d2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db81034c0 0x7f5db819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dbd1d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8107df0 0x7f5db819c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dbd1d2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5db8108740 0x7f5db819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dbd1d2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8113460 con 0x7f5db8107df0 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dbd1d2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81132e0 con 0x7f5db8108740 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dbd1d2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5db81135e0 con 0x7f5db81034c0 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8107df0 0x7f5db819c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8107df0 0x7f5db819c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47464/0 (socket says 172.21.15.37:47464) 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 -- 172.21.15.37:0/768893151 learned_addr learned my addr 172.21.15.37:0/768893151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5db6d9d700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db81034c0 0x7f5db819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5db759e700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5db8108740 0x7f5db819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 -- 172.21.15.37:0/768893151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db81034c0 msgr2=0x7f5db819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db81034c0 0x7f5db819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 -- 172.21.15.37:0/768893151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5db8108740 msgr2=0x7f5db819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5db8108740 0x7f5db819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 -- 172.21.15.37:0/768893151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db81a70d0 con 0x7f5db8107df0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.220+0000 7f5dae59c700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8107df0 0x7f5db819c2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5da000b500 tx=0x7f5da000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.221+0000 7f5db4d99700 1 -- 172.21.15.37:0/768893151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0015020 con 0x7f5db8107df0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.221+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db81a73c0 con 0x7f5db8107df0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.221+0000 7f5db4d99700 1 -- 172.21.15.37:0/768893151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5da0011ce0 con 0x7f5db8107df0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.221+0000 7f5db4d99700 1 -- 172.21.15.37:0/768893151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0010cb0 con 0x7f5db8107df0 2024-05-09T01:00:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.221+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db81a7900 con 0x7f5db8107df0 2024-05-09T01:00:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.222+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db80512c0 con 0x7f5db8107df0 2024-05-09T01:00:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.223+0000 7f5db4d99700 1 -- 172.21.15.37:0/768893151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5da0018020 con 0x7f5db8107df0 2024-05-09T01:00:28.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:28 smithi037 ceph-mon[30122]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-09T01:00:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.224+0000 7f5db4d99700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5da40b2880 0x7f5da40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.224+0000 7f5db6d9d700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5da40b2880 0x7f5da40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.224+0000 7f5db4d99700 1 -- 172.21.15.37:0/768893151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5da00e1df0 con 0x7f5db8107df0 2024-05-09T01:00:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.225+0000 7f5db6d9d700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5da40b2880 0x7f5da40b4d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009a10 tx=0x7f5da8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.228+0000 7f5db4d99700 1 -- 172.21.15.37:0/768893151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5da001f020 con 0x7f5db8107df0 2024-05-09T01:00:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:28 smithi136 ceph-mon[34110]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-09T01:00:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.442+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f5db802e5f0 con 0x7f5db8107df0 2024-05-09T01:00:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.442+0000 7f5db4d99700 1 -- 172.21.15.37:0/768893151 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5da00a9b10 con 0x7f5db8107df0 2024-05-09T01:00:28.443 INFO:teuthology.orchestra.run.smithi037.stdout:279172874283 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5da40b2880 msgr2=0x7f5da40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5da40b2880 0x7f5da40b4d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009a10 tx=0x7f5da8009190 comp rx=0 tx=0).stop 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8107df0 msgr2=0x7f5db819c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8107df0 0x7f5db819c2a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5da000b500 tx=0x7f5da000b810 comp rx=0 tx=0).stop 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 shutdown_connections 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5da40b2880 0x7f5da40b4d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5db8108740 0x7f5db819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db81034c0 0x7f5db819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 --2- 172.21.15.37:0/768893151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5db8107df0 0x7f5db819c2a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 >> 172.21.15.37:0/768893151 conn(0x7f5db80fedc0 msgr2=0x7f5db81096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 shutdown_connections 2024-05-09T01:00:28.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:28.445+0000 7f5dbd1d2700 1 -- 172.21.15.37:0/768893151 wait complete. 2024-05-09T01:00:28.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:28 smithi151 ceph-mon[34780]: pgmap v345: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-09T01:00:29.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:29 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/768893151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 -- 172.21.15.37:0/1174717135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 msgr2=0x7ffba01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 --2- 172.21.15.37:0/1174717135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba01038d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0099c0 tx=0x7ffb9c009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 -- 172.21.15.37:0/1174717135 shutdown_connections 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 --2- 172.21.15.37:0/1174717135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffba0108740 0x7ffba01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 --2- 172.21.15.37:0/1174717135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba01038d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 --2- 172.21.15.37:0/1174717135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0107df0 0x7ffba0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 -- 172.21.15.37:0/1174717135 >> 172.21.15.37:0/1174717135 conn(0x7ffba00fedc0 msgr2=0x7ffba01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 -- 172.21.15.37:0/1174717135 shutdown_connections 2024-05-09T01:00:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 -- 172.21.15.37:0/1174717135 wait complete. 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.236+0000 7ffba6f58700 1 Processor -- start 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba6f58700 1 -- start start 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba6f58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba6f58700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffba0107df0 0x7ffba019c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba6f58700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0108740 0x7ffba01a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba6f58700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffba0113370 con 0x7ffba01034c0 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba6f58700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01131f0 con 0x7ffba0108740 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba6f58700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffba01134f0 con 0x7ffba0107df0 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba019bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47484/0 (socket says 172.21.15.37:47484) 2024-05-09T01:00:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 -- 172.21.15.37:0/2175154791 learned_addr learned my addr 172.21.15.37:0/2175154791 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba54f5700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0108740 0x7ffba01a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 -- 172.21.15.37:0/2175154791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffba0107df0 msgr2=0x7ffba019c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffba0107df0 0x7ffba019c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 -- 172.21.15.37:0/2175154791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0108740 msgr2=0x7ffba01a6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0108740 0x7ffba01a6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 -- 172.21.15.37:0/2175154791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba019c9e0 con 0x7ffba01034c0 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba54f5700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0108740 0x7ffba01a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.237+0000 7ffba4cf4700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba019bbf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0098e0 tx=0x7ffb9c003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.238+0000 7ffb95ffb700 1 -- 172.21.15.37:0/2175154791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c027070 con 0x7ffba01034c0 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.238+0000 7ffb95ffb700 1 -- 172.21.15.37:0/2175154791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb9c0040a0 con 0x7ffba01034c0 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.238+0000 7ffb95ffb700 1 -- 172.21.15.37:0/2175154791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c00f460 con 0x7ffba01034c0 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.238+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba01a7270 con 0x7ffba01034c0 2024-05-09T01:00:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.238+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba01a76c0 con 0x7ffba01034c0 2024-05-09T01:00:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.239+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba00512c0 con 0x7ffba01034c0 2024-05-09T01:00:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.241+0000 7ffb95ffb700 1 -- 172.21.15.37:0/2175154791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ffb9c02a070 con 0x7ffba01034c0 2024-05-09T01:00:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.241+0000 7ffb95ffb700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb880b2880 0x7ffb880b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.241+0000 7ffb95ffb700 1 -- 172.21.15.37:0/2175154791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ffb9c0e39e0 con 0x7ffba01034c0 2024-05-09T01:00:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.241+0000 7ffb97fff700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb880b2880 0x7ffb880b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.242+0000 7ffb97fff700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb880b2880 0x7ffb880b4d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffba01024b0 tx=0x7ffb90005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.245+0000 7ffb95ffb700 1 -- 172.21.15.37:0/2175154791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffb9c031080 con 0x7ffba01034c0 2024-05-09T01:00:29.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:29 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/768893151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T01:00:29.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.470+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ffba002e7b0 con 0x7ffba01034c0 2024-05-09T01:00:29.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.470+0000 7ffb95ffb700 1 -- 172.21.15.37:0/2175154791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ffb9c013070 con 0x7ffba01034c0 2024-05-09T01:00:29.476 INFO:teuthology.orchestra.run.smithi037.stdout:304942678056 2024-05-09T01:00:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb880b2880 msgr2=0x7ffb880b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb880b2880 0x7ffb880b4d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffba01024b0 tx=0x7ffb90005c80 comp rx=0 tx=0).stop 2024-05-09T01:00:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 msgr2=0x7ffba019bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba019bbf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0098e0 tx=0x7ffb9c003680 comp rx=0 tx=0).stop 2024-05-09T01:00:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 shutdown_connections 2024-05-09T01:00:29.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb880b2880 0x7ffb880b4d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffba0108740 0x7ffba01a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01034c0 0x7ffba019bbf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 --2- 172.21.15.37:0/2175154791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffba0107df0 0x7ffba019c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 >> 172.21.15.37:0/2175154791 conn(0x7ffba00fedc0 msgr2=0x7ffba01096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 shutdown_connections 2024-05-09T01:00:29.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:29.473+0000 7ffba6f58700 1 -- 172.21.15.37:0/2175154791 wait complete. 2024-05-09T01:00:29.479 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:29 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/768893151' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T01:00:29.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874276 got 279172874283 for osd.10 2024-05-09T01:00:29.801 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:30 smithi136 ceph-mon[34110]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-09T01:00:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:30 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2175154791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T01:00:30.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:30 smithi037 ceph-mon[30122]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-09T01:00:30.427 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:30 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2175154791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T01:00:30.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678051 got 304942678056 for osd.11 2024-05-09T01:00:30.460 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:30.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:30 smithi151 ceph-mon[34780]: pgmap v346: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-05-09T01:00:30.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:30 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2175154791' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T01:00:30.835 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037800 got 257698037808 for osd.9 2024-05-09T01:00:30.836 DEBUG:teuthology.parallel:result is None 2024-05-09T01:00:30.836 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T01:00:30.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T01:00:31.092 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:32.188 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:32 smithi037 ceph-mon[30122]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-09T01:00:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:32 smithi136 ceph-mon[34110]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-09T01:00:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:32 smithi151 ceph-mon[34780]: pgmap v347: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-05-09T01:00:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 -- 172.21.15.37:0/2367501199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38109850 msgr2=0x7f0b381111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/2367501199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38109850 0x7f0b381111b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000b0d0 tx=0x7f0b3000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 -- 172.21.15.37:0/2367501199 shutdown_connections 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/2367501199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38109850 0x7f0b381111b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/2367501199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b381045d0 0x7f0b381049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/2367501199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b38108f00 0x7f0b38109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 -- 172.21.15.37:0/2367501199 >> 172.21.15.37:0/2367501199 conn(0x7f0b380ffea0 msgr2=0x7f0b381022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 -- 172.21.15.37:0/2367501199 shutdown_connections 2024-05-09T01:00:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.741+0000 7f0b3fd59700 1 -- 172.21.15.37:0/2367501199 wait complete. 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.742+0000 7f0b3fd59700 1 Processor -- start 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.742+0000 7f0b3fd59700 1 -- start start 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3fd59700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b381045d0 0x7f0b3819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3fd59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38108f00 0x7f0b3819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3fd59700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b38109850 0x7f0b3819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3fd59700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b381144d0 con 0x7f0b38108f00 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3fd59700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0b38114350 con 0x7f0b381045d0 2024-05-09T01:00:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3fd59700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0b38114650 con 0x7f0b38109850 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38108f00 0x7f0b3819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38108f00 0x7f0b3819b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45262/0 (socket says 172.21.15.37:45262) 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 -- 172.21.15.37:0/4248335174 learned_addr learned my addr 172.21.15.37:0/4248335174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3daf5700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b381045d0 0x7f0b3819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3e2f6700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b38109850 0x7f0b3819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 -- 172.21.15.37:0/4248335174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b38109850 msgr2=0x7f0b3819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b38109850 0x7f0b3819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 -- 172.21.15.37:0/4248335174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b381045d0 msgr2=0x7f0b3819ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b381045d0 0x7f0b3819ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3d2f4700 1 -- 172.21.15.37:0/4248335174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3819fc70 con 0x7f0b38108f00 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3daf5700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b381045d0 0x7f0b3819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.743+0000 7f0b3e2f6700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b38109850 0x7f0b3819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.744+0000 7f0b3d2f4700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38108f00 0x7f0b3819b340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800c8f0 tx=0x7f0b2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.744+0000 7f0b2effd700 1 -- 172.21.15.37:0/4248335174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28007b00 con 0x7f0b38108f00 2024-05-09T01:00:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.744+0000 7f0b2effd700 1 -- 172.21.15.37:0/4248335174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b28007ca0 con 0x7f0b38108f00 2024-05-09T01:00:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.744+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3819ff60 con 0x7f0b38108f00 2024-05-09T01:00:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.744+0000 7f0b2effd700 1 -- 172.21.15.37:0/4248335174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28018660 con 0x7f0b38108f00 2024-05-09T01:00:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.744+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b381a7880 con 0x7f0b38108f00 2024-05-09T01:00:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.745+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b380512c0 con 0x7f0b38108f00 2024-05-09T01:00:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.747+0000 7f0b2effd700 1 -- 172.21.15.37:0/4248335174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0b2800f450 con 0x7f0b38108f00 2024-05-09T01:00:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.747+0000 7f0b2effd700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0b240b2880 0x7f0b240b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.748+0000 7f0b3daf5700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0b240b2880 0x7f0b240b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.748+0000 7f0b2effd700 1 -- 172.21.15.37:0/4248335174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0b280e21a0 con 0x7f0b38108f00 2024-05-09T01:00:32.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.748+0000 7f0b3daf5700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0b240b2880 0x7f0b240b4d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005950 tx=0x7f0b34005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:32.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.752+0000 7f0b2effd700 1 -- 172.21.15.37:0/4248335174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0b28014030 con 0x7f0b38108f00 2024-05-09T01:00:32.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.965+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0b3819c100 con 0x7f0b240b2880 2024-05-09T01:00:32.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.972+0000 7f0b2effd700 1 -- 172.21.15.37:0/4248335174 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258860 (secure 0 0 0) 0x7f0b3819c100 con 0x7f0b240b2880 2024-05-09T01:00:32.977 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0b240b2880 msgr2=0x7f0b240b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0b240b2880 0x7f0b240b4d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005950 tx=0x7f0b34005f50 comp rx=0 tx=0).stop 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38108f00 msgr2=0x7f0b3819b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38108f00 0x7f0b3819b340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800c8f0 tx=0x7f0b2800ccb0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 shutdown_connections 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0b240b2880 0x7f0b240b4d90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b38109850 0x7f0b3819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b381045d0 0x7f0b3819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 --2- 172.21.15.37:0/4248335174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38108f00 0x7f0b3819b340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 >> 172.21.15.37:0/4248335174 conn(0x7f0b380ffea0 msgr2=0x7f0b38108670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 shutdown_connections 2024-05-09T01:00:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:32.976+0000 7f0b3fd59700 1 -- 172.21.15.37:0/4248335174 wait complete. 2024-05-09T01:00:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-09T01:00:33.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-05-09T01:00:32.913082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658684,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1057,"num_read_kb":632,"num_write":379,"num_write_kb":2295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":812,"ondisk_log_size":812,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382492,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559332,"statfs":{"total":1151940427776,"available":1151548755968,"internally_reserved":0,"allocated":12840960,"data_stored":7133292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":56,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003844"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924240+0000","last_change":"2024-05-09T00:58:37.371502+0000","last_active":"2024-05-09T01:00:18.924240+0000","last_peered":"2024-05-09T01:00:18.924240+0000","last_clean":"2024-05-09T01:00:18.924240+0000","last_became_active":"2024-05-09T00:58:37.371172+0000","last_became_peered":"2024-05-09T00:58:37.371172+0000","last_unstale":"2024-05-09T01:00:18.924240+0000","last_undegraded":"2024-05-09T01:00:18.924240+0000","last_fullsized":"2024-05-09T01:00:18.924240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:37.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917627+0000","last_change":"2024-05-09T00:58:37.362831+0000","last_active":"2024-05-09T01:00:18.917627+0000","last_peered":"2024-05-09T01:00:18.917627+0000","last_clean":"2024-05-09T01:00:18.917627+0000","last_became_active":"2024-05-09T00:58:37.362063+0000","last_became_peered":"2024-05-09T00:58:37.362063+0000","last_unstale":"2024-05-09T01:00:18.917627+0000","last_undegraded":"2024-05-09T01:00:18.917627+0000","last_fullsized":"2024-05-09T01:00:18.917627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:01.222962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924849+0000","last_change":"2024-05-09T00:58:37.369903+0000","last_active":"2024-05-09T01:00:18.924849+0000","last_peered":"2024-05-09T01:00:18.924849+0000","last_clean":"2024-05-09T01:00:18.924849+0000","last_became_active":"2024-05-09T00:58:37.366215+0000","last_became_peered":"2024-05-09T00:58:37.366215+0000","last_unstale":"2024-05-09T01:00:18.924849+0000","last_undegraded":"2024-05-09T01:00:18.924849+0000","last_fullsized":"2024-05-09T01:00:18.924849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:47.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914443+0000","last_change":"2024-05-09T00:58:37.358878+0000","last_active":"2024-05-09T01:00:18.914443+0000","last_peered":"2024-05-09T01:00:18.914443+0000","last_clean":"2024-05-09T01:00:18.914443+0000","last_became_active":"2024-05-09T00:58:37.358516+0000","last_became_peered":"2024-05-09T00:58:37.358516+0000","last_unstale":"2024-05-09T01:00:18.914443+0000","last_undegraded":"2024-05-09T01:00:18.914443+0000","last_fullsized":"2024-05-09T01:00:18.914443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.896957+0000","last_change":"2024-05-09T00:58:37.358196+0000","last_active":"2024-05-09T01:00:18.896957+0000","last_peered":"2024-05-09T01:00:18.896957+0000","last_clean":"2024-05-09T01:00:18.896957+0000","last_became_active":"2024-05-09T00:58:37.357840+0000","last_became_peered":"2024-05-09T00:58:37.357840+0000","last_unstale":"2024-05-09T01:00:18.896957+0000","last_undegraded":"2024-05-09T01:00:18.896957+0000","last_fullsized":"2024-05-09T01:00:18.896957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:58.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923026+0000","last_change":"2024-05-09T00:58:37.364523+0000","last_active":"2024-05-09T01:00:18.923026+0000","last_peered":"2024-05-09T01:00:18.923026+0000","last_clean":"2024-05-09T01:00:18.923026+0000","last_became_active":"2024-05-09T00:58:37.364172+0000","last_became_peered":"2024-05-09T00:58:37.364172+0000","last_unstale":"2024-05-09T01:00:18.923026+0000","last_undegraded":"2024-05-09T01:00:18.923026+0000","last_fullsized":"2024-05-09T01:00:18.923026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:36.872701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913452+0000","last_change":"2024-05-09T00:58:37.371226+0000","last_active":"2024-05-09T01:00:18.913452+0000","last_peered":"2024-05-09T01:00:18.913452+0000","last_clean":"2024-05-09T01:00:18.913452+0000","last_became_active":"2024-05-09T00:58:37.370647+0000","last_became_peered":"2024-05-09T00:58:37.370647+0000","last_unstale":"2024-05-09T01:00:18.913452+0000","last_undegraded":"2024-05-09T01:00:18.913452+0000","last_fullsized":"2024-05-09T01:00:18.913452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:46.350845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914039+0000","last_change":"2024-05-09T00:58:37.362487+0000","last_active":"2024-05-09T01:00:18.914039+0000","last_peered":"2024-05-09T01:00:18.914039+0000","last_clean":"2024-05-09T01:00:18.914039+0000","last_became_active":"2024-05-09T00:58:37.361454+0000","last_became_peered":"2024-05-09T00:58:37.361454+0000","last_unstale":"2024-05-09T01:00:18.914039+0000","last_undegraded":"2024-05-09T01:00:18.914039+0000","last_fullsized":"2024-05-09T01:00:18.914039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:36.930754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925201+0000","last_change":"2024-05-09T00:58:37.370069+0000","last_active":"2024-05-09T01:00:18.925201+0000","last_peered":"2024-05-09T01:00:18.925201+0000","last_clean":"2024-05-09T01:00:18.925201+0000","last_became_active":"2024-05-09T00:58:37.369634+0000","last_became_peered":"2024-05-09T00:58:37.369634+0000","last_unstale":"2024-05-09T01:00:18.925201+0000","last_undegraded":"2024-05-09T01:00:18.925201+0000","last_fullsized":"2024-05-09T01:00:18.925201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:22.424919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923224+0000","last_change":"2024-05-09T00:58:37.365066+0000","last_active":"2024-05-09T01:00:18.923224+0000","last_peered":"2024-05-09T01:00:18.923224+0000","last_clean":"2024-05-09T01:00:18.923224+0000","last_became_active":"2024-05-09T00:58:37.364638+0000","last_became_peered":"2024-05-09T00:58:37.364638+0000","last_unstale":"2024-05-09T01:00:18.923224+0000","last_undegraded":"2024-05-09T01:00:18.923224+0000","last_fullsized":"2024-05-09T01:00:18.923224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:14.706123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926289+0000","last_change":"2024-05-09T00:58:37.366880+0000","last_active":"2024-05-09T01:00:18.926289+0000","last_peered":"2024-05-09T01:00:18.926289+0000","last_clean":"2024-05-09T01:00:18.926289+0000","last_became_active":"2024-05-09T00:58:37.366510+0000","last_became_peered":"2024-05-09T00:58:37.366510+0000","last_unstale":"2024-05-09T01:00:18.926289+0000","last_undegraded":"2024-05-09T01:00:18.926289+0000","last_fullsized":"2024-05-09T01:00:18.926289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:36.968096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916863+0000","last_change":"2024-05-09T00:58:37.363258+0000","last_active":"2024-05-09T01:00:18.916863+0000","last_peered":"2024-05-09T01:00:18.916863+0000","last_clean":"2024-05-09T01:00:18.916863+0000","last_became_active":"2024-05-09T00:58:37.362791+0000","last_became_peered":"2024-05-09T00:58:37.362791+0000","last_unstale":"2024-05-09T01:00:18.916863+0000","last_undegraded":"2024-05-09T01:00:18.916863+0000","last_fullsized":"2024-05-09T01:00:18.916863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:03.341731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913744+0000","last_change":"2024-05-09T00:58:37.371276+0000","last_active":"2024-05-09T01:00:18.913744+0000","last_peered":"2024-05-09T01:00:18.913744+0000","last_clean":"2024-05-09T01:00:18.913744+0000","last_became_active":"2024-05-09T00:58:37.370881+0000","last_became_peered":"2024-05-09T00:58:37.370881+0000","last_unstale":"2024-05-09T01:00:18.913744+0000","last_undegraded":"2024-05-09T01:00:18.913744+0000","last_fullsized":"2024-05-09T01:00:18.913744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:14.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919238+0000","last_change":"2024-05-09T00:58:37.361394+0000","last_active":"2024-05-09T01:00:18.919238+0000","last_peered":"2024-05-09T01:00:18.919238+0000","last_clean":"2024-05-09T01:00:18.919238+0000","last_became_active":"2024-05-09T00:58:37.360669+0000","last_became_peered":"2024-05-09T00:58:37.360669+0000","last_unstale":"2024-05-09T01:00:18.919238+0000","last_undegraded":"2024-05-09T01:00:18.919238+0000","last_fullsized":"2024-05-09T01:00:18.919238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.110889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920471+0000","last_change":"2024-05-09T00:58:37.371900+0000","last_active":"2024-05-09T01:00:18.920471+0000","last_peered":"2024-05-09T01:00:18.920471+0000","last_clean":"2024-05-09T01:00:18.920471+0000","last_became_active":"2024-05-09T00:58:37.368608+0000","last_became_peered":"2024-05-09T00:58:37.368608+0000","last_unstale":"2024-05-09T01:00:18.920471+0000","last_undegraded":"2024-05-09T01:00:18.920471+0000","last_fullsized":"2024-05-09T01:00:18.920471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:17.673058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926719+0000","last_change":"2024-05-09T00:58:37.372717+0000","last_active":"2024-05-09T01:00:18.926719+0000","last_peered":"2024-05-09T01:00:18.926719+0000","last_clean":"2024-05-09T01:00:18.926719+0000","last_became_active":"2024-05-09T00:58:37.372376+0000","last_became_peered":"2024-05-09T00:58:37.372376+0000","last_unstale":"2024-05-09T01:00:18.926719+0000","last_undegraded":"2024-05-09T01:00:18.926719+0000","last_fullsized":"2024-05-09T01:00:18.926719+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:51.092242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924222+0000","last_change":"2024-05-09T00:58:37.373971+0000","last_active":"2024-05-09T01:00:18.924222+0000","last_peered":"2024-05-09T01:00:18.924222+0000","last_clean":"2024-05-09T01:00:18.924222+0000","last_became_active":"2024-05-09T00:58:37.373620+0000","last_became_peered":"2024-05-09T00:58:37.373620+0000","last_unstale":"2024-05-09T01:00:18.924222+0000","last_undegraded":"2024-05-09T01:00:18.924222+0000","last_fullsized":"2024-05-09T01:00:18.924222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.070455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914149+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.914149+0000","last_peered":"2024-05-09T01:00:18.914149+0000","last_clean":"2024-05-09T01:00:18.914149+0000","last_became_active":"2024-05-09T00:58:37.367820+0000","last_became_peered":"2024-05-09T00:58:37.367820+0000","last_unstale":"2024-05-09T01:00:18.914149+0000","last_undegraded":"2024-05-09T01:00:18.914149+0000","last_fullsized":"2024-05-09T01:00:18.914149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:45.207654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918475+0000","last_change":"2024-05-09T00:58:37.358736+0000","last_active":"2024-05-09T01:00:18.918475+0000","last_peered":"2024-05-09T01:00:18.918475+0000","last_clean":"2024-05-09T01:00:18.918475+0000","last_became_active":"2024-05-09T00:58:37.358354+0000","last_became_peered":"2024-05-09T00:58:37.358354+0000","last_unstale":"2024-05-09T01:00:18.918475+0000","last_undegraded":"2024-05-09T01:00:18.918475+0000","last_fullsized":"2024-05-09T01:00:18.918475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:51.084484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.146519+0000","last_change":"2024-05-09T00:58:34.333847+0000","last_active":"2024-05-09T01:00:30.146519+0000","last_peered":"2024-05-09T01:00:30.146519+0000","last_clean":"2024-05-09T01:00:30.146519+0000","last_became_active":"2024-05-09T00:58:34.333479+0000","last_became_peered":"2024-05-09T00:58:34.333479+0000","last_unstale":"2024-05-09T01:00:30.146519+0000","last_undegraded":"2024-05-09T01:00:30.146519+0000","last_fullsized":"2024-05-09T01:00:30.146519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:53.709034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915266+0000","last_change":"2024-05-09T00:58:37.367327+0000","last_active":"2024-05-09T01:00:18.915266+0000","last_peered":"2024-05-09T01:00:18.915266+0000","last_clean":"2024-05-09T01:00:18.915266+0000","last_became_active":"2024-05-09T00:58:37.366973+0000","last_became_peered":"2024-05-09T00:58:37.366973+0000","last_unstale":"2024-05-09T01:00:18.915266+0000","last_undegraded":"2024-05-09T01:00:18.915266+0000","last_fullsized":"2024-05-09T01:00:18.915266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:10.610274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078226+0000","last_change":"2024-05-09T00:58:34.821107+0000","last_active":"2024-05-09T00:59:20.078226+0000","last_peered":"2024-05-09T00:59:20.078226+0000","last_clean":"2024-05-09T00:59:20.078226+0000","last_became_active":"2024-05-09T00:58:34.820737+0000","last_became_peered":"2024-05-09T00:58:34.820737+0000","last_unstale":"2024-05-09T00:59:20.078226+0000","last_undegraded":"2024-05-09T00:59:20.078226+0000","last_fullsized":"2024-05-09T00:59:20.078226+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:45.450781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924709+0000","last_change":"2024-05-09T00:58:37.363559+0000","last_active":"2024-05-09T01:00:18.924709+0000","last_peered":"2024-05-09T01:00:18.924709+0000","last_clean":"2024-05-09T01:00:18.924709+0000","last_became_active":"2024-05-09T00:58:37.358299+0000","last_became_peered":"2024-05-09T00:58:37.358299+0000","last_unstale":"2024-05-09T01:00:18.924709+0000","last_undegraded":"2024-05-09T01:00:18.924709+0000","last_fullsized":"2024-05-09T01:00:18.924709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:15.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077192+0000","last_change":"2024-05-09T00:58:34.333154+0000","last_active":"2024-05-09T00:59:20.077192+0000","last_peered":"2024-05-09T00:59:20.077192+0000","last_clean":"2024-05-09T00:59:20.077192+0000","last_became_active":"2024-05-09T00:58:34.332469+0000","last_became_peered":"2024-05-09T00:58:34.332469+0000","last_unstale":"2024-05-09T00:59:20.077192+0000","last_undegraded":"2024-05-09T00:59:20.077192+0000","last_fullsized":"2024-05-09T00:59:20.077192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:56.343377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925090+0000","last_change":"2024-05-09T00:58:37.361595+0000","last_active":"2024-05-09T01:00:18.925090+0000","last_peered":"2024-05-09T01:00:18.925090+0000","last_clean":"2024-05-09T01:00:18.925090+0000","last_became_active":"2024-05-09T00:58:37.361239+0000","last_became_peered":"2024-05-09T00:58:37.361239+0000","last_unstale":"2024-05-09T01:00:18.925090+0000","last_undegraded":"2024-05-09T01:00:18.925090+0000","last_fullsized":"2024-05-09T01:00:18.925090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:24.526487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077004+0000","last_change":"2024-05-09T00:58:34.331974+0000","last_active":"2024-05-09T00:59:20.077004+0000","last_peered":"2024-05-09T00:59:20.077004+0000","last_clean":"2024-05-09T00:59:20.077004+0000","last_became_active":"2024-05-09T00:58:34.331460+0000","last_became_peered":"2024-05-09T00:58:34.331460+0000","last_unstale":"2024-05-09T00:59:20.077004+0000","last_undegraded":"2024-05-09T00:59:20.077004+0000","last_fullsized":"2024-05-09T00:59:20.077004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:17.746247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918649+0000","last_change":"2024-05-09T00:58:37.370155+0000","last_active":"2024-05-09T01:00:18.918649+0000","last_peered":"2024-05-09T01:00:18.918649+0000","last_clean":"2024-05-09T01:00:18.918649+0000","last_became_active":"2024-05-09T00:58:37.369351+0000","last_became_peered":"2024-05-09T00:58:37.369351+0000","last_unstale":"2024-05-09T01:00:18.918649+0000","last_undegraded":"2024-05-09T01:00:18.918649+0000","last_fullsized":"2024-05-09T01:00:18.918649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:57.494715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:27.145616+0000","last_change":"2024-05-09T00:58:34.332532+0000","last_active":"2024-05-09T01:00:27.145616+0000","last_peered":"2024-05-09T01:00:27.145616+0000","last_clean":"2024-05-09T01:00:27.145616+0000","last_became_active":"2024-05-09T00:58:34.332202+0000","last_became_peered":"2024-05-09T00:58:34.332202+0000","last_unstale":"2024-05-09T01:00:27.145616+0000","last_undegraded":"2024-05-09T01:00:27.145616+0000","last_fullsized":"2024-05-09T01:00:27.145616+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:17.561374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.907065+0000","last_change":"2024-05-09T00:58:37.360504+0000","last_active":"2024-05-09T01:00:18.907065+0000","last_peered":"2024-05-09T01:00:18.907065+0000","last_clean":"2024-05-09T01:00:18.907065+0000","last_became_active":"2024-05-09T00:58:37.360078+0000","last_became_peered":"2024-05-09T00:58:37.360078+0000","last_unstale":"2024-05-09T01:00:18.907065+0000","last_undegraded":"2024-05-09T01:00:18.907065+0000","last_fullsized":"2024-05-09T01:00:18.907065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:19.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074437+0000","last_change":"2024-05-09T00:58:34.333762+0000","last_active":"2024-05-09T00:59:20.074437+0000","last_peered":"2024-05-09T00:59:20.074437+0000","last_clean":"2024-05-09T00:59:20.074437+0000","last_became_active":"2024-05-09T00:58:34.333376+0000","last_became_peered":"2024-05-09T00:58:34.333376+0000","last_unstale":"2024-05-09T00:59:20.074437+0000","last_undegraded":"2024-05-09T00:59:20.074437+0000","last_fullsized":"2024-05-09T00:59:20.074437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:58.027982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.909915+0000","last_change":"2024-05-09T00:59:20.081897+0000","last_active":"2024-05-09T01:00:18.909915+0000","last_peered":"2024-05-09T01:00:18.909915+0000","last_clean":"2024-05-09T01:00:18.909915+0000","last_became_active":"2024-05-09T00:59:20.081446+0000","last_became_peered":"2024-05-09T00:59:20.081446+0000","last_unstale":"2024-05-09T01:00:18.909915+0000","last_undegraded":"2024-05-09T01:00:18.909915+0000","last_fullsized":"2024-05-09T01:00:18.909915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:58.471576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072992+0000","last_change":"2024-05-09T00:58:34.332308+0000","last_active":"2024-05-09T00:59:20.072992+0000","last_peered":"2024-05-09T00:59:20.072992+0000","last_clean":"2024-05-09T00:59:20.072992+0000","last_became_active":"2024-05-09T00:58:34.331154+0000","last_became_peered":"2024-05-09T00:58:34.331154+0000","last_unstale":"2024-05-09T00:59:20.072992+0000","last_undegraded":"2024-05-09T00:59:20.072992+0000","last_fullsized":"2024-05-09T00:59:20.072992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.781375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920181+0000","last_change":"2024-05-09T00:58:37.368925+0000","last_active":"2024-05-09T01:00:18.920181+0000","last_peered":"2024-05-09T01:00:18.920181+0000","last_clean":"2024-05-09T01:00:18.920181+0000","last_became_active":"2024-05-09T00:58:37.368586+0000","last_became_peered":"2024-05-09T00:58:37.368586+0000","last_unstale":"2024-05-09T01:00:18.920181+0000","last_undegraded":"2024-05-09T01:00:18.920181+0000","last_fullsized":"2024-05-09T01:00:18.920181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:57.248832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078023+0000","last_change":"2024-05-09T00:58:34.334356+0000","last_active":"2024-05-09T00:59:20.078023+0000","last_peered":"2024-05-09T00:59:20.078023+0000","last_clean":"2024-05-09T00:59:20.078023+0000","last_became_active":"2024-05-09T00:58:34.333993+0000","last_became_peered":"2024-05-09T00:58:34.333993+0000","last_unstale":"2024-05-09T00:59:20.078023+0000","last_undegraded":"2024-05-09T00:59:20.078023+0000","last_fullsized":"2024-05-09T00:59:20.078023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:19.793851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914947+0000","last_change":"2024-05-09T00:58:37.360565+0000","last_active":"2024-05-09T01:00:18.914947+0000","last_peered":"2024-05-09T01:00:18.914947+0000","last_clean":"2024-05-09T01:00:18.914947+0000","last_became_active":"2024-05-09T00:58:37.360215+0000","last_became_peered":"2024-05-09T00:58:37.360215+0000","last_unstale":"2024-05-09T01:00:18.914947+0000","last_undegraded":"2024-05-09T01:00:18.914947+0000","last_fullsized":"2024-05-09T01:00:18.914947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:12.877333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'5","reported_seq":219,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.149272+0000","last_change":"2024-05-09T00:58:34.332654+0000","last_active":"2024-05-09T01:00:30.149272+0000","last_peered":"2024-05-09T01:00:30.149272+0000","last_clean":"2024-05-09T01:00:30.149272+0000","last_became_active":"2024-05-09T00:58:34.331915+0000","last_became_peered":"2024-05-09T00:58:34.331915+0000","last_unstale":"2024-05-09T01:00:30.149272+0000","last_undegraded":"2024-05-09T01:00:30.149272+0000","last_fullsized":"2024-05-09T01:00:30.149272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:47.521158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924708+0000","last_change":"2024-05-09T00:58:37.364248+0000","last_active":"2024-05-09T01:00:18.924708+0000","last_peered":"2024-05-09T01:00:18.924708+0000","last_clean":"2024-05-09T01:00:18.924708+0000","last_became_active":"2024-05-09T00:58:37.363872+0000","last_became_peered":"2024-05-09T00:58:37.363872+0000","last_unstale":"2024-05-09T01:00:18.924708+0000","last_undegraded":"2024-05-09T01:00:18.924708+0000","last_fullsized":"2024-05-09T01:00:18.924708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075486+0000","last_change":"2024-05-09T00:58:34.331157+0000","last_active":"2024-05-09T00:59:20.075486+0000","last_peered":"2024-05-09T00:59:20.075486+0000","last_clean":"2024-05-09T00:59:20.075486+0000","last_became_active":"2024-05-09T00:58:34.330151+0000","last_became_peered":"2024-05-09T00:58:34.330151+0000","last_unstale":"2024-05-09T00:59:20.075486+0000","last_undegraded":"2024-05-09T00:59:20.075486+0000","last_fullsized":"2024-05-09T00:59:20.075486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:07.777304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916453+0000","last_change":"2024-05-09T00:58:37.369357+0000","last_active":"2024-05-09T01:00:18.916453+0000","last_peered":"2024-05-09T01:00:18.916453+0000","last_clean":"2024-05-09T01:00:18.916453+0000","last_became_active":"2024-05-09T00:58:37.368994+0000","last_became_peered":"2024-05-09T00:58:37.368994+0000","last_unstale":"2024-05-09T01:00:18.916453+0000","last_undegraded":"2024-05-09T01:00:18.916453+0000","last_fullsized":"2024-05-09T01:00:18.916453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079900+0000","last_change":"2024-05-09T00:58:34.822508+0000","last_active":"2024-05-09T00:59:20.079900+0000","last_peered":"2024-05-09T00:59:20.079900+0000","last_clean":"2024-05-09T00:59:20.079900+0000","last_became_active":"2024-05-09T00:58:34.821765+0000","last_became_peered":"2024-05-09T00:58:34.821765+0000","last_unstale":"2024-05-09T00:59:20.079900+0000","last_undegraded":"2024-05-09T00:59:20.079900+0000","last_fullsized":"2024-05-09T00:59:20.079900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:56.931158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926487+0000","last_change":"2024-05-09T00:58:37.362739+0000","last_active":"2024-05-09T01:00:18.926487+0000","last_peered":"2024-05-09T01:00:18.926487+0000","last_clean":"2024-05-09T01:00:18.926487+0000","last_became_active":"2024-05-09T00:58:37.362395+0000","last_became_peered":"2024-05-09T00:58:37.362395+0000","last_unstale":"2024-05-09T01:00:18.926487+0000","last_undegraded":"2024-05-09T01:00:18.926487+0000","last_fullsized":"2024-05-09T01:00:18.926487+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:51.380197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":258,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.158206+0000","last_change":"2024-05-09T00:58:34.336548+0000","last_active":"2024-05-09T01:00:30.158206+0000","last_peered":"2024-05-09T01:00:30.158206+0000","last_clean":"2024-05-09T01:00:30.158206+0000","last_became_active":"2024-05-09T00:58:34.335792+0000","last_became_peered":"2024-05-09T00:58:34.335792+0000","last_unstale":"2024-05-09T01:00:30.158206+0000","last_undegraded":"2024-05-09T01:00:30.158206+0000","last_fullsized":"2024-05-09T01:00:30.158206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:37.996544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60596,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":158,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918090+0000","last_change":"2024-05-09T00:58:37.365468+0000","last_active":"2024-05-09T01:00:18.918090+0000","last_peered":"2024-05-09T01:00:18.918090+0000","last_clean":"2024-05-09T01:00:18.918090+0000","last_became_active":"2024-05-09T00:58:37.365085+0000","last_became_peered":"2024-05-09T00:58:37.365085+0000","last_unstale":"2024-05-09T01:00:18.918090+0000","last_undegraded":"2024-05-09T01:00:18.918090+0000","last_fullsized":"2024-05-09T01:00:18.918090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:06.836757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077180+0000","last_change":"2024-05-09T00:58:34.331174+0000","last_active":"2024-05-09T00:59:20.077180+0000","last_peered":"2024-05-09T00:59:20.077180+0000","last_clean":"2024-05-09T00:59:20.077180+0000","last_became_active":"2024-05-09T00:58:34.330871+0000","last_became_peered":"2024-05-09T00:58:34.330871+0000","last_unstale":"2024-05-09T00:59:20.077180+0000","last_undegraded":"2024-05-09T00:59:20.077180+0000","last_fullsized":"2024-05-09T00:59:20.077180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:21:47.840730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.907084+0000","last_change":"2024-05-09T00:58:37.367821+0000","last_active":"2024-05-09T01:00:18.907084+0000","last_peered":"2024-05-09T01:00:18.907084+0000","last_clean":"2024-05-09T01:00:18.907084+0000","last_became_active":"2024-05-09T00:58:37.367495+0000","last_became_peered":"2024-05-09T00:58:37.367495+0000","last_unstale":"2024-05-09T01:00:18.907084+0000","last_undegraded":"2024-05-09T01:00:18.907084+0000","last_fullsized":"2024-05-09T01:00:18.907084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:08.285301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078474+0000","last_change":"2024-05-09T00:58:34.334381+0000","last_active":"2024-05-09T00:59:20.078474+0000","last_peered":"2024-05-09T00:59:20.078474+0000","last_clean":"2024-05-09T00:59:20.078474+0000","last_became_active":"2024-05-09T00:58:34.333948+0000","last_became_peered":"2024-05-09T00:58:34.333948+0000","last_unstale":"2024-05-09T00:59:20.078474+0000","last_undegraded":"2024-05-09T00:59:20.078474+0000","last_fullsized":"2024-05-09T00:59:20.078474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:05.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913942+0000","last_change":"2024-05-09T00:59:20.079435+0000","last_active":"2024-05-09T01:00:18.913942+0000","last_peered":"2024-05-09T01:00:18.913942+0000","last_clean":"2024-05-09T01:00:18.913942+0000","last_became_active":"2024-05-09T00:59:20.079110+0000","last_became_peered":"2024-05-09T00:59:20.079110+0000","last_unstale":"2024-05-09T01:00:18.913942+0000","last_undegraded":"2024-05-09T01:00:18.913942+0000","last_fullsized":"2024-05-09T01:00:18.913942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:31.449360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:28.155687+0000","last_change":"2024-05-09T00:58:34.335831+0000","last_active":"2024-05-09T01:00:28.155687+0000","last_peered":"2024-05-09T01:00:28.155687+0000","last_clean":"2024-05-09T01:00:28.155687+0000","last_became_active":"2024-05-09T00:58:34.334950+0000","last_became_peered":"2024-05-09T00:58:34.334950+0000","last_unstale":"2024-05-09T01:00:28.155687+0000","last_undegraded":"2024-05-09T01:00:28.155687+0000","last_fullsized":"2024-05-09T01:00:28.155687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:05.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":98,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914131+0000","last_change":"2024-05-09T00:58:37.373115+0000","last_active":"2024-05-09T01:00:18.914131+0000","last_peered":"2024-05-09T01:00:18.914131+0000","last_clean":"2024-05-09T01:00:18.914131+0000","last_became_active":"2024-05-09T00:58:37.369976+0000","last_became_peered":"2024-05-09T00:58:37.369976+0000","last_unstale":"2024-05-09T01:00:18.914131+0000","last_undegraded":"2024-05-09T01:00:18.914131+0000","last_fullsized":"2024-05-09T01:00:18.914131+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:40.439954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.096415+0000","last_change":"2024-05-09T00:59:20.095889+0000","last_active":"2024-05-09T00:59:20.096415+0000","last_peered":"2024-05-09T00:59:20.096415+0000","last_clean":"2024-05-09T00:59:20.096415+0000","last_became_active":"2024-05-09T00:59:20.078865+0000","last_became_peered":"2024-05-09T00:59:20.078865+0000","last_unstale":"2024-05-09T00:59:20.096415+0000","last_undegraded":"2024-05-09T00:59:20.096415+0000","last_fullsized":"2024-05-09T00:59:20.096415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.470868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.906074+0000","last_change":"2024-05-09T00:59:20.349963+0000","last_active":"2024-05-09T01:00:18.906074+0000","last_peered":"2024-05-09T01:00:18.906074+0000","last_clean":"2024-05-09T01:00:18.906074+0000","last_became_active":"2024-05-09T00:59:20.349510+0000","last_became_peered":"2024-05-09T00:59:20.349510+0000","last_unstale":"2024-05-09T01:00:18.906074+0000","last_undegraded":"2024-05-09T01:00:18.906074+0000","last_fullsized":"2024-05-09T01:00:18.906074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:33.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077294+0000","last_change":"2024-05-09T00:58:34.331661+0000","last_active":"2024-05-09T00:59:20.077294+0000","last_peered":"2024-05-09T00:59:20.077294+0000","last_clean":"2024-05-09T00:59:20.077294+0000","last_became_active":"2024-05-09T00:58:34.331271+0000","last_became_peered":"2024-05-09T00:58:34.331271+0000","last_unstale":"2024-05-09T00:59:20.077294+0000","last_undegraded":"2024-05-09T00:59:20.077294+0000","last_fullsized":"2024-05-09T00:59:20.077294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:10.130811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916372+0000","last_change":"2024-05-09T00:58:37.367367+0000","last_active":"2024-05-09T01:00:18.916372+0000","last_peered":"2024-05-09T01:00:18.916372+0000","last_clean":"2024-05-09T01:00:18.916372+0000","last_became_active":"2024-05-09T00:58:37.366927+0000","last_became_peered":"2024-05-09T00:58:37.366927+0000","last_unstale":"2024-05-09T01:00:18.916372+0000","last_undegraded":"2024-05-09T01:00:18.916372+0000","last_fullsized":"2024-05-09T01:00:18.916372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:31.066913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077749+0000","last_change":"2024-05-09T00:58:34.821956+0000","last_active":"2024-05-09T00:59:20.077749+0000","last_peered":"2024-05-09T00:59:20.077749+0000","last_clean":"2024-05-09T00:59:20.077749+0000","last_became_active":"2024-05-09T00:58:34.821570+0000","last_became_peered":"2024-05-09T00:58:34.821570+0000","last_unstale":"2024-05-09T00:59:20.077749+0000","last_undegraded":"2024-05-09T00:59:20.077749+0000","last_fullsized":"2024-05-09T00:59:20.077749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:45.027927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.909732+0000","last_change":"2024-05-09T00:58:37.361646+0000","last_active":"2024-05-09T01:00:18.909732+0000","last_peered":"2024-05-09T01:00:18.909732+0000","last_clean":"2024-05-09T01:00:18.909732+0000","last_became_active":"2024-05-09T00:58:37.360216+0000","last_became_peered":"2024-05-09T00:58:37.360216+0000","last_unstale":"2024-05-09T01:00:18.909732+0000","last_undegraded":"2024-05-09T01:00:18.909732+0000","last_fullsized":"2024-05-09T01:00:18.909732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:13.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'5","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:28.144193+0000","last_change":"2024-05-09T00:58:34.330657+0000","last_active":"2024-05-09T01:00:28.144193+0000","last_peered":"2024-05-09T01:00:28.144193+0000","last_clean":"2024-05-09T01:00:28.144193+0000","last_became_active":"2024-05-09T00:58:34.330235+0000","last_became_peered":"2024-05-09T00:58:34.330235+0000","last_unstale":"2024-05-09T01:00:28.144193+0000","last_undegraded":"2024-05-09T01:00:28.144193+0000","last_fullsized":"2024-05-09T01:00:28.144193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:21.647916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923215+0000","last_change":"2024-05-09T00:58:37.361155+0000","last_active":"2024-05-09T01:00:18.923215+0000","last_peered":"2024-05-09T01:00:18.923215+0000","last_clean":"2024-05-09T01:00:18.923215+0000","last_became_active":"2024-05-09T00:58:37.360653+0000","last_became_peered":"2024-05-09T00:58:37.360653+0000","last_unstale":"2024-05-09T01:00:18.923215+0000","last_undegraded":"2024-05-09T01:00:18.923215+0000","last_fullsized":"2024-05-09T01:00:18.923215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:49.473522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913024+0000","last_change":"2024-05-09T00:58:37.367592+0000","last_active":"2024-05-09T01:00:18.913024+0000","last_peered":"2024-05-09T01:00:18.913024+0000","last_clean":"2024-05-09T01:00:18.913024+0000","last_became_active":"2024-05-09T00:58:37.366365+0000","last_became_peered":"2024-05-09T00:58:37.366365+0000","last_unstale":"2024-05-09T01:00:18.913024+0000","last_undegraded":"2024-05-09T01:00:18.913024+0000","last_fullsized":"2024-05-09T01:00:18.913024+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:37.279269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:29.156463+0000","last_change":"2024-05-09T00:58:34.821092+0000","last_active":"2024-05-09T01:00:29.156463+0000","last_peered":"2024-05-09T01:00:29.156463+0000","last_clean":"2024-05-09T01:00:29.156463+0000","last_became_active":"2024-05-09T00:58:34.820713+0000","last_became_peered":"2024-05-09T00:58:34.820713+0000","last_unstale":"2024-05-09T01:00:29.156463+0000","last_undegraded":"2024-05-09T01:00:29.156463+0000","last_fullsized":"2024-05-09T01:00:29.156463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:11.372613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915974+0000","last_change":"2024-05-09T00:58:37.364624+0000","last_active":"2024-05-09T01:00:18.915974+0000","last_peered":"2024-05-09T01:00:18.915974+0000","last_clean":"2024-05-09T01:00:18.915974+0000","last_became_active":"2024-05-09T00:58:37.364013+0000","last_became_peered":"2024-05-09T00:58:37.364013+0000","last_unstale":"2024-05-09T01:00:18.915974+0000","last_undegraded":"2024-05-09T01:00:18.915974+0000","last_fullsized":"2024-05-09T01:00:18.915974+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:14.205958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.349071+0000","last_change":"2024-05-09T00:58:34.335364+0000","last_active":"2024-05-09T00:59:20.349071+0000","last_peered":"2024-05-09T00:59:20.349071+0000","last_clean":"2024-05-09T00:59:20.349071+0000","last_became_active":"2024-05-09T00:58:34.334965+0000","last_became_peered":"2024-05-09T00:58:34.334965+0000","last_unstale":"2024-05-09T00:59:20.349071+0000","last_undegraded":"2024-05-09T00:59:20.349071+0000","last_fullsized":"2024-05-09T00:59:20.349071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:50.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075224+0000","last_change":"2024-05-09T00:57:07.637377+0000","last_active":"2024-05-09T00:59:20.075224+0000","last_peered":"2024-05-09T00:59:20.075224+0000","last_clean":"2024-05-09T00:59:20.075224+0000","last_became_active":"2024-05-09T00:57:07.631727+0000","last_became_peered":"2024-05-09T00:57:07.631727+0000","last_unstale":"2024-05-09T00:59:20.075224+0000","last_undegraded":"2024-05-09T00:59:20.075224+0000","last_fullsized":"2024-05-09T00:59:20.075224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_clean_scrub_stamp":"2024-05-09T00:53:47.457762+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:09.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913338+0000","last_change":"2024-05-09T00:59:20.081462+0000","last_active":"2024-05-09T01:00:18.913338+0000","last_peered":"2024-05-09T01:00:18.913338+0000","last_clean":"2024-05-09T01:00:18.913338+0000","last_became_active":"2024-05-09T00:59:20.080955+0000","last_became_peered":"2024-05-09T00:59:20.080955+0000","last_unstale":"2024-05-09T01:00:18.913338+0000","last_undegraded":"2024-05-09T01:00:18.913338+0000","last_fullsized":"2024-05-09T01:00:18.913338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:11.106912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075354+0000","last_change":"2024-05-09T00:58:34.329694+0000","last_active":"2024-05-09T00:59:20.075354+0000","last_peered":"2024-05-09T00:59:20.075354+0000","last_clean":"2024-05-09T00:59:20.075354+0000","last_became_active":"2024-05-09T00:58:34.329267+0000","last_became_peered":"2024-05-09T00:58:34.329267+0000","last_unstale":"2024-05-09T00:59:20.075354+0000","last_undegraded":"2024-05-09T00:59:20.075354+0000","last_fullsized":"2024-05-09T00:59:20.075354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:28.060489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077064+0000","last_change":"2024-05-09T00:58:34.822706+0000","last_active":"2024-05-09T00:59:20.077064+0000","last_peered":"2024-05-09T00:59:20.077064+0000","last_clean":"2024-05-09T00:59:20.077064+0000","last_became_active":"2024-05-09T00:58:34.822223+0000","last_became_peered":"2024-05-09T00:58:34.822223+0000","last_unstale":"2024-05-09T00:59:20.077064+0000","last_undegraded":"2024-05-09T00:59:20.077064+0000","last_fullsized":"2024-05-09T00:59:20.077064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:47.378798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.908295+0000","last_change":"2024-05-09T00:58:37.360600+0000","last_active":"2024-05-09T01:00:18.908295+0000","last_peered":"2024-05-09T01:00:18.908295+0000","last_clean":"2024-05-09T01:00:18.908295+0000","last_became_active":"2024-05-09T00:58:37.360265+0000","last_became_peered":"2024-05-09T00:58:37.360265+0000","last_unstale":"2024-05-09T01:00:18.908295+0000","last_undegraded":"2024-05-09T01:00:18.908295+0000","last_fullsized":"2024-05-09T01:00:18.908295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:44.423709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'16","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.372236+0000","last_change":"2024-05-09T00:58:34.331544+0000","last_active":"2024-05-09T00:59:20.372236+0000","last_peered":"2024-05-09T00:59:20.372236+0000","last_clean":"2024-05-09T00:59:20.372236+0000","last_became_active":"2024-05-09T00:58:34.331147+0000","last_became_peered":"2024-05-09T00:58:34.331147+0000","last_unstale":"2024-05-09T00:59:20.372236+0000","last_undegraded":"2024-05-09T00:59:20.372236+0000","last_fullsized":"2024-05-09T00:59:20.372236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:27.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920210+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.920210+0000","last_peered":"2024-05-09T01:00:18.920210+0000","last_clean":"2024-05-09T01:00:18.920210+0000","last_became_active":"2024-05-09T00:58:37.367875+0000","last_became_peered":"2024-05-09T00:58:37.367875+0000","last_unstale":"2024-05-09T01:00:18.920210+0000","last_undegraded":"2024-05-09T01:00:18.920210+0000","last_fullsized":"2024-05-09T01:00:18.920210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:45.800008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348673+0000","last_change":"2024-05-09T00:58:34.956500+0000","last_active":"2024-05-09T00:59:20.348673+0000","last_peered":"2024-05-09T00:59:20.348673+0000","last_clean":"2024-05-09T00:59:20.348673+0000","last_became_active":"2024-05-09T00:58:34.956108+0000","last_became_peered":"2024-05-09T00:58:34.956108+0000","last_unstale":"2024-05-09T00:59:20.348673+0000","last_undegraded":"2024-05-09T00:59:20.348673+0000","last_fullsized":"2024-05-09T00:59:20.348673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:03.283325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925261+0000","last_change":"2024-05-09T00:58:37.369174+0000","last_active":"2024-05-09T01:00:18.925261+0000","last_peered":"2024-05-09T01:00:18.925261+0000","last_clean":"2024-05-09T01:00:18.925261+0000","last_became_active":"2024-05-09T00:58:37.368650+0000","last_became_peered":"2024-05-09T00:58:37.368650+0000","last_unstale":"2024-05-09T01:00:18.925261+0000","last_undegraded":"2024-05-09T01:00:18.925261+0000","last_fullsized":"2024-05-09T01:00:18.925261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:07.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.087845+0000","last_change":"2024-05-09T00:58:34.821742+0000","last_active":"2024-05-09T00:59:20.087845+0000","last_peered":"2024-05-09T00:59:20.087845+0000","last_clean":"2024-05-09T00:59:20.087845+0000","last_became_active":"2024-05-09T00:58:34.821290+0000","last_became_peered":"2024-05-09T00:58:34.821290+0000","last_unstale":"2024-05-09T00:59:20.087845+0000","last_undegraded":"2024-05-09T00:59:20.087845+0000","last_fullsized":"2024-05-09T00:59:20.087845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:18.735763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.890604+0000","last_change":"2024-05-09T00:58:37.361727+0000","last_active":"2024-05-09T01:00:18.890604+0000","last_peered":"2024-05-09T01:00:18.890604+0000","last_clean":"2024-05-09T01:00:18.890604+0000","last_became_active":"2024-05-09T00:58:37.361351+0000","last_became_peered":"2024-05-09T00:58:37.361351+0000","last_unstale":"2024-05-09T01:00:18.890604+0000","last_undegraded":"2024-05-09T01:00:18.890604+0000","last_fullsized":"2024-05-09T01:00:18.890604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:14.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077882+0000","last_change":"2024-05-09T00:58:34.330578+0000","last_active":"2024-05-09T00:59:20.077882+0000","last_peered":"2024-05-09T00:59:20.077882+0000","last_clean":"2024-05-09T00:59:20.077882+0000","last_became_active":"2024-05-09T00:58:34.330273+0000","last_became_peered":"2024-05-09T00:58:34.330273+0000","last_unstale":"2024-05-09T00:59:20.077882+0000","last_undegraded":"2024-05-09T00:59:20.077882+0000","last_fullsized":"2024-05-09T00:59:20.077882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:45.795771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917899+0000","last_change":"2024-05-09T00:58:37.371323+0000","last_active":"2024-05-09T01:00:18.917899+0000","last_peered":"2024-05-09T01:00:18.917899+0000","last_clean":"2024-05-09T01:00:18.917899+0000","last_became_active":"2024-05-09T00:58:37.370942+0000","last_became_peered":"2024-05-09T00:58:37.370942+0000","last_unstale":"2024-05-09T01:00:18.917899+0000","last_undegraded":"2024-05-09T01:00:18.917899+0000","last_fullsized":"2024-05-09T01:00:18.917899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:57.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.100103+0000","last_change":"2024-05-09T00:59:20.099633+0000","last_active":"2024-05-09T00:59:20.100103+0000","last_peered":"2024-05-09T00:59:20.100103+0000","last_clean":"2024-05-09T00:59:20.100103+0000","last_became_active":"2024-05-09T00:59:20.080964+0000","last_became_peered":"2024-05-09T00:59:20.080964+0000","last_unstale":"2024-05-09T00:59:20.100103+0000","last_undegraded":"2024-05-09T00:59:20.100103+0000","last_fullsized":"2024-05-09T00:59:20.100103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:53.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918851+0000","last_change":"2024-05-09T00:58:37.361319+0000","last_active":"2024-05-09T01:00:18.918851+0000","last_peered":"2024-05-09T01:00:18.918851+0000","last_clean":"2024-05-09T01:00:18.918851+0000","last_became_active":"2024-05-09T00:58:37.360703+0000","last_became_peered":"2024-05-09T00:58:37.360703+0000","last_unstale":"2024-05-09T01:00:18.918851+0000","last_undegraded":"2024-05-09T01:00:18.918851+0000","last_fullsized":"2024-05-09T01:00:18.918851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:24.202453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076474+0000","last_change":"2024-05-09T00:58:34.333394+0000","last_active":"2024-05-09T00:59:20.076474+0000","last_peered":"2024-05-09T00:59:20.076474+0000","last_clean":"2024-05-09T00:59:20.076474+0000","last_became_active":"2024-05-09T00:58:34.332902+0000","last_became_peered":"2024-05-09T00:58:34.332902+0000","last_unstale":"2024-05-09T00:59:20.076474+0000","last_undegraded":"2024-05-09T00:59:20.076474+0000","last_fullsized":"2024-05-09T00:59:20.076474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:38.301831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925334+0000","last_change":"2024-05-09T00:58:37.366963+0000","last_active":"2024-05-09T01:00:18.925334+0000","last_peered":"2024-05-09T01:00:18.925334+0000","last_clean":"2024-05-09T01:00:18.925334+0000","last_became_active":"2024-05-09T00:58:37.366591+0000","last_became_peered":"2024-05-09T00:58:37.366591+0000","last_unstale":"2024-05-09T01:00:18.925334+0000","last_undegraded":"2024-05-09T01:00:18.925334+0000","last_fullsized":"2024-05-09T01:00:18.925334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:44.894281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'7","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.150318+0000","last_change":"2024-05-09T00:58:34.956368+0000","last_active":"2024-05-09T01:00:30.150318+0000","last_peered":"2024-05-09T01:00:30.150318+0000","last_clean":"2024-05-09T01:00:30.150318+0000","last_became_active":"2024-05-09T00:58:34.955888+0000","last_became_peered":"2024-05-09T00:58:34.955888+0000","last_unstale":"2024-05-09T01:00:30.150318+0000","last_undegraded":"2024-05-09T01:00:30.150318+0000","last_fullsized":"2024-05-09T01:00:30.150318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:15.884435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926614+0000","last_change":"2024-05-09T00:58:37.368150+0000","last_active":"2024-05-09T01:00:18.926614+0000","last_peered":"2024-05-09T01:00:18.926614+0000","last_clean":"2024-05-09T01:00:18.926614+0000","last_became_active":"2024-05-09T00:58:37.367800+0000","last_became_peered":"2024-05-09T00:58:37.367800+0000","last_unstale":"2024-05-09T01:00:18.926614+0000","last_undegraded":"2024-05-09T01:00:18.926614+0000","last_fullsized":"2024-05-09T01:00:18.926614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:20.791816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079953+0000","last_change":"2024-05-09T00:58:34.329311+0000","last_active":"2024-05-09T00:59:20.079953+0000","last_peered":"2024-05-09T00:59:20.079953+0000","last_clean":"2024-05-09T00:59:20.079953+0000","last_became_active":"2024-05-09T00:58:34.328841+0000","last_became_peered":"2024-05-09T00:58:34.328841+0000","last_unstale":"2024-05-09T00:59:20.079953+0000","last_undegraded":"2024-05-09T00:59:20.079953+0000","last_fullsized":"2024-05-09T00:59:20.079953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.912688+0000","last_change":"2024-05-09T00:58:37.369498+0000","last_active":"2024-05-09T01:00:18.912688+0000","last_peered":"2024-05-09T01:00:18.912688+0000","last_clean":"2024-05-09T01:00:18.912688+0000","last_became_active":"2024-05-09T00:58:37.369166+0000","last_became_peered":"2024-05-09T00:58:37.369166+0000","last_unstale":"2024-05-09T01:00:18.912688+0000","last_undegraded":"2024-05-09T01:00:18.912688+0000","last_fullsized":"2024-05-09T01:00:18.912688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:56.411666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073056+0000","last_change":"2024-05-09T00:58:34.328756+0000","last_active":"2024-05-09T00:59:20.073056+0000","last_peered":"2024-05-09T00:59:20.073056+0000","last_clean":"2024-05-09T00:59:20.073056+0000","last_became_active":"2024-05-09T00:58:34.328381+0000","last_became_peered":"2024-05-09T00:58:34.328381+0000","last_unstale":"2024-05-09T00:59:20.073056+0000","last_undegraded":"2024-05-09T00:59:20.073056+0000","last_fullsized":"2024-05-09T00:59:20.073056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:26.558360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924991+0000","last_change":"2024-05-09T00:58:37.369557+0000","last_active":"2024-05-09T01:00:18.924991+0000","last_peered":"2024-05-09T01:00:18.924991+0000","last_clean":"2024-05-09T01:00:18.924991+0000","last_became_active":"2024-05-09T00:58:37.369225+0000","last_became_peered":"2024-05-09T00:58:37.369225+0000","last_unstale":"2024-05-09T01:00:18.924991+0000","last_undegraded":"2024-05-09T01:00:18.924991+0000","last_fullsized":"2024-05-09T01:00:18.924991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:21.761421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920013+0000","last_change":"2024-05-09T00:58:37.369919+0000","last_active":"2024-05-09T01:00:18.920013+0000","last_peered":"2024-05-09T01:00:18.920013+0000","last_clean":"2024-05-09T01:00:18.920013+0000","last_became_active":"2024-05-09T00:58:37.369507+0000","last_became_peered":"2024-05-09T00:58:37.369507+0000","last_unstale":"2024-05-09T01:00:18.920013+0000","last_undegraded":"2024-05-09T01:00:18.920013+0000","last_fullsized":"2024-05-09T01:00:18.920013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.294074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919725+0000","last_change":"2024-05-09T00:58:37.363775+0000","last_active":"2024-05-09T01:00:18.919725+0000","last_peered":"2024-05-09T01:00:18.919725+0000","last_clean":"2024-05-09T01:00:18.919725+0000","last_became_active":"2024-05-09T00:58:37.363394+0000","last_became_peered":"2024-05-09T00:58:37.363394+0000","last_unstale":"2024-05-09T01:00:18.919725+0000","last_undegraded":"2024-05-09T01:00:18.919725+0000","last_fullsized":"2024-05-09T01:00:18.919725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.156009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919467+0000","last_change":"2024-05-09T00:58:37.357699+0000","last_active":"2024-05-09T01:00:18.919467+0000","last_peered":"2024-05-09T01:00:18.919467+0000","last_clean":"2024-05-09T01:00:18.919467+0000","last_became_active":"2024-05-09T00:58:37.357356+0000","last_became_peered":"2024-05-09T00:58:37.357356+0000","last_unstale":"2024-05-09T01:00:18.919467+0000","last_undegraded":"2024-05-09T01:00:18.919467+0000","last_fullsized":"2024-05-09T01:00:18.919467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:14.861644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925268+0000","last_change":"2024-05-09T00:58:37.369419+0000","last_active":"2024-05-09T01:00:18.925268+0000","last_peered":"2024-05-09T01:00:18.925268+0000","last_clean":"2024-05-09T01:00:18.925268+0000","last_became_active":"2024-05-09T00:58:37.363949+0000","last_became_peered":"2024-05-09T00:58:37.363949+0000","last_unstale":"2024-05-09T01:00:18.925268+0000","last_undegraded":"2024-05-09T01:00:18.925268+0000","last_fullsized":"2024-05-09T01:00:18.925268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:04.081713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918659+0000","last_change":"2024-05-09T00:58:37.373651+0000","last_active":"2024-05-09T01:00:18.918659+0000","last_peered":"2024-05-09T01:00:18.918659+0000","last_clean":"2024-05-09T01:00:18.918659+0000","last_became_active":"2024-05-09T00:58:37.373257+0000","last_became_peered":"2024-05-09T00:58:37.373257+0000","last_unstale":"2024-05-09T01:00:18.918659+0000","last_undegraded":"2024-05-09T01:00:18.918659+0000","last_fullsized":"2024-05-09T01:00:18.918659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:27.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917530+0000","last_change":"2024-05-09T00:58:37.367666+0000","last_active":"2024-05-09T01:00:18.917530+0000","last_peered":"2024-05-09T01:00:18.917530+0000","last_clean":"2024-05-09T01:00:18.917530+0000","last_became_active":"2024-05-09T00:58:37.366869+0000","last_became_peered":"2024-05-09T00:58:37.366869+0000","last_unstale":"2024-05-09T01:00:18.917530+0000","last_undegraded":"2024-05-09T01:00:18.917530+0000","last_fullsized":"2024-05-09T01:00:18.917530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:07.952594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915045+0000","last_change":"2024-05-09T00:58:37.362205+0000","last_active":"2024-05-09T01:00:18.915045+0000","last_peered":"2024-05-09T01:00:18.915045+0000","last_clean":"2024-05-09T01:00:18.915045+0000","last_became_active":"2024-05-09T00:58:37.361704+0000","last_became_peered":"2024-05-09T00:58:37.361704+0000","last_unstale":"2024-05-09T01:00:18.915045+0000","last_undegraded":"2024-05-09T01:00:18.915045+0000","last_fullsized":"2024-05-09T01:00:18.915045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:34.334593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915177+0000","last_change":"2024-05-09T00:58:37.367143+0000","last_active":"2024-05-09T01:00:18.915177+0000","last_peered":"2024-05-09T01:00:18.915177+0000","last_clean":"2024-05-09T01:00:18.915177+0000","last_became_active":"2024-05-09T00:58:37.364364+0000","last_became_peered":"2024-05-09T00:58:37.364364+0000","last_unstale":"2024-05-09T01:00:18.915177+0000","last_undegraded":"2024-05-09T01:00:18.915177+0000","last_fullsized":"2024-05-09T01:00:18.915177+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:55.154458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.912464+0000","last_change":"2024-05-09T00:58:37.365757+0000","last_active":"2024-05-09T01:00:18.912464+0000","last_peered":"2024-05-09T01:00:18.912464+0000","last_clean":"2024-05-09T01:00:18.912464+0000","last_became_active":"2024-05-09T00:58:37.365408+0000","last_became_peered":"2024-05-09T00:58:37.365408+0000","last_unstale":"2024-05-09T01:00:18.912464+0000","last_undegraded":"2024-05-09T01:00:18.912464+0000","last_fullsized":"2024-05-09T01:00:18.912464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920328+0000","last_change":"2024-05-09T00:58:37.366954+0000","last_active":"2024-05-09T01:00:18.920328+0000","last_peered":"2024-05-09T01:00:18.920328+0000","last_clean":"2024-05-09T01:00:18.920328+0000","last_became_active":"2024-05-09T00:58:37.364361+0000","last_became_peered":"2024-05-09T00:58:37.364361+0000","last_unstale":"2024-05-09T01:00:18.920328+0000","last_undegraded":"2024-05-09T01:00:18.920328+0000","last_fullsized":"2024-05-09T01:00:18.920328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:31.248873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926774+0000","last_change":"2024-05-09T00:58:37.368467+0000","last_active":"2024-05-09T01:00:18.926774+0000","last_peered":"2024-05-09T01:00:18.926774+0000","last_clean":"2024-05-09T01:00:18.926774+0000","last_became_active":"2024-05-09T00:58:37.368104+0000","last_became_peered":"2024-05-09T00:58:37.368104+0000","last_unstale":"2024-05-09T01:00:18.926774+0000","last_undegraded":"2024-05-09T01:00:18.926774+0000","last_fullsized":"2024-05-09T01:00:18.926774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919830+0000","last_change":"2024-05-09T00:58:37.366897+0000","last_active":"2024-05-09T01:00:18.919830+0000","last_peered":"2024-05-09T01:00:18.919830+0000","last_clean":"2024-05-09T01:00:18.919830+0000","last_became_active":"2024-05-09T00:58:37.366555+0000","last_became_peered":"2024-05-09T00:58:37.366555+0000","last_unstale":"2024-05-09T01:00:18.919830+0000","last_undegraded":"2024-05-09T01:00:18.919830+0000","last_fullsized":"2024-05-09T01:00:18.919830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.394191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916213+0000","last_change":"2024-05-09T00:58:37.358875+0000","last_active":"2024-05-09T01:00:18.916213+0000","last_peered":"2024-05-09T01:00:18.916213+0000","last_clean":"2024-05-09T01:00:18.916213+0000","last_became_active":"2024-05-09T00:58:37.358505+0000","last_became_peered":"2024-05-09T00:58:37.358505+0000","last_unstale":"2024-05-09T01:00:18.916213+0000","last_undegraded":"2024-05-09T01:00:18.916213+0000","last_fullsized":"2024-05-09T01:00:18.916213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:15.268147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68082,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":981,"num_read_kb":568,"num_write":254,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":892928,"data_stored":431606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874284,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1585152,"data_stored":1083119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037810,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":431158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462971,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1503232,"data_stored":1023929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626498,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":430609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":492118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":432480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":974848,"data_stored":492870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":431002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1023075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:00:33.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T01:00:33.955 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:34.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:34 smithi151 ceph-mon[34780]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-09T01:00:34.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:34 smithi151 ceph-mon[34780]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:00:34.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:00:34.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:34 smithi136 ceph-mon[34110]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-09T01:00:34.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:34 smithi136 ceph-mon[34110]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:00:34.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:00:34.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:34 smithi037 ceph-mon[30122]: pgmap v348: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-09T01:00:34.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:34 smithi037 ceph-mon[30122]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:00:34.399 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.665+0000 7f0e075f1700 1 -- 172.21.15.37:0/1720398882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00110c30 msgr2=0x7f0e00113050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.665+0000 7f0e075f1700 1 --2- 172.21.15.37:0/1720398882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00110c30 0x7f0e00113050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009990 tx=0x7f0df8009ca0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.665+0000 7f0e075f1700 1 -- 172.21.15.37:0/1720398882 shutdown_connections 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.665+0000 7f0e075f1700 1 --2- 172.21.15.37:0/1720398882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00110c30 0x7f0e00113050 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.665+0000 7f0e075f1700 1 --2- 172.21.15.37:0/1720398882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e00103080 0x7f0e00103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.665+0000 7f0e075f1700 1 --2- 172.21.15.37:0/1720398882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e001039d0 0x7f0e001106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.665+0000 7f0e075f1700 1 -- 172.21.15.37:0/1720398882 >> 172.21.15.37:0/1720398882 conn(0x7f0e000fedf0 msgr2=0x7f0e00101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.666+0000 7f0e075f1700 1 -- 172.21.15.37:0/1720398882 shutdown_connections 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.666+0000 7f0e075f1700 1 -- 172.21.15.37:0/1720398882 wait complete. 2024-05-09T01:00:35.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.666+0000 7f0e075f1700 1 Processor -- start 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e075f1700 1 -- start start 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e075f1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e00103080 0x7f0e0019d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e075f1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e001039d0 0x7f0e0019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e075f1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e00110c30 0x7f0e001a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e075f1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001166b0 con 0x7f0e001039d0 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e075f1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0e00116530 con 0x7f0e00110c30 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e075f1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e00116830 con 0x7f0e00103080 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e001039d0 0x7f0e0019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e001039d0 0x7f0e0019d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45290/0 (socket says 172.21.15.37:45290) 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 -- 172.21.15.37:0/2059673990 learned_addr learned my addr 172.21.15.37:0/2059673990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e0538d700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e00103080 0x7f0e0019d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e05b8e700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e00110c30 0x7f0e001a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 -- 172.21.15.37:0/2059673990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e00103080 msgr2=0x7f0e0019d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:35.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e00103080 0x7f0e0019d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 -- 172.21.15.37:0/2059673990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e00110c30 msgr2=0x7f0e001a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e00110c30 0x7f0e001a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.667+0000 7f0e04b8c700 1 -- 172.21.15.37:0/2059673990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e001a1ed0 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.668+0000 7f0e04b8c700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e001039d0 0x7f0e0019d5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0df400e940 tx=0x7f0df400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.668+0000 7f0dfe7fc700 1 -- 172.21.15.37:0/2059673990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df400c9e0 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.668+0000 7f0dfe7fc700 1 -- 172.21.15.37:0/2059673990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df400cb80 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.668+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e001a21c0 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.668+0000 7f0dfe7fc700 1 -- 172.21.15.37:0/2059673990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4010e60 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.668+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e001a9ae0 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.669+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e000512c0 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.671+0000 7f0dfe7fc700 1 -- 172.21.15.37:0/2059673990 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0df4010430 con 0x7f0e001039d0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.672+0000 7f0dfe7fc700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0de80b2900 0x7f0de80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.672+0000 7f0e0538d700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0de80b2900 0x7f0de80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:35.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.672+0000 7f0dfe7fc700 1 -- 172.21.15.37:0/2059673990 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0df40e2730 con 0x7f0e001039d0 2024-05-09T01:00:35.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.673+0000 7f0e0538d700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0de80b2900 0x7f0de80b4e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0df000f540 tx=0x7f0df000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:35.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.676+0000 7f0dfe7fc700 1 -- 172.21.15.37:0/2059673990 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0df40aa450 con 0x7f0e001039d0 2024-05-09T01:00:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.901+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e00063c00 con 0x7f0de80b2900 2024-05-09T01:00:35.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.909+0000 7f0dfe7fc700 1 -- 172.21.15.37:0/2059673990 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258859 (secure 0 0 0) 0x7f0e00063c00 con 0x7f0de80b2900 2024-05-09T01:00:35.913 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0de80b2900 msgr2=0x7f0de80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0de80b2900 0x7f0de80b4e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0df000f540 tx=0x7f0df000b040 comp rx=0 tx=0).stop 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e001039d0 msgr2=0x7f0e0019d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e001039d0 0x7f0e0019d5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0df400e940 tx=0x7f0df400ec50 comp rx=0 tx=0).stop 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 shutdown_connections 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0de80b2900 0x7f0de80b4e10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e00110c30 0x7f0e001a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e00103080 0x7f0e0019d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 --2- 172.21.15.37:0/2059673990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e001039d0 0x7f0e0019d5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:35.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 >> 172.21.15.37:0/2059673990 conn(0x7f0e000fedf0 msgr2=0x7f0e00112740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 shutdown_connections 2024-05-09T01:00:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:35.912+0000 7f0e075f1700 1 -- 172.21.15.37:0/2059673990 wait complete. 2024-05-09T01:00:35.916 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-09T01:00:36.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:36 smithi037 ceph-mon[30122]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:36.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:36 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:36 smithi136 ceph-mon[34110]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:36.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:36 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:36 smithi151 ceph-mon[34780]: pgmap v349: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:36.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:36 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:36.591 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-05-09T01:00:34.913617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658684,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1072,"num_read_kb":632,"num_write":379,"num_write_kb":2295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":812,"ondisk_log_size":812,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382492,"kb_used_data":12540,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559332,"statfs":{"total":1151940427776,"available":1151548755968,"internally_reserved":0,"allocated":12840960,"data_stored":7133292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003883"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924240+0000","last_change":"2024-05-09T00:58:37.371502+0000","last_active":"2024-05-09T01:00:18.924240+0000","last_peered":"2024-05-09T01:00:18.924240+0000","last_clean":"2024-05-09T01:00:18.924240+0000","last_became_active":"2024-05-09T00:58:37.371172+0000","last_became_peered":"2024-05-09T00:58:37.371172+0000","last_unstale":"2024-05-09T01:00:18.924240+0000","last_undegraded":"2024-05-09T01:00:18.924240+0000","last_fullsized":"2024-05-09T01:00:18.924240+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:37.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917627+0000","last_change":"2024-05-09T00:58:37.362831+0000","last_active":"2024-05-09T01:00:18.917627+0000","last_peered":"2024-05-09T01:00:18.917627+0000","last_clean":"2024-05-09T01:00:18.917627+0000","last_became_active":"2024-05-09T00:58:37.362063+0000","last_became_peered":"2024-05-09T00:58:37.362063+0000","last_unstale":"2024-05-09T01:00:18.917627+0000","last_undegraded":"2024-05-09T01:00:18.917627+0000","last_fullsized":"2024-05-09T01:00:18.917627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:01.222962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924849+0000","last_change":"2024-05-09T00:58:37.369903+0000","last_active":"2024-05-09T01:00:18.924849+0000","last_peered":"2024-05-09T01:00:18.924849+0000","last_clean":"2024-05-09T01:00:18.924849+0000","last_became_active":"2024-05-09T00:58:37.366215+0000","last_became_peered":"2024-05-09T00:58:37.366215+0000","last_unstale":"2024-05-09T01:00:18.924849+0000","last_undegraded":"2024-05-09T01:00:18.924849+0000","last_fullsized":"2024-05-09T01:00:18.924849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:47.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914443+0000","last_change":"2024-05-09T00:58:37.358878+0000","last_active":"2024-05-09T01:00:18.914443+0000","last_peered":"2024-05-09T01:00:18.914443+0000","last_clean":"2024-05-09T01:00:18.914443+0000","last_became_active":"2024-05-09T00:58:37.358516+0000","last_became_peered":"2024-05-09T00:58:37.358516+0000","last_unstale":"2024-05-09T01:00:18.914443+0000","last_undegraded":"2024-05-09T01:00:18.914443+0000","last_fullsized":"2024-05-09T01:00:18.914443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.896957+0000","last_change":"2024-05-09T00:58:37.358196+0000","last_active":"2024-05-09T01:00:18.896957+0000","last_peered":"2024-05-09T01:00:18.896957+0000","last_clean":"2024-05-09T01:00:18.896957+0000","last_became_active":"2024-05-09T00:58:37.357840+0000","last_became_peered":"2024-05-09T00:58:37.357840+0000","last_unstale":"2024-05-09T01:00:18.896957+0000","last_undegraded":"2024-05-09T01:00:18.896957+0000","last_fullsized":"2024-05-09T01:00:18.896957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:58.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923026+0000","last_change":"2024-05-09T00:58:37.364523+0000","last_active":"2024-05-09T01:00:18.923026+0000","last_peered":"2024-05-09T01:00:18.923026+0000","last_clean":"2024-05-09T01:00:18.923026+0000","last_became_active":"2024-05-09T00:58:37.364172+0000","last_became_peered":"2024-05-09T00:58:37.364172+0000","last_unstale":"2024-05-09T01:00:18.923026+0000","last_undegraded":"2024-05-09T01:00:18.923026+0000","last_fullsized":"2024-05-09T01:00:18.923026+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:36.872701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913452+0000","last_change":"2024-05-09T00:58:37.371226+0000","last_active":"2024-05-09T01:00:18.913452+0000","last_peered":"2024-05-09T01:00:18.913452+0000","last_clean":"2024-05-09T01:00:18.913452+0000","last_became_active":"2024-05-09T00:58:37.370647+0000","last_became_peered":"2024-05-09T00:58:37.370647+0000","last_unstale":"2024-05-09T01:00:18.913452+0000","last_undegraded":"2024-05-09T01:00:18.913452+0000","last_fullsized":"2024-05-09T01:00:18.913452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:46.350845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914039+0000","last_change":"2024-05-09T00:58:37.362487+0000","last_active":"2024-05-09T01:00:18.914039+0000","last_peered":"2024-05-09T01:00:18.914039+0000","last_clean":"2024-05-09T01:00:18.914039+0000","last_became_active":"2024-05-09T00:58:37.361454+0000","last_became_peered":"2024-05-09T00:58:37.361454+0000","last_unstale":"2024-05-09T01:00:18.914039+0000","last_undegraded":"2024-05-09T01:00:18.914039+0000","last_fullsized":"2024-05-09T01:00:18.914039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:36.930754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925201+0000","last_change":"2024-05-09T00:58:37.370069+0000","last_active":"2024-05-09T01:00:18.925201+0000","last_peered":"2024-05-09T01:00:18.925201+0000","last_clean":"2024-05-09T01:00:18.925201+0000","last_became_active":"2024-05-09T00:58:37.369634+0000","last_became_peered":"2024-05-09T00:58:37.369634+0000","last_unstale":"2024-05-09T01:00:18.925201+0000","last_undegraded":"2024-05-09T01:00:18.925201+0000","last_fullsized":"2024-05-09T01:00:18.925201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:22.424919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923224+0000","last_change":"2024-05-09T00:58:37.365066+0000","last_active":"2024-05-09T01:00:18.923224+0000","last_peered":"2024-05-09T01:00:18.923224+0000","last_clean":"2024-05-09T01:00:18.923224+0000","last_became_active":"2024-05-09T00:58:37.364638+0000","last_became_peered":"2024-05-09T00:58:37.364638+0000","last_unstale":"2024-05-09T01:00:18.923224+0000","last_undegraded":"2024-05-09T01:00:18.923224+0000","last_fullsized":"2024-05-09T01:00:18.923224+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:14.706123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926289+0000","last_change":"2024-05-09T00:58:37.366880+0000","last_active":"2024-05-09T01:00:18.926289+0000","last_peered":"2024-05-09T01:00:18.926289+0000","last_clean":"2024-05-09T01:00:18.926289+0000","last_became_active":"2024-05-09T00:58:37.366510+0000","last_became_peered":"2024-05-09T00:58:37.366510+0000","last_unstale":"2024-05-09T01:00:18.926289+0000","last_undegraded":"2024-05-09T01:00:18.926289+0000","last_fullsized":"2024-05-09T01:00:18.926289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:36.968096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916863+0000","last_change":"2024-05-09T00:58:37.363258+0000","last_active":"2024-05-09T01:00:18.916863+0000","last_peered":"2024-05-09T01:00:18.916863+0000","last_clean":"2024-05-09T01:00:18.916863+0000","last_became_active":"2024-05-09T00:58:37.362791+0000","last_became_peered":"2024-05-09T00:58:37.362791+0000","last_unstale":"2024-05-09T01:00:18.916863+0000","last_undegraded":"2024-05-09T01:00:18.916863+0000","last_fullsized":"2024-05-09T01:00:18.916863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:03.341731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913744+0000","last_change":"2024-05-09T00:58:37.371276+0000","last_active":"2024-05-09T01:00:18.913744+0000","last_peered":"2024-05-09T01:00:18.913744+0000","last_clean":"2024-05-09T01:00:18.913744+0000","last_became_active":"2024-05-09T00:58:37.370881+0000","last_became_peered":"2024-05-09T00:58:37.370881+0000","last_unstale":"2024-05-09T01:00:18.913744+0000","last_undegraded":"2024-05-09T01:00:18.913744+0000","last_fullsized":"2024-05-09T01:00:18.913744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:14.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919238+0000","last_change":"2024-05-09T00:58:37.361394+0000","last_active":"2024-05-09T01:00:18.919238+0000","last_peered":"2024-05-09T01:00:18.919238+0000","last_clean":"2024-05-09T01:00:18.919238+0000","last_became_active":"2024-05-09T00:58:37.360669+0000","last_became_peered":"2024-05-09T00:58:37.360669+0000","last_unstale":"2024-05-09T01:00:18.919238+0000","last_undegraded":"2024-05-09T01:00:18.919238+0000","last_fullsized":"2024-05-09T01:00:18.919238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.110889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920471+0000","last_change":"2024-05-09T00:58:37.371900+0000","last_active":"2024-05-09T01:00:18.920471+0000","last_peered":"2024-05-09T01:00:18.920471+0000","last_clean":"2024-05-09T01:00:18.920471+0000","last_became_active":"2024-05-09T00:58:37.368608+0000","last_became_peered":"2024-05-09T00:58:37.368608+0000","last_unstale":"2024-05-09T01:00:18.920471+0000","last_undegraded":"2024-05-09T01:00:18.920471+0000","last_fullsized":"2024-05-09T01:00:18.920471+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:17.673058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926719+0000","last_change":"2024-05-09T00:58:37.372717+0000","last_active":"2024-05-09T01:00:18.926719+0000","last_peered":"2024-05-09T01:00:18.926719+0000","last_clean":"2024-05-09T01:00:18.926719+0000","last_became_active":"2024-05-09T00:58:37.372376+0000","last_became_peered":"2024-05-09T00:58:37.372376+0000","last_unstale":"2024-05-09T01:00:18.926719+0000","last_undegraded":"2024-05-09T01:00:18.926719+0000","last_fullsized":"2024-05-09T01:00:18.926719+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:51.092242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924222+0000","last_change":"2024-05-09T00:58:37.373971+0000","last_active":"2024-05-09T01:00:18.924222+0000","last_peered":"2024-05-09T01:00:18.924222+0000","last_clean":"2024-05-09T01:00:18.924222+0000","last_became_active":"2024-05-09T00:58:37.373620+0000","last_became_peered":"2024-05-09T00:58:37.373620+0000","last_unstale":"2024-05-09T01:00:18.924222+0000","last_undegraded":"2024-05-09T01:00:18.924222+0000","last_fullsized":"2024-05-09T01:00:18.924222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.070455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914149+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.914149+0000","last_peered":"2024-05-09T01:00:18.914149+0000","last_clean":"2024-05-09T01:00:18.914149+0000","last_became_active":"2024-05-09T00:58:37.367820+0000","last_became_peered":"2024-05-09T00:58:37.367820+0000","last_unstale":"2024-05-09T01:00:18.914149+0000","last_undegraded":"2024-05-09T01:00:18.914149+0000","last_fullsized":"2024-05-09T01:00:18.914149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:45.207654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918475+0000","last_change":"2024-05-09T00:58:37.358736+0000","last_active":"2024-05-09T01:00:18.918475+0000","last_peered":"2024-05-09T01:00:18.918475+0000","last_clean":"2024-05-09T01:00:18.918475+0000","last_became_active":"2024-05-09T00:58:37.358354+0000","last_became_peered":"2024-05-09T00:58:37.358354+0000","last_unstale":"2024-05-09T01:00:18.918475+0000","last_undegraded":"2024-05-09T01:00:18.918475+0000","last_fullsized":"2024-05-09T01:00:18.918475+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:51.084484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.146519+0000","last_change":"2024-05-09T00:58:34.333847+0000","last_active":"2024-05-09T01:00:30.146519+0000","last_peered":"2024-05-09T01:00:30.146519+0000","last_clean":"2024-05-09T01:00:30.146519+0000","last_became_active":"2024-05-09T00:58:34.333479+0000","last_became_peered":"2024-05-09T00:58:34.333479+0000","last_unstale":"2024-05-09T01:00:30.146519+0000","last_undegraded":"2024-05-09T01:00:30.146519+0000","last_fullsized":"2024-05-09T01:00:30.146519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:53.709034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915266+0000","last_change":"2024-05-09T00:58:37.367327+0000","last_active":"2024-05-09T01:00:18.915266+0000","last_peered":"2024-05-09T01:00:18.915266+0000","last_clean":"2024-05-09T01:00:18.915266+0000","last_became_active":"2024-05-09T00:58:37.366973+0000","last_became_peered":"2024-05-09T00:58:37.366973+0000","last_unstale":"2024-05-09T01:00:18.915266+0000","last_undegraded":"2024-05-09T01:00:18.915266+0000","last_fullsized":"2024-05-09T01:00:18.915266+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:10.610274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078289+0000","last_change":"2024-05-09T00:58:34.821107+0000","last_active":"2024-05-09T00:59:20.078289+0000","last_peered":"2024-05-09T00:59:20.078289+0000","last_clean":"2024-05-09T00:59:20.078289+0000","last_became_active":"2024-05-09T00:58:34.820737+0000","last_became_peered":"2024-05-09T00:58:34.820737+0000","last_unstale":"2024-05-09T00:59:20.078289+0000","last_undegraded":"2024-05-09T00:59:20.078289+0000","last_fullsized":"2024-05-09T00:59:20.078289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:45.450781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924709+0000","last_change":"2024-05-09T00:58:37.363559+0000","last_active":"2024-05-09T01:00:18.924709+0000","last_peered":"2024-05-09T01:00:18.924709+0000","last_clean":"2024-05-09T01:00:18.924709+0000","last_became_active":"2024-05-09T00:58:37.358299+0000","last_became_peered":"2024-05-09T00:58:37.358299+0000","last_unstale":"2024-05-09T01:00:18.924709+0000","last_undegraded":"2024-05-09T01:00:18.924709+0000","last_fullsized":"2024-05-09T01:00:18.924709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:15.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077192+0000","last_change":"2024-05-09T00:58:34.333154+0000","last_active":"2024-05-09T00:59:20.077192+0000","last_peered":"2024-05-09T00:59:20.077192+0000","last_clean":"2024-05-09T00:59:20.077192+0000","last_became_active":"2024-05-09T00:58:34.332469+0000","last_became_peered":"2024-05-09T00:58:34.332469+0000","last_unstale":"2024-05-09T00:59:20.077192+0000","last_undegraded":"2024-05-09T00:59:20.077192+0000","last_fullsized":"2024-05-09T00:59:20.077192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:56.343377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925090+0000","last_change":"2024-05-09T00:58:37.361595+0000","last_active":"2024-05-09T01:00:18.925090+0000","last_peered":"2024-05-09T01:00:18.925090+0000","last_clean":"2024-05-09T01:00:18.925090+0000","last_became_active":"2024-05-09T00:58:37.361239+0000","last_became_peered":"2024-05-09T00:58:37.361239+0000","last_unstale":"2024-05-09T01:00:18.925090+0000","last_undegraded":"2024-05-09T01:00:18.925090+0000","last_fullsized":"2024-05-09T01:00:18.925090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:24.526487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077004+0000","last_change":"2024-05-09T00:58:34.331974+0000","last_active":"2024-05-09T00:59:20.077004+0000","last_peered":"2024-05-09T00:59:20.077004+0000","last_clean":"2024-05-09T00:59:20.077004+0000","last_became_active":"2024-05-09T00:58:34.331460+0000","last_became_peered":"2024-05-09T00:58:34.331460+0000","last_unstale":"2024-05-09T00:59:20.077004+0000","last_undegraded":"2024-05-09T00:59:20.077004+0000","last_fullsized":"2024-05-09T00:59:20.077004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:17.746247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918649+0000","last_change":"2024-05-09T00:58:37.370155+0000","last_active":"2024-05-09T01:00:18.918649+0000","last_peered":"2024-05-09T01:00:18.918649+0000","last_clean":"2024-05-09T01:00:18.918649+0000","last_became_active":"2024-05-09T00:58:37.369351+0000","last_became_peered":"2024-05-09T00:58:37.369351+0000","last_unstale":"2024-05-09T01:00:18.918649+0000","last_undegraded":"2024-05-09T01:00:18.918649+0000","last_fullsized":"2024-05-09T01:00:18.918649+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:57.494715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:32.153131+0000","last_change":"2024-05-09T00:58:34.332532+0000","last_active":"2024-05-09T01:00:32.153131+0000","last_peered":"2024-05-09T01:00:32.153131+0000","last_clean":"2024-05-09T01:00:32.153131+0000","last_became_active":"2024-05-09T00:58:34.332202+0000","last_became_peered":"2024-05-09T00:58:34.332202+0000","last_unstale":"2024-05-09T01:00:32.153131+0000","last_undegraded":"2024-05-09T01:00:32.153131+0000","last_fullsized":"2024-05-09T01:00:32.153131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:17.561374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.907065+0000","last_change":"2024-05-09T00:58:37.360504+0000","last_active":"2024-05-09T01:00:18.907065+0000","last_peered":"2024-05-09T01:00:18.907065+0000","last_clean":"2024-05-09T01:00:18.907065+0000","last_became_active":"2024-05-09T00:58:37.360078+0000","last_became_peered":"2024-05-09T00:58:37.360078+0000","last_unstale":"2024-05-09T01:00:18.907065+0000","last_undegraded":"2024-05-09T01:00:18.907065+0000","last_fullsized":"2024-05-09T01:00:18.907065+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:19.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074437+0000","last_change":"2024-05-09T00:58:34.333762+0000","last_active":"2024-05-09T00:59:20.074437+0000","last_peered":"2024-05-09T00:59:20.074437+0000","last_clean":"2024-05-09T00:59:20.074437+0000","last_became_active":"2024-05-09T00:58:34.333376+0000","last_became_peered":"2024-05-09T00:58:34.333376+0000","last_unstale":"2024-05-09T00:59:20.074437+0000","last_undegraded":"2024-05-09T00:59:20.074437+0000","last_fullsized":"2024-05-09T00:59:20.074437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:58.027982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.909915+0000","last_change":"2024-05-09T00:59:20.081897+0000","last_active":"2024-05-09T01:00:18.909915+0000","last_peered":"2024-05-09T01:00:18.909915+0000","last_clean":"2024-05-09T01:00:18.909915+0000","last_became_active":"2024-05-09T00:59:20.081446+0000","last_became_peered":"2024-05-09T00:59:20.081446+0000","last_unstale":"2024-05-09T01:00:18.909915+0000","last_undegraded":"2024-05-09T01:00:18.909915+0000","last_fullsized":"2024-05-09T01:00:18.909915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:58.471576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.072992+0000","last_change":"2024-05-09T00:58:34.332308+0000","last_active":"2024-05-09T00:59:20.072992+0000","last_peered":"2024-05-09T00:59:20.072992+0000","last_clean":"2024-05-09T00:59:20.072992+0000","last_became_active":"2024-05-09T00:58:34.331154+0000","last_became_peered":"2024-05-09T00:58:34.331154+0000","last_unstale":"2024-05-09T00:59:20.072992+0000","last_undegraded":"2024-05-09T00:59:20.072992+0000","last_fullsized":"2024-05-09T00:59:20.072992+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.781375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920181+0000","last_change":"2024-05-09T00:58:37.368925+0000","last_active":"2024-05-09T01:00:18.920181+0000","last_peered":"2024-05-09T01:00:18.920181+0000","last_clean":"2024-05-09T01:00:18.920181+0000","last_became_active":"2024-05-09T00:58:37.368586+0000","last_became_peered":"2024-05-09T00:58:37.368586+0000","last_unstale":"2024-05-09T01:00:18.920181+0000","last_undegraded":"2024-05-09T01:00:18.920181+0000","last_fullsized":"2024-05-09T01:00:18.920181+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:57.248832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078023+0000","last_change":"2024-05-09T00:58:34.334356+0000","last_active":"2024-05-09T00:59:20.078023+0000","last_peered":"2024-05-09T00:59:20.078023+0000","last_clean":"2024-05-09T00:59:20.078023+0000","last_became_active":"2024-05-09T00:58:34.333993+0000","last_became_peered":"2024-05-09T00:58:34.333993+0000","last_unstale":"2024-05-09T00:59:20.078023+0000","last_undegraded":"2024-05-09T00:59:20.078023+0000","last_fullsized":"2024-05-09T00:59:20.078023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:19.793851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914947+0000","last_change":"2024-05-09T00:58:37.360565+0000","last_active":"2024-05-09T01:00:18.914947+0000","last_peered":"2024-05-09T01:00:18.914947+0000","last_clean":"2024-05-09T01:00:18.914947+0000","last_became_active":"2024-05-09T00:58:37.360215+0000","last_became_peered":"2024-05-09T00:58:37.360215+0000","last_unstale":"2024-05-09T01:00:18.914947+0000","last_undegraded":"2024-05-09T01:00:18.914947+0000","last_fullsized":"2024-05-09T01:00:18.914947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:12.877333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'5","reported_seq":219,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.149272+0000","last_change":"2024-05-09T00:58:34.332654+0000","last_active":"2024-05-09T01:00:30.149272+0000","last_peered":"2024-05-09T01:00:30.149272+0000","last_clean":"2024-05-09T01:00:30.149272+0000","last_became_active":"2024-05-09T00:58:34.331915+0000","last_became_peered":"2024-05-09T00:58:34.331915+0000","last_unstale":"2024-05-09T01:00:30.149272+0000","last_undegraded":"2024-05-09T01:00:30.149272+0000","last_fullsized":"2024-05-09T01:00:30.149272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:47.521158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":188,"num_read_kb":188,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924708+0000","last_change":"2024-05-09T00:58:37.364248+0000","last_active":"2024-05-09T01:00:18.924708+0000","last_peered":"2024-05-09T01:00:18.924708+0000","last_clean":"2024-05-09T01:00:18.924708+0000","last_became_active":"2024-05-09T00:58:37.363872+0000","last_became_peered":"2024-05-09T00:58:37.363872+0000","last_unstale":"2024-05-09T01:00:18.924708+0000","last_undegraded":"2024-05-09T01:00:18.924708+0000","last_fullsized":"2024-05-09T01:00:18.924708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075486+0000","last_change":"2024-05-09T00:58:34.331157+0000","last_active":"2024-05-09T00:59:20.075486+0000","last_peered":"2024-05-09T00:59:20.075486+0000","last_clean":"2024-05-09T00:59:20.075486+0000","last_became_active":"2024-05-09T00:58:34.330151+0000","last_became_peered":"2024-05-09T00:58:34.330151+0000","last_unstale":"2024-05-09T00:59:20.075486+0000","last_undegraded":"2024-05-09T00:59:20.075486+0000","last_fullsized":"2024-05-09T00:59:20.075486+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:07.777304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916453+0000","last_change":"2024-05-09T00:58:37.369357+0000","last_active":"2024-05-09T01:00:18.916453+0000","last_peered":"2024-05-09T01:00:18.916453+0000","last_clean":"2024-05-09T01:00:18.916453+0000","last_became_active":"2024-05-09T00:58:37.368994+0000","last_became_peered":"2024-05-09T00:58:37.368994+0000","last_unstale":"2024-05-09T01:00:18.916453+0000","last_undegraded":"2024-05-09T01:00:18.916453+0000","last_fullsized":"2024-05-09T01:00:18.916453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079900+0000","last_change":"2024-05-09T00:58:34.822508+0000","last_active":"2024-05-09T00:59:20.079900+0000","last_peered":"2024-05-09T00:59:20.079900+0000","last_clean":"2024-05-09T00:59:20.079900+0000","last_became_active":"2024-05-09T00:58:34.821765+0000","last_became_peered":"2024-05-09T00:58:34.821765+0000","last_unstale":"2024-05-09T00:59:20.079900+0000","last_undegraded":"2024-05-09T00:59:20.079900+0000","last_fullsized":"2024-05-09T00:59:20.079900+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:56.931158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926487+0000","last_change":"2024-05-09T00:58:37.362739+0000","last_active":"2024-05-09T01:00:18.926487+0000","last_peered":"2024-05-09T01:00:18.926487+0000","last_clean":"2024-05-09T01:00:18.926487+0000","last_became_active":"2024-05-09T00:58:37.362395+0000","last_became_peered":"2024-05-09T00:58:37.362395+0000","last_unstale":"2024-05-09T01:00:18.926487+0000","last_undegraded":"2024-05-09T01:00:18.926487+0000","last_fullsized":"2024-05-09T01:00:18.926487+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:51.380197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":258,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.158206+0000","last_change":"2024-05-09T00:58:34.336548+0000","last_active":"2024-05-09T01:00:30.158206+0000","last_peered":"2024-05-09T01:00:30.158206+0000","last_clean":"2024-05-09T01:00:30.158206+0000","last_became_active":"2024-05-09T00:58:34.335792+0000","last_became_peered":"2024-05-09T00:58:34.335792+0000","last_unstale":"2024-05-09T01:00:30.158206+0000","last_undegraded":"2024-05-09T01:00:30.158206+0000","last_fullsized":"2024-05-09T01:00:30.158206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:37.996544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60596,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":158,"num_write":36,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918090+0000","last_change":"2024-05-09T00:58:37.365468+0000","last_active":"2024-05-09T01:00:18.918090+0000","last_peered":"2024-05-09T01:00:18.918090+0000","last_clean":"2024-05-09T01:00:18.918090+0000","last_became_active":"2024-05-09T00:58:37.365085+0000","last_became_peered":"2024-05-09T00:58:37.365085+0000","last_unstale":"2024-05-09T01:00:18.918090+0000","last_undegraded":"2024-05-09T01:00:18.918090+0000","last_fullsized":"2024-05-09T01:00:18.918090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:06.836757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077180+0000","last_change":"2024-05-09T00:58:34.331174+0000","last_active":"2024-05-09T00:59:20.077180+0000","last_peered":"2024-05-09T00:59:20.077180+0000","last_clean":"2024-05-09T00:59:20.077180+0000","last_became_active":"2024-05-09T00:58:34.330871+0000","last_became_peered":"2024-05-09T00:58:34.330871+0000","last_unstale":"2024-05-09T00:59:20.077180+0000","last_undegraded":"2024-05-09T00:59:20.077180+0000","last_fullsized":"2024-05-09T00:59:20.077180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:21:47.840730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.907084+0000","last_change":"2024-05-09T00:58:37.367821+0000","last_active":"2024-05-09T01:00:18.907084+0000","last_peered":"2024-05-09T01:00:18.907084+0000","last_clean":"2024-05-09T01:00:18.907084+0000","last_became_active":"2024-05-09T00:58:37.367495+0000","last_became_peered":"2024-05-09T00:58:37.367495+0000","last_unstale":"2024-05-09T01:00:18.907084+0000","last_undegraded":"2024-05-09T01:00:18.907084+0000","last_fullsized":"2024-05-09T01:00:18.907084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:08.285301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078474+0000","last_change":"2024-05-09T00:58:34.334381+0000","last_active":"2024-05-09T00:59:20.078474+0000","last_peered":"2024-05-09T00:59:20.078474+0000","last_clean":"2024-05-09T00:59:20.078474+0000","last_became_active":"2024-05-09T00:58:34.333948+0000","last_became_peered":"2024-05-09T00:58:34.333948+0000","last_unstale":"2024-05-09T00:59:20.078474+0000","last_undegraded":"2024-05-09T00:59:20.078474+0000","last_fullsized":"2024-05-09T00:59:20.078474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:05.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913942+0000","last_change":"2024-05-09T00:59:20.079435+0000","last_active":"2024-05-09T01:00:18.913942+0000","last_peered":"2024-05-09T01:00:18.913942+0000","last_clean":"2024-05-09T01:00:18.913942+0000","last_became_active":"2024-05-09T00:59:20.079110+0000","last_became_peered":"2024-05-09T00:59:20.079110+0000","last_unstale":"2024-05-09T01:00:18.913942+0000","last_undegraded":"2024-05-09T01:00:18.913942+0000","last_fullsized":"2024-05-09T01:00:18.913942+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:31.449360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'7","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:33.163473+0000","last_change":"2024-05-09T00:58:34.335831+0000","last_active":"2024-05-09T01:00:33.163473+0000","last_peered":"2024-05-09T01:00:33.163473+0000","last_clean":"2024-05-09T01:00:33.163473+0000","last_became_active":"2024-05-09T00:58:34.334950+0000","last_became_peered":"2024-05-09T00:58:34.334950+0000","last_unstale":"2024-05-09T01:00:33.163473+0000","last_undegraded":"2024-05-09T01:00:33.163473+0000","last_fullsized":"2024-05-09T01:00:33.163473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:05.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914131+0000","last_change":"2024-05-09T00:58:37.373115+0000","last_active":"2024-05-09T01:00:18.914131+0000","last_peered":"2024-05-09T01:00:18.914131+0000","last_clean":"2024-05-09T01:00:18.914131+0000","last_became_active":"2024-05-09T00:58:37.369976+0000","last_became_peered":"2024-05-09T00:58:37.369976+0000","last_unstale":"2024-05-09T01:00:18.914131+0000","last_undegraded":"2024-05-09T01:00:18.914131+0000","last_fullsized":"2024-05-09T01:00:18.914131+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:40.439954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.096415+0000","last_change":"2024-05-09T00:59:20.095889+0000","last_active":"2024-05-09T00:59:20.096415+0000","last_peered":"2024-05-09T00:59:20.096415+0000","last_clean":"2024-05-09T00:59:20.096415+0000","last_became_active":"2024-05-09T00:59:20.078865+0000","last_became_peered":"2024-05-09T00:59:20.078865+0000","last_unstale":"2024-05-09T00:59:20.096415+0000","last_undegraded":"2024-05-09T00:59:20.096415+0000","last_fullsized":"2024-05-09T00:59:20.096415+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.470868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.906074+0000","last_change":"2024-05-09T00:59:20.349963+0000","last_active":"2024-05-09T01:00:18.906074+0000","last_peered":"2024-05-09T01:00:18.906074+0000","last_clean":"2024-05-09T01:00:18.906074+0000","last_became_active":"2024-05-09T00:59:20.349510+0000","last_became_peered":"2024-05-09T00:59:20.349510+0000","last_unstale":"2024-05-09T01:00:18.906074+0000","last_undegraded":"2024-05-09T01:00:18.906074+0000","last_fullsized":"2024-05-09T01:00:18.906074+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:33.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077294+0000","last_change":"2024-05-09T00:58:34.331661+0000","last_active":"2024-05-09T00:59:20.077294+0000","last_peered":"2024-05-09T00:59:20.077294+0000","last_clean":"2024-05-09T00:59:20.077294+0000","last_became_active":"2024-05-09T00:58:34.331271+0000","last_became_peered":"2024-05-09T00:58:34.331271+0000","last_unstale":"2024-05-09T00:59:20.077294+0000","last_undegraded":"2024-05-09T00:59:20.077294+0000","last_fullsized":"2024-05-09T00:59:20.077294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:10.130811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916372+0000","last_change":"2024-05-09T00:58:37.367367+0000","last_active":"2024-05-09T01:00:18.916372+0000","last_peered":"2024-05-09T01:00:18.916372+0000","last_clean":"2024-05-09T01:00:18.916372+0000","last_became_active":"2024-05-09T00:58:37.366927+0000","last_became_peered":"2024-05-09T00:58:37.366927+0000","last_unstale":"2024-05-09T01:00:18.916372+0000","last_undegraded":"2024-05-09T01:00:18.916372+0000","last_fullsized":"2024-05-09T01:00:18.916372+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:31.066913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077749+0000","last_change":"2024-05-09T00:58:34.821956+0000","last_active":"2024-05-09T00:59:20.077749+0000","last_peered":"2024-05-09T00:59:20.077749+0000","last_clean":"2024-05-09T00:59:20.077749+0000","last_became_active":"2024-05-09T00:58:34.821570+0000","last_became_peered":"2024-05-09T00:58:34.821570+0000","last_unstale":"2024-05-09T00:59:20.077749+0000","last_undegraded":"2024-05-09T00:59:20.077749+0000","last_fullsized":"2024-05-09T00:59:20.077749+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:45.027927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.909732+0000","last_change":"2024-05-09T00:58:37.361646+0000","last_active":"2024-05-09T01:00:18.909732+0000","last_peered":"2024-05-09T01:00:18.909732+0000","last_clean":"2024-05-09T01:00:18.909732+0000","last_became_active":"2024-05-09T00:58:37.360216+0000","last_became_peered":"2024-05-09T00:58:37.360216+0000","last_unstale":"2024-05-09T01:00:18.909732+0000","last_undegraded":"2024-05-09T01:00:18.909732+0000","last_fullsized":"2024-05-09T01:00:18.909732+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:13.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'5","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:33.152122+0000","last_change":"2024-05-09T00:58:34.330657+0000","last_active":"2024-05-09T01:00:33.152122+0000","last_peered":"2024-05-09T01:00:33.152122+0000","last_clean":"2024-05-09T01:00:33.152122+0000","last_became_active":"2024-05-09T00:58:34.330235+0000","last_became_peered":"2024-05-09T00:58:34.330235+0000","last_unstale":"2024-05-09T01:00:33.152122+0000","last_undegraded":"2024-05-09T01:00:33.152122+0000","last_fullsized":"2024-05-09T01:00:33.152122+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:21.647916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923215+0000","last_change":"2024-05-09T00:58:37.361155+0000","last_active":"2024-05-09T01:00:18.923215+0000","last_peered":"2024-05-09T01:00:18.923215+0000","last_clean":"2024-05-09T01:00:18.923215+0000","last_became_active":"2024-05-09T00:58:37.360653+0000","last_became_peered":"2024-05-09T00:58:37.360653+0000","last_unstale":"2024-05-09T01:00:18.923215+0000","last_undegraded":"2024-05-09T01:00:18.923215+0000","last_fullsized":"2024-05-09T01:00:18.923215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:49.473522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913024+0000","last_change":"2024-05-09T00:58:37.367592+0000","last_active":"2024-05-09T01:00:18.913024+0000","last_peered":"2024-05-09T01:00:18.913024+0000","last_clean":"2024-05-09T01:00:18.913024+0000","last_became_active":"2024-05-09T00:58:37.366365+0000","last_became_peered":"2024-05-09T00:58:37.366365+0000","last_unstale":"2024-05-09T01:00:18.913024+0000","last_undegraded":"2024-05-09T01:00:18.913024+0000","last_fullsized":"2024-05-09T01:00:18.913024+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:37.279269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":127,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:29.156463+0000","last_change":"2024-05-09T00:58:34.821092+0000","last_active":"2024-05-09T01:00:29.156463+0000","last_peered":"2024-05-09T01:00:29.156463+0000","last_clean":"2024-05-09T01:00:29.156463+0000","last_became_active":"2024-05-09T00:58:34.820713+0000","last_became_peered":"2024-05-09T00:58:34.820713+0000","last_unstale":"2024-05-09T01:00:29.156463+0000","last_undegraded":"2024-05-09T01:00:29.156463+0000","last_fullsized":"2024-05-09T01:00:29.156463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:11.372613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915974+0000","last_change":"2024-05-09T00:58:37.364624+0000","last_active":"2024-05-09T01:00:18.915974+0000","last_peered":"2024-05-09T01:00:18.915974+0000","last_clean":"2024-05-09T01:00:18.915974+0000","last_became_active":"2024-05-09T00:58:37.364013+0000","last_became_peered":"2024-05-09T00:58:37.364013+0000","last_unstale":"2024-05-09T01:00:18.915974+0000","last_undegraded":"2024-05-09T01:00:18.915974+0000","last_fullsized":"2024-05-09T01:00:18.915974+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:14.205958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.349071+0000","last_change":"2024-05-09T00:58:34.335364+0000","last_active":"2024-05-09T00:59:20.349071+0000","last_peered":"2024-05-09T00:59:20.349071+0000","last_clean":"2024-05-09T00:59:20.349071+0000","last_became_active":"2024-05-09T00:58:34.334965+0000","last_became_peered":"2024-05-09T00:58:34.334965+0000","last_unstale":"2024-05-09T00:59:20.349071+0000","last_undegraded":"2024-05-09T00:59:20.349071+0000","last_fullsized":"2024-05-09T00:59:20.349071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:50.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075224+0000","last_change":"2024-05-09T00:57:07.637377+0000","last_active":"2024-05-09T00:59:20.075224+0000","last_peered":"2024-05-09T00:59:20.075224+0000","last_clean":"2024-05-09T00:59:20.075224+0000","last_became_active":"2024-05-09T00:57:07.631727+0000","last_became_peered":"2024-05-09T00:57:07.631727+0000","last_unstale":"2024-05-09T00:59:20.075224+0000","last_undegraded":"2024-05-09T00:59:20.075224+0000","last_fullsized":"2024-05-09T00:59:20.075224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_clean_scrub_stamp":"2024-05-09T00:53:47.457762+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:09.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913338+0000","last_change":"2024-05-09T00:59:20.081462+0000","last_active":"2024-05-09T01:00:18.913338+0000","last_peered":"2024-05-09T01:00:18.913338+0000","last_clean":"2024-05-09T01:00:18.913338+0000","last_became_active":"2024-05-09T00:59:20.080955+0000","last_became_peered":"2024-05-09T00:59:20.080955+0000","last_unstale":"2024-05-09T01:00:18.913338+0000","last_undegraded":"2024-05-09T01:00:18.913338+0000","last_fullsized":"2024-05-09T01:00:18.913338+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:11.106912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075413+0000","last_change":"2024-05-09T00:58:34.329694+0000","last_active":"2024-05-09T00:59:20.075413+0000","last_peered":"2024-05-09T00:59:20.075413+0000","last_clean":"2024-05-09T00:59:20.075413+0000","last_became_active":"2024-05-09T00:58:34.329267+0000","last_became_peered":"2024-05-09T00:58:34.329267+0000","last_unstale":"2024-05-09T00:59:20.075413+0000","last_undegraded":"2024-05-09T00:59:20.075413+0000","last_fullsized":"2024-05-09T00:59:20.075413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:28.060489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077064+0000","last_change":"2024-05-09T00:58:34.822706+0000","last_active":"2024-05-09T00:59:20.077064+0000","last_peered":"2024-05-09T00:59:20.077064+0000","last_clean":"2024-05-09T00:59:20.077064+0000","last_became_active":"2024-05-09T00:58:34.822223+0000","last_became_peered":"2024-05-09T00:58:34.822223+0000","last_unstale":"2024-05-09T00:59:20.077064+0000","last_undegraded":"2024-05-09T00:59:20.077064+0000","last_fullsized":"2024-05-09T00:59:20.077064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:47.378798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.908295+0000","last_change":"2024-05-09T00:58:37.360600+0000","last_active":"2024-05-09T01:00:18.908295+0000","last_peered":"2024-05-09T01:00:18.908295+0000","last_clean":"2024-05-09T01:00:18.908295+0000","last_became_active":"2024-05-09T00:58:37.360265+0000","last_became_peered":"2024-05-09T00:58:37.360265+0000","last_unstale":"2024-05-09T01:00:18.908295+0000","last_undegraded":"2024-05-09T01:00:18.908295+0000","last_fullsized":"2024-05-09T01:00:18.908295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:44.423709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'16","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.372236+0000","last_change":"2024-05-09T00:58:34.331544+0000","last_active":"2024-05-09T00:59:20.372236+0000","last_peered":"2024-05-09T00:59:20.372236+0000","last_clean":"2024-05-09T00:59:20.372236+0000","last_became_active":"2024-05-09T00:58:34.331147+0000","last_became_peered":"2024-05-09T00:58:34.331147+0000","last_unstale":"2024-05-09T00:59:20.372236+0000","last_undegraded":"2024-05-09T00:59:20.372236+0000","last_fullsized":"2024-05-09T00:59:20.372236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:27.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920210+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.920210+0000","last_peered":"2024-05-09T01:00:18.920210+0000","last_clean":"2024-05-09T01:00:18.920210+0000","last_became_active":"2024-05-09T00:58:37.367875+0000","last_became_peered":"2024-05-09T00:58:37.367875+0000","last_unstale":"2024-05-09T01:00:18.920210+0000","last_undegraded":"2024-05-09T01:00:18.920210+0000","last_fullsized":"2024-05-09T01:00:18.920210+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:45.800008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348673+0000","last_change":"2024-05-09T00:58:34.956500+0000","last_active":"2024-05-09T00:59:20.348673+0000","last_peered":"2024-05-09T00:59:20.348673+0000","last_clean":"2024-05-09T00:59:20.348673+0000","last_became_active":"2024-05-09T00:58:34.956108+0000","last_became_peered":"2024-05-09T00:58:34.956108+0000","last_unstale":"2024-05-09T00:59:20.348673+0000","last_undegraded":"2024-05-09T00:59:20.348673+0000","last_fullsized":"2024-05-09T00:59:20.348673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:03.283325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925261+0000","last_change":"2024-05-09T00:58:37.369174+0000","last_active":"2024-05-09T01:00:18.925261+0000","last_peered":"2024-05-09T01:00:18.925261+0000","last_clean":"2024-05-09T01:00:18.925261+0000","last_became_active":"2024-05-09T00:58:37.368650+0000","last_became_peered":"2024-05-09T00:58:37.368650+0000","last_unstale":"2024-05-09T01:00:18.925261+0000","last_undegraded":"2024-05-09T01:00:18.925261+0000","last_fullsized":"2024-05-09T01:00:18.925261+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:07.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.087845+0000","last_change":"2024-05-09T00:58:34.821742+0000","last_active":"2024-05-09T00:59:20.087845+0000","last_peered":"2024-05-09T00:59:20.087845+0000","last_clean":"2024-05-09T00:59:20.087845+0000","last_became_active":"2024-05-09T00:58:34.821290+0000","last_became_peered":"2024-05-09T00:58:34.821290+0000","last_unstale":"2024-05-09T00:59:20.087845+0000","last_undegraded":"2024-05-09T00:59:20.087845+0000","last_fullsized":"2024-05-09T00:59:20.087845+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:18.735763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.890604+0000","last_change":"2024-05-09T00:58:37.361727+0000","last_active":"2024-05-09T01:00:18.890604+0000","last_peered":"2024-05-09T01:00:18.890604+0000","last_clean":"2024-05-09T01:00:18.890604+0000","last_became_active":"2024-05-09T00:58:37.361351+0000","last_became_peered":"2024-05-09T00:58:37.361351+0000","last_unstale":"2024-05-09T01:00:18.890604+0000","last_undegraded":"2024-05-09T01:00:18.890604+0000","last_fullsized":"2024-05-09T01:00:18.890604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:14.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077882+0000","last_change":"2024-05-09T00:58:34.330578+0000","last_active":"2024-05-09T00:59:20.077882+0000","last_peered":"2024-05-09T00:59:20.077882+0000","last_clean":"2024-05-09T00:59:20.077882+0000","last_became_active":"2024-05-09T00:58:34.330273+0000","last_became_peered":"2024-05-09T00:58:34.330273+0000","last_unstale":"2024-05-09T00:59:20.077882+0000","last_undegraded":"2024-05-09T00:59:20.077882+0000","last_fullsized":"2024-05-09T00:59:20.077882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:45.795771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917899+0000","last_change":"2024-05-09T00:58:37.371323+0000","last_active":"2024-05-09T01:00:18.917899+0000","last_peered":"2024-05-09T01:00:18.917899+0000","last_clean":"2024-05-09T01:00:18.917899+0000","last_became_active":"2024-05-09T00:58:37.370942+0000","last_became_peered":"2024-05-09T00:58:37.370942+0000","last_unstale":"2024-05-09T01:00:18.917899+0000","last_undegraded":"2024-05-09T01:00:18.917899+0000","last_fullsized":"2024-05-09T01:00:18.917899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:57.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.100103+0000","last_change":"2024-05-09T00:59:20.099633+0000","last_active":"2024-05-09T00:59:20.100103+0000","last_peered":"2024-05-09T00:59:20.100103+0000","last_clean":"2024-05-09T00:59:20.100103+0000","last_became_active":"2024-05-09T00:59:20.080964+0000","last_became_peered":"2024-05-09T00:59:20.080964+0000","last_unstale":"2024-05-09T00:59:20.100103+0000","last_undegraded":"2024-05-09T00:59:20.100103+0000","last_fullsized":"2024-05-09T00:59:20.100103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:53.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918851+0000","last_change":"2024-05-09T00:58:37.361319+0000","last_active":"2024-05-09T01:00:18.918851+0000","last_peered":"2024-05-09T01:00:18.918851+0000","last_clean":"2024-05-09T01:00:18.918851+0000","last_became_active":"2024-05-09T00:58:37.360703+0000","last_became_peered":"2024-05-09T00:58:37.360703+0000","last_unstale":"2024-05-09T01:00:18.918851+0000","last_undegraded":"2024-05-09T01:00:18.918851+0000","last_fullsized":"2024-05-09T01:00:18.918851+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:24.202453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076474+0000","last_change":"2024-05-09T00:58:34.333394+0000","last_active":"2024-05-09T00:59:20.076474+0000","last_peered":"2024-05-09T00:59:20.076474+0000","last_clean":"2024-05-09T00:59:20.076474+0000","last_became_active":"2024-05-09T00:58:34.332902+0000","last_became_peered":"2024-05-09T00:58:34.332902+0000","last_unstale":"2024-05-09T00:59:20.076474+0000","last_undegraded":"2024-05-09T00:59:20.076474+0000","last_fullsized":"2024-05-09T00:59:20.076474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:38.301831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925334+0000","last_change":"2024-05-09T00:58:37.366963+0000","last_active":"2024-05-09T01:00:18.925334+0000","last_peered":"2024-05-09T01:00:18.925334+0000","last_clean":"2024-05-09T01:00:18.925334+0000","last_became_active":"2024-05-09T00:58:37.366591+0000","last_became_peered":"2024-05-09T00:58:37.366591+0000","last_unstale":"2024-05-09T01:00:18.925334+0000","last_undegraded":"2024-05-09T01:00:18.925334+0000","last_fullsized":"2024-05-09T01:00:18.925334+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:44.894281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'7","reported_seq":132,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:30.150318+0000","last_change":"2024-05-09T00:58:34.956368+0000","last_active":"2024-05-09T01:00:30.150318+0000","last_peered":"2024-05-09T01:00:30.150318+0000","last_clean":"2024-05-09T01:00:30.150318+0000","last_became_active":"2024-05-09T00:58:34.955888+0000","last_became_peered":"2024-05-09T00:58:34.955888+0000","last_unstale":"2024-05-09T01:00:30.150318+0000","last_undegraded":"2024-05-09T01:00:30.150318+0000","last_fullsized":"2024-05-09T01:00:30.150318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:15.884435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926614+0000","last_change":"2024-05-09T00:58:37.368150+0000","last_active":"2024-05-09T01:00:18.926614+0000","last_peered":"2024-05-09T01:00:18.926614+0000","last_clean":"2024-05-09T01:00:18.926614+0000","last_became_active":"2024-05-09T00:58:37.367800+0000","last_became_peered":"2024-05-09T00:58:37.367800+0000","last_unstale":"2024-05-09T01:00:18.926614+0000","last_undegraded":"2024-05-09T01:00:18.926614+0000","last_fullsized":"2024-05-09T01:00:18.926614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:20.791816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079953+0000","last_change":"2024-05-09T00:58:34.329311+0000","last_active":"2024-05-09T00:59:20.079953+0000","last_peered":"2024-05-09T00:59:20.079953+0000","last_clean":"2024-05-09T00:59:20.079953+0000","last_became_active":"2024-05-09T00:58:34.328841+0000","last_became_peered":"2024-05-09T00:58:34.328841+0000","last_unstale":"2024-05-09T00:59:20.079953+0000","last_undegraded":"2024-05-09T00:59:20.079953+0000","last_fullsized":"2024-05-09T00:59:20.079953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.912688+0000","last_change":"2024-05-09T00:58:37.369498+0000","last_active":"2024-05-09T01:00:18.912688+0000","last_peered":"2024-05-09T01:00:18.912688+0000","last_clean":"2024-05-09T01:00:18.912688+0000","last_became_active":"2024-05-09T00:58:37.369166+0000","last_became_peered":"2024-05-09T00:58:37.369166+0000","last_unstale":"2024-05-09T01:00:18.912688+0000","last_undegraded":"2024-05-09T01:00:18.912688+0000","last_fullsized":"2024-05-09T01:00:18.912688+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:56.411666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073056+0000","last_change":"2024-05-09T00:58:34.328756+0000","last_active":"2024-05-09T00:59:20.073056+0000","last_peered":"2024-05-09T00:59:20.073056+0000","last_clean":"2024-05-09T00:59:20.073056+0000","last_became_active":"2024-05-09T00:58:34.328381+0000","last_became_peered":"2024-05-09T00:58:34.328381+0000","last_unstale":"2024-05-09T00:59:20.073056+0000","last_undegraded":"2024-05-09T00:59:20.073056+0000","last_fullsized":"2024-05-09T00:59:20.073056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:26.558360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924991+0000","last_change":"2024-05-09T00:58:37.369557+0000","last_active":"2024-05-09T01:00:18.924991+0000","last_peered":"2024-05-09T01:00:18.924991+0000","last_clean":"2024-05-09T01:00:18.924991+0000","last_became_active":"2024-05-09T00:58:37.369225+0000","last_became_peered":"2024-05-09T00:58:37.369225+0000","last_unstale":"2024-05-09T01:00:18.924991+0000","last_undegraded":"2024-05-09T01:00:18.924991+0000","last_fullsized":"2024-05-09T01:00:18.924991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:21.761421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920013+0000","last_change":"2024-05-09T00:58:37.369919+0000","last_active":"2024-05-09T01:00:18.920013+0000","last_peered":"2024-05-09T01:00:18.920013+0000","last_clean":"2024-05-09T01:00:18.920013+0000","last_became_active":"2024-05-09T00:58:37.369507+0000","last_became_peered":"2024-05-09T00:58:37.369507+0000","last_unstale":"2024-05-09T01:00:18.920013+0000","last_undegraded":"2024-05-09T01:00:18.920013+0000","last_fullsized":"2024-05-09T01:00:18.920013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.294074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919725+0000","last_change":"2024-05-09T00:58:37.363775+0000","last_active":"2024-05-09T01:00:18.919725+0000","last_peered":"2024-05-09T01:00:18.919725+0000","last_clean":"2024-05-09T01:00:18.919725+0000","last_became_active":"2024-05-09T00:58:37.363394+0000","last_became_peered":"2024-05-09T00:58:37.363394+0000","last_unstale":"2024-05-09T01:00:18.919725+0000","last_undegraded":"2024-05-09T01:00:18.919725+0000","last_fullsized":"2024-05-09T01:00:18.919725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.156009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919467+0000","last_change":"2024-05-09T00:58:37.357699+0000","last_active":"2024-05-09T01:00:18.919467+0000","last_peered":"2024-05-09T01:00:18.919467+0000","last_clean":"2024-05-09T01:00:18.919467+0000","last_became_active":"2024-05-09T00:58:37.357356+0000","last_became_peered":"2024-05-09T00:58:37.357356+0000","last_unstale":"2024-05-09T01:00:18.919467+0000","last_undegraded":"2024-05-09T01:00:18.919467+0000","last_fullsized":"2024-05-09T01:00:18.919467+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:14.861644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925268+0000","last_change":"2024-05-09T00:58:37.369419+0000","last_active":"2024-05-09T01:00:18.925268+0000","last_peered":"2024-05-09T01:00:18.925268+0000","last_clean":"2024-05-09T01:00:18.925268+0000","last_became_active":"2024-05-09T00:58:37.363949+0000","last_became_peered":"2024-05-09T00:58:37.363949+0000","last_unstale":"2024-05-09T01:00:18.925268+0000","last_undegraded":"2024-05-09T01:00:18.925268+0000","last_fullsized":"2024-05-09T01:00:18.925268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:04.081713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918659+0000","last_change":"2024-05-09T00:58:37.373651+0000","last_active":"2024-05-09T01:00:18.918659+0000","last_peered":"2024-05-09T01:00:18.918659+0000","last_clean":"2024-05-09T01:00:18.918659+0000","last_became_active":"2024-05-09T00:58:37.373257+0000","last_became_peered":"2024-05-09T00:58:37.373257+0000","last_unstale":"2024-05-09T01:00:18.918659+0000","last_undegraded":"2024-05-09T01:00:18.918659+0000","last_fullsized":"2024-05-09T01:00:18.918659+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:27.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917530+0000","last_change":"2024-05-09T00:58:37.367666+0000","last_active":"2024-05-09T01:00:18.917530+0000","last_peered":"2024-05-09T01:00:18.917530+0000","last_clean":"2024-05-09T01:00:18.917530+0000","last_became_active":"2024-05-09T00:58:37.366869+0000","last_became_peered":"2024-05-09T00:58:37.366869+0000","last_unstale":"2024-05-09T01:00:18.917530+0000","last_undegraded":"2024-05-09T01:00:18.917530+0000","last_fullsized":"2024-05-09T01:00:18.917530+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:07.952594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915045+0000","last_change":"2024-05-09T00:58:37.362205+0000","last_active":"2024-05-09T01:00:18.915045+0000","last_peered":"2024-05-09T01:00:18.915045+0000","last_clean":"2024-05-09T01:00:18.915045+0000","last_became_active":"2024-05-09T00:58:37.361704+0000","last_became_peered":"2024-05-09T00:58:37.361704+0000","last_unstale":"2024-05-09T01:00:18.915045+0000","last_undegraded":"2024-05-09T01:00:18.915045+0000","last_fullsized":"2024-05-09T01:00:18.915045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:34.334593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915177+0000","last_change":"2024-05-09T00:58:37.367143+0000","last_active":"2024-05-09T01:00:18.915177+0000","last_peered":"2024-05-09T01:00:18.915177+0000","last_clean":"2024-05-09T01:00:18.915177+0000","last_became_active":"2024-05-09T00:58:37.364364+0000","last_became_peered":"2024-05-09T00:58:37.364364+0000","last_unstale":"2024-05-09T01:00:18.915177+0000","last_undegraded":"2024-05-09T01:00:18.915177+0000","last_fullsized":"2024-05-09T01:00:18.915177+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:55.154458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.912464+0000","last_change":"2024-05-09T00:58:37.365757+0000","last_active":"2024-05-09T01:00:18.912464+0000","last_peered":"2024-05-09T01:00:18.912464+0000","last_clean":"2024-05-09T01:00:18.912464+0000","last_became_active":"2024-05-09T00:58:37.365408+0000","last_became_peered":"2024-05-09T00:58:37.365408+0000","last_unstale":"2024-05-09T01:00:18.912464+0000","last_undegraded":"2024-05-09T01:00:18.912464+0000","last_fullsized":"2024-05-09T01:00:18.912464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920328+0000","last_change":"2024-05-09T00:58:37.366954+0000","last_active":"2024-05-09T01:00:18.920328+0000","last_peered":"2024-05-09T01:00:18.920328+0000","last_clean":"2024-05-09T01:00:18.920328+0000","last_became_active":"2024-05-09T00:58:37.364361+0000","last_became_peered":"2024-05-09T00:58:37.364361+0000","last_unstale":"2024-05-09T01:00:18.920328+0000","last_undegraded":"2024-05-09T01:00:18.920328+0000","last_fullsized":"2024-05-09T01:00:18.920328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:31.248873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926774+0000","last_change":"2024-05-09T00:58:37.368467+0000","last_active":"2024-05-09T01:00:18.926774+0000","last_peered":"2024-05-09T01:00:18.926774+0000","last_clean":"2024-05-09T01:00:18.926774+0000","last_became_active":"2024-05-09T00:58:37.368104+0000","last_became_peered":"2024-05-09T00:58:37.368104+0000","last_unstale":"2024-05-09T01:00:18.926774+0000","last_undegraded":"2024-05-09T01:00:18.926774+0000","last_fullsized":"2024-05-09T01:00:18.926774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919830+0000","last_change":"2024-05-09T00:58:37.366897+0000","last_active":"2024-05-09T01:00:18.919830+0000","last_peered":"2024-05-09T01:00:18.919830+0000","last_clean":"2024-05-09T01:00:18.919830+0000","last_became_active":"2024-05-09T00:58:37.366555+0000","last_became_peered":"2024-05-09T00:58:37.366555+0000","last_unstale":"2024-05-09T01:00:18.919830+0000","last_undegraded":"2024-05-09T01:00:18.919830+0000","last_fullsized":"2024-05-09T01:00:18.919830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.394191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916213+0000","last_change":"2024-05-09T00:58:37.358875+0000","last_active":"2024-05-09T01:00:18.916213+0000","last_peered":"2024-05-09T01:00:18.916213+0000","last_clean":"2024-05-09T01:00:18.916213+0000","last_became_active":"2024-05-09T00:58:37.358505+0000","last_became_peered":"2024-05-09T00:58:37.358505+0000","last_unstale":"2024-05-09T01:00:18.916213+0000","last_undegraded":"2024-05-09T01:00:18.916213+0000","last_fullsized":"2024-05-09T01:00:18.916213+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:15.268147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68082,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":996,"num_read_kb":568,"num_write":254,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":892928,"data_stored":431606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874284,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1585152,"data_stored":1083119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037810,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":431158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1503232,"data_stored":1023929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626498,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":430609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":492118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":432480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36288,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708864,"statfs":{"total":95995035648,"available":95957876736,"internally_reserved":0,"allocated":974848,"data_stored":492870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":431002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1023075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:00:36.595 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T01:00:36.595 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T01:00:36.595 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-09T01:00:36.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-09T01:00:37.086 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:37.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:37 smithi136 ceph-mon[34110]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:00:37.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:37 smithi037 ceph-mon[30122]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:00:37.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:37 smithi151 ceph-mon[34780]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:00:38.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:38 smithi136 ceph-mon[34110]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:38.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:38 smithi037 ceph-mon[30122]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:38.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:38 smithi151 ceph-mon[34780]: pgmap v350: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 -- 172.21.15.37:0/4111470719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df81034c0 msgr2=0x7f5df81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/4111470719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df81034c0 0x7f5df81038d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5de800dd20 tx=0x7f5de800f330 comp rx=0 tx=0).stop 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 -- 172.21.15.37:0/4111470719 shutdown_connections 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/4111470719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df8108740 0x7f5df81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/4111470719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df81034c0 0x7f5df81038d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/4111470719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df8107df0 0x7f5df8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 -- 172.21.15.37:0/4111470719 >> 172.21.15.37:0/4111470719 conn(0x7f5df80fedc0 msgr2=0x7f5df81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.730+0000 7f5dfdebb700 1 -- 172.21.15.37:0/4111470719 shutdown_connections 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.731+0000 7f5dfdebb700 1 -- 172.21.15.37:0/4111470719 wait complete. 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 Processor -- start 2024-05-09T01:00:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 -- start start 2024-05-09T01:00:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df81034c0 0x7f5df819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df8107df0 0x7f5df819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df8108740 0x7f5df8198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5df81122c0 con 0x7f5df8108740 2024-05-09T01:00:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5df8112140 con 0x7f5df8107df0 2024-05-09T01:00:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.732+0000 7f5dfdebb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5df8112440 con 0x7f5df81034c0 2024-05-09T01:00:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df8108740 0x7f5df8198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df8108740 0x7f5df8198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45316/0 (socket says 172.21.15.37:45316) 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df7fff700 1 -- 172.21.15.37:0/29595282 learned_addr learned my addr 172.21.15.37:0/29595282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df8107df0 0x7f5df819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df77fe700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df81034c0 0x7f5df819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df6ffd700 1 -- 172.21.15.37:0/29595282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df81034c0 msgr2=0x7f5df819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df6ffd700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df81034c0 0x7f5df819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df6ffd700 1 -- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df8108740 msgr2=0x7f5df8198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df6ffd700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df8108740 0x7f5df8198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df6ffd700 1 -- 172.21.15.37:0/29595282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df81990c0 con 0x7f5df8107df0 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df6ffd700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df8107df0 0x7f5df819eda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9c0 tx=0x7f5dec00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.733+0000 7f5df4ff9700 1 -- 172.21.15.37:0/29595282 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec004220 con 0x7f5df8107df0 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.734+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df81993b0 con 0x7f5df8107df0 2024-05-09T01:00:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.734+0000 7f5df4ff9700 1 -- 172.21.15.37:0/29595282 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dec0043c0 con 0x7f5df8107df0 2024-05-09T01:00:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.734+0000 7f5df4ff9700 1 -- 172.21.15.37:0/29595282 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dec005020 con 0x7f5df8107df0 2024-05-09T01:00:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.734+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df81a56f0 con 0x7f5df8107df0 2024-05-09T01:00:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.735+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df80512c0 con 0x7f5df8107df0 2024-05-09T01:00:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.736+0000 7f5df4ff9700 1 -- 172.21.15.37:0/29595282 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5dec004750 con 0x7f5df8107df0 2024-05-09T01:00:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.737+0000 7f5df4ff9700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5de00b2880 0x7f5de00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.737+0000 7f5df4ff9700 1 -- 172.21.15.37:0/29595282 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5dec0e2200 con 0x7f5df8107df0 2024-05-09T01:00:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.737+0000 7f5df77fe700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5de00b2880 0x7f5de00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.738+0000 7f5df77fe700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5de00b2880 0x7f5de00b4d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5de8006010 tx=0x7f5de800f6c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:38.741+0000 7f5df4ff9700 1 -- 172.21.15.37:0/29595282 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5dec0a9fb0 con 0x7f5df8107df0 2024-05-09T01:00:39.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.021+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5df8199fb0 con 0x7f5df8107df0 2024-05-09T01:00:39.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.022+0000 7f5df4ff9700 1 -- 172.21.15.37:0/29595282 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5dec0a98b0 con 0x7f5df8107df0 2024-05-09T01:00:39.023 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:00:39.023 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T01:00:39.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5de00b2880 msgr2=0x7f5de00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5de00b2880 0x7f5de00b4d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5de8006010 tx=0x7f5de800f6c0 comp rx=0 tx=0).stop 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df8107df0 msgr2=0x7f5df819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df8107df0 0x7f5df819eda0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e9c0 tx=0x7f5dec00ecd0 comp rx=0 tx=0).stop 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 shutdown_connections 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5de00b2880 0x7f5de00b4d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df8108740 0x7f5df8198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df81034c0 0x7f5df819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 --2- 172.21.15.37:0/29595282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5df8107df0 0x7f5df819eda0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.024+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 >> 172.21.15.37:0/29595282 conn(0x7f5df80fedc0 msgr2=0x7f5df81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.025+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 shutdown_connections 2024-05-09T01:00:39.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:39.025+0000 7f5dfdebb700 1 -- 172.21.15.37:0/29595282 wait complete. 2024-05-09T01:00:39.651 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-09T01:00:39.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:00:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:39 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:39 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:39 smithi037 ceph-mon[30122]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:39 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/29595282' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T01:00:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:39 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:00:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:39 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:00:39.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:39 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:40.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:39 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:40.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:39 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:40.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:39 smithi136 ceph-mon[34110]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:40.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:39 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/29595282' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T01:00:40.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:39 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:00:40.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:39 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:00:40.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:39 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:40.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:39 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:40.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:39 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:40.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:39 smithi151 ceph-mon[34780]: pgmap v351: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:40.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:39 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/29595282' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T01:00:40.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:39 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:00:40.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:39 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:00:40.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:39 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:00:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 -- 172.21.15.37:0/2503335131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b4103310 msgr2=0x7f52b410f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/2503335131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b4103310 0x7f52b410f890 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00b0a0 tx=0x7f52ac00b3b0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 -- 172.21.15.37:0/2503335131 shutdown_connections 2024-05-09T01:00:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/2503335131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b4103310 0x7f52b410f890 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/2503335131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b41089f0 0x7f52b4108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/2503335131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52b41029c0 0x7f52b4102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 -- 172.21.15.37:0/2503335131 >> 172.21.15.37:0/2503335131 conn(0x7f52b40fe4e0 msgr2=0x7f52b4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 -- 172.21.15.37:0/2503335131 shutdown_connections 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.508+0000 7f52b8c7c700 1 -- 172.21.15.37:0/2503335131 wait complete. 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.509+0000 7f52b8c7c700 1 Processor -- start 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.509+0000 7f52b8c7c700 1 -- start start 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b8c7c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52b41029c0 0x7f52b419ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b8c7c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b4103310 0x7f52b419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b8c7c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b41089f0 0x7f52b419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b8c7c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41122e0 con 0x7f52b41089f0 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b8c7c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4112160 con 0x7f52b41029c0 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b8c7c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4112460 con 0x7f52b4103310 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b41089f0 0x7f52b419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b41089f0 0x7f52b419f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45328/0 (socket says 172.21.15.37:45328) 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 -- 172.21.15.37:0/1525121569 learned_addr learned my addr 172.21.15.37:0/1525121569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b259c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52b41029c0 0x7f52b419ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b1d9b700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b4103310 0x7f52b419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 -- 172.21.15.37:0/1525121569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b4103310 msgr2=0x7f52b419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b4103310 0x7f52b419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 -- 172.21.15.37:0/1525121569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52b41029c0 msgr2=0x7f52b419ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52b41029c0 0x7f52b419ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 -- 172.21.15.37:0/1525121569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b419fcb0 con 0x7f52b41089f0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b1d9b700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b4103310 0x7f52b419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52b2d9d700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b41089f0 0x7f52b419f610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00b830 tx=0x7f52ac004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.510+0000 7f52a37fe700 1 -- 172.21.15.37:0/1525121569 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac021070 con 0x7f52b41089f0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.511+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b419ff40 con 0x7f52b41089f0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.511+0000 7f52a37fe700 1 -- 172.21.15.37:0/1525121569 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac007e30 con 0x7f52b41089f0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.511+0000 7f52a37fe700 1 -- 172.21.15.37:0/1525121569 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0047d0 con 0x7f52b41089f0 2024-05-09T01:00:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.511+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b41a78c0 con 0x7f52b41089f0 2024-05-09T01:00:41.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.512+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b4104100 con 0x7f52b41089f0 2024-05-09T01:00:41.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.513+0000 7f52a37fe700 1 -- 172.21.15.37:0/1525121569 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f52ac007980 con 0x7f52b41089f0 2024-05-09T01:00:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.514+0000 7f52a37fe700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f529c0b2900 0x7f529c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.514+0000 7f52b259c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f529c0b2900 0x7f529c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.514+0000 7f52a37fe700 1 -- 172.21.15.37:0/1525121569 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f52ac00f020 con 0x7f52b41089f0 2024-05-09T01:00:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.515+0000 7f52b259c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f529c0b2900 0x7f529c0b4e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005950 tx=0x7f52a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.518+0000 7f52a37fe700 1 -- 172.21.15.37:0/1525121569 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52ac02a020 con 0x7f52b41089f0 2024-05-09T01:00:41.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.778+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52b402e5f0 con 0x7f52b41089f0 2024-05-09T01:00:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.779+0000 7f52a37fe700 1 -- 172.21.15.37:0/1525121569 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f52ac0ab920 con 0x7f52b41089f0 2024-05-09T01:00:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:00:41.780 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T00:58:58.933698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.781+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f529c0b2900 msgr2=0x7f529c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.781+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f529c0b2900 0x7f529c0b4e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005950 tx=0x7f52a400b410 comp rx=0 tx=0).stop 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.781+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b41089f0 msgr2=0x7f52b419f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.781+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b41089f0 0x7f52b419f610 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00b830 tx=0x7f52ac004ce0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.781+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 shutdown_connections 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.782+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f529c0b2900 0x7f529c0b4e10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.782+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b41089f0 0x7f52b419f610 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.782+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52b41029c0 0x7f52b419ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.782+0000 7f52b8c7c700 1 --2- 172.21.15.37:0/1525121569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b4103310 0x7f52b419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.782+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 >> 172.21.15.37:0/1525121569 conn(0x7f52b40fe4e0 msgr2=0x7f52b4106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.782+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 shutdown_connections 2024-05-09T01:00:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:41.782+0000 7f52b8c7c700 1 -- 172.21.15.37:0/1525121569 wait complete. 2024-05-09T01:00:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-09T01:00:42.159 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:41 smithi037 ceph-mon[30122]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:42.159 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:41 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1525121569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:42.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:41 smithi151 ceph-mon[34780]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:42.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:41 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1525121569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:42.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:41 smithi136 ceph-mon[34110]: pgmap v352: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:42.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:41 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1525121569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:42.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:00:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:44.114 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:43 smithi037 ceph-mon[30122]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:44.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:43 smithi151 ceph-mon[34780]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 -- 172.21.15.37:0/618154482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 msgr2=0x7fb1dc104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 --2- 172.21.15.37:0/618154482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc104a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0099c0 tx=0x7fb1cc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 -- 172.21.15.37:0/618154482 shutdown_connections 2024-05-09T01:00:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 --2- 172.21.15.37:0/618154482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1dc109880 0x7fb1dc1111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 --2- 172.21.15.37:0/618154482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc104a60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 --2- 172.21.15.37:0/618154482 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1dc108f30 0x7fb1dc109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 -- 172.21.15.37:0/618154482 >> 172.21.15.37:0/618154482 conn(0x7fb1dc079f00 msgr2=0x7fb1dc07a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 -- 172.21.15.37:0/618154482 shutdown_connections 2024-05-09T01:00:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 -- 172.21.15.37:0/618154482 wait complete. 2024-05-09T01:00:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.351+0000 7fb1e160a700 1 Processor -- start 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1e160a700 1 -- start start 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1e160a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1e160a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1dc108f30 0x7fb1dc19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1e160a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1dc109880 0x7fb1dc19f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1e160a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc1144d0 con 0x7fb1dc104650 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1e160a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc114350 con 0x7fb1dc108f30 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1e160a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc114650 con 0x7fb1dc109880 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc19ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34768/0 (socket says 172.21.15.37:34768) 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 -- 172.21.15.37:0/3779329120 learned_addr learned my addr 172.21.15.37:0/3779329120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1da7fc700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1dc108f30 0x7fb1dc19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1db7fe700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1dc109880 0x7fb1dc19f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 -- 172.21.15.37:0/3779329120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1dc109880 msgr2=0x7fb1dc19f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1dc109880 0x7fb1dc19f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 -- 172.21.15.37:0/3779329120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1dc108f30 msgr2=0x7fb1dc19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1dc108f30 0x7fb1dc19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1daffd700 1 -- 172.21.15.37:0/3779329120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc19fcd0 con 0x7fb1dc104650 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1da7fc700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1dc108f30 0x7fb1dc19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.352+0000 7fb1db7fe700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1dc109880 0x7fb1dc19f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.353+0000 7fb1daffd700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc19ae00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc006010 tx=0x7fb1cc004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.353+0000 7fb1c3fff700 1 -- 172.21.15.37:0/3779329120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc026070 con 0x7fb1dc104650 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.353+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc19ff60 con 0x7fb1dc104650 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.353+0000 7fb1c3fff700 1 -- 172.21.15.37:0/3779329120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1cc00f460 con 0x7fb1dc104650 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.353+0000 7fb1c3fff700 1 -- 172.21.15.37:0/3779329120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc009e60 con 0x7fb1dc104650 2024-05-09T01:00:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.353+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc1a0440 con 0x7fb1dc104650 2024-05-09T01:00:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.354+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1dc0512c0 con 0x7fb1dc104650 2024-05-09T01:00:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.355+0000 7fb1c3fff700 1 -- 172.21.15.37:0/3779329120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb1cc029070 con 0x7fb1dc104650 2024-05-09T01:00:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.356+0000 7fb1c3fff700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1c40b2880 0x7fb1c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.356+0000 7fb1da7fc700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1c40b2880 0x7fb1c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.356+0000 7fb1c3fff700 1 -- 172.21.15.37:0/3779329120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb1cc0e2b40 con 0x7fb1dc104650 2024-05-09T01:00:44.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.357+0000 7fb1da7fc700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1c40b2880 0x7fb1c40b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0005950 tx=0x7fb1d00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.361+0000 7fb1c3fff700 1 -- 172.21.15.37:0/3779329120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb1cc013070 con 0x7fb1dc104650 2024-05-09T01:00:44.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:43 smithi136 ceph-mon[34110]: pgmap v353: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:44.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.625+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1dc02e5f0 con 0x7fb1dc104650 2024-05-09T01:00:44.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.625+0000 7fb1c3fff700 1 -- 172.21.15.37:0/3779329120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7fb1cc0aa8f0 con 0x7fb1dc104650 2024-05-09T01:00:44.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:00:44.626 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T00:58:58.933698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1c40b2880 msgr2=0x7fb1c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1c40b2880 0x7fb1c40b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0005950 tx=0x7fb1d00058e0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 msgr2=0x7fb1dc19ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc19ae00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc006010 tx=0x7fb1cc004690 comp rx=0 tx=0).stop 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 shutdown_connections 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1c40b2880 0x7fb1c40b4d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1dc109880 0x7fb1dc19f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1dc104650 0x7fb1dc19ae00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 --2- 172.21.15.37:0/3779329120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1dc108f30 0x7fb1dc19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 >> 172.21.15.37:0/3779329120 conn(0x7fb1dc079f00 msgr2=0x7fb1dc102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:44.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 shutdown_connections 2024-05-09T01:00:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:44.628+0000 7fb1e160a700 1 -- 172.21.15.37:0/3779329120 wait complete. 2024-05-09T01:00:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-09T01:00:45.332 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:44 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3779329120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:45.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T01:00:45.380 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:44 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3779329120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:45.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:44 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3779329120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:46.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:45 smithi037 ceph-mon[30122]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:46.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:45 smithi136 ceph-mon[34110]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:46.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:45 smithi151 ceph-mon[34780]: pgmap v354: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 -- 172.21.15.37:0/751915105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a841055b0 msgr2=0x7f4a841059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 --2- 172.21.15.37:0/751915105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a841055b0 0x7f4a841059c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4a7400b0a0 tx=0x7f4a7400b3b0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 -- 172.21.15.37:0/751915105 shutdown_connections 2024-05-09T01:00:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 --2- 172.21.15.37:0/751915105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a8410e990 0x7f4a84110e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 --2- 172.21.15.37:0/751915105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a841055b0 0x7f4a841059c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 --2- 172.21.15.37:0/751915105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84105f00 0x7f4a8410e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 -- 172.21.15.37:0/751915105 >> 172.21.15.37:0/751915105 conn(0x7f4a84078e00 msgr2=0x7f4a84079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 -- 172.21.15.37:0/751915105 shutdown_connections 2024-05-09T01:00:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.199+0000 7f4a8960d700 1 -- 172.21.15.37:0/751915105 wait complete. 2024-05-09T01:00:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.200+0000 7f4a8960d700 1 Processor -- start 2024-05-09T01:00:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.200+0000 7f4a8960d700 1 -- start start 2024-05-09T01:00:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a8960d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a841055b0 0x7f4a8419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a8960d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84105f00 0x7f4a8419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a8960d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8410e990 0x7f4a8419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a8960d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a841144b0 con 0x7f4a8410e990 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a8960d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84114330 con 0x7f4a841055b0 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a8960d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4a84114630 con 0x7f4a84105f00 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8410e990 0x7f4a8419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8410e990 0x7f4a8419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34788/0 (socket says 172.21.15.37:34788) 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 -- 172.21.15.37:0/3003922960 learned_addr learned my addr 172.21.15.37:0/3003922960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a82ffd700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a841055b0 0x7f4a8419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a827fc700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84105f00 0x7f4a8419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 -- 172.21.15.37:0/3003922960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84105f00 msgr2=0x7f4a8419b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84105f00 0x7f4a8419b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 -- 172.21.15.37:0/3003922960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a841055b0 msgr2=0x7f4a8419ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a841055b0 0x7f4a8419ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.201+0000 7f4a837fe700 1 -- 172.21.15.37:0/3003922960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8419fc60 con 0x7f4a8410e990 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.202+0000 7f4a837fe700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8410e990 0x7f4a8419f670 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00d950 tx=0x7f4a7c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.202+0000 7f4a6bfff700 1 -- 172.21.15.37:0/3003922960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c016070 con 0x7f4a8410e990 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.202+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8419ff50 con 0x7f4a8410e990 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.202+0000 7f4a6bfff700 1 -- 172.21.15.37:0/3003922960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a7c005020 con 0x7f4a8410e990 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.202+0000 7f4a6bfff700 1 -- 172.21.15.37:0/3003922960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c00fa10 con 0x7f4a8410e990 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.202+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a841a0440 con 0x7f4a8410e990 2024-05-09T01:00:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.203+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a840512c0 con 0x7f4a8410e990 2024-05-09T01:00:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.204+0000 7f4a6bfff700 1 -- 172.21.15.37:0/3003922960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4a7c00fbd0 con 0x7f4a8410e990 2024-05-09T01:00:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.205+0000 7f4a6bfff700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4a6c0b2880 0x7f4a6c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.205+0000 7f4a82ffd700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4a6c0b2880 0x7f4a6c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.205+0000 7f4a6bfff700 1 -- 172.21.15.37:0/3003922960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4a7c0e1be0 con 0x7f4a8410e990 2024-05-09T01:00:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.206+0000 7f4a82ffd700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4a6c0b2880 0x7f4a6c0b4d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009900 tx=0x7f4a7400b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:47.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.210+0000 7f4a6bfff700 1 -- 172.21.15.37:0/3003922960 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4a7c0a9900 con 0x7f4a8410e990 2024-05-09T01:00:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.423+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a8402e5f0 con 0x7f4a8410e990 2024-05-09T01:00:47.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.425+0000 7f4a6bfff700 1 -- 172.21.15.37:0/3003922960 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7f4a7c0a9200 con 0x7f4a8410e990 2024-05-09T01:00:47.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:00:47.426 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:00:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4a6c0b2880 msgr2=0x7f4a6c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4a6c0b2880 0x7f4a6c0b4d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a74009900 tx=0x7f4a7400b7b0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8410e990 msgr2=0x7f4a8419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8410e990 0x7f4a8419f670 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c00d950 tx=0x7f4a7c00dc60 comp rx=0 tx=0).stop 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 shutdown_connections 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4a6c0b2880 0x7f4a6c0b4d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8410e990 0x7f4a8419f670 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4a841055b0 0x7f4a8419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 --2- 172.21.15.37:0/3003922960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a84105f00 0x7f4a8419b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.427+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 >> 172.21.15.37:0/3003922960 conn(0x7f4a84078e00 msgr2=0x7f4a84100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.428+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 shutdown_connections 2024-05-09T01:00:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:47.428+0000 7f4a8960d700 1 -- 172.21.15.37:0/3003922960 wait complete. 2024-05-09T01:00:48.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:00:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:48.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:47 smithi136 ceph-mon[34110]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:48.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:47 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3003922960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:00:48.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:47 smithi037 ceph-mon[30122]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:48.395 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:47 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3003922960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:00:48.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:47 smithi151 ceph-mon[34780]: pgmap v355: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:48.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:47 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3003922960' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:00:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 -- 172.21.15.37:0/276703141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8108740 msgr2=0x7f50a81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 --2- 172.21.15.37:0/276703141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8108740 0x7f50a81100a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f50a000b0d0 tx=0x7f50a000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:00:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 -- 172.21.15.37:0/276703141 shutdown_connections 2024-05-09T01:00:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 --2- 172.21.15.37:0/276703141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8108740 0x7f50a81100a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 --2- 172.21.15.37:0/276703141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50a81034c0 0x7f50a81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 --2- 172.21.15.37:0/276703141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a8107df0 0x7f50a8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 -- 172.21.15.37:0/276703141 >> 172.21.15.37:0/276703141 conn(0x7f50a80fedf0 msgr2=0x7f50a8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 -- 172.21.15.37:0/276703141 shutdown_connections 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.956+0000 7f50add52700 1 -- 172.21.15.37:0/276703141 wait complete. 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 Processor -- start 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 -- start start 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81034c0 0x7f50a819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8107df0 0x7f50a819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50a8108740 0x7f50a819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50a81144c0 con 0x7f50a8107df0 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8114340 con 0x7f50a8108740 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.957+0000 7f50add52700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8114640 con 0x7f50a81034c0 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8107df0 0x7f50a819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8107df0 0x7f50a819b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34802/0 (socket says 172.21.15.37:34802) 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 -- 172.21.15.37:0/396884022 learned_addr learned my addr 172.21.15.37:0/396884022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a7fff700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50a8108740 0x7f50a819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a77fe700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81034c0 0x7f50a819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 -- 172.21.15.37:0/396884022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81034c0 msgr2=0x7f50a819ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81034c0 0x7f50a819ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 -- 172.21.15.37:0/396884022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50a8108740 msgr2=0x7f50a819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50a8108740 0x7f50a819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 -- 172.21.15.37:0/396884022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a819fc60 con 0x7f50a8107df0 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a77fe700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81034c0 0x7f50a819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a6ffd700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8107df0 0x7f50a819b330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f509c00c8f0 tx=0x7f509c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a4ff9700 1 -- 172.21.15.37:0/396884022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c007940 con 0x7f50a8107df0 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a819ff50 con 0x7f50a8107df0 2024-05-09T01:00:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a4ff9700 1 -- 172.21.15.37:0/396884022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f509c00f450 con 0x7f50a8107df0 2024-05-09T01:00:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.958+0000 7f50a4ff9700 1 -- 172.21.15.37:0/396884022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509c018660 con 0x7f50a8107df0 2024-05-09T01:00:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.959+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a81a7870 con 0x7f50a8107df0 2024-05-09T01:00:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.960+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a80512c0 con 0x7f50a8107df0 2024-05-09T01:00:49.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.961+0000 7f50a4ff9700 1 -- 172.21.15.37:0/396884022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f509c00f890 con 0x7f50a8107df0 2024-05-09T01:00:49.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.962+0000 7f50a4ff9700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50900b2880 0x7f50900b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:49.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.962+0000 7f50a77fe700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50900b2880 0x7f50900b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:49.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.962+0000 7f50a4ff9700 1 -- 172.21.15.37:0/396884022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f509c0e1fa0 con 0x7f50a8107df0 2024-05-09T01:00:49.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.963+0000 7f50a77fe700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50900b2880 0x7f50900b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5098005950 tx=0x7f50980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:49.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:49.967+0000 7f50a4ff9700 1 -- 172.21.15.37:0/396884022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f509c014030 con 0x7f50a8107df0 2024-05-09T01:00:50.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:50 smithi037 ceph-mon[30122]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.231+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50a819c0f0 con 0x7f50a8107df0 2024-05-09T01:00:50.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.232+0000 7f50a4ff9700 1 -- 172.21.15.37:0/396884022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f509c0a9d60 con 0x7f50a8107df0 2024-05-09T01:00:50.233 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:00:50.233 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T00:58:58.933698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50900b2880 msgr2=0x7f50900b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50900b2880 0x7f50900b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5098005950 tx=0x7f50980058e0 comp rx=0 tx=0).stop 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8107df0 msgr2=0x7f50a819b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8107df0 0x7f50a819b330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f509c00c8f0 tx=0x7f509c00cc00 comp rx=0 tx=0).stop 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 shutdown_connections 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50900b2880 0x7f50900b4d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50a8108740 0x7f50a819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81034c0 0x7f50a819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 --2- 172.21.15.37:0/396884022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a8107df0 0x7f50a819b330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 >> 172.21.15.37:0/396884022 conn(0x7f50a80fedf0 msgr2=0x7f50a81096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 shutdown_connections 2024-05-09T01:00:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:50.235+0000 7f50add52700 1 -- 172.21.15.37:0/396884022 wait complete. 2024-05-09T01:00:50.237 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-09T01:00:50.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:50 smithi136 ceph-mon[34110]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:50.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:50 smithi151 ceph-mon[34780]: pgmap v356: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:00:50.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-09T00:58:39.582936+0000', 'modified': '2024-05-09T00:58:58.933698+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24491, 'mds_1': 24467, 'mds_2': 24454, 'mds_3': 24446, 'mds_4': 24445}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14547': {'gid': 14547, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/752211904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 752211904}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 752211904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14559': {'gid': 14559, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/828379246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 828379246}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 828379246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6833/1277029223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1277029223}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 1277029223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24425': {'gid': 24425, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6833/3863179212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 3863179212}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 3863179212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6835/1211505643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 1211505643}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 1211505643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.151:6837/980204664', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 980204664}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 980204664}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.136:6835/3966539810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 3966539810}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 3966539810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.151:6839/1727507509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 1727507509}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 1727507509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.136:6837/2054090484', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2054090484}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2054090484}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.136:6839/336490852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 336490852}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 336490852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24491, 'qdb_cluster': [24467, 24446, 24445, 24454, 24491]} 2024-05-09T01:00:50.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-09T01:00:50.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.c status 2024-05-09T01:00:51.138 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:51.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:51 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/396884022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:51.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:51 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/396884022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:51.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:51 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/396884022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:00:52.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:52 smithi037 ceph-mon[30122]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:52.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:52 smithi136 ceph-mon[34110]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:52.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:52 smithi151 ceph-mon[34780]: pgmap v357: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:00:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.837+0000 7f2ca0069700 1 -- 172.21.15.37:0/2309388118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 msgr2=0x7f2c981111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.837+0000 7f2ca0069700 1 --2- 172.21.15.37:0/2309388118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c981111d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2c900099c0 tx=0x7f2c90009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.837+0000 7f2ca0069700 1 -- 172.21.15.37:0/2309388118 shutdown_connections 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.837+0000 7f2ca0069700 1 --2- 172.21.15.37:0/2309388118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c981111d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.837+0000 7f2ca0069700 1 --2- 172.21.15.37:0/2309388118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c981045f0 0x7f2c98104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.837+0000 7f2ca0069700 1 --2- 172.21.15.37:0/2309388118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c98108f20 0x7f2c98109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.837+0000 7f2ca0069700 1 -- 172.21.15.37:0/2309388118 >> 172.21.15.37:0/2309388118 conn(0x7f2c98100040 msgr2=0x7f2c98102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.838+0000 7f2ca0069700 1 -- 172.21.15.37:0/2309388118 shutdown_connections 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.838+0000 7f2ca0069700 1 -- 172.21.15.37:0/2309388118 wait complete. 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 Processor -- start 2024-05-09T01:00:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 -- start start 2024-05-09T01:00:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c981045f0 0x7f2c9819adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c98108f20 0x7f2c9819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c9819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c981144a0 con 0x7f2c98109870 2024-05-09T01:00:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c98114320 con 0x7f2c98108f20 2024-05-09T01:00:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2ca0069700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c98114620 con 0x7f2c981045f0 2024-05-09T01:00:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9e606700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c9819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9de05700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c981045f0 0x7f2c9819adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9e606700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c9819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55312/0 (socket says 172.21.15.37:55312) 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9de05700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c981045f0 0x7f2c9819adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46956/0 (socket says 172.21.15.37:46956) 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9e606700 1 -- 172.21.15.37:0/3142972832 learned_addr learned my addr 172.21.15.37:0/3142972832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9d604700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c98108f20 0x7f2c9819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9e606700 1 -- 172.21.15.37:0/3142972832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c981045f0 msgr2=0x7f2c9819adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9e606700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c981045f0 0x7f2c9819adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9e606700 1 -- 172.21.15.37:0/3142972832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c98108f20 msgr2=0x7f2c9819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.839+0000 7f2c9e606700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c98108f20 0x7f2c9819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.840+0000 7f2c9e606700 1 -- 172.21.15.37:0/3142972832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9819fcc0 con 0x7f2c98109870 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.840+0000 7f2c9e606700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c9819f620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c900059d0 tx=0x7f2c900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.840+0000 7f2c96ffd700 1 -- 172.21.15.37:0/3142972832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90026070 con 0x7f2c98109870 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.840+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9819ff50 con 0x7f2c98109870 2024-05-09T01:00:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.840+0000 7f2c96ffd700 1 -- 172.21.15.37:0/3142972832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c9000f460 con 0x7f2c98109870 2024-05-09T01:00:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.840+0000 7f2c96ffd700 1 -- 172.21.15.37:0/3142972832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c90009e60 con 0x7f2c98109870 2024-05-09T01:00:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.840+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c981a78d0 con 0x7f2c98109870 2024-05-09T01:00:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.843+0000 7f2c96ffd700 1 -- 172.21.15.37:0/3142972832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2c90029070 con 0x7f2c98109870 2024-05-09T01:00:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.844+0000 7f2c96ffd700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c800b2900 0x7f2c800b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.844+0000 7f2c9de05700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c800b2900 0x7f2c800b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.844+0000 7f2c96ffd700 1 -- 172.21.15.37:0/3142972832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2c900e2a40 con 0x7f2c98109870 2024-05-09T01:00:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.844+0000 7f2caea7fb80 1 Processor -- start 2024-05-09T01:00:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.844+0000 7f2caea7fb80 1 -- start start 2024-05-09T01:00:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.844+0000 7f2c9de05700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c800b2900 0x7f2c800b4e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800f540 tx=0x7f2c8800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa324a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5625aa246fa0 con 0x5625aa291110 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5625aa1e57a0 con 0x5625aa1a7450 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5625aa242f60 con 0x5625aa324650 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55316/0 (socket says 172.21.15.37:55316) 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 -- 172.21.15.37:0/103052585 learned_addr learned my addr 172.21.15.37:0/103052585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9d604700 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9e606700 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa324a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 -- 172.21.15.37:0/103052585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 msgr2=0x5625aa324a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa324a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 -- 172.21.15.37:0/103052585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 msgr2=0x5625aa32a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 -- 172.21.15.37:0/103052585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625aa1dd320 con 0x5625aa291110 2024-05-09T01:00:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.845+0000 7f2c9de05700 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32a4a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c88003d20 tx=0x7f2c88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e13150f554c5baa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.846+0000 7f2c7ffff700 1 -- 172.21.15.37:0/103052585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88027070 con 0x5625aa291110 2024-05-09T01:00:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.846+0000 7f2c7ffff700 1 -- 172.21.15.37:0/103052585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c8801e040 con 0x5625aa291110 2024-05-09T01:00:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.846+0000 7f2c7ffff700 1 -- 172.21.15.37:0/103052585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8801d050 con 0x5625aa291110 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.846+0000 7f2caea7fb80 1 -- 172.21.15.37:0/103052585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 msgr2=0x5625aa32a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.846+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32a4a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c88003d20 tx=0x7f2c88014000 comp rx=0 tx=0).stop 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 -- 172.21.15.37:0/103052585 shutdown_connections 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa324a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32a4a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/103052585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 -- 172.21.15.37:0/103052585 >> 172.21.15.37:0/103052585 conn(0x5625aa207650 msgr2=0x5625aa31f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 -- 172.21.15.37:0/103052585 shutdown_connections 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 -- 172.21.15.37:0/103052585 wait complete. 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 -- start start 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.847+0000 7f2caea7fb80 1 Processor -- start 2024-05-09T01:00:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa1a7450 0x5625aa32e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa32e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa324650 0x5625aa32ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5625aa0c2b50 con 0x5625aa1a7450 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5625aa201100 con 0x5625aa324650 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5625aa331180 con 0x5625aa291110 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2caea7fb80 10 client.0 _ll_register_callbacks cb 0x5625aa0b8670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa1a7450 0x5625aa32e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa1a7450 0x5625aa32e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55330/0 (socket says 172.21.15.37:55330) 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 -- 172.21.15.37:0/4110132172 learned_addr learned my addr 172.21.15.37:0/4110132172 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9e606700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa324650 0x5625aa32ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9d604700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa32e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 -- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 msgr2=0x5625aa32e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa32e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 -- 172.21.15.37:0/4110132172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa324650 msgr2=0x5625aa32ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa324650 0x5625aa32ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 -- 172.21.15.37:0/4110132172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625aa0c2440 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9e606700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa324650 0x5625aa32ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c9de05700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa1a7450 0x5625aa32e230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2c88003f80 tx=0x7f2c88005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85ab799b62faacf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.848+0000 7f2c7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/4110132172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88031020 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/4110132172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2c880090f0 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c8801e040 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/4110132172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c8801d020 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 10 client.14913 fetch_fsmap learned FSMap version 28 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625aa33bc10 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/4110132172 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c8801e040 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/4110132172 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f2c88022440 con 0x5625aa1a7450 2024-05-09T01:00:52.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 10 client.14913 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 10 client.14913 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 20 client.14913 populate_metadata read hostname 'smithi037' 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa33f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 4 client.14913 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.849+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625aa254980 con 0x5625aa33de60 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.850+0000 7f2c9d604700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa33f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.850+0000 7f2c7d7fa700 10 client.14913 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.850+0000 7f2c9d604700 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa33f2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e61c2a5d6dd5d5b3 server_cookie=ac7eed7850380c76 in_seq=0 out_seq=0 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/4110132172 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5625aa254980 con 0x5625aa33de60 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2c7d7fa700 10 client.14913 handle_command_reply: tid=0 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 client.14913 shutdown 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa1a7450 msgr2=0x5625aa32e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa1a7450 0x5625aa32e230 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2c88003f80 tx=0x7f2c88005aa0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 shutdown_connections 2024-05-09T01:00:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa33f2d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa324650 0x5625aa32ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa1a7450 0x5625aa32e230 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2c7d7fa700 0 client.14913 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/4110132172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa32e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 >> 172.21.15.37:0/4110132172 conn(0x5625aa207650 msgr2=0x5625aa31f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.851+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 shutdown_connections 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.852+0000 7f2caea7fb80 1 -- 172.21.15.37:0/4110132172 wait complete. 2024-05-09T01:00:52.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.852+0000 7f2caea7fb80 20 client.14913 trim_cache size 0 max 16384 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 Processor -- start 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 -- start start 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa328990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa348b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa324650 0x5625aa32e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5625aa33d610 con 0x5625aa324650 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5625aa33dce0 con 0x5625aa1a7450 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5625aa33e3b0 con 0x5625aa291110 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa324650 0x5625aa32e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa324650 0x5625aa32e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55338/0 (socket says 172.21.15.37:55338) 2024-05-09T01:00:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 -- 172.21.15.37:0/2288810499 learned_addr learned my addr 172.21.15.37:0/2288810499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9de05700 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa328990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9d604700 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa348b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 -- 172.21.15.37:0/2288810499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 msgr2=0x5625aa348b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa348b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 -- 172.21.15.37:0/2288810499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 msgr2=0x5625aa328990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa328990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9e606700 1 -- 172.21.15.37:0/2288810499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625aa320cb0 con 0x5625aa324650 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.873+0000 7f2c9de05700 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa328990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.874+0000 7f2c9e606700 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa324650 0x5625aa32e900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009d70 tx=0x7f2c900a98e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bea1d3a1ed5ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.874+0000 7f2c7f7fe700 1 -- 172.21.15.37:0/2288810499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900aa7f0 con 0x5625aa324650 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.874+0000 7f2c7f7fe700 1 -- 172.21.15.37:0/2288810499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c900aa0f0 con 0x5625aa324650 2024-05-09T01:00:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.874+0000 7f2c7f7fe700 1 -- 172.21.15.37:0/2288810499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900aa350 con 0x5625aa324650 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.874+0000 7f2caea7fb80 1 -- 172.21.15.37:0/2288810499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa324650 msgr2=0x5625aa32e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa324650 0x5625aa32e900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009d70 tx=0x7f2c900a98e0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 -- 172.21.15.37:0/2288810499 shutdown_connections 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa324650 0x5625aa32e900 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa328990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/2288810499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa291110 0x5625aa348b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 -- 172.21.15.37:0/2288810499 >> 172.21.15.37:0/2288810499 conn(0x5625aa207650 msgr2=0x5625aa32e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 -- 172.21.15.37:0/2288810499 shutdown_connections 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 -- 172.21.15.37:0/2288810499 wait complete. 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 -- start start 2024-05-09T01:00:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.875+0000 7f2caea7fb80 1 Processor -- start 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa3a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5625aa33f150 con 0x5625aa291110 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5625aa33ea80 con 0x5625aa1a7450 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5625aa33f820 con 0x5625aa324650 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 10 client.0 _ll_register_callbacks cb 0x5625aa0b8670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55354/0 (socket says 172.21.15.37:55354) 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 -- 172.21.15.37:0/442789546 learned_addr learned my addr 172.21.15.37:0/442789546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:52.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9e606700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa3a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9de05700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 -- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 msgr2=0x5625aa3a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa3a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 -- 172.21.15.37:0/442789546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 msgr2=0x5625aa32ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 -- 172.21.15.37:0/442789546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625aa3a6800 con 0x5625aa291110 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9e606700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa3a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9de05700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c9d604700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32b2c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2c98103a70 tx=0x7f2c8c012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c32479d0130035 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c7d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/442789546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c01b6d0 con 0x5625aa291110 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/442789546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2c8c01b870 con 0x5625aa291110 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.876+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c900aa0f0 con 0x5625aa291110 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/442789546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c8c02a050 con 0x5625aa291110 2024-05-09T01:00:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 10 client.14919 fetch_fsmap learned FSMap version 28 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5625aa3adb90 con 0x5625aa291110 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/442789546 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c900aa0f0 con 0x5625aa291110 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/442789546 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f2c8c00f450 con 0x5625aa291110 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 10 client.14919 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 10 client.14919 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 20 client.14919 populate_metadata read hostname 'smithi037' 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa3b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 4 client.14919 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "status"}) -- 0x5625aa24ea20 con 0x5625aa33de60 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.877+0000 7f2c9de05700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa3b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2c7d7fa700 10 client.14919 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2c9de05700 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa3b14b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=458261484f7944b5 server_cookie=357d2d0c043ce3a2 in_seq=0 out_seq=0 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2c7d7fa700 1 -- 172.21.15.37:0/442789546 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5625aa24ea20 con 0x5625aa33de60 2024-05-09T01:00:52.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2c7d7fa700 10 client.14919 handle_command_reply: tid=0 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 client.14919 shutdown 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 msgr2=0x5625aa32b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32b2c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2c98103a70 tx=0x7f2c8c012730 comp rx=0 tx=0).stop 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 shutdown_connections 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625aa33de60 0x5625aa3b14b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625aa324650 0x5625aa3a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625aa1a7450 0x5625aa32ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 --2- 172.21.15.37:0/442789546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625aa291110 0x5625aa32b2c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2c7d7fa700 0 client.14919 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.878+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 >> 172.21.15.37:0/442789546 conn(0x5625aa207650 msgr2=0x5625aa32e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 shutdown_connections 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2caea7fb80 1 -- 172.21.15.37:0/442789546 wait complete. 2024-05-09T01:00:52.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2caea7fb80 20 client.14919 trim_cache size 0 max 16384 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24445, 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 116.885669049, 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:00:52.886 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:00:52.887 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 166.66448591100001 2024-05-09T01:00:52.887 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:00:52.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c800b2900 msgr2=0x7f2c800b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c800b2900 0x7f2c800b4e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800f540 tx=0x7f2c8800b040 comp rx=0 tx=0).stop 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 msgr2=0x7f2c9819f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c9819f620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c900059d0 tx=0x7f2c900045e0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 shutdown_connections 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c800b2900 0x7f2c800b4e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c98109870 0x7f2c9819f620 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c981045f0 0x7f2c9819adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 --2- 172.21.15.37:0/3142972832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c98108f20 0x7f2c9819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.879+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 >> 172.21.15.37:0/3142972832 conn(0x7f2c98100040 msgr2=0x7f2c98108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.880+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 shutdown_connections 2024-05-09T01:00:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:52.880+0000 7f2ca0069700 1 -- 172.21.15.37:0/3142972832 wait complete. 2024-05-09T01:00:53.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-09T01:00:53.858 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:54.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:54 smithi037 ceph-mon[30122]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:54 smithi136 ceph-mon[34110]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:54.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:54 smithi151 ceph-mon[34780]: pgmap v358: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:00:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 -- 172.21.15.37:0/1451465823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 msgr2=0x7f87441038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 --2- 172.21.15.37:0/1451465823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f87441038d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f87340099c0 tx=0x7f8734009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 -- 172.21.15.37:0/1451465823 shutdown_connections 2024-05-09T01:00:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 --2- 172.21.15.37:0/1451465823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8744108740 0x7f87441100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 --2- 172.21.15.37:0/1451465823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f87441038d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 --2- 172.21.15.37:0/1451465823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8744107df0 0x7f8744108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 -- 172.21.15.37:0/1451465823 >> 172.21.15.37:0/1451465823 conn(0x7f87440fedc0 msgr2=0x7f87441011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 -- 172.21.15.37:0/1451465823 shutdown_connections 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.466+0000 7f874ab43700 1 -- 172.21.15.37:0/1451465823 wait complete. 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 Processor -- start 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 -- start start 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f874419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8744107df0 0x7f874419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8744108740 0x7f874419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87441144c0 con 0x7f87441034c0 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8744114340 con 0x7f8744107df0 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f874ab43700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8744114640 con 0x7f8744108740 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f87488df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f874419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f87488df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f874419add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55376/0 (socket says 172.21.15.37:55376) 2024-05-09T01:00:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f87488df700 1 -- 172.21.15.37:0/2715535084 learned_addr learned my addr 172.21.15.37:0/2715535084 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f8743fff700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8744107df0 0x7f874419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.467+0000 7f87490e0700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8744108740 0x7f874419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f87488df700 1 -- 172.21.15.37:0/2715535084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8744108740 msgr2=0x7f874419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f87488df700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8744108740 0x7f874419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f87488df700 1 -- 172.21.15.37:0/2715535084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8744107df0 msgr2=0x7f874419b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f87488df700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8744107df0 0x7f874419b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f87488df700 1 -- 172.21.15.37:0/2715535084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874419fca0 con 0x7f87441034c0 2024-05-09T01:00:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f87488df700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f874419add0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8734006010 tx=0x7f8734004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f8741ffb700 1 -- 172.21.15.37:0/2715535084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734026070 con 0x7f87441034c0 2024-05-09T01:00:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874419ff30 con 0x7f87441034c0 2024-05-09T01:00:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f8741ffb700 1 -- 172.21.15.37:0/2715535084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8734004630 con 0x7f87441034c0 2024-05-09T01:00:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f8741ffb700 1 -- 172.21.15.37:0/2715535084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873400fb20 con 0x7f87441034c0 2024-05-09T01:00:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.468+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441a0410 con 0x7f87441034c0 2024-05-09T01:00:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.472+0000 7f8741ffb700 1 -- 172.21.15.37:0/2715535084 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8734029070 con 0x7f87441034c0 2024-05-09T01:00:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8741ffb700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87300b2880 0x7f87300b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8743fff700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87300b2880 0x7f87300b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8741ffb700 1 -- 172.21.15.37:0/2715535084 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f87340e2860 con 0x7f87441034c0 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8759559b80 1 Processor -- start 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8759559b80 1 -- start start 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8759559b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adbbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8743fff700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87300b2880 0x7f87300b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8744102360 tx=0x7f872c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.473+0000 7f8759559b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adbc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f8759559b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f8759559b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56097acd9fa0 con 0x56097ad24110 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f8759559b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56097ac787a0 con 0x56097adc03b0 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f8759559b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56097acd5f60 con 0x56097ac3a450 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adbbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adbbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55384/0 (socket says 172.21.15.37:55384) 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 -- 172.21.15.37:0/2552715160 learned_addr learned my addr 172.21.15.37:0/2552715160 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f8743fff700 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adbc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 -- 172.21.15.37:0/2552715160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 msgr2=0x56097adbc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adbc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87490e0700 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 -- 172.21.15.37:0/2552715160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 msgr2=0x56097adc07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 -- 172.21.15.37:0/2552715160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56097ac70320 con 0x56097ad24110 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f87488df700 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adbbd00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f87340a9f40 tx=0x7f87340a9850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1a44261079d24c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f873affd700 1 -- 172.21.15.37:0/2552715160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340aa6b0 con 0x56097ad24110 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f873affd700 1 -- 172.21.15.37:0/2552715160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87340a9fb0 con 0x56097ad24110 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.474+0000 7f873affd700 1 -- 172.21.15.37:0/2552715160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340a5920 con 0x56097ad24110 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 -- 172.21.15.37:0/2552715160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 msgr2=0x56097adbbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adbbd00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f87340a9f40 tx=0x7f87340a9850 comp rx=0 tx=0).stop 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 -- 172.21.15.37:0/2552715160 shutdown_connections 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adbbd00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 --2- 172.21.15.37:0/2552715160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adbc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 -- 172.21.15.37:0/2552715160 >> 172.21.15.37:0/2552715160 conn(0x56097ac9a650 msgr2=0x56097adb23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 -- 172.21.15.37:0/2552715160 shutdown_connections 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.475+0000 7f8759559b80 1 -- 172.21.15.37:0/2552715160 wait complete. 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 -- start start 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 Processor -- start 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ac3a450 0x56097adcafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ad24110 0x56097adcb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56097ab55b50 con 0x56097ac3a450 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56097ac94100 con 0x56097adc03b0 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.476+0000 7f8759559b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56097adc0f20 con 0x56097ad24110 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f8759559b80 10 client.0 _ll_register_callbacks cb 0x56097ab4b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:00:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ac3a450 0x56097adcafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ac3a450 0x56097adcafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55388/0 (socket says 172.21.15.37:55388) 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 -- 172.21.15.37:0/1309677183 learned_addr learned my addr 172.21.15.37:0/1309677183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f8743fff700 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ad24110 0x56097adcb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87490e0700 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 -- 172.21.15.37:0/1309677183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ad24110 msgr2=0x56097adcb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ad24110 0x56097adcb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 -- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 msgr2=0x56097adc53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 -- 172.21.15.37:0/1309677183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56097ab55440 con 0x56097ac3a450 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f87488df700 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ac3a450 0x56097adcafe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f87340a5fe0 tx=0x7f8734009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bb1fc2295924ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f8723fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f8723fff700 1 -- 172.21.15.37:0/1309677183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340b2d80 con 0x56097ac3a450 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f8723fff700 1 -- 172.21.15.37:0/1309677183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f87340a65a0 con 0x56097ac3a450 2024-05-09T01:00:55.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.477+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87340a9fb0 con 0x56097ac3a450 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8723fff700 1 -- 172.21.15.37:0/1309677183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f87340b2b00 con 0x56097ac3a450 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 10 client.14931 fetch_fsmap learned FSMap version 28 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56097add2c00 con 0x56097ac3a450 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8723fff700 1 -- 172.21.15.37:0/1309677183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87340a9fb0 con 0x56097ac3a450 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8723fff700 1 -- 172.21.15.37:0/1309677183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f87340a8e20 con 0x56097ac3a450 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 10 client.14931 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 10 client.14931 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 20 client.14931 populate_metadata read hostname 'smithi037' 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097add4f80 0x56097add63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 4 client.14931 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56097ace7980 con 0x56097add4f80 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.478+0000 7f8743fff700 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097add4f80 0x56097add63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.479+0000 7f8723fff700 10 client.14931 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:00:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.479+0000 7f8743fff700 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097add4f80 0x56097add63f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5f1974be041aa2b7 server_cookie=9e052481cf2d8136 in_seq=0 out_seq=0 2024-05-09T01:00:55.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8723fff700 1 -- 172.21.15.37:0/1309677183 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56097ace7980 con 0x56097add4f80 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8723fff700 10 client.14931 handle_command_reply: tid=0 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 client.14931 shutdown 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ac3a450 msgr2=0x56097adcafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ac3a450 0x56097adcafe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f87340a5fe0 tx=0x7f8734009ef0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 shutdown_connections 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097add4f80 0x56097add63f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097adc53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ac3a450 0x56097adcafe0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 --2- 172.21.15.37:0/1309677183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ad24110 0x56097adcb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 >> 172.21.15.37:0/1309677183 conn(0x56097ac9a650 msgr2=0x56097adb2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8723fff700 0 client.14931 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 shutdown_connections 2024-05-09T01:00:55.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.480+0000 7f8759559b80 1 -- 172.21.15.37:0/1309677183 wait complete. 2024-05-09T01:00:55.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.481+0000 7f8759559b80 20 client.14931 trim_cache size 0 max 16384 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 Processor -- start 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 -- start start 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097addf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097ad24110 0x56097addfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097adc03b0 0x56097adbf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56097add4730 con 0x56097adc03b0 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56097add4e00 con 0x56097ad24110 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8759559b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56097add54d0 con 0x56097ac3a450 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f87490e0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097adc03b0 0x56097adbf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f87490e0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097adc03b0 0x56097adbf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55400/0 (socket says 172.21.15.37:55400) 2024-05-09T01:00:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f87490e0700 1 -- 172.21.15.37:0/334781444 learned_addr learned my addr 172.21.15.37:0/334781444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f87488df700 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097addf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.502+0000 7f8743fff700 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097ad24110 0x56097addfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f87490e0700 1 -- 172.21.15.37:0/334781444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 msgr2=0x56097addf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f87490e0700 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097addf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f87490e0700 1 -- 172.21.15.37:0/334781444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097ad24110 msgr2=0x56097addfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f87490e0700 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097ad24110 0x56097addfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f87490e0700 1 -- 172.21.15.37:0/334781444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56097adb3120 con 0x56097adc03b0 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f8743fff700 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097ad24110 0x56097addfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f87490e0700 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097adc03b0 0x56097adbf430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f873c0076c0 tx=0x7f873c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546283774dc18433 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f873a7fc700 1 -- 172.21.15.37:0/334781444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c017610 con 0x56097adc03b0 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f873a7fc700 1 -- 172.21.15.37:0/334781444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c017c60 con 0x56097adc03b0 2024-05-09T01:00:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.503+0000 7f873a7fc700 1 -- 172.21.15.37:0/334781444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c016d60 con 0x56097adc03b0 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 -- 172.21.15.37:0/334781444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097adc03b0 msgr2=0x56097adbf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097adc03b0 0x56097adbf430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f873c0076c0 tx=0x7f873c00b040 comp rx=0 tx=0).stop 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 -- 172.21.15.37:0/334781444 shutdown_connections 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097adc03b0 0x56097adbf430 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097addf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 --2- 172.21.15.37:0/334781444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097ad24110 0x56097addfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 -- 172.21.15.37:0/334781444 >> 172.21.15.37:0/334781444 conn(0x56097ac9a650 msgr2=0x56097adcafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 -- 172.21.15.37:0/334781444 shutdown_connections 2024-05-09T01:00:55.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 -- 172.21.15.37:0/334781444 wait complete. 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 -- start start 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.504+0000 7f8759559b80 1 Processor -- start 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8759559b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adcbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8759559b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adcc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8759559b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097add0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8759559b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56097add6270 con 0x56097ad24110 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8759559b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56097add5ba0 con 0x56097adc03b0 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8759559b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56097add6940 con 0x56097ac3a450 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8759559b80 10 client.0 _ll_register_callbacks cb 0x56097ab4b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adcc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adcc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55416/0 (socket says 172.21.15.37:55416) 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 -- 172.21.15.37:0/745880835 learned_addr learned my addr 172.21.15.37:0/745880835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f87488df700 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adcbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f87490e0700 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097add0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 -- 172.21.15.37:0/745880835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 msgr2=0x56097adcbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adcbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 -- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 msgr2=0x56097add0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097add0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.505+0000 7f8743fff700 1 -- 172.21.15.37:0/745880835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56097add11b0 con 0x56097ad24110 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8743fff700 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adcc300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f872c004180 tx=0x7f872c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1e60e12c5ed7f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8723fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8723fff700 1 -- 172.21.15.37:0/745880835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872c028400 con 0x56097ad24110 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8723fff700 1 -- 172.21.15.37:0/745880835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f872c0285a0 con 0x56097ad24110 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f873c017c60 con 0x56097ad24110 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8723fff700 1 -- 172.21.15.37:0/745880835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f872c0287a0 con 0x56097ad24110 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 10 client.14937 fetch_fsmap learned FSMap version 28 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56097ae407d0 con 0x56097ad24110 2024-05-09T01:00:55.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8723fff700 1 -- 172.21.15.37:0/745880835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c017c60 con 0x56097ad24110 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8723fff700 1 -- 172.21.15.37:0/745880835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f872c01db80 con 0x56097ad24110 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 10 client.14937 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 10 client.14937 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 20 client.14937 populate_metadata read hostname 'smithi037' 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097ae42d10 0x56097ae44180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 4 client.14937 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.506+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "status"}) -- 0x56097ace1a20 con 0x56097ae42d10 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f87488df700 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097ae42d10 0x56097ae44180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f87488df700 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097ae42d10 0x56097ae44180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=405e2043c5b926a2 server_cookie=89bac346e1ec2058 in_seq=0 out_seq=0 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8723fff700 10 client.14937 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8723fff700 1 -- 172.21.15.37:0/745880835 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56097ace1a20 con 0x56097ae42d10 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8723fff700 10 client.14937 handle_command_reply: tid=0 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 client.14937 shutdown 2024-05-09T01:00:55.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 msgr2=0x56097adcc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adcc300 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f872c004180 tx=0x7f872c0047c0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 shutdown_connections 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56097ae42d10 0x56097ae44180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56097adc03b0 0x56097add0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56097ac3a450 0x56097adcbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f8723fff700 0 client.14937 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.507+0000 7f8759559b80 1 --2- 172.21.15.37:0/745880835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56097ad24110 0x56097adcc300 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 >> 172.21.15.37:0/745880835 conn(0x56097ac9a650 msgr2=0x56097adbf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 shutdown_connections 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f8759559b80 1 -- 172.21.15.37:0/745880835 wait complete. 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f8759559b80 20 client.14937 trim_cache size 0 max 16384 2024-05-09T01:00:55.513 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24446, 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 120.52199909399999, 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 174.74778314100001 2024-05-09T01:00:55.514 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:00:55.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87300b2880 msgr2=0x7f87300b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87300b2880 0x7f87300b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8744102360 tx=0x7f872c009260 comp rx=0 tx=0).stop 2024-05-09T01:00:55.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 msgr2=0x7f874419add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:55.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f874419add0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8734006010 tx=0x7f8734004270 comp rx=0 tx=0).stop 2024-05-09T01:00:55.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 shutdown_connections 2024-05-09T01:00:55.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87300b2880 0x7f87300b4d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8744108740 0x7f874419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87441034c0 0x7f874419add0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 --2- 172.21.15.37:0/2715535084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8744107df0 0x7f874419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:55.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.508+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 >> 172.21.15.37:0/2715535084 conn(0x7f87440fedc0 msgr2=0x7f87441075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:55.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.509+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 shutdown_connections 2024-05-09T01:00:55.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:55.509+0000 7f874ab43700 1 -- 172.21.15.37:0/2715535084 wait complete. 2024-05-09T01:00:56.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:56 smithi037 ceph-mon[30122]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:56.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-09T01:00:56.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:56 smithi136 ceph-mon[34110]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:00:56.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:56 smithi151 ceph-mon[34780]: pgmap v359: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:00:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.047+0000 7f40b1795700 1 -- 172.21.15.37:0/803328123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac109850 msgr2=0x7f40ac1111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.047+0000 7f40b1795700 1 --2- 172.21.15.37:0/803328123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac109850 0x7f40ac1111b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f40a40099c0 tx=0x7f40a4009cd0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 -- 172.21.15.37:0/803328123 shutdown_connections 2024-05-09T01:00:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 --2- 172.21.15.37:0/803328123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac109850 0x7f40ac1111b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 --2- 172.21.15.37:0/803328123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40ac1045d0 0x7f40ac1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 --2- 172.21.15.37:0/803328123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ac108f00 0x7f40ac109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 -- 172.21.15.37:0/803328123 >> 172.21.15.37:0/803328123 conn(0x7f40ac0ffea0 msgr2=0x7f40ac1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 -- 172.21.15.37:0/803328123 shutdown_connections 2024-05-09T01:00:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 -- 172.21.15.37:0/803328123 wait complete. 2024-05-09T01:00:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 Processor -- start 2024-05-09T01:00:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.048+0000 7f40b1795700 1 -- start start 2024-05-09T01:00:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40b1795700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ac1045d0 0x7f40ac19ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40b1795700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac108f00 0x7f40ac19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40b1795700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40ac109850 0x7f40ac19f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40b1795700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac1144d0 con 0x7f40ac108f00 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40b1795700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac114350 con 0x7f40ac109850 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40b1795700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f40ac114650 con 0x7f40ac1045d0 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac108f00 0x7f40ac19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac108f00 0x7f40ac19b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55430/0 (socket says 172.21.15.37:55430) 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 -- 172.21.15.37:0/3546983845 learned_addr learned my addr 172.21.15.37:0/3546983845 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aaffd700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ac1045d0 0x7f40ac19ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40ac109850 0x7f40ac19f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 -- 172.21.15.37:0/3546983845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ac1045d0 msgr2=0x7f40ac19ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ac1045d0 0x7f40ac19ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 -- 172.21.15.37:0/3546983845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40ac109850 msgr2=0x7f40ac19f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40ac109850 0x7f40ac19f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.049+0000 7f40aa7fc700 1 -- 172.21.15.37:0/3546983845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ac19fd10 con 0x7f40ac108f00 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.050+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac108f00 0x7f40ac19b3e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f40a000d950 tx=0x7f40a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.050+0000 7f4093fff700 1 -- 172.21.15.37:0/3546983845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0016070 con 0x7f40ac108f00 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.050+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ac1a0000 con 0x7f40ac108f00 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.050+0000 7f4093fff700 1 -- 172.21.15.37:0/3546983845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a0004830 con 0x7f40ac108f00 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.050+0000 7f4093fff700 1 -- 172.21.15.37:0/3546983845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0005420 con 0x7f40ac108f00 2024-05-09T01:00:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.050+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ac1a7920 con 0x7f40ac108f00 2024-05-09T01:00:58.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.053+0000 7f4093fff700 1 -- 172.21.15.37:0/3546983845 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f40a0005600 con 0x7f40ac108f00 2024-05-09T01:00:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.054+0000 7f4093fff700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40940b2880 0x7f40940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.054+0000 7f40c01abb80 1 Processor -- start 2024-05-09T01:00:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.054+0000 7f40aaffd700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40940b2880 0x7f40940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.054+0000 7f4093fff700 1 -- 172.21.15.37:0/3546983845 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f40a00e1f40 con 0x7f40ac108f00 2024-05-09T01:00:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.054+0000 7f40c01abb80 1 -- start start 2024-05-09T01:00:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c57b8110 0x5653c58558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c56ce450 0x5653c5855df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c584fa60 0x5653c584fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40c01abb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5653c576dfa0 con 0x5653c584fa60 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40c01abb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5653c570c7a0 con 0x5653c56ce450 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40c01abb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5653c5769f60 con 0x5653c57b8110 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40aaffd700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40940b2880 0x7f40940b4d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f409c0060b0 tx=0x7f409c00c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c584fa60 0x5653c584fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c584fa60 0x5653c584fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55446/0 (socket says 172.21.15.37:55446) 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 -- 172.21.15.37:0/3178543004 learned_addr learned my addr 172.21.15.37:0/3178543004 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40aaffd700 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c57b8110 0x5653c58558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c56ce450 0x5653c5855df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 -- 172.21.15.37:0/3178543004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c57b8110 msgr2=0x5653c58558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c57b8110 0x5653c58558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 -- 172.21.15.37:0/3178543004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c56ce450 msgr2=0x5653c5855df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c56ce450 0x5653c5855df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 -- 172.21.15.37:0/3178543004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c5704320 con 0x5653c584fa60 2024-05-09T01:00:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c584fa60 0x5653c584fe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f40a40099c0 tx=0x7f40a4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b204ebfdfa56e2a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.055+0000 7f40917fa700 1 -- 172.21.15.37:0/3178543004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4026070 con 0x5653c584fa60 2024-05-09T01:00:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40917fa700 1 -- 172.21.15.37:0/3178543004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a4005070 con 0x5653c584fa60 2024-05-09T01:00:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40917fa700 1 -- 172.21.15.37:0/3178543004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a400bb00 con 0x5653c584fa60 2024-05-09T01:00:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40c01abb80 1 -- 172.21.15.37:0/3178543004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c584fa60 msgr2=0x5653c584fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c584fa60 0x5653c584fe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f40a40099c0 tx=0x7f40a4009510 comp rx=0 tx=0).stop 2024-05-09T01:00:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40c01abb80 1 -- 172.21.15.37:0/3178543004 shutdown_connections 2024-05-09T01:00:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c584fa60 0x5653c584fe90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c57b8110 0x5653c58558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3178543004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c56ce450 0x5653c5855df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.056+0000 7f40c01abb80 1 -- 172.21.15.37:0/3178543004 >> 172.21.15.37:0/3178543004 conn(0x5653c572e650 msgr2=0x5653c58463b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 -- 172.21.15.37:0/3178543004 shutdown_connections 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 -- 172.21.15.37:0/3178543004 wait complete. 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 -- start start 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 Processor -- start 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c58595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c5859b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c584fa60 0x5653c585a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5653c55e9b50 con 0x5653c57b8110 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5653c5728100 con 0x5653c584fa60 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.057+0000 7f40c01abb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5653c585c590 con 0x5653c56ce450 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40c01abb80 10 client.0 _ll_register_callbacks cb 0x5653c55df670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:00:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c5859b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c5859b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55454/0 (socket says 172.21.15.37:55454) 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 -- 172.21.15.37:0/722693201 learned_addr learned my addr 172.21.15.37:0/722693201 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aaffd700 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c58595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c584fa60 0x5653c585a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 -- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 msgr2=0x5653c58595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c58595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 -- 172.21.15.37:0/722693201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c584fa60 msgr2=0x5653c585a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c584fa60 0x5653c585a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 -- 172.21.15.37:0/722693201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c55e9440 con 0x5653c57b8110 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c5859b30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f40a00a67d0 tx=0x7f40a00a8de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c1d307a1068193 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f408eff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f408eff5700 1 -- 172.21.15.37:0/722693201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a00a9560 con 0x5653c57b8110 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f408eff5700 1 -- 172.21.15.37:0/722693201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f40a00b1f30 con 0x5653c57b8110 2024-05-09T01:00:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a4005070 con 0x5653c57b8110 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f408eff5700 1 -- 172.21.15.37:0/722693201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40a00ad910 con 0x5653c57b8110 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40c01abb80 10 client.14949 fetch_fsmap learned FSMap version 28 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.058+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653c5866fd0 con 0x5653c57b8110 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f408eff5700 1 -- 172.21.15.37:0/722693201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40a00c3e50 con 0x5653c57b8110 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f408eff5700 1 -- 172.21.15.37:0/722693201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f40a00ca290 con 0x5653c57b8110 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f40c01abb80 10 client.14949 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f40c01abb80 10 client.14949 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f40c01abb80 20 client.14949 populate_metadata read hostname 'smithi037' 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f40c01abb80 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c58695f0 0x5653c586aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f40c01abb80 4 client.14949 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653c577b980 con 0x5653c58695f0 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.059+0000 7f40aaffd700 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c58695f0 0x5653c586aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.060+0000 7f40aaffd700 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c58695f0 0x5653c586aa60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f096f9ce4d7caa1d server_cookie=160dd10df1f8f052 in_seq=0 out_seq=0 2024-05-09T01:00:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.060+0000 7f408eff5700 10 client.14949 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f408eff5700 1 -- 172.21.15.37:0/722693201 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5653c577b980 con 0x5653c58695f0 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f408eff5700 10 client.14949 handle_command_reply: tid=0 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 client.14949 shutdown 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 msgr2=0x5653c5859b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c5859b30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f40a00a67d0 tx=0x7f40a00a8de0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 shutdown_connections 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c58695f0 0x5653c586aa60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c584fa60 0x5653c585a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c58595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 --2- 172.21.15.37:0/722693201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c5859b30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 >> 172.21.15.37:0/722693201 conn(0x5653c572e650 msgr2=0x5653c5846170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f408eff5700 0 client.14949 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:00:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 shutdown_connections 2024-05-09T01:00:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 1 -- 172.21.15.37:0/722693201 wait complete. 2024-05-09T01:00:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.061+0000 7f40c01abb80 20 client.14949 trim_cache size 0 max 16384 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 Processor -- start 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 -- start start 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c572e650 0x5653c5853c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5865440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c57b8110 0x5653c58521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5653c5868da0 con 0x5653c572e650 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5653c5869470 con 0x5653c57b8110 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40c01abb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5653c5869b40 con 0x5653c56ce450 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.083+0000 7f40aaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c572e650 0x5653c5853c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c572e650 0x5653c5853c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55458/0 (socket says 172.21.15.37:55458) 2024-05-09T01:00:58.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 -- 172.21.15.37:0/3127021757 learned_addr learned my addr 172.21.15.37:0/3127021757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c57b8110 0x5653c58521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5865440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 -- 172.21.15.37:0/3127021757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 msgr2=0x5653c5865440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5865440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 -- 172.21.15.37:0/3127021757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c57b8110 msgr2=0x5653c58521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c57b8110 0x5653c58521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 -- 172.21.15.37:0/3127021757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c5855410 con 0x5653c572e650 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f40aaffd700 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c572e650 0x5653c5853c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f409c007fd0 tx=0x7f409c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8c4511f3e69746 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f4090ff9700 1 -- 172.21.15.37:0/3127021757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c016d60 con 0x5653c572e650 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f4090ff9700 1 -- 172.21.15.37:0/3127021757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c029680 con 0x5653c572e650 2024-05-09T01:00:58.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.084+0000 7f4090ff9700 1 -- 172.21.15.37:0/3127021757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c024a80 con 0x5653c572e650 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 -- 172.21.15.37:0/3127021757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c572e650 msgr2=0x5653c5853c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c572e650 0x5653c5853c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f409c007fd0 tx=0x7f409c012000 comp rx=0 tx=0).stop 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 -- 172.21.15.37:0/3127021757 shutdown_connections 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c57b8110 0x5653c58521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c572e650 0x5653c5853c80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 --2- 172.21.15.37:0/3127021757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5865440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 -- 172.21.15.37:0/3127021757 >> 172.21.15.37:0/3127021757 conn(0x5653c58501d0 msgr2=0x5653c58558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 -- 172.21.15.37:0/3127021757 shutdown_connections 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 -- 172.21.15.37:0/3127021757 wait complete. 2024-05-09T01:00:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.085+0000 7f40c01abb80 1 -- start start 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 1 Processor -- start 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5873ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c572e650 0x5653c5874410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c586e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5653c586a8e0 con 0x5653c57b8110 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5653c586a210 con 0x5653c572e650 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5653c586afb0 con 0x5653c56ce450 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40c01abb80 10 client.0 _ll_register_callbacks cb 0x5653c55df670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c586e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c586e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55474/0 (socket says 172.21.15.37:55474) 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 -- 172.21.15.37:0/4170516179 learned_addr learned my addr 172.21.15.37:0/4170516179 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40aa7fc700 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c572e650 0x5653c5874410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40aaffd700 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5873ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 -- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 msgr2=0x5653c5873ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5873ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 -- 172.21.15.37:0/4170516179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c572e650 msgr2=0x5653c5874410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c572e650 0x5653c5874410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.086+0000 7f40ab7fe700 1 -- 172.21.15.37:0/4170516179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c586e9c0 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f40ab7fe700 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c586e270 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5653c5856480 tx=0x7f40a4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec21df1116f3f243 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f408eff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f408eff5700 1 -- 172.21.15.37:0/4170516179 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4032070 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f408eff5700 1 -- 172.21.15.37:0/4170516179 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f40a4003c70 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f409c029680 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f408eff5700 1 -- 172.21.15.37:0/4170516179 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40a4026040 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f40c01abb80 10 client.14955 fetch_fsmap learned FSMap version 28 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653c58d5400 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f408eff5700 1 -- 172.21.15.37:0/4170516179 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c029680 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f408eff5700 1 -- 172.21.15.37:0/4170516179 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f40a4021590 con 0x5653c57b8110 2024-05-09T01:00:58.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.087+0000 7f40c01abb80 10 client.14955 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f40c01abb80 10 client.14955 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f40c01abb80 20 client.14955 populate_metadata read hostname 'smithi037' 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f40c01abb80 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c584fa60 0x5653c58d8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f40c01abb80 4 client.14955 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "status"}) -- 0x5653c5775a20 con 0x5653c584fa60 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f40aaffd700 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c584fa60 0x5653c58d8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f40aaffd700 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c584fa60 0x5653c58d8740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ac23da401b10a18 server_cookie=6c33759b1c100709 in_seq=0 out_seq=0 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.088+0000 7f408eff5700 10 client.14955 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f408eff5700 1 -- 172.21.15.37:0/4170516179 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x5653c5775a20 con 0x5653c584fa60 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f408eff5700 10 client.14955 handle_command_reply: tid=0 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 client.14955 shutdown 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 msgr2=0x5653c586e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c586e270 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5653c5856480 tx=0x7f40a4005740 comp rx=0 tx=0).stop 2024-05-09T01:00:58.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 shutdown_connections 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5653c584fa60 0x5653c58d8740 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653c57b8110 0x5653c586e270 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5653c56ce450 0x5653c5873ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 --2- 172.21.15.37:0/4170516179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5653c572e650 0x5653c5874410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 >> 172.21.15.37:0/4170516179 conn(0x5653c58501d0 msgr2=0x5653c58546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f408eff5700 0 client.14955 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 shutdown_connections 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 1 -- 172.21.15.37:0/4170516179 wait complete. 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40c01abb80 20 client.14955 trim_cache size 0 max 16384 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:00:58.094 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24454, 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 124.112326768, 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 166.443268598 2024-05-09T01:00:58.095 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40940b2880 msgr2=0x7f40940b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40b1795700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40940b2880 0x7f40940b4d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f409c0060b0 tx=0x7f409c00c040 comp rx=0 tx=0).stop 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac108f00 msgr2=0x7f40ac19b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40b1795700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac108f00 0x7f40ac19b3e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f40a000d950 tx=0x7f40a000dc60 comp rx=0 tx=0).stop 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 shutdown_connections 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.089+0000 7f40b1795700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40940b2880 0x7f40940b4d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.090+0000 7f40b1795700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40ac109850 0x7f40ac19f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.090+0000 7f40b1795700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40ac1045d0 0x7f40ac19ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.090+0000 7f40b1795700 1 --2- 172.21.15.37:0/3546983845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ac108f00 0x7f40ac19b3e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:00:58.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.090+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 >> 172.21.15.37:0/3546983845 conn(0x7f40ac0ffea0 msgr2=0x7f40ac1086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:00:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.090+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 shutdown_connections 2024-05-09T01:00:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:00:58.090+0000 7f40b1795700 1 -- 172.21.15.37:0/3546983845 wait complete. 2024-05-09T01:00:58.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:00:58 smithi136 ceph-mon[34110]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:58.407 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:00:58 smithi037 ceph-mon[30122]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:58.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:00:58 smithi151 ceph-mon[34780]: pgmap v360: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:00:58.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-09T01:00:59.015 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:00.336 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:00 smithi037 ceph-mon[30122]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:00.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:00 smithi136 ceph-mon[34110]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:00 smithi151 ceph-mon[34780]: pgmap v361: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 -- 172.21.15.37:0/2184302031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc108f20 msgr2=0x7f99fc109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 --2- 172.21.15.37:0/2184302031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc108f20 0x7f99fc109330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f99e40099c0 tx=0x7f99e4009cd0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 -- 172.21.15.37:0/2184302031 shutdown_connections 2024-05-09T01:01:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 --2- 172.21.15.37:0/2184302031 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99fc109870 0x7f99fc1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 --2- 172.21.15.37:0/2184302031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99fc1045f0 0x7f99fc104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 --2- 172.21.15.37:0/2184302031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc108f20 0x7f99fc109330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 -- 172.21.15.37:0/2184302031 >> 172.21.15.37:0/2184302031 conn(0x7f99fc100040 msgr2=0x7f99fc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.570+0000 7f9a00cca700 1 -- 172.21.15.37:0/2184302031 shutdown_connections 2024-05-09T01:01:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.571+0000 7f9a00cca700 1 -- 172.21.15.37:0/2184302031 wait complete. 2024-05-09T01:01:00.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.571+0000 7f9a00cca700 1 Processor -- start 2024-05-09T01:01:00.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.571+0000 7f9a00cca700 1 -- start start 2024-05-09T01:01:00.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f9a00cca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc1045f0 0x7f99fc19afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f9a00cca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99fc108f20 0x7f99fc19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f9a00cca700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99fc109870 0x7f99fc19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f9a00cca700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc1144a0 con 0x7f99fc1045f0 2024-05-09T01:01:00.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f9a00cca700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc114320 con 0x7f99fc109870 2024-05-09T01:01:00.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f9a00cca700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc114620 con 0x7f99fc108f20 2024-05-09T01:01:00.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc1045f0 0x7f99fc19afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc1045f0 0x7f99fc19afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55484/0 (socket says 172.21.15.37:55484) 2024-05-09T01:01:00.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 -- 172.21.15.37:0/1226085658 learned_addr learned my addr 172.21.15.37:0/1226085658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:00.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99fc108f20 0x7f99fc19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 -- 172.21.15.37:0/1226085658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99fc108f20 msgr2=0x7f99fc19b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99fc108f20 0x7f99fc19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fad9d700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99fc109870 0x7f99fc19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 -- 172.21.15.37:0/1226085658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99fc109870 msgr2=0x7f99fc19f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99fc109870 0x7f99fc19f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 -- 172.21.15.37:0/1226085658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc19fe80 con 0x7f99fc1045f0 2024-05-09T01:01:00.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fad9d700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99fc109870 0x7f99fc19f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:00.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.572+0000 7f99fa59c700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc1045f0 0x7f99fc19afb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f99ec007f10 tx=0x7f99ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.573+0000 7f99f37fe700 1 -- 172.21.15.37:0/1226085658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00dc90 con 0x7f99fc1045f0 2024-05-09T01:01:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.573+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc1a0170 con 0x7f99fc1045f0 2024-05-09T01:01:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.573+0000 7f99f37fe700 1 -- 172.21.15.37:0/1226085658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec00de30 con 0x7f99fc1045f0 2024-05-09T01:01:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.573+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc1a7a90 con 0x7f99fc1045f0 2024-05-09T01:01:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.573+0000 7f99f37fe700 1 -- 172.21.15.37:0/1226085658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0133f0 con 0x7f99fc1045f0 2024-05-09T01:01:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.575+0000 7f99f37fe700 1 -- 172.21.15.37:0/1226085658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f99ec01a020 con 0x7f99fc1045f0 2024-05-09T01:01:00.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.576+0000 7f99f37fe700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f99e80b2900 0x7f99e80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.576+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f99e80b2900 0x7f99e80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.576+0000 7f99f37fe700 1 -- 172.21.15.37:0/1226085658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f99ec0e19f0 con 0x7f99fc1045f0 2024-05-09T01:01:00.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.576+0000 7f9a0f6e0b80 1 Processor -- start 2024-05-09T01:01:00.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f9a0f6e0b80 1 -- start start 2024-05-09T01:01:00.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f99e80b2900 0x7f99e80b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99e4006010 tx=0x7f99e4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:00.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc1c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627eca99450 0x5627ecc1c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc16a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627ecb38fa0 con 0x5627ecc16650 2024-05-09T01:01:00.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5627ecad77a0 con 0x5627ecb83110 2024-05-09T01:01:00.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627ecb34f60 con 0x5627eca99450 2024-05-09T01:01:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f99fad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc16a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f99fad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc16a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55496/0 (socket says 172.21.15.37:55496) 2024-05-09T01:01:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f99fad9d700 1 -- 172.21.15.37:0/3685222645 learned_addr learned my addr 172.21.15.37:0/3685222645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627eca99450 0x5627ecc1c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.577+0000 7f99fa59c700 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc1c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99fad9d700 1 -- 172.21.15.37:0/3685222645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627eca99450 msgr2=0x5627ecc1c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99fad9d700 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627eca99450 0x5627ecc1c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99fad9d700 1 -- 172.21.15.37:0/3685222645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 msgr2=0x5627ecc1c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99fad9d700 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc1c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99fad9d700 1 -- 172.21.15.37:0/3685222645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ecacf320 con 0x5627ecc16650 2024-05-09T01:01:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99fa59c700 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc1c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:00.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99fad9d700 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc16a80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009bd0 tx=0x7f99f4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaf440f9880ae70 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:00.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99f0ff9700 1 -- 172.21.15.37:0/3685222645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4016070 con 0x5627ecc16650 2024-05-09T01:01:00.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99f0ff9700 1 -- 172.21.15.37:0/3685222645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99f4011470 con 0x5627ecc16650 2024-05-09T01:01:00.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.578+0000 7f99f0ff9700 1 -- 172.21.15.37:0/3685222645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4010630 con 0x5627ecc16650 2024-05-09T01:01:00.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3685222645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 msgr2=0x5627ecc16a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc16a80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009bd0 tx=0x7f99f4009ee0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3685222645 shutdown_connections 2024-05-09T01:01:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc16a80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc1c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3685222645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627eca99450 0x5627ecc1c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3685222645 >> 172.21.15.37:0/3685222645 conn(0x5627ecaf9650 msgr2=0x5627ecc113b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3685222645 shutdown_connections 2024-05-09T01:01:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3685222645 wait complete. 2024-05-09T01:01:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.579+0000 7f9a0f6e0b80 1 -- start start 2024-05-09T01:01:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 1 Processor -- start 2024-05-09T01:01:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc20040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc20580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecc16650 0x5627ecc20ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627ec9b4b50 con 0x5627eca99450 2024-05-09T01:01:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5627ecaf3100 con 0x5627ecb83110 2024-05-09T01:01:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627ecc23180 con 0x5627ecc16650 2024-05-09T01:01:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f9a0f6e0b80 10 client.0 _ll_register_callbacks cb 0x5627ec9aa670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc20040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc20040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55502/0 (socket says 172.21.15.37:55502) 2024-05-09T01:01:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 -- 172.21.15.37:0/3702259696 learned_addr learned my addr 172.21.15.37:0/3702259696 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fad9d700 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecc16650 0x5627ecc20ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc20580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 -- 172.21.15.37:0/3702259696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecc16650 msgr2=0x5627ecc20ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecc16650 0x5627ecc20ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 -- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 msgr2=0x5627ecc20580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc20580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.580+0000 7f99fa59c700 1 -- 172.21.15.37:0/3702259696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ec9b4440 con 0x5627eca99450 2024-05-09T01:01:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f99fa59c700 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc20040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0a5130 tx=0x7f99ec0a9880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad69457aff05708 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f99e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f99e1ffb700 1 -- 172.21.15.37:0/3702259696 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0b1f10 con 0x5627eca99450 2024-05-09T01:01:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f99e1ffb700 1 -- 172.21.15.37:0/3702259696 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f99ec0ad0d0 con 0x5627eca99450 2024-05-09T01:01:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99f4011470 con 0x5627eca99450 2024-05-09T01:01:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f99e1ffb700 1 -- 172.21.15.37:0/3702259696 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99ec0b1a80 con 0x5627eca99450 2024-05-09T01:01:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f9a0f6e0b80 10 client.14967 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5627ecc2db30 con 0x5627eca99450 2024-05-09T01:01:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f99e1ffb700 1 -- 172.21.15.37:0/3702259696 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99f4011470 con 0x5627eca99450 2024-05-09T01:01:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f99e1ffb700 1 -- 172.21.15.37:0/3702259696 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f99ec0a7d80 con 0x5627eca99450 2024-05-09T01:01:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f9a0f6e0b80 10 client.14967 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f9a0f6e0b80 10 client.14967 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T01:01:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.581+0000 7f9a0f6e0b80 20 client.14967 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.582+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecc31570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.582+0000 7f9a0f6e0b80 4 client.14967 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:01:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.582+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627ecb46980 con 0x5627ecc30100 2024-05-09T01:01:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.582+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecc31570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.582+0000 7f99e1ffb700 10 client.14967 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.582+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecc31570 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c1e0989df92bb29 server_cookie=549237fe44ecc86a in_seq=0 out_seq=0 2024-05-09T01:01:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.583+0000 7f99e1ffb700 1 -- 172.21.15.37:0/3702259696 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5627ecb46980 con 0x5627ecc30100 2024-05-09T01:01:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.583+0000 7f99e1ffb700 10 client.14967 handle_command_reply: tid=0 2024-05-09T01:01:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.583+0000 7f9a0f6e0b80 1 client.14967 shutdown 2024-05-09T01:01:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.583+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 msgr2=0x5627ecc20040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.583+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc20040 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0a5130 tx=0x7f99ec0a9880 comp rx=0 tx=0).stop 2024-05-09T01:01:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 shutdown_connections 2024-05-09T01:01:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecc16650 0x5627ecc20ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecc31570 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc20040 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f99e1ffb700 0 client.14967 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/3702259696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecb83110 0x5627ecc20580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 >> 172.21.15.37:0/3702259696 conn(0x5627ecaf9650 msgr2=0x5627ecc11170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 shutdown_connections 2024-05-09T01:01:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/3702259696 wait complete. 2024-05-09T01:01:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.584+0000 7f9a0f6e0b80 20 client.14967 trim_cache size 0 max 16384 2024-05-09T01:01:00.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.605+0000 7f9a0f6e0b80 1 Processor -- start 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.605+0000 7f9a0f6e0b80 1 -- start start 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.605+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627eca99450 0x5627ecc1e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.605+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc1ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.605+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc1b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.605+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627ecc2f8b0 con 0x5627ecc16650 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.605+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5627ecc2ff80 con 0x5627eca99450 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627ecc30650 con 0x5627ecb83110 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc1b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc1b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55508/0 (socket says 172.21.15.37:55508) 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 -- 172.21.15.37:0/812826654 learned_addr learned my addr 172.21.15.37:0/812826654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fa59c700 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627eca99450 0x5627ecc1e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc1ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 -- 172.21.15.37:0/812826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 msgr2=0x5627ecc1ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc1ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 -- 172.21.15.37:0/812826654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627eca99450 msgr2=0x5627ecc1e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627eca99450 0x5627ecc1e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 -- 172.21.15.37:0/812826654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ecc1e5d0 con 0x5627ecc16650 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc1ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99fad9d700 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc1b2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009bd0 tx=0x7f99f40096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b73a931df08178 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.606+0000 7f99e3fff700 1 -- 172.21.15.37:0/812826654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4016040 con 0x5627ecc16650 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f99e3fff700 1 -- 172.21.15.37:0/812826654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99f4005040 con 0x5627ecc16650 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f99e3fff700 1 -- 172.21.15.37:0/812826654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f40119a0 con 0x5627ecc16650 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/812826654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 msgr2=0x5627ecc1b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc1b2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009bd0 tx=0x7f99f40096e0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/812826654 shutdown_connections 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627ecc16650 0x5627ecc1b2a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627eca99450 0x5627ecc1e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/812826654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc1ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/812826654 >> 172.21.15.37:0/812826654 conn(0x5627ecaf9650 msgr2=0x5627ecc1c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.607+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/812826654 shutdown_connections 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/812826654 wait complete. 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 -- start start 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 Processor -- start 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc22070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc39db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecc16650 0x5627ecc3a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627ecc313f0 con 0x5627eca99450 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5627ecc30d20 con 0x5627ecc16650 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627ecc31ac0 con 0x5627ecb83110 2024-05-09T01:01:00.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f9a0f6e0b80 10 client.0 _ll_register_callbacks cb 0x5627ec9aa670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc22070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f99fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc22070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55510/0 (socket says 172.21.15.37:55510) 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.608+0000 7f99fa59c700 1 -- 172.21.15.37:0/4260463461 learned_addr learned my addr 172.21.15.37:0/4260463461 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc39db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99fad9d700 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecc16650 0x5627ecc3a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99fa59c700 1 -- 172.21.15.37:0/4260463461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 msgr2=0x5627ecc39db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99fa59c700 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc39db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99fa59c700 1 -- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecc16650 msgr2=0x5627ecc3a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99fa59c700 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecc16650 0x5627ecc3a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99fa59c700 1 -- 172.21.15.37:0/4260463461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ecc3a9f0 con 0x5627eca99450 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99fa59c700 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc22070 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0df5e0 tx=0x7f99ec004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4380218194303fc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99e1ffb700 1 -- 172.21.15.37:0/4260463461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0b1f10 con 0x5627eca99450 2024-05-09T01:01:00.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99e1ffb700 1 -- 172.21.15.37:0/4260463461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f99ec0a8310 con 0x5627eca99450 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99f4005040 con 0x5627eca99450 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f99e1ffb700 1 -- 172.21.15.37:0/4260463461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99ec0a8a00 con 0x5627eca99450 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f9a0f6e0b80 10 client.14973 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.609+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5627ecca03e0 con 0x5627eca99450 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f99e1ffb700 1 -- 172.21.15.37:0/4260463461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99f4005040 con 0x5627eca99450 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f99e1ffb700 1 -- 172.21.15.37:0/4260463461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f99ec0192c0 con 0x5627eca99450 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f9a0f6e0b80 10 client.14973 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f9a0f6e0b80 10 client.14973 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f9a0f6e0b80 20 client.14973 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecca3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f9a0f6e0b80 4 client.14973 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "status"}) -- 0x5627ecb40a20 con 0x5627ecc30100 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.610+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecca3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:00.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f99e1ffb700 10 client.14973 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f99f9d9b700 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecca3d40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d990886dd9af2a1 server_cookie=a5d453a81631ddda in_seq=0 out_seq=0 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f99e1ffb700 1 -- 172.21.15.37:0/4260463461 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5627ecb40a20 con 0x5627ecc30100 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f99e1ffb700 10 client.14973 handle_command_reply: tid=0 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 client.14973 shutdown 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 msgr2=0x5627ecc22070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc22070 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99ec0df5e0 tx=0x7f99ec004f50 comp rx=0 tx=0).stop 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 shutdown_connections 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627ecc16650 0x5627ecc3a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5627ecc30100 0x5627ecca3d40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627eca99450 0x5627ecc22070 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 --2- 172.21.15.37:0/4260463461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627ecb83110 0x5627ecc39db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 >> 172.21.15.37:0/4260463461 conn(0x5627ecaf9650 msgr2=0x5627ecc1e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f99e1ffb700 0 client.14973 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 shutdown_connections 2024-05-09T01:01:00.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 1 -- 172.21.15.37:0/4260463461 wait complete. 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.611+0000 7f9a0f6e0b80 20 client.14973 trim_cache size 0 max 16384 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24467, 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 127.641406561, 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:01:00.625 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:01:00.626 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:01:00.626 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 171.70653093999999 2024-05-09T01:01:00.626 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:01:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f99e80b2900 msgr2=0x7f99e80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f99e80b2900 0x7f99e80b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99e4006010 tx=0x7f99e4000bc0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc1045f0 msgr2=0x7f99fc19afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:00.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc1045f0 0x7f99fc19afb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f99ec007f10 tx=0x7f99ec00d3b0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 shutdown_connections 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f99e80b2900 0x7f99e80b4e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99fc109870 0x7f99fc19f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99fc1045f0 0x7f99fc19afb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 --2- 172.21.15.37:0/1226085658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99fc108f20 0x7f99fc19b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 >> 172.21.15.37:0/1226085658 conn(0x7f99fc100040 msgr2=0x7f99fc108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 shutdown_connections 2024-05-09T01:01:00.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:00.612+0000 7f9a00cca700 1 -- 172.21.15.37:0/1226085658 wait complete. 2024-05-09T01:01:01.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-09T01:01:01.613 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:02 smithi037 ceph-mon[30122]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:02.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:02 smithi151 ceph-mon[34780]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:02.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:02 smithi136 ceph-mon[34110]: pgmap v362: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 -- 172.21.15.37:0/376185413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e8108740 msgr2=0x7f36e81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 --2- 172.21.15.37:0/376185413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e8108740 0x7f36e81100a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f36e000b0d0 tx=0x7f36e000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 -- 172.21.15.37:0/376185413 shutdown_connections 2024-05-09T01:01:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 --2- 172.21.15.37:0/376185413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e8108740 0x7f36e81100a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 --2- 172.21.15.37:0/376185413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e81034c0 0x7f36e81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 --2- 172.21.15.37:0/376185413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36e8107df0 0x7f36e8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 -- 172.21.15.37:0/376185413 >> 172.21.15.37:0/376185413 conn(0x7f36e80fedf0 msgr2=0x7f36e8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:03.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 -- 172.21.15.37:0/376185413 shutdown_connections 2024-05-09T01:01:03.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.188+0000 7f36ecba4700 1 -- 172.21.15.37:0/376185413 wait complete. 2024-05-09T01:01:03.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 Processor -- start 2024-05-09T01:01:03.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 -- start start 2024-05-09T01:01:03.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e81034c0 0x7f36e819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e8107df0 0x7f36e819c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36e8108740 0x7f36e819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f36e8113370 con 0x7f36e81034c0 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f36e81131f0 con 0x7f36e8108740 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36ecba4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f36e81134f0 con 0x7f36e8107df0 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e81034c0 0x7f36e819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e81034c0 0x7f36e819bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36780/0 (socket says 172.21.15.37:36780) 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.189+0000 7f36e659c700 1 -- 172.21.15.37:0/3090940480 learned_addr learned my addr 172.21.15.37:0/3090940480 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e8107df0 0x7f36e819c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e6d9d700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36e8108740 0x7f36e819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e659c700 1 -- 172.21.15.37:0/3090940480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e8107df0 msgr2=0x7f36e819c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e659c700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e8107df0 0x7f36e819c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e659c700 1 -- 172.21.15.37:0/3090940480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36e8108740 msgr2=0x7f36e819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e659c700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36e8108740 0x7f36e819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e659c700 1 -- 172.21.15.37:0/3090940480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e81a6f40 con 0x7f36e81034c0 2024-05-09T01:01:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36e659c700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e81034c0 0x7f36e819bbf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e9a0 tx=0x7f36d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36d77fe700 1 -- 172.21.15.37:0/3090940480 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d800ca10 con 0x7f36e81034c0 2024-05-09T01:01:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e8199a40 con 0x7f36e81034c0 2024-05-09T01:01:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36d77fe700 1 -- 172.21.15.37:0/3090940480 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d800cbb0 con 0x7f36e81034c0 2024-05-09T01:01:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36d77fe700 1 -- 172.21.15.37:0/3090940480 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8018680 con 0x7f36e81034c0 2024-05-09T01:01:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.190+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e8199fd0 con 0x7f36e81034c0 2024-05-09T01:01:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.193+0000 7f36d77fe700 1 -- 172.21.15.37:0/3090940480 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f36d8018820 con 0x7f36e81034c0 2024-05-09T01:01:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.194+0000 7f36d77fe700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f36d00b2900 0x7f36d00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.194+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f36d00b2900 0x7f36d00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.194+0000 7f36d77fe700 1 -- 172.21.15.37:0/3090940480 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f36d80e22b0 con 0x7f36e81034c0 2024-05-09T01:01:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.194+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f36d00b2900 0x7f36d00b4e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f36e8102940 tx=0x7f36dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.194+0000 7f36fb5bab80 1 Processor -- start 2024-05-09T01:01:03.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36fb5bab80 1 -- start start 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ed2b450 0x557b6eeae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6eea8650 0x557b6eea8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b6edcafa0 con 0x557b6ee15110 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557b6ed697a0 con 0x557b6eea8650 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b6edc6f60 con 0x557b6ed2b450 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36796/0 (socket says 172.21.15.37:36796) 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 -- 172.21.15.37:0/2601424994 learned_addr learned my addr 172.21.15.37:0/2601424994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ed2b450 0x557b6eeae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e6d9d700 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6eea8650 0x557b6eea8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 -- 172.21.15.37:0/2601424994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ed2b450 msgr2=0x557b6eeae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ed2b450 0x557b6eeae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 -- 172.21.15.37:0/2601424994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6eea8650 msgr2=0x557b6eea8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6eea8650 0x557b6eea8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.195+0000 7f36e659c700 1 -- 172.21.15.37:0/2601424994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6ed61320 con 0x557b6ee15110 2024-05-09T01:01:03.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.196+0000 7f36e659c700 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f36d80a59f0 tx=0x7f36d8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8522b8cb411155 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:03.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.196+0000 7f36d4ff9700 1 -- 172.21.15.37:0/2601424994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8090e60 con 0x557b6ee15110 2024-05-09T01:01:03.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.196+0000 7f36d4ff9700 1 -- 172.21.15.37:0/2601424994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d80a9970 con 0x557b6ee15110 2024-05-09T01:01:03.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.196+0000 7f36d4ff9700 1 -- 172.21.15.37:0/2601424994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80a9bd0 con 0x557b6ee15110 2024-05-09T01:01:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 -- 172.21.15.37:0/2601424994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 msgr2=0x557b6eeae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f36d80a59f0 tx=0x7f36d8014000 comp rx=0 tx=0).stop 2024-05-09T01:01:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 -- 172.21.15.37:0/2601424994 shutdown_connections 2024-05-09T01:01:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6eea8650 0x557b6eea8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/2601424994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ed2b450 0x557b6eeae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 -- 172.21.15.37:0/2601424994 >> 172.21.15.37:0/2601424994 conn(0x557b6ed8b650 msgr2=0x557b6eea33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 -- 172.21.15.37:0/2601424994 shutdown_connections 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 -- 172.21.15.37:0/2601424994 wait complete. 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 -- start start 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.197+0000 7f36fb5bab80 1 Processor -- start 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eeb21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeb2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeb2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b6ec46b50 con 0x557b6ee15110 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557b6ed85100 con 0x557b6ed2b450 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b6eeb5180 con 0x557b6eea8650 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36fb5bab80 10 client.0 _ll_register_callbacks cb 0x557b6ec3c670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeb2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeb2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36798/0 (socket says 172.21.15.37:36798) 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 -- 172.21.15.37:0/3726230071 learned_addr learned my addr 172.21.15.37:0/3726230071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e6d9d700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeb2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e659c700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eeb21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 -- 172.21.15.37:0/3726230071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 msgr2=0x557b6eeb2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeb2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 -- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 msgr2=0x557b6eeb21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eeb21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 -- 172.21.15.37:0/3726230071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6ec46440 con 0x557b6ee15110 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e659c700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eeb21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeb2720 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0116f0 tx=0x7f36dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a929dd20524405f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.198+0000 7f36cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36cdffb700 1 -- 172.21.15.37:0/3726230071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc004a30 con 0x557b6ee15110 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36cdffb700 1 -- 172.21.15.37:0/3726230071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f36dc004bd0 con 0x557b6ee15110 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36d80a9970 con 0x557b6ee15110 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36cdffb700 1 -- 172.21.15.37:0/3726230071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36dc02f050 con 0x557b6ee15110 2024-05-09T01:01:03.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 10 client.14985 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557b6eebfc20 con 0x557b6ee15110 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36cdffb700 1 -- 172.21.15.37:0/3726230071 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d80a9970 con 0x557b6ee15110 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36cdffb700 1 -- 172.21.15.37:0/3726230071 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f36dc01f840 con 0x557b6ee15110 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 10 client.14985 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 10 client.14985 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 20 client.14985 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6eec2260 0x557b6eec36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 4 client.14985 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.199+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b6edd8980 con 0x557b6eec2260 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.200+0000 7f36e659c700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6eec2260 0x557b6eec36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.200+0000 7f36e659c700 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6eec2260 0x557b6eec36d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24d3796f5c459028 server_cookie=9dcbe781746a9d56 in_seq=0 out_seq=0 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.200+0000 7f36cdffb700 10 client.14985 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36cdffb700 1 -- 172.21.15.37:0/3726230071 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557b6edd8980 con 0x557b6eec2260 2024-05-09T01:01:03.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36cdffb700 10 client.14985 handle_command_reply: tid=0 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 client.14985 shutdown 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 msgr2=0x557b6eeb2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeb2720 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0116f0 tx=0x7f36dc0047c0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 shutdown_connections 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6eec2260 0x557b6eec36d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeb2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eeb21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/3726230071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ee15110 0x557b6eeb2720 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 >> 172.21.15.37:0/3726230071 conn(0x557b6ed8b650 msgr2=0x557b6eea3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36cdffb700 0 client.14985 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 shutdown_connections 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 1 -- 172.21.15.37:0/3726230071 wait complete. 2024-05-09T01:01:03.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.201+0000 7f36fb5bab80 20 client.14985 trim_cache size 0 max 16384 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 Processor -- start 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 -- start start 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ed2b450 0x557b6eeb2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b6eec1a10 con 0x557b6ed2b450 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557b6eec20e0 con 0x557b6ee15110 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b6eec27b0 con 0x557b6eea8650 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ed2b450 0x557b6eeb2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ed2b450 0x557b6eeb2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36814/0 (socket says 172.21.15.37:36814) 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36e659c700 1 -- 172.21.15.37:0/223253628 learned_addr learned my addr 172.21.15.37:0/223253628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36e6d9d700 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.223+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36e659c700 1 -- 172.21.15.37:0/223253628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 msgr2=0x557b6eeae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36e659c700 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36e659c700 1 -- 172.21.15.37:0/223253628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ee15110 msgr2=0x557b6eeae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36e659c700 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36e659c700 1 -- 172.21.15.37:0/223253628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6eeb2fe0 con 0x557b6ed2b450 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36e659c700 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ed2b450 0x557b6eeb2aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f36d80a9330 tx=0x7f36d8092040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb507ae4542a4779 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36cffff700 1 -- 172.21.15.37:0/223253628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d8090e60 con 0x557b6ed2b450 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36cffff700 1 -- 172.21.15.37:0/223253628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d80a9970 con 0x557b6ed2b450 2024-05-09T01:01:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.224+0000 7f36cffff700 1 -- 172.21.15.37:0/223253628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d80a9e30 con 0x557b6ed2b450 2024-05-09T01:01:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 -- 172.21.15.37:0/223253628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ed2b450 msgr2=0x557b6eeb2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ed2b450 0x557b6eeb2aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f36d80a9330 tx=0x7f36d8092040 comp rx=0 tx=0).stop 2024-05-09T01:01:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 -- 172.21.15.37:0/223253628 shutdown_connections 2024-05-09T01:01:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6eea8650 0x557b6eeae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6ed2b450 0x557b6eeb2aa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/223253628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ee15110 0x557b6eeae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 -- 172.21.15.37:0/223253628 >> 172.21.15.37:0/223253628 conn(0x557b6ed8b650 msgr2=0x557b6eea3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 -- 172.21.15.37:0/223253628 shutdown_connections 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 -- 172.21.15.37:0/223253628 wait complete. 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 -- start start 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.225+0000 7f36fb5bab80 1 Processor -- start 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eecd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ee15110 0x557b6eeaf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6eea8650 0x557b6eeaf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b6eec3550 con 0x557b6eea8650 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557b6eec2e80 con 0x557b6ed2b450 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b6eec3c20 con 0x557b6ee15110 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 10 client.0 _ll_register_callbacks cb 0x557b6ec3c670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6eea8650 0x557b6eeaf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6eea8650 0x557b6eeaf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36828/0 (socket says 172.21.15.37:36828) 2024-05-09T01:01:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 -- 172.21.15.37:0/431015090 learned_addr learned my addr 172.21.15.37:0/431015090 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e5d9b700 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ee15110 0x557b6eeaf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e659c700 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eecd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 -- 172.21.15.37:0/431015090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ee15110 msgr2=0x557b6eeaf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ee15110 0x557b6eeaf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 -- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 msgr2=0x557b6eecd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eecd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 -- 172.21.15.37:0/431015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b6eeafec0 con 0x557b6eea8650 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36e6d9d700 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6eea8650 0x557b6eeaf740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36e000b770 tx=0x7f36e000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac1cfc9495e109 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36cdffb700 1 -- 172.21.15.37:0/431015090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0003e10 con 0x557b6eea8650 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36cdffb700 1 -- 172.21.15.37:0/431015090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f36e00075c0 con 0x557b6eea8650 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.226+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36d80a9970 con 0x557b6eea8650 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36cdffb700 1 -- 172.21.15.37:0/431015090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36e00077c0 con 0x557b6eea8650 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 10 client.14991 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557b6ef2d6d0 con 0x557b6eea8650 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36cdffb700 1 -- 172.21.15.37:0/431015090 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36d80a9970 con 0x557b6eea8650 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36cdffb700 1 -- 172.21.15.37:0/431015090 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f36e0011070 con 0x557b6eea8650 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 10 client.14991 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 10 client.14991 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 20 client.14991 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6ef2fae0 0x557b6ef30f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 4 client.14991 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "status"}) -- 0x557b6edd2a20 con 0x557b6ef2fae0 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.227+0000 7f36e659c700 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6ef2fae0 0x557b6ef30f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36cdffb700 10 client.14991 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36e659c700 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6ef2fae0 0x557b6ef30f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=900e5b027cbaf588 server_cookie=d8b2f7f538a1bc3c in_seq=0 out_seq=0 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36cdffb700 1 -- 172.21.15.37:0/431015090 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557b6edd2a20 con 0x557b6ef2fae0 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36cdffb700 10 client.14991 handle_command_reply: tid=0 2024-05-09T01:01:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 client.14991 shutdown 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6eea8650 msgr2=0x557b6eeaf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6eea8650 0x557b6eeaf740 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36e000b770 tx=0x7f36e000be70 comp rx=0 tx=0).stop 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 shutdown_connections 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b6ef2fae0 0x557b6ef30f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b6eea8650 0x557b6eeaf740 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b6ed2b450 0x557b6eecd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 --2- 172.21.15.37:0/431015090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b6ee15110 0x557b6eeaf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36cdffb700 0 client.14991 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.228+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 >> 172.21.15.37:0/431015090 conn(0x557b6ed8b650 msgr2=0x557b6eea2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 shutdown_connections 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36fb5bab80 1 -- 172.21.15.37:0/431015090 wait complete. 2024-05-09T01:01:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36fb5bab80 20 client.14991 trim_cache size 0 max 16384 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24491, 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 142.87018235299999, 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:01:03.235 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 160.78739089300001 2024-05-09T01:01:03.236 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:01:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f36d00b2900 msgr2=0x7f36d00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f36d00b2900 0x7f36d00b4e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f36e8102940 tx=0x7f36dc00b410 comp rx=0 tx=0).stop 2024-05-09T01:01:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e81034c0 msgr2=0x7f36e819bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e81034c0 0x7f36e819bbf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f36d800e9a0 tx=0x7f36d800ecb0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 shutdown_connections 2024-05-09T01:01:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f36d00b2900 0x7f36d00b4e10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36e8108740 0x7f36e819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36e81034c0 0x7f36e819bbf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 --2- 172.21.15.37:0/3090940480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36e8107df0 0x7f36e819c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 >> 172.21.15.37:0/3090940480 conn(0x7f36e80fedf0 msgr2=0x7f36e8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 shutdown_connections 2024-05-09T01:01:03.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:03.229+0000 7f36ecba4700 1 -- 172.21.15.37:0/3090940480 wait complete. 2024-05-09T01:01:03.914 INFO:tasks.cephadm:Setup complete, yielding 2024-05-09T01:01:03.914 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T01:01:03.924 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:01:03.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-09T01:01:04.178 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:04.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:04 smithi037 ceph-mon[30122]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:04.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:04 smithi136 ceph-mon[34110]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:04.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:04 smithi151 ceph-mon[34780]: pgmap v363: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 -- 172.21.15.37:0/748859148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e20104370 msgr2=0x7f5e20104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 --2- 172.21.15.37:0/748859148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e20104370 0x7f5e20104780 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000b0a0 tx=0x7f5e1000b3b0 comp rx=0 tx=0).stop 2024-05-09T01:01:05.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 -- 172.21.15.37:0/748859148 shutdown_connections 2024-05-09T01:01:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 --2- 172.21.15.37:0/748859148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e20105e40 0x7f5e2010c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 --2- 172.21.15.37:0/748859148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e20104370 0x7f5e20104780 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 --2- 172.21.15.37:0/748859148 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e201054a0 0x7f5e201058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 -- 172.21.15.37:0/748859148 >> 172.21.15.37:0/748859148 conn(0x7f5e200ff9d0 msgr2=0x7f5e20101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:05.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 -- 172.21.15.37:0/748859148 shutdown_connections 2024-05-09T01:01:05.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.892+0000 7f5e284d5700 1 -- 172.21.15.37:0/748859148 wait complete. 2024-05-09T01:01:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.893+0000 7f5e284d5700 1 Processor -- start 2024-05-09T01:01:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.893+0000 7f5e284d5700 1 -- start start 2024-05-09T01:01:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e284d5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e20104370 0x7f5e2019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e284d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e201054a0 0x7f5e2019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e284d5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e20105e40 0x7f5e201a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e284d5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2010fdc0 con 0x7f5e201054a0 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e284d5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2010fc40 con 0x7f5e20104370 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e284d5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2010ff40 con 0x7f5e20105e40 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e201054a0 0x7f5e2019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e201054a0 0x7f5e2019ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36848/0 (socket says 172.21.15.37:36848) 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 -- 172.21.15.37:0/2153475499 learned_addr learned my addr 172.21.15.37:0/2153475499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e26271700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e20104370 0x7f5e2019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e26a72700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e20105e40 0x7f5e201a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 -- 172.21.15.37:0/2153475499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e20105e40 msgr2=0x7f5e201a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e20105e40 0x7f5e201a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 -- 172.21.15.37:0/2153475499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e20104370 msgr2=0x7f5e2019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:05.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e20104370 0x7f5e2019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 -- 172.21.15.37:0/2153475499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e201a2490 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e25a70700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e201054a0 0x7f5e2019ae70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c920 tx=0x7f5e1400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.894+0000 7f5e1f7fe700 1 -- 172.21.15.37:0/2153475499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14004a30 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.895+0000 7f5e1f7fe700 1 -- 172.21.15.37:0/2153475499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e140054d0 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.895+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e201a2780 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.895+0000 7f5e1f7fe700 1 -- 172.21.15.37:0/2153475499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14007c70 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.895+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e201a2cc0 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.896+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e200512c0 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.897+0000 7f5e1f7fe700 1 -- 172.21.15.37:0/2153475499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5e14004c60 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.898+0000 7f5e1f7fe700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e080b2880 0x7f5e080b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.898+0000 7f5e26271700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e080b2880 0x7f5e080b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.898+0000 7f5e1f7fe700 1 -- 172.21.15.37:0/2153475499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5e140e20b0 con 0x7f5e201054a0 2024-05-09T01:01:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.899+0000 7f5e26271700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e080b2880 0x7f5e080b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009fd0 tx=0x7f5e1000b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:05.902+0000 7f5e1f7fe700 1 -- 172.21.15.37:0/2153475499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5e14014030 con 0x7f5e201054a0 2024-05-09T01:01:06.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.136+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5e20063c00 con 0x7f5e080b2880 2024-05-09T01:01:06.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.137+0000 7f5e1f7fe700 1 -- 172.21.15.37:0/2153475499 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5e20063c00 con 0x7f5e080b2880 2024-05-09T01:01:06.138 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-05-09T01:01:06.138 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-05-09T01:01:06.138 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-05-09T01:01:06.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.139+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e080b2880 msgr2=0x7f5e080b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:06.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.139+0000 7f5e284d5700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e080b2880 0x7f5e080b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009fd0 tx=0x7f5e1000b7b0 comp rx=0 tx=0).stop 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.139+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e201054a0 msgr2=0x7f5e2019ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.139+0000 7f5e284d5700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e201054a0 0x7f5e2019ae70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c920 tx=0x7f5e1400cc30 comp rx=0 tx=0).stop 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 shutdown_connections 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5e080b2880 0x7f5e080b4d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e20105e40 0x7f5e201a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e20104370 0x7f5e2019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 --2- 172.21.15.37:0/2153475499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e201054a0 0x7f5e2019ae70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 >> 172.21.15.37:0/2153475499 conn(0x7f5e200ff9d0 msgr2=0x7f5e201086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 shutdown_connections 2024-05-09T01:01:06.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:06.140+0000 7f5e284d5700 1 -- 172.21.15.37:0/2153475499 wait complete. 2024-05-09T01:01:06.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:06 smithi136 ceph-mon[34110]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:06 smithi037 ceph-mon[30122]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:06.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:06 smithi151 ceph-mon[34780]: pgmap v364: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:06.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-09T01:01:07.058 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:07.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:07 smithi037 ceph-mon[30122]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:07.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:07 smithi136 ceph-mon[34110]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:07.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:07 smithi151 ceph-mon[34780]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:08.172 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:08 smithi037 ceph-mon[30122]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:08 smithi136 ceph-mon[34110]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:08.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:08 smithi151 ceph-mon[34780]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:08.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 -- 172.21.15.37:0/245888585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8104370 msgr2=0x7f2ab8104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 --2- 172.21.15.37:0/245888585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8104370 0x7f2ab8104780 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009990 tx=0x7f2aa0009ca0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 -- 172.21.15.37:0/245888585 shutdown_connections 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 --2- 172.21.15.37:0/245888585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ab8104d10 0x7f2ab810b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 --2- 172.21.15.37:0/245888585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ab8103240 0x7f2ab8103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 --2- 172.21.15.37:0/245888585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8104370 0x7f2ab8104780 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 -- 172.21.15.37:0/245888585 >> 172.21.15.37:0/245888585 conn(0x7f2ab80fe880 msgr2=0x7f2ab8100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 -- 172.21.15.37:0/245888585 shutdown_connections 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.727+0000 7f2abe04a700 1 -- 172.21.15.37:0/245888585 wait complete. 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.728+0000 7f2abe04a700 1 Processor -- start 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.728+0000 7f2abe04a700 1 -- start start 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2abe04a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8103240 0x7f2ab8199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2abe04a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ab8104370 0x7f2ab8199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2abe04a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ab8104d10 0x7f2ab81a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2abe04a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab810ed20 con 0x7f2ab8103240 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2abe04a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab810eba0 con 0x7f2ab8104d10 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2abe04a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab810eea0 con 0x7f2ab8104370 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8103240 0x7f2ab8199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8103240 0x7f2ab8199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36870/0 (socket says 172.21.15.37:36870) 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 -- 172.21.15.37:0/1583555500 learned_addr learned my addr 172.21.15.37:0/1583555500 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab7fff700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ab8104d10 0x7f2ab81a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab6ffd700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ab8104370 0x7f2ab8199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 -- 172.21.15.37:0/1583555500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ab8104370 msgr2=0x7f2ab8199da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ab8104370 0x7f2ab8199da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 -- 172.21.15.37:0/1583555500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ab8104d10 msgr2=0x7f2ab81a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ab8104d10 0x7f2ab81a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 -- 172.21.15.37:0/1583555500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab81a13c0 con 0x7f2ab8103240 2024-05-09T01:01:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab77fe700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8103240 0x7f2ab8199860 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007b50 tx=0x7f2aa8007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.729+0000 7f2ab4ff9700 1 -- 172.21.15.37:0/1583555500 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa8019020 con 0x7f2ab8103240 2024-05-09T01:01:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.730+0000 7f2ab4ff9700 1 -- 172.21.15.37:0/1583555500 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2aa800ce10 con 0x7f2ab8103240 2024-05-09T01:01:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.730+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab806b670 con 0x7f2ab8103240 2024-05-09T01:01:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.730+0000 7f2ab4ff9700 1 -- 172.21.15.37:0/1583555500 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa800e580 con 0x7f2ab8103240 2024-05-09T01:01:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.730+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab806bc30 con 0x7f2ab8103240 2024-05-09T01:01:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.731+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab80512c0 con 0x7f2ab8103240 2024-05-09T01:01:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.733+0000 7f2ab4ff9700 1 -- 172.21.15.37:0/1583555500 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2aa8003f60 con 0x7f2ab8103240 2024-05-09T01:01:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.734+0000 7f2ab4ff9700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2aa40b2880 0x7f2aa40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.734+0000 7f2ab6ffd700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2aa40b2880 0x7f2aa40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.734+0000 7f2ab4ff9700 1 -- 172.21.15.37:0/1583555500 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2aa80e38a0 con 0x7f2ab8103240 2024-05-09T01:01:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.735+0000 7f2ab6ffd700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2aa40b2880 0x7f2aa40b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000b5c0 tx=0x7f2aa001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:08.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.738+0000 7f2ab4ff9700 1 -- 172.21.15.37:0/1583555500 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2aa8023020 con 0x7f2ab8103240 2024-05-09T01:01:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.964+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2ab806be90 con 0x7f2aa40b2880 2024-05-09T01:01:08.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.978+0000 7f2ab4ff9700 1 -- 172.21.15.37:0/1583555500 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f2ab806be90 con 0x7f2aa40b2880 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.a smithi037 running (2m) 30s ago 2m 89.2M - 19.0.0-3594-gc9da4049 db794d706f49 cb18d56c95e1 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.b smithi136 running (2m) 33s ago 2m 94.9M - 19.0.0-3594-gc9da4049 db794d706f49 cf0016c1dfa5 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.c smithi151 running (3m) 33s ago 3m 89.4M - 19.0.0-3594-gc9da4049 db794d706f49 119ac92182b3 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.d smithi037 running (3m) 30s ago 3m 81.4M - 19.0.0-3594-gc9da4049 db794d706f49 5ceb014e1213 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.e smithi136 running (3m) 33s ago 3m 89.8M - 19.0.0-3594-gc9da4049 db794d706f49 7db6c509525b 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.f smithi151 running (3m) 33s ago 3m 87.3M - 19.0.0-3594-gc9da4049 db794d706f49 2544b0495f1a 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.g smithi037 running (2m) 30s ago 2m 88.3M - 19.0.0-3594-gc9da4049 db794d706f49 0e97b0a89395 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.h smithi136 running (3m) 33s ago 2m 86.9M - 19.0.0-3594-gc9da4049 db794d706f49 641f714e6c2a 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.i smithi151 running (2m) 33s ago 2m 89.0M - 19.0.0-3594-gc9da4049 db794d706f49 103667fe17a0 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.j smithi037 running (3m) 30s ago 3m 83.8M - 19.0.0-3594-gc9da4049 db794d706f49 68d994b4b6f8 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.k smithi136 running (3m) 33s ago 3m 89.2M - 19.0.0-3594-gc9da4049 db794d706f49 2617c853fb14 2024-05-09T01:01:08.979 INFO:teuthology.orchestra.run.smithi037.stdout:mds.l smithi151 running (3m) 33s ago 3m 86.2M - 19.0.0-3594-gc9da4049 db794d706f49 3b4450749e8a 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.x smithi037 *:9283,8765 running (10m) 30s ago 10m 598M - 19.0.0-3594-gc9da4049 db794d706f49 00d64b3c7a23 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.y smithi136 *:8443,8765 running (8m) 33s ago 8m 537M - 19.0.0-3594-gc9da4049 db794d706f49 70b7d49e8a7e 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.z smithi151 *:8443,8765 running (8m) 33s ago 8m 539M - 19.0.0-3594-gc9da4049 db794d706f49 e02b5abdae5c 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a smithi037 running (10m) 30s ago 10m 119M 2048M 19.0.0-3594-gc9da4049 db794d706f49 d9bacac277c5 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b smithi136 running (8m) 33s ago 8m 110M 2048M 19.0.0-3594-gc9da4049 db794d706f49 8791a6ea5d27 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c smithi151 running (9m) 33s ago 9m 110M 2048M 19.0.0-3594-gc9da4049 db794d706f49 3db7f298ed87 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (8m) 30s ago 8m 128M 4273M 19.0.0-3594-gc9da4049 db794d706f49 dfc3207479f5 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi136 running (7m) 33s ago 7m 117M 4272M 19.0.0-3594-gc9da4049 db794d706f49 497d0f2b9363 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi151 running (7m) 33s ago 7m 127M 4272M 19.0.0-3594-gc9da4049 db794d706f49 c3f4b1b53d71 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi037 running (7m) 30s ago 7m 115M 4273M 19.0.0-3594-gc9da4049 db794d706f49 a9e1dd450e13 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi136 running (6m) 33s ago 6m 122M 4272M 19.0.0-3594-gc9da4049 db794d706f49 3a79445960f2 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi151 running (6m) 33s ago 6m 118M 4272M 19.0.0-3594-gc9da4049 db794d706f49 0f8f809df8bb 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 smithi037 running (5m) 30s ago 5m 122M 4273M 19.0.0-3594-gc9da4049 db794d706f49 95755ee791bc 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 smithi136 running (5m) 33s ago 5m 116M 4272M 19.0.0-3594-gc9da4049 db794d706f49 cfec0b5ecead 2024-05-09T01:01:08.980 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 smithi151 running (5m) 33s ago 5m 123M 4272M 19.0.0-3594-gc9da4049 db794d706f49 4f3cca232003 2024-05-09T01:01:08.981 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 smithi037 running (4m) 30s ago 4m 113M 4273M 19.0.0-3594-gc9da4049 db794d706f49 6557de925d50 2024-05-09T01:01:08.981 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 smithi136 running (4m) 33s ago 4m 115M 4272M 19.0.0-3594-gc9da4049 db794d706f49 e458312898e5 2024-05-09T01:01:08.981 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 smithi151 running (3m) 33s ago 3m 123M 4272M 19.0.0-3594-gc9da4049 db794d706f49 5e27da2fb93a 2024-05-09T01:01:08.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.980+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2aa40b2880 msgr2=0x7f2aa40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.980+0000 7f2abe04a700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2aa40b2880 0x7f2aa40b4d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000b5c0 tx=0x7f2aa001a040 comp rx=0 tx=0).stop 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.980+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8103240 msgr2=0x7f2ab8199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.980+0000 7f2abe04a700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8103240 0x7f2ab8199860 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8007b50 tx=0x7f2aa8007e60 comp rx=0 tx=0).stop 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 shutdown_connections 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2aa40b2880 0x7f2aa40b4d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ab8104d10 0x7f2ab81a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ab8103240 0x7f2ab8199860 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 --2- 172.21.15.37:0/1583555500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ab8104370 0x7f2ab8199da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 >> 172.21.15.37:0/1583555500 conn(0x7f2ab80fe880 msgr2=0x7f2ab81075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 shutdown_connections 2024-05-09T01:01:08.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:08.981+0000 7f2abe04a700 1 -- 172.21.15.37:0/1583555500 wait complete. 2024-05-09T01:01:09.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-09T01:01:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:10.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:10 smithi037 ceph-mon[30122]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:10.298 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:10 smithi037 ceph-mon[30122]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:10 smithi136 ceph-mon[34110]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:10 smithi136 ceph-mon[34110]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:10 smithi151 ceph-mon[34780]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:10 smithi151 ceph-mon[34780]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 -- 172.21.15.37:0/2944489569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1018103f60 msgr2=0x7f1018104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 --2- 172.21.15.37:0/2944489569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1018103f60 0x7f1018104370 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1014009990 tx=0x7f1014009ca0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 -- 172.21.15.37:0/2944489569 shutdown_connections 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 --2- 172.21.15.37:0/2944489569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10181049e0 0x7f101810c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 --2- 172.21.15.37:0/2944489569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10181059b0 0x7f1018105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 --2- 172.21.15.37:0/2944489569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1018103f60 0x7f1018104370 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 -- 172.21.15.37:0/2944489569 >> 172.21.15.37:0/2944489569 conn(0x7f10180ff9d0 msgr2=0x7f1018101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 -- 172.21.15.37:0/2944489569 shutdown_connections 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.613+0000 7f10203ec700 1 -- 172.21.15.37:0/2944489569 wait complete. 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 Processor -- start 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 -- start start 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1018103f60 0x7f101819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181049e0 0x7f101819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10181059b0 0x7f10181a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f101810fef0 con 0x7f10181049e0 2024-05-09T01:01:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f101810fd70 con 0x7f1018103f60 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f10203ec700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1018110070 con 0x7f10181059b0 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f101d987700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181049e0 0x7f101819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f101d987700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181049e0 0x7f101819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60846/0 (socket says 172.21.15.37:60846) 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f101d987700 1 -- 172.21.15.37:0/991575316 learned_addr learned my addr 172.21.15.37:0/991575316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f101e188700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1018103f60 0x7f101819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.614+0000 7f101e989700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10181059b0 0x7f10181a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f101d987700 1 -- 172.21.15.37:0/991575316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10181059b0 msgr2=0x7f10181a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f101d987700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10181059b0 0x7f10181a1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f101d987700 1 -- 172.21.15.37:0/991575316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1018103f60 msgr2=0x7f101819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f101d987700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1018103f60 0x7f101819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f101d987700 1 -- 172.21.15.37:0/991575316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10181a2560 con 0x7f10181049e0 2024-05-09T01:01:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f101d987700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181049e0 0x7f101819af40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1014006010 tx=0x7f10140047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:11.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f100b7fe700 1 -- 172.21.15.37:0/991575316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1014027070 con 0x7f10181049e0 2024-05-09T01:01:11.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10181a27f0 con 0x7f10181049e0 2024-05-09T01:01:11.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f100b7fe700 1 -- 172.21.15.37:0/991575316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1014004000 con 0x7f10181049e0 2024-05-09T01:01:11.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f100b7fe700 1 -- 172.21.15.37:0/991575316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1014022d30 con 0x7f10181049e0 2024-05-09T01:01:11.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.615+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181a2c40 con 0x7f10181049e0 2024-05-09T01:01:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.616+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10180512c0 con 0x7f10181049e0 2024-05-09T01:01:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.618+0000 7f100b7fe700 1 -- 172.21.15.37:0/991575316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f101402a070 con 0x7f10181049e0 2024-05-09T01:01:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.618+0000 7f100b7fe700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10040b2880 0x7f10040b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.619+0000 7f101e188700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10040b2880 0x7f10040b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.619+0000 7f100b7fe700 1 -- 172.21.15.37:0/991575316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f10140e3230 con 0x7f10181049e0 2024-05-09T01:01:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.619+0000 7f101e188700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10040b2880 0x7f10040b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f10181053a0 tx=0x7f100c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:11.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.622+0000 7f100b7fe700 1 -- 172.21.15.37:0/991575316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1014013070 con 0x7f10181049e0 2024-05-09T01:01:11.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.846+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f101802e9b0 con 0x7f10040b2880 2024-05-09T01:01:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.852+0000 7f100b7fe700 1 -- 172.21.15.37:0/991575316 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f101802e9b0 con 0x7f10040b2880 2024-05-09T01:01:11.852 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-09T01:01:11.853 INFO:teuthology.orchestra.run.smithi037.stdout:mds.all 12/12 36s ago 3m smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-09T01:01:11.853 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 3/3 36s ago 8m smithi037=x;smithi136=y;smithi151=z;count:3 2024-05-09T01:01:11.853 INFO:teuthology.orchestra.run.smithi037.stdout:mon 3/3 36s ago 9m smithi037:172.21.15.37=a;smithi136:172.21.15.136=b;smithi151:172.21.15.151=c;count:3 2024-05-09T01:01:11.853 INFO:teuthology.orchestra.run.smithi037.stdout:osd 12 36s ago - 2024-05-09T01:01:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10040b2880 msgr2=0x7f10040b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10040b2880 0x7f10040b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f10181053a0 tx=0x7f100c00a380 comp rx=0 tx=0).stop 2024-05-09T01:01:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181049e0 msgr2=0x7f101819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181049e0 0x7f101819af40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1014006010 tx=0x7f10140047b0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 shutdown_connections 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10040b2880 0x7f10040b4d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10181059b0 0x7f10181a1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1018103f60 0x7f101819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 --2- 172.21.15.37:0/991575316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10181049e0 0x7f101819af40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 >> 172.21.15.37:0/991575316 conn(0x7f10180ff9d0 msgr2=0x7f10181086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 shutdown_connections 2024-05-09T01:01:11.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:11.854+0000 7f10203ec700 1 -- 172.21.15.37:0/991575316 wait complete. 2024-05-09T01:01:12.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:12 smithi037 ceph-mon[30122]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:12 smithi136 ceph-mon[34110]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:12 smithi151 ceph-mon[34780]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:12.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-09T01:01:12.980 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:13.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:13 smithi151 ceph-mon[34780]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:13.333 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:13 smithi037 ceph-mon[30122]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:13.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:13 smithi136 ceph-mon[34110]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:14.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:14 smithi037 ceph-mon[30122]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:14 smithi136 ceph-mon[34110]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:14.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:14 smithi151 ceph-mon[34780]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1548051250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc41049e0 msgr2=0x7f6fc410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1548051250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc41049e0 0x7f6fc410c6f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00b0a0 tx=0x7f6fbc00b3b0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1548051250 shutdown_connections 2024-05-09T01:01:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1548051250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc41049e0 0x7f6fc410c6f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1548051250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc41059b0 0x7f6fc4105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1548051250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6fc4103f60 0x7f6fc4104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1548051250 >> 172.21.15.37:0/1548051250 conn(0x7f6fc40ff9d0 msgr2=0x7f6fc4101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1548051250 shutdown_connections 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1548051250 wait complete. 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.693+0000 7f6fc9b25700 1 Processor -- start 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc9b25700 1 -- start start 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc9b25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc4103f60 0x7f6fc4078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc9b25700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6fc41049e0 0x7f6fc4076c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc9b25700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc41059b0 0x7f6fc4077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc9b25700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc410ff60 con 0x7f6fc4103f60 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc9b25700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc410fde0 con 0x7f6fc41049e0 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc9b25700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc41100e0 con 0x7f6fc41059b0 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc4103f60 0x7f6fc4078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc4103f60 0x7f6fc4078570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60856/0 (socket says 172.21.15.37:60856) 2024-05-09T01:01:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 -- 172.21.15.37:0/1664447165 learned_addr learned my addr 172.21.15.37:0/1664447165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc3fff700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc41059b0 0x7f6fc4077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc2ffd700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6fc41049e0 0x7f6fc4076c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 -- 172.21.15.37:0/1664447165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc41059b0 msgr2=0x7f6fc4077160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc41059b0 0x7f6fc4077160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 -- 172.21.15.37:0/1664447165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6fc41049e0 msgr2=0x7f6fc4076c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6fc41049e0 0x7f6fc4076c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.694+0000 7f6fc37fe700 1 -- 172.21.15.37:0/1664447165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc40778c0 con 0x7f6fc4103f60 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.695+0000 7f6fc37fe700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc4103f60 0x7f6fc4078570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c970 tx=0x7f6fb400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.695+0000 7f6fc0ff9700 1 -- 172.21.15.37:0/1664447165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4004220 con 0x7f6fc4103f60 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.695+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc41a4af0 con 0x7f6fc4103f60 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.695+0000 7f6fc0ff9700 1 -- 172.21.15.37:0/1664447165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fb4007db0 con 0x7f6fc4103f60 2024-05-09T01:01:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.695+0000 7f6fc0ff9700 1 -- 172.21.15.37:0/1664447165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb4003d00 con 0x7f6fc4103f60 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.695+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc41a4fd0 con 0x7f6fc4103f60 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.696+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc40512c0 con 0x7f6fc4103f60 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.698+0000 7f6fc0ff9700 1 -- 172.21.15.37:0/1664447165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6fb4007900 con 0x7f6fc4103f60 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.698+0000 7f6fc0ff9700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6fac0b2880 0x7f6fac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.698+0000 7f6fc2ffd700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6fac0b2880 0x7f6fac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.699+0000 7f6fc0ff9700 1 -- 172.21.15.37:0/1664447165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f6fb40e21e0 con 0x7f6fc4103f60 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.699+0000 7f6fc2ffd700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6fac0b2880 0x7f6fac0b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8006fd0 tx=0x7f6fb8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.702+0000 7f6fc0ff9700 1 -- 172.21.15.37:0/1664447165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6fb4014030 con 0x7f6fc4103f60 2024-05-09T01:01:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.923+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6fc402ea10 con 0x7f6fac0b2880 2024-05-09T01:01:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.924+0000 7f6fc0ff9700 1 -- 172.21.15.37:0/1664447165 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6fc402ea10 con 0x7f6fac0b2880 2024-05-09T01:01:14.925 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-05-09T01:01:14.925 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-05-09T01:01:14.925 INFO:teuthology.orchestra.run.smithi037.stdout:smithi136 172.21.15.136 2024-05-09T01:01:14.925 INFO:teuthology.orchestra.run.smithi037.stdout:smithi151 172.21.15.151 2024-05-09T01:01:14.926 INFO:teuthology.orchestra.run.smithi037.stdout:3 hosts in cluster 2024-05-09T01:01:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6fac0b2880 msgr2=0x7f6fac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6fac0b2880 0x7f6fac0b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8006fd0 tx=0x7f6fb8008040 comp rx=0 tx=0).stop 2024-05-09T01:01:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc4103f60 msgr2=0x7f6fc4078570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:14.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc4103f60 0x7f6fc4078570 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6fb400c970 tx=0x7f6fb400cd30 comp rx=0 tx=0).stop 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 shutdown_connections 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6fac0b2880 0x7f6fac0b4d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc41059b0 0x7f6fc4077160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fc4103f60 0x7f6fc4078570 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 --2- 172.21.15.37:0/1664447165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6fc41049e0 0x7f6fc4076c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 >> 172.21.15.37:0/1664447165 conn(0x7f6fc40ff9d0 msgr2=0x7f6fc41086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 shutdown_connections 2024-05-09T01:01:14.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:14.927+0000 7f6fc9b25700 1 -- 172.21.15.37:0/1664447165 wait complete. 2024-05-09T01:01:15.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-09T01:01:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:16.348 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:16 smithi037 ceph-mon[30122]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:16.349 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:16 smithi037 ceph-mon[30122]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:16 smithi136 ceph-mon[34110]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:16 smithi136 ceph-mon[34110]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:16 smithi151 ceph-mon[34780]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:16 smithi151 ceph-mon[34780]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 -- 172.21.15.37:0/491609748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290103260 msgr2=0x7fc290103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 --2- 172.21.15.37:0/491609748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290103260 0x7fc290103670 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc280009990 tx=0x7fc280009ca0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 -- 172.21.15.37:0/491609748 shutdown_connections 2024-05-09T01:01:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 --2- 172.21.15.37:0/491609748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc290104d30 0x7fc29010b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 --2- 172.21.15.37:0/491609748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290103260 0x7fc290103670 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 --2- 172.21.15.37:0/491609748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc290104390 0x7fc2901047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 -- 172.21.15.37:0/491609748 >> 172.21.15.37:0/491609748 conn(0x7fc2900fe8c0 msgr2=0x7fc290100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 -- 172.21.15.37:0/491609748 shutdown_connections 2024-05-09T01:01:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.690+0000 7fc294ce8700 1 -- 172.21.15.37:0/491609748 wait complete. 2024-05-09T01:01:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 Processor -- start 2024-05-09T01:01:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 -- start start 2024-05-09T01:01:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc290103260 0x7fc29019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290104390 0x7fc29019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc290104d30 0x7fc2901a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc29010ed00 con 0x7fc290104390 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc29010eb80 con 0x7fc290103260 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc29010ee80 con 0x7fc290104d30 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290104390 0x7fc29019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290104390 0x7fc29019aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60886/0 (socket says 172.21.15.37:60886) 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 -- 172.21.15.37:0/1546404165 learned_addr learned my addr 172.21.15.37:0/1546404165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc28ed9d700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc290104d30 0x7fc2901a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc28e59c700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc290103260 0x7fc29019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 -- 172.21.15.37:0/1546404165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc290104d30 msgr2=0x7fc2901a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc290104d30 0x7fc2901a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 -- 172.21.15.37:0/1546404165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc290103260 msgr2=0x7fc29019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc290103260 0x7fc29019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 -- 172.21.15.37:0/1546404165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2901a2440 con 0x7fc290104390 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc28ed9d700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc290104d30 0x7fc2901a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc28e59c700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc290103260 0x7fc29019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc287fff700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290104390 0x7fc29019aeb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c9b0 tx=0x7fc27800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc2877fe700 1 -- 172.21.15.37:0/1546404165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278007b00 con 0x7fc290104390 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2901a2730 con 0x7fc290104390 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc2877fe700 1 -- 172.21.15.37:0/1546404165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc278007ca0 con 0x7fc290104390 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc2877fe700 1 -- 172.21.15.37:0/1546404165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278018730 con 0x7fc290104390 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.692+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2901a2cc0 con 0x7fc290104390 2024-05-09T01:01:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.693+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2900512c0 con 0x7fc290104390 2024-05-09T01:01:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.694+0000 7fc2877fe700 1 -- 172.21.15.37:0/1546404165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc27800f450 con 0x7fc290104390 2024-05-09T01:01:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.695+0000 7fc2877fe700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc27c0b2880 0x7fc27c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.695+0000 7fc28e59c700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc27c0b2880 0x7fc27c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.695+0000 7fc2877fe700 1 -- 172.21.15.37:0/1546404165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc2780e2500 con 0x7fc290104390 2024-05-09T01:01:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.696+0000 7fc28e59c700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc27c0b2880 0x7fc27c0b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc280005b40 tx=0x7fc280005ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.699+0000 7fc2877fe700 1 -- 172.21.15.37:0/1546404165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc278014030 con 0x7fc290104390 2024-05-09T01:01:17.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.922+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc2901a2f80 con 0x7fc27c0b2880 2024-05-09T01:01:17.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.924+0000 7fc2877fe700 1 -- 172.21.15.37:0/1546404165 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc2901a2f80 con 0x7fc27c0b2880 2024-05-09T01:01:17.925 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-09T01:01:17.925 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-09T01:01:17.925 INFO:teuthology.orchestra.run.smithi037.stdout:smithi136 /dev/nvme0n1 ssd INTEL_SSDPEDMX020T4_CVPD514100122P0SGN 1863G No 4m ago Has a FileSystem, LVM detected 2024-05-09T01:01:17.925 INFO:teuthology.orchestra.run.smithi037.stdout:smithi151 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-09T01:01:17.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc27c0b2880 msgr2=0x7fc27c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:17.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc27c0b2880 0x7fc27c0b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc280005b40 tx=0x7fc280005ad0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290104390 msgr2=0x7fc29019aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290104390 0x7fc29019aeb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc27800c9b0 tx=0x7fc27800cd70 comp rx=0 tx=0).stop 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 shutdown_connections 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc27c0b2880 0x7fc27c0b4d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc290104d30 0x7fc2901a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.926+0000 7fc294ce8700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc290103260 0x7fc29019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.927+0000 7fc294ce8700 1 --2- 172.21.15.37:0/1546404165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc290104390 0x7fc29019aeb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.927+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 >> 172.21.15.37:0/1546404165 conn(0x7fc2900fe8c0 msgr2=0x7fc290100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.927+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 shutdown_connections 2024-05-09T01:01:17.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:17.927+0000 7fc294ce8700 1 -- 172.21.15.37:0/1546404165 wait complete. 2024-05-09T01:01:18.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:18 smithi037 ceph-mon[30122]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:18.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:18 smithi136 ceph-mon[34110]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:18.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:18 smithi151 ceph-mon[34780]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:18.734 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T01:01:18.744 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:01:18.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T01:01:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:19.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:19 smithi037 ceph-mon[30122]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:19.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:19 smithi136 ceph-mon[34110]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:19.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:19 smithi151 ceph-mon[34780]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T01:01:20.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:20 smithi037 ceph-mon[30122]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:20.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:20 smithi136 ceph-mon[34110]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:20 smithi151 ceph-mon[34780]: pgmap v371: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 -- 172.21.15.37:0/2327618290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510104370 msgr2=0x7fb510104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2327618290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510104370 0x7fb510104780 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009990 tx=0x7fb50c009ca0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 -- 172.21.15.37:0/2327618290 shutdown_connections 2024-05-09T01:01:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2327618290 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb510105e40 0x7fb51010c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2327618290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510104370 0x7fb510104780 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2327618290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5101054a0 0x7fb5101058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 -- 172.21.15.37:0/2327618290 >> 172.21.15.37:0/2327618290 conn(0x7fb5100ff9d0 msgr2=0x7fb510101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 -- 172.21.15.37:0/2327618290 shutdown_connections 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.718+0000 7fb517bd5700 1 -- 172.21.15.37:0/2327618290 wait complete. 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 Processor -- start 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 -- start start 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb510104370 0x7fb51019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5101054a0 0x7fb51019ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510105e40 0x7fb5101a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010fdc0 con 0x7fb510105e40 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010fc40 con 0x7fb510104370 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb517bd5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb51010ff40 con 0x7fb5101054a0 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb516172700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510105e40 0x7fb5101a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb516172700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510105e40 0x7fb5101a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60910/0 (socket says 172.21.15.37:60910) 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb516172700 1 -- 172.21.15.37:0/2690577408 learned_addr learned my addr 172.21.15.37:0/2690577408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb515170700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5101054a0 0x7fb51019ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.719+0000 7fb515971700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb510104370 0x7fb51019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb516172700 1 -- 172.21.15.37:0/2690577408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5101054a0 msgr2=0x7fb51019ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb516172700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5101054a0 0x7fb51019ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb516172700 1 -- 172.21.15.37:0/2690577408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb510104370 msgr2=0x7fb51019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb516172700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb510104370 0x7fb51019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb516172700 1 -- 172.21.15.37:0/2690577408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5101a2490 con 0x7fb510105e40 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb515971700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb510104370 0x7fb51019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb516172700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510105e40 0x7fb5101a1e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb50800ef30 tx=0x7fb50800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb506ffd700 1 -- 172.21.15.37:0/2690577408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5080092e0 con 0x7fb510105e40 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb506ffd700 1 -- 172.21.15.37:0/2690577408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb508004bb0 con 0x7fb510105e40 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5101a2720 con 0x7fb510105e40 2024-05-09T01:01:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb506ffd700 1 -- 172.21.15.37:0/2690577408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508004280 con 0x7fb510105e40 2024-05-09T01:01:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.720+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5101a2c10 con 0x7fb510105e40 2024-05-09T01:01:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.721+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5100512c0 con 0x7fb510105e40 2024-05-09T01:01:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.723+0000 7fb506ffd700 1 -- 172.21.15.37:0/2690577408 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb50801b030 con 0x7fb510105e40 2024-05-09T01:01:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.723+0000 7fb506ffd700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb4fc0b2880 0x7fb4fc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.723+0000 7fb515971700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb4fc0b2880 0x7fb4fc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.723+0000 7fb506ffd700 1 -- 172.21.15.37:0/2690577408 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb5080e26c0 con 0x7fb510105e40 2024-05-09T01:01:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.724+0000 7fb515971700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb4fc0b2880 0x7fb4fc0b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00b760 tx=0x7fb50c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:20.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.727+0000 7fb506ffd700 1 -- 172.21.15.37:0/2690577408 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb508022020 con 0x7fb510105e40 2024-05-09T01:01:20.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.986+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb5100643d0 con 0x7fb510105e40 2024-05-09T01:01:20.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.987+0000 7fb506ffd700 1 -- 172.21.15.37:0/2690577408 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3094 (secure 0 0 0) 0x7fb508010040 con 0x7fb510105e40 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout:e28 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-05-09T01:01:20.987 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 28 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-05-09T00:58:39.582936+0000 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-05-09T00:58:58.933698+0000 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 300 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-05-09T01:01:20.988 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 5 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:in 0,1,2,3,4 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24491,1=24467,2=24454,3=24446,4=24445} 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24491 members: 24467,24446,24445,24454,24491 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b{0:24491} state up:active seq 6 addr [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.989 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f{0:24439} state up:standby-replay seq 1 addr [v2:172.21.15.151:6834/1211505643,v1:172.21.15.151:6835/1211505643] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.h{1:24467} state up:active seq 13 addr [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.k{1:24425} state up:standby-replay seq 1 addr [v2:172.21.15.136:6832/3863179212,v1:172.21.15.136:6833/3863179212] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.i{2:24454} state up:active seq 12 addr [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.l{2:24400} state up:standby-replay seq 1 addr [v2:172.21.15.151:6832/1277029223,v1:172.21.15.151:6833/1277029223] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e{3:24446} state up:active seq 15 addr [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a{3:14559} state up:standby-replay seq 1 addr [v2:172.21.15.37:6840/828379246,v1:172.21.15.37:6841/828379246] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c{4:24445} state up:active seq 14 addr [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.g{4:14547} state up:standby-replay seq 1 addr [v2:172.21.15.37:6838/752211904,v1:172.21.15.37:6839/752211904] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:20.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:20.991 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-05-09T01:01:20.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:20.991 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.j{-1:14496} state up:standby seq 1 addr [v2:172.21.15.37:6834/2528930406,v1:172.21.15.37:6835/2528930406] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.991 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d{-1:14508} state up:standby seq 1 addr [v2:172.21.15.37:6836/1940552634,v1:172.21.15.37:6837/1940552634] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T01:01:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb4fc0b2880 msgr2=0x7fb4fc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb4fc0b2880 0x7fb4fc0b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb50c00b760 tx=0x7fb50c005fb0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510105e40 msgr2=0x7fb5101a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510105e40 0x7fb5101a1e10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb50800ef30 tx=0x7fb50800c3a0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 shutdown_connections 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb4fc0b2880 0x7fb4fc0b4d90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb510105e40 0x7fb5101a1e10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb510104370 0x7fb51019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 --2- 172.21.15.37:0/2690577408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5101054a0 0x7fb51019ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 >> 172.21.15.37:0/2690577408 conn(0x7fb5100ff9d0 msgr2=0x7fb5101086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 shutdown_connections 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:20.989+0000 7fb517bd5700 1 -- 172.21.15.37:0/2690577408 wait complete. 2024-05-09T01:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-09T01:01:21.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:21 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2690577408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T01:01:21.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:21 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2690577408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T01:01:21.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:21 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2690577408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T01:01:21.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-09T01:01:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:22.319 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:22 smithi037 ceph-mon[30122]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:22.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:22 smithi136 ceph-mon[34110]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:22.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:22 smithi151 ceph-mon[34780]: pgmap v372: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.508+0000 7f029bc67700 1 -- 172.21.15.37:0/2906757255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 msgr2=0x7f0294109960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.508+0000 7f029bc67700 1 --2- 172.21.15.37:0/2906757255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f0294109960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0284009990 tx=0x7f0284009ca0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.508+0000 7f029bc67700 1 -- 172.21.15.37:0/2906757255 shutdown_connections 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.508+0000 7f029bc67700 1 --2- 172.21.15.37:0/2906757255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0294109ff0 0x7f029410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.508+0000 7f029bc67700 1 --2- 172.21.15.37:0/2906757255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f029406c2d0 0x7f0294106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.508+0000 7f029bc67700 1 --2- 172.21.15.37:0/2906757255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f0294109960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.508+0000 7f029bc67700 1 -- 172.21.15.37:0/2906757255 >> 172.21.15.37:0/2906757255 conn(0x7f02940fe880 msgr2=0x7f0294100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.509+0000 7f029bc67700 1 -- 172.21.15.37:0/2906757255 shutdown_connections 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.509+0000 7f029bc67700 1 -- 172.21.15.37:0/2906757255 wait complete. 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.509+0000 7f029bc67700 1 Processor -- start 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.509+0000 7f029bc67700 1 -- start start 2024-05-09T01:01:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029bc67700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029406c2d0 0x7f029419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029bc67700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f029419ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029bc67700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0294109ff0 0x7f02941a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029bc67700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f029410fdd0 con 0x7f0294107480 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029bc67700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f029410fc50 con 0x7f029406c2d0 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029bc67700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f029410ff50 con 0x7f0294109ff0 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f029419ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f029419ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43652/0 (socket says 172.21.15.37:43652) 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 -- 172.21.15.37:0/4166567956 learned_addr learned my addr 172.21.15.37:0/4166567956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299a03700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029406c2d0 0x7f029419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029a204700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0294109ff0 0x7f02941a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 -- 172.21.15.37:0/4166567956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0294109ff0 msgr2=0x7f02941a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0294109ff0 0x7f02941a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 -- 172.21.15.37:0/4166567956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029406c2d0 msgr2=0x7f029419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029406c2d0 0x7f029419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 -- 172.21.15.37:0/4166567956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02941a2480 con 0x7f0294107480 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299a03700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029406c2d0 0x7f029419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f0299202700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f029419ae60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f028400b760 tx=0x7f0284004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f028affd700 1 -- 172.21.15.37:0/4166567956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028400fc40 con 0x7f0294107480 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f028affd700 1 -- 172.21.15.37:0/4166567956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f028400fde0 con 0x7f0294107480 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02941a2710 con 0x7f0294107480 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.510+0000 7f028affd700 1 -- 172.21.15.37:0/4166567956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02840173f0 con 0x7f0294107480 2024-05-09T01:01:23.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.511+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02941a2b60 con 0x7f0294107480 2024-05-09T01:01:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.512+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02940512c0 con 0x7f0294107480 2024-05-09T01:01:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.513+0000 7f028affd700 1 -- 172.21.15.37:0/4166567956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0284028060 con 0x7f0294107480 2024-05-09T01:01:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.514+0000 7f028affd700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f02800b2900 0x7f02800b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.514+0000 7f0299a03700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f02800b2900 0x7f02800b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.514+0000 7f028affd700 1 -- 172.21.15.37:0/4166567956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f02840e30b0 con 0x7f0294107480 2024-05-09T01:01:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.514+0000 7f0299a03700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f02800b2900 0x7f02800b4e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0290009cb0 tx=0x7f0290009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:23.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.519+0000 7f028affd700 1 -- 172.21.15.37:0/4166567956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0284013070 con 0x7f0294107480 2024-05-09T01:01:23.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.734+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f02940643d0 con 0x7f0294107480 2024-05-09T01:01:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.735+0000 7f028affd700 1 -- 172.21.15.37:0/4166567956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) ==== 56+0+5223 (secure 0 0 0) 0x7f02840aae60 con 0x7f0294107480 2024-05-09T01:01:23.735 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 81 2024-05-09T01:01:23.735 INFO:teuthology.orchestra.run.smithi037.stdout:fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-05-09T00:50:23.248208+0000 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-05-09T00:59:20.069520+0000 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 26 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client luminous 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-09T01:01:23.736 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 8 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/3555372504,v1:172.21.15.37:6803/3555372504] [v2:172.21.15.37:6804/3555372504,v1:172.21.15.37:6805/3555372504] exists,up 25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 13 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/368492738,v1:172.21.15.136:6801/368492738] [v2:172.21.15.136:6802/368492738,v1:172.21.15.136:6803/368492738] exists,up 95653797-b846-453e-8884-1f30a924c060 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 18 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/373949032,v1:172.21.15.151:6801/373949032] [v2:172.21.15.151:6802/373949032,v1:172.21.15.151:6803/373949032] exists,up 39dfb29d-97a5-43c3-b38c-72d80c4f6a3d 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 25 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/1053835571,v1:172.21.15.37:6811/1053835571] [v2:172.21.15.37:6812/1053835571,v1:172.21.15.37:6813/1053835571] exists,up 9b9c00e5-3ca7-4e87-9977-a03a58a8d469 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 31 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6808/4131324959,v1:172.21.15.136:6809/4131324959] [v2:172.21.15.136:6810/4131324959,v1:172.21.15.136:6811/4131324959] exists,up 4e49af9f-a958-439e-8a9a-a1e4a4f0417b 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 36 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6808/1854577417,v1:172.21.15.151:6809/1854577417] [v2:172.21.15.151:6810/1854577417,v1:172.21.15.151:6811/1854577417] exists,up dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 42 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/545144898,v1:172.21.15.37:6819/545144898] [v2:172.21.15.37:6820/545144898,v1:172.21.15.37:6821/545144898] exists,up 658cbbc1-8426-41a3-81f2-604aad93fc5c 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 47 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6816/3759016475,v1:172.21.15.136:6817/3759016475] [v2:172.21.15.136:6818/3759016475,v1:172.21.15.136:6819/3759016475] exists,up a968a66d-5c3c-45eb-ba5b-40014fd1e831 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 54 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6816/4201522027,v1:172.21.15.151:6817/4201522027] [v2:172.21.15.151:6818/4201522027,v1:172.21.15.151:6819/4201522027] exists,up 4beeb243-ed25-40a3-9aac-04a7d79e74d5 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 60 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/479009325,v1:172.21.15.37:6827/479009325] [v2:172.21.15.37:6828/479009325,v1:172.21.15.37:6829/479009325] exists,up 6b819cc6-32b0-4abb-80a3-cd74996b94ca 2024-05-09T01:01:23.737 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 65 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6824/2664303650,v1:172.21.15.136:6825/2664303650] [v2:172.21.15.136:6826/2664303650,v1:172.21.15.136:6827/2664303650] exists,up 38839342-1039-4594-aa73-8ed002d99e65 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 71 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6824/443816849,v1:172.21.15.151:6825/443816849] [v2:172.21.15.151:6826/443816849,v1:172.21.15.151:6827/443816849] exists,up b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.a [2,11] 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.10 [8,11] 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.1 [4,9] 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.11 [5,9] 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.13 [4,9] 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.1b [4,8] 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1655313927 expires 2024-05-10T00:51:18.788676+0000 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1149890534 expires 2024-05-10T00:51:18.788676+0000 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/1416845590 expires 2024-05-10T00:50:51.377266+0000 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/1512065281 expires 2024-05-10T00:51:18.788676+0000 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/1416845590 expires 2024-05-10T00:50:51.377266+0000 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/722560957 expires 2024-05-10T00:50:51.377266+0000 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/613766853 expires 2024-05-10T00:50:51.377266+0000 2024-05-09T01:01:23.738 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/791077362 expires 2024-05-10T00:51:18.788676+0000 2024-05-09T01:01:23.739 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/1512065281 expires 2024-05-10T00:51:18.788676+0000 2024-05-09T01:01:23.739 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2410271980 expires 2024-05-10T00:50:51.377266+0000 2024-05-09T01:01:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f02800b2900 msgr2=0x7f02800b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f02800b2900 0x7f02800b4e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0290009cb0 tx=0x7f0290009260 comp rx=0 tx=0).stop 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 msgr2=0x7f029419ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f029419ae60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f028400b760 tx=0x7f0284004790 comp rx=0 tx=0).stop 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 shutdown_connections 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f02800b2900 0x7f02800b4e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0294109ff0 0x7f02941a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029406c2d0 0x7f029419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 --2- 172.21.15.37:0/4166567956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0294107480 0x7f029419ae60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 >> 172.21.15.37:0/4166567956 conn(0x7f02940fe880 msgr2=0x7f0294105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 shutdown_connections 2024-05-09T01:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:23.739+0000 7f029bc67700 1 -- 172.21.15.37:0/4166567956 wait complete. 2024-05-09T01:01:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:24 smithi136 ceph-mon[34110]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:24 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/4166567956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T01:01:24.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:24 smithi037 ceph-mon[30122]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:24.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:24 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/4166567956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T01:01:24.459 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-09T01:01:24.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:01:24.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:24 smithi151 ceph-mon[34780]: pgmap v373: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:24.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:24 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/4166567956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T01:01:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:26.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:26 smithi037 ceph-mon[30122]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:26.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:26 smithi136 ceph-mon[34110]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:26.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:26 smithi151 ceph-mon[34780]: pgmap v374: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 -- 172.21.15.37:0/4008327461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0108200 msgr2=0x7f8cf0108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 --2- 172.21.15.37:0/4008327461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0108200 0x7f8cf0108610 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009990 tx=0x7f8ce0009ca0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 -- 172.21.15.37:0/4008327461 shutdown_connections 2024-05-09T01:01:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 --2- 172.21.15.37:0/4008327461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf01042b0 0x7f8cf0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 --2- 172.21.15.37:0/4008327461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0108200 0x7f8cf0108610 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 --2- 172.21.15.37:0/4008327461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cf0103960 0x7f8cf0103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 -- 172.21.15.37:0/4008327461 >> 172.21.15.37:0/4008327461 conn(0x7f8cf00fe4e0 msgr2=0x7f8cf0100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 -- 172.21.15.37:0/4008327461 shutdown_connections 2024-05-09T01:01:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.481+0000 7f8cf654d700 1 -- 172.21.15.37:0/4008327461 wait complete. 2024-05-09T01:01:26.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 Processor -- start 2024-05-09T01:01:26.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 -- start start 2024-05-09T01:01:26.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0103960 0x7f8cf019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cf01042b0 0x7f8cf019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf0108200 0x7f8cf019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf0113370 con 0x7f8cf0103960 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf01131f0 con 0x7f8cf0108200 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf654d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf01134f0 con 0x7f8cf01042b0 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0103960 0x7f8cf019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8ceffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0103960 0x7f8cf019adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43676/0 (socket says 172.21.15.37:43676) 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8ceffff700 1 -- 172.21.15.37:0/3408618999 learned_addr learned my addr 172.21.15.37:0/3408618999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cef7fe700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cf01042b0 0x7f8cf019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.482+0000 7f8cf4aea700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf0108200 0x7f8cf019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ceffff700 1 -- 172.21.15.37:0/3408618999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cf01042b0 msgr2=0x7f8cf019b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ceffff700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cf01042b0 0x7f8cf019b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ceffff700 1 -- 172.21.15.37:0/3408618999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf0108200 msgr2=0x7f8cf019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ceffff700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf0108200 0x7f8cf019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ceffff700 1 -- 172.21.15.37:0/3408618999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf019fcc0 con 0x7f8cf0103960 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8cf4aea700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf0108200 0x7f8cf019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8cef7fe700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cf01042b0 0x7f8cf019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ceffff700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0103960 0x7f8cf019adf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0006010 tx=0x7f8ce0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ced7fa700 1 -- 172.21.15.37:0/3408618999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0027070 con 0x7f8cf0103960 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf019ff50 con 0x7f8cf0103960 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ced7fa700 1 -- 172.21.15.37:0/3408618999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce0003fe0 con 0x7f8cf0103960 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8ced7fa700 1 -- 172.21.15.37:0/3408618999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0022c40 con 0x7f8cf0103960 2024-05-09T01:01:26.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.483+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf01a78d0 con 0x7f8cf0103960 2024-05-09T01:01:26.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.484+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf0104b80 con 0x7f8cf0103960 2024-05-09T01:01:26.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.486+0000 7f8ced7fa700 1 -- 172.21.15.37:0/3408618999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8ce002a070 con 0x7f8cf0103960 2024-05-09T01:01:26.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.486+0000 7f8ced7fa700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8cd80b2880 0x7f8cd80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:26.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.487+0000 7f8cef7fe700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8cd80b2880 0x7f8cd80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:26.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.487+0000 7f8ced7fa700 1 -- 172.21.15.37:0/3408618999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8ce0022e00 con 0x7f8cf0103960 2024-05-09T01:01:26.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.487+0000 7f8cef7fe700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8cd80b2880 0x7f8cd80b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4005fd0 tx=0x7f8ce4005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:26.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.490+0000 7f8ced7fa700 1 -- 172.21.15.37:0/3408618999 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ce0013070 con 0x7f8cf0103960 2024-05-09T01:01:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.752+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cf019c150 con 0x7f8cf0103960 2024-05-09T01:01:26.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.753+0000 7f8ced7fa700 1 -- 172.21.15.37:0/3408618999 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f8ce0004190 con 0x7f8cf0103960 2024-05-09T01:01:26.754 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:26.754 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T00:58:58.933698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:01:26.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.755+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8cd80b2880 msgr2=0x7f8cd80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.755+0000 7f8cf654d700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8cd80b2880 0x7f8cd80b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4005fd0 tx=0x7f8ce4005f60 comp rx=0 tx=0).stop 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.755+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0103960 msgr2=0x7f8cf019adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.755+0000 7f8cf654d700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0103960 0x7f8cf019adf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0006010 tx=0x7f8ce0005ef0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 shutdown_connections 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8cd80b2880 0x7f8cd80b4d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cf0108200 0x7f8cf019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0103960 0x7f8cf019adf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 --2- 172.21.15.37:0/3408618999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cf01042b0 0x7f8cf019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 >> 172.21.15.37:0/3408618999 conn(0x7f8cf00fe4e0 msgr2=0x7f8cf0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 shutdown_connections 2024-05-09T01:01:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:26.756+0000 7f8cf654d700 1 -- 172.21.15.37:0/3408618999 wait complete. 2024-05-09T01:01:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-09T01:01:27.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:27 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3408618999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:27.442 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:27 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3408618999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:27.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:01:27.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:27 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3408618999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:28.153 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:28 smithi037 ceph-mon[30122]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:28 smithi136 ceph-mon[34110]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:28.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:28 smithi151 ceph-mon[34780]: pgmap v375: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 -- 172.21.15.37:0/319412509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 msgr2=0x7f69f81111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/319412509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f81111c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f69f000b0d0 tx=0x7f69f000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 -- 172.21.15.37:0/319412509 shutdown_connections 2024-05-09T01:01:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/319412509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f81111c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/319412509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f81045e0 0x7f69f81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/319412509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8108f10 0x7f69f8109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 -- 172.21.15.37:0/319412509 >> 172.21.15.37:0/319412509 conn(0x7f69f80ffef0 msgr2=0x7f69f8102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 -- 172.21.15.37:0/319412509 shutdown_connections 2024-05-09T01:01:29.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.444+0000 7f69ff5b4700 1 -- 172.21.15.37:0/319412509 wait complete. 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 Processor -- start 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 -- start start 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f81045e0 0x7f69f819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8108f10 0x7f69f819b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8114490 con 0x7f69f8109860 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8114310 con 0x7f69f81045e0 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69ff5b4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8114610 con 0x7f69f8108f10 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69fdb51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69fdb51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f819f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43686/0 (socket says 172.21.15.37:43686) 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69fdb51700 1 -- 172.21.15.37:0/1194169093 learned_addr learned my addr 172.21.15.37:0/1194169093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69fd350700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f81045e0 0x7f69f819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:29.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.445+0000 7f69fcb4f700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8108f10 0x7f69f819b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69fdb51700 1 -- 172.21.15.37:0/1194169093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8108f10 msgr2=0x7f69f819b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69fdb51700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8108f10 0x7f69f819b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69fdb51700 1 -- 172.21.15.37:0/1194169093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f81045e0 msgr2=0x7f69f819ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69fdb51700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f81045e0 0x7f69f819ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69fdb51700 1 -- 172.21.15.37:0/1194169093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f819fc70 con 0x7f69f8109860 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69fdb51700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f819f5d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009850 tx=0x7f69f0007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1194169093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f001f070 con 0x7f69f8109860 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f819ff00 con 0x7f69f8109860 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1194169093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69f0004c50 con 0x7f69f8109860 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1194169093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f001b690 con 0x7f69f8109860 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.446+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f81a03e0 con 0x7f69f8109860 2024-05-09T01:01:29.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.447+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f80512c0 con 0x7f69f8109860 2024-05-09T01:01:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.449+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1194169093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f69f0022070 con 0x7f69f8109860 2024-05-09T01:01:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.449+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69e40b2880 0x7f69e40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.450+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1194169093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f69f000f020 con 0x7f69f8109860 2024-05-09T01:01:29.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.450+0000 7f69fd350700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69e40b2880 0x7f69e40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:29.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.450+0000 7f69fd350700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69e40b2880 0x7f69e40b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69f4007be0 tx=0x7f69f40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:29.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.453+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1194169093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f69f0029020 con 0x7f69f8109860 2024-05-09T01:01:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.714+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69f819c100 con 0x7f69f8109860 2024-05-09T01:01:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.715+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1194169093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11936 (secure 0 0 0) 0x7f69f00ab4b0 con 0x7f69f8109860 2024-05-09T01:01:29.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:29.716 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T00:58:58.933698+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:01:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69e40b2880 msgr2=0x7f69e40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69e40b2880 0x7f69e40b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69f4007be0 tx=0x7f69f40073d0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 msgr2=0x7f69f819f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:29.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f819f5d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009850 tx=0x7f69f0007a20 comp rx=0 tx=0).stop 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 shutdown_connections 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69e40b2880 0x7f69e40b4d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f8109860 0x7f69f819f5d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f81045e0 0x7f69f819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 --2- 172.21.15.37:0/1194169093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8108f10 0x7f69f819b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 >> 172.21.15.37:0/1194169093 conn(0x7f69f80ffef0 msgr2=0x7f69f8108680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 shutdown_connections 2024-05-09T01:01:29.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:29.718+0000 7f69ff5b4700 1 -- 172.21.15.37:0/1194169093 wait complete. 2024-05-09T01:01:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-09T01:01:30.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:30 smithi037 ceph-mon[30122]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:30.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:30 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1194169093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:30 smithi136 ceph-mon[34110]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:30 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1194169093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:30.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T01:01:30.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:30 smithi151 ceph-mon[34780]: pgmap v376: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:30.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:30 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1194169093' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:30.643 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:32.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:32 smithi037 ceph-mon[30122]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 -- 172.21.15.37:0/278752423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 msgr2=0x7fe0581111e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/278752423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe0581111e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe05000b0d0 tx=0x7fe05000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 -- 172.21.15.37:0/278752423 shutdown_connections 2024-05-09T01:01:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/278752423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe0581111e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/278752423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058104650 0x7fe058104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/278752423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe058108f30 0x7fe058109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 -- 172.21.15.37:0/278752423 >> 172.21.15.37:0/278752423 conn(0x7fe058079f00 msgr2=0x7fe05807a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:32.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 -- 172.21.15.37:0/278752423 shutdown_connections 2024-05-09T01:01:32.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.293+0000 7fe05e8ae700 1 -- 172.21.15.37:0/278752423 wait complete. 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.294+0000 7fe05e8ae700 1 Processor -- start 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.294+0000 7fe05e8ae700 1 -- start start 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.294+0000 7fe05e8ae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058104650 0x7fe058075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.294+0000 7fe05e8ae700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe058108f30 0x7fe058076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.294+0000 7fe05e8ae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe058076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05e8ae700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0581144b0 con 0x7fe058109880 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05e8ae700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe058114330 con 0x7fe058108f30 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05e8ae700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe058114630 con 0x7fe058104650 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe058076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe058076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54110/0 (socket says 172.21.15.37:54110) 2024-05-09T01:01:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 -- 172.21.15.37:0/2701800605 learned_addr learned my addr 172.21.15.37:0/2701800605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe057fff700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058104650 0x7fe058075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe0577fe700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe058108f30 0x7fe058076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 -- 172.21.15.37:0/2701800605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058104650 msgr2=0x7fe058075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058104650 0x7fe058075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 -- 172.21.15.37:0/2701800605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe058108f30 msgr2=0x7fe058076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe058108f30 0x7fe058076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 -- 172.21.15.37:0/2701800605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0581a9160 con 0x7fe058109880 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe0577fe700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe058108f30 0x7fe058076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05ce4b700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe058076540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe050009850 tx=0x7fe050007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe0557fa700 1 -- 172.21.15.37:0/2701800605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05001f070 con 0x7fe058109880 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe0557fa700 1 -- 172.21.15.37:0/2701800605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe050004c50 con 0x7fe058109880 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0581a93f0 con 0x7fe058109880 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.295+0000 7fe0557fa700 1 -- 172.21.15.37:0/2701800605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05001b7b0 con 0x7fe058109880 2024-05-09T01:01:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.296+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0581a9840 con 0x7fe058109880 2024-05-09T01:01:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.297+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0580512c0 con 0x7fe058109880 2024-05-09T01:01:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.298+0000 7fe0557fa700 1 -- 172.21.15.37:0/2701800605 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe050022070 con 0x7fe058109880 2024-05-09T01:01:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.299+0000 7fe0557fa700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0440b2880 0x7fe0440b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.299+0000 7fe057fff700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0440b2880 0x7fe0440b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.299+0000 7fe0557fa700 1 -- 172.21.15.37:0/2701800605 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe05000f020 con 0x7fe058109880 2024-05-09T01:01:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.299+0000 7fe057fff700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0440b2880 0x7fe0440b4d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe048009c60 tx=0x7fe048009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:32.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.304+0000 7fe0557fa700 1 -- 172.21.15.37:0/2701800605 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe050029020 con 0x7fe058109880 2024-05-09T01:01:32.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:32 smithi136 ceph-mon[34110]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:32 smithi151 ceph-mon[34780]: pgmap v377: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.522+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe05802e5f0 con 0x7fe058109880 2024-05-09T01:01:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.524+0000 7fe0557fa700 1 -- 172.21.15.37:0/2701800605 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7fe050009cb0 con 0x7fe058109880 2024-05-09T01:01:32.525 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:32.526 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0440b2880 msgr2=0x7fe0440b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0440b2880 0x7fe0440b4d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe048009c60 tx=0x7fe048009260 comp rx=0 tx=0).stop 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 msgr2=0x7fe058076540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe058076540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe050009850 tx=0x7fe050007a20 comp rx=0 tx=0).stop 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 shutdown_connections 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0440b2880 0x7fe0440b4d90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe058109880 0x7fe058076540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058104650 0x7fe058075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 --2- 172.21.15.37:0/2701800605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe058108f30 0x7fe058076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 >> 172.21.15.37:0/2701800605 conn(0x7fe058079f00 msgr2=0x7fe058102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 shutdown_connections 2024-05-09T01:01:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:32.527+0000 7fe05e8ae700 1 -- 172.21.15.37:0/2701800605 wait complete. 2024-05-09T01:01:33.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-09T00:58:39.582936+0000', 'modified': '2024-05-09T00:58:58.933698+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24491, 'mds_1': 24467, 'mds_2': 24454, 'mds_3': 24446, 'mds_4': 24445}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14547': {'gid': 14547, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/752211904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 752211904}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 752211904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14559': {'gid': 14559, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/828379246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 828379246}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 828379246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24400': {'gid': 24400, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6833/1277029223', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1277029223}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 1277029223}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24425': {'gid': 24425, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6833/3863179212', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 3863179212}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 3863179212}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24439': {'gid': 24439, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6835/1211505643', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 1211505643}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 1211505643}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'c', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.151:6837/980204664', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 980204664}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 980204664}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.136:6835/3966539810', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 3966539810}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 3966539810}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.151:6839/1727507509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 1727507509}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 1727507509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.136:6837/2054090484', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2054090484}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2054090484}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24491': {'gid': 24491, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.136:6839/336490852', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 336490852}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 336490852}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24491, 'qdb_cluster': [24467, 24446, 24445, 24454, 24491]} 2024-05-09T01:01:33.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-09T01:01:33.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.c status 2024-05-09T01:01:33.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:33 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2701800605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:01:33.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:33 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2701800605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:01:33.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:33 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2701800605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:01:33.493 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:34.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:34 smithi037 ceph-mon[30122]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:34.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:34 smithi136 ceph-mon[34110]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:34.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:34 smithi151 ceph-mon[34780]: pgmap v378: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 -- 172.21.15.37:0/3059569318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f4103310 msgr2=0x7fe2f410f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 --2- 172.21.15.37:0/3059569318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f4103310 0x7fe2f410f890 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c210 tx=0x7fe2ec00c520 comp rx=0 tx=0).stop 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 -- 172.21.15.37:0/3059569318 shutdown_connections 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 --2- 172.21.15.37:0/3059569318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f4103310 0x7fe2f410f890 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 --2- 172.21.15.37:0/3059569318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f41089f0 0x7fe2f4108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 --2- 172.21.15.37:0/3059569318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f41029c0 0x7fe2f4102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 -- 172.21.15.37:0/3059569318 >> 172.21.15.37:0/3059569318 conn(0x7fe2f40fe4e0 msgr2=0x7fe2f4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 -- 172.21.15.37:0/3059569318 shutdown_connections 2024-05-09T01:01:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.237+0000 7fe2fb567700 1 -- 172.21.15.37:0/3059569318 wait complete. 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.238+0000 7fe2fb567700 1 Processor -- start 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.238+0000 7fe2fb567700 1 -- start start 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2fb567700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f41029c0 0x7fe2f4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2fb567700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f4103310 0x7fe2f4198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2fb567700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f41089f0 0x7fe2f41994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2fb567700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f41122f0 con 0x7fe2f41089f0 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2fb567700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f4112170 con 0x7fe2f41029c0 2024-05-09T01:01:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2fb567700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f4112470 con 0x7fe2f4103310 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f41089f0 0x7fe2f41994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f41089f0 0x7fe2f41994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54122/0 (socket says 172.21.15.37:54122) 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 -- 172.21.15.37:0/2230402526 learned_addr learned my addr 172.21.15.37:0/2230402526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9303700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f41029c0 0x7fe2f4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f4103310 0x7fe2f4198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 -- 172.21.15.37:0/2230402526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f4103310 msgr2=0x7fe2f4198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f4103310 0x7fe2f4198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 -- 172.21.15.37:0/2230402526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f41029c0 msgr2=0x7fe2f4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f41029c0 0x7fe2f4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f9b04700 1 -- 172.21.15.37:0/2230402526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f41a91f0 con 0x7fe2f41089f0 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.239+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f4103310 0x7fe2f4198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.240+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f41089f0 0x7fe2f41994f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00a720 tx=0x7fe2ec00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.240+0000 7fe2ea7fc700 1 -- 172.21.15.37:0/2230402526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec022020 con 0x7fe2f41089f0 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.240+0000 7fe2ea7fc700 1 -- 172.21.15.37:0/2230402526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2ec008c90 con 0x7fe2f41089f0 2024-05-09T01:01:35.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.240+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f41a9480 con 0x7fe2f41089f0 2024-05-09T01:01:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.240+0000 7fe2ea7fc700 1 -- 172.21.15.37:0/2230402526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0052a0 con 0x7fe2f41089f0 2024-05-09T01:01:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.240+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f41a9930 con 0x7fe2f41089f0 2024-05-09T01:01:35.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.243+0000 7fe2ea7fc700 1 -- 172.21.15.37:0/2230402526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe2ec025020 con 0x7fe2f41089f0 2024-05-09T01:01:35.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.243+0000 7fe2ea7fc700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2e00b2900 0x7fe2e00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.244+0000 7fe2f9303700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2e00b2900 0x7fe2e00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.244+0000 7fe2ea7fc700 1 -- 172.21.15.37:0/2230402526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe2ec010020 con 0x7fe2f41089f0 2024-05-09T01:01:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.244+0000 7fe2f9303700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2e00b2900 0x7fe2e00b4e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0005950 tx=0x7fe2f000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.244+0000 7fe309f7db80 1 Processor -- start 2024-05-09T01:01:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.244+0000 7fe309f7db80 1 -- start start 2024-05-09T01:01:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd02f0cb0 0x561fd03f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd03f9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd03f33b0 0x561fd03f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe309f7db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561fd0316050 con 0x561fd03f33b0 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe309f7db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561fd02bb950 con 0x561fd02f0cb0 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe309f7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561fd0312010 con 0x561fd0276450 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd03f33b0 0x561fd03f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd03f33b0 0x561fd03f37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54130/0 (socket says 172.21.15.37:54130) 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 -- 172.21.15.37:0/3143867216 learned_addr learned my addr 172.21.15.37:0/3143867216 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9303700 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd02f0cb0 0x561fd03f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd03f9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 -- 172.21.15.37:0/3143867216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 msgr2=0x561fd03f9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd03f9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 -- 172.21.15.37:0/3143867216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd02f0cb0 msgr2=0x561fd03f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd02f0cb0 0x561fd03f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 -- 172.21.15.37:0/3143867216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd02ac4b0 con 0x561fd03f33b0 2024-05-09T01:01:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9303700 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd02f0cb0 0x561fd03f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:01:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.245+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd03f33b0 0x561fd03f37c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0aa9e0 tx=0x7fe2ec01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba3236ab84acb97 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.246+0000 7fe2df7fe700 1 -- 172.21.15.37:0/3143867216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0a6040 con 0x561fd03f33b0 2024-05-09T01:01:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.246+0000 7fe2df7fe700 1 -- 172.21.15.37:0/3143867216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2ec0b3170 con 0x561fd03f33b0 2024-05-09T01:01:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.246+0000 7fe2df7fe700 1 -- 172.21.15.37:0/3143867216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0aacb0 con 0x561fd03f33b0 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.246+0000 7fe309f7db80 1 -- 172.21.15.37:0/3143867216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd03f33b0 msgr2=0x561fd03f37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.246+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd03f33b0 0x561fd03f37c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0aa9e0 tx=0x7fe2ec01ecf0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 -- 172.21.15.37:0/3143867216 shutdown_connections 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd03f33b0 0x561fd03f37c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd02f0cb0 0x561fd03f91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3143867216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd03f9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 -- 172.21.15.37:0/3143867216 >> 172.21.15.37:0/3143867216 conn(0x561fd0279f20 msgr2=0x561fd03ee1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 -- 172.21.15.37:0/3143867216 shutdown_connections 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 -- 172.21.15.37:0/3143867216 wait complete. 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 -- start start 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.247+0000 7fe309f7db80 1 Processor -- start 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd0276450 0x561fd0402a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0402f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd03f33b0 0x561fd03fce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561fd0316050 con 0x561fd02f0cb0 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561fd02b0ad0 con 0x561fd0276450 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561fd03f3f60 con 0x561fd03f33b0 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 10 client.0 _ll_register_callbacks cb 0x561fd0187670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0402f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0402f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54140/0 (socket says 172.21.15.37:54140) 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 -- 172.21.15.37:0/2995406541 learned_addr learned my addr 172.21.15.37:0/2995406541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd03f33b0 0x561fd03fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f9303700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd0276450 0x561fd0402a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 -- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd03f33b0 msgr2=0x561fd03fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd03f33b0 0x561fd03fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 -- 172.21.15.37:0/2995406541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd0276450 msgr2=0x561fd0402a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd0276450 0x561fd0402a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 -- 172.21.15.37:0/2995406541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd0191440 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f9303700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd0276450 0x561fd0402a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0402f90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400bad0 tx=0x7fe2e400bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48ae717a46b8fdb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2dcff9700 1 -- 172.21.15.37:0/2995406541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e401b640 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe2dcff9700 1 -- 172.21.15.37:0/2995406541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe2e4011440 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.248+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ec0b3170 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe2dcff9700 1 -- 172.21.15.37:0/2995406541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2e4003e40 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 10 client.15063 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561fd040a6d0 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe2dcff9700 1 -- 172.21.15.37:0/2995406541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2ec0b3170 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe2dcff9700 1 -- 172.21.15.37:0/2995406541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe2e4019020 con 0x561fd02f0cb0 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 10 client.15063 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 10 client.15063 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 20 client.15063 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd040cd00 0x561fd040e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 4 client.15063 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:01:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.249+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fd0323a30 con 0x561fd040cd00 2024-05-09T01:01:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.250+0000 7fe2f9303700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd040cd00 0x561fd040e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.250+0000 7fe2f9303700 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd040cd00 0x561fd040e170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=27d3caa7e3ed38b7 server_cookie=14c17222fd533e0f in_seq=0 out_seq=0 2024-05-09T01:01:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.250+0000 7fe2dcff9700 10 client.15063 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe2dcff9700 1 -- 172.21.15.37:0/2995406541 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561fd0323a30 con 0x561fd040cd00 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe2dcff9700 10 client.15063 handle_command_reply: tid=0 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 client.15063 shutdown 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 msgr2=0x561fd0402f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0402f90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400bad0 tx=0x7fe2e400bde0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 shutdown_connections 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd040cd00 0x561fd040e170 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd03f33b0 0x561fd03fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd0276450 0x561fd0402a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 --2- 172.21.15.37:0/2995406541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0402f90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 >> 172.21.15.37:0/2995406541 conn(0x561fd0279f20 msgr2=0x561fd03e7fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe2dcff9700 0 client.15063 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:01:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 shutdown_connections 2024-05-09T01:01:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.251+0000 7fe309f7db80 1 -- 172.21.15.37:0/2995406541 wait complete. 2024-05-09T01:01:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.252+0000 7fe309f7db80 20 client.15063 trim_cache size 0 max 16384 2024-05-09T01:01:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.273+0000 7fe309f7db80 1 Processor -- start 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.273+0000 7fe309f7db80 1 -- start start 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd04175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0417b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd03edb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe309f7db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561fd040c4b0 con 0x561fd02f0cb0 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe309f7db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561fd040cb80 con 0x561fd03f33b0 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe309f7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561fd040d250 con 0x561fd0276450 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0417b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0417b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54144/0 (socket says 172.21.15.37:54144) 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 -- 172.21.15.37:0/13323779 learned_addr learned my addr 172.21.15.37:0/13323779 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f9303700 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd04175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 -- 172.21.15.37:0/13323779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 msgr2=0x561fd04175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd04175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 -- 172.21.15.37:0/13323779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 msgr2=0x561fd03edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd03edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 -- 172.21.15.37:0/13323779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd03ea980 con 0x561fd02f0cb0 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f9303700 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd04175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0417b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4001eb0 tx=0x7fe2e400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba089961acfc4858 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2deffd700 1 -- 172.21.15.37:0/13323779 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4000e60 con 0x561fd02f0cb0 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2deffd700 1 -- 172.21.15.37:0/13323779 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e402a070 con 0x561fd02f0cb0 2024-05-09T01:01:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.274+0000 7fe2deffd700 1 -- 172.21.15.37:0/13323779 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4004cc0 con 0x561fd02f0cb0 2024-05-09T01:01:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 -- 172.21.15.37:0/13323779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 msgr2=0x561fd0417b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0417b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4001eb0 tx=0x7fe2e400b630 comp rx=0 tx=0).stop 2024-05-09T01:01:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 -- 172.21.15.37:0/13323779 shutdown_connections 2024-05-09T01:01:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd03edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd04175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 --2- 172.21.15.37:0/13323779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0417b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 -- 172.21.15.37:0/13323779 >> 172.21.15.37:0/13323779 conn(0x561fd0279f20 msgr2=0x561fd0402a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 -- 172.21.15.37:0/13323779 shutdown_connections 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.275+0000 7fe309f7db80 1 -- 172.21.15.37:0/13323779 wait complete. 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.276+0000 7fe309f7db80 1 -- start start 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.276+0000 7fe309f7db80 1 Processor -- start 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.276+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd0405790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.276+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0405cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.276+0000 7fe309f7db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd0406210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.276+0000 7fe309f7db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561fd040dff0 con 0x561fd02f0cb0 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe309f7db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561fd040d920 con 0x561fd03f33b0 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe309f7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561fd040e6c0 con 0x561fd0276450 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe309f7db80 10 client.0 _ll_register_callbacks cb 0x561fd03e7ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0405cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0405cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54146/0 (socket says 172.21.15.37:54146) 2024-05-09T01:01:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 -- 172.21.15.37:0/3223976900 learned_addr learned my addr 172.21.15.37:0/3223976900 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f9303700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd0405790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd0406210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 -- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 msgr2=0x561fd0405790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd0405790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 -- 172.21.15.37:0/3223976900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 msgr2=0x561fd0406210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd0406210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 -- 172.21.15.37:0/3223976900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd04771f0 con 0x561fd02f0cb0 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f9303700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd0405790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f9b04700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd0406210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2f8b02700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0405cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4004550 tx=0x7fe2e4026690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc757226d36066e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2dcff9700 1 -- 172.21.15.37:0/3223976900 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e403c060 con 0x561fd02f0cb0 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe2dcff9700 1 -- 172.21.15.37:0/3223976900 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe2e4026b70 con 0x561fd02f0cb0 2024-05-09T01:01:35.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.277+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2e402a070 con 0x561fd02f0cb0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe2dcff9700 1 -- 172.21.15.37:0/3223976900 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2e4003960 con 0x561fd02f0cb0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 10 client.15069 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561fd0478450 con 0x561fd02f0cb0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe2dcff9700 1 -- 172.21.15.37:0/3223976900 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2e402a070 con 0x561fd02f0cb0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe2dcff9700 1 -- 172.21.15.37:0/3223976900 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe2e4041070 con 0x561fd02f0cb0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 10 client.15069 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 10 client.15069 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 20 client.15069 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd047a4b0 0x561fd047b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 4 client.15069 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "status"}) -- 0x561fd031dad0 con 0x561fd047a4b0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.278+0000 7fe2f9303700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd047a4b0 0x561fd047b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe2f9303700 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd047a4b0 0x561fd047b920 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a2fcb4a3ed7e9622 server_cookie=7b8f849e285ecf7 in_seq=0 out_seq=0 2024-05-09T01:01:35.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe2dcff9700 10 client.15069 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe2dcff9700 1 -- 172.21.15.37:0/3223976900 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561fd031dad0 con 0x561fd047a4b0 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe2dcff9700 10 client.15069 handle_command_reply: tid=0 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 client.15069 shutdown 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 msgr2=0x561fd0405cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0405cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4004550 tx=0x7fe2e4026690 comp rx=0 tx=0).stop 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 shutdown_connections 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561fd047a4b0 0x561fd047b920 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561fd03f33b0 0x561fd0406210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561fd0276450 0x561fd0405790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 --2- 172.21.15.37:0/3223976900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fd02f0cb0 0x561fd0405cd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 >> 172.21.15.37:0/3223976900 conn(0x561fd0279f20 msgr2=0x561fd03edb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe2dcff9700 0 client.15069 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 shutdown_connections 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 1 -- 172.21.15.37:0/3223976900 wait complete. 2024-05-09T01:01:35.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.279+0000 7fe309f7db80 20 client.15069 trim_cache size 0 max 16384 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24445, 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 159.28646941400001, 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:01:35.286 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 209.06528661600001 2024-05-09T01:01:35.287 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:01:35.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2e00b2900 msgr2=0x7fe2e00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2e00b2900 0x7fe2e00b4e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0005950 tx=0x7fe2f000a300 comp rx=0 tx=0).stop 2024-05-09T01:01:35.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f41089f0 msgr2=0x7fe2f41994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:35.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f41089f0 0x7fe2f41994f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00a720 tx=0x7fe2ec00a8f0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 shutdown_connections 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2e00b2900 0x7fe2e00b4e10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f41089f0 0x7fe2f41994f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2f41029c0 0x7fe2f4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 --2- 172.21.15.37:0/2230402526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f4103310 0x7fe2f4198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 >> 172.21.15.37:0/2230402526 conn(0x7fe2f40fe4e0 msgr2=0x7fe2f4106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 shutdown_connections 2024-05-09T01:01:35.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:35.280+0000 7fe2fb567700 1 -- 172.21.15.37:0/2230402526 wait complete. 2024-05-09T01:01:36.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-09T01:01:36.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:36 smithi136 ceph-mon[34110]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:36.419 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:36.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:36 smithi037 ceph-mon[30122]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:36.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:36 smithi151 ceph-mon[34780]: pgmap v379: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 -- 172.21.15.37:0/4192401314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 msgr2=0x7f291c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 --2- 172.21.15.37:0/4192401314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c108200 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f29100099c0 tx=0x7f2910009cd0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 -- 172.21.15.37:0/4192401314 shutdown_connections 2024-05-09T01:01:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 --2- 172.21.15.37:0/4192401314 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f291c108740 0x7f291c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 --2- 172.21.15.37:0/4192401314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f291c1034c0 0x7f291c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 --2- 172.21.15.37:0/4192401314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c108200 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 -- 172.21.15.37:0/4192401314 >> 172.21.15.37:0/4192401314 conn(0x7f291c0fedc0 msgr2=0x7f291c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 -- 172.21.15.37:0/4192401314 shutdown_connections 2024-05-09T01:01:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.199+0000 7f292137c700 1 -- 172.21.15.37:0/4192401314 wait complete. 2024-05-09T01:01:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 Processor -- start 2024-05-09T01:01:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 -- start start 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f291c1034c0 0x7f291c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c19c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f291c108740 0x7f291c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f291c113350 con 0x7f291c107df0 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1131d0 con 0x7f291c1034c0 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f292137c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1134d0 con 0x7f291c108740 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f291a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c19c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f291a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c19c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54154/0 (socket says 172.21.15.37:54154) 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f291a7fc700 1 -- 172.21.15.37:0/2795531583 learned_addr learned my addr 172.21.15.37:0/2795531583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.200+0000 7f291affd700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f291c1034c0 0x7f291c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f291b7fe700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f291c108740 0x7f291c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f291a7fc700 1 -- 172.21.15.37:0/2795531583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f291c108740 msgr2=0x7f291c19c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f291a7fc700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f291c108740 0x7f291c19c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f291a7fc700 1 -- 172.21.15.37:0/2795531583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f291c1034c0 msgr2=0x7f291c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f291a7fc700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f291c1034c0 0x7f291c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f291a7fc700 1 -- 172.21.15.37:0/2795531583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c1a6fc0 con 0x7f291c107df0 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f291a7fc700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c19c190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2910006010 tx=0x7f29100047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f2903fff700 1 -- 172.21.15.37:0/2795531583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910027070 con 0x7f291c107df0 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c1a7250 con 0x7f291c107df0 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f2903fff700 1 -- 172.21.15.37:0/2795531583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2910003f20 con 0x7f291c107df0 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f2903fff700 1 -- 172.21.15.37:0/2795531583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910022cd0 con 0x7f291c107df0 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.201+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c1a7700 con 0x7f291c107df0 2024-05-09T01:01:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.204+0000 7f2903fff700 1 -- 172.21.15.37:0/2795531583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f291002a070 con 0x7f291c107df0 2024-05-09T01:01:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.204+0000 7f2903fff700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b2900 0x7f29040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.205+0000 7f291affd700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b2900 0x7f29040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.205+0000 7f2903fff700 1 -- 172.21.15.37:0/2795531583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f29100e30e0 con 0x7f291c107df0 2024-05-09T01:01:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.205+0000 7f291affd700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b2900 0x7f29040b4e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f290c005950 tx=0x7f290c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.205+0000 7f292fd92b80 1 Processor -- start 2024-05-09T01:01:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.205+0000 7f292fd92b80 1 -- start start 2024-05-09T01:01:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.205+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db254a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3d9a2450 0x562b3db259e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3db1f650 0x562b3db1fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f292fd92b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b3da41fa0 con 0x562b3da8c110 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f292fd92b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562b3d9e07a0 con 0x562b3d9a2450 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f292fd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562b3da3df60 con 0x562b3db1f650 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db254a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54162/0 (socket says 172.21.15.37:54162) 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 -- 172.21.15.37:0/419075807 learned_addr learned my addr 172.21.15.37:0/419075807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291a7fc700 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3d9a2450 0x562b3db259e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291b7fe700 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3db1f650 0x562b3db1fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 -- 172.21.15.37:0/419075807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3db1f650 msgr2=0x562b3db1fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3db1f650 0x562b3db1fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 -- 172.21.15.37:0/419075807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3d9a2450 msgr2=0x562b3db259e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3d9a2450 0x562b3db259e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 -- 172.21.15.37:0/419075807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3d9d8320 con 0x562b3da8c110 2024-05-09T01:01:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291b7fe700 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3db1f650 0x562b3db1fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f291affd700 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db254a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f290c00fde0 tx=0x7f290c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65165b82a94beb28 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f29017fa700 1 -- 172.21.15.37:0/419075807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c016070 con 0x562b3da8c110 2024-05-09T01:01:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f29017fa700 1 -- 172.21.15.37:0/419075807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f290c010d70 con 0x562b3da8c110 2024-05-09T01:01:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.206+0000 7f29017fa700 1 -- 172.21.15.37:0/419075807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c025e10 con 0x562b3da8c110 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 -- 172.21.15.37:0/419075807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 msgr2=0x562b3db254a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db254a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f290c00fde0 tx=0x7f290c012000 comp rx=0 tx=0).stop 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 -- 172.21.15.37:0/419075807 shutdown_connections 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3db1f650 0x562b3db1fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db254a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 --2- 172.21.15.37:0/419075807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3d9a2450 0x562b3db259e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 -- 172.21.15.37:0/419075807 >> 172.21.15.37:0/419075807 conn(0x562b3da02650 msgr2=0x562b3db1a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 -- 172.21.15.37:0/419075807 shutdown_connections 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.207+0000 7f292fd92b80 1 -- 172.21.15.37:0/419075807 wait complete. 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 -- start start 2024-05-09T01:01:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 Processor -- start 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db291e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3da8c110 0x562b3db29720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3db1f650 0x562b3db29c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b3d8bdb50 con 0x562b3db1f650 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562b3d9fc100 con 0x562b3da8c110 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562b3db2c180 con 0x562b3d9a2450 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f292fd92b80 10 client.0 _ll_register_callbacks cb 0x562b3d8b3670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3db1f650 0x562b3db29c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f291b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3db1f650 0x562b3db29c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54172/0 (socket says 172.21.15.37:54172) 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.208+0000 7f291b7fe700 1 -- 172.21.15.37:0/750565663 learned_addr learned my addr 172.21.15.37:0/750565663 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291a7fc700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3da8c110 0x562b3db29720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291affd700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db291e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291b7fe700 1 -- 172.21.15.37:0/750565663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 msgr2=0x562b3db291e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291b7fe700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db291e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291b7fe700 1 -- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3da8c110 msgr2=0x562b3db29720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291b7fe700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3da8c110 0x562b3db29720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291b7fe700 1 -- 172.21.15.37:0/750565663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3d8bd440 con 0x562b3db1f650 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291affd700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db291e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f291b7fe700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3db1f650 0x562b3db29c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29140078a0 tx=0x7f2914007bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb314474524e1a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f28feff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f28feff5700 1 -- 172.21.15.37:0/750565663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914019020 con 0x562b3db1f650 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f290c010d70 con 0x562b3db1f650 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f28feff5700 1 -- 172.21.15.37:0/750565663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2914010670 con 0x562b3db1f650 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f28feff5700 1 -- 172.21.15.37:0/750565663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2914010870 con 0x562b3db1f650 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f292fd92b80 10 client.15081 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.209+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b3db36b90 con 0x562b3db1f650 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f28feff5700 1 -- 172.21.15.37:0/750565663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f290c010d70 con 0x562b3db1f650 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f28feff5700 1 -- 172.21.15.37:0/750565663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f2914020c20 con 0x562b3db1f650 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f292fd92b80 10 client.15081 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f292fd92b80 10 client.15081 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f292fd92b80 20 client.15081 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f292fd92b80 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3db39210 0x562b3db3a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f292fd92b80 4 client.15081 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b3da4f980 con 0x562b3db39210 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.210+0000 7f291affd700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3db39210 0x562b3db3a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.211+0000 7f291affd700 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3db39210 0x562b3db3a680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4de5c2d7171fada6 server_cookie=6714a405dbe7ec11 in_seq=0 out_seq=0 2024-05-09T01:01:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.211+0000 7f28feff5700 10 client.15081 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:01:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.211+0000 7f28feff5700 1 -- 172.21.15.37:0/750565663 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562b3da4f980 con 0x562b3db39210 2024-05-09T01:01:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.211+0000 7f28feff5700 10 client.15081 handle_command_reply: tid=0 2024-05-09T01:01:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 client.15081 shutdown 2024-05-09T01:01:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3db1f650 msgr2=0x562b3db29c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3db1f650 0x562b3db29c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f29140078a0 tx=0x7f2914007bb0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 shutdown_connections 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3db1f650 0x562b3db29c60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db291e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3db39210 0x562b3db3a680 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 --2- 172.21.15.37:0/750565663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3da8c110 0x562b3db29720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 >> 172.21.15.37:0/750565663 conn(0x562b3da02650 msgr2=0x562b3db1a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f28feff5700 0 client.15081 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 shutdown_connections 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 1 -- 172.21.15.37:0/750565663 wait complete. 2024-05-09T01:01:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.212+0000 7f292fd92b80 20 client.15081 trim_cache size 0 max 16384 2024-05-09T01:01:38.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.233+0000 7f292fd92b80 1 Processor -- start 2024-05-09T01:01:38.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.233+0000 7f292fd92b80 1 -- start start 2024-05-09T01:01:38.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db254a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db24800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f292fd92b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b3db389c0 con 0x562b3da8c110 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f292fd92b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562b3db39090 con 0x562b3db1f650 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f292fd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562b3db39760 con 0x562b3d9a2450 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db242c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54176/0 (socket says 172.21.15.37:54176) 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 -- 172.21.15.37:0/1855508361 learned_addr learned my addr 172.21.15.37:0/1855508361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291affd700 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291b7fe700 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db24800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 -- 172.21.15.37:0/1855508361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 msgr2=0x562b3db254a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db254a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 -- 172.21.15.37:0/1855508361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 msgr2=0x562b3db24800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db24800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 -- 172.21.15.37:0/1855508361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3db35190 con 0x562b3da8c110 2024-05-09T01:01:38.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.234+0000 7f291a7fc700 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db242c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f29100e0c20 tx=0x7f2910093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f951aef6e18940 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:38.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f2900ff9700 1 -- 172.21.15.37:0/1855508361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29100c4070 con 0x562b3da8c110 2024-05-09T01:01:38.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f2900ff9700 1 -- 172.21.15.37:0/1855508361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29100cd0b0 con 0x562b3da8c110 2024-05-09T01:01:38.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f2900ff9700 1 -- 172.21.15.37:0/1855508361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29100b3330 con 0x562b3da8c110 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 -- 172.21.15.37:0/1855508361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 msgr2=0x562b3db242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db242c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f29100e0c20 tx=0x7f2910093040 comp rx=0 tx=0).stop 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 -- 172.21.15.37:0/1855508361 shutdown_connections 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db24800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3d9a2450 0x562b3db254a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 --2- 172.21.15.37:0/1855508361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3da8c110 0x562b3db242c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 -- 172.21.15.37:0/1855508361 >> 172.21.15.37:0/1855508361 conn(0x562b3da02650 msgr2=0x562b3db1a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 -- 172.21.15.37:0/1855508361 shutdown_connections 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.235+0000 7f292fd92b80 1 -- 172.21.15.37:0/1855508361 wait complete. 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 -- start start 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 Processor -- start 2024-05-09T01:01:38.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3d9a2450 0x562b3db230b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3da8c110 0x562b3db235f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db1e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b3db3a500 con 0x562b3d9a2450 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562b3db39e30 con 0x562b3db1f650 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562b3db3abd0 con 0x562b3da8c110 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f292fd92b80 10 client.0 _ll_register_callbacks cb 0x562b3db200a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f291affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3d9a2450 0x562b3db230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f291affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3d9a2450 0x562b3db230b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54192/0 (socket says 172.21.15.37:54192) 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f291affd700 1 -- 172.21.15.37:0/3489043271 learned_addr learned my addr 172.21.15.37:0/3489043271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.236+0000 7f291a7fc700 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3da8c110 0x562b3db235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f291b7fe700 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db1e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f291affd700 1 -- 172.21.15.37:0/3489043271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3da8c110 msgr2=0x562b3db235f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f291affd700 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3da8c110 0x562b3db235f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f291affd700 1 -- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 msgr2=0x562b3db1e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f291affd700 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db1e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f291affd700 1 -- 172.21.15.37:0/3489043271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3db1eb80 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f291affd700 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3d9a2450 0x562b3db230b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f290c00fdb0 tx=0x7f290c00fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a191720ca16a1008 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f28feff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f28feff5700 1 -- 172.21.15.37:0/3489043271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c016070 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f28feff5700 1 -- 172.21.15.37:0/3489043271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f290c033640 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29100cd0b0 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f28feff5700 1 -- 172.21.15.37:0/3489043271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f290c033880 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f292fd92b80 10 client.15087 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.237+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b3dba4de0 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f28feff5700 1 -- 172.21.15.37:0/3489043271 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29100cd0b0 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f28feff5700 1 -- 172.21.15.37:0/3489043271 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f290c004780 con 0x562b3d9a2450 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f292fd92b80 10 client.15087 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f292fd92b80 10 client.15087 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-09T01:01:38.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f292fd92b80 20 client.15087 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f292fd92b80 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3dba6f00 0x562b3dba8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f292fd92b80 4 client.15087 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "status"}) -- 0x562b3db19f60 con 0x562b3dba6f00 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f291a7fc700 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3dba6f00 0x562b3dba8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f291a7fc700 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3dba6f00 0x562b3dba8370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e0cc77609c349c1e server_cookie=8e4fd07efac59f3b in_seq=0 out_seq=0 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.238+0000 7f28feff5700 10 client.15087 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f28feff5700 1 -- 172.21.15.37:0/3489043271 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562b3db19f60 con 0x562b3dba6f00 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f28feff5700 10 client.15087 handle_command_reply: tid=0 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 client.15087 shutdown 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3d9a2450 msgr2=0x562b3db230b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3d9a2450 0x562b3db230b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f290c00fdb0 tx=0x7f290c00fe10 comp rx=0 tx=0).stop 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 shutdown_connections 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x562b3dba6f00 0x562b3dba8370 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562b3db1f650 0x562b3db1e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b3d9a2450 0x562b3db230b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f28feff5700 0 client.15087 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 --2- 172.21.15.37:0/3489043271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b3da8c110 0x562b3db235f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 >> 172.21.15.37:0/3489043271 conn(0x562b3da02650 msgr2=0x562b3db254a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 shutdown_connections 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 1 -- 172.21.15.37:0/3489043271 wait complete. 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292fd92b80 20 client.15087 trim_cache size 0 max 16384 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-05-09T01:01:38.245 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24446, 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 163.25338140400001, 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 217.47916548500001 2024-05-09T01:01:38.246 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.239+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b2900 msgr2=0x7f29040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b2900 0x7f29040b4e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f290c005950 tx=0x7f290c00a300 comp rx=0 tx=0).stop 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 msgr2=0x7f291c19c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c19c190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2910006010 tx=0x7f29100047b0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 shutdown_connections 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b2900 0x7f29040b4e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f291c108740 0x7f291c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f291c1034c0 0x7f291c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 --2- 172.21.15.37:0/2795531583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f291c107df0 0x7f291c19c190 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:38.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 >> 172.21.15.37:0/2795531583 conn(0x7f291c0fedc0 msgr2=0x7f291c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:38.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 shutdown_connections 2024-05-09T01:01:38.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:38.240+0000 7f292137c700 1 -- 172.21.15.37:0/2795531583 wait complete. 2024-05-09T01:01:38.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:38 smithi136 ceph-mon[34110]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:38.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:38 smithi037 ceph-mon[30122]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:38.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:38 smithi151 ceph-mon[34780]: pgmap v380: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:39.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-09T01:01:39.308 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:40.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:40 smithi136 ceph-mon[34110]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:40.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:40 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:01:40.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:40 smithi037 ceph-mon[30122]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:40.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:40 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:01:40.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:40 smithi151 ceph-mon[34780]: pgmap v381: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:40.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:40 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:01:41.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 -- 172.21.15.37:0/2707491010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 msgr2=0x7fc57c108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 --2- 172.21.15.37:0/2707491010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 0x7fc57c108240 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc5700099c0 tx=0x7fc570009cd0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 -- 172.21.15.37:0/2707491010 shutdown_connections 2024-05-09T01:01:41.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 --2- 172.21.15.37:0/2707491010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c108780 0x7fc57c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 --2- 172.21.15.37:0/2707491010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57c103550 0x7fc57c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 --2- 172.21.15.37:0/2707491010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 0x7fc57c108240 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 -- 172.21.15.37:0/2707491010 >> 172.21.15.37:0/2707491010 conn(0x7fc57c078e00 msgr2=0x7fc57c079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 -- 172.21.15.37:0/2707491010 shutdown_connections 2024-05-09T01:01:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.070+0000 7fc5823d7700 1 -- 172.21.15.37:0/2707491010 wait complete. 2024-05-09T01:01:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.071+0000 7fc5823d7700 1 Processor -- start 2024-05-09T01:01:41.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.071+0000 7fc5823d7700 1 -- start start 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc5823d7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57c103550 0x7fc57c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc5823d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 0x7fc57c19c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc5823d7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c108780 0x7fc57c19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc5823d7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c113390 con 0x7fc57c107e30 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc5823d7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c113210 con 0x7fc57c108780 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc5823d7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c113510 con 0x7fc57c103550 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc57b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 0x7fc57c19c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57c103550 0x7fc57c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc57b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 0x7fc57c19c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54214/0 (socket says 172.21.15.37:54214) 2024-05-09T01:01:41.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc57b7fe700 1 -- 172.21.15.37:0/1421566913 learned_addr learned my addr 172.21.15.37:0/1421566913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc580974700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c108780 0x7fc57c19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc580974700 1 -- 172.21.15.37:0/1421566913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57c103550 msgr2=0x7fc57c19bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc580974700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57c103550 0x7fc57c19bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc580974700 1 -- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 msgr2=0x7fc57c19c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc580974700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 0x7fc57c19c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc580974700 1 -- 172.21.15.37:0/1421566913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c1a6fe0 con 0x7fc57c108780 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.072+0000 7fc580974700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c108780 0x7fc57c19c730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc57400b330 tx=0x7fc57400b640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.073+0000 7fc5797fa700 1 -- 172.21.15.37:0/1421566913 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57400bdd0 con 0x7fc57c108780 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.073+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57c199a60 con 0x7fc57c108780 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.073+0000 7fc5797fa700 1 -- 172.21.15.37:0/1421566913 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc574004bb0 con 0x7fc57c108780 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.073+0000 7fc5797fa700 1 -- 172.21.15.37:0/1421566913 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574007dc0 con 0x7fc57c108780 2024-05-09T01:01:41.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.073+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57c199f50 con 0x7fc57c108780 2024-05-09T01:01:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.075+0000 7fc5797fa700 1 -- 172.21.15.37:0/1421566913 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc574020020 con 0x7fc57c108780 2024-05-09T01:01:41.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.077+0000 7fc5797fa700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5640b2880 0x7fc5640b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.077+0000 7fc57bfff700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5640b2880 0x7fc5640b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.077+0000 7fc5797fa700 1 -- 172.21.15.37:0/1421566913 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc5740e5780 con 0x7fc57c108780 2024-05-09T01:01:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.077+0000 7fc57bfff700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5640b2880 0x7fc5640b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc56c007be0 tx=0x7fc56c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.077+0000 7fc590dedb80 1 Processor -- start 2024-05-09T01:01:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.077+0000 7fc590dedb80 1 -- start start 2024-05-09T01:01:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308491d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x56308491d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x5630849177c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc590dedb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56308483a050 con 0x5630849173b0 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc590dedb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5630847df950 con 0x563084814cb0 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc590dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563084836010 con 0x56308479a450 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308491d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc580974700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x5630849177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308491d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55578/0 (socket says 172.21.15.37:55578) 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 -- 172.21.15.37:0/995860069 learned_addr learned my addr 172.21.15.37:0/995860069 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57b7fe700 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x56308491d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 -- 172.21.15.37:0/995860069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 msgr2=0x56308491d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x56308491d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 -- 172.21.15.37:0/995860069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 msgr2=0x5630849177c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x5630849177c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57bfff700 1 -- 172.21.15.37:0/995860069 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630847d04b0 con 0x563084814cb0 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc57b7fe700 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x56308491d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:41.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.078+0000 7fc580974700 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x5630849177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:01:41.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.079+0000 7fc57bfff700 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308491d1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc56c010e80 tx=0x7fc56c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=819f7e1495a13fee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:41.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.079+0000 7fc5627fc700 1 -- 172.21.15.37:0/995860069 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c024070 con 0x563084814cb0 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.079+0000 7fc5627fc700 1 -- 172.21.15.37:0/995860069 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc56c015070 con 0x563084814cb0 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.079+0000 7fc5627fc700 1 -- 172.21.15.37:0/995860069 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0118c0 con 0x563084814cb0 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 -- 172.21.15.37:0/995860069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 msgr2=0x56308491d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308491d1f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc56c010e80 tx=0x7fc56c013000 comp rx=0 tx=0).stop 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 -- 172.21.15.37:0/995860069 shutdown_connections 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x5630849177c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308491d1f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 --2- 172.21.15.37:0/995860069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x56308491d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 -- 172.21.15.37:0/995860069 >> 172.21.15.37:0/995860069 conn(0x56308479df20 msgr2=0x5630849121d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 -- 172.21.15.37:0/995860069 shutdown_connections 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 -- 172.21.15.37:0/995860069 wait complete. 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.080+0000 7fc590dedb80 1 -- start start 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 1 Processor -- start 2024-05-09T01:01:41.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56308479a450 0x563084921030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563084814cb0 0x563084921570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084921ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563084918110 con 0x5630849173b0 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5630847d4ad0 con 0x56308479a450 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563084923fd0 con 0x563084814cb0 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc590dedb80 10 client.0 _ll_register_callbacks cb 0x5630846ab670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084921ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084921ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54240/0 (socket says 172.21.15.37:54240) 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 -- 172.21.15.37:0/3692466098 learned_addr learned my addr 172.21.15.37:0/3692466098 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc57b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563084814cb0 0x563084921570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc57bfff700 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56308479a450 0x563084921030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 -- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563084814cb0 msgr2=0x563084921570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563084814cb0 0x563084921570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 -- 172.21.15.37:0/3692466098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56308479a450 msgr2=0x563084921030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56308479a450 0x563084921030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc580974700 1 -- 172.21.15.37:0/3692466098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630846b5440 con 0x5630849173b0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.081+0000 7fc57b7fe700 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563084814cb0 0x563084921570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc580974700 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084921ab0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc5740acaa0 tx=0x7fc5740ad2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1413cebb70840af2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc55b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc55b7fe700 1 -- 172.21.15.37:0/3692466098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740acda0 con 0x5630849173b0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc55b7fe700 1 -- 172.21.15.37:0/3692466098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc5740c7430 con 0x5630849173b0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56c015070 con 0x5630849173b0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc55b7fe700 1 -- 172.21.15.37:0/3692466098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5740b1150 con 0x5630849173b0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc590dedb80 10 client.15099 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56308492eab0 con 0x5630849173b0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc55b7fe700 1 -- 172.21.15.37:0/3692466098 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc56c015070 con 0x5630849173b0 2024-05-09T01:01:41.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.082+0000 7fc55b7fe700 1 -- 172.21.15.37:0/3692466098 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc5740aba70 con 0x5630849173b0 2024-05-09T01:01:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc590dedb80 10 client.15099 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc590dedb80 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T01:01:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc590dedb80 20 client.15099 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc590dedb80 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5630849310c0 0x563084932530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc590dedb80 4 client.15099 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:01:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563084847a30 con 0x5630849310c0 2024-05-09T01:01:41.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc57bfff700 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5630849310c0 0x563084932530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc55b7fe700 10 client.15099 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:01:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.083+0000 7fc57bfff700 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5630849310c0 0x563084932530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=86ecc7592a7680ab server_cookie=ce002dc3237b6729 in_seq=0 out_seq=0 2024-05-09T01:01:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.084+0000 7fc55b7fe700 1 -- 172.21.15.37:0/3692466098 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563084847a30 con 0x5630849310c0 2024-05-09T01:01:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.084+0000 7fc55b7fe700 10 client.15099 handle_command_reply: tid=0 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.084+0000 7fc590dedb80 1 client.15099 shutdown 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.084+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 msgr2=0x563084921ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.084+0000 7fc590dedb80 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084921ab0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc5740acaa0 tx=0x7fc5740ad2e0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.084+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 shutdown_connections 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.084+0000 7fc590dedb80 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5630849310c0 0x563084932530 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc590dedb80 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084921ab0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc590dedb80 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56308479a450 0x563084921030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc55b7fe700 0 client.15099 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc590dedb80 1 --2- 172.21.15.37:0/3692466098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563084814cb0 0x563084921570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 >> 172.21.15.37:0/3692466098 conn(0x56308479df20 msgr2=0x56308490bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 shutdown_connections 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc590dedb80 1 -- 172.21.15.37:0/3692466098 wait complete. 2024-05-09T01:01:41.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.085+0000 7fc590dedb80 20 client.15099 trim_cache size 0 max 16384 2024-05-09T01:01:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 Processor -- start 2024-05-09T01:01:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 -- start start 2024-05-09T01:01:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56308479a450 0x56308492cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308490c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630849173b0 0x5630849215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563084930870 con 0x56308479a450 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563084930f40 con 0x563084814cb0 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.106+0000 7fc590dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563084931610 con 0x5630849173b0 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56308479a450 0x56308492cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56308479a450 0x56308492cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54252/0 (socket says 172.21.15.37:54252) 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 -- 172.21.15.37:0/2876441193 learned_addr learned my addr 172.21.15.37:0/2876441193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57b7fe700 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308490c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc580974700 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630849173b0 0x5630849215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 -- 172.21.15.37:0/2876441193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630849173b0 msgr2=0x5630849215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630849173b0 0x5630849215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 -- 172.21.15.37:0/2876441193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 msgr2=0x56308490c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308490c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 -- 172.21.15.37:0/2876441193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308490e980 con 0x56308479a450 2024-05-09T01:01:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57b7fe700 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308490c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc57bfff700 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56308479a450 0x56308492cfe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc56c004310 tx=0x7fc56c010ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32768a963f2fca11 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc561ffb700 1 -- 172.21.15.37:0/2876441193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c024070 con 0x56308479a450 2024-05-09T01:01:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc561ffb700 1 -- 172.21.15.37:0/2876441193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc56c036020 con 0x56308479a450 2024-05-09T01:01:41.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.107+0000 7fc561ffb700 1 -- 172.21.15.37:0/2876441193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c003c50 con 0x56308479a450 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 -- 172.21.15.37:0/2876441193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56308479a450 msgr2=0x56308492cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56308479a450 0x56308492cfe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc56c004310 tx=0x7fc56c010ac0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 -- 172.21.15.37:0/2876441193 shutdown_connections 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630849173b0 0x5630849215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56308479a450 0x56308492cfe0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 --2- 172.21.15.37:0/2876441193 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x56308490c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 -- 172.21.15.37:0/2876441193 >> 172.21.15.37:0/2876441193 conn(0x56308479df20 msgr2=0x56308490bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 -- 172.21.15.37:0/2876441193 shutdown_connections 2024-05-09T01:01:41.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.108+0000 7fc590dedb80 1 -- 172.21.15.37:0/2876441193 wait complete. 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 -- start start 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 Processor -- start 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x563084935820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x563084935d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084939fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630849323b0 con 0x5630849173b0 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563084931ce0 con 0x563084814cb0 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563084932a80 con 0x56308479a450 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.109+0000 7fc590dedb80 10 client.0 _ll_register_callbacks cb 0x5630846ab670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc580974700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084939fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x563084935820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x563084935820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57510/0 (socket says 172.21.15.37:57510) 2024-05-09T01:01:41.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 -- 172.21.15.37:0/4255594706 learned_addr learned my addr 172.21.15.37:0/4255594706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc580974700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084939fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54264/0 (socket says 172.21.15.37:54264) 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x563084935d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 -- 172.21.15.37:0/4255594706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 msgr2=0x563084935d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x563084935d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 -- 172.21.15.37:0/4255594706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 msgr2=0x563084939fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084939fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 -- 172.21.15.37:0/4255594706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563084936580 con 0x56308479a450 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc57bfff700 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x563084935820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc56c011010 tx=0x7fc56c005550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccde93421db4b9b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc55b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc55b7fe700 1 -- 172.21.15.37:0/4255594706 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c041060 con 0x56308479a450 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56c036020 con 0x56308479a450 2024-05-09T01:01:41.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.110+0000 7fc55b7fe700 1 -- 172.21.15.37:0/4255594706 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc56c0117e0 con 0x56308479a450 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc55b7fe700 1 -- 172.21.15.37:0/4255594706 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc56c024050 con 0x56308479a450 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 10 client.24871 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56308499c980 con 0x56308479a450 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc55b7fe700 1 -- 172.21.15.37:0/4255594706 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc56c036020 con 0x56308479a450 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc55b7fe700 1 -- 172.21.15.37:0/4255594706 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc56c046070 con 0x56308479a450 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 10 client.24871 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 10 client.24871 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 20 client.24871 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56308499e660 0x56308499fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 4 client.24871 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.111+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "status"}) -- 0x563084841ad0 con 0x56308499e660 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc57b7fe700 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56308499e660 0x56308499fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc55b7fe700 10 client.24871 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc57b7fe700 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56308499e660 0x56308499fad0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83f626181aa79dd7 server_cookie=5288eb4b6bfd0195 in_seq=0 out_seq=0 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc55b7fe700 1 -- 172.21.15.37:0/4255594706 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x563084841ad0 con 0x56308499e660 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc55b7fe700 10 client.24871 handle_command_reply: tid=0 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 client.24871 shutdown 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 msgr2=0x563084935820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x563084935820 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc56c011010 tx=0x7fc56c005550 comp rx=0 tx=0).stop 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 shutdown_connections 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56308499e660 0x56308499fad0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630849173b0 0x563084939fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56308479a450 0x563084935820 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 --2- 172.21.15.37:0/4255594706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563084814cb0 0x563084935d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.112+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 >> 172.21.15.37:0/4255594706 conn(0x56308479df20 msgr2=0x5630849163a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc55b7fe700 0 client.24871 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 shutdown_connections 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc590dedb80 1 -- 172.21.15.37:0/4255594706 wait complete. 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc590dedb80 20 client.24871 trim_cache size 0 max 16384 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24454, 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:01:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 167.13596679, 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 209.46690912599999 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:01:41.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5640b2880 msgr2=0x7fc5640b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5640b2880 0x7fc5640b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc56c007be0 tx=0x7fc56c0073d0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c108780 msgr2=0x7fc57c19c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c108780 0x7fc57c19c730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc57400b330 tx=0x7fc57400b640 comp rx=0 tx=0).stop 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 shutdown_connections 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5640b2880 0x7fc5640b4d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c108780 0x7fc57c19c730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.113+0000 7fc5823d7700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc57c103550 0x7fc57c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.114+0000 7fc5823d7700 1 --2- 172.21.15.37:0/1421566913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc57c107e30 0x7fc57c19c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.114+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 >> 172.21.15.37:0/1421566913 conn(0x7fc57c078e00 msgr2=0x7fc57c100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.114+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 shutdown_connections 2024-05-09T01:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:41.114+0000 7fc5823d7700 1 -- 172.21.15.37:0/1421566913 wait complete. 2024-05-09T01:01:41.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-09T01:01:41.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:41 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:41.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:41 smithi136 ceph-mon[34110]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:41.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:41.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:41 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:41.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:41 smithi037 ceph-mon[30122]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:41.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:41.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:41 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:41.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:41 smithi151 ceph-mon[34780]: pgmap v382: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:42.076 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:42.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:42 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:01:42.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:42 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:01:42.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:42 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:42.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:42 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:01:42.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:42 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:01:42.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:42 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:43.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:42 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:01:43.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:42 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:01:43.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:42 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:01:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 -- 172.21.15.37:0/3340418004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 msgr2=0x7f9a2010e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 --2- 172.21.15.37:0/3340418004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2010e380 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009990 tx=0x7f9a10009ca0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 -- 172.21.15.37:0/3340418004 shutdown_connections 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 --2- 172.21.15.37:0/3340418004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a2010e910 0x7f9a20110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 --2- 172.21.15.37:0/3340418004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a201054e0 0x7f9a201058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 --2- 172.21.15.37:0/3340418004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2010e380 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 -- 172.21.15.37:0/3340418004 >> 172.21.15.37:0/3340418004 conn(0x7f9a200fef50 msgr2=0x7f9a20101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 -- 172.21.15.37:0/3340418004 shutdown_connections 2024-05-09T01:01:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.787+0000 7f9a28351700 1 -- 172.21.15.37:0/3340418004 wait complete. 2024-05-09T01:01:43.789 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:43 smithi037 ceph-mon[30122]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 Processor -- start 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 -- start start 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a201054e0 0x7f9a2019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2019d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a2010e910 0x7f9a201a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20114460 con 0x7f9a20105e30 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9a201142e0 con 0x7f9a201054e0 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a28351700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a201145e0 con 0x7f9a2010e910 2024-05-09T01:01:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a258ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2019d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a258ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2019d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38566/0 (socket says 172.21.15.37:38566) 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a258ec700 1 -- 172.21.15.37:0/2482681161 learned_addr learned my addr 172.21.15.37:0/2482681161 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.788+0000 7f9a268ee700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a2010e910 0x7f9a201a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a201054e0 0x7f9a2019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a258ec700 1 -- 172.21.15.37:0/2482681161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a2010e910 msgr2=0x7f9a201a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a258ec700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a2010e910 0x7f9a201a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a258ec700 1 -- 172.21.15.37:0/2482681161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a201054e0 msgr2=0x7f9a2019d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a258ec700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a201054e0 0x7f9a2019d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a258ec700 1 -- 172.21.15.37:0/2482681161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a201a1f20 con 0x7f9a20105e30 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a258ec700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2019d5f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9a10000c00 tx=0x7f9a100047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a177fe700 1 -- 172.21.15.37:0/2482681161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a10027070 con 0x7f9a20105e30 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a201a21b0 con 0x7f9a20105e30 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a177fe700 1 -- 172.21.15.37:0/2482681161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a10003f20 con 0x7f9a20105e30 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a177fe700 1 -- 172.21.15.37:0/2482681161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a10022c70 con 0x7f9a20105e30 2024-05-09T01:01:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.789+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a201a9b30 con 0x7f9a20105e30 2024-05-09T01:01:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.792+0000 7f9a177fe700 1 -- 172.21.15.37:0/2482681161 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9a1002a070 con 0x7f9a20105e30 2024-05-09T01:01:43.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.793+0000 7f9a177fe700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a0c0b2900 0x7f9a0c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.793+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a0c0b2900 0x7f9a0c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.793+0000 7f9a177fe700 1 -- 172.21.15.37:0/2482681161 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9a100e3160 con 0x7f9a20105e30 2024-05-09T01:01:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.793+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a0c0b2900 0x7f9a0c0b4e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c005950 tx=0x7f9a1c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 Processor -- start 2024-05-09T01:01:43.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 -- start start 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d26acb0 0x560e2d3731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d373730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d36d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e2d290050 con 0x560e2d1f0450 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560e2d235950 con 0x560e2d26acb0 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e2d28c010 con 0x560e2d36d3b0 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a258ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d373730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a258ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d373730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38574/0 (socket says 172.21.15.37:38574) 2024-05-09T01:01:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a258ec700 1 -- 172.21.15.37:0/2395439876 learned_addr learned my addr 172.21.15.37:0/2395439876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a268ee700 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d36d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.794+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d26acb0 0x560e2d3731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a258ec700 1 -- 172.21.15.37:0/2395439876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 msgr2=0x560e2d36d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a258ec700 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d36d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a258ec700 1 -- 172.21.15.37:0/2395439876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d26acb0 msgr2=0x560e2d3731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a258ec700 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d26acb0 0x560e2d3731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a258ec700 1 -- 172.21.15.37:0/2395439876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2d2264b0 con 0x560e2d1f0450 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d26acb0 0x560e2d3731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a258ec700 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d373730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9a10005f50 tx=0x7f9a10009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a758b10ac25fdd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a14d47700 1 -- 172.21.15.37:0/2395439876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a100cd0d0 con 0x560e2d1f0450 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a14d47700 1 -- 172.21.15.37:0/2395439876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a100aa810 con 0x560e2d1f0450 2024-05-09T01:01:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.795+0000 7f9a14d47700 1 -- 172.21.15.37:0/2395439876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a100b33b0 con 0x560e2d1f0450 2024-05-09T01:01:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2395439876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 msgr2=0x560e2d373730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d373730 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9a10005f50 tx=0x7f9a10009310 comp rx=0 tx=0).stop 2024-05-09T01:01:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2395439876 shutdown_connections 2024-05-09T01:01:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d36d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d26acb0 0x560e2d3731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2395439876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d373730 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2395439876 >> 172.21.15.37:0/2395439876 conn(0x560e2d1f3f20 msgr2=0x560e2d3681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2395439876 shutdown_connections 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.796+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2395439876 wait complete. 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 -- start start 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 Processor -- start 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d37cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d26acb0 0x560e2d37d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d376f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e2d36df60 con 0x560e2d26acb0 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560e2d22aad0 con 0x560e2d1f0450 2024-05-09T01:01:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e2d36e0e0 con 0x560e2d36d3b0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a36d67b80 10 client.0 _ll_register_callbacks cb 0x560e2d101670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d26acb0 0x560e2d37d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d26acb0 0x560e2d37d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38580/0 (socket says 172.21.15.37:38580) 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 -- 172.21.15.37:0/1605796407 learned_addr learned my addr 172.21.15.37:0/1605796407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a268ee700 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d376f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a260ed700 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d37cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 -- 172.21.15.37:0/1605796407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 msgr2=0x560e2d376f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d376f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 -- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 msgr2=0x560e2d37cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d37cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.797+0000 7f9a258ec700 1 -- 172.21.15.37:0/1605796407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2d10b440 con 0x560e2d26acb0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a258ec700 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d26acb0 0x560e2d37d090 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a100aa7a0 tx=0x7f9a100cd180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550cd0352440ac28 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a09ffb700 1 -- 172.21.15.37:0/1605796407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a100c4060 con 0x560e2d26acb0 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a09ffb700 1 -- 172.21.15.37:0/1605796407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9a100040d0 con 0x560e2d26acb0 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a100aa810 con 0x560e2d26acb0 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a09ffb700 1 -- 172.21.15.37:0/1605796407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a100b35e0 con 0x560e2d26acb0 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 10 client.15117 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560e2d36df60 con 0x560e2d26acb0 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a09ffb700 1 -- 172.21.15.37:0/1605796407 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a100aa810 con 0x560e2d26acb0 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a09ffb700 1 -- 172.21.15.37:0/1605796407 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9a100a9a70 con 0x560e2d26acb0 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 10 client.15117 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 10 client.15117 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 20 client.15117 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d386b30 0x560e2d387fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 4 client.15117 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.798+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e2d29da30 con 0x560e2d386b30 2024-05-09T01:01:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.799+0000 7f9a260ed700 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d386b30 0x560e2d387fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.799+0000 7f9a260ed700 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d386b30 0x560e2d387fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8654ed1f49e5bd4b server_cookie=49e7a6cf6753b8e3 in_seq=0 out_seq=0 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.799+0000 7f9a09ffb700 10 client.15117 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a09ffb700 1 -- 172.21.15.37:0/1605796407 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560e2d29da30 con 0x560e2d386b30 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a09ffb700 10 client.15117 handle_command_reply: tid=0 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 client.15117 shutdown 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d26acb0 msgr2=0x560e2d37d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d26acb0 0x560e2d37d090 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9a100aa7a0 tx=0x7f9a100cd180 comp rx=0 tx=0).stop 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 shutdown_connections 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d36d3b0 0x560e2d376f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d37cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d386b30 0x560e2d387fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/1605796407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d26acb0 0x560e2d37d090 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 >> 172.21.15.37:0/1605796407 conn(0x560e2d1f3f20 msgr2=0x560e2d361fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a09ffb700 0 client.15117 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 shutdown_connections 2024-05-09T01:01:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 1 -- 172.21.15.37:0/1605796407 wait complete. 2024-05-09T01:01:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.800+0000 7f9a36d67b80 20 client.15117 trim_cache size 0 max 16384 2024-05-09T01:01:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 Processor -- start 2024-05-09T01:01:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 -- start start 2024-05-09T01:01:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d391400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d391940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d36d3b0 0x560e2d372040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e2d3862e0 con 0x560e2d1f0450 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560e2d3869b0 con 0x560e2d36d3b0 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e2d387080 con 0x560e2d26acb0 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d391400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d391400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38588/0 (socket says 172.21.15.37:38588) 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 -- 172.21.15.37:0/4203118950 learned_addr learned my addr 172.21.15.37:0/4203118950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a258ec700 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d391940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 -- 172.21.15.37:0/4203118950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 msgr2=0x560e2d391940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d391940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 -- 172.21.15.37:0/4203118950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d36d3b0 msgr2=0x560e2d372040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d36d3b0 0x560e2d372040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.822+0000 7f9a260ed700 1 -- 172.21.15.37:0/4203118950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e2d3644c0 con 0x560e2d1f0450 2024-05-09T01:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.823+0000 7f9a260ed700 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d391400 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00fc60 tx=0x7f9a1c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36816967fa596b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.823+0000 7f9a0bfff700 1 -- 172.21.15.37:0/4203118950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c02d070 con 0x560e2d1f0450 2024-05-09T01:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.823+0000 7f9a0bfff700 1 -- 172.21.15.37:0/4203118950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1c0273b0 con 0x560e2d1f0450 2024-05-09T01:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.823+0000 7f9a0bfff700 1 -- 172.21.15.37:0/4203118950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c016070 con 0x560e2d1f0450 2024-05-09T01:01:43.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- 172.21.15.37:0/4203118950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 msgr2=0x560e2d391400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d391400 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00fc60 tx=0x7f9a1c012000 comp rx=0 tx=0).stop 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- 172.21.15.37:0/4203118950 shutdown_connections 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d36d3b0 0x560e2d372040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d1f0450 0x560e2d391400 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/4203118950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d391940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- 172.21.15.37:0/4203118950 >> 172.21.15.37:0/4203118950 conn(0x560e2d1f3f20 msgr2=0x560e2d375860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- 172.21.15.37:0/4203118950 shutdown_connections 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- 172.21.15.37:0/4203118950 wait complete. 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- start start 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 Processor -- start 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d377510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d37f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d36d3b0 0x560e2d37fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e2d387e20 con 0x560e2d36d3b0 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560e2d387750 con 0x560e2d1f0450 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.824+0000 7f9a36d67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e2d3884f0 con 0x560e2d26acb0 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a36d67b80 10 client.0 _ll_register_callbacks cb 0x560e2d36de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d36d3b0 0x560e2d37fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d36d3b0 0x560e2d37fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38602/0 (socket says 172.21.15.37:38602) 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 -- 172.21.15.37:0/2390214942 learned_addr learned my addr 172.21.15.37:0/2390214942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a258ec700 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d37f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d377510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 -- 172.21.15.37:0/2390214942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 msgr2=0x560e2d37f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d37f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 -- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 msgr2=0x560e2d377510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d377510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 -- 172.21.15.37:0/2390214942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e2d3801c0 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a268ee700 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d36d3b0 0x560e2d37fbb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007b40 tx=0x7f9a18007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3993a879b3e5dfa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a09ffb700 1 -- 172.21.15.37:0/2390214942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1801b070 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a09ffb700 1 -- 172.21.15.37:0/2390214942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9a180178e0 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a1c0273b0 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a09ffb700 1 -- 172.21.15.37:0/2390214942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9a18017ae0 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.825+0000 7f9a36d67b80 10 client.15123 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560e2d3f1da0 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a09ffb700 1 -- 172.21.15.37:0/2390214942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1c0273b0 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a09ffb700 1 -- 172.21.15.37:0/2390214942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9a1802b400 con 0x560e2d36d3b0 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a36d67b80 10 client.15123 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a36d67b80 10 client.15123 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a36d67b80 20 client.15123 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:43.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d3f4240 0x560e2d3f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a36d67b80 4 client.15123 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "status"}) -- 0x560e2d297ad0 con 0x560e2d3f4240 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.826+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d3f4240 0x560e2d3f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a260ed700 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d3f4240 0x560e2d3f56b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8942fe4cf5814199 server_cookie=910b73ab49829266 in_seq=0 out_seq=0 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a09ffb700 10 client.15123 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a09ffb700 1 -- 172.21.15.37:0/2390214942 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560e2d297ad0 con 0x560e2d3f4240 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a09ffb700 10 client.15123 handle_command_reply: tid=0 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 client.15123 shutdown 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d36d3b0 msgr2=0x560e2d37fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d36d3b0 0x560e2d37fbb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a18007b40 tx=0x7f9a18007b70 comp rx=0 tx=0).stop 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 shutdown_connections 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x560e2d3f4240 0x560e2d3f56b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e2d36d3b0 0x560e2d37fbb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560e2d1f0450 0x560e2d377510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a09ffb700 0 client.15123 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 --2- 172.21.15.37:0/2390214942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e2d26acb0 0x560e2d37f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 >> 172.21.15.37:0/2390214942 conn(0x560e2d1f3f20 msgr2=0x560e2d361fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 shutdown_connections 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 1 -- 172.21.15.37:0/2390214942 wait complete. 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.827+0000 7f9a36d67b80 20 client.15123 trim_cache size 0 max 16384 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24467, 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:01:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:01:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:01:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 170.85740672200001, 2024-05-09T01:01:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:01:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:01:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:01:43.834 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 214.92253285699999 2024-05-09T01:01:43.834 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a0c0b2900 msgr2=0x7f9a0c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a0c0b2900 0x7f9a0c0b4e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c005950 tx=0x7f9a1c00a300 comp rx=0 tx=0).stop 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 msgr2=0x7f9a2019d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2019d5f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9a10000c00 tx=0x7f9a100047b0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 shutdown_connections 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a0c0b2900 0x7f9a0c0b4e10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a2010e910 0x7f9a201a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a201054e0 0x7f9a2019d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 --2- 172.21.15.37:0/2482681161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a20105e30 0x7f9a2019d5f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 >> 172.21.15.37:0/2482681161 conn(0x7f9a200fef50 msgr2=0x7f9a201031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 shutdown_connections 2024-05-09T01:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:43.828+0000 7f9a28351700 1 -- 172.21.15.37:0/2482681161 wait complete. 2024-05-09T01:01:43.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:43 smithi151 ceph-mon[34780]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:44.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:43 smithi136 ceph-mon[34110]: pgmap v383: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:44.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-09T01:01:44.794 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:46.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:45 smithi037 ceph-mon[30122]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:46.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:45 smithi136 ceph-mon[34110]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 -- 172.21.15.37:0/1494662788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e81034c0 msgr2=0x7f57e81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1494662788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e81034c0 0x7f57e81038d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f57d80099c0 tx=0x7f57d8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 -- 172.21.15.37:0/1494662788 shutdown_connections 2024-05-09T01:01:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1494662788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57e8108740 0x7f57e81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1494662788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e81034c0 0x7f57e81038d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1494662788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57e8107df0 0x7f57e8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 -- 172.21.15.37:0/1494662788 >> 172.21.15.37:0/1494662788 conn(0x7f57e80fedf0 msgr2=0x7f57e8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 -- 172.21.15.37:0/1494662788 shutdown_connections 2024-05-09T01:01:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.451+0000 7f57eefb5700 1 -- 172.21.15.37:0/1494662788 wait complete. 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 Processor -- start 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 -- start start 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57e81034c0 0x7f57e80ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e8107df0 0x7f57e80ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57e8108740 0x7f57e80ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57e81133e0 con 0x7f57e8107df0 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8113260 con 0x7f57e81034c0 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.452+0000 7f57eefb5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57e8113560 con 0x7f57e8108740 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e8107df0 0x7f57e80ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57ed552700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57e8108740 0x7f57e80ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e8107df0 0x7f57e80ff810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38624/0 (socket says 172.21.15.37:38624) 2024-05-09T01:01:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 -- 172.21.15.37:0/1978245050 learned_addr learned my addr 172.21.15.37:0/1978245050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57ecd51700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57e81034c0 0x7f57e80ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 -- 172.21.15.37:0/1978245050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57e8108740 msgr2=0x7f57e80ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57e8108740 0x7f57e80ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 -- 172.21.15.37:0/1978245050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57e81034c0 msgr2=0x7f57e80ff2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57e81034c0 0x7f57e80ff2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 -- 172.21.15.37:0/1978245050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e81a9230 con 0x7f57e8107df0 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e7fff700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e8107df0 0x7f57e80ff810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00d950 tx=0x7f57dc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e5ffb700 1 -- 172.21.15.37:0/1978245050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc017070 con 0x7f57e8107df0 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e81a9520 con 0x7f57e8107df0 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e5ffb700 1 -- 172.21.15.37:0/1978245050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57dc005020 con 0x7f57e8107df0 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.453+0000 7f57e5ffb700 1 -- 172.21.15.37:0/1978245050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00fa10 con 0x7f57e8107df0 2024-05-09T01:01:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.454+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e81a9a60 con 0x7f57e8107df0 2024-05-09T01:01:46.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.456+0000 7f57e5ffb700 1 -- 172.21.15.37:0/1978245050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f57dc00fbd0 con 0x7f57e8107df0 2024-05-09T01:01:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.457+0000 7f57e5ffb700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57d00b2880 0x7f57d00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.457+0000 7f57ecd51700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57d00b2880 0x7f57d00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.457+0000 7f57e5ffb700 1 -- 172.21.15.37:0/1978245050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f57dc0e1a80 con 0x7f57e8107df0 2024-05-09T01:01:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57ecd51700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57d00b2880 0x7f57d00b4d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57d800b580 tx=0x7f57d80036e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 Processor -- start 2024-05-09T01:01:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 -- start start 2024-05-09T01:01:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b4311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b42b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b34e050 con 0x55fd9b2ae450 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b2f3950 con 0x55fd9b42b3b0 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b34a010 con 0x55fd9b328cb0 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38626/0 (socket says 172.21.15.37:38626) 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57e7fff700 1 -- 172.21.15.37:0/3598846126 learned_addr learned my addr 172.21.15.37:0/3598846126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57ecd51700 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b4311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.458+0000 7f57ed552700 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b42b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57e7fff700 1 -- 172.21.15.37:0/3598846126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 msgr2=0x55fd9b4311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57e7fff700 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b4311f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57e7fff700 1 -- 172.21.15.37:0/3598846126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 msgr2=0x55fd9b42b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57e7fff700 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b42b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57e7fff700 1 -- 172.21.15.37:0/3598846126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9b2e44b0 con 0x55fd9b2ae450 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57ecd51700 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b4311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:46.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57ed552700 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b42b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57e7fff700 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0a9030 tx=0x7f57dc0a90a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afdcb2bec56051f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57ceffd700 1 -- 172.21.15.37:0/3598846126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc020040 con 0x55fd9b2ae450 2024-05-09T01:01:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57ceffd700 1 -- 172.21.15.37:0/3598846126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57dc0054d0 con 0x55fd9b2ae450 2024-05-09T01:01:46.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.459+0000 7f57ceffd700 1 -- 172.21.15.37:0/3598846126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0b1cd0 con 0x55fd9b2ae450 2024-05-09T01:01:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3598846126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 msgr2=0x55fd9b431730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0a9030 tx=0x7f57dc0a90a0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3598846126 shutdown_connections 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b42b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b4311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3598846126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431730 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3598846126 >> 172.21.15.37:0/3598846126 conn(0x55fd9b2b1f20 msgr2=0x55fd9b4261d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3598846126 shutdown_connections 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3598846126 wait complete. 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.460+0000 7f57fd9cbb80 1 -- start start 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 1 Processor -- start 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b434f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b435460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b4359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b42c110 con 0x55fd9b2ae450 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b2e8ad0 con 0x55fd9b42b3b0 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b437fd0 con 0x55fd9b328cb0 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57fd9cbb80 10 client.0 _ll_register_callbacks cb 0x55fd9b1bf670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57ecd51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b434f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57ecd51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b434f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38634/0 (socket says 172.21.15.37:38634) 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57ecd51700 1 -- 172.21.15.37:0/4269417914 learned_addr learned my addr 172.21.15.37:0/4269417914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57e7fff700 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b435460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.461+0000 7f57ed552700 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b4359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57ecd51700 1 -- 172.21.15.37:0/4269417914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 msgr2=0x55fd9b435460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57ecd51700 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b435460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57ecd51700 1 -- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 msgr2=0x55fd9b4359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57ecd51700 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b4359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57ecd51700 1 -- 172.21.15.37:0/4269417914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9b1c9440 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57ecd51700 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b434f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f57d80099c0 tx=0x7f57d8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505f7e081919df5a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57c7fff700 1 -- 172.21.15.37:0/4269417914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8034060 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57c7fff700 1 -- 172.21.15.37:0/4269417914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f57d800bdf0 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57dc0054d0 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57c7fff700 1 -- 172.21.15.37:0/4269417914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57d800f460 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57fd9cbb80 10 client.15135 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd9b442980 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.462+0000 7f57c7fff700 1 -- 172.21.15.37:0/4269417914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57dc0054d0 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57c7fff700 1 -- 172.21.15.37:0/4269417914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f57d8039070 con 0x55fd9b2ae450 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57fd9cbb80 10 client.15135 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57fd9cbb80 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:01:46.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57fd9cbb80 20 client.15135 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b444fa0 0x55fd9b446410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57fd9cbb80 4 client.15135 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd9b35ba30 con 0x55fd9b444fa0 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57e7fff700 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b444fa0 0x55fd9b446410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57c7fff700 10 client.15135 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.463+0000 7f57e7fff700 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b444fa0 0x55fd9b446410 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9516fdf1dcc2e54 server_cookie=861f2fcdba7c4f05 in_seq=0 out_seq=0 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.464+0000 7f57c7fff700 1 -- 172.21.15.37:0/4269417914 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd9b35ba30 con 0x55fd9b444fa0 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.464+0000 7f57c7fff700 10 client.15135 handle_command_reply: tid=0 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.464+0000 7f57fd9cbb80 1 client.15135 shutdown 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.464+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 msgr2=0x55fd9b434f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.464+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b434f20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f57d80099c0 tx=0x7f57d8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 shutdown_connections 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b444fa0 0x55fd9b446410 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b42b3b0 0x55fd9b4359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b434f20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/4269417914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b328cb0 0x55fd9b435460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 >> 172.21.15.37:0/4269417914 conn(0x55fd9b2b1f20 msgr2=0x55fd9b41ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57c7fff700 0 client.15135 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 shutdown_connections 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/4269417914 wait complete. 2024-05-09T01:01:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.465+0000 7f57fd9cbb80 20 client.15135 trim_cache size 0 max 16384 2024-05-09T01:01:46.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:45 smithi151 ceph-mon[34780]: pgmap v384: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-09T01:01:46.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.486+0000 7f57fd9cbb80 1 Processor -- start 2024-05-09T01:01:46.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.486+0000 7f57fd9cbb80 1 -- start start 2024-05-09T01:01:46.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b2ae450 0x55fd9b440f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b433f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b444750 con 0x55fd9b42b3b0 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b444e20 con 0x55fd9b328cb0 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b4454f0 con 0x55fd9b2ae450 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38644/0 (socket says 172.21.15.37:38644) 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 -- 172.21.15.37:0/3014060973 learned_addr learned my addr 172.21.15.37:0/3014060973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57e7fff700 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b433f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ecd51700 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b2ae450 0x55fd9b440f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 -- 172.21.15.37:0/3014060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b2ae450 msgr2=0x55fd9b440f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b2ae450 0x55fd9b440f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 -- 172.21.15.37:0/3014060973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 msgr2=0x55fd9b433f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b433f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 -- 172.21.15.37:0/3014060973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9b4334b0 con 0x55fd9b42b3b0 2024-05-09T01:01:46.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ed552700 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432200 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f57e00135f0 tx=0x7f57e0007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2594f18a14a819bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:46.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.487+0000 7f57ce7fc700 1 -- 172.21.15.37:0/3014060973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e001a030 con 0x55fd9b42b3b0 2024-05-09T01:01:46.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57ce7fc700 1 -- 172.21.15.37:0/3014060973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e0016b10 con 0x55fd9b42b3b0 2024-05-09T01:01:46.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57ce7fc700 1 -- 172.21.15.37:0/3014060973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e001e950 con 0x55fd9b42b3b0 2024-05-09T01:01:46.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3014060973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b42b3b0 msgr2=0x55fd9b432200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432200 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f57e00135f0 tx=0x7f57e0007950 comp rx=0 tx=0).stop 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3014060973 shutdown_connections 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432200 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b2ae450 0x55fd9b440f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/3014060973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b433f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3014060973 >> 172.21.15.37:0/3014060973 conn(0x55fd9b2b1f20 msgr2=0x55fd9b433830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3014060973 shutdown_connections 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.488+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/3014060973 wait complete. 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 -- start start 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 Processor -- start 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b432320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b446290 con 0x55fd9b2ae450 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b445bc0 con 0x55fd9b328cb0 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd9b446960 con 0x55fd9b42b3b0 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57fd9cbb80 10 client.0 _ll_register_callbacks cb 0x55fd9b1bf670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.489+0000 7f57ecd51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38652/0 (socket says 172.21.15.37:38652) 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 -- 172.21.15.37:0/1113048162 learned_addr learned my addr 172.21.15.37:0/1113048162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57e7fff700 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b432320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 -- 172.21.15.37:0/1113048162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b42b3b0 msgr2=0x55fd9b432860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 -- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 msgr2=0x55fd9b432320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b432320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 -- 172.21.15.37:0/1113048162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9b44dbc0 con 0x55fd9b2ae450 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57e7fff700 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b432320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57ecd51700 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431de0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f57d80099c0 tx=0x7f57d802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c738ae3d178ef179 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:46.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57c7fff700 1 -- 172.21.15.37:0/1113048162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d803f070 con 0x55fd9b2ae450 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57c7fff700 1 -- 172.21.15.37:0/1113048162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f57d800fce0 con 0x55fd9b2ae450 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57e0016b10 con 0x55fd9b2ae450 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57c7fff700 1 -- 172.21.15.37:0/1113048162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57d800be70 con 0x55fd9b2ae450 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57fd9cbb80 10 client.15141 fetch_fsmap learned FSMap version 28 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.490+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd9b4b05d0 con 0x55fd9b2ae450 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57c7fff700 1 -- 172.21.15.37:0/1113048162 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57e0016b10 con 0x55fd9b2ae450 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57c7fff700 1 -- 172.21.15.37:0/1113048162 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f57d8039040 con 0x55fd9b2ae450 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57fd9cbb80 10 client.15141 fetch_fsmap finished waiting for FSMap version 28 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57fd9cbb80 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57fd9cbb80 20 client.15141 populate_metadata read hostname 'smithi037' 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b4b2b30 0x55fd9b4b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57fd9cbb80 4 client.15141 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "status"}) -- 0x55fd9b355ad0 con 0x55fd9b4b2b30 2024-05-09T01:01:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.491+0000 7f57e7fff700 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b4b2b30 0x55fd9b4b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57c7fff700 10 client.15141 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57e7fff700 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b4b2b30 0x55fd9b4b3fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=394b9908bf2a95ac server_cookie=d84ecdb35a0dbec1 in_seq=0 out_seq=0 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57c7fff700 1 -- 172.21.15.37:0/1113048162 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fd9b355ad0 con 0x55fd9b4b2b30 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57c7fff700 10 client.15141 handle_command_reply: tid=0 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 client.15141 shutdown 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 msgr2=0x55fd9b431de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431de0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f57d80099c0 tx=0x7f57d802f710 comp rx=0 tx=0).stop 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 shutdown_connections 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9b4b2b30 0x55fd9b4b3fa0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd9b42b3b0 0x55fd9b432860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd9b2ae450 0x55fd9b431de0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 --2- 172.21.15.37:0/1113048162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd9b328cb0 0x55fd9b432320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 >> 172.21.15.37:0/1113048162 conn(0x55fd9b2b1f20 msgr2=0x55fd9b430810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:46.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57c7fff700 0 client.15141 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 shutdown_connections 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 1 -- 172.21.15.37:0/1113048162 wait complete. 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.492+0000 7f57fd9cbb80 20 client.15141 trim_cache size 0 max 16384 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "ec4482a6-0d9d-11ef-bc97-c7b262605968", 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24491, 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-09T01:01:46.498 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 186.13388442499999, 2024-05-09T01:01:46.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-05-09T01:01:46.499 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 81, 2024-05-09T01:01:46.499 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T01:01:46.499 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 204.05109264500001 2024-05-09T01:01:46.499 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:01:46.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57d00b2880 msgr2=0x7f57d00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57d00b2880 0x7f57d00b4d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57d800b580 tx=0x7f57d80036e0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e8107df0 msgr2=0x7f57e80ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e8107df0 0x7f57e80ff810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00d950 tx=0x7f57dc00dc60 comp rx=0 tx=0).stop 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 shutdown_connections 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57d00b2880 0x7f57d00b4d90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57e8108740 0x7f57e80ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57e81034c0 0x7f57e80ff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 --2- 172.21.15.37:0/1978245050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e8107df0 0x7f57e80ff810 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 >> 172.21.15.37:0/1978245050 conn(0x7f57e80fedf0 msgr2=0x7f57e8075dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 shutdown_connections 2024-05-09T01:01:46.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:46.493+0000 7f57eefb5700 1 -- 172.21.15.37:0/1978245050 wait complete. 2024-05-09T01:01:47.166 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T01:01:47.176 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T01:01:47.176 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T01:01:47.177 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T01:01:47.177 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T01:01:47.216 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T01:01:47.216 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-09T01:01:47.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:47.217 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-09T01:01:47.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:47.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-09T01:01:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-05-09T01:01:47.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:01:47.306 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v2', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-05-09T01:01:47.306 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T01:01:47.307 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-05-09T01:01:47.307 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-05-09T01:01:47.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T01:01:47.596 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:48.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:47 smithi136 ceph-mon[34110]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:48.419 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:47 smithi037 ceph-mon[30122]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:48.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:47 smithi151 ceph-mon[34780]: pgmap v385: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-05-09T01:01:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 -- 172.21.15.37:0/216907796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe04108740 msgr2=0x7efe041100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:49.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/216907796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe04108740 0x7efe041100a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0099c0 tx=0x7efdfc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 -- 172.21.15.37:0/216907796 shutdown_connections 2024-05-09T01:01:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/216907796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe04108740 0x7efe041100a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/216907796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe041034c0 0x7efe041038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/216907796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe04107df0 0x7efe04108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 -- 172.21.15.37:0/216907796 >> 172.21.15.37:0/216907796 conn(0x7efe040fedf0 msgr2=0x7efe04101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 -- 172.21.15.37:0/216907796 shutdown_connections 2024-05-09T01:01:49.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.243+0000 7efe0b7f2700 1 -- 172.21.15.37:0/216907796 wait complete. 2024-05-09T01:01:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 Processor -- start 2024-05-09T01:01:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 -- start start 2024-05-09T01:01:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe041034c0 0x7efe0419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe04107df0 0x7efe0419c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe04108740 0x7efe041a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe04113370 con 0x7efe041034c0 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efe041131f0 con 0x7efe04108740 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0b7f2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efe041134f0 con 0x7efe04107df0 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0958e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe041034c0 0x7efe0419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0958e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe041034c0 0x7efe0419bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38672/0 (socket says 172.21.15.37:38672) 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.244+0000 7efe0958e700 1 -- 172.21.15.37:0/1695097001 learned_addr learned my addr 172.21.15.37:0/1695097001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe08d8d700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe04107df0 0x7efe0419c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe0958e700 1 -- 172.21.15.37:0/1695097001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe04107df0 msgr2=0x7efe0419c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe0958e700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe04107df0 0x7efe0419c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe0958e700 1 -- 172.21.15.37:0/1695097001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe04108740 msgr2=0x7efe041a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe09d8f700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe04108740 0x7efe041a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe0958e700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe04108740 0x7efe041a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe0958e700 1 -- 172.21.15.37:0/1695097001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0419c8b0 con 0x7efe041034c0 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe09d8f700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe04108740 0x7efe041a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe08d8d700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe04107df0 0x7efe0419c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efe0958e700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe041034c0 0x7efe0419bb50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efe00007e20 tx=0x7efe0000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.245+0000 7efdfa7fc700 1 -- 172.21.15.37:0/1695097001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00016020 con 0x7efe041034c0 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.246+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe041a7170 con 0x7efe041034c0 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.246+0000 7efdfa7fc700 1 -- 172.21.15.37:0/1695097001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe0000ae00 con 0x7efe041034c0 2024-05-09T01:01:49.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.246+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe041a76b0 con 0x7efe041034c0 2024-05-09T01:01:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.246+0000 7efdfa7fc700 1 -- 172.21.15.37:0/1695097001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00011700 con 0x7efe041034c0 2024-05-09T01:01:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.247+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe040512c0 con 0x7efe041034c0 2024-05-09T01:01:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.249+0000 7efdfa7fc700 1 -- 172.21.15.37:0/1695097001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efe00019020 con 0x7efe041034c0 2024-05-09T01:01:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.250+0000 7efdfa7fc700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7efdf00b2880 0x7efdf00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.250+0000 7efe08d8d700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7efdf00b2880 0x7efdf00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:49.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.250+0000 7efdfa7fc700 1 -- 172.21.15.37:0/1695097001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7efe000e2740 con 0x7efe041034c0 2024-05-09T01:01:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.250+0000 7efe08d8d700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7efdf00b2880 0x7efdf00b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efdf4005fd0 tx=0x7efdf400a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.253+0000 7efdfa7fc700 1 -- 172.21.15.37:0/1695097001 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efe000aa500 con 0x7efe041034c0 2024-05-09T01:01:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.519+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efe04076040 con 0x7efe041034c0 2024-05-09T01:01:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.520+0000 7efdfa7fc700 1 -- 172.21.15.37:0/1695097001 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7efe000a9e00 con 0x7efe041034c0 2024-05-09T01:01:49.521 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7efdf00b2880 msgr2=0x7efdf00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7efdf00b2880 0x7efdf00b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efdf4005fd0 tx=0x7efdf400a5e0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe041034c0 msgr2=0x7efe0419bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe041034c0 0x7efe0419bb50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7efe00007e20 tx=0x7efe0000a340 comp rx=0 tx=0).stop 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 shutdown_connections 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7efdf00b2880 0x7efdf00b4d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efe04108740 0x7efe041a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe041034c0 0x7efe0419bb50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 --2- 172.21.15.37:0/1695097001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe04107df0 0x7efe0419c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 >> 172.21.15.37:0/1695097001 conn(0x7efe040fedf0 msgr2=0x7efe04107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 shutdown_connections 2024-05-09T01:01:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:49.522+0000 7efe0b7f2700 1 -- 172.21.15.37:0/1695097001 wait complete. 2024-05-09T01:01:50.144 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:49 smithi037 ceph-mon[30122]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:50.144 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:49 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1695097001' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T01:01:50.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-05-09T01:01:50.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:50.174 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-09T01:01:50.192 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T01:01:50.192 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T01:01:50.192 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-09T01:01:50.193 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-09T01:01:50.194 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-09T01:01:50.194 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42027sec preferred_lft 42027sec 2024-05-09T01:01:50.194 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-05-09T01:01:50.194 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-09T01:01:50.194 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T01:01:50.194 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-09T01:01:50.194 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-09T01:01:50.195 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T01:01:50.195 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:01:50.195 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-09T01:01:50.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-05-09T01:01:50.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-05-09T01:01:50.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-05-09T01:01:50.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T01:01:50.196 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-09T01:01:50.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:01:50.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:49 smithi136 ceph-mon[34110]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:50.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:49 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1695097001' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T01:01:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:50.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:50.391 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T01:01:50.417 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-09T01:01:50.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:50.419 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-09T01:01:50.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:49 smithi151 ceph-mon[34780]: pgmap v386: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-09T01:01:50.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:49 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1695097001' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T01:01:50.489 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-09T01:01:50.489 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T01:01:50.489 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-09T01:01:50.489 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-09T01:01:50.489 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T01:01:50.490 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:01:50.490 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-09T01:01:50.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-09T01:01:50.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-09T01:01:50.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-09T01:01:50.490 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-09T01:01:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:01:50.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:50.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:50.794 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-09T01:01:50.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:50.813 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-05-09T01:01:50.874 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:01:50.874 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-09T01:01:50.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--tmp-cephfs 2024-05-09T01:01:50.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-05-09T01:01:50.874 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-09T01:01:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:01:50.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:51.000 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-05-09T01:01:51.001 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-09T01:01:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:01:51.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:51.135 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T01:01:51.135 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-09T01:01:51.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-09T01:01:51.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T01:01:51.135 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-09T01:01:51.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:01:51.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:51.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T01:01:51.215 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /tmp/cephfs 2024-05-09T01:01:51.231 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/tmp/cephfs' 2024-05-09T01:01:51.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T01:01:51.231 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /tmp/cephfs 2024-05-09T01:01:51.285 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-09T01:01:51.286 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-09T01:01:51.286 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 2024-05-09T01:01:51.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:51.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context=system_u:object_r:postgresql_db_t:s0,nofallback 2024-05-09T01:01:51.402 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-05-09T01:01:51.402 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-05-09T01:01:51.535 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",nofallback 2024-05-09T01:01:51.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-05-09T01:01:51.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.136:3300,172.21.15.151:3300" 2024-05-09T01:01:51.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@ec4482a6-0d9d-11ef-bc97-c7b262605968.cephfs=/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 2024-05-09T01:01:51.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",name=0,key=0,mon_addr=172.21.15.37:3300/172.21.15.136:3300/172.21.15.151:3300" will pass to kernel 2024-05-09T01:01:51.538 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T01:01:51.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:01:51.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /tmp/cephfs 2024-05-09T01:01:51.566 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T01:01:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T01:01:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:51.666 INFO:teuthology.orchestra.run.smithi037.stdout:client24910 2024-05-09T01:01:51.666 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T01:01:51.666 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T01:01:51.684 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T01:01:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T01:01:51.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:51.782 INFO:teuthology.orchestra.run.smithi037.stdout:client24910 2024-05-09T01:01:51.783 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T01:01:51.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T01:01:51.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:51.841 INFO:teuthology.orchestra.run.smithi037.stdout:client24910 2024-05-09T01:01:51.841 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968.client24910/status') 2024-05-09T01:01:51.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T01:01:51.902 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.24910 (3)172.21.15.37:0/3382839042 2024-05-09T01:01:51.902 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-05-09T01:01:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-05-09T01:01:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-05-09T01:01:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:71 bytes copied, 2.4944e-05 s, 2.8 MB/s 2024-05-09T01:01:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T01:01:51.909 INFO:teuthology.run_tasks:Running task exec... 2024-05-09T01:01:51.920 INFO:teuthology.task.exec:Executing custom commands... 2024-05-09T01:01:51.920 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:01:51.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-05-09T01:01:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/3864773915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64101fc0 msgr2=0x7f5f641023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/3864773915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64101fc0 0x7f5f641023d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009900 tx=0x7f5f5402a410 comp rx=0 tx=0).stop 2024-05-09T01:01:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/3864773915 shutdown_connections 2024-05-09T01:01:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/3864773915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64109910 0x7f5f6410be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/3864773915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f64106da0 0x7f5f64109280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/3864773915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64101fc0 0x7f5f641023d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:52.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/3864773915 >> 172.21.15.37:0/3864773915 conn(0x7f5f640fd4f0 msgr2=0x7f5f640ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/3864773915 shutdown_connections 2024-05-09T01:01:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/3864773915 wait complete. 2024-05-09T01:01:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 Processor -- start 2024-05-09T01:01:52.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.036+0000 7f5f6a4c8640 1 -- start start 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f6a4c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f64101fc0 0x7f5f6419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f6a4c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64106da0 0x7f5f6419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f6a4c8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64109910 0x7f5f641a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f6a4c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6410f7d0 con 0x7f5f64106da0 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f6a4c8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6410f650 con 0x7f5f64101fc0 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f6a4c8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6410f950 con 0x7f5f64109910 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64106da0 0x7f5f6419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64106da0 0x7f5f6419a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57346/0 (socket says 172.21.15.37:57346) 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 -- 172.21.15.37:0/1451828770 learned_addr learned my addr 172.21.15.37:0/1451828770 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f63fff640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f64101fc0 0x7f5f6419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f68a65640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64109910 0x7f5f641a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:52.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 -- 172.21.15.37:0/1451828770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64109910 msgr2=0x7f5f641a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64109910 0x7f5f641a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 -- 172.21.15.37:0/1451828770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f64101fc0 msgr2=0x7f5f6419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f64101fc0 0x7f5f6419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f637fe640 1 -- 172.21.15.37:0/1451828770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f641a1f10 con 0x7f5f64106da0 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.037+0000 7f5f63fff640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f64101fc0 0x7f5f6419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.038+0000 7f5f637fe640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64106da0 0x7f5f6419a910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c890 tx=0x7f5f5800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.038+0000 7f5f617fa640 1 -- 172.21.15.37:0/1451828770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58004220 con 0x7f5f64106da0 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.038+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f641a2200 con 0x7f5f64106da0 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.038+0000 7f5f617fa640 1 -- 172.21.15.37:0/1451828770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f580043c0 con 0x7f5f64106da0 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.038+0000 7f5f617fa640 1 -- 172.21.15.37:0/1451828770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58004a00 con 0x7f5f64106da0 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.038+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f641a27d0 con 0x7f5f64106da0 2024-05-09T01:01:52.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.039+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f640ff010 con 0x7f5f64106da0 2024-05-09T01:01:52.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.041+0000 7f5f617fa640 1 -- 172.21.15.37:0/1451828770 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5f580079b0 con 0x7f5f64106da0 2024-05-09T01:01:52.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.042+0000 7f5f617fa640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f4c0b27e0 0x7f5f4c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:52.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.042+0000 7f5f63fff640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f4c0b27e0 0x7f5f4c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:52.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.042+0000 7f5f617fa640 1 -- 172.21.15.37:0/1451828770 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5f580e2420 con 0x7f5f64106da0 2024-05-09T01:01:52.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.043+0000 7f5f63fff640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f4c0b27e0 0x7f5f4c0b4cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f54000c00 tx=0x7f5f540314c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:52.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.045+0000 7f5f617fa640 1 -- 172.21.15.37:0/1451828770 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5f58014030 con 0x7f5f64106da0 2024-05-09T01:01:52.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:51 smithi037 ceph-mon[30122]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:52.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:52.282+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f5f6402dc30 con 0x7f5f64106da0 2024-05-09T01:01:52.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:51 smithi136 ceph-mon[34110]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:52.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:51 smithi151 ceph-mon[34780]: pgmap v387: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-09T01:01:53.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.001+0000 7f5f617fa640 1 -- 172.21.15.37:0/1451828770 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f5f580aa140 con 0x7f5f64106da0 2024-05-09T01:01:53.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.004+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f4c0b27e0 msgr2=0x7f5f4c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.004+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f4c0b27e0 0x7f5f4c0b4cf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5f54000c00 tx=0x7f5f540314c0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.004+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64106da0 msgr2=0x7f5f6419a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.004+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64106da0 0x7f5f6419a910 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c890 tx=0x7f5f5800cd50 comp rx=0 tx=0).stop 2024-05-09T01:01:53.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 shutdown_connections 2024-05-09T01:01:53.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64109910 0x7f5f641a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f64106da0 0x7f5f6419a910 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f4c0b27e0 0x7f5f4c0b4cf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 --2- 172.21.15.37:0/1451828770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f64101fc0 0x7f5f6419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 >> 172.21.15.37:0/1451828770 conn(0x7f5f640fd4f0 msgr2=0x7f5f64107d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:53.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 shutdown_connections 2024-05-09T01:01:53.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.005+0000 7f5f6a4c8640 1 -- 172.21.15.37:0/1451828770 wait complete. 2024-05-09T01:01:53.020 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-09T01:01:53.034 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-09T01:01:53.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:01:53.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3678665551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4108a30 msgr2=0x7f0ac410ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3678665551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4108a30 0x7f0ac410ae50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009ca0 tx=0x7f0abc02a8e0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3678665551 shutdown_connections 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3678665551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4108a30 0x7f0ac410ae50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3678665551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac4103d30 0x7f0ac4104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3678665551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4102af0 0x7f0ac41037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3678665551 >> 172.21.15.37:0/3678665551 conn(0x7f0ac40fdd00 msgr2=0x7f0ac4100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3678665551 shutdown_connections 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.202+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3678665551 wait complete. 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 Processor -- start 2024-05-09T01:01:53.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 -- start start 2024-05-09T01:01:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4102af0 0x7f0ac406aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4103d30 0x7f0ac41a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac4108a30 0x7f0ac41a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac410e6f0 con 0x7f0ac4102af0 2024-05-09T01:01:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac410e570 con 0x7f0ac4108a30 2024-05-09T01:01:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac8c78640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac410e870 con 0x7f0ac4103d30 2024-05-09T01:01:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4102af0 0x7f0ac406aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4102af0 0x7f0ac406aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57368/0 (socket says 172.21.15.37:57368) 2024-05-09T01:01:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.203+0000 7f0ac259c640 1 -- 172.21.15.37:0/3434826858 learned_addr learned my addr 172.21.15.37:0/3434826858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac2d9d640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac4108a30 0x7f0ac41a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac1d9b640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4103d30 0x7f0ac41a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac259c640 1 -- 172.21.15.37:0/3434826858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4103d30 msgr2=0x7f0ac41a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac259c640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4103d30 0x7f0ac41a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac259c640 1 -- 172.21.15.37:0/3434826858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac4108a30 msgr2=0x7f0ac41a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac259c640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac4108a30 0x7f0ac41a3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac259c640 1 -- 172.21.15.37:0/3434826858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac41a4170 con 0x7f0ac4102af0 2024-05-09T01:01:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac1d9b640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4103d30 0x7f0ac41a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac2d9d640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac4108a30 0x7f0ac41a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:53.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac259c640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4102af0 0x7f0ac406aa90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4006fd0 tx=0x7f0ab400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ab37fe640 1 -- 172.21.15.37:0/3434826858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011830 con 0x7f0ac4102af0 2024-05-09T01:01:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ab37fe640 1 -- 172.21.15.37:0/3434826858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab4016070 con 0x7f0ac4102af0 2024-05-09T01:01:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac41a4460 con 0x7f0ac4102af0 2024-05-09T01:01:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ab37fe640 1 -- 172.21.15.37:0/3434826858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4010e00 con 0x7f0ac4102af0 2024-05-09T01:01:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.204+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac41a49e0 con 0x7f0ac4102af0 2024-05-09T01:01:53.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.205+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac4107840 con 0x7f0ac4102af0 2024-05-09T01:01:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.208+0000 7f0ab37fe640 1 -- 172.21.15.37:0/3434826858 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0ab40119d0 con 0x7f0ac4102af0 2024-05-09T01:01:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.209+0000 7f0ab37fe640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0aac0b27f0 0x7f0aac0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.209+0000 7f0ac1d9b640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0aac0b27f0 0x7f0aac0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.209+0000 7f0ab37fe640 1 -- 172.21.15.37:0/3434826858 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0ab40e1fe0 con 0x7f0ac4102af0 2024-05-09T01:01:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.209+0000 7f0ac1d9b640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0aac0b27f0 0x7f0aac0b4d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8006fd0 tx=0x7f0ab8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:53.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.212+0000 7f0ab37fe640 1 -- 172.21.15.37:0/3434826858 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0ab40a9d20 con 0x7f0ac4102af0 2024-05-09T01:01:53.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:52 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1451828770' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-09T01:01:53.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.411+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ac402de80 con 0x7f0ac4102af0 2024-05-09T01:01:53.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.413+0000 7f0ab37fe640 1 -- 172.21.15.37:0/3434826858 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7f0ab40a9620 con 0x7f0ac4102af0 2024-05-09T01:01:53.414 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:53.414 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:01:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0aac0b27f0 msgr2=0x7f0aac0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0aac0b27f0 0x7f0aac0b4d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8006fd0 tx=0x7f0ab8008040 comp rx=0 tx=0).stop 2024-05-09T01:01:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4102af0 msgr2=0x7f0ac406aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4102af0 0x7f0ac406aa90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4006fd0 tx=0x7f0ab400b8e0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 shutdown_connections 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0aac0b27f0 0x7f0aac0b4d00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ac4108a30 0x7f0ac41a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4103d30 0x7f0ac41a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 --2- 172.21.15.37:0/3434826858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ac4102af0 0x7f0ac406aa90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 >> 172.21.15.37:0/3434826858 conn(0x7f0ac40fdd00 msgr2=0x7f0ac4104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 shutdown_connections 2024-05-09T01:01:53.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.415+0000 7f0ac8c78640 1 -- 172.21.15.37:0/3434826858 wait complete. 2024-05-09T01:01:53.426 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:52 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1451828770' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-09T01:01:53.428 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T00:53:46.888552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:58:33.187247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:58:36.068427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T01:01:53.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T01:01:53.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:52 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1451828770' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-09T01:01:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.545+0000 7f87f7f5e640 1 -- 172.21.15.37:0/1803798443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0102b10 msgr2=0x7f87f0103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.545+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/1803798443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0102b10 0x7f87f0103810 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009900 tx=0x7f87ec02a410 comp rx=0 tx=0).stop 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 -- 172.21.15.37:0/1803798443 shutdown_connections 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/1803798443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f0108a50 0x7f87f010ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/1803798443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f0103d50 0x7f87f0104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/1803798443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0102b10 0x7f87f0103810 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 -- 172.21.15.37:0/1803798443 >> 172.21.15.37:0/1803798443 conn(0x7f87f00fdd00 msgr2=0x7f87f01001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 -- 172.21.15.37:0/1803798443 shutdown_connections 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 -- 172.21.15.37:0/1803798443 wait complete. 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 Processor -- start 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 -- start start 2024-05-09T01:01:53.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f0102b10 0x7f87f019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.546+0000 7f87f7f5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f0103d50 0x7f87f019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f7f5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0108a50 0x7f87f01a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f7f5e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010f780 con 0x7f87f0108a50 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f7f5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010f600 con 0x7f87f0103d50 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f7f5e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f87f010f900 con 0x7f87f0102b10 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0108a50 0x7f87f01a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0108a50 0x7f87f01a1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57388/0 (socket says 172.21.15.37:57388) 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 -- 172.21.15.37:0/2023593075 learned_addr learned my addr 172.21.15.37:0/2023593075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f54f9640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f0103d50 0x7f87f019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f5cfa640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f0102b10 0x7f87f019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 -- 172.21.15.37:0/2023593075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f0102b10 msgr2=0x7f87f019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f0102b10 0x7f87f019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 -- 172.21.15.37:0/2023593075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f0103d50 msgr2=0x7f87f019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f0103d50 0x7f87f019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 -- 172.21.15.37:0/2023593075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f01a21c0 con 0x7f87f0108a50 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f54f9640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f0103d50 0x7f87f019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f64fb640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0108a50 0x7f87f01a1b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87e800eaa0 tx=0x7f87e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87e6ffd640 1 -- 172.21.15.37:0/2023593075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800cdb0 con 0x7f87f0108a50 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87e6ffd640 1 -- 172.21.15.37:0/2023593075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87e8005020 con 0x7f87f0108a50 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f01a24b0 con 0x7f87f0108a50 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87e6ffd640 1 -- 172.21.15.37:0/2023593075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e80116d0 con 0x7f87f0108a50 2024-05-09T01:01:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.547+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f01a2a00 con 0x7f87f0108a50 2024-05-09T01:01:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.548+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f0107860 con 0x7f87f0108a50 2024-05-09T01:01:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.550+0000 7f87e6ffd640 1 -- 172.21.15.37:0/2023593075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f87e80051d0 con 0x7f87f0108a50 2024-05-09T01:01:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.551+0000 7f87e6ffd640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87dc0b27f0 0x7f87dc0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.551+0000 7f87f5cfa640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87dc0b27f0 0x7f87dc0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.551+0000 7f87e6ffd640 1 -- 172.21.15.37:0/2023593075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f87e80e2820 con 0x7f87f0108a50 2024-05-09T01:01:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.551+0000 7f87f5cfa640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87dc0b27f0 0x7f87dc0b4d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0096c0 tx=0x7f87ec005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.554+0000 7f87e6ffd640 1 -- 172.21.15.37:0/2023593075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f87e8016030 con 0x7f87f0108a50 2024-05-09T01:01:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.746+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f87f002de30 con 0x7f87f0108a50 2024-05-09T01:01:53.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.747+0000 7f87e6ffd640 1 -- 172.21.15.37:0/2023593075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f87e80aa540 con 0x7f87f0108a50 2024-05-09T01:01:53.748 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-09T01:01:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87dc0b27f0 msgr2=0x7f87dc0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87dc0b27f0 0x7f87dc0b4d00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0096c0 tx=0x7f87ec005fd0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0108a50 msgr2=0x7f87f01a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0108a50 0x7f87f01a1b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87e800eaa0 tx=0x7f87e800ef60 comp rx=0 tx=0).stop 2024-05-09T01:01:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 shutdown_connections 2024-05-09T01:01:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87f0108a50 0x7f87f01a1b50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87dc0b27f0 0x7f87dc0b4d00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f0103d50 0x7f87f019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 --2- 172.21.15.37:0/2023593075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f0102b10 0x7f87f019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 >> 172.21.15.37:0/2023593075 conn(0x7f87f00fdd00 msgr2=0x7f87f0104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 shutdown_connections 2024-05-09T01:01:53.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.749+0000 7f87f7f5e640 1 -- 172.21.15.37:0/2023593075 wait complete. 2024-05-09T01:01:53.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T01:01:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 -- 172.21.15.37:0/1179845258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51701051b0 msgr2=0x7f51701055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 --2- 172.21.15.37:0/1179845258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51701051b0 0x7f51701055c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5160009900 tx=0x7f516002a410 comp rx=0 tx=0).stop 2024-05-09T01:01:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 -- 172.21.15.37:0/1179845258 shutdown_connections 2024-05-09T01:01:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 --2- 172.21.15.37:0/1179845258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5170102360 0x7f517010bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 --2- 172.21.15.37:0/1179845258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5170101860 0x7f5170101cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 --2- 172.21.15.37:0/1179845258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51701051b0 0x7f51701055c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 -- 172.21.15.37:0/1179845258 >> 172.21.15.37:0/1179845258 conn(0x7f51700fd460 msgr2=0x7f51700ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 -- 172.21.15.37:0/1179845258 shutdown_connections 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.879+0000 7f5175e92640 1 -- 172.21.15.37:0/1179845258 wait complete. 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 Processor -- start 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 -- start start 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5170101860 0x7f517019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5170102360 0x7f517019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51701051b0 0x7f51701a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f517010f720 con 0x7f5170102360 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f517010f5a0 con 0x7f5170101860 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.880+0000 7f5175e92640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f517010f8a0 con 0x7f51701051b0 2024-05-09T01:01:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5170102360 0x7f517019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5170102360 0x7f517019a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57420/0 (socket says 172.21.15.37:57420) 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 -- 172.21.15.37:0/3769518599 learned_addr learned my addr 172.21.15.37:0/3769518599 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516f7fe640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5170101860 0x7f517019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516ffff640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51701051b0 0x7f51701a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 -- 172.21.15.37:0/3769518599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51701051b0 msgr2=0x7f51701a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51701051b0 0x7f51701a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 -- 172.21.15.37:0/3769518599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5170101860 msgr2=0x7f517019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5170101860 0x7f517019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 -- 172.21.15.37:0/3769518599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51701a1ec0 con 0x7f5170102360 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516ffff640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51701051b0 0x7f51701a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516effd640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5170102360 0x7f517019a8c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f516400d770 tx=0x7f516400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516cff9640 1 -- 172.21.15.37:0/3769518599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5164017070 con 0x7f5170102360 2024-05-09T01:01:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516cff9640 1 -- 172.21.15.37:0/3769518599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51640054d0 con 0x7f5170102360 2024-05-09T01:01:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51701a21b0 con 0x7f5170102360 2024-05-09T01:01:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f516cff9640 1 -- 172.21.15.37:0/3769518599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5164004c30 con 0x7f5170102360 2024-05-09T01:01:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.881+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51701a2700 con 0x7f5170102360 2024-05-09T01:01:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.882+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5170108b40 con 0x7f5170102360 2024-05-09T01:01:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.884+0000 7f516cff9640 1 -- 172.21.15.37:0/3769518599 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5164004dd0 con 0x7f5170102360 2024-05-09T01:01:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.885+0000 7f516cff9640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51580b2870 0x7f51580b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.885+0000 7f516cff9640 1 -- 172.21.15.37:0/3769518599 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f51640e1fe0 con 0x7f5170102360 2024-05-09T01:01:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.885+0000 7f516f7fe640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51580b2870 0x7f51580b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:53.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.885+0000 7f516f7fe640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51580b2870 0x7f51580b4d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5160005ab0 tx=0x7f5160031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:53.889+0000 7f516cff9640 1 -- 172.21.15.37:0/3769518599 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f51640a9e20 con 0x7f5170102360 2024-05-09T01:01:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.082+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f517002ddc0 con 0x7f5170102360 2024-05-09T01:01:54.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.083+0000 7f516cff9640 1 -- 172.21.15.37:0/3769518599 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7f51640a9720 con 0x7f5170102360 2024-05-09T01:01:54.084 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-09T01:01:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51580b2870 msgr2=0x7f51580b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51580b2870 0x7f51580b4d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5160005ab0 tx=0x7f5160031400 comp rx=0 tx=0).stop 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5170102360 msgr2=0x7f517019a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5170102360 0x7f517019a8c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f516400d770 tx=0x7f516400dc30 comp rx=0 tx=0).stop 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 shutdown_connections 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51701051b0 0x7f51701a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5170102360 0x7f517019a8c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51580b2870 0x7f51580b4d80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 --2- 172.21.15.37:0/3769518599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5170101860 0x7f517019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 >> 172.21.15.37:0/3769518599 conn(0x7f51700fd460 msgr2=0x7f5170105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 shutdown_connections 2024-05-09T01:01:54.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.085+0000 7f5175e92640 1 -- 172.21.15.37:0/3769518599 wait complete. 2024-05-09T01:01:54.096 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:54 smithi037 ceph-mon[30122]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:54.096 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:54 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1451828770' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-09T01:01:54.097 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:54 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:01:54.097 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:54 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3434826858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:01:54.097 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:54 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2023593075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T01:01:54.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 -- 172.21.15.37:0/2518235211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 msgr2=0x7fac10104180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 --2- 172.21.15.37:0/2518235211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac10104180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fac04009900 tx=0x7fac0402a410 comp rx=0 tx=0).stop 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 -- 172.21.15.37:0/2518235211 shutdown_connections 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 --2- 172.21.15.37:0/2518235211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10108a70 0x7fac1010ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 --2- 172.21.15.37:0/2518235211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac10104180 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 --2- 172.21.15.37:0/2518235211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac10102b30 0x7fac10103830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 -- 172.21.15.37:0/2518235211 >> 172.21.15.37:0/2518235211 conn(0x7fac100fdd20 msgr2=0x7fac101001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 -- 172.21.15.37:0/2518235211 shutdown_connections 2024-05-09T01:01:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 -- 172.21.15.37:0/2518235211 wait complete. 2024-05-09T01:01:54.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.216+0000 7fac16043640 1 Processor -- start 2024-05-09T01:01:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac16043640 1 -- start start 2024-05-09T01:01:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac16043640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10102b30 0x7fac1019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac16043640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac1019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac16043640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac10108a70 0x7fac101a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac16043640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac1010f760 con 0x7fac10103d70 2024-05-09T01:01:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac16043640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fac1010f5e0 con 0x7fac10102b30 2024-05-09T01:01:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac16043640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fac1010f8e0 con 0x7fac10108a70 2024-05-09T01:01:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac1019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac1019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57444/0 (socket says 172.21.15.37:57444) 2024-05-09T01:01:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 -- 172.21.15.37:0/841938083 learned_addr learned my addr 172.21.15.37:0/841938083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0f7fe640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10102b30 0x7fac1019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0ffff640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac10108a70 0x7fac101a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 -- 172.21.15.37:0/841938083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac10108a70 msgr2=0x7fac101a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac10108a70 0x7fac101a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 -- 172.21.15.37:0/841938083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10102b30 msgr2=0x7fac1019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10102b30 0x7fac1019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.217+0000 7fac0effd640 1 -- 172.21.15.37:0/841938083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac101a1f30 con 0x7fac10103d70 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.218+0000 7fac0effd640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac1019a9a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fac04006010 tx=0x7fac04004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.218+0000 7fac0cff9640 1 -- 172.21.15.37:0/841938083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0403f030 con 0x7fac10103d70 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.218+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac101a21c0 con 0x7fac10103d70 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.218+0000 7fac0cff9640 1 -- 172.21.15.37:0/841938083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac04003cb0 con 0x7fac10103d70 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.218+0000 7fac0cff9640 1 -- 172.21.15.37:0/841938083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04035070 con 0x7fac10103d70 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.218+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac101a26b0 con 0x7fac10103d70 2024-05-09T01:01:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.219+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac10107880 con 0x7fac10103d70 2024-05-09T01:01:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.220+0000 7fac0cff9640 1 -- 172.21.15.37:0/841938083 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fac04042030 con 0x7fac10103d70 2024-05-09T01:01:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.221+0000 7fac0cff9640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fabf80b27f0 0x7fabf80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.221+0000 7fac0f7fe640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fabf80b27f0 0x7fabf80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.221+0000 7fac0cff9640 1 -- 172.21.15.37:0/841938083 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fac04102d90 con 0x7fac10103d70 2024-05-09T01:01:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.222+0000 7fac0f7fe640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fabf80b27f0 0x7fabf80b4d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac00005fd0 tx=0x7fac0000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.225+0000 7fac0cff9640 1 -- 172.21.15.37:0/841938083 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fac040ca460 con 0x7fac10103d70 2024-05-09T01:01:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:54 smithi136 ceph-mon[34110]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:54 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1451828770' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-09T01:01:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:54 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:01:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:54 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3434826858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:01:54.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:54 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2023593075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T01:01:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.418+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fac100638d0 con 0x7fac10103d70 2024-05-09T01:01:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.419+0000 7fac0cff9640 1 -- 172.21.15.37:0/841938083 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7fac040ce760 con 0x7fac10103d70 2024-05-09T01:01:54.419 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-09T01:01:54.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fabf80b27f0 msgr2=0x7fabf80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:54.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fabf80b27f0 0x7fabf80b4d00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac00005fd0 tx=0x7fac0000b390 comp rx=0 tx=0).stop 2024-05-09T01:01:54.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 msgr2=0x7fac1019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:54.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac1019a9a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fac04006010 tx=0x7fac04004340 comp rx=0 tx=0).stop 2024-05-09T01:01:54.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 shutdown_connections 2024-05-09T01:01:54.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac10108a70 0x7fac101a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac10103d70 0x7fac1019a9a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fabf80b27f0 0x7fabf80b4d00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 --2- 172.21.15.37:0/841938083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac10102b30 0x7fac1019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:54.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 >> 172.21.15.37:0/841938083 conn(0x7fac100fdd20 msgr2=0x7fac10104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:54.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 shutdown_connections 2024-05-09T01:01:54.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:54.421+0000 7fac16043640 1 -- 172.21.15.37:0/841938083 wait complete. 2024-05-09T01:01:54.433 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-09T01:01:54.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:01:54.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:54 smithi151 ceph-mon[34780]: pgmap v388: 97 pgs: 97 active+clean; 643 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-09T01:01:54.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:54 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1451828770' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-09T01:01:54.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:54 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:01:54.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:54 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3434826858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:01:54.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:54 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2023593075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T01:01:54.686 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:55.101 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:55 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3769518599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T01:01:55.101 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:55 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/841938083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T01:01:55.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:55 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3769518599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T01:01:55.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:55 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/841938083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T01:01:55.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:55 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3769518599' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T01:01:55.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:55 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/841938083' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T01:01:56.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:56 smithi037 ceph-mon[30122]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-09T01:01:56.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:56 smithi136 ceph-mon[34110]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 -- 172.21.15.37:0/1311269368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 msgr2=0x7fd970109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 --2- 172.21.15.37:0/1311269368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd970109320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9580099c0 tx=0x7fd958009cd0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 -- 172.21.15.37:0/1311269368 shutdown_connections 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 --2- 172.21.15.37:0/1311269368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd970109860 0x7fd9701111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 --2- 172.21.15.37:0/1311269368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9701045e0 0x7fd9701049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 --2- 172.21.15.37:0/1311269368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd970109320 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 -- 172.21.15.37:0/1311269368 >> 172.21.15.37:0/1311269368 conn(0x7fd9700ffe70 msgr2=0x7fd9701022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 -- 172.21.15.37:0/1311269368 shutdown_connections 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.427+0000 7fd9758df700 1 -- 172.21.15.37:0/1311269368 wait complete. 2024-05-09T01:01:56.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.428+0000 7fd9758df700 1 Processor -- start 2024-05-09T01:01:56.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.428+0000 7fd9758df700 1 -- start start 2024-05-09T01:01:56.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd9758df700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9701045e0 0x7fd97019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:56.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd9758df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd97019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:56.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd9758df700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd970109860 0x7fd97019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd9758df700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd970114470 con 0x7fd970108f10 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd9758df700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701142f0 con 0x7fd9701045e0 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd9758df700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd9701145f0 con 0x7fd970109860 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd97019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd97019b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57462/0 (socket says 172.21.15.37:57462) 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 -- 172.21.15.37:0/1532536850 learned_addr learned my addr 172.21.15.37:0/1532536850 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96f7fe700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd970109860 0x7fd97019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96effd700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9701045e0 0x7fd97019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 -- 172.21.15.37:0/1532536850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd970109860 msgr2=0x7fd97019f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd970109860 0x7fd97019f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 -- 172.21.15.37:0/1532536850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9701045e0 msgr2=0x7fd97019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9701045e0 0x7fd97019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 -- 172.21.15.37:0/1532536850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97019fd10 con 0x7fd970108f10 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96effd700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9701045e0 0x7fd97019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:56.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.429+0000 7fd96e7fc700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd97019b3e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd9580045e0 tx=0x7fd958004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:56.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.430+0000 7fd9748dd700 1 -- 172.21.15.37:0/1532536850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958026070 con 0x7fd970108f10 2024-05-09T01:01:56.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.430+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97019ffa0 con 0x7fd970108f10 2024-05-09T01:01:56.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.430+0000 7fd9748dd700 1 -- 172.21.15.37:0/1532536850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd95800f460 con 0x7fd970108f10 2024-05-09T01:01:56.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.430+0000 7fd9748dd700 1 -- 172.21.15.37:0/1532536850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958009e60 con 0x7fd970108f10 2024-05-09T01:01:56.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.430+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9701a7920 con 0x7fd970108f10 2024-05-09T01:01:56.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.431+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9700512c0 con 0x7fd970108f10 2024-05-09T01:01:56.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.432+0000 7fd9748dd700 1 -- 172.21.15.37:0/1532536850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd958029070 con 0x7fd970108f10 2024-05-09T01:01:56.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.433+0000 7fd9748dd700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd95c0b2880 0x7fd95c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:56.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.433+0000 7fd96effd700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd95c0b2880 0x7fd95c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:56.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.433+0000 7fd9748dd700 1 -- 172.21.15.37:0/1532536850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd9580e31e0 con 0x7fd970108f10 2024-05-09T01:01:56.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.434+0000 7fd96effd700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd95c0b2880 0x7fd95c0b4d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd960005950 tx=0x7fd9600058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:56.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.436+0000 7fd9748dd700 1 -- 172.21.15.37:0/1532536850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd958013070 con 0x7fd970108f10 2024-05-09T01:01:56.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:56 smithi151 ceph-mon[34780]: pgmap v389: 97 pgs: 97 active+clean; 644 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-09T01:01:56.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.700+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd97002e5f0 con 0x7fd970108f10 2024-05-09T01:01:56.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.701+0000 7fd9748dd700 1 -- 172.21.15.37:0/1532536850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11936 (secure 0 0 0) 0x7fd9580aaf90 con 0x7fd970108f10 2024-05-09T01:01:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:56.702 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:01:52.283608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24454,24445,24467,24446]},"id":1}]} 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd95c0b2880 msgr2=0x7fd95c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd95c0b2880 0x7fd95c0b4d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd960005950 tx=0x7fd9600058e0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 msgr2=0x7fd97019b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd97019b3e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd9580045e0 tx=0x7fd958004610 comp rx=0 tx=0).stop 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 shutdown_connections 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd95c0b2880 0x7fd95c0b4d90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd970109860 0x7fd97019f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9701045e0 0x7fd97019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 --2- 172.21.15.37:0/1532536850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd970108f10 0x7fd97019b3e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 >> 172.21.15.37:0/1532536850 conn(0x7fd9700ffe70 msgr2=0x7fd970107160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 shutdown_connections 2024-05-09T01:01:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:56.703+0000 7fd9758df700 1 -- 172.21.15.37:0/1532536850 wait complete. 2024-05-09T01:01:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-05-09T01:01:57.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:57 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1532536850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:57.349 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-09T01:01:57.349 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-09T01:01:57.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:01:57.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:57 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1532536850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 -- 172.21.15.37:0/408285477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730102af0 msgr2=0x7f07301037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 --2- 172.21.15.37:0/408285477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730102af0 0x7f07301037f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0720009900 tx=0x7f072002a410 comp rx=0 tx=0).stop 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 -- 172.21.15.37:0/408285477 shutdown_connections 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 --2- 172.21.15.37:0/408285477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730108a30 0x7f073010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 --2- 172.21.15.37:0/408285477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730103d30 0x7f0730104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 --2- 172.21.15.37:0/408285477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730102af0 0x7f07301037f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 -- 172.21.15.37:0/408285477 >> 172.21.15.37:0/408285477 conn(0x7f07300fdd00 msgr2=0x7f0730100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 -- 172.21.15.37:0/408285477 shutdown_connections 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.470+0000 7f073690d640 1 -- 172.21.15.37:0/408285477 wait complete. 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 Processor -- start 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 -- start start 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730102af0 0x7f073019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730103d30 0x7f073019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730108a30 0x7f07301a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f073010e5f0 con 0x7f0730108a30 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f073010e470 con 0x7f0730103d30 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f073690d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f073010e770 con 0x7f0730102af0 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0734eaa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730108a30 0x7f07301a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0734eaa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730108a30 0x7f07301a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57476/0 (socket says 172.21.15.37:57476) 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0734eaa640 1 -- 172.21.15.37:0/863482525 learned_addr learned my addr 172.21.15.37:0/863482525 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:57.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f072ffff640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730102af0 0x7f073019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0727fff640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730103d30 0x7f073019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0734eaa640 1 -- 172.21.15.37:0/863482525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730102af0 msgr2=0x7f073019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0734eaa640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730102af0 0x7f073019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0734eaa640 1 -- 172.21.15.37:0/863482525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730103d30 msgr2=0x7f073019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.471+0000 7f0734eaa640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730103d30 0x7f073019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.472+0000 7f0734eaa640 1 -- 172.21.15.37:0/863482525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07301a1eb0 con 0x7f0730108a30 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.472+0000 7f0734eaa640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730108a30 0x7f07301a1840 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f072800cad0 tx=0x7f072800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.472+0000 7f072dffb640 1 -- 172.21.15.37:0/863482525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072800ae20 con 0x7f0730108a30 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.472+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07301a21a0 con 0x7f0730108a30 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.472+0000 7f072dffb640 1 -- 172.21.15.37:0/863482525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0728005020 con 0x7f0730108a30 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.472+0000 7f072dffb640 1 -- 172.21.15.37:0/863482525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072800f6b0 con 0x7f0730108a30 2024-05-09T01:01:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.472+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07301a2740 con 0x7f0730108a30 2024-05-09T01:01:57.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:57 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1532536850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:01:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.473+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07301a2a60 con 0x7f0730108a30 2024-05-09T01:01:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.474+0000 7f072dffb640 1 -- 172.21.15.37:0/863482525 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f07280051d0 con 0x7f0730108a30 2024-05-09T01:01:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.475+0000 7f072dffb640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f071c0b27f0 0x7f071c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.475+0000 7f072ffff640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f071c0b27f0 0x7f071c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.475+0000 7f072dffb640 1 -- 172.21.15.37:0/863482525 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f07280e2550 con 0x7f0730108a30 2024-05-09T01:01:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.476+0000 7f072ffff640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f071c0b27f0 0x7f071c0b4d00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0720005ab0 tx=0x7f0720031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:57.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.479+0000 7f072dffb640 1 -- 172.21.15.37:0/863482525 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0728014030 con 0x7f0730108a30 2024-05-09T01:01:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.668+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f073010a750 con 0x7f071c0b27f0 2024-05-09T01:01:57.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.675+0000 7f072dffb640 1 -- 172.21.15.37:0/863482525 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258873 (secure 0 0 0) 0x7f073010a750 con 0x7f071c0b27f0 2024-05-09T01:01:57.679 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f071c0b27f0 msgr2=0x7f071c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f071c0b27f0 0x7f071c0b4d00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0720005ab0 tx=0x7f0720031400 comp rx=0 tx=0).stop 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730108a30 msgr2=0x7f07301a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730108a30 0x7f07301a1840 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f072800cad0 tx=0x7f072800cf90 comp rx=0 tx=0).stop 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 shutdown_connections 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0730108a30 0x7f07301a1840 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f071c0b27f0 0x7f071c0b4d00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730103d30 0x7f073019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 --2- 172.21.15.37:0/863482525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0730102af0 0x7f073019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 >> 172.21.15.37:0/863482525 conn(0x7f07300fdd00 msgr2=0x7f073010a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 shutdown_connections 2024-05-09T01:01:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.679+0000 7f073690d640 1 -- 172.21.15.37:0/863482525 wait complete. 2024-05-09T01:01:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-09T01:01:56.936958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664673,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1910,"num_read_kb":1065,"num_write":386,"num_write_kb":2306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382516,"kb_used_data":12564,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559308,"statfs":{"total":1151940427776,"available":1151548731392,"internally_reserved":0,"allocated":12865536,"data_stored":7151259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":83,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924302+0000","last_change":"2024-05-09T00:58:37.371502+0000","last_active":"2024-05-09T01:00:18.924302+0000","last_peered":"2024-05-09T01:00:18.924302+0000","last_clean":"2024-05-09T01:00:18.924302+0000","last_became_active":"2024-05-09T00:58:37.371172+0000","last_became_peered":"2024-05-09T00:58:37.371172+0000","last_unstale":"2024-05-09T01:00:18.924302+0000","last_undegraded":"2024-05-09T01:00:18.924302+0000","last_fullsized":"2024-05-09T01:00:18.924302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:37.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919151+0000","last_change":"2024-05-09T00:58:37.362831+0000","last_active":"2024-05-09T01:00:18.919151+0000","last_peered":"2024-05-09T01:00:18.919151+0000","last_clean":"2024-05-09T01:00:18.919151+0000","last_became_active":"2024-05-09T00:58:37.362063+0000","last_became_peered":"2024-05-09T00:58:37.362063+0000","last_unstale":"2024-05-09T01:00:18.919151+0000","last_undegraded":"2024-05-09T01:00:18.919151+0000","last_fullsized":"2024-05-09T01:00:18.919151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:01.222962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924951+0000","last_change":"2024-05-09T00:58:37.369903+0000","last_active":"2024-05-09T01:00:18.924951+0000","last_peered":"2024-05-09T01:00:18.924951+0000","last_clean":"2024-05-09T01:00:18.924951+0000","last_became_active":"2024-05-09T00:58:37.366215+0000","last_became_peered":"2024-05-09T00:58:37.366215+0000","last_unstale":"2024-05-09T01:00:18.924951+0000","last_undegraded":"2024-05-09T01:00:18.924951+0000","last_fullsized":"2024-05-09T01:00:18.924951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:47.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914741+0000","last_change":"2024-05-09T00:58:37.358878+0000","last_active":"2024-05-09T01:00:18.914741+0000","last_peered":"2024-05-09T01:00:18.914741+0000","last_clean":"2024-05-09T01:00:18.914741+0000","last_became_active":"2024-05-09T00:58:37.358516+0000","last_became_peered":"2024-05-09T00:58:37.358516+0000","last_unstale":"2024-05-09T01:00:18.914741+0000","last_undegraded":"2024-05-09T01:00:18.914741+0000","last_fullsized":"2024-05-09T01:00:18.914741+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.899081+0000","last_change":"2024-05-09T00:58:37.358196+0000","last_active":"2024-05-09T01:00:18.899081+0000","last_peered":"2024-05-09T01:00:18.899081+0000","last_clean":"2024-05-09T01:00:18.899081+0000","last_became_active":"2024-05-09T00:58:37.357840+0000","last_became_peered":"2024-05-09T00:58:37.357840+0000","last_unstale":"2024-05-09T01:00:18.899081+0000","last_undegraded":"2024-05-09T01:00:18.899081+0000","last_fullsized":"2024-05-09T01:00:18.899081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:58.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923410+0000","last_change":"2024-05-09T00:58:37.364523+0000","last_active":"2024-05-09T01:00:18.923410+0000","last_peered":"2024-05-09T01:00:18.923410+0000","last_clean":"2024-05-09T01:00:18.923410+0000","last_became_active":"2024-05-09T00:58:37.364172+0000","last_became_peered":"2024-05-09T00:58:37.364172+0000","last_unstale":"2024-05-09T01:00:18.923410+0000","last_undegraded":"2024-05-09T01:00:18.923410+0000","last_fullsized":"2024-05-09T01:00:18.923410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:36.872701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914326+0000","last_change":"2024-05-09T00:58:37.371226+0000","last_active":"2024-05-09T01:00:18.914326+0000","last_peered":"2024-05-09T01:00:18.914326+0000","last_clean":"2024-05-09T01:00:18.914326+0000","last_became_active":"2024-05-09T00:58:37.370647+0000","last_became_peered":"2024-05-09T00:58:37.370647+0000","last_unstale":"2024-05-09T01:00:18.914326+0000","last_undegraded":"2024-05-09T01:00:18.914326+0000","last_fullsized":"2024-05-09T01:00:18.914326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:46.350845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914174+0000","last_change":"2024-05-09T00:58:37.362487+0000","last_active":"2024-05-09T01:00:18.914174+0000","last_peered":"2024-05-09T01:00:18.914174+0000","last_clean":"2024-05-09T01:00:18.914174+0000","last_became_active":"2024-05-09T00:58:37.361454+0000","last_became_peered":"2024-05-09T00:58:37.361454+0000","last_unstale":"2024-05-09T01:00:18.914174+0000","last_undegraded":"2024-05-09T01:00:18.914174+0000","last_fullsized":"2024-05-09T01:00:18.914174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:36.930754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925505+0000","last_change":"2024-05-09T00:58:37.370069+0000","last_active":"2024-05-09T01:00:18.925505+0000","last_peered":"2024-05-09T01:00:18.925505+0000","last_clean":"2024-05-09T01:00:18.925505+0000","last_became_active":"2024-05-09T00:58:37.369634+0000","last_became_peered":"2024-05-09T00:58:37.369634+0000","last_unstale":"2024-05-09T01:00:18.925505+0000","last_undegraded":"2024-05-09T01:00:18.925505+0000","last_fullsized":"2024-05-09T01:00:18.925505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:22.424919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923448+0000","last_change":"2024-05-09T00:58:37.365066+0000","last_active":"2024-05-09T01:00:18.923448+0000","last_peered":"2024-05-09T01:00:18.923448+0000","last_clean":"2024-05-09T01:00:18.923448+0000","last_became_active":"2024-05-09T00:58:37.364638+0000","last_became_peered":"2024-05-09T00:58:37.364638+0000","last_unstale":"2024-05-09T01:00:18.923448+0000","last_undegraded":"2024-05-09T01:00:18.923448+0000","last_fullsized":"2024-05-09T01:00:18.923448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:14.706123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926422+0000","last_change":"2024-05-09T00:58:37.366880+0000","last_active":"2024-05-09T01:00:18.926422+0000","last_peered":"2024-05-09T01:00:18.926422+0000","last_clean":"2024-05-09T01:00:18.926422+0000","last_became_active":"2024-05-09T00:58:37.366510+0000","last_became_peered":"2024-05-09T00:58:37.366510+0000","last_unstale":"2024-05-09T01:00:18.926422+0000","last_undegraded":"2024-05-09T01:00:18.926422+0000","last_fullsized":"2024-05-09T01:00:18.926422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:36.968096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917574+0000","last_change":"2024-05-09T00:58:37.363258+0000","last_active":"2024-05-09T01:00:18.917574+0000","last_peered":"2024-05-09T01:00:18.917574+0000","last_clean":"2024-05-09T01:00:18.917574+0000","last_became_active":"2024-05-09T00:58:37.362791+0000","last_became_peered":"2024-05-09T00:58:37.362791+0000","last_unstale":"2024-05-09T01:00:18.917574+0000","last_undegraded":"2024-05-09T01:00:18.917574+0000","last_fullsized":"2024-05-09T01:00:18.917574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:03.341731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914771+0000","last_change":"2024-05-09T00:58:37.371276+0000","last_active":"2024-05-09T01:00:18.914771+0000","last_peered":"2024-05-09T01:00:18.914771+0000","last_clean":"2024-05-09T01:00:18.914771+0000","last_became_active":"2024-05-09T00:58:37.370881+0000","last_became_peered":"2024-05-09T00:58:37.370881+0000","last_unstale":"2024-05-09T01:00:18.914771+0000","last_undegraded":"2024-05-09T01:00:18.914771+0000","last_fullsized":"2024-05-09T01:00:18.914771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:14.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919600+0000","last_change":"2024-05-09T00:58:37.361394+0000","last_active":"2024-05-09T01:00:18.919600+0000","last_peered":"2024-05-09T01:00:18.919600+0000","last_clean":"2024-05-09T01:00:18.919600+0000","last_became_active":"2024-05-09T00:58:37.360669+0000","last_became_peered":"2024-05-09T00:58:37.360669+0000","last_unstale":"2024-05-09T01:00:18.919600+0000","last_undegraded":"2024-05-09T01:00:18.919600+0000","last_fullsized":"2024-05-09T01:00:18.919600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.110889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.922832+0000","last_change":"2024-05-09T00:58:37.371900+0000","last_active":"2024-05-09T01:00:18.922832+0000","last_peered":"2024-05-09T01:00:18.922832+0000","last_clean":"2024-05-09T01:00:18.922832+0000","last_became_active":"2024-05-09T00:58:37.368608+0000","last_became_peered":"2024-05-09T00:58:37.368608+0000","last_unstale":"2024-05-09T01:00:18.922832+0000","last_undegraded":"2024-05-09T01:00:18.922832+0000","last_fullsized":"2024-05-09T01:00:18.922832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:17.673058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926840+0000","last_change":"2024-05-09T00:58:37.372717+0000","last_active":"2024-05-09T01:00:18.926840+0000","last_peered":"2024-05-09T01:00:18.926840+0000","last_clean":"2024-05-09T01:00:18.926840+0000","last_became_active":"2024-05-09T00:58:37.372376+0000","last_became_peered":"2024-05-09T00:58:37.372376+0000","last_unstale":"2024-05-09T01:00:18.926840+0000","last_undegraded":"2024-05-09T01:00:18.926840+0000","last_fullsized":"2024-05-09T01:00:18.926840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:51.092242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924285+0000","last_change":"2024-05-09T00:58:37.373971+0000","last_active":"2024-05-09T01:00:18.924285+0000","last_peered":"2024-05-09T01:00:18.924285+0000","last_clean":"2024-05-09T01:00:18.924285+0000","last_became_active":"2024-05-09T00:58:37.373620+0000","last_became_peered":"2024-05-09T00:58:37.373620+0000","last_unstale":"2024-05-09T01:00:18.924285+0000","last_undegraded":"2024-05-09T01:00:18.924285+0000","last_fullsized":"2024-05-09T01:00:18.924285+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.070455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914287+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.914287+0000","last_peered":"2024-05-09T01:00:18.914287+0000","last_clean":"2024-05-09T01:00:18.914287+0000","last_became_active":"2024-05-09T00:58:37.367820+0000","last_became_peered":"2024-05-09T00:58:37.367820+0000","last_unstale":"2024-05-09T01:00:18.914287+0000","last_undegraded":"2024-05-09T01:00:18.914287+0000","last_fullsized":"2024-05-09T01:00:18.914287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:45.207654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918607+0000","last_change":"2024-05-09T00:58:37.358736+0000","last_active":"2024-05-09T01:00:18.918607+0000","last_peered":"2024-05-09T01:00:18.918607+0000","last_clean":"2024-05-09T01:00:18.918607+0000","last_became_active":"2024-05-09T00:58:37.358354+0000","last_became_peered":"2024-05-09T00:58:37.358354+0000","last_unstale":"2024-05-09T01:00:18.918607+0000","last_undegraded":"2024-05-09T01:00:18.918607+0000","last_fullsized":"2024-05-09T01:00:18.918607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:51.084484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":221,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.310479+0000","last_change":"2024-05-09T00:58:34.333847+0000","last_active":"2024-05-09T01:01:55.310479+0000","last_peered":"2024-05-09T01:01:55.310479+0000","last_clean":"2024-05-09T01:01:55.310479+0000","last_became_active":"2024-05-09T00:58:34.333479+0000","last_became_peered":"2024-05-09T00:58:34.333479+0000","last_unstale":"2024-05-09T01:01:55.310479+0000","last_undegraded":"2024-05-09T01:01:55.310479+0000","last_fullsized":"2024-05-09T01:01:55.310479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:53.709034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":181,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915386+0000","last_change":"2024-05-09T00:58:37.367327+0000","last_active":"2024-05-09T01:00:18.915386+0000","last_peered":"2024-05-09T01:00:18.915386+0000","last_clean":"2024-05-09T01:00:18.915386+0000","last_became_active":"2024-05-09T00:58:37.366973+0000","last_became_peered":"2024-05-09T00:58:37.366973+0000","last_unstale":"2024-05-09T01:00:18.915386+0000","last_undegraded":"2024-05-09T01:00:18.915386+0000","last_fullsized":"2024-05-09T01:00:18.915386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:10.610274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078289+0000","last_change":"2024-05-09T00:58:34.821107+0000","last_active":"2024-05-09T00:59:20.078289+0000","last_peered":"2024-05-09T00:59:20.078289+0000","last_clean":"2024-05-09T00:59:20.078289+0000","last_became_active":"2024-05-09T00:58:34.820737+0000","last_became_peered":"2024-05-09T00:58:34.820737+0000","last_unstale":"2024-05-09T00:59:20.078289+0000","last_undegraded":"2024-05-09T00:59:20.078289+0000","last_fullsized":"2024-05-09T00:59:20.078289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:45.450781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924805+0000","last_change":"2024-05-09T00:58:37.363559+0000","last_active":"2024-05-09T01:00:18.924805+0000","last_peered":"2024-05-09T01:00:18.924805+0000","last_clean":"2024-05-09T01:00:18.924805+0000","last_became_active":"2024-05-09T00:58:37.358299+0000","last_became_peered":"2024-05-09T00:58:37.358299+0000","last_unstale":"2024-05-09T01:00:18.924805+0000","last_undegraded":"2024-05-09T01:00:18.924805+0000","last_fullsized":"2024-05-09T01:00:18.924805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:15.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077246+0000","last_change":"2024-05-09T00:58:34.333154+0000","last_active":"2024-05-09T00:59:20.077246+0000","last_peered":"2024-05-09T00:59:20.077246+0000","last_clean":"2024-05-09T00:59:20.077246+0000","last_became_active":"2024-05-09T00:58:34.332469+0000","last_became_peered":"2024-05-09T00:58:34.332469+0000","last_unstale":"2024-05-09T00:59:20.077246+0000","last_undegraded":"2024-05-09T00:59:20.077246+0000","last_fullsized":"2024-05-09T00:59:20.077246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:56.343377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925242+0000","last_change":"2024-05-09T00:58:37.361595+0000","last_active":"2024-05-09T01:00:18.925242+0000","last_peered":"2024-05-09T01:00:18.925242+0000","last_clean":"2024-05-09T01:00:18.925242+0000","last_became_active":"2024-05-09T00:58:37.361239+0000","last_became_peered":"2024-05-09T00:58:37.361239+0000","last_unstale":"2024-05-09T01:00:18.925242+0000","last_undegraded":"2024-05-09T01:00:18.925242+0000","last_fullsized":"2024-05-09T01:00:18.925242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:24.526487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077067+0000","last_change":"2024-05-09T00:58:34.331974+0000","last_active":"2024-05-09T00:59:20.077067+0000","last_peered":"2024-05-09T00:59:20.077067+0000","last_clean":"2024-05-09T00:59:20.077067+0000","last_became_active":"2024-05-09T00:58:34.331460+0000","last_became_peered":"2024-05-09T00:58:34.331460+0000","last_unstale":"2024-05-09T00:59:20.077067+0000","last_undegraded":"2024-05-09T00:59:20.077067+0000","last_fullsized":"2024-05-09T00:59:20.077067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:17.746247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918863+0000","last_change":"2024-05-09T00:58:37.370155+0000","last_active":"2024-05-09T01:00:18.918863+0000","last_peered":"2024-05-09T01:00:18.918863+0000","last_clean":"2024-05-09T01:00:18.918863+0000","last_became_active":"2024-05-09T00:58:37.369351+0000","last_became_peered":"2024-05-09T00:58:37.369351+0000","last_unstale":"2024-05-09T01:00:18.918863+0000","last_undegraded":"2024-05-09T01:00:18.918863+0000","last_fullsized":"2024-05-09T01:00:18.918863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:57.494715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:52.280650+0000","last_change":"2024-05-09T00:58:34.332532+0000","last_active":"2024-05-09T01:01:52.280650+0000","last_peered":"2024-05-09T01:01:52.280650+0000","last_clean":"2024-05-09T01:01:52.280650+0000","last_became_active":"2024-05-09T00:58:34.332202+0000","last_became_peered":"2024-05-09T00:58:34.332202+0000","last_unstale":"2024-05-09T01:01:52.280650+0000","last_undegraded":"2024-05-09T01:01:52.280650+0000","last_fullsized":"2024-05-09T01:01:52.280650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:17.561374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":179,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.907192+0000","last_change":"2024-05-09T00:58:37.360504+0000","last_active":"2024-05-09T01:00:18.907192+0000","last_peered":"2024-05-09T01:00:18.907192+0000","last_clean":"2024-05-09T01:00:18.907192+0000","last_became_active":"2024-05-09T00:58:37.360078+0000","last_became_peered":"2024-05-09T00:58:37.360078+0000","last_unstale":"2024-05-09T01:00:18.907192+0000","last_undegraded":"2024-05-09T01:00:18.907192+0000","last_fullsized":"2024-05-09T01:00:18.907192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:19.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074507+0000","last_change":"2024-05-09T00:58:34.333762+0000","last_active":"2024-05-09T00:59:20.074507+0000","last_peered":"2024-05-09T00:59:20.074507+0000","last_clean":"2024-05-09T00:59:20.074507+0000","last_became_active":"2024-05-09T00:58:34.333376+0000","last_became_peered":"2024-05-09T00:58:34.333376+0000","last_unstale":"2024-05-09T00:59:20.074507+0000","last_undegraded":"2024-05-09T00:59:20.074507+0000","last_fullsized":"2024-05-09T00:59:20.074507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:58.027982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.910059+0000","last_change":"2024-05-09T00:59:20.081897+0000","last_active":"2024-05-09T01:00:18.910059+0000","last_peered":"2024-05-09T01:00:18.910059+0000","last_clean":"2024-05-09T01:00:18.910059+0000","last_became_active":"2024-05-09T00:59:20.081446+0000","last_became_peered":"2024-05-09T00:59:20.081446+0000","last_unstale":"2024-05-09T01:00:18.910059+0000","last_undegraded":"2024-05-09T01:00:18.910059+0000","last_fullsized":"2024-05-09T01:00:18.910059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:58.471576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073047+0000","last_change":"2024-05-09T00:58:34.332308+0000","last_active":"2024-05-09T00:59:20.073047+0000","last_peered":"2024-05-09T00:59:20.073047+0000","last_clean":"2024-05-09T00:59:20.073047+0000","last_became_active":"2024-05-09T00:58:34.331154+0000","last_became_peered":"2024-05-09T00:58:34.331154+0000","last_unstale":"2024-05-09T00:59:20.073047+0000","last_undegraded":"2024-05-09T00:59:20.073047+0000","last_fullsized":"2024-05-09T00:59:20.073047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.781375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920305+0000","last_change":"2024-05-09T00:58:37.368925+0000","last_active":"2024-05-09T01:00:18.920305+0000","last_peered":"2024-05-09T01:00:18.920305+0000","last_clean":"2024-05-09T01:00:18.920305+0000","last_became_active":"2024-05-09T00:58:37.368586+0000","last_became_peered":"2024-05-09T00:58:37.368586+0000","last_unstale":"2024-05-09T01:00:18.920305+0000","last_undegraded":"2024-05-09T01:00:18.920305+0000","last_fullsized":"2024-05-09T01:00:18.920305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:57.248832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078100+0000","last_change":"2024-05-09T00:58:34.334356+0000","last_active":"2024-05-09T00:59:20.078100+0000","last_peered":"2024-05-09T00:59:20.078100+0000","last_clean":"2024-05-09T00:59:20.078100+0000","last_became_active":"2024-05-09T00:58:34.333993+0000","last_became_peered":"2024-05-09T00:58:34.333993+0000","last_unstale":"2024-05-09T00:59:20.078100+0000","last_undegraded":"2024-05-09T00:59:20.078100+0000","last_fullsized":"2024-05-09T00:59:20.078100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:19.793851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915391+0000","last_change":"2024-05-09T00:58:37.360565+0000","last_active":"2024-05-09T01:00:18.915391+0000","last_peered":"2024-05-09T01:00:18.915391+0000","last_clean":"2024-05-09T01:00:18.915391+0000","last_became_active":"2024-05-09T00:58:37.360215+0000","last_became_peered":"2024-05-09T00:58:37.360215+0000","last_unstale":"2024-05-09T01:00:18.915391+0000","last_undegraded":"2024-05-09T01:00:18.915391+0000","last_fullsized":"2024-05-09T01:00:18.915391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:12.877333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'5","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.284506+0000","last_change":"2024-05-09T00:58:34.332654+0000","last_active":"2024-05-09T01:01:55.284506+0000","last_peered":"2024-05-09T01:01:55.284506+0000","last_clean":"2024-05-09T01:01:55.284506+0000","last_became_active":"2024-05-09T00:58:34.331915+0000","last_became_peered":"2024-05-09T00:58:34.331915+0000","last_unstale":"2024-05-09T01:01:55.284506+0000","last_undegraded":"2024-05-09T01:01:55.284506+0000","last_fullsized":"2024-05-09T01:01:55.284506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:47.521158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":358,"num_read_kb":358,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924836+0000","last_change":"2024-05-09T00:58:37.364248+0000","last_active":"2024-05-09T01:00:18.924836+0000","last_peered":"2024-05-09T01:00:18.924836+0000","last_clean":"2024-05-09T01:00:18.924836+0000","last_became_active":"2024-05-09T00:58:37.363872+0000","last_became_peered":"2024-05-09T00:58:37.363872+0000","last_unstale":"2024-05-09T01:00:18.924836+0000","last_undegraded":"2024-05-09T01:00:18.924836+0000","last_fullsized":"2024-05-09T01:00:18.924836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075542+0000","last_change":"2024-05-09T00:58:34.331157+0000","last_active":"2024-05-09T00:59:20.075542+0000","last_peered":"2024-05-09T00:59:20.075542+0000","last_clean":"2024-05-09T00:59:20.075542+0000","last_became_active":"2024-05-09T00:58:34.330151+0000","last_became_peered":"2024-05-09T00:58:34.330151+0000","last_unstale":"2024-05-09T00:59:20.075542+0000","last_undegraded":"2024-05-09T00:59:20.075542+0000","last_fullsized":"2024-05-09T00:59:20.075542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:07.777304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.922803+0000","last_change":"2024-05-09T00:58:37.369357+0000","last_active":"2024-05-09T01:00:18.922803+0000","last_peered":"2024-05-09T01:00:18.922803+0000","last_clean":"2024-05-09T01:00:18.922803+0000","last_became_active":"2024-05-09T00:58:37.368994+0000","last_became_peered":"2024-05-09T00:58:37.368994+0000","last_unstale":"2024-05-09T01:00:18.922803+0000","last_undegraded":"2024-05-09T01:00:18.922803+0000","last_fullsized":"2024-05-09T01:00:18.922803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079957+0000","last_change":"2024-05-09T00:58:34.822508+0000","last_active":"2024-05-09T00:59:20.079957+0000","last_peered":"2024-05-09T00:59:20.079957+0000","last_clean":"2024-05-09T00:59:20.079957+0000","last_became_active":"2024-05-09T00:58:34.821765+0000","last_became_peered":"2024-05-09T00:58:34.821765+0000","last_unstale":"2024-05-09T00:59:20.079957+0000","last_undegraded":"2024-05-09T00:59:20.079957+0000","last_fullsized":"2024-05-09T00:59:20.079957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:56.931158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926602+0000","last_change":"2024-05-09T00:58:37.362739+0000","last_active":"2024-05-09T01:00:18.926602+0000","last_peered":"2024-05-09T01:00:18.926602+0000","last_clean":"2024-05-09T01:00:18.926602+0000","last_became_active":"2024-05-09T00:58:37.362395+0000","last_became_peered":"2024-05-09T00:58:37.362395+0000","last_unstale":"2024-05-09T01:00:18.926602+0000","last_undegraded":"2024-05-09T01:00:18.926602+0000","last_fullsized":"2024-05-09T01:00:18.926602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:51.380197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'37","reported_seq":434,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.285141+0000","last_change":"2024-05-09T00:58:34.336548+0000","last_active":"2024-05-09T01:01:55.285141+0000","last_peered":"2024-05-09T01:01:55.285141+0000","last_clean":"2024-05-09T01:01:55.285141+0000","last_became_active":"2024-05-09T00:58:34.335792+0000","last_became_peered":"2024-05-09T00:58:34.335792+0000","last_unstale":"2024-05-09T01:01:55.285141+0000","last_undegraded":"2024-05-09T01:01:55.285141+0000","last_fullsized":"2024-05-09T01:01:55.285141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:37.996544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66277,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":370,"num_read_kb":250,"num_write":39,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918217+0000","last_change":"2024-05-09T00:58:37.365468+0000","last_active":"2024-05-09T01:00:18.918217+0000","last_peered":"2024-05-09T01:00:18.918217+0000","last_clean":"2024-05-09T01:00:18.918217+0000","last_became_active":"2024-05-09T00:58:37.365085+0000","last_became_peered":"2024-05-09T00:58:37.365085+0000","last_unstale":"2024-05-09T01:00:18.918217+0000","last_undegraded":"2024-05-09T01:00:18.918217+0000","last_fullsized":"2024-05-09T01:00:18.918217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:06.836757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077241+0000","last_change":"2024-05-09T00:58:34.331174+0000","last_active":"2024-05-09T00:59:20.077241+0000","last_peered":"2024-05-09T00:59:20.077241+0000","last_clean":"2024-05-09T00:59:20.077241+0000","last_became_active":"2024-05-09T00:58:34.330871+0000","last_became_peered":"2024-05-09T00:58:34.330871+0000","last_unstale":"2024-05-09T00:59:20.077241+0000","last_undegraded":"2024-05-09T00:59:20.077241+0000","last_fullsized":"2024-05-09T00:59:20.077241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:21:47.840730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915665+0000","last_change":"2024-05-09T00:58:37.367821+0000","last_active":"2024-05-09T01:00:18.915665+0000","last_peered":"2024-05-09T01:00:18.915665+0000","last_clean":"2024-05-09T01:00:18.915665+0000","last_became_active":"2024-05-09T00:58:37.367495+0000","last_became_peered":"2024-05-09T00:58:37.367495+0000","last_unstale":"2024-05-09T01:00:18.915665+0000","last_undegraded":"2024-05-09T01:00:18.915665+0000","last_fullsized":"2024-05-09T01:00:18.915665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:08.285301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078531+0000","last_change":"2024-05-09T00:58:34.334381+0000","last_active":"2024-05-09T00:59:20.078531+0000","last_peered":"2024-05-09T00:59:20.078531+0000","last_clean":"2024-05-09T00:59:20.078531+0000","last_became_active":"2024-05-09T00:58:34.333948+0000","last_became_peered":"2024-05-09T00:58:34.333948+0000","last_unstale":"2024-05-09T00:59:20.078531+0000","last_undegraded":"2024-05-09T00:59:20.078531+0000","last_fullsized":"2024-05-09T00:59:20.078531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:05.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914070+0000","last_change":"2024-05-09T00:59:20.079435+0000","last_active":"2024-05-09T01:00:18.914070+0000","last_peered":"2024-05-09T01:00:18.914070+0000","last_clean":"2024-05-09T01:00:18.914070+0000","last_became_active":"2024-05-09T00:59:20.079110+0000","last_became_peered":"2024-05-09T00:59:20.079110+0000","last_unstale":"2024-05-09T01:00:18.914070+0000","last_undegraded":"2024-05-09T01:00:18.914070+0000","last_fullsized":"2024-05-09T01:00:18.914070+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:31.449360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:53.282587+0000","last_change":"2024-05-09T00:58:34.335831+0000","last_active":"2024-05-09T01:01:53.282587+0000","last_peered":"2024-05-09T01:01:53.282587+0000","last_clean":"2024-05-09T01:01:53.282587+0000","last_became_active":"2024-05-09T00:58:34.334950+0000","last_became_peered":"2024-05-09T00:58:34.334950+0000","last_unstale":"2024-05-09T01:01:53.282587+0000","last_undegraded":"2024-05-09T01:01:53.282587+0000","last_fullsized":"2024-05-09T01:01:53.282587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:05.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914516+0000","last_change":"2024-05-09T00:58:37.373115+0000","last_active":"2024-05-09T01:00:18.914516+0000","last_peered":"2024-05-09T01:00:18.914516+0000","last_clean":"2024-05-09T01:00:18.914516+0000","last_became_active":"2024-05-09T00:58:37.369976+0000","last_became_peered":"2024-05-09T00:58:37.369976+0000","last_unstale":"2024-05-09T01:00:18.914516+0000","last_undegraded":"2024-05-09T01:00:18.914516+0000","last_fullsized":"2024-05-09T01:00:18.914516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:40.439954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:22.014590+0000","last_change":"2024-05-09T00:59:20.095889+0000","last_active":"2024-05-09T00:59:22.014590+0000","last_peered":"2024-05-09T00:59:22.014590+0000","last_clean":"2024-05-09T00:59:22.014590+0000","last_became_active":"2024-05-09T00:59:20.078865+0000","last_became_peered":"2024-05-09T00:59:20.078865+0000","last_unstale":"2024-05-09T00:59:22.014590+0000","last_undegraded":"2024-05-09T00:59:22.014590+0000","last_fullsized":"2024-05-09T00:59:22.014590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.470868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.911239+0000","last_change":"2024-05-09T00:59:20.349963+0000","last_active":"2024-05-09T01:00:18.911239+0000","last_peered":"2024-05-09T01:00:18.911239+0000","last_clean":"2024-05-09T01:00:18.911239+0000","last_became_active":"2024-05-09T00:59:20.349510+0000","last_became_peered":"2024-05-09T00:59:20.349510+0000","last_unstale":"2024-05-09T01:00:18.911239+0000","last_undegraded":"2024-05-09T01:00:18.911239+0000","last_fullsized":"2024-05-09T01:00:18.911239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:33.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077349+0000","last_change":"2024-05-09T00:58:34.331661+0000","last_active":"2024-05-09T00:59:20.077349+0000","last_peered":"2024-05-09T00:59:20.077349+0000","last_clean":"2024-05-09T00:59:20.077349+0000","last_became_active":"2024-05-09T00:58:34.331271+0000","last_became_peered":"2024-05-09T00:58:34.331271+0000","last_unstale":"2024-05-09T00:59:20.077349+0000","last_undegraded":"2024-05-09T00:59:20.077349+0000","last_fullsized":"2024-05-09T00:59:20.077349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:10.130811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923326+0000","last_change":"2024-05-09T00:58:37.367367+0000","last_active":"2024-05-09T01:00:18.923326+0000","last_peered":"2024-05-09T01:00:18.923326+0000","last_clean":"2024-05-09T01:00:18.923326+0000","last_became_active":"2024-05-09T00:58:37.366927+0000","last_became_peered":"2024-05-09T00:58:37.366927+0000","last_unstale":"2024-05-09T01:00:18.923326+0000","last_undegraded":"2024-05-09T01:00:18.923326+0000","last_fullsized":"2024-05-09T01:00:18.923326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:31.066913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077808+0000","last_change":"2024-05-09T00:58:34.821956+0000","last_active":"2024-05-09T00:59:20.077808+0000","last_peered":"2024-05-09T00:59:20.077808+0000","last_clean":"2024-05-09T00:59:20.077808+0000","last_became_active":"2024-05-09T00:58:34.821570+0000","last_became_peered":"2024-05-09T00:58:34.821570+0000","last_unstale":"2024-05-09T00:59:20.077808+0000","last_undegraded":"2024-05-09T00:59:20.077808+0000","last_fullsized":"2024-05-09T00:59:20.077808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:45.027927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.910139+0000","last_change":"2024-05-09T00:58:37.361646+0000","last_active":"2024-05-09T01:00:18.910139+0000","last_peered":"2024-05-09T01:00:18.910139+0000","last_clean":"2024-05-09T01:00:18.910139+0000","last_became_active":"2024-05-09T00:58:37.360216+0000","last_became_peered":"2024-05-09T00:58:37.360216+0000","last_unstale":"2024-05-09T01:00:18.910139+0000","last_undegraded":"2024-05-09T01:00:18.910139+0000","last_fullsized":"2024-05-09T01:00:18.910139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:13.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'5","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:53.308313+0000","last_change":"2024-05-09T00:58:34.330657+0000","last_active":"2024-05-09T01:01:53.308313+0000","last_peered":"2024-05-09T01:01:53.308313+0000","last_clean":"2024-05-09T01:01:53.308313+0000","last_became_active":"2024-05-09T00:58:34.330235+0000","last_became_peered":"2024-05-09T00:58:34.330235+0000","last_unstale":"2024-05-09T01:01:53.308313+0000","last_undegraded":"2024-05-09T01:01:53.308313+0000","last_fullsized":"2024-05-09T01:01:53.308313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:21.647916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":179,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923332+0000","last_change":"2024-05-09T00:58:37.361155+0000","last_active":"2024-05-09T01:00:18.923332+0000","last_peered":"2024-05-09T01:00:18.923332+0000","last_clean":"2024-05-09T01:00:18.923332+0000","last_became_active":"2024-05-09T00:58:37.360653+0000","last_became_peered":"2024-05-09T00:58:37.360653+0000","last_unstale":"2024-05-09T01:00:18.923332+0000","last_undegraded":"2024-05-09T01:00:18.923332+0000","last_fullsized":"2024-05-09T01:00:18.923332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:49.473522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913133+0000","last_change":"2024-05-09T00:58:37.367592+0000","last_active":"2024-05-09T01:00:18.913133+0000","last_peered":"2024-05-09T01:00:18.913133+0000","last_clean":"2024-05-09T01:00:18.913133+0000","last_became_active":"2024-05-09T00:58:37.366365+0000","last_became_peered":"2024-05-09T00:58:37.366365+0000","last_unstale":"2024-05-09T01:00:18.913133+0000","last_undegraded":"2024-05-09T01:00:18.913133+0000","last_fullsized":"2024-05-09T01:00:18.913133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:37.279269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'7","reported_seq":214,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:54.283506+0000","last_change":"2024-05-09T00:58:34.821092+0000","last_active":"2024-05-09T01:01:54.283506+0000","last_peered":"2024-05-09T01:01:54.283506+0000","last_clean":"2024-05-09T01:01:54.283506+0000","last_became_active":"2024-05-09T00:58:34.820713+0000","last_became_peered":"2024-05-09T00:58:34.820713+0000","last_unstale":"2024-05-09T01:01:54.283506+0000","last_undegraded":"2024-05-09T01:01:54.283506+0000","last_fullsized":"2024-05-09T01:01:54.283506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:11.372613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":180,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916093+0000","last_change":"2024-05-09T00:58:37.364624+0000","last_active":"2024-05-09T01:00:18.916093+0000","last_peered":"2024-05-09T01:00:18.916093+0000","last_clean":"2024-05-09T01:00:18.916093+0000","last_became_active":"2024-05-09T00:58:37.364013+0000","last_became_peered":"2024-05-09T00:58:37.364013+0000","last_unstale":"2024-05-09T01:00:18.916093+0000","last_undegraded":"2024-05-09T01:00:18.916093+0000","last_fullsized":"2024-05-09T01:00:18.916093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:14.205958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.349116+0000","last_change":"2024-05-09T00:58:34.335364+0000","last_active":"2024-05-09T00:59:20.349116+0000","last_peered":"2024-05-09T00:59:20.349116+0000","last_clean":"2024-05-09T00:59:20.349116+0000","last_became_active":"2024-05-09T00:58:34.334965+0000","last_became_peered":"2024-05-09T00:58:34.334965+0000","last_unstale":"2024-05-09T00:59:20.349116+0000","last_undegraded":"2024-05-09T00:59:20.349116+0000","last_fullsized":"2024-05-09T00:59:20.349116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:50.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:54.309227+0000","last_change":"2024-05-09T00:57:07.637377+0000","last_active":"2024-05-09T00:59:54.309227+0000","last_peered":"2024-05-09T00:59:54.309227+0000","last_clean":"2024-05-09T00:59:54.309227+0000","last_became_active":"2024-05-09T00:57:07.631727+0000","last_became_peered":"2024-05-09T00:57:07.631727+0000","last_unstale":"2024-05-09T00:59:54.309227+0000","last_undegraded":"2024-05-09T00:59:54.309227+0000","last_fullsized":"2024-05-09T00:59:54.309227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_clean_scrub_stamp":"2024-05-09T00:53:47.457762+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:09.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913540+0000","last_change":"2024-05-09T00:59:20.081462+0000","last_active":"2024-05-09T01:00:18.913540+0000","last_peered":"2024-05-09T01:00:18.913540+0000","last_clean":"2024-05-09T01:00:18.913540+0000","last_became_active":"2024-05-09T00:59:20.080955+0000","last_became_peered":"2024-05-09T00:59:20.080955+0000","last_unstale":"2024-05-09T01:00:18.913540+0000","last_undegraded":"2024-05-09T01:00:18.913540+0000","last_fullsized":"2024-05-09T01:00:18.913540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:11.106912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075413+0000","last_change":"2024-05-09T00:58:34.329694+0000","last_active":"2024-05-09T00:59:20.075413+0000","last_peered":"2024-05-09T00:59:20.075413+0000","last_clean":"2024-05-09T00:59:20.075413+0000","last_became_active":"2024-05-09T00:58:34.329267+0000","last_became_peered":"2024-05-09T00:58:34.329267+0000","last_unstale":"2024-05-09T00:59:20.075413+0000","last_undegraded":"2024-05-09T00:59:20.075413+0000","last_fullsized":"2024-05-09T00:59:20.075413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:28.060489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077124+0000","last_change":"2024-05-09T00:58:34.822706+0000","last_active":"2024-05-09T00:59:20.077124+0000","last_peered":"2024-05-09T00:59:20.077124+0000","last_clean":"2024-05-09T00:59:20.077124+0000","last_became_active":"2024-05-09T00:58:34.822223+0000","last_became_peered":"2024-05-09T00:58:34.822223+0000","last_unstale":"2024-05-09T00:59:20.077124+0000","last_undegraded":"2024-05-09T00:59:20.077124+0000","last_fullsized":"2024-05-09T00:59:20.077124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:47.378798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.908462+0000","last_change":"2024-05-09T00:58:37.360600+0000","last_active":"2024-05-09T01:00:18.908462+0000","last_peered":"2024-05-09T01:00:18.908462+0000","last_clean":"2024-05-09T01:00:18.908462+0000","last_became_active":"2024-05-09T00:58:37.360265+0000","last_became_peered":"2024-05-09T00:58:37.360265+0000","last_unstale":"2024-05-09T01:00:18.908462+0000","last_undegraded":"2024-05-09T01:00:18.908462+0000","last_fullsized":"2024-05-09T01:00:18.908462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:44.423709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:46.359462+0000","last_change":"2024-05-09T00:58:34.331544+0000","last_active":"2024-05-09T01:00:46.359462+0000","last_peered":"2024-05-09T01:00:46.359462+0000","last_clean":"2024-05-09T01:00:46.359462+0000","last_became_active":"2024-05-09T00:58:34.331147+0000","last_became_peered":"2024-05-09T00:58:34.331147+0000","last_unstale":"2024-05-09T01:00:46.359462+0000","last_undegraded":"2024-05-09T01:00:46.359462+0000","last_fullsized":"2024-05-09T01:00:46.359462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:27.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920395+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.920395+0000","last_peered":"2024-05-09T01:00:18.920395+0000","last_clean":"2024-05-09T01:00:18.920395+0000","last_became_active":"2024-05-09T00:58:37.367875+0000","last_became_peered":"2024-05-09T00:58:37.367875+0000","last_unstale":"2024-05-09T01:00:18.920395+0000","last_undegraded":"2024-05-09T01:00:18.920395+0000","last_fullsized":"2024-05-09T01:00:18.920395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:45.800008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348750+0000","last_change":"2024-05-09T00:58:34.956500+0000","last_active":"2024-05-09T00:59:20.348750+0000","last_peered":"2024-05-09T00:59:20.348750+0000","last_clean":"2024-05-09T00:59:20.348750+0000","last_became_active":"2024-05-09T00:58:34.956108+0000","last_became_peered":"2024-05-09T00:58:34.956108+0000","last_unstale":"2024-05-09T00:59:20.348750+0000","last_undegraded":"2024-05-09T00:59:20.348750+0000","last_fullsized":"2024-05-09T00:59:20.348750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:03.283325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925373+0000","last_change":"2024-05-09T00:58:37.369174+0000","last_active":"2024-05-09T01:00:18.925373+0000","last_peered":"2024-05-09T01:00:18.925373+0000","last_clean":"2024-05-09T01:00:18.925373+0000","last_became_active":"2024-05-09T00:58:37.368650+0000","last_became_peered":"2024-05-09T00:58:37.368650+0000","last_unstale":"2024-05-09T01:00:18.925373+0000","last_undegraded":"2024-05-09T01:00:18.925373+0000","last_fullsized":"2024-05-09T01:00:18.925373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:07.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.087924+0000","last_change":"2024-05-09T00:58:34.821742+0000","last_active":"2024-05-09T00:59:20.087924+0000","last_peered":"2024-05-09T00:59:20.087924+0000","last_clean":"2024-05-09T00:59:20.087924+0000","last_became_active":"2024-05-09T00:58:34.821290+0000","last_became_peered":"2024-05-09T00:58:34.821290+0000","last_unstale":"2024-05-09T00:59:20.087924+0000","last_undegraded":"2024-05-09T00:59:20.087924+0000","last_fullsized":"2024-05-09T00:59:20.087924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:18.735763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916729+0000","last_change":"2024-05-09T00:58:37.361727+0000","last_active":"2024-05-09T01:00:18.916729+0000","last_peered":"2024-05-09T01:00:18.916729+0000","last_clean":"2024-05-09T01:00:18.916729+0000","last_became_active":"2024-05-09T00:58:37.361351+0000","last_became_peered":"2024-05-09T00:58:37.361351+0000","last_unstale":"2024-05-09T01:00:18.916729+0000","last_undegraded":"2024-05-09T01:00:18.916729+0000","last_fullsized":"2024-05-09T01:00:18.916729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:14.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077949+0000","last_change":"2024-05-09T00:58:34.330578+0000","last_active":"2024-05-09T00:59:20.077949+0000","last_peered":"2024-05-09T00:59:20.077949+0000","last_clean":"2024-05-09T00:59:20.077949+0000","last_became_active":"2024-05-09T00:58:34.330273+0000","last_became_peered":"2024-05-09T00:58:34.330273+0000","last_unstale":"2024-05-09T00:59:20.077949+0000","last_undegraded":"2024-05-09T00:59:20.077949+0000","last_fullsized":"2024-05-09T00:59:20.077949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:45.795771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919919+0000","last_change":"2024-05-09T00:58:37.371323+0000","last_active":"2024-05-09T01:00:18.919919+0000","last_peered":"2024-05-09T01:00:18.919919+0000","last_clean":"2024-05-09T01:00:18.919919+0000","last_became_active":"2024-05-09T00:58:37.370942+0000","last_became_peered":"2024-05-09T00:58:37.370942+0000","last_unstale":"2024-05-09T01:00:18.919919+0000","last_undegraded":"2024-05-09T01:00:18.919919+0000","last_fullsized":"2024-05-09T01:00:18.919919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:57.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:22.014632+0000","last_change":"2024-05-09T00:59:20.099633+0000","last_active":"2024-05-09T00:59:22.014632+0000","last_peered":"2024-05-09T00:59:22.014632+0000","last_clean":"2024-05-09T00:59:22.014632+0000","last_became_active":"2024-05-09T00:59:20.080964+0000","last_became_peered":"2024-05-09T00:59:20.080964+0000","last_unstale":"2024-05-09T00:59:22.014632+0000","last_undegraded":"2024-05-09T00:59:22.014632+0000","last_fullsized":"2024-05-09T00:59:22.014632+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:53.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919046+0000","last_change":"2024-05-09T00:58:37.361319+0000","last_active":"2024-05-09T01:00:18.919046+0000","last_peered":"2024-05-09T01:00:18.919046+0000","last_clean":"2024-05-09T01:00:18.919046+0000","last_became_active":"2024-05-09T00:58:37.360703+0000","last_became_peered":"2024-05-09T00:58:37.360703+0000","last_unstale":"2024-05-09T01:00:18.919046+0000","last_undegraded":"2024-05-09T01:00:18.919046+0000","last_fullsized":"2024-05-09T01:00:18.919046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:24.202453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076552+0000","last_change":"2024-05-09T00:58:34.333394+0000","last_active":"2024-05-09T00:59:20.076552+0000","last_peered":"2024-05-09T00:59:20.076552+0000","last_clean":"2024-05-09T00:59:20.076552+0000","last_became_active":"2024-05-09T00:58:34.332902+0000","last_became_peered":"2024-05-09T00:58:34.332902+0000","last_unstale":"2024-05-09T00:59:20.076552+0000","last_undegraded":"2024-05-09T00:59:20.076552+0000","last_fullsized":"2024-05-09T00:59:20.076552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:38.301831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925516+0000","last_change":"2024-05-09T00:58:37.366963+0000","last_active":"2024-05-09T01:00:18.925516+0000","last_peered":"2024-05-09T01:00:18.925516+0000","last_clean":"2024-05-09T01:00:18.925516+0000","last_became_active":"2024-05-09T00:58:37.366591+0000","last_became_peered":"2024-05-09T00:58:37.366591+0000","last_unstale":"2024-05-09T01:00:18.925516+0000","last_undegraded":"2024-05-09T01:00:18.925516+0000","last_fullsized":"2024-05-09T01:00:18.925516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:44.894281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'7","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.285325+0000","last_change":"2024-05-09T00:58:34.956368+0000","last_active":"2024-05-09T01:01:55.285325+0000","last_peered":"2024-05-09T01:01:55.285325+0000","last_clean":"2024-05-09T01:01:55.285325+0000","last_became_active":"2024-05-09T00:58:34.955888+0000","last_became_peered":"2024-05-09T00:58:34.955888+0000","last_unstale":"2024-05-09T01:01:55.285325+0000","last_undegraded":"2024-05-09T01:01:55.285325+0000","last_fullsized":"2024-05-09T01:01:55.285325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:15.884435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926749+0000","last_change":"2024-05-09T00:58:37.368150+0000","last_active":"2024-05-09T01:00:18.926749+0000","last_peered":"2024-05-09T01:00:18.926749+0000","last_clean":"2024-05-09T01:00:18.926749+0000","last_became_active":"2024-05-09T00:58:37.367800+0000","last_became_peered":"2024-05-09T00:58:37.367800+0000","last_unstale":"2024-05-09T01:00:18.926749+0000","last_undegraded":"2024-05-09T01:00:18.926749+0000","last_fullsized":"2024-05-09T01:00:18.926749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:20.791816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.080026+0000","last_change":"2024-05-09T00:58:34.329311+0000","last_active":"2024-05-09T00:59:20.080026+0000","last_peered":"2024-05-09T00:59:20.080026+0000","last_clean":"2024-05-09T00:59:20.080026+0000","last_became_active":"2024-05-09T00:58:34.328841+0000","last_became_peered":"2024-05-09T00:58:34.328841+0000","last_unstale":"2024-05-09T00:59:20.080026+0000","last_undegraded":"2024-05-09T00:59:20.080026+0000","last_fullsized":"2024-05-09T00:59:20.080026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.912975+0000","last_change":"2024-05-09T00:58:37.369498+0000","last_active":"2024-05-09T01:00:18.912975+0000","last_peered":"2024-05-09T01:00:18.912975+0000","last_clean":"2024-05-09T01:00:18.912975+0000","last_became_active":"2024-05-09T00:58:37.369166+0000","last_became_peered":"2024-05-09T00:58:37.369166+0000","last_unstale":"2024-05-09T01:00:18.912975+0000","last_undegraded":"2024-05-09T01:00:18.912975+0000","last_fullsized":"2024-05-09T01:00:18.912975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:56.411666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073140+0000","last_change":"2024-05-09T00:58:34.328756+0000","last_active":"2024-05-09T00:59:20.073140+0000","last_peered":"2024-05-09T00:59:20.073140+0000","last_clean":"2024-05-09T00:59:20.073140+0000","last_became_active":"2024-05-09T00:58:34.328381+0000","last_became_peered":"2024-05-09T00:58:34.328381+0000","last_unstale":"2024-05-09T00:59:20.073140+0000","last_undegraded":"2024-05-09T00:59:20.073140+0000","last_fullsized":"2024-05-09T00:59:20.073140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:26.558360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925108+0000","last_change":"2024-05-09T00:58:37.369557+0000","last_active":"2024-05-09T01:00:18.925108+0000","last_peered":"2024-05-09T01:00:18.925108+0000","last_clean":"2024-05-09T01:00:18.925108+0000","last_became_active":"2024-05-09T00:58:37.369225+0000","last_became_peered":"2024-05-09T00:58:37.369225+0000","last_unstale":"2024-05-09T01:00:18.925108+0000","last_undegraded":"2024-05-09T01:00:18.925108+0000","last_fullsized":"2024-05-09T01:00:18.925108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:21.761421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920116+0000","last_change":"2024-05-09T00:58:37.369919+0000","last_active":"2024-05-09T01:00:18.920116+0000","last_peered":"2024-05-09T01:00:18.920116+0000","last_clean":"2024-05-09T01:00:18.920116+0000","last_became_active":"2024-05-09T00:58:37.369507+0000","last_became_peered":"2024-05-09T00:58:37.369507+0000","last_unstale":"2024-05-09T01:00:18.920116+0000","last_undegraded":"2024-05-09T01:00:18.920116+0000","last_fullsized":"2024-05-09T01:00:18.920116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.294074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919847+0000","last_change":"2024-05-09T00:58:37.363775+0000","last_active":"2024-05-09T01:00:18.919847+0000","last_peered":"2024-05-09T01:00:18.919847+0000","last_clean":"2024-05-09T01:00:18.919847+0000","last_became_active":"2024-05-09T00:58:37.363394+0000","last_became_peered":"2024-05-09T00:58:37.363394+0000","last_unstale":"2024-05-09T01:00:18.919847+0000","last_undegraded":"2024-05-09T01:00:18.919847+0000","last_fullsized":"2024-05-09T01:00:18.919847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.156009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919599+0000","last_change":"2024-05-09T00:58:37.357699+0000","last_active":"2024-05-09T01:00:18.919599+0000","last_peered":"2024-05-09T01:00:18.919599+0000","last_clean":"2024-05-09T01:00:18.919599+0000","last_became_active":"2024-05-09T00:58:37.357356+0000","last_became_peered":"2024-05-09T00:58:37.357356+0000","last_unstale":"2024-05-09T01:00:18.919599+0000","last_undegraded":"2024-05-09T01:00:18.919599+0000","last_fullsized":"2024-05-09T01:00:18.919599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:14.861644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925357+0000","last_change":"2024-05-09T00:58:37.369419+0000","last_active":"2024-05-09T01:00:18.925357+0000","last_peered":"2024-05-09T01:00:18.925357+0000","last_clean":"2024-05-09T01:00:18.925357+0000","last_became_active":"2024-05-09T00:58:37.363949+0000","last_became_peered":"2024-05-09T00:58:37.363949+0000","last_unstale":"2024-05-09T01:00:18.925357+0000","last_undegraded":"2024-05-09T01:00:18.925357+0000","last_fullsized":"2024-05-09T01:00:18.925357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:04.081713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919398+0000","last_change":"2024-05-09T00:58:37.373651+0000","last_active":"2024-05-09T01:00:18.919398+0000","last_peered":"2024-05-09T01:00:18.919398+0000","last_clean":"2024-05-09T01:00:18.919398+0000","last_became_active":"2024-05-09T00:58:37.373257+0000","last_became_peered":"2024-05-09T00:58:37.373257+0000","last_unstale":"2024-05-09T01:00:18.919398+0000","last_undegraded":"2024-05-09T01:00:18.919398+0000","last_fullsized":"2024-05-09T01:00:18.919398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:27.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917661+0000","last_change":"2024-05-09T00:58:37.367666+0000","last_active":"2024-05-09T01:00:18.917661+0000","last_peered":"2024-05-09T01:00:18.917661+0000","last_clean":"2024-05-09T01:00:18.917661+0000","last_became_active":"2024-05-09T00:58:37.366869+0000","last_became_peered":"2024-05-09T00:58:37.366869+0000","last_unstale":"2024-05-09T01:00:18.917661+0000","last_undegraded":"2024-05-09T01:00:18.917661+0000","last_fullsized":"2024-05-09T01:00:18.917661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:07.952594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915233+0000","last_change":"2024-05-09T00:58:37.362205+0000","last_active":"2024-05-09T01:00:18.915233+0000","last_peered":"2024-05-09T01:00:18.915233+0000","last_clean":"2024-05-09T01:00:18.915233+0000","last_became_active":"2024-05-09T00:58:37.361704+0000","last_became_peered":"2024-05-09T00:58:37.361704+0000","last_unstale":"2024-05-09T01:00:18.915233+0000","last_undegraded":"2024-05-09T01:00:18.915233+0000","last_fullsized":"2024-05-09T01:00:18.915233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:34.334593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915284+0000","last_change":"2024-05-09T00:58:37.367143+0000","last_active":"2024-05-09T01:00:18.915284+0000","last_peered":"2024-05-09T01:00:18.915284+0000","last_clean":"2024-05-09T01:00:18.915284+0000","last_became_active":"2024-05-09T00:58:37.364364+0000","last_became_peered":"2024-05-09T00:58:37.364364+0000","last_unstale":"2024-05-09T01:00:18.915284+0000","last_undegraded":"2024-05-09T01:00:18.915284+0000","last_fullsized":"2024-05-09T01:00:18.915284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:55.154458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913286+0000","last_change":"2024-05-09T00:58:37.365757+0000","last_active":"2024-05-09T01:00:18.913286+0000","last_peered":"2024-05-09T01:00:18.913286+0000","last_clean":"2024-05-09T01:00:18.913286+0000","last_became_active":"2024-05-09T00:58:37.365408+0000","last_became_peered":"2024-05-09T00:58:37.365408+0000","last_unstale":"2024-05-09T01:00:18.913286+0000","last_undegraded":"2024-05-09T01:00:18.913286+0000","last_fullsized":"2024-05-09T01:00:18.913286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920462+0000","last_change":"2024-05-09T00:58:37.366954+0000","last_active":"2024-05-09T01:00:18.920462+0000","last_peered":"2024-05-09T01:00:18.920462+0000","last_clean":"2024-05-09T01:00:18.920462+0000","last_became_active":"2024-05-09T00:58:37.364361+0000","last_became_peered":"2024-05-09T00:58:37.364361+0000","last_unstale":"2024-05-09T01:00:18.920462+0000","last_undegraded":"2024-05-09T01:00:18.920462+0000","last_fullsized":"2024-05-09T01:00:18.920462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:31.248873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926925+0000","last_change":"2024-05-09T00:58:37.368467+0000","last_active":"2024-05-09T01:00:18.926925+0000","last_peered":"2024-05-09T01:00:18.926925+0000","last_clean":"2024-05-09T01:00:18.926925+0000","last_became_active":"2024-05-09T00:58:37.368104+0000","last_became_peered":"2024-05-09T00:58:37.368104+0000","last_unstale":"2024-05-09T01:00:18.926925+0000","last_undegraded":"2024-05-09T01:00:18.926925+0000","last_fullsized":"2024-05-09T01:00:18.926925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919954+0000","last_change":"2024-05-09T00:58:37.366897+0000","last_active":"2024-05-09T01:00:18.919954+0000","last_peered":"2024-05-09T01:00:18.919954+0000","last_clean":"2024-05-09T01:00:18.919954+0000","last_became_active":"2024-05-09T00:58:37.366555+0000","last_became_peered":"2024-05-09T00:58:37.366555+0000","last_unstale":"2024-05-09T01:00:18.919954+0000","last_undegraded":"2024-05-09T01:00:18.919954+0000","last_fullsized":"2024-05-09T01:00:18.919954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.394191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923286+0000","last_change":"2024-05-09T00:58:37.358875+0000","last_active":"2024-05-09T01:00:18.923286+0000","last_peered":"2024-05-09T01:00:18.923286+0000","last_clean":"2024-05-09T01:00:18.923286+0000","last_became_active":"2024-05-09T00:58:37.358505+0000","last_became_peered":"2024-05-09T00:58:37.358505+0000","last_unstale":"2024-05-09T01:00:18.923286+0000","last_undegraded":"2024-05-09T01:00:18.923286+0000","last_fullsized":"2024-05-09T01:00:18.923286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:15.268147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74071,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1834,"num_read_kb":1001,"num_write":261,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":222213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678073,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":892928,"data_stored":431606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874301,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1089108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234056,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":431158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462988,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1503232,"data_stored":1024237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":430609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":497799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":432480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":983040,"data_stored":498551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986268,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":431310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822741,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1023075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:01:57.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 -- 172.21.15.37:0/1045343629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 msgr2=0x7f57201037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 --2- 172.21.15.37:0/1045343629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f57201037f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5710009ca0 tx=0x7f571002a8c0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 -- 172.21.15.37:0/1045343629 shutdown_connections 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 --2- 172.21.15.37:0/1045343629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5720108a30 0x7f572010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 --2- 172.21.15.37:0/1045343629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5720103d30 0x7f5720104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 --2- 172.21.15.37:0/1045343629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f57201037f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 -- 172.21.15.37:0/1045343629 >> 172.21.15.37:0/1045343629 conn(0x7f57200fdd00 msgr2=0x7f5720100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:57.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 -- 172.21.15.37:0/1045343629 shutdown_connections 2024-05-09T01:01:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 -- 172.21.15.37:0/1045343629 wait complete. 2024-05-09T01:01:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.846+0000 7f57252a7640 1 Processor -- start 2024-05-09T01:01:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f57252a7640 1 -- start start 2024-05-09T01:01:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f57252a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f5720199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f57252a7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5720103d30 0x7f57201997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f57252a7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5720108a30 0x7f57201a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f57252a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f572010e620 con 0x7f5720102af0 2024-05-09T01:01:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f57252a7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f572010e4a0 con 0x7f5720103d30 2024-05-09T01:01:57.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f57252a7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f572010e7a0 con 0x7f5720108a30 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f5720199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f5720199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57488/0 (socket says 172.21.15.37:57488) 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 -- 172.21.15.37:0/1706438569 learned_addr learned my addr 172.21.15.37:0/1706438569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571f7fe640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5720108a30 0x7f57201a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571e7fc640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5720103d30 0x7f57201997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 -- 172.21.15.37:0/1706438569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5720108a30 msgr2=0x7f57201a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5720108a30 0x7f57201a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 -- 172.21.15.37:0/1706438569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5720103d30 msgr2=0x7f57201997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5720103d30 0x7f57201997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571effd640 1 -- 172.21.15.37:0/1706438569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5720069fc0 con 0x7f5720102af0 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571f7fe640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5720108a30 0x7f57201a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.847+0000 7f571e7fc640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5720103d30 0x7f57201997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.848+0000 7f571effd640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f5720199260 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5710000f80 tx=0x7f5710003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.848+0000 7f5707fff640 1 -- 172.21.15.37:0/1706438569 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57100317c0 con 0x7f5720102af0 2024-05-09T01:01:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.848+0000 7f5707fff640 1 -- 172.21.15.37:0/1706438569 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57100044f0 con 0x7f5720102af0 2024-05-09T01:01:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.848+0000 7f5707fff640 1 -- 172.21.15.37:0/1706438569 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571002fd60 con 0x7f5720102af0 2024-05-09T01:01:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.848+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f572006a250 con 0x7f5720102af0 2024-05-09T01:01:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.848+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f572006a7f0 con 0x7f5720102af0 2024-05-09T01:01:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.849+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5720107840 con 0x7f5720102af0 2024-05-09T01:01:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.851+0000 7f5707fff640 1 -- 172.21.15.37:0/1706438569 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5710004040 con 0x7f5720102af0 2024-05-09T01:01:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.851+0000 7f5707fff640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57080b2870 0x7f57080b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.851+0000 7f571e7fc640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57080b2870 0x7f57080b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.851+0000 7f5707fff640 1 -- 172.21.15.37:0/1706438569 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5710103920 con 0x7f5720102af0 2024-05-09T01:01:57.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.852+0000 7f571e7fc640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57080b2870 0x7f57080b4d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f572019a300 tx=0x7f5714005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:57.855+0000 7f5707fff640 1 -- 172.21.15.37:0/1706438569 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f57100cb6e0 con 0x7f5720102af0 2024-05-09T01:01:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.049+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f572006aa50 con 0x7f57080b2870 2024-05-09T01:01:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.057+0000 7f5707fff640 1 -- 172.21.15.37:0/1706438569 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258873 (secure 0 0 0) 0x7f572006aa50 con 0x7f57080b2870 2024-05-09T01:01:58.060 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57080b2870 msgr2=0x7f57080b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57080b2870 0x7f57080b4d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f572019a300 tx=0x7f5714005e70 comp rx=0 tx=0).stop 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 msgr2=0x7f5720199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f5720199260 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5710000f80 tx=0x7f5710003ba0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 shutdown_connections 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5720108a30 0x7f57201a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f57080b2870 0x7f57080b4d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5720103d30 0x7f57201997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 --2- 172.21.15.37:0/1706438569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5720102af0 0x7f5720199260 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.060+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 >> 172.21.15.37:0/1706438569 conn(0x7f57200fdd00 msgr2=0x7f5720104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.061+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 shutdown_connections 2024-05-09T01:01:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.061+0000 7f57252a7640 1 -- 172.21.15.37:0/1706438569 wait complete. 2024-05-09T01:01:58.073 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-09T01:01:56.936958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664673,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1910,"num_read_kb":1065,"num_write":386,"num_write_kb":2306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382516,"kb_used_data":12564,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559308,"statfs":{"total":1151940427776,"available":1151548731392,"internally_reserved":0,"allocated":12865536,"data_stored":7151259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":83,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924302+0000","last_change":"2024-05-09T00:58:37.371502+0000","last_active":"2024-05-09T01:00:18.924302+0000","last_peered":"2024-05-09T01:00:18.924302+0000","last_clean":"2024-05-09T01:00:18.924302+0000","last_became_active":"2024-05-09T00:58:37.371172+0000","last_became_peered":"2024-05-09T00:58:37.371172+0000","last_unstale":"2024-05-09T01:00:18.924302+0000","last_undegraded":"2024-05-09T01:00:18.924302+0000","last_fullsized":"2024-05-09T01:00:18.924302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:37.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919151+0000","last_change":"2024-05-09T00:58:37.362831+0000","last_active":"2024-05-09T01:00:18.919151+0000","last_peered":"2024-05-09T01:00:18.919151+0000","last_clean":"2024-05-09T01:00:18.919151+0000","last_became_active":"2024-05-09T00:58:37.362063+0000","last_became_peered":"2024-05-09T00:58:37.362063+0000","last_unstale":"2024-05-09T01:00:18.919151+0000","last_undegraded":"2024-05-09T01:00:18.919151+0000","last_fullsized":"2024-05-09T01:00:18.919151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:01.222962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924951+0000","last_change":"2024-05-09T00:58:37.369903+0000","last_active":"2024-05-09T01:00:18.924951+0000","last_peered":"2024-05-09T01:00:18.924951+0000","last_clean":"2024-05-09T01:00:18.924951+0000","last_became_active":"2024-05-09T00:58:37.366215+0000","last_became_peered":"2024-05-09T00:58:37.366215+0000","last_unstale":"2024-05-09T01:00:18.924951+0000","last_undegraded":"2024-05-09T01:00:18.924951+0000","last_fullsized":"2024-05-09T01:00:18.924951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:47.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914741+0000","last_change":"2024-05-09T00:58:37.358878+0000","last_active":"2024-05-09T01:00:18.914741+0000","last_peered":"2024-05-09T01:00:18.914741+0000","last_clean":"2024-05-09T01:00:18.914741+0000","last_became_active":"2024-05-09T00:58:37.358516+0000","last_became_peered":"2024-05-09T00:58:37.358516+0000","last_unstale":"2024-05-09T01:00:18.914741+0000","last_undegraded":"2024-05-09T01:00:18.914741+0000","last_fullsized":"2024-05-09T01:00:18.914741+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.899081+0000","last_change":"2024-05-09T00:58:37.358196+0000","last_active":"2024-05-09T01:00:18.899081+0000","last_peered":"2024-05-09T01:00:18.899081+0000","last_clean":"2024-05-09T01:00:18.899081+0000","last_became_active":"2024-05-09T00:58:37.357840+0000","last_became_peered":"2024-05-09T00:58:37.357840+0000","last_unstale":"2024-05-09T01:00:18.899081+0000","last_undegraded":"2024-05-09T01:00:18.899081+0000","last_fullsized":"2024-05-09T01:00:18.899081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:58.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923410+0000","last_change":"2024-05-09T00:58:37.364523+0000","last_active":"2024-05-09T01:00:18.923410+0000","last_peered":"2024-05-09T01:00:18.923410+0000","last_clean":"2024-05-09T01:00:18.923410+0000","last_became_active":"2024-05-09T00:58:37.364172+0000","last_became_peered":"2024-05-09T00:58:37.364172+0000","last_unstale":"2024-05-09T01:00:18.923410+0000","last_undegraded":"2024-05-09T01:00:18.923410+0000","last_fullsized":"2024-05-09T01:00:18.923410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:36.872701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914326+0000","last_change":"2024-05-09T00:58:37.371226+0000","last_active":"2024-05-09T01:00:18.914326+0000","last_peered":"2024-05-09T01:00:18.914326+0000","last_clean":"2024-05-09T01:00:18.914326+0000","last_became_active":"2024-05-09T00:58:37.370647+0000","last_became_peered":"2024-05-09T00:58:37.370647+0000","last_unstale":"2024-05-09T01:00:18.914326+0000","last_undegraded":"2024-05-09T01:00:18.914326+0000","last_fullsized":"2024-05-09T01:00:18.914326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:46.350845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914174+0000","last_change":"2024-05-09T00:58:37.362487+0000","last_active":"2024-05-09T01:00:18.914174+0000","last_peered":"2024-05-09T01:00:18.914174+0000","last_clean":"2024-05-09T01:00:18.914174+0000","last_became_active":"2024-05-09T00:58:37.361454+0000","last_became_peered":"2024-05-09T00:58:37.361454+0000","last_unstale":"2024-05-09T01:00:18.914174+0000","last_undegraded":"2024-05-09T01:00:18.914174+0000","last_fullsized":"2024-05-09T01:00:18.914174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:36.930754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925505+0000","last_change":"2024-05-09T00:58:37.370069+0000","last_active":"2024-05-09T01:00:18.925505+0000","last_peered":"2024-05-09T01:00:18.925505+0000","last_clean":"2024-05-09T01:00:18.925505+0000","last_became_active":"2024-05-09T00:58:37.369634+0000","last_became_peered":"2024-05-09T00:58:37.369634+0000","last_unstale":"2024-05-09T01:00:18.925505+0000","last_undegraded":"2024-05-09T01:00:18.925505+0000","last_fullsized":"2024-05-09T01:00:18.925505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:22.424919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923448+0000","last_change":"2024-05-09T00:58:37.365066+0000","last_active":"2024-05-09T01:00:18.923448+0000","last_peered":"2024-05-09T01:00:18.923448+0000","last_clean":"2024-05-09T01:00:18.923448+0000","last_became_active":"2024-05-09T00:58:37.364638+0000","last_became_peered":"2024-05-09T00:58:37.364638+0000","last_unstale":"2024-05-09T01:00:18.923448+0000","last_undegraded":"2024-05-09T01:00:18.923448+0000","last_fullsized":"2024-05-09T01:00:18.923448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:14.706123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926422+0000","last_change":"2024-05-09T00:58:37.366880+0000","last_active":"2024-05-09T01:00:18.926422+0000","last_peered":"2024-05-09T01:00:18.926422+0000","last_clean":"2024-05-09T01:00:18.926422+0000","last_became_active":"2024-05-09T00:58:37.366510+0000","last_became_peered":"2024-05-09T00:58:37.366510+0000","last_unstale":"2024-05-09T01:00:18.926422+0000","last_undegraded":"2024-05-09T01:00:18.926422+0000","last_fullsized":"2024-05-09T01:00:18.926422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:36.968096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917574+0000","last_change":"2024-05-09T00:58:37.363258+0000","last_active":"2024-05-09T01:00:18.917574+0000","last_peered":"2024-05-09T01:00:18.917574+0000","last_clean":"2024-05-09T01:00:18.917574+0000","last_became_active":"2024-05-09T00:58:37.362791+0000","last_became_peered":"2024-05-09T00:58:37.362791+0000","last_unstale":"2024-05-09T01:00:18.917574+0000","last_undegraded":"2024-05-09T01:00:18.917574+0000","last_fullsized":"2024-05-09T01:00:18.917574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:03.341731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914771+0000","last_change":"2024-05-09T00:58:37.371276+0000","last_active":"2024-05-09T01:00:18.914771+0000","last_peered":"2024-05-09T01:00:18.914771+0000","last_clean":"2024-05-09T01:00:18.914771+0000","last_became_active":"2024-05-09T00:58:37.370881+0000","last_became_peered":"2024-05-09T00:58:37.370881+0000","last_unstale":"2024-05-09T01:00:18.914771+0000","last_undegraded":"2024-05-09T01:00:18.914771+0000","last_fullsized":"2024-05-09T01:00:18.914771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:14.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919600+0000","last_change":"2024-05-09T00:58:37.361394+0000","last_active":"2024-05-09T01:00:18.919600+0000","last_peered":"2024-05-09T01:00:18.919600+0000","last_clean":"2024-05-09T01:00:18.919600+0000","last_became_active":"2024-05-09T00:58:37.360669+0000","last_became_peered":"2024-05-09T00:58:37.360669+0000","last_unstale":"2024-05-09T01:00:18.919600+0000","last_undegraded":"2024-05-09T01:00:18.919600+0000","last_fullsized":"2024-05-09T01:00:18.919600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.110889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.922832+0000","last_change":"2024-05-09T00:58:37.371900+0000","last_active":"2024-05-09T01:00:18.922832+0000","last_peered":"2024-05-09T01:00:18.922832+0000","last_clean":"2024-05-09T01:00:18.922832+0000","last_became_active":"2024-05-09T00:58:37.368608+0000","last_became_peered":"2024-05-09T00:58:37.368608+0000","last_unstale":"2024-05-09T01:00:18.922832+0000","last_undegraded":"2024-05-09T01:00:18.922832+0000","last_fullsized":"2024-05-09T01:00:18.922832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:17.673058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926840+0000","last_change":"2024-05-09T00:58:37.372717+0000","last_active":"2024-05-09T01:00:18.926840+0000","last_peered":"2024-05-09T01:00:18.926840+0000","last_clean":"2024-05-09T01:00:18.926840+0000","last_became_active":"2024-05-09T00:58:37.372376+0000","last_became_peered":"2024-05-09T00:58:37.372376+0000","last_unstale":"2024-05-09T01:00:18.926840+0000","last_undegraded":"2024-05-09T01:00:18.926840+0000","last_fullsized":"2024-05-09T01:00:18.926840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:51.092242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924285+0000","last_change":"2024-05-09T00:58:37.373971+0000","last_active":"2024-05-09T01:00:18.924285+0000","last_peered":"2024-05-09T01:00:18.924285+0000","last_clean":"2024-05-09T01:00:18.924285+0000","last_became_active":"2024-05-09T00:58:37.373620+0000","last_became_peered":"2024-05-09T00:58:37.373620+0000","last_unstale":"2024-05-09T01:00:18.924285+0000","last_undegraded":"2024-05-09T01:00:18.924285+0000","last_fullsized":"2024-05-09T01:00:18.924285+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.070455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914287+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.914287+0000","last_peered":"2024-05-09T01:00:18.914287+0000","last_clean":"2024-05-09T01:00:18.914287+0000","last_became_active":"2024-05-09T00:58:37.367820+0000","last_became_peered":"2024-05-09T00:58:37.367820+0000","last_unstale":"2024-05-09T01:00:18.914287+0000","last_undegraded":"2024-05-09T01:00:18.914287+0000","last_fullsized":"2024-05-09T01:00:18.914287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:45.207654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918607+0000","last_change":"2024-05-09T00:58:37.358736+0000","last_active":"2024-05-09T01:00:18.918607+0000","last_peered":"2024-05-09T01:00:18.918607+0000","last_clean":"2024-05-09T01:00:18.918607+0000","last_became_active":"2024-05-09T00:58:37.358354+0000","last_became_peered":"2024-05-09T00:58:37.358354+0000","last_unstale":"2024-05-09T01:00:18.918607+0000","last_undegraded":"2024-05-09T01:00:18.918607+0000","last_fullsized":"2024-05-09T01:00:18.918607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:51.084484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":221,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.310479+0000","last_change":"2024-05-09T00:58:34.333847+0000","last_active":"2024-05-09T01:01:55.310479+0000","last_peered":"2024-05-09T01:01:55.310479+0000","last_clean":"2024-05-09T01:01:55.310479+0000","last_became_active":"2024-05-09T00:58:34.333479+0000","last_became_peered":"2024-05-09T00:58:34.333479+0000","last_unstale":"2024-05-09T01:01:55.310479+0000","last_undegraded":"2024-05-09T01:01:55.310479+0000","last_fullsized":"2024-05-09T01:01:55.310479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:53.709034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":181,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915386+0000","last_change":"2024-05-09T00:58:37.367327+0000","last_active":"2024-05-09T01:00:18.915386+0000","last_peered":"2024-05-09T01:00:18.915386+0000","last_clean":"2024-05-09T01:00:18.915386+0000","last_became_active":"2024-05-09T00:58:37.366973+0000","last_became_peered":"2024-05-09T00:58:37.366973+0000","last_unstale":"2024-05-09T01:00:18.915386+0000","last_undegraded":"2024-05-09T01:00:18.915386+0000","last_fullsized":"2024-05-09T01:00:18.915386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:10.610274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078289+0000","last_change":"2024-05-09T00:58:34.821107+0000","last_active":"2024-05-09T00:59:20.078289+0000","last_peered":"2024-05-09T00:59:20.078289+0000","last_clean":"2024-05-09T00:59:20.078289+0000","last_became_active":"2024-05-09T00:58:34.820737+0000","last_became_peered":"2024-05-09T00:58:34.820737+0000","last_unstale":"2024-05-09T00:59:20.078289+0000","last_undegraded":"2024-05-09T00:59:20.078289+0000","last_fullsized":"2024-05-09T00:59:20.078289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:45.450781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924805+0000","last_change":"2024-05-09T00:58:37.363559+0000","last_active":"2024-05-09T01:00:18.924805+0000","last_peered":"2024-05-09T01:00:18.924805+0000","last_clean":"2024-05-09T01:00:18.924805+0000","last_became_active":"2024-05-09T00:58:37.358299+0000","last_became_peered":"2024-05-09T00:58:37.358299+0000","last_unstale":"2024-05-09T01:00:18.924805+0000","last_undegraded":"2024-05-09T01:00:18.924805+0000","last_fullsized":"2024-05-09T01:00:18.924805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:15.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077246+0000","last_change":"2024-05-09T00:58:34.333154+0000","last_active":"2024-05-09T00:59:20.077246+0000","last_peered":"2024-05-09T00:59:20.077246+0000","last_clean":"2024-05-09T00:59:20.077246+0000","last_became_active":"2024-05-09T00:58:34.332469+0000","last_became_peered":"2024-05-09T00:58:34.332469+0000","last_unstale":"2024-05-09T00:59:20.077246+0000","last_undegraded":"2024-05-09T00:59:20.077246+0000","last_fullsized":"2024-05-09T00:59:20.077246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:56.343377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925242+0000","last_change":"2024-05-09T00:58:37.361595+0000","last_active":"2024-05-09T01:00:18.925242+0000","last_peered":"2024-05-09T01:00:18.925242+0000","last_clean":"2024-05-09T01:00:18.925242+0000","last_became_active":"2024-05-09T00:58:37.361239+0000","last_became_peered":"2024-05-09T00:58:37.361239+0000","last_unstale":"2024-05-09T01:00:18.925242+0000","last_undegraded":"2024-05-09T01:00:18.925242+0000","last_fullsized":"2024-05-09T01:00:18.925242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:24.526487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077067+0000","last_change":"2024-05-09T00:58:34.331974+0000","last_active":"2024-05-09T00:59:20.077067+0000","last_peered":"2024-05-09T00:59:20.077067+0000","last_clean":"2024-05-09T00:59:20.077067+0000","last_became_active":"2024-05-09T00:58:34.331460+0000","last_became_peered":"2024-05-09T00:58:34.331460+0000","last_unstale":"2024-05-09T00:59:20.077067+0000","last_undegraded":"2024-05-09T00:59:20.077067+0000","last_fullsized":"2024-05-09T00:59:20.077067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:17.746247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918863+0000","last_change":"2024-05-09T00:58:37.370155+0000","last_active":"2024-05-09T01:00:18.918863+0000","last_peered":"2024-05-09T01:00:18.918863+0000","last_clean":"2024-05-09T01:00:18.918863+0000","last_became_active":"2024-05-09T00:58:37.369351+0000","last_became_peered":"2024-05-09T00:58:37.369351+0000","last_unstale":"2024-05-09T01:00:18.918863+0000","last_undegraded":"2024-05-09T01:00:18.918863+0000","last_fullsized":"2024-05-09T01:00:18.918863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:57.494715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:52.280650+0000","last_change":"2024-05-09T00:58:34.332532+0000","last_active":"2024-05-09T01:01:52.280650+0000","last_peered":"2024-05-09T01:01:52.280650+0000","last_clean":"2024-05-09T01:01:52.280650+0000","last_became_active":"2024-05-09T00:58:34.332202+0000","last_became_peered":"2024-05-09T00:58:34.332202+0000","last_unstale":"2024-05-09T01:01:52.280650+0000","last_undegraded":"2024-05-09T01:01:52.280650+0000","last_fullsized":"2024-05-09T01:01:52.280650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:17.561374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":179,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.907192+0000","last_change":"2024-05-09T00:58:37.360504+0000","last_active":"2024-05-09T01:00:18.907192+0000","last_peered":"2024-05-09T01:00:18.907192+0000","last_clean":"2024-05-09T01:00:18.907192+0000","last_became_active":"2024-05-09T00:58:37.360078+0000","last_became_peered":"2024-05-09T00:58:37.360078+0000","last_unstale":"2024-05-09T01:00:18.907192+0000","last_undegraded":"2024-05-09T01:00:18.907192+0000","last_fullsized":"2024-05-09T01:00:18.907192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:19.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074507+0000","last_change":"2024-05-09T00:58:34.333762+0000","last_active":"2024-05-09T00:59:20.074507+0000","last_peered":"2024-05-09T00:59:20.074507+0000","last_clean":"2024-05-09T00:59:20.074507+0000","last_became_active":"2024-05-09T00:58:34.333376+0000","last_became_peered":"2024-05-09T00:58:34.333376+0000","last_unstale":"2024-05-09T00:59:20.074507+0000","last_undegraded":"2024-05-09T00:59:20.074507+0000","last_fullsized":"2024-05-09T00:59:20.074507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:58.027982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.910059+0000","last_change":"2024-05-09T00:59:20.081897+0000","last_active":"2024-05-09T01:00:18.910059+0000","last_peered":"2024-05-09T01:00:18.910059+0000","last_clean":"2024-05-09T01:00:18.910059+0000","last_became_active":"2024-05-09T00:59:20.081446+0000","last_became_peered":"2024-05-09T00:59:20.081446+0000","last_unstale":"2024-05-09T01:00:18.910059+0000","last_undegraded":"2024-05-09T01:00:18.910059+0000","last_fullsized":"2024-05-09T01:00:18.910059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:58.471576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073047+0000","last_change":"2024-05-09T00:58:34.332308+0000","last_active":"2024-05-09T00:59:20.073047+0000","last_peered":"2024-05-09T00:59:20.073047+0000","last_clean":"2024-05-09T00:59:20.073047+0000","last_became_active":"2024-05-09T00:58:34.331154+0000","last_became_peered":"2024-05-09T00:58:34.331154+0000","last_unstale":"2024-05-09T00:59:20.073047+0000","last_undegraded":"2024-05-09T00:59:20.073047+0000","last_fullsized":"2024-05-09T00:59:20.073047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.781375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920305+0000","last_change":"2024-05-09T00:58:37.368925+0000","last_active":"2024-05-09T01:00:18.920305+0000","last_peered":"2024-05-09T01:00:18.920305+0000","last_clean":"2024-05-09T01:00:18.920305+0000","last_became_active":"2024-05-09T00:58:37.368586+0000","last_became_peered":"2024-05-09T00:58:37.368586+0000","last_unstale":"2024-05-09T01:00:18.920305+0000","last_undegraded":"2024-05-09T01:00:18.920305+0000","last_fullsized":"2024-05-09T01:00:18.920305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:57.248832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078100+0000","last_change":"2024-05-09T00:58:34.334356+0000","last_active":"2024-05-09T00:59:20.078100+0000","last_peered":"2024-05-09T00:59:20.078100+0000","last_clean":"2024-05-09T00:59:20.078100+0000","last_became_active":"2024-05-09T00:58:34.333993+0000","last_became_peered":"2024-05-09T00:58:34.333993+0000","last_unstale":"2024-05-09T00:59:20.078100+0000","last_undegraded":"2024-05-09T00:59:20.078100+0000","last_fullsized":"2024-05-09T00:59:20.078100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:19.793851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915391+0000","last_change":"2024-05-09T00:58:37.360565+0000","last_active":"2024-05-09T01:00:18.915391+0000","last_peered":"2024-05-09T01:00:18.915391+0000","last_clean":"2024-05-09T01:00:18.915391+0000","last_became_active":"2024-05-09T00:58:37.360215+0000","last_became_peered":"2024-05-09T00:58:37.360215+0000","last_unstale":"2024-05-09T01:00:18.915391+0000","last_undegraded":"2024-05-09T01:00:18.915391+0000","last_fullsized":"2024-05-09T01:00:18.915391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:12.877333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'5","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.284506+0000","last_change":"2024-05-09T00:58:34.332654+0000","last_active":"2024-05-09T01:01:55.284506+0000","last_peered":"2024-05-09T01:01:55.284506+0000","last_clean":"2024-05-09T01:01:55.284506+0000","last_became_active":"2024-05-09T00:58:34.331915+0000","last_became_peered":"2024-05-09T00:58:34.331915+0000","last_unstale":"2024-05-09T01:01:55.284506+0000","last_undegraded":"2024-05-09T01:01:55.284506+0000","last_fullsized":"2024-05-09T01:01:55.284506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:47.521158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":358,"num_read_kb":358,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924836+0000","last_change":"2024-05-09T00:58:37.364248+0000","last_active":"2024-05-09T01:00:18.924836+0000","last_peered":"2024-05-09T01:00:18.924836+0000","last_clean":"2024-05-09T01:00:18.924836+0000","last_became_active":"2024-05-09T00:58:37.363872+0000","last_became_peered":"2024-05-09T00:58:37.363872+0000","last_unstale":"2024-05-09T01:00:18.924836+0000","last_undegraded":"2024-05-09T01:00:18.924836+0000","last_fullsized":"2024-05-09T01:00:18.924836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075542+0000","last_change":"2024-05-09T00:58:34.331157+0000","last_active":"2024-05-09T00:59:20.075542+0000","last_peered":"2024-05-09T00:59:20.075542+0000","last_clean":"2024-05-09T00:59:20.075542+0000","last_became_active":"2024-05-09T00:58:34.330151+0000","last_became_peered":"2024-05-09T00:58:34.330151+0000","last_unstale":"2024-05-09T00:59:20.075542+0000","last_undegraded":"2024-05-09T00:59:20.075542+0000","last_fullsized":"2024-05-09T00:59:20.075542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:07.777304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.922803+0000","last_change":"2024-05-09T00:58:37.369357+0000","last_active":"2024-05-09T01:00:18.922803+0000","last_peered":"2024-05-09T01:00:18.922803+0000","last_clean":"2024-05-09T01:00:18.922803+0000","last_became_active":"2024-05-09T00:58:37.368994+0000","last_became_peered":"2024-05-09T00:58:37.368994+0000","last_unstale":"2024-05-09T01:00:18.922803+0000","last_undegraded":"2024-05-09T01:00:18.922803+0000","last_fullsized":"2024-05-09T01:00:18.922803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079957+0000","last_change":"2024-05-09T00:58:34.822508+0000","last_active":"2024-05-09T00:59:20.079957+0000","last_peered":"2024-05-09T00:59:20.079957+0000","last_clean":"2024-05-09T00:59:20.079957+0000","last_became_active":"2024-05-09T00:58:34.821765+0000","last_became_peered":"2024-05-09T00:58:34.821765+0000","last_unstale":"2024-05-09T00:59:20.079957+0000","last_undegraded":"2024-05-09T00:59:20.079957+0000","last_fullsized":"2024-05-09T00:59:20.079957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:56.931158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926602+0000","last_change":"2024-05-09T00:58:37.362739+0000","last_active":"2024-05-09T01:00:18.926602+0000","last_peered":"2024-05-09T01:00:18.926602+0000","last_clean":"2024-05-09T01:00:18.926602+0000","last_became_active":"2024-05-09T00:58:37.362395+0000","last_became_peered":"2024-05-09T00:58:37.362395+0000","last_unstale":"2024-05-09T01:00:18.926602+0000","last_undegraded":"2024-05-09T01:00:18.926602+0000","last_fullsized":"2024-05-09T01:00:18.926602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:51.380197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'37","reported_seq":434,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.285141+0000","last_change":"2024-05-09T00:58:34.336548+0000","last_active":"2024-05-09T01:01:55.285141+0000","last_peered":"2024-05-09T01:01:55.285141+0000","last_clean":"2024-05-09T01:01:55.285141+0000","last_became_active":"2024-05-09T00:58:34.335792+0000","last_became_peered":"2024-05-09T00:58:34.335792+0000","last_unstale":"2024-05-09T01:01:55.285141+0000","last_undegraded":"2024-05-09T01:01:55.285141+0000","last_fullsized":"2024-05-09T01:01:55.285141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:37.996544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66277,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":370,"num_read_kb":250,"num_write":39,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918217+0000","last_change":"2024-05-09T00:58:37.365468+0000","last_active":"2024-05-09T01:00:18.918217+0000","last_peered":"2024-05-09T01:00:18.918217+0000","last_clean":"2024-05-09T01:00:18.918217+0000","last_became_active":"2024-05-09T00:58:37.365085+0000","last_became_peered":"2024-05-09T00:58:37.365085+0000","last_unstale":"2024-05-09T01:00:18.918217+0000","last_undegraded":"2024-05-09T01:00:18.918217+0000","last_fullsized":"2024-05-09T01:00:18.918217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:06.836757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077241+0000","last_change":"2024-05-09T00:58:34.331174+0000","last_active":"2024-05-09T00:59:20.077241+0000","last_peered":"2024-05-09T00:59:20.077241+0000","last_clean":"2024-05-09T00:59:20.077241+0000","last_became_active":"2024-05-09T00:58:34.330871+0000","last_became_peered":"2024-05-09T00:58:34.330871+0000","last_unstale":"2024-05-09T00:59:20.077241+0000","last_undegraded":"2024-05-09T00:59:20.077241+0000","last_fullsized":"2024-05-09T00:59:20.077241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:21:47.840730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915665+0000","last_change":"2024-05-09T00:58:37.367821+0000","last_active":"2024-05-09T01:00:18.915665+0000","last_peered":"2024-05-09T01:00:18.915665+0000","last_clean":"2024-05-09T01:00:18.915665+0000","last_became_active":"2024-05-09T00:58:37.367495+0000","last_became_peered":"2024-05-09T00:58:37.367495+0000","last_unstale":"2024-05-09T01:00:18.915665+0000","last_undegraded":"2024-05-09T01:00:18.915665+0000","last_fullsized":"2024-05-09T01:00:18.915665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:08.285301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078531+0000","last_change":"2024-05-09T00:58:34.334381+0000","last_active":"2024-05-09T00:59:20.078531+0000","last_peered":"2024-05-09T00:59:20.078531+0000","last_clean":"2024-05-09T00:59:20.078531+0000","last_became_active":"2024-05-09T00:58:34.333948+0000","last_became_peered":"2024-05-09T00:58:34.333948+0000","last_unstale":"2024-05-09T00:59:20.078531+0000","last_undegraded":"2024-05-09T00:59:20.078531+0000","last_fullsized":"2024-05-09T00:59:20.078531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:05.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914070+0000","last_change":"2024-05-09T00:59:20.079435+0000","last_active":"2024-05-09T01:00:18.914070+0000","last_peered":"2024-05-09T01:00:18.914070+0000","last_clean":"2024-05-09T01:00:18.914070+0000","last_became_active":"2024-05-09T00:59:20.079110+0000","last_became_peered":"2024-05-09T00:59:20.079110+0000","last_unstale":"2024-05-09T01:00:18.914070+0000","last_undegraded":"2024-05-09T01:00:18.914070+0000","last_fullsized":"2024-05-09T01:00:18.914070+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:31.449360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:53.282587+0000","last_change":"2024-05-09T00:58:34.335831+0000","last_active":"2024-05-09T01:01:53.282587+0000","last_peered":"2024-05-09T01:01:53.282587+0000","last_clean":"2024-05-09T01:01:53.282587+0000","last_became_active":"2024-05-09T00:58:34.334950+0000","last_became_peered":"2024-05-09T00:58:34.334950+0000","last_unstale":"2024-05-09T01:01:53.282587+0000","last_undegraded":"2024-05-09T01:01:53.282587+0000","last_fullsized":"2024-05-09T01:01:53.282587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:05.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914516+0000","last_change":"2024-05-09T00:58:37.373115+0000","last_active":"2024-05-09T01:00:18.914516+0000","last_peered":"2024-05-09T01:00:18.914516+0000","last_clean":"2024-05-09T01:00:18.914516+0000","last_became_active":"2024-05-09T00:58:37.369976+0000","last_became_peered":"2024-05-09T00:58:37.369976+0000","last_unstale":"2024-05-09T01:00:18.914516+0000","last_undegraded":"2024-05-09T01:00:18.914516+0000","last_fullsized":"2024-05-09T01:00:18.914516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:40.439954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:22.014590+0000","last_change":"2024-05-09T00:59:20.095889+0000","last_active":"2024-05-09T00:59:22.014590+0000","last_peered":"2024-05-09T00:59:22.014590+0000","last_clean":"2024-05-09T00:59:22.014590+0000","last_became_active":"2024-05-09T00:59:20.078865+0000","last_became_peered":"2024-05-09T00:59:20.078865+0000","last_unstale":"2024-05-09T00:59:22.014590+0000","last_undegraded":"2024-05-09T00:59:22.014590+0000","last_fullsized":"2024-05-09T00:59:22.014590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.470868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.911239+0000","last_change":"2024-05-09T00:59:20.349963+0000","last_active":"2024-05-09T01:00:18.911239+0000","last_peered":"2024-05-09T01:00:18.911239+0000","last_clean":"2024-05-09T01:00:18.911239+0000","last_became_active":"2024-05-09T00:59:20.349510+0000","last_became_peered":"2024-05-09T00:59:20.349510+0000","last_unstale":"2024-05-09T01:00:18.911239+0000","last_undegraded":"2024-05-09T01:00:18.911239+0000","last_fullsized":"2024-05-09T01:00:18.911239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:33.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077349+0000","last_change":"2024-05-09T00:58:34.331661+0000","last_active":"2024-05-09T00:59:20.077349+0000","last_peered":"2024-05-09T00:59:20.077349+0000","last_clean":"2024-05-09T00:59:20.077349+0000","last_became_active":"2024-05-09T00:58:34.331271+0000","last_became_peered":"2024-05-09T00:58:34.331271+0000","last_unstale":"2024-05-09T00:59:20.077349+0000","last_undegraded":"2024-05-09T00:59:20.077349+0000","last_fullsized":"2024-05-09T00:59:20.077349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:10.130811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923326+0000","last_change":"2024-05-09T00:58:37.367367+0000","last_active":"2024-05-09T01:00:18.923326+0000","last_peered":"2024-05-09T01:00:18.923326+0000","last_clean":"2024-05-09T01:00:18.923326+0000","last_became_active":"2024-05-09T00:58:37.366927+0000","last_became_peered":"2024-05-09T00:58:37.366927+0000","last_unstale":"2024-05-09T01:00:18.923326+0000","last_undegraded":"2024-05-09T01:00:18.923326+0000","last_fullsized":"2024-05-09T01:00:18.923326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:31.066913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077808+0000","last_change":"2024-05-09T00:58:34.821956+0000","last_active":"2024-05-09T00:59:20.077808+0000","last_peered":"2024-05-09T00:59:20.077808+0000","last_clean":"2024-05-09T00:59:20.077808+0000","last_became_active":"2024-05-09T00:58:34.821570+0000","last_became_peered":"2024-05-09T00:58:34.821570+0000","last_unstale":"2024-05-09T00:59:20.077808+0000","last_undegraded":"2024-05-09T00:59:20.077808+0000","last_fullsized":"2024-05-09T00:59:20.077808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:45.027927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.910139+0000","last_change":"2024-05-09T00:58:37.361646+0000","last_active":"2024-05-09T01:00:18.910139+0000","last_peered":"2024-05-09T01:00:18.910139+0000","last_clean":"2024-05-09T01:00:18.910139+0000","last_became_active":"2024-05-09T00:58:37.360216+0000","last_became_peered":"2024-05-09T00:58:37.360216+0000","last_unstale":"2024-05-09T01:00:18.910139+0000","last_undegraded":"2024-05-09T01:00:18.910139+0000","last_fullsized":"2024-05-09T01:00:18.910139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:13.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'5","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:53.308313+0000","last_change":"2024-05-09T00:58:34.330657+0000","last_active":"2024-05-09T01:01:53.308313+0000","last_peered":"2024-05-09T01:01:53.308313+0000","last_clean":"2024-05-09T01:01:53.308313+0000","last_became_active":"2024-05-09T00:58:34.330235+0000","last_became_peered":"2024-05-09T00:58:34.330235+0000","last_unstale":"2024-05-09T01:01:53.308313+0000","last_undegraded":"2024-05-09T01:01:53.308313+0000","last_fullsized":"2024-05-09T01:01:53.308313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:21.647916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":179,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923332+0000","last_change":"2024-05-09T00:58:37.361155+0000","last_active":"2024-05-09T01:00:18.923332+0000","last_peered":"2024-05-09T01:00:18.923332+0000","last_clean":"2024-05-09T01:00:18.923332+0000","last_became_active":"2024-05-09T00:58:37.360653+0000","last_became_peered":"2024-05-09T00:58:37.360653+0000","last_unstale":"2024-05-09T01:00:18.923332+0000","last_undegraded":"2024-05-09T01:00:18.923332+0000","last_fullsized":"2024-05-09T01:00:18.923332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:49.473522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913133+0000","last_change":"2024-05-09T00:58:37.367592+0000","last_active":"2024-05-09T01:00:18.913133+0000","last_peered":"2024-05-09T01:00:18.913133+0000","last_clean":"2024-05-09T01:00:18.913133+0000","last_became_active":"2024-05-09T00:58:37.366365+0000","last_became_peered":"2024-05-09T00:58:37.366365+0000","last_unstale":"2024-05-09T01:00:18.913133+0000","last_undegraded":"2024-05-09T01:00:18.913133+0000","last_fullsized":"2024-05-09T01:00:18.913133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:37.279269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'7","reported_seq":214,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:54.283506+0000","last_change":"2024-05-09T00:58:34.821092+0000","last_active":"2024-05-09T01:01:54.283506+0000","last_peered":"2024-05-09T01:01:54.283506+0000","last_clean":"2024-05-09T01:01:54.283506+0000","last_became_active":"2024-05-09T00:58:34.820713+0000","last_became_peered":"2024-05-09T00:58:34.820713+0000","last_unstale":"2024-05-09T01:01:54.283506+0000","last_undegraded":"2024-05-09T01:01:54.283506+0000","last_fullsized":"2024-05-09T01:01:54.283506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:11.372613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":180,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916093+0000","last_change":"2024-05-09T00:58:37.364624+0000","last_active":"2024-05-09T01:00:18.916093+0000","last_peered":"2024-05-09T01:00:18.916093+0000","last_clean":"2024-05-09T01:00:18.916093+0000","last_became_active":"2024-05-09T00:58:37.364013+0000","last_became_peered":"2024-05-09T00:58:37.364013+0000","last_unstale":"2024-05-09T01:00:18.916093+0000","last_undegraded":"2024-05-09T01:00:18.916093+0000","last_fullsized":"2024-05-09T01:00:18.916093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:14.205958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.349116+0000","last_change":"2024-05-09T00:58:34.335364+0000","last_active":"2024-05-09T00:59:20.349116+0000","last_peered":"2024-05-09T00:59:20.349116+0000","last_clean":"2024-05-09T00:59:20.349116+0000","last_became_active":"2024-05-09T00:58:34.334965+0000","last_became_peered":"2024-05-09T00:58:34.334965+0000","last_unstale":"2024-05-09T00:59:20.349116+0000","last_undegraded":"2024-05-09T00:59:20.349116+0000","last_fullsized":"2024-05-09T00:59:20.349116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:50.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:54.309227+0000","last_change":"2024-05-09T00:57:07.637377+0000","last_active":"2024-05-09T00:59:54.309227+0000","last_peered":"2024-05-09T00:59:54.309227+0000","last_clean":"2024-05-09T00:59:54.309227+0000","last_became_active":"2024-05-09T00:57:07.631727+0000","last_became_peered":"2024-05-09T00:57:07.631727+0000","last_unstale":"2024-05-09T00:59:54.309227+0000","last_undegraded":"2024-05-09T00:59:54.309227+0000","last_fullsized":"2024-05-09T00:59:54.309227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_clean_scrub_stamp":"2024-05-09T00:53:47.457762+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:09.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913540+0000","last_change":"2024-05-09T00:59:20.081462+0000","last_active":"2024-05-09T01:00:18.913540+0000","last_peered":"2024-05-09T01:00:18.913540+0000","last_clean":"2024-05-09T01:00:18.913540+0000","last_became_active":"2024-05-09T00:59:20.080955+0000","last_became_peered":"2024-05-09T00:59:20.080955+0000","last_unstale":"2024-05-09T01:00:18.913540+0000","last_undegraded":"2024-05-09T01:00:18.913540+0000","last_fullsized":"2024-05-09T01:00:18.913540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:11.106912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075413+0000","last_change":"2024-05-09T00:58:34.329694+0000","last_active":"2024-05-09T00:59:20.075413+0000","last_peered":"2024-05-09T00:59:20.075413+0000","last_clean":"2024-05-09T00:59:20.075413+0000","last_became_active":"2024-05-09T00:58:34.329267+0000","last_became_peered":"2024-05-09T00:58:34.329267+0000","last_unstale":"2024-05-09T00:59:20.075413+0000","last_undegraded":"2024-05-09T00:59:20.075413+0000","last_fullsized":"2024-05-09T00:59:20.075413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:28.060489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077124+0000","last_change":"2024-05-09T00:58:34.822706+0000","last_active":"2024-05-09T00:59:20.077124+0000","last_peered":"2024-05-09T00:59:20.077124+0000","last_clean":"2024-05-09T00:59:20.077124+0000","last_became_active":"2024-05-09T00:58:34.822223+0000","last_became_peered":"2024-05-09T00:58:34.822223+0000","last_unstale":"2024-05-09T00:59:20.077124+0000","last_undegraded":"2024-05-09T00:59:20.077124+0000","last_fullsized":"2024-05-09T00:59:20.077124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:47.378798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.908462+0000","last_change":"2024-05-09T00:58:37.360600+0000","last_active":"2024-05-09T01:00:18.908462+0000","last_peered":"2024-05-09T01:00:18.908462+0000","last_clean":"2024-05-09T01:00:18.908462+0000","last_became_active":"2024-05-09T00:58:37.360265+0000","last_became_peered":"2024-05-09T00:58:37.360265+0000","last_unstale":"2024-05-09T01:00:18.908462+0000","last_undegraded":"2024-05-09T01:00:18.908462+0000","last_fullsized":"2024-05-09T01:00:18.908462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:44.423709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:46.359462+0000","last_change":"2024-05-09T00:58:34.331544+0000","last_active":"2024-05-09T01:00:46.359462+0000","last_peered":"2024-05-09T01:00:46.359462+0000","last_clean":"2024-05-09T01:00:46.359462+0000","last_became_active":"2024-05-09T00:58:34.331147+0000","last_became_peered":"2024-05-09T00:58:34.331147+0000","last_unstale":"2024-05-09T01:00:46.359462+0000","last_undegraded":"2024-05-09T01:00:46.359462+0000","last_fullsized":"2024-05-09T01:00:46.359462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:27.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920395+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.920395+0000","last_peered":"2024-05-09T01:00:18.920395+0000","last_clean":"2024-05-09T01:00:18.920395+0000","last_became_active":"2024-05-09T00:58:37.367875+0000","last_became_peered":"2024-05-09T00:58:37.367875+0000","last_unstale":"2024-05-09T01:00:18.920395+0000","last_undegraded":"2024-05-09T01:00:18.920395+0000","last_fullsized":"2024-05-09T01:00:18.920395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:45.800008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348750+0000","last_change":"2024-05-09T00:58:34.956500+0000","last_active":"2024-05-09T00:59:20.348750+0000","last_peered":"2024-05-09T00:59:20.348750+0000","last_clean":"2024-05-09T00:59:20.348750+0000","last_became_active":"2024-05-09T00:58:34.956108+0000","last_became_peered":"2024-05-09T00:58:34.956108+0000","last_unstale":"2024-05-09T00:59:20.348750+0000","last_undegraded":"2024-05-09T00:59:20.348750+0000","last_fullsized":"2024-05-09T00:59:20.348750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:03.283325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925373+0000","last_change":"2024-05-09T00:58:37.369174+0000","last_active":"2024-05-09T01:00:18.925373+0000","last_peered":"2024-05-09T01:00:18.925373+0000","last_clean":"2024-05-09T01:00:18.925373+0000","last_became_active":"2024-05-09T00:58:37.368650+0000","last_became_peered":"2024-05-09T00:58:37.368650+0000","last_unstale":"2024-05-09T01:00:18.925373+0000","last_undegraded":"2024-05-09T01:00:18.925373+0000","last_fullsized":"2024-05-09T01:00:18.925373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:07.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.087924+0000","last_change":"2024-05-09T00:58:34.821742+0000","last_active":"2024-05-09T00:59:20.087924+0000","last_peered":"2024-05-09T00:59:20.087924+0000","last_clean":"2024-05-09T00:59:20.087924+0000","last_became_active":"2024-05-09T00:58:34.821290+0000","last_became_peered":"2024-05-09T00:58:34.821290+0000","last_unstale":"2024-05-09T00:59:20.087924+0000","last_undegraded":"2024-05-09T00:59:20.087924+0000","last_fullsized":"2024-05-09T00:59:20.087924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:18.735763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916729+0000","last_change":"2024-05-09T00:58:37.361727+0000","last_active":"2024-05-09T01:00:18.916729+0000","last_peered":"2024-05-09T01:00:18.916729+0000","last_clean":"2024-05-09T01:00:18.916729+0000","last_became_active":"2024-05-09T00:58:37.361351+0000","last_became_peered":"2024-05-09T00:58:37.361351+0000","last_unstale":"2024-05-09T01:00:18.916729+0000","last_undegraded":"2024-05-09T01:00:18.916729+0000","last_fullsized":"2024-05-09T01:00:18.916729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:14.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077949+0000","last_change":"2024-05-09T00:58:34.330578+0000","last_active":"2024-05-09T00:59:20.077949+0000","last_peered":"2024-05-09T00:59:20.077949+0000","last_clean":"2024-05-09T00:59:20.077949+0000","last_became_active":"2024-05-09T00:58:34.330273+0000","last_became_peered":"2024-05-09T00:58:34.330273+0000","last_unstale":"2024-05-09T00:59:20.077949+0000","last_undegraded":"2024-05-09T00:59:20.077949+0000","last_fullsized":"2024-05-09T00:59:20.077949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:45.795771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919919+0000","last_change":"2024-05-09T00:58:37.371323+0000","last_active":"2024-05-09T01:00:18.919919+0000","last_peered":"2024-05-09T01:00:18.919919+0000","last_clean":"2024-05-09T01:00:18.919919+0000","last_became_active":"2024-05-09T00:58:37.370942+0000","last_became_peered":"2024-05-09T00:58:37.370942+0000","last_unstale":"2024-05-09T01:00:18.919919+0000","last_undegraded":"2024-05-09T01:00:18.919919+0000","last_fullsized":"2024-05-09T01:00:18.919919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:57.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:22.014632+0000","last_change":"2024-05-09T00:59:20.099633+0000","last_active":"2024-05-09T00:59:22.014632+0000","last_peered":"2024-05-09T00:59:22.014632+0000","last_clean":"2024-05-09T00:59:22.014632+0000","last_became_active":"2024-05-09T00:59:20.080964+0000","last_became_peered":"2024-05-09T00:59:20.080964+0000","last_unstale":"2024-05-09T00:59:22.014632+0000","last_undegraded":"2024-05-09T00:59:22.014632+0000","last_fullsized":"2024-05-09T00:59:22.014632+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:53.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919046+0000","last_change":"2024-05-09T00:58:37.361319+0000","last_active":"2024-05-09T01:00:18.919046+0000","last_peered":"2024-05-09T01:00:18.919046+0000","last_clean":"2024-05-09T01:00:18.919046+0000","last_became_active":"2024-05-09T00:58:37.360703+0000","last_became_peered":"2024-05-09T00:58:37.360703+0000","last_unstale":"2024-05-09T01:00:18.919046+0000","last_undegraded":"2024-05-09T01:00:18.919046+0000","last_fullsized":"2024-05-09T01:00:18.919046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:24.202453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076552+0000","last_change":"2024-05-09T00:58:34.333394+0000","last_active":"2024-05-09T00:59:20.076552+0000","last_peered":"2024-05-09T00:59:20.076552+0000","last_clean":"2024-05-09T00:59:20.076552+0000","last_became_active":"2024-05-09T00:58:34.332902+0000","last_became_peered":"2024-05-09T00:58:34.332902+0000","last_unstale":"2024-05-09T00:59:20.076552+0000","last_undegraded":"2024-05-09T00:59:20.076552+0000","last_fullsized":"2024-05-09T00:59:20.076552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:38.301831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925516+0000","last_change":"2024-05-09T00:58:37.366963+0000","last_active":"2024-05-09T01:00:18.925516+0000","last_peered":"2024-05-09T01:00:18.925516+0000","last_clean":"2024-05-09T01:00:18.925516+0000","last_became_active":"2024-05-09T00:58:37.366591+0000","last_became_peered":"2024-05-09T00:58:37.366591+0000","last_unstale":"2024-05-09T01:00:18.925516+0000","last_undegraded":"2024-05-09T01:00:18.925516+0000","last_fullsized":"2024-05-09T01:00:18.925516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:44.894281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'7","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.285325+0000","last_change":"2024-05-09T00:58:34.956368+0000","last_active":"2024-05-09T01:01:55.285325+0000","last_peered":"2024-05-09T01:01:55.285325+0000","last_clean":"2024-05-09T01:01:55.285325+0000","last_became_active":"2024-05-09T00:58:34.955888+0000","last_became_peered":"2024-05-09T00:58:34.955888+0000","last_unstale":"2024-05-09T01:01:55.285325+0000","last_undegraded":"2024-05-09T01:01:55.285325+0000","last_fullsized":"2024-05-09T01:01:55.285325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:15.884435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926749+0000","last_change":"2024-05-09T00:58:37.368150+0000","last_active":"2024-05-09T01:00:18.926749+0000","last_peered":"2024-05-09T01:00:18.926749+0000","last_clean":"2024-05-09T01:00:18.926749+0000","last_became_active":"2024-05-09T00:58:37.367800+0000","last_became_peered":"2024-05-09T00:58:37.367800+0000","last_unstale":"2024-05-09T01:00:18.926749+0000","last_undegraded":"2024-05-09T01:00:18.926749+0000","last_fullsized":"2024-05-09T01:00:18.926749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:20.791816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.080026+0000","last_change":"2024-05-09T00:58:34.329311+0000","last_active":"2024-05-09T00:59:20.080026+0000","last_peered":"2024-05-09T00:59:20.080026+0000","last_clean":"2024-05-09T00:59:20.080026+0000","last_became_active":"2024-05-09T00:58:34.328841+0000","last_became_peered":"2024-05-09T00:58:34.328841+0000","last_unstale":"2024-05-09T00:59:20.080026+0000","last_undegraded":"2024-05-09T00:59:20.080026+0000","last_fullsized":"2024-05-09T00:59:20.080026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.912975+0000","last_change":"2024-05-09T00:58:37.369498+0000","last_active":"2024-05-09T01:00:18.912975+0000","last_peered":"2024-05-09T01:00:18.912975+0000","last_clean":"2024-05-09T01:00:18.912975+0000","last_became_active":"2024-05-09T00:58:37.369166+0000","last_became_peered":"2024-05-09T00:58:37.369166+0000","last_unstale":"2024-05-09T01:00:18.912975+0000","last_undegraded":"2024-05-09T01:00:18.912975+0000","last_fullsized":"2024-05-09T01:00:18.912975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:56.411666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073140+0000","last_change":"2024-05-09T00:58:34.328756+0000","last_active":"2024-05-09T00:59:20.073140+0000","last_peered":"2024-05-09T00:59:20.073140+0000","last_clean":"2024-05-09T00:59:20.073140+0000","last_became_active":"2024-05-09T00:58:34.328381+0000","last_became_peered":"2024-05-09T00:58:34.328381+0000","last_unstale":"2024-05-09T00:59:20.073140+0000","last_undegraded":"2024-05-09T00:59:20.073140+0000","last_fullsized":"2024-05-09T00:59:20.073140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:26.558360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925108+0000","last_change":"2024-05-09T00:58:37.369557+0000","last_active":"2024-05-09T01:00:18.925108+0000","last_peered":"2024-05-09T01:00:18.925108+0000","last_clean":"2024-05-09T01:00:18.925108+0000","last_became_active":"2024-05-09T00:58:37.369225+0000","last_became_peered":"2024-05-09T00:58:37.369225+0000","last_unstale":"2024-05-09T01:00:18.925108+0000","last_undegraded":"2024-05-09T01:00:18.925108+0000","last_fullsized":"2024-05-09T01:00:18.925108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:21.761421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920116+0000","last_change":"2024-05-09T00:58:37.369919+0000","last_active":"2024-05-09T01:00:18.920116+0000","last_peered":"2024-05-09T01:00:18.920116+0000","last_clean":"2024-05-09T01:00:18.920116+0000","last_became_active":"2024-05-09T00:58:37.369507+0000","last_became_peered":"2024-05-09T00:58:37.369507+0000","last_unstale":"2024-05-09T01:00:18.920116+0000","last_undegraded":"2024-05-09T01:00:18.920116+0000","last_fullsized":"2024-05-09T01:00:18.920116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.294074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919847+0000","last_change":"2024-05-09T00:58:37.363775+0000","last_active":"2024-05-09T01:00:18.919847+0000","last_peered":"2024-05-09T01:00:18.919847+0000","last_clean":"2024-05-09T01:00:18.919847+0000","last_became_active":"2024-05-09T00:58:37.363394+0000","last_became_peered":"2024-05-09T00:58:37.363394+0000","last_unstale":"2024-05-09T01:00:18.919847+0000","last_undegraded":"2024-05-09T01:00:18.919847+0000","last_fullsized":"2024-05-09T01:00:18.919847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.156009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919599+0000","last_change":"2024-05-09T00:58:37.357699+0000","last_active":"2024-05-09T01:00:18.919599+0000","last_peered":"2024-05-09T01:00:18.919599+0000","last_clean":"2024-05-09T01:00:18.919599+0000","last_became_active":"2024-05-09T00:58:37.357356+0000","last_became_peered":"2024-05-09T00:58:37.357356+0000","last_unstale":"2024-05-09T01:00:18.919599+0000","last_undegraded":"2024-05-09T01:00:18.919599+0000","last_fullsized":"2024-05-09T01:00:18.919599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:14.861644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925357+0000","last_change":"2024-05-09T00:58:37.369419+0000","last_active":"2024-05-09T01:00:18.925357+0000","last_peered":"2024-05-09T01:00:18.925357+0000","last_clean":"2024-05-09T01:00:18.925357+0000","last_became_active":"2024-05-09T00:58:37.363949+0000","last_became_peered":"2024-05-09T00:58:37.363949+0000","last_unstale":"2024-05-09T01:00:18.925357+0000","last_undegraded":"2024-05-09T01:00:18.925357+0000","last_fullsized":"2024-05-09T01:00:18.925357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:04.081713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919398+0000","last_change":"2024-05-09T00:58:37.373651+0000","last_active":"2024-05-09T01:00:18.919398+0000","last_peered":"2024-05-09T01:00:18.919398+0000","last_clean":"2024-05-09T01:00:18.919398+0000","last_became_active":"2024-05-09T00:58:37.373257+0000","last_became_peered":"2024-05-09T00:58:37.373257+0000","last_unstale":"2024-05-09T01:00:18.919398+0000","last_undegraded":"2024-05-09T01:00:18.919398+0000","last_fullsized":"2024-05-09T01:00:18.919398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:27.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917661+0000","last_change":"2024-05-09T00:58:37.367666+0000","last_active":"2024-05-09T01:00:18.917661+0000","last_peered":"2024-05-09T01:00:18.917661+0000","last_clean":"2024-05-09T01:00:18.917661+0000","last_became_active":"2024-05-09T00:58:37.366869+0000","last_became_peered":"2024-05-09T00:58:37.366869+0000","last_unstale":"2024-05-09T01:00:18.917661+0000","last_undegraded":"2024-05-09T01:00:18.917661+0000","last_fullsized":"2024-05-09T01:00:18.917661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:07.952594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915233+0000","last_change":"2024-05-09T00:58:37.362205+0000","last_active":"2024-05-09T01:00:18.915233+0000","last_peered":"2024-05-09T01:00:18.915233+0000","last_clean":"2024-05-09T01:00:18.915233+0000","last_became_active":"2024-05-09T00:58:37.361704+0000","last_became_peered":"2024-05-09T00:58:37.361704+0000","last_unstale":"2024-05-09T01:00:18.915233+0000","last_undegraded":"2024-05-09T01:00:18.915233+0000","last_fullsized":"2024-05-09T01:00:18.915233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:34.334593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915284+0000","last_change":"2024-05-09T00:58:37.367143+0000","last_active":"2024-05-09T01:00:18.915284+0000","last_peered":"2024-05-09T01:00:18.915284+0000","last_clean":"2024-05-09T01:00:18.915284+0000","last_became_active":"2024-05-09T00:58:37.364364+0000","last_became_peered":"2024-05-09T00:58:37.364364+0000","last_unstale":"2024-05-09T01:00:18.915284+0000","last_undegraded":"2024-05-09T01:00:18.915284+0000","last_fullsized":"2024-05-09T01:00:18.915284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:55.154458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913286+0000","last_change":"2024-05-09T00:58:37.365757+0000","last_active":"2024-05-09T01:00:18.913286+0000","last_peered":"2024-05-09T01:00:18.913286+0000","last_clean":"2024-05-09T01:00:18.913286+0000","last_became_active":"2024-05-09T00:58:37.365408+0000","last_became_peered":"2024-05-09T00:58:37.365408+0000","last_unstale":"2024-05-09T01:00:18.913286+0000","last_undegraded":"2024-05-09T01:00:18.913286+0000","last_fullsized":"2024-05-09T01:00:18.913286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920462+0000","last_change":"2024-05-09T00:58:37.366954+0000","last_active":"2024-05-09T01:00:18.920462+0000","last_peered":"2024-05-09T01:00:18.920462+0000","last_clean":"2024-05-09T01:00:18.920462+0000","last_became_active":"2024-05-09T00:58:37.364361+0000","last_became_peered":"2024-05-09T00:58:37.364361+0000","last_unstale":"2024-05-09T01:00:18.920462+0000","last_undegraded":"2024-05-09T01:00:18.920462+0000","last_fullsized":"2024-05-09T01:00:18.920462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:31.248873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926925+0000","last_change":"2024-05-09T00:58:37.368467+0000","last_active":"2024-05-09T01:00:18.926925+0000","last_peered":"2024-05-09T01:00:18.926925+0000","last_clean":"2024-05-09T01:00:18.926925+0000","last_became_active":"2024-05-09T00:58:37.368104+0000","last_became_peered":"2024-05-09T00:58:37.368104+0000","last_unstale":"2024-05-09T01:00:18.926925+0000","last_undegraded":"2024-05-09T01:00:18.926925+0000","last_fullsized":"2024-05-09T01:00:18.926925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919954+0000","last_change":"2024-05-09T00:58:37.366897+0000","last_active":"2024-05-09T01:00:18.919954+0000","last_peered":"2024-05-09T01:00:18.919954+0000","last_clean":"2024-05-09T01:00:18.919954+0000","last_became_active":"2024-05-09T00:58:37.366555+0000","last_became_peered":"2024-05-09T00:58:37.366555+0000","last_unstale":"2024-05-09T01:00:18.919954+0000","last_undegraded":"2024-05-09T01:00:18.919954+0000","last_fullsized":"2024-05-09T01:00:18.919954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.394191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923286+0000","last_change":"2024-05-09T00:58:37.358875+0000","last_active":"2024-05-09T01:00:18.923286+0000","last_peered":"2024-05-09T01:00:18.923286+0000","last_clean":"2024-05-09T01:00:18.923286+0000","last_became_active":"2024-05-09T00:58:37.358505+0000","last_became_peered":"2024-05-09T00:58:37.358505+0000","last_unstale":"2024-05-09T01:00:18.923286+0000","last_undegraded":"2024-05-09T01:00:18.923286+0000","last_fullsized":"2024-05-09T01:00:18.923286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:15.268147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74071,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1834,"num_read_kb":1001,"num_write":261,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":222213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678073,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":892928,"data_stored":431606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874301,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1089108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234056,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":431158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462988,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1503232,"data_stored":1024237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":430609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":497799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":432480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":983040,"data_stored":498551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986268,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":431310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822741,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1023075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:01:58.077 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-09T01:01:58.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T01:01:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 -- 172.21.15.37:0/1370355088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 msgr2=0x7f60ec104900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 --2- 172.21.15.37:0/1370355088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec104900 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009900 tx=0x7f60e802a410 comp rx=0 tx=0).stop 2024-05-09T01:01:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 -- 172.21.15.37:0/1370355088 shutdown_connections 2024-05-09T01:01:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 --2- 172.21.15.37:0/1370355088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60ec109b40 0x7f60ec10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 --2- 172.21.15.37:0/1370355088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60ec104e40 0x7f60ec105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 --2- 172.21.15.37:0/1370355088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec104900 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 -- 172.21.15.37:0/1370355088 >> 172.21.15.37:0/1370355088 conn(0x7f60ec0fedf0 msgr2=0x7f60ec1012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 -- 172.21.15.37:0/1370355088 shutdown_connections 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.228+0000 7f60f3d27640 1 -- 172.21.15.37:0/1370355088 wait complete. 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 Processor -- start 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 -- start start 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60ec104e40 0x7f60ec19a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60ec109b40 0x7f60ec1a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec10f700 con 0x7f60ec103c00 2024-05-09T01:01:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec10f580 con 0x7f60ec104e40 2024-05-09T01:01:58.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f3d27640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec10f880 con 0x7f60ec109b40 2024-05-09T01:01:58.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f1ac3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:58.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f1ac3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec19a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57506/0 (socket says 172.21.15.37:57506) 2024-05-09T01:01:58.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f1ac3640 1 -- 172.21.15.37:0/502059973 learned_addr learned my addr 172.21.15.37:0/502059973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:01:58.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.229+0000 7f60f22c4640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60ec109b40 0x7f60ec1a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:58.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f12c2640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60ec104e40 0x7f60ec19a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f1ac3640 1 -- 172.21.15.37:0/502059973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60ec109b40 msgr2=0x7f60ec1a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f1ac3640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60ec109b40 0x7f60ec1a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f1ac3640 1 -- 172.21.15.37:0/502059973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60ec104e40 msgr2=0x7f60ec19a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f1ac3640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60ec104e40 0x7f60ec19a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f1ac3640 1 -- 172.21.15.37:0/502059973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec1a1e90 con 0x7f60ec103c00 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f12c2640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60ec104e40 0x7f60ec19a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f1ac3640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec19a350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006010 tx=0x7f60e8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60e2ffd640 1 -- 172.21.15.37:0/502059973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e803f030 con 0x7f60ec103c00 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60e2ffd640 1 -- 172.21.15.37:0/502059973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e8003aa0 con 0x7f60ec103c00 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec1a2120 con 0x7f60ec103c00 2024-05-09T01:01:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60e2ffd640 1 -- 172.21.15.37:0/502059973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8035070 con 0x7f60ec103c00 2024-05-09T01:01:58.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.230+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec1a2610 con 0x7f60ec103c00 2024-05-09T01:01:58.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.231+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ec108950 con 0x7f60ec103c00 2024-05-09T01:01:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.233+0000 7f60e2ffd640 1 -- 172.21.15.37:0/502059973 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f60e8042030 con 0x7f60ec103c00 2024-05-09T01:01:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.234+0000 7f60e2ffd640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f60d80b27f0 0x7f60d80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:01:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.234+0000 7f60f12c2640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f60d80b27f0 0x7f60d80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:01:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.234+0000 7f60e2ffd640 1 -- 172.21.15.37:0/502059973 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f60e8102be0 con 0x7f60ec103c00 2024-05-09T01:01:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.234+0000 7f60f12c2640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f60d80b27f0 0x7f60d80b4d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f60ec19b3f0 tx=0x7f60dc005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:01:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.237+0000 7f60e2ffd640 1 -- 172.21.15.37:0/502059973 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f60e80ca900 con 0x7f60ec103c00 2024-05-09T01:01:58.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:58 smithi136 ceph-mon[34110]: pgmap v390: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-09T01:01:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.427+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 --> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60ec063110 con 0x7f60d80b27f0 2024-05-09T01:01:58.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.434+0000 7f60e2ffd640 1 -- 172.21.15.37:0/502059973 <== mgr.14152 v2:172.21.15.37:6800/2764436863 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258873 (secure 0 0 0) 0x7f60ec063110 con 0x7f60d80b27f0 2024-05-09T01:01:58.439 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:01:58.440 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-09T01:01:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.437+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f60d80b27f0 msgr2=0x7f60d80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.437+0000 7f60f3d27640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f60d80b27f0 0x7f60d80b4d00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f60ec19b3f0 tx=0x7f60dc005e70 comp rx=0 tx=0).stop 2024-05-09T01:01:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.437+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 msgr2=0x7f60ec19a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:01:58.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.437+0000 7f60f3d27640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec19a350 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006010 tx=0x7f60e8031a50 comp rx=0 tx=0).stop 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 shutdown_connections 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60ec109b40 0x7f60ec1a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f60d80b27f0 0x7f60d80b4d00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60ec104e40 0x7f60ec19a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 --2- 172.21.15.37:0/502059973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60ec103c00 0x7f60ec19a350 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 >> 172.21.15.37:0/502059973 conn(0x7f60ec0fedf0 msgr2=0x7f60ec105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 shutdown_connections 2024-05-09T01:01:58.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:01:58.438+0000 7f60f3d27640 1 -- 172.21.15.37:0/502059973 wait complete. 2024-05-09T01:01:58.449 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:58 smithi037 ceph-mon[30122]: pgmap v390: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-09T01:01:58.450 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-09T01:01:56.936958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664673,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1910,"num_read_kb":1065,"num_write":386,"num_write_kb":2306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2951952,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":382516,"kb_used_data":12564,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124559308,"statfs":{"total":1151940427776,"available":1151548731392,"internally_reserved":0,"allocated":12865536,"data_stored":7151259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5989,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":83,"num_write":7,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924302+0000","last_change":"2024-05-09T00:58:37.371502+0000","last_active":"2024-05-09T01:00:18.924302+0000","last_peered":"2024-05-09T01:00:18.924302+0000","last_clean":"2024-05-09T01:00:18.924302+0000","last_became_active":"2024-05-09T00:58:37.371172+0000","last_became_peered":"2024-05-09T00:58:37.371172+0000","last_unstale":"2024-05-09T01:00:18.924302+0000","last_undegraded":"2024-05-09T01:00:18.924302+0000","last_fullsized":"2024-05-09T01:00:18.924302+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:37.884728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919151+0000","last_change":"2024-05-09T00:58:37.362831+0000","last_active":"2024-05-09T01:00:18.919151+0000","last_peered":"2024-05-09T01:00:18.919151+0000","last_clean":"2024-05-09T01:00:18.919151+0000","last_became_active":"2024-05-09T00:58:37.362063+0000","last_became_peered":"2024-05-09T00:58:37.362063+0000","last_unstale":"2024-05-09T01:00:18.919151+0000","last_undegraded":"2024-05-09T01:00:18.919151+0000","last_fullsized":"2024-05-09T01:00:18.919151+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:10:01.222962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924951+0000","last_change":"2024-05-09T00:58:37.369903+0000","last_active":"2024-05-09T01:00:18.924951+0000","last_peered":"2024-05-09T01:00:18.924951+0000","last_clean":"2024-05-09T01:00:18.924951+0000","last_became_active":"2024-05-09T00:58:37.366215+0000","last_became_peered":"2024-05-09T00:58:37.366215+0000","last_unstale":"2024-05-09T01:00:18.924951+0000","last_undegraded":"2024-05-09T01:00:18.924951+0000","last_fullsized":"2024-05-09T01:00:18.924951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:47.732357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914741+0000","last_change":"2024-05-09T00:58:37.358878+0000","last_active":"2024-05-09T01:00:18.914741+0000","last_peered":"2024-05-09T01:00:18.914741+0000","last_clean":"2024-05-09T01:00:18.914741+0000","last_became_active":"2024-05-09T00:58:37.358516+0000","last_became_peered":"2024-05-09T00:58:37.358516+0000","last_unstale":"2024-05-09T01:00:18.914741+0000","last_undegraded":"2024-05-09T01:00:18.914741+0000","last_fullsized":"2024-05-09T01:00:18.914741+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:28:18.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.899081+0000","last_change":"2024-05-09T00:58:37.358196+0000","last_active":"2024-05-09T01:00:18.899081+0000","last_peered":"2024-05-09T01:00:18.899081+0000","last_clean":"2024-05-09T01:00:18.899081+0000","last_became_active":"2024-05-09T00:58:37.357840+0000","last_became_peered":"2024-05-09T00:58:37.357840+0000","last_unstale":"2024-05-09T01:00:18.899081+0000","last_undegraded":"2024-05-09T01:00:18.899081+0000","last_fullsized":"2024-05-09T01:00:18.899081+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:14:58.424344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923410+0000","last_change":"2024-05-09T00:58:37.364523+0000","last_active":"2024-05-09T01:00:18.923410+0000","last_peered":"2024-05-09T01:00:18.923410+0000","last_clean":"2024-05-09T01:00:18.923410+0000","last_became_active":"2024-05-09T00:58:37.364172+0000","last_became_peered":"2024-05-09T00:58:37.364172+0000","last_unstale":"2024-05-09T01:00:18.923410+0000","last_undegraded":"2024-05-09T01:00:18.923410+0000","last_fullsized":"2024-05-09T01:00:18.923410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:36.872701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914326+0000","last_change":"2024-05-09T00:58:37.371226+0000","last_active":"2024-05-09T01:00:18.914326+0000","last_peered":"2024-05-09T01:00:18.914326+0000","last_clean":"2024-05-09T01:00:18.914326+0000","last_became_active":"2024-05-09T00:58:37.370647+0000","last_became_peered":"2024-05-09T00:58:37.370647+0000","last_unstale":"2024-05-09T01:00:18.914326+0000","last_undegraded":"2024-05-09T01:00:18.914326+0000","last_fullsized":"2024-05-09T01:00:18.914326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:46.350845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914174+0000","last_change":"2024-05-09T00:58:37.362487+0000","last_active":"2024-05-09T01:00:18.914174+0000","last_peered":"2024-05-09T01:00:18.914174+0000","last_clean":"2024-05-09T01:00:18.914174+0000","last_became_active":"2024-05-09T00:58:37.361454+0000","last_became_peered":"2024-05-09T00:58:37.361454+0000","last_unstale":"2024-05-09T01:00:18.914174+0000","last_undegraded":"2024-05-09T01:00:18.914174+0000","last_fullsized":"2024-05-09T01:00:18.914174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:36.930754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925505+0000","last_change":"2024-05-09T00:58:37.370069+0000","last_active":"2024-05-09T01:00:18.925505+0000","last_peered":"2024-05-09T01:00:18.925505+0000","last_clean":"2024-05-09T01:00:18.925505+0000","last_became_active":"2024-05-09T00:58:37.369634+0000","last_became_peered":"2024-05-09T00:58:37.369634+0000","last_unstale":"2024-05-09T01:00:18.925505+0000","last_undegraded":"2024-05-09T01:00:18.925505+0000","last_fullsized":"2024-05-09T01:00:18.925505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:22.424919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923448+0000","last_change":"2024-05-09T00:58:37.365066+0000","last_active":"2024-05-09T01:00:18.923448+0000","last_peered":"2024-05-09T01:00:18.923448+0000","last_clean":"2024-05-09T01:00:18.923448+0000","last_became_active":"2024-05-09T00:58:37.364638+0000","last_became_peered":"2024-05-09T00:58:37.364638+0000","last_unstale":"2024-05-09T01:00:18.923448+0000","last_undegraded":"2024-05-09T01:00:18.923448+0000","last_fullsized":"2024-05-09T01:00:18.923448+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:14.706123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926422+0000","last_change":"2024-05-09T00:58:37.366880+0000","last_active":"2024-05-09T01:00:18.926422+0000","last_peered":"2024-05-09T01:00:18.926422+0000","last_clean":"2024-05-09T01:00:18.926422+0000","last_became_active":"2024-05-09T00:58:37.366510+0000","last_became_peered":"2024-05-09T00:58:37.366510+0000","last_unstale":"2024-05-09T01:00:18.926422+0000","last_undegraded":"2024-05-09T01:00:18.926422+0000","last_fullsized":"2024-05-09T01:00:18.926422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:04:36.968096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917574+0000","last_change":"2024-05-09T00:58:37.363258+0000","last_active":"2024-05-09T01:00:18.917574+0000","last_peered":"2024-05-09T01:00:18.917574+0000","last_clean":"2024-05-09T01:00:18.917574+0000","last_became_active":"2024-05-09T00:58:37.362791+0000","last_became_peered":"2024-05-09T00:58:37.362791+0000","last_unstale":"2024-05-09T01:00:18.917574+0000","last_undegraded":"2024-05-09T01:00:18.917574+0000","last_fullsized":"2024-05-09T01:00:18.917574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:23:03.341731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914771+0000","last_change":"2024-05-09T00:58:37.371276+0000","last_active":"2024-05-09T01:00:18.914771+0000","last_peered":"2024-05-09T01:00:18.914771+0000","last_clean":"2024-05-09T01:00:18.914771+0000","last_became_active":"2024-05-09T00:58:37.370881+0000","last_became_peered":"2024-05-09T00:58:37.370881+0000","last_unstale":"2024-05-09T01:00:18.914771+0000","last_undegraded":"2024-05-09T01:00:18.914771+0000","last_fullsized":"2024-05-09T01:00:18.914771+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:14.031432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919600+0000","last_change":"2024-05-09T00:58:37.361394+0000","last_active":"2024-05-09T01:00:18.919600+0000","last_peered":"2024-05-09T01:00:18.919600+0000","last_clean":"2024-05-09T01:00:18.919600+0000","last_became_active":"2024-05-09T00:58:37.360669+0000","last_became_peered":"2024-05-09T00:58:37.360669+0000","last_unstale":"2024-05-09T01:00:18.919600+0000","last_undegraded":"2024-05-09T01:00:18.919600+0000","last_fullsized":"2024-05-09T01:00:18.919600+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:06:50.110889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.922832+0000","last_change":"2024-05-09T00:58:37.371900+0000","last_active":"2024-05-09T01:00:18.922832+0000","last_peered":"2024-05-09T01:00:18.922832+0000","last_clean":"2024-05-09T01:00:18.922832+0000","last_became_active":"2024-05-09T00:58:37.368608+0000","last_became_peered":"2024-05-09T00:58:37.368608+0000","last_unstale":"2024-05-09T01:00:18.922832+0000","last_undegraded":"2024-05-09T01:00:18.922832+0000","last_fullsized":"2024-05-09T01:00:18.922832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:17.673058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926840+0000","last_change":"2024-05-09T00:58:37.372717+0000","last_active":"2024-05-09T01:00:18.926840+0000","last_peered":"2024-05-09T01:00:18.926840+0000","last_clean":"2024-05-09T01:00:18.926840+0000","last_became_active":"2024-05-09T00:58:37.372376+0000","last_became_peered":"2024-05-09T00:58:37.372376+0000","last_unstale":"2024-05-09T01:00:18.926840+0000","last_undegraded":"2024-05-09T01:00:18.926840+0000","last_fullsized":"2024-05-09T01:00:18.926840+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:33:51.092242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924285+0000","last_change":"2024-05-09T00:58:37.373971+0000","last_active":"2024-05-09T01:00:18.924285+0000","last_peered":"2024-05-09T01:00:18.924285+0000","last_clean":"2024-05-09T01:00:18.924285+0000","last_became_active":"2024-05-09T00:58:37.373620+0000","last_became_peered":"2024-05-09T00:58:37.373620+0000","last_unstale":"2024-05-09T01:00:18.924285+0000","last_undegraded":"2024-05-09T01:00:18.924285+0000","last_fullsized":"2024-05-09T01:00:18.924285+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:51.070455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914287+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.914287+0000","last_peered":"2024-05-09T01:00:18.914287+0000","last_clean":"2024-05-09T01:00:18.914287+0000","last_became_active":"2024-05-09T00:58:37.367820+0000","last_became_peered":"2024-05-09T00:58:37.367820+0000","last_unstale":"2024-05-09T01:00:18.914287+0000","last_undegraded":"2024-05-09T01:00:18.914287+0000","last_fullsized":"2024-05-09T01:00:18.914287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:20:45.207654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918607+0000","last_change":"2024-05-09T00:58:37.358736+0000","last_active":"2024-05-09T01:00:18.918607+0000","last_peered":"2024-05-09T01:00:18.918607+0000","last_clean":"2024-05-09T01:00:18.918607+0000","last_became_active":"2024-05-09T00:58:37.358354+0000","last_became_peered":"2024-05-09T00:58:37.358354+0000","last_unstale":"2024-05-09T01:00:18.918607+0000","last_undegraded":"2024-05-09T01:00:18.918607+0000","last_fullsized":"2024-05-09T01:00:18.918607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:51.084484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'13","reported_seq":221,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.310479+0000","last_change":"2024-05-09T00:58:34.333847+0000","last_active":"2024-05-09T01:01:55.310479+0000","last_peered":"2024-05-09T01:01:55.310479+0000","last_clean":"2024-05-09T01:01:55.310479+0000","last_became_active":"2024-05-09T00:58:34.333479+0000","last_became_peered":"2024-05-09T00:58:34.333479+0000","last_unstale":"2024-05-09T01:01:55.310479+0000","last_undegraded":"2024-05-09T01:01:55.310479+0000","last_fullsized":"2024-05-09T01:01:55.310479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:58:53.709034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":181,"num_read_kb":181,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915386+0000","last_change":"2024-05-09T00:58:37.367327+0000","last_active":"2024-05-09T01:00:18.915386+0000","last_peered":"2024-05-09T01:00:18.915386+0000","last_clean":"2024-05-09T01:00:18.915386+0000","last_became_active":"2024-05-09T00:58:37.366973+0000","last_became_peered":"2024-05-09T00:58:37.366973+0000","last_unstale":"2024-05-09T01:00:18.915386+0000","last_undegraded":"2024-05-09T01:00:18.915386+0000","last_fullsized":"2024-05-09T01:00:18.915386+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:10.610274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078289+0000","last_change":"2024-05-09T00:58:34.821107+0000","last_active":"2024-05-09T00:59:20.078289+0000","last_peered":"2024-05-09T00:59:20.078289+0000","last_clean":"2024-05-09T00:59:20.078289+0000","last_became_active":"2024-05-09T00:58:34.820737+0000","last_became_peered":"2024-05-09T00:58:34.820737+0000","last_unstale":"2024-05-09T00:59:20.078289+0000","last_undegraded":"2024-05-09T00:59:20.078289+0000","last_fullsized":"2024-05-09T00:59:20.078289+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:53:45.450781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924805+0000","last_change":"2024-05-09T00:58:37.363559+0000","last_active":"2024-05-09T01:00:18.924805+0000","last_peered":"2024-05-09T01:00:18.924805+0000","last_clean":"2024-05-09T01:00:18.924805+0000","last_became_active":"2024-05-09T00:58:37.358299+0000","last_became_peered":"2024-05-09T00:58:37.358299+0000","last_unstale":"2024-05-09T01:00:18.924805+0000","last_undegraded":"2024-05-09T01:00:18.924805+0000","last_fullsized":"2024-05-09T01:00:18.924805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:31:15.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'12","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077246+0000","last_change":"2024-05-09T00:58:34.333154+0000","last_active":"2024-05-09T00:59:20.077246+0000","last_peered":"2024-05-09T00:59:20.077246+0000","last_clean":"2024-05-09T00:59:20.077246+0000","last_became_active":"2024-05-09T00:58:34.332469+0000","last_became_peered":"2024-05-09T00:58:34.332469+0000","last_unstale":"2024-05-09T00:59:20.077246+0000","last_undegraded":"2024-05-09T00:59:20.077246+0000","last_fullsized":"2024-05-09T00:59:20.077246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:42:56.343377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925242+0000","last_change":"2024-05-09T00:58:37.361595+0000","last_active":"2024-05-09T01:00:18.925242+0000","last_peered":"2024-05-09T01:00:18.925242+0000","last_clean":"2024-05-09T01:00:18.925242+0000","last_became_active":"2024-05-09T00:58:37.361239+0000","last_became_peered":"2024-05-09T00:58:37.361239+0000","last_unstale":"2024-05-09T01:00:18.925242+0000","last_undegraded":"2024-05-09T01:00:18.925242+0000","last_fullsized":"2024-05-09T01:00:18.925242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:24.526487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077067+0000","last_change":"2024-05-09T00:58:34.331974+0000","last_active":"2024-05-09T00:59:20.077067+0000","last_peered":"2024-05-09T00:59:20.077067+0000","last_clean":"2024-05-09T00:59:20.077067+0000","last_became_active":"2024-05-09T00:58:34.331460+0000","last_became_peered":"2024-05-09T00:58:34.331460+0000","last_unstale":"2024-05-09T00:59:20.077067+0000","last_undegraded":"2024-05-09T00:59:20.077067+0000","last_fullsized":"2024-05-09T00:59:20.077067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:17.746247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918863+0000","last_change":"2024-05-09T00:58:37.370155+0000","last_active":"2024-05-09T01:00:18.918863+0000","last_peered":"2024-05-09T01:00:18.918863+0000","last_clean":"2024-05-09T01:00:18.918863+0000","last_became_active":"2024-05-09T00:58:37.369351+0000","last_became_peered":"2024-05-09T00:58:37.369351+0000","last_unstale":"2024-05-09T01:00:18.918863+0000","last_undegraded":"2024-05-09T01:00:18.918863+0000","last_fullsized":"2024-05-09T01:00:18.918863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:53:57.494715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:52.280650+0000","last_change":"2024-05-09T00:58:34.332532+0000","last_active":"2024-05-09T01:01:52.280650+0000","last_peered":"2024-05-09T01:01:52.280650+0000","last_clean":"2024-05-09T01:01:52.280650+0000","last_became_active":"2024-05-09T00:58:34.332202+0000","last_became_peered":"2024-05-09T00:58:34.332202+0000","last_unstale":"2024-05-09T01:01:52.280650+0000","last_undegraded":"2024-05-09T01:01:52.280650+0000","last_fullsized":"2024-05-09T01:01:52.280650+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:17.561374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":179,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.907192+0000","last_change":"2024-05-09T00:58:37.360504+0000","last_active":"2024-05-09T01:00:18.907192+0000","last_peered":"2024-05-09T01:00:18.907192+0000","last_clean":"2024-05-09T01:00:18.907192+0000","last_became_active":"2024-05-09T00:58:37.360078+0000","last_became_peered":"2024-05-09T00:58:37.360078+0000","last_unstale":"2024-05-09T01:00:18.907192+0000","last_undegraded":"2024-05-09T01:00:18.907192+0000","last_fullsized":"2024-05-09T01:00:18.907192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:19.277269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.074507+0000","last_change":"2024-05-09T00:58:34.333762+0000","last_active":"2024-05-09T00:59:20.074507+0000","last_peered":"2024-05-09T00:59:20.074507+0000","last_clean":"2024-05-09T00:59:20.074507+0000","last_became_active":"2024-05-09T00:58:34.333376+0000","last_became_peered":"2024-05-09T00:58:34.333376+0000","last_unstale":"2024-05-09T00:59:20.074507+0000","last_undegraded":"2024-05-09T00:59:20.074507+0000","last_fullsized":"2024-05-09T00:59:20.074507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:58.027982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.910059+0000","last_change":"2024-05-09T00:59:20.081897+0000","last_active":"2024-05-09T01:00:18.910059+0000","last_peered":"2024-05-09T01:00:18.910059+0000","last_clean":"2024-05-09T01:00:18.910059+0000","last_became_active":"2024-05-09T00:59:20.081446+0000","last_became_peered":"2024-05-09T00:59:20.081446+0000","last_unstale":"2024-05-09T01:00:18.910059+0000","last_undegraded":"2024-05-09T01:00:18.910059+0000","last_fullsized":"2024-05-09T01:00:18.910059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:58.471576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073047+0000","last_change":"2024-05-09T00:58:34.332308+0000","last_active":"2024-05-09T00:59:20.073047+0000","last_peered":"2024-05-09T00:59:20.073047+0000","last_clean":"2024-05-09T00:59:20.073047+0000","last_became_active":"2024-05-09T00:58:34.331154+0000","last_became_peered":"2024-05-09T00:58:34.331154+0000","last_unstale":"2024-05-09T00:59:20.073047+0000","last_undegraded":"2024-05-09T00:59:20.073047+0000","last_fullsized":"2024-05-09T00:59:20.073047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:31.781375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920305+0000","last_change":"2024-05-09T00:58:37.368925+0000","last_active":"2024-05-09T01:00:18.920305+0000","last_peered":"2024-05-09T01:00:18.920305+0000","last_clean":"2024-05-09T01:00:18.920305+0000","last_became_active":"2024-05-09T00:58:37.368586+0000","last_became_peered":"2024-05-09T00:58:37.368586+0000","last_unstale":"2024-05-09T01:00:18.920305+0000","last_undegraded":"2024-05-09T01:00:18.920305+0000","last_fullsized":"2024-05-09T01:00:18.920305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:57.248832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078100+0000","last_change":"2024-05-09T00:58:34.334356+0000","last_active":"2024-05-09T00:59:20.078100+0000","last_peered":"2024-05-09T00:59:20.078100+0000","last_clean":"2024-05-09T00:59:20.078100+0000","last_became_active":"2024-05-09T00:58:34.333993+0000","last_became_peered":"2024-05-09T00:58:34.333993+0000","last_unstale":"2024-05-09T00:59:20.078100+0000","last_undegraded":"2024-05-09T00:59:20.078100+0000","last_fullsized":"2024-05-09T00:59:20.078100+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:44:19.793851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915391+0000","last_change":"2024-05-09T00:58:37.360565+0000","last_active":"2024-05-09T01:00:18.915391+0000","last_peered":"2024-05-09T01:00:18.915391+0000","last_clean":"2024-05-09T01:00:18.915391+0000","last_became_active":"2024-05-09T00:58:37.360215+0000","last_became_peered":"2024-05-09T00:58:37.360215+0000","last_unstale":"2024-05-09T01:00:18.915391+0000","last_undegraded":"2024-05-09T01:00:18.915391+0000","last_fullsized":"2024-05-09T01:00:18.915391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:12.877333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'5","reported_seq":390,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.284506+0000","last_change":"2024-05-09T00:58:34.332654+0000","last_active":"2024-05-09T01:01:55.284506+0000","last_peered":"2024-05-09T01:01:55.284506+0000","last_clean":"2024-05-09T01:01:55.284506+0000","last_became_active":"2024-05-09T00:58:34.331915+0000","last_became_peered":"2024-05-09T00:58:34.331915+0000","last_unstale":"2024-05-09T01:01:55.284506+0000","last_undegraded":"2024-05-09T01:01:55.284506+0000","last_fullsized":"2024-05-09T01:01:55.284506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:11:47.521158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":358,"num_read_kb":358,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.924836+0000","last_change":"2024-05-09T00:58:37.364248+0000","last_active":"2024-05-09T01:00:18.924836+0000","last_peered":"2024-05-09T01:00:18.924836+0000","last_clean":"2024-05-09T01:00:18.924836+0000","last_became_active":"2024-05-09T00:58:37.363872+0000","last_became_peered":"2024-05-09T00:58:37.363872+0000","last_unstale":"2024-05-09T01:00:18.924836+0000","last_undegraded":"2024-05-09T01:00:18.924836+0000","last_fullsized":"2024-05-09T01:00:18.924836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.348364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075542+0000","last_change":"2024-05-09T00:58:34.331157+0000","last_active":"2024-05-09T00:59:20.075542+0000","last_peered":"2024-05-09T00:59:20.075542+0000","last_clean":"2024-05-09T00:59:20.075542+0000","last_became_active":"2024-05-09T00:58:34.330151+0000","last_became_peered":"2024-05-09T00:58:34.330151+0000","last_unstale":"2024-05-09T00:59:20.075542+0000","last_undegraded":"2024-05-09T00:59:20.075542+0000","last_fullsized":"2024-05-09T00:59:20.075542+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:07.777304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.922803+0000","last_change":"2024-05-09T00:58:37.369357+0000","last_active":"2024-05-09T01:00:18.922803+0000","last_peered":"2024-05-09T01:00:18.922803+0000","last_clean":"2024-05-09T01:00:18.922803+0000","last_became_active":"2024-05-09T00:58:37.368994+0000","last_became_peered":"2024-05-09T00:58:37.368994+0000","last_unstale":"2024-05-09T01:00:18.922803+0000","last_undegraded":"2024-05-09T01:00:18.922803+0000","last_fullsized":"2024-05-09T01:00:18.922803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:54.639097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.079957+0000","last_change":"2024-05-09T00:58:34.822508+0000","last_active":"2024-05-09T00:59:20.079957+0000","last_peered":"2024-05-09T00:59:20.079957+0000","last_clean":"2024-05-09T00:59:20.079957+0000","last_became_active":"2024-05-09T00:58:34.821765+0000","last_became_peered":"2024-05-09T00:58:34.821765+0000","last_unstale":"2024-05-09T00:59:20.079957+0000","last_undegraded":"2024-05-09T00:59:20.079957+0000","last_fullsized":"2024-05-09T00:59:20.079957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:16:56.931158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926602+0000","last_change":"2024-05-09T00:58:37.362739+0000","last_active":"2024-05-09T01:00:18.926602+0000","last_peered":"2024-05-09T01:00:18.926602+0000","last_clean":"2024-05-09T01:00:18.926602+0000","last_became_active":"2024-05-09T00:58:37.362395+0000","last_became_peered":"2024-05-09T00:58:37.362395+0000","last_unstale":"2024-05-09T01:00:18.926602+0000","last_undegraded":"2024-05-09T01:00:18.926602+0000","last_fullsized":"2024-05-09T01:00:18.926602+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:51.380197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'37","reported_seq":434,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.285141+0000","last_change":"2024-05-09T00:58:34.336548+0000","last_active":"2024-05-09T01:01:55.285141+0000","last_peered":"2024-05-09T01:01:55.285141+0000","last_clean":"2024-05-09T01:01:55.285141+0000","last_became_active":"2024-05-09T00:58:34.335792+0000","last_became_peered":"2024-05-09T00:58:34.335792+0000","last_unstale":"2024-05-09T01:01:55.285141+0000","last_undegraded":"2024-05-09T01:01:55.285141+0000","last_fullsized":"2024-05-09T01:01:55.285141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:37.996544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66277,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":370,"num_read_kb":250,"num_write":39,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.918217+0000","last_change":"2024-05-09T00:58:37.365468+0000","last_active":"2024-05-09T01:00:18.918217+0000","last_peered":"2024-05-09T01:00:18.918217+0000","last_clean":"2024-05-09T01:00:18.918217+0000","last_became_active":"2024-05-09T00:58:37.365085+0000","last_became_peered":"2024-05-09T00:58:37.365085+0000","last_unstale":"2024-05-09T01:00:18.918217+0000","last_undegraded":"2024-05-09T01:00:18.918217+0000","last_fullsized":"2024-05-09T01:00:18.918217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:08:06.836757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'9","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077241+0000","last_change":"2024-05-09T00:58:34.331174+0000","last_active":"2024-05-09T00:59:20.077241+0000","last_peered":"2024-05-09T00:59:20.077241+0000","last_clean":"2024-05-09T00:59:20.077241+0000","last_became_active":"2024-05-09T00:58:34.330871+0000","last_became_peered":"2024-05-09T00:58:34.330871+0000","last_unstale":"2024-05-09T00:59:20.077241+0000","last_undegraded":"2024-05-09T00:59:20.077241+0000","last_fullsized":"2024-05-09T00:59:20.077241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:21:47.840730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915665+0000","last_change":"2024-05-09T00:58:37.367821+0000","last_active":"2024-05-09T01:00:18.915665+0000","last_peered":"2024-05-09T01:00:18.915665+0000","last_clean":"2024-05-09T01:00:18.915665+0000","last_became_active":"2024-05-09T00:58:37.367495+0000","last_became_peered":"2024-05-09T00:58:37.367495+0000","last_unstale":"2024-05-09T01:00:18.915665+0000","last_undegraded":"2024-05-09T01:00:18.915665+0000","last_fullsized":"2024-05-09T01:00:18.915665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:08.285301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'5","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.078531+0000","last_change":"2024-05-09T00:58:34.334381+0000","last_active":"2024-05-09T00:59:20.078531+0000","last_peered":"2024-05-09T00:59:20.078531+0000","last_clean":"2024-05-09T00:59:20.078531+0000","last_became_active":"2024-05-09T00:58:34.333948+0000","last_became_peered":"2024-05-09T00:58:34.333948+0000","last_unstale":"2024-05-09T00:59:20.078531+0000","last_undegraded":"2024-05-09T00:59:20.078531+0000","last_fullsized":"2024-05-09T00:59:20.078531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:05.861423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914070+0000","last_change":"2024-05-09T00:59:20.079435+0000","last_active":"2024-05-09T01:00:18.914070+0000","last_peered":"2024-05-09T01:00:18.914070+0000","last_clean":"2024-05-09T01:00:18.914070+0000","last_became_active":"2024-05-09T00:59:20.079110+0000","last_became_peered":"2024-05-09T00:59:20.079110+0000","last_unstale":"2024-05-09T01:00:18.914070+0000","last_undegraded":"2024-05-09T01:00:18.914070+0000","last_fullsized":"2024-05-09T01:00:18.914070+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:31.449360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'8","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:53.282587+0000","last_change":"2024-05-09T00:58:34.335831+0000","last_active":"2024-05-09T01:01:53.282587+0000","last_peered":"2024-05-09T01:01:53.282587+0000","last_clean":"2024-05-09T01:01:53.282587+0000","last_became_active":"2024-05-09T00:58:34.334950+0000","last_became_peered":"2024-05-09T00:58:34.334950+0000","last_unstale":"2024-05-09T01:01:53.282587+0000","last_undegraded":"2024-05-09T01:01:53.282587+0000","last_fullsized":"2024-05-09T01:01:53.282587+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:32:05.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":6,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.914516+0000","last_change":"2024-05-09T00:58:37.373115+0000","last_active":"2024-05-09T01:00:18.914516+0000","last_peered":"2024-05-09T01:00:18.914516+0000","last_clean":"2024-05-09T01:00:18.914516+0000","last_became_active":"2024-05-09T00:58:37.369976+0000","last_became_peered":"2024-05-09T00:58:37.369976+0000","last_unstale":"2024-05-09T01:00:18.914516+0000","last_undegraded":"2024-05-09T01:00:18.914516+0000","last_fullsized":"2024-05-09T01:00:18.914516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:40.439954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'17","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:22.014590+0000","last_change":"2024-05-09T00:59:20.095889+0000","last_active":"2024-05-09T00:59:22.014590+0000","last_peered":"2024-05-09T00:59:22.014590+0000","last_clean":"2024-05-09T00:59:22.014590+0000","last_became_active":"2024-05-09T00:59:20.078865+0000","last_became_peered":"2024-05-09T00:59:20.078865+0000","last_unstale":"2024-05-09T00:59:22.014590+0000","last_undegraded":"2024-05-09T00:59:22.014590+0000","last_fullsized":"2024-05-09T00:59:22.014590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:30.470868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.911239+0000","last_change":"2024-05-09T00:59:20.349963+0000","last_active":"2024-05-09T01:00:18.911239+0000","last_peered":"2024-05-09T01:00:18.911239+0000","last_clean":"2024-05-09T01:00:18.911239+0000","last_became_active":"2024-05-09T00:59:20.349510+0000","last_became_peered":"2024-05-09T00:59:20.349510+0000","last_unstale":"2024-05-09T01:00:18.911239+0000","last_undegraded":"2024-05-09T01:00:18.911239+0000","last_fullsized":"2024-05-09T01:00:18.911239+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:33.764365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077349+0000","last_change":"2024-05-09T00:58:34.331661+0000","last_active":"2024-05-09T00:59:20.077349+0000","last_peered":"2024-05-09T00:59:20.077349+0000","last_clean":"2024-05-09T00:59:20.077349+0000","last_became_active":"2024-05-09T00:58:34.331271+0000","last_became_peered":"2024-05-09T00:58:34.331271+0000","last_unstale":"2024-05-09T00:59:20.077349+0000","last_undegraded":"2024-05-09T00:59:20.077349+0000","last_fullsized":"2024-05-09T00:59:20.077349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:35:10.130811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923326+0000","last_change":"2024-05-09T00:58:37.367367+0000","last_active":"2024-05-09T01:00:18.923326+0000","last_peered":"2024-05-09T01:00:18.923326+0000","last_clean":"2024-05-09T01:00:18.923326+0000","last_became_active":"2024-05-09T00:58:37.366927+0000","last_became_peered":"2024-05-09T00:58:37.366927+0000","last_unstale":"2024-05-09T01:00:18.923326+0000","last_undegraded":"2024-05-09T01:00:18.923326+0000","last_fullsized":"2024-05-09T01:00:18.923326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:44:31.066913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"79'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077808+0000","last_change":"2024-05-09T00:58:34.821956+0000","last_active":"2024-05-09T00:59:20.077808+0000","last_peered":"2024-05-09T00:59:20.077808+0000","last_clean":"2024-05-09T00:59:20.077808+0000","last_became_active":"2024-05-09T00:58:34.821570+0000","last_became_peered":"2024-05-09T00:58:34.821570+0000","last_unstale":"2024-05-09T00:59:20.077808+0000","last_undegraded":"2024-05-09T00:59:20.077808+0000","last_fullsized":"2024-05-09T00:59:20.077808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:29:45.027927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.910139+0000","last_change":"2024-05-09T00:58:37.361646+0000","last_active":"2024-05-09T01:00:18.910139+0000","last_peered":"2024-05-09T01:00:18.910139+0000","last_clean":"2024-05-09T01:00:18.910139+0000","last_became_active":"2024-05-09T00:58:37.360216+0000","last_became_peered":"2024-05-09T00:58:37.360216+0000","last_unstale":"2024-05-09T01:00:18.910139+0000","last_undegraded":"2024-05-09T01:00:18.910139+0000","last_fullsized":"2024-05-09T01:00:18.910139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:49:13.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'5","reported_seq":211,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:53.308313+0000","last_change":"2024-05-09T00:58:34.330657+0000","last_active":"2024-05-09T01:01:53.308313+0000","last_peered":"2024-05-09T01:01:53.308313+0000","last_clean":"2024-05-09T01:01:53.308313+0000","last_became_active":"2024-05-09T00:58:34.330235+0000","last_became_peered":"2024-05-09T00:58:34.330235+0000","last_unstale":"2024-05-09T01:01:53.308313+0000","last_undegraded":"2024-05-09T01:01:53.308313+0000","last_fullsized":"2024-05-09T01:01:53.308313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:56:21.647916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":179,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923332+0000","last_change":"2024-05-09T00:58:37.361155+0000","last_active":"2024-05-09T01:00:18.923332+0000","last_peered":"2024-05-09T01:00:18.923332+0000","last_clean":"2024-05-09T01:00:18.923332+0000","last_became_active":"2024-05-09T00:58:37.360653+0000","last_became_peered":"2024-05-09T00:58:37.360653+0000","last_unstale":"2024-05-09T01:00:18.923332+0000","last_undegraded":"2024-05-09T01:00:18.923332+0000","last_fullsized":"2024-05-09T01:00:18.923332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:49.473522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913133+0000","last_change":"2024-05-09T00:58:37.367592+0000","last_active":"2024-05-09T01:00:18.913133+0000","last_peered":"2024-05-09T01:00:18.913133+0000","last_clean":"2024-05-09T01:00:18.913133+0000","last_became_active":"2024-05-09T00:58:37.366365+0000","last_became_peered":"2024-05-09T00:58:37.366365+0000","last_unstale":"2024-05-09T01:00:18.913133+0000","last_undegraded":"2024-05-09T01:00:18.913133+0000","last_fullsized":"2024-05-09T01:00:18.913133+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:57:37.279269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'7","reported_seq":214,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:54.283506+0000","last_change":"2024-05-09T00:58:34.821092+0000","last_active":"2024-05-09T01:01:54.283506+0000","last_peered":"2024-05-09T01:01:54.283506+0000","last_clean":"2024-05-09T01:01:54.283506+0000","last_became_active":"2024-05-09T00:58:34.820713+0000","last_became_peered":"2024-05-09T00:58:34.820713+0000","last_unstale":"2024-05-09T01:01:54.283506+0000","last_undegraded":"2024-05-09T01:01:54.283506+0000","last_fullsized":"2024-05-09T01:01:54.283506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:11.372613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":180,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916093+0000","last_change":"2024-05-09T00:58:37.364624+0000","last_active":"2024-05-09T01:00:18.916093+0000","last_peered":"2024-05-09T01:00:18.916093+0000","last_clean":"2024-05-09T01:00:18.916093+0000","last_became_active":"2024-05-09T00:58:37.364013+0000","last_became_peered":"2024-05-09T00:58:37.364013+0000","last_unstale":"2024-05-09T01:00:18.916093+0000","last_undegraded":"2024-05-09T01:00:18.916093+0000","last_fullsized":"2024-05-09T01:00:18.916093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:14.205958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'6","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.349116+0000","last_change":"2024-05-09T00:58:34.335364+0000","last_active":"2024-05-09T00:59:20.349116+0000","last_peered":"2024-05-09T00:59:20.349116+0000","last_clean":"2024-05-09T00:59:20.349116+0000","last_became_active":"2024-05-09T00:58:34.334965+0000","last_became_peered":"2024-05-09T00:58:34.334965+0000","last_unstale":"2024-05-09T00:59:20.349116+0000","last_undegraded":"2024-05-09T00:59:20.349116+0000","last_fullsized":"2024-05-09T00:59:20.349116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:50.656330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:54.309227+0000","last_change":"2024-05-09T00:57:07.637377+0000","last_active":"2024-05-09T00:59:54.309227+0000","last_peered":"2024-05-09T00:59:54.309227+0000","last_clean":"2024-05-09T00:59:54.309227+0000","last_became_active":"2024-05-09T00:57:07.631727+0000","last_became_peered":"2024-05-09T00:57:07.631727+0000","last_unstale":"2024-05-09T00:59:54.309227+0000","last_undegraded":"2024-05-09T00:59:54.309227+0000","last_fullsized":"2024-05-09T00:59:54.309227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:53:47.457762+0000","last_clean_scrub_stamp":"2024-05-09T00:53:47.457762+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:09.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913540+0000","last_change":"2024-05-09T00:59:20.081462+0000","last_active":"2024-05-09T01:00:18.913540+0000","last_peered":"2024-05-09T01:00:18.913540+0000","last_clean":"2024-05-09T01:00:18.913540+0000","last_became_active":"2024-05-09T00:59:20.080955+0000","last_became_peered":"2024-05-09T00:59:20.080955+0000","last_unstale":"2024-05-09T01:00:18.913540+0000","last_undegraded":"2024-05-09T01:00:18.913540+0000","last_fullsized":"2024-05-09T01:00:18.913540+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:11.106912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.075413+0000","last_change":"2024-05-09T00:58:34.329694+0000","last_active":"2024-05-09T00:59:20.075413+0000","last_peered":"2024-05-09T00:59:20.075413+0000","last_clean":"2024-05-09T00:59:20.075413+0000","last_became_active":"2024-05-09T00:58:34.329267+0000","last_became_peered":"2024-05-09T00:58:34.329267+0000","last_unstale":"2024-05-09T00:59:20.075413+0000","last_undegraded":"2024-05-09T00:59:20.075413+0000","last_fullsized":"2024-05-09T00:59:20.075413+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:30:28.060489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077124+0000","last_change":"2024-05-09T00:58:34.822706+0000","last_active":"2024-05-09T00:59:20.077124+0000","last_peered":"2024-05-09T00:59:20.077124+0000","last_clean":"2024-05-09T00:59:20.077124+0000","last_became_active":"2024-05-09T00:58:34.822223+0000","last_became_peered":"2024-05-09T00:58:34.822223+0000","last_unstale":"2024-05-09T00:59:20.077124+0000","last_undegraded":"2024-05-09T00:59:20.077124+0000","last_fullsized":"2024-05-09T00:59:20.077124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:39:47.378798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.908462+0000","last_change":"2024-05-09T00:58:37.360600+0000","last_active":"2024-05-09T01:00:18.908462+0000","last_peered":"2024-05-09T01:00:18.908462+0000","last_clean":"2024-05-09T01:00:18.908462+0000","last_became_active":"2024-05-09T00:58:37.360265+0000","last_became_peered":"2024-05-09T00:58:37.360265+0000","last_unstale":"2024-05-09T01:00:18.908462+0000","last_undegraded":"2024-05-09T01:00:18.908462+0000","last_fullsized":"2024-05-09T01:00:18.908462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:44.423709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'17","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:46.359462+0000","last_change":"2024-05-09T00:58:34.331544+0000","last_active":"2024-05-09T01:00:46.359462+0000","last_peered":"2024-05-09T01:00:46.359462+0000","last_clean":"2024-05-09T01:00:46.359462+0000","last_became_active":"2024-05-09T00:58:34.331147+0000","last_became_peered":"2024-05-09T00:58:34.331147+0000","last_unstale":"2024-05-09T01:00:46.359462+0000","last_undegraded":"2024-05-09T01:00:46.359462+0000","last_fullsized":"2024-05-09T01:00:46.359462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:06:27.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920395+0000","last_change":"2024-05-09T00:58:37.368186+0000","last_active":"2024-05-09T01:00:18.920395+0000","last_peered":"2024-05-09T01:00:18.920395+0000","last_clean":"2024-05-09T01:00:18.920395+0000","last_became_active":"2024-05-09T00:58:37.367875+0000","last_became_peered":"2024-05-09T00:58:37.367875+0000","last_unstale":"2024-05-09T01:00:18.920395+0000","last_undegraded":"2024-05-09T01:00:18.920395+0000","last_fullsized":"2024-05-09T01:00:18.920395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:45.800008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'7","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.348750+0000","last_change":"2024-05-09T00:58:34.956500+0000","last_active":"2024-05-09T00:59:20.348750+0000","last_peered":"2024-05-09T00:59:20.348750+0000","last_clean":"2024-05-09T00:59:20.348750+0000","last_became_active":"2024-05-09T00:58:34.956108+0000","last_became_peered":"2024-05-09T00:58:34.956108+0000","last_unstale":"2024-05-09T00:59:20.348750+0000","last_undegraded":"2024-05-09T00:59:20.348750+0000","last_fullsized":"2024-05-09T00:59:20.348750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:04:03.283325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925373+0000","last_change":"2024-05-09T00:58:37.369174+0000","last_active":"2024-05-09T01:00:18.925373+0000","last_peered":"2024-05-09T01:00:18.925373+0000","last_clean":"2024-05-09T01:00:18.925373+0000","last_became_active":"2024-05-09T00:58:37.368650+0000","last_became_peered":"2024-05-09T00:58:37.368650+0000","last_unstale":"2024-05-09T01:00:18.925373+0000","last_undegraded":"2024-05-09T01:00:18.925373+0000","last_fullsized":"2024-05-09T01:00:18.925373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:07.218634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.087924+0000","last_change":"2024-05-09T00:58:34.821742+0000","last_active":"2024-05-09T00:59:20.087924+0000","last_peered":"2024-05-09T00:59:20.087924+0000","last_clean":"2024-05-09T00:59:20.087924+0000","last_became_active":"2024-05-09T00:58:34.821290+0000","last_became_peered":"2024-05-09T00:58:34.821290+0000","last_unstale":"2024-05-09T00:59:20.087924+0000","last_undegraded":"2024-05-09T00:59:20.087924+0000","last_fullsized":"2024-05-09T00:59:20.087924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:18.735763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.916729+0000","last_change":"2024-05-09T00:58:37.361727+0000","last_active":"2024-05-09T01:00:18.916729+0000","last_peered":"2024-05-09T01:00:18.916729+0000","last_clean":"2024-05-09T01:00:18.916729+0000","last_became_active":"2024-05-09T00:58:37.361351+0000","last_became_peered":"2024-05-09T00:58:37.361351+0000","last_unstale":"2024-05-09T01:00:18.916729+0000","last_undegraded":"2024-05-09T01:00:18.916729+0000","last_fullsized":"2024-05-09T01:00:18.916729+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:27:14.814698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'7","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.077949+0000","last_change":"2024-05-09T00:58:34.330578+0000","last_active":"2024-05-09T00:59:20.077949+0000","last_peered":"2024-05-09T00:59:20.077949+0000","last_clean":"2024-05-09T00:59:20.077949+0000","last_became_active":"2024-05-09T00:58:34.330273+0000","last_became_peered":"2024-05-09T00:58:34.330273+0000","last_unstale":"2024-05-09T00:59:20.077949+0000","last_undegraded":"2024-05-09T00:59:20.077949+0000","last_fullsized":"2024-05-09T00:59:20.077949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:50:45.795771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919919+0000","last_change":"2024-05-09T00:58:37.371323+0000","last_active":"2024-05-09T01:00:18.919919+0000","last_peered":"2024-05-09T01:00:18.919919+0000","last_clean":"2024-05-09T01:00:18.919919+0000","last_became_active":"2024-05-09T00:58:37.370942+0000","last_became_peered":"2024-05-09T00:58:37.370942+0000","last_unstale":"2024-05-09T01:00:18.919919+0000","last_undegraded":"2024-05-09T01:00:18.919919+0000","last_fullsized":"2024-05-09T01:00:18.919919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:50:57.821068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:22.014632+0000","last_change":"2024-05-09T00:59:20.099633+0000","last_active":"2024-05-09T00:59:22.014632+0000","last_peered":"2024-05-09T00:59:22.014632+0000","last_clean":"2024-05-09T00:59:22.014632+0000","last_became_active":"2024-05-09T00:59:20.080964+0000","last_became_peered":"2024-05-09T00:59:20.080964+0000","last_unstale":"2024-05-09T00:59:22.014632+0000","last_undegraded":"2024-05-09T00:59:22.014632+0000","last_fullsized":"2024-05-09T00:59:22.014632+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:26:53.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919046+0000","last_change":"2024-05-09T00:58:37.361319+0000","last_active":"2024-05-09T01:00:18.919046+0000","last_peered":"2024-05-09T01:00:18.919046+0000","last_clean":"2024-05-09T01:00:18.919046+0000","last_became_active":"2024-05-09T00:58:37.360703+0000","last_became_peered":"2024-05-09T00:58:37.360703+0000","last_unstale":"2024-05-09T01:00:18.919046+0000","last_undegraded":"2024-05-09T01:00:18.919046+0000","last_fullsized":"2024-05-09T01:00:18.919046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:24.202453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.076552+0000","last_change":"2024-05-09T00:58:34.333394+0000","last_active":"2024-05-09T00:59:20.076552+0000","last_peered":"2024-05-09T00:59:20.076552+0000","last_clean":"2024-05-09T00:59:20.076552+0000","last_became_active":"2024-05-09T00:58:34.332902+0000","last_became_peered":"2024-05-09T00:58:34.332902+0000","last_unstale":"2024-05-09T00:59:20.076552+0000","last_undegraded":"2024-05-09T00:59:20.076552+0000","last_fullsized":"2024-05-09T00:59:20.076552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:38.301831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925516+0000","last_change":"2024-05-09T00:58:37.366963+0000","last_active":"2024-05-09T01:00:18.925516+0000","last_peered":"2024-05-09T01:00:18.925516+0000","last_clean":"2024-05-09T01:00:18.925516+0000","last_became_active":"2024-05-09T00:58:37.366591+0000","last_became_peered":"2024-05-09T00:58:37.366591+0000","last_unstale":"2024-05-09T01:00:18.925516+0000","last_undegraded":"2024-05-09T01:00:18.925516+0000","last_fullsized":"2024-05-09T01:00:18.925516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:44.894281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'7","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:01:55.285325+0000","last_change":"2024-05-09T00:58:34.956368+0000","last_active":"2024-05-09T01:01:55.285325+0000","last_peered":"2024-05-09T01:01:55.285325+0000","last_clean":"2024-05-09T01:01:55.285325+0000","last_became_active":"2024-05-09T00:58:34.955888+0000","last_became_peered":"2024-05-09T00:58:34.955888+0000","last_unstale":"2024-05-09T01:01:55.285325+0000","last_undegraded":"2024-05-09T01:01:55.285325+0000","last_fullsized":"2024-05-09T01:01:55.285325+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:23:15.884435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926749+0000","last_change":"2024-05-09T00:58:37.368150+0000","last_active":"2024-05-09T01:00:18.926749+0000","last_peered":"2024-05-09T01:00:18.926749+0000","last_clean":"2024-05-09T01:00:18.926749+0000","last_became_active":"2024-05-09T00:58:37.367800+0000","last_became_peered":"2024-05-09T00:58:37.367800+0000","last_unstale":"2024-05-09T01:00:18.926749+0000","last_undegraded":"2024-05-09T01:00:18.926749+0000","last_fullsized":"2024-05-09T01:00:18.926749+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:51:20.791816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.080026+0000","last_change":"2024-05-09T00:58:34.329311+0000","last_active":"2024-05-09T00:59:20.080026+0000","last_peered":"2024-05-09T00:59:20.080026+0000","last_clean":"2024-05-09T00:59:20.080026+0000","last_became_active":"2024-05-09T00:58:34.328841+0000","last_became_peered":"2024-05-09T00:58:34.328841+0000","last_unstale":"2024-05-09T00:59:20.080026+0000","last_undegraded":"2024-05-09T00:59:20.080026+0000","last_fullsized":"2024-05-09T00:59:20.080026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:31.200019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.912975+0000","last_change":"2024-05-09T00:58:37.369498+0000","last_active":"2024-05-09T01:00:18.912975+0000","last_peered":"2024-05-09T01:00:18.912975+0000","last_clean":"2024-05-09T01:00:18.912975+0000","last_became_active":"2024-05-09T00:58:37.369166+0000","last_became_peered":"2024-05-09T00:58:37.369166+0000","last_unstale":"2024-05-09T01:00:18.912975+0000","last_undegraded":"2024-05-09T01:00:18.912975+0000","last_fullsized":"2024-05-09T01:00:18.912975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:56.411666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'5","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:59:20.073140+0000","last_change":"2024-05-09T00:58:34.328756+0000","last_active":"2024-05-09T00:59:20.073140+0000","last_peered":"2024-05-09T00:59:20.073140+0000","last_clean":"2024-05-09T00:59:20.073140+0000","last_became_active":"2024-05-09T00:58:34.328381+0000","last_became_peered":"2024-05-09T00:58:34.328381+0000","last_unstale":"2024-05-09T00:59:20.073140+0000","last_undegraded":"2024-05-09T00:59:20.073140+0000","last_fullsized":"2024-05-09T00:59:20.073140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:33.305257+0000","last_clean_scrub_stamp":"2024-05-09T00:58:33.305257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:26.558360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925108+0000","last_change":"2024-05-09T00:58:37.369557+0000","last_active":"2024-05-09T01:00:18.925108+0000","last_peered":"2024-05-09T01:00:18.925108+0000","last_clean":"2024-05-09T01:00:18.925108+0000","last_became_active":"2024-05-09T00:58:37.369225+0000","last_became_peered":"2024-05-09T00:58:37.369225+0000","last_unstale":"2024-05-09T01:00:18.925108+0000","last_undegraded":"2024-05-09T01:00:18.925108+0000","last_fullsized":"2024-05-09T01:00:18.925108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:21.761421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920116+0000","last_change":"2024-05-09T00:58:37.369919+0000","last_active":"2024-05-09T01:00:18.920116+0000","last_peered":"2024-05-09T01:00:18.920116+0000","last_clean":"2024-05-09T01:00:18.920116+0000","last_became_active":"2024-05-09T00:58:37.369507+0000","last_became_peered":"2024-05-09T00:58:37.369507+0000","last_unstale":"2024-05-09T01:00:18.920116+0000","last_undegraded":"2024-05-09T01:00:18.920116+0000","last_fullsized":"2024-05-09T01:00:18.920116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:21:06.294074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919847+0000","last_change":"2024-05-09T00:58:37.363775+0000","last_active":"2024-05-09T01:00:18.919847+0000","last_peered":"2024-05-09T01:00:18.919847+0000","last_clean":"2024-05-09T01:00:18.919847+0000","last_became_active":"2024-05-09T00:58:37.363394+0000","last_became_peered":"2024-05-09T00:58:37.363394+0000","last_unstale":"2024-05-09T01:00:18.919847+0000","last_undegraded":"2024-05-09T01:00:18.919847+0000","last_fullsized":"2024-05-09T01:00:18.919847+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:38:43.156009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919599+0000","last_change":"2024-05-09T00:58:37.357699+0000","last_active":"2024-05-09T01:00:18.919599+0000","last_peered":"2024-05-09T01:00:18.919599+0000","last_clean":"2024-05-09T01:00:18.919599+0000","last_became_active":"2024-05-09T00:58:37.357356+0000","last_became_peered":"2024-05-09T00:58:37.357356+0000","last_unstale":"2024-05-09T01:00:18.919599+0000","last_undegraded":"2024-05-09T01:00:18.919599+0000","last_fullsized":"2024-05-09T01:00:18.919599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:03:14.861644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.925357+0000","last_change":"2024-05-09T00:58:37.369419+0000","last_active":"2024-05-09T01:00:18.925357+0000","last_peered":"2024-05-09T01:00:18.925357+0000","last_clean":"2024-05-09T01:00:18.925357+0000","last_became_active":"2024-05-09T00:58:37.363949+0000","last_became_peered":"2024-05-09T00:58:37.363949+0000","last_unstale":"2024-05-09T01:00:18.925357+0000","last_undegraded":"2024-05-09T01:00:18.925357+0000","last_fullsized":"2024-05-09T01:00:18.925357+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:04.081713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919398+0000","last_change":"2024-05-09T00:58:37.373651+0000","last_active":"2024-05-09T01:00:18.919398+0000","last_peered":"2024-05-09T01:00:18.919398+0000","last_clean":"2024-05-09T01:00:18.919398+0000","last_became_active":"2024-05-09T00:58:37.373257+0000","last_became_peered":"2024-05-09T00:58:37.373257+0000","last_unstale":"2024-05-09T01:00:18.919398+0000","last_undegraded":"2024-05-09T01:00:18.919398+0000","last_fullsized":"2024-05-09T01:00:18.919398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:27.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.917661+0000","last_change":"2024-05-09T00:58:37.367666+0000","last_active":"2024-05-09T01:00:18.917661+0000","last_peered":"2024-05-09T01:00:18.917661+0000","last_clean":"2024-05-09T01:00:18.917661+0000","last_became_active":"2024-05-09T00:58:37.366869+0000","last_became_peered":"2024-05-09T00:58:37.366869+0000","last_unstale":"2024-05-09T01:00:18.917661+0000","last_undegraded":"2024-05-09T01:00:18.917661+0000","last_fullsized":"2024-05-09T01:00:18.917661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:19:07.952594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915233+0000","last_change":"2024-05-09T00:58:37.362205+0000","last_active":"2024-05-09T01:00:18.915233+0000","last_peered":"2024-05-09T01:00:18.915233+0000","last_clean":"2024-05-09T01:00:18.915233+0000","last_became_active":"2024-05-09T00:58:37.361704+0000","last_became_peered":"2024-05-09T00:58:37.361704+0000","last_unstale":"2024-05-09T01:00:18.915233+0000","last_undegraded":"2024-05-09T01:00:18.915233+0000","last_fullsized":"2024-05-09T01:00:18.915233+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:24:34.334593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.915284+0000","last_change":"2024-05-09T00:58:37.367143+0000","last_active":"2024-05-09T01:00:18.915284+0000","last_peered":"2024-05-09T01:00:18.915284+0000","last_clean":"2024-05-09T01:00:18.915284+0000","last_became_active":"2024-05-09T00:58:37.364364+0000","last_became_peered":"2024-05-09T00:58:37.364364+0000","last_unstale":"2024-05-09T01:00:18.915284+0000","last_undegraded":"2024-05-09T01:00:18.915284+0000","last_fullsized":"2024-05-09T01:00:18.915284+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:22:55.154458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.913286+0000","last_change":"2024-05-09T00:58:37.365757+0000","last_active":"2024-05-09T01:00:18.913286+0000","last_peered":"2024-05-09T01:00:18.913286+0000","last_clean":"2024-05-09T01:00:18.913286+0000","last_became_active":"2024-05-09T00:58:37.365408+0000","last_became_peered":"2024-05-09T00:58:37.365408+0000","last_unstale":"2024-05-09T01:00:18.913286+0000","last_undegraded":"2024-05-09T01:00:18.913286+0000","last_fullsized":"2024-05-09T01:00:18.913286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.401549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.920462+0000","last_change":"2024-05-09T00:58:37.366954+0000","last_active":"2024-05-09T01:00:18.920462+0000","last_peered":"2024-05-09T01:00:18.920462+0000","last_clean":"2024-05-09T01:00:18.920462+0000","last_became_active":"2024-05-09T00:58:37.364361+0000","last_became_peered":"2024-05-09T00:58:37.364361+0000","last_unstale":"2024-05-09T01:00:18.920462+0000","last_undegraded":"2024-05-09T01:00:18.920462+0000","last_fullsized":"2024-05-09T01:00:18.920462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:25:31.248873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.926925+0000","last_change":"2024-05-09T00:58:37.368467+0000","last_active":"2024-05-09T01:00:18.926925+0000","last_peered":"2024-05-09T01:00:18.926925+0000","last_clean":"2024-05-09T01:00:18.926925+0000","last_became_active":"2024-05-09T00:58:37.368104+0000","last_became_peered":"2024-05-09T00:58:37.368104+0000","last_unstale":"2024-05-09T01:00:18.926925+0000","last_undegraded":"2024-05-09T01:00:18.926925+0000","last_fullsized":"2024-05-09T01:00:18.926925+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.919954+0000","last_change":"2024-05-09T00:58:37.366897+0000","last_active":"2024-05-09T01:00:18.919954+0000","last_peered":"2024-05-09T01:00:18.919954+0000","last_clean":"2024-05-09T01:00:18.919954+0000","last_became_active":"2024-05-09T00:58:37.366555+0000","last_became_peered":"2024-05-09T00:58:37.366555+0000","last_unstale":"2024-05-09T01:00:18.919954+0000","last_undegraded":"2024-05-09T01:00:18.919954+0000","last_fullsized":"2024-05-09T01:00:18.919954+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:15.394191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T01:00:18.923286+0000","last_change":"2024-05-09T00:58:37.358875+0000","last_active":"2024-05-09T01:00:18.923286+0000","last_peered":"2024-05-09T01:00:18.923286+0000","last_clean":"2024-05-09T01:00:18.923286+0000","last_became_active":"2024-05-09T00:58:37.358505+0000","last_became_peered":"2024-05-09T00:58:37.358505+0000","last_unstale":"2024-05-09T01:00:18.923286+0000","last_undegraded":"2024-05-09T01:00:18.923286+0000","last_fullsized":"2024-05-09T01:00:18.923286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:58:36.326127+0000","last_clean_scrub_stamp":"2024-05-09T00:58:36.326127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:15.268147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74071,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1834,"num_read_kb":1001,"num_write":261,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":222213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678073,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":892928,"data_stored":431606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874301,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1089108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234056,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":897024,"data_stored":431158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462988,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1503232,"data_stored":1024237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626515,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":430609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":497799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":913408,"data_stored":432480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":983040,"data_stored":498551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":430434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986268,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":892928,"data_stored":431310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822741,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1515520,"data_stored":1023075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T01:01:58.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:01:58.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:58 smithi151 ceph-mon[34780]: pgmap v390: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-09T01:01:58.741 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:01:59.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:59 smithi037 ceph-mon[30122]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:01:59.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:01:59 smithi037 ceph-mon[30122]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:01:59.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:59 smithi136 ceph-mon[34110]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:01:59.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:01:59 smithi136 ceph-mon[34110]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:01:59.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:59 smithi151 ceph-mon[34780]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:01:59.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:01:59 smithi151 ceph-mon[34780]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:02:00.115 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:00 smithi037 ceph-mon[30122]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:02:00.115 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:00 smithi037 ceph-mon[30122]: pgmap v391: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T01:02:00.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:00 smithi136 ceph-mon[34110]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:02:00.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:00 smithi136 ceph-mon[34110]: pgmap v391: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T01:02:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 -- 172.21.15.37:0/1312004513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c1034c0 msgr2=0x7f3e2c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 --2- 172.21.15.37:0/1312004513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c1034c0 0x7f3e2c1038d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3e280099c0 tx=0x7f3e28009cd0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 -- 172.21.15.37:0/1312004513 shutdown_connections 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 --2- 172.21.15.37:0/1312004513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e2c108740 0x7f3e2c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 --2- 172.21.15.37:0/1312004513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c1034c0 0x7f3e2c1038d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 --2- 172.21.15.37:0/1312004513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2c107df0 0x7f3e2c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 -- 172.21.15.37:0/1312004513 >> 172.21.15.37:0/1312004513 conn(0x7f3e2c0fedf0 msgr2=0x7f3e2c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.362+0000 7f3e34681700 1 -- 172.21.15.37:0/1312004513 shutdown_connections 2024-05-09T01:02:00.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.363+0000 7f3e34681700 1 -- 172.21.15.37:0/1312004513 wait complete. 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.363+0000 7f3e34681700 1 Processor -- start 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.363+0000 7f3e34681700 1 -- start start 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e34681700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2c1034c0 0x7f3e2c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e34681700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c107df0 0x7f3e2c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e34681700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e2c108740 0x7f3e2c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e34681700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1133e0 con 0x7f3e2c107df0 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e34681700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c113260 con 0x7f3e2c108740 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e34681700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c113560 con 0x7f3e2c1034c0 2024-05-09T01:02:00.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c107df0 0x7f3e2c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c107df0 0x7f3e2c19a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57522/0 (socket says 172.21.15.37:57522) 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 -- 172.21.15.37:0/2551700527 learned_addr learned my addr 172.21.15.37:0/2551700527 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e32c1e700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e2c108740 0x7f3e2c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e3241d700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2c1034c0 0x7f3e2c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 -- 172.21.15.37:0/2551700527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2c1034c0 msgr2=0x7f3e2c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2c1034c0 0x7f3e2c199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 -- 172.21.15.37:0/2551700527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e2c108740 msgr2=0x7f3e2c19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e2c108740 0x7f3e2c19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 -- 172.21.15.37:0/2551700527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c1a91f0 con 0x7f3e2c107df0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.364+0000 7f3e31c1c700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c107df0 0x7f3e2c19a030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00b500 tx=0x7f3e1c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.365+0000 7f3e237fe700 1 -- 172.21.15.37:0/2551700527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c015020 con 0x7f3e2c107df0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.365+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2c1a94e0 con 0x7f3e2c107df0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.365+0000 7f3e237fe700 1 -- 172.21.15.37:0/2551700527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c011ce0 con 0x7f3e2c107df0 2024-05-09T01:02:00.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.365+0000 7f3e237fe700 1 -- 172.21.15.37:0/2551700527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c010cb0 con 0x7f3e2c107df0 2024-05-09T01:02:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.365+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2c1a9a20 con 0x7f3e2c107df0 2024-05-09T01:02:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.366+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2c104970 con 0x7f3e2c107df0 2024-05-09T01:02:00.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.367+0000 7f3e237fe700 1 -- 172.21.15.37:0/2551700527 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3e1c018020 con 0x7f3e2c107df0 2024-05-09T01:02:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.368+0000 7f3e237fe700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e180b2880 0x7f3e180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.368+0000 7f3e3241d700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e180b2880 0x7f3e180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.368+0000 7f3e237fe700 1 -- 172.21.15.37:0/2551700527 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3e1c0e1dc0 con 0x7f3e2c107df0 2024-05-09T01:02:00.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.369+0000 7f3e3241d700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e180b2880 0x7f3e180b4d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009990 tx=0x7f3e28000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:00.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.372+0000 7f3e237fe700 1 -- 172.21.15.37:0/2551700527 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3e1c01f020 con 0x7f3e2c107df0 2024-05-09T01:02:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:00 smithi151 ceph-mon[34780]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T01:02:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:00 smithi151 ceph-mon[34780]: pgmap v391: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T01:02:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.632+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e2c076010 con 0x7f3e2c107df0 2024-05-09T01:02:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.633+0000 7f3e237fe700 1 -- 172.21.15.37:0/2551700527 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11936 (secure 0 0 0) 0x7f3e2c076010 con 0x7f3e2c107df0 2024-05-09T01:02:00.635 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:00.635 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:01:52.283608+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24454,24445,24467,24446]},"id":1}]} 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e180b2880 msgr2=0x7f3e180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e180b2880 0x7f3e180b4d90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009990 tx=0x7f3e28000bc0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c107df0 msgr2=0x7f3e2c19a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c107df0 0x7f3e2c19a030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00b500 tx=0x7f3e1c00b810 comp rx=0 tx=0).stop 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 shutdown_connections 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e180b2880 0x7f3e180b4d90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e2c108740 0x7f3e2c19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2c1034c0 0x7f3e2c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 --2- 172.21.15.37:0/2551700527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2c107df0 0x7f3e2c19a030 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 >> 172.21.15.37:0/2551700527 conn(0x7f3e2c0fedf0 msgr2=0x7f3e2c1096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 shutdown_connections 2024-05-09T01:02:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:00.636+0000 7f3e34681700 1 -- 172.21.15.37:0/2551700527 wait complete. 2024-05-09T01:02:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-05-09T01:02:01.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:01 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2551700527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:02:01.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T01:02:01.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:01 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2551700527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:02:01.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:01 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2551700527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:02:01.519 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:02.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:02 smithi037 ceph-mon[30122]: pgmap v392: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-09T01:02:02.376 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:02 smithi151 ceph-mon[34780]: pgmap v392: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-09T01:02:02.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:02 smithi136 ceph-mon[34110]: pgmap v392: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.123+0000 7f2a1f392700 1 -- 172.21.15.37:0/2924573005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a18108740 msgr2=0x7f2a181100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.123+0000 7f2a1f392700 1 --2- 172.21.15.37:0/2924573005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a18108740 0x7f2a181100a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b0d0 tx=0x7f2a1000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.123+0000 7f2a1f392700 1 -- 172.21.15.37:0/2924573005 shutdown_connections 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.123+0000 7f2a1f392700 1 --2- 172.21.15.37:0/2924573005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a18108740 0x7f2a181100a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.123+0000 7f2a1f392700 1 --2- 172.21.15.37:0/2924573005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a181034c0 0x7f2a181038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.123+0000 7f2a1f392700 1 --2- 172.21.15.37:0/2924573005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18107df0 0x7f2a18108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.123+0000 7f2a1f392700 1 -- 172.21.15.37:0/2924573005 >> 172.21.15.37:0/2924573005 conn(0x7f2a180fedf0 msgr2=0x7f2a18101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.124+0000 7f2a1f392700 1 -- 172.21.15.37:0/2924573005 shutdown_connections 2024-05-09T01:02:03.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.124+0000 7f2a1f392700 1 -- 172.21.15.37:0/2924573005 wait complete. 2024-05-09T01:02:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 Processor -- start 2024-05-09T01:02:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 -- start start 2024-05-09T01:02:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a181034c0 0x7f2a1819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a18107df0 0x7f2a1819c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18108740 0x7f2a181a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a181133f0 con 0x7f2a181034c0 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18113270 con 0x7f2a18108740 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1f392700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2a18113570 con 0x7f2a18107df0 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1d12e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a181034c0 0x7f2a1819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1d12e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a181034c0 0x7f2a1819bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53632/0 (socket says 172.21.15.37:53632) 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1d12e700 1 -- 172.21.15.37:0/937772330 learned_addr learned my addr 172.21.15.37:0/937772330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1d92f700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18108740 0x7f2a181a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.125+0000 7f2a1c92d700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a18107df0 0x7f2a1819c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1d12e700 1 -- 172.21.15.37:0/937772330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a18107df0 msgr2=0x7f2a1819c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1d12e700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a18107df0 0x7f2a1819c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1d12e700 1 -- 172.21.15.37:0/937772330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18108740 msgr2=0x7f2a181a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1d12e700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18108740 0x7f2a181a6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1d12e700 1 -- 172.21.15.37:0/937772330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1819ca40 con 0x7f2a181034c0 2024-05-09T01:02:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1d12e700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a181034c0 0x7f2a1819bc50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400b530 tx=0x7f2a1400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:03.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a0e7fc700 1 -- 172.21.15.37:0/937772330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14015020 con 0x7f2a181034c0 2024-05-09T01:02:03.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a181a7330 con 0x7f2a181034c0 2024-05-09T01:02:03.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a181a7870 con 0x7f2a181034c0 2024-05-09T01:02:03.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a0e7fc700 1 -- 172.21.15.37:0/937772330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a14011ce0 con 0x7f2a181034c0 2024-05-09T01:02:03.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.126+0000 7f2a0e7fc700 1 -- 172.21.15.37:0/937772330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14010dd0 con 0x7f2a181034c0 2024-05-09T01:02:03.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.127+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a180512c0 con 0x7f2a181034c0 2024-05-09T01:02:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.129+0000 7f2a0e7fc700 1 -- 172.21.15.37:0/937772330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2a14018020 con 0x7f2a181034c0 2024-05-09T01:02:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.129+0000 7f2a0e7fc700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a040b2880 0x7f2a040b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.130+0000 7f2a1c92d700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a040b2880 0x7f2a040b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.130+0000 7f2a0e7fc700 1 -- 172.21.15.37:0/937772330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2a140e1dc0 con 0x7f2a181034c0 2024-05-09T01:02:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.130+0000 7f2a1c92d700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a040b2880 0x7f2a040b4d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a1806b9f0 tx=0x7f2a0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:03.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.133+0000 7f2a0e7fc700 1 -- 172.21.15.37:0/937772330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2a1401f020 con 0x7f2a181034c0 2024-05-09T01:02:03.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.349+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a18076040 con 0x7f2a181034c0 2024-05-09T01:02:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.351+0000 7f2a0e7fc700 1 -- 172.21.15.37:0/937772330 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7f2a140a9b80 con 0x7f2a181034c0 2024-05-09T01:02:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:03.352 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:02:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a040b2880 msgr2=0x7f2a040b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a040b2880 0x7f2a040b4d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2a1806b9f0 tx=0x7f2a0800b410 comp rx=0 tx=0).stop 2024-05-09T01:02:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a181034c0 msgr2=0x7f2a1819bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a181034c0 0x7f2a1819bc50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400b530 tx=0x7f2a1400b840 comp rx=0 tx=0).stop 2024-05-09T01:02:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 shutdown_connections 2024-05-09T01:02:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2a040b2880 0x7f2a040b4d90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18108740 0x7f2a181a6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a181034c0 0x7f2a1819bc50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 --2- 172.21.15.37:0/937772330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a18107df0 0x7f2a1819c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 >> 172.21.15.37:0/937772330 conn(0x7f2a180fedf0 msgr2=0x7f2a18107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 shutdown_connections 2024-05-09T01:02:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:03.353+0000 7f2a1f392700 1 -- 172.21.15.37:0/937772330 wait complete. 2024-05-09T01:02:04.010 DEBUG:tasks.fwd_scrub:Yielding 2024-05-09T01:02:04.010 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-09T01:02:04.021 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:02:04.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-09T01:02:04.022 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-09T01:02:04.022 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:02:04.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:02:04.025 INFO:teuthology.run_tasks:Running task exec... 2024-05-09T01:02:04.061 INFO:teuthology.task.exec:Executing custom commands... 2024-05-09T01:02:04.062 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:02:04.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-05-09T01:02:04.101 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:04.116 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem Size Used Avail Use% Mounted on 2024-05-09T01:02:04.117 INFO:teuthology.orchestra.run.smithi037.stdout:0@ec4482a6-0d9d-11ef-bc97-c7b262605968.cephfs=/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 340G 0 340G 0% /tmp/cephfs 2024-05-09T01:02:04.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-05-09T01:02:04.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-05-09T01:02:04.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:04 smithi037 ceph-mon[30122]: pgmap v393: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 937 B/s wr, 9 op/s 2024-05-09T01:02:04.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:04 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/937772330' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:02:04.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-05-09T01:02:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:04.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:04 smithi136 ceph-mon[34110]: pgmap v393: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 937 B/s wr, 9 op/s 2024-05-09T01:02:04.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:04 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/937772330' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:02:04.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:04 smithi151 ceph-mon[34780]: pgmap v393: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 937 B/s wr, 9 op/s 2024-05-09T01:02:04.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:04 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/937772330' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:02:06.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-05-09T01:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-05-09T01:02:06.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-05-09T01:02:06.247 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:06 smithi037 ceph-mon[30122]: pgmap v394: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 937 B/s wr, 10 op/s 2024-05-09T01:02:06.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 .. 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 data 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 .. 2024-05-09T01:02:06.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-05-09T01:02:06.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:06 smithi136 ceph-mon[34110]: pgmap v394: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 937 B/s wr, 10 op/s 2024-05-09T01:02:06.451 INFO:teuthology.orchestra.run.smithi037.stdout:[Service] 2024-05-09T01:02:06.451 INFO:teuthology.orchestra.run.smithi037.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-05-09T01:02:06.451 INFO:teuthology.orchestra.run.smithi037.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-05-09T01:02:06.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-05-09T01:02:06.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:06 smithi151 ceph-mon[34780]: pgmap v394: 97 pgs: 97 active+clean; 649 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 937 B/s wr, 10 op/s 2024-05-09T01:02:06.580 INFO:teuthology.orchestra.run.smithi037.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-05-09T01:02:06.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.698+0000 7f4f9cd98700 1 -- 172.21.15.37:0/381909813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f981034c0 msgr2=0x7f4f981038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.698+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/381909813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f981034c0 0x7f4f981038d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4f880099c0 tx=0x7f4f88009cd0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.698+0000 7f4f9cd98700 1 -- 172.21.15.37:0/381909813 shutdown_connections 2024-05-09T01:02:06.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.698+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/381909813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f98108740 0x7f4f981100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.698+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/381909813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f981034c0 0x7f4f981038d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.698+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/381909813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f98107df0 0x7f4f98108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.698+0000 7f4f9cd98700 1 -- 172.21.15.37:0/381909813 >> 172.21.15.37:0/381909813 conn(0x7f4f980fedf0 msgr2=0x7f4f98101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:06.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.699+0000 7f4f9cd98700 1 -- 172.21.15.37:0/381909813 shutdown_connections 2024-05-09T01:02:06.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.699+0000 7f4f9cd98700 1 -- 172.21.15.37:0/381909813 wait complete. 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.699+0000 7f4f9cd98700 1 Processor -- start 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.699+0000 7f4f9cd98700 1 -- start start 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f9cd98700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f981034c0 0x7f4f9819add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f9cd98700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f98107df0 0x7f4f9819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f9cd98700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f98108740 0x7f4f9819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f9cd98700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f981144c0 con 0x7f4f98108740 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f9cd98700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98114340 con 0x7f4f981034c0 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f9cd98700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98114640 con 0x7f4f98107df0 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f98108740 0x7f4f9819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f98108740 0x7f4f9819f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53644/0 (socket says 172.21.15.37:53644) 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 -- 172.21.15.37:0/3844208862 learned_addr learned my addr 172.21.15.37:0/3844208862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:06.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f981034c0 0x7f4f9819add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f98107df0 0x7f4f9819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 -- 172.21.15.37:0/3844208862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f98107df0 msgr2=0x7f4f9819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f98107df0 0x7f4f9819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 -- 172.21.15.37:0/3844208862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f981034c0 msgr2=0x7f4f9819add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f981034c0 0x7f4f9819add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.700+0000 7f4f96d9d700 1 -- 172.21.15.37:0/3844208862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9819fca0 con 0x7f4f98108740 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.701+0000 7f4f96d9d700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f98108740 0x7f4f9819f600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007ee0 tx=0x7f4f9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.701+0000 7f4f877fe700 1 -- 172.21.15.37:0/3844208862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90004bb0 con 0x7f4f98108740 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.701+0000 7f4f877fe700 1 -- 172.21.15.37:0/3844208862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f90004d50 con 0x7f4f98108740 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.701+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9819ff90 con 0x7f4f98108740 2024-05-09T01:02:06.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.701+0000 7f4f877fe700 1 -- 172.21.15.37:0/3844208862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90005920 con 0x7f4f98108740 2024-05-09T01:02:06.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.701+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f981a78b0 con 0x7f4f98108740 2024-05-09T01:02:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.705+0000 7f4f877fe700 1 -- 172.21.15.37:0/3844208862 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4f9001a020 con 0x7f4f98108740 2024-05-09T01:02:06.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.705+0000 7f4fab7aeb80 1 Processor -- start 2024-05-09T01:02:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.705+0000 7f4fab7aeb80 1 -- start start 2024-05-09T01:02:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a44106c1e0 0x55a441105570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441105ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a4410ff720 0x55a4410ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a441022070 con 0x55a4410ff720 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a440fc0870 con 0x55a440f82520 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a44101e030 con 0x55a44106c1e0 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a4410ff720 0x55a4410ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a4410ff720 0x55a4410ffb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53648/0 (socket says 172.21.15.37:53648) 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f95d9b700 1 -- 172.21.15.37:0/3859242073 learned_addr learned my addr 172.21.15.37:0/3859242073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f877fe700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f800b2880 0x7f4f800b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441105ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a44106c1e0 0x55a441105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f96d9d700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f800b2880 0x7f4f800b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f9659c700 1 -- 172.21.15.37:0/3859242073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a44106c1e0 msgr2=0x55a441105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a44106c1e0 0x55a441105570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f9659c700 1 -- 172.21.15.37:0/3859242073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a4410ff720 msgr2=0x55a4410ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a4410ff720 0x55a4410ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f877fe700 1 -- 172.21.15.37:0/3844208862 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4f900e16e0 con 0x7f4f98108740 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.706+0000 7f4f9659c700 1 -- 172.21.15.37:0/3859242073 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a440fb83f0 con 0x55a440f82520 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.707+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441105ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009f50 tx=0x7f4f880095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537d6326cbfcfa83 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.707+0000 7f4f96d9d700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f800b2880 0x7f4f800b4d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007fd0 tx=0x7f4f90004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.707+0000 7f4f84ff9700 1 -- 172.21.15.37:0/3859242073 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88003a60 con 0x55a440f82520 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.707+0000 7f4f84ff9700 1 -- 172.21.15.37:0/3859242073 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f88005520 con 0x55a440f82520 2024-05-09T01:02:06.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.707+0000 7f4f84ff9700 1 -- 172.21.15.37:0/3859242073 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800bc70 con 0x55a440f82520 2024-05-09T01:02:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3859242073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 msgr2=0x55a441105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441105ab0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009f50 tx=0x7f4f880095c0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3859242073 shutdown_connections 2024-05-09T01:02:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a4410ff720 0x55a4410ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a44106c1e0 0x55a441105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3859242073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441105ab0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3859242073 >> 172.21.15.37:0/3859242073 conn(0x55a440fe2720 msgr2=0x55a4410fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3859242073 shutdown_connections 2024-05-09T01:02:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3859242073 wait complete. 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.708+0000 7f4fab7aeb80 1 -- start start 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 1 Processor -- start 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441109220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441109760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a440e9dc20 con 0x55a44106c1e0 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a440fdc1d0 con 0x55a440f82520 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a441100560 con 0x55a4410ff720 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4fab7aeb80 10 client.0 _ll_register_callbacks cb 0x55a440e93740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441109760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53660/0 (socket says 172.21.15.37:53660) 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 -- 172.21.15.37:0/3620946053 learned_addr learned my addr 172.21.15.37:0/3620946053 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 -- 172.21.15.37:0/3620946053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 msgr2=0x55a441109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 -- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 msgr2=0x55a441109220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441109220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.709+0000 7f4f9659c700 1 -- 172.21.15.37:0/3620946053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a440e9d510 con 0x55a44106c1e0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4f9659c700 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441109760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009350 tx=0x7f4f8800bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a4484aca7cb16f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4f7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4f7dffb700 1 -- 172.21.15.37:0/3620946053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800be80 con 0x55a44106c1e0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4f7dffb700 1 -- 172.21.15.37:0/3620946053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4f88028040 con 0x55a44106c1e0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f88005520 con 0x55a44106c1e0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4f7dffb700 1 -- 172.21.15.37:0/3620946053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f880052e0 con 0x55a44106c1e0 2024-05-09T01:02:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4fab7aeb80 10 client.15225 fetch_fsmap learned FSMap version 29 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a44111af70 con 0x55a44106c1e0 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.710+0000 7f4f7dffb700 1 -- 172.21.15.37:0/3620946053 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f88005520 con 0x55a44106c1e0 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4f7dffb700 1 -- 172.21.15.37:0/3620946053 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4f88034030 con 0x55a44106c1e0 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4fab7aeb80 10 client.15225 fetch_fsmap finished waiting for FSMap version 29 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4fab7aeb80 10 client.15225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4fab7aeb80 20 client.15225 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a44111d440 0x55a44111f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4fab7aeb80 4 client.15225 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a44102fa50 con 0x55a44111d440 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a44111d440 0x55a44111f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a44111d440 0x55a44111f860 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da1b24e4efbd4968 server_cookie=dfd4af530935deb9 in_seq=0 out_seq=0 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.711+0000 7f4f7dffb700 10 client.15225 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.712+0000 7f4f7dffb700 1 -- 172.21.15.37:0/3620946053 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a44102fa50 con 0x55a44111d440 2024-05-09T01:02:06.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.712+0000 7f4f7dffb700 10 client.15225 handle_command_reply: tid=0 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.712+0000 7f4fab7aeb80 1 client.15225 shutdown 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.712+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 msgr2=0x55a441109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.712+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441109760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009350 tx=0x7f4f8800bb80 comp rx=0 tx=0).stop 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 shutdown_connections 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a44111d440 0x55a44111f860 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a441109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/3620946053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441109760 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4f7dffb700 0 client.15225 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 >> 172.21.15.37:0/3620946053 conn(0x55a440fe2720 msgr2=0x55a4410fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 shutdown_connections 2024-05-09T01:02:06.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/3620946053 wait complete. 2024-05-09T01:02:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.713+0000 7f4fab7aeb80 20 client.15225 trim_cache size 0 max 16384 2024-05-09T01:02:06.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.733+0000 7f4fab7aeb80 1 Processor -- start 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.733+0000 7f4fab7aeb80 1 -- start start 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a4411197b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441103380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7800d220 con 0x55a44106c1e0 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7800ed60 con 0x55a440f82520 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7800d8f0 con 0x55a4410ff720 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441103380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441103380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53664/0 (socket says 172.21.15.37:53664) 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 -- 172.21.15.37:0/1601888403 learned_addr learned my addr 172.21.15.37:0/1601888403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a4411197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 -- 172.21.15.37:0/1601888403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 msgr2=0x55a441109790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 -- 172.21.15.37:0/1601888403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 msgr2=0x55a4411197b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a4411197b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 -- 172.21.15.37:0/1601888403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a441107790 con 0x55a44106c1e0 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.734+0000 7f4f9659c700 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441103380 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b700 tx=0x7f4f88009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2119388ff93c6d3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.735+0000 7f4f7ffff700 1 -- 172.21.15.37:0/1601888403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800fb70 con 0x55a44106c1e0 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.735+0000 7f4f7ffff700 1 -- 172.21.15.37:0/1601888403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f8800bcc0 con 0x55a44106c1e0 2024-05-09T01:02:06.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.735+0000 7f4f7ffff700 1 -- 172.21.15.37:0/1601888403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88022430 con 0x55a44106c1e0 2024-05-09T01:02:06.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/1601888403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 msgr2=0x55a441103380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441103380 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b700 tx=0x7f4f88009f10 comp rx=0 tx=0).stop 2024-05-09T01:02:06.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/1601888403 shutdown_connections 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a440f82520 0x55a4411197b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/1601888403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a44106c1e0 0x55a441103380 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/1601888403 >> 172.21.15.37:0/1601888403 conn(0x55a440fe2720 msgr2=0x55a441102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/1601888403 shutdown_connections 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/1601888403 wait complete. 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 -- start start 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 Processor -- start 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a440f82520 0x55a441122700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.736+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a44106c1e0 0x55a441122c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4fab7aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441120b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7800e690 con 0x55a440f82520 2024-05-09T01:02:06.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7800dfc0 con 0x55a44106c1e0 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4fab7aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7800b1c0 con 0x55a4410ff720 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4fab7aeb80 10 client.0 _ll_register_callbacks cb 0x55a440e93740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a440f82520 0x55a441122700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a440f82520 0x55a441122700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53678/0 (socket says 172.21.15.37:53678) 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 -- 172.21.15.37:0/672697138 learned_addr learned my addr 172.21.15.37:0/672697138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f9659c700 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a44106c1e0 0x55a441122c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 -- 172.21.15.37:0/672697138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 msgr2=0x55a441120b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441120b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 -- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a44106c1e0 msgr2=0x55a441122c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a44106c1e0 0x55a441122c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 -- 172.21.15.37:0/672697138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a441121290 con 0x55a440f82520 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f95d9b700 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a440f82520 0x55a441122700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55a441106140 tx=0x7f4f8c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e1b8f108e47b77 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:06.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f7dffb700 1 -- 172.21.15.37:0/672697138 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c010be0 con 0x55a440f82520 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4f7dffb700 1 -- 172.21.15.37:0/672697138 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4f8c010d80 con 0x55a440f82520 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.737+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f8800bcc0 con 0x55a440f82520 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4f7dffb700 1 -- 172.21.15.37:0/672697138 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f8c004020 con 0x55a440f82520 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 10 client.15231 fetch_fsmap learned FSMap version 29 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a441188330 con 0x55a440f82520 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4f7dffb700 1 -- 172.21.15.37:0/672697138 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f8800bcc0 con 0x55a440f82520 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4f7dffb700 1 -- 172.21.15.37:0/672697138 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4f8c02d030 con 0x55a440f82520 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 10 client.15231 fetch_fsmap finished waiting for FSMap version 29 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 10 client.15231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 20 client.15231 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a441188a20 0x55a44118ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 4 client.15231 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a441029af0 con 0x55a441188a20 2024-05-09T01:02:06.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.738+0000 7f4f9659c700 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a441188a20 0x55a44118ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:06.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.739+0000 7f4f7dffb700 10 client.15231 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:06.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.739+0000 7f4f9659c700 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a441188a20 0x55a44118ae40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4bddf8d684bd495 server_cookie=927c4bd772bf9498 in_seq=0 out_seq=0 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4f7dffb700 1 -- 172.21.15.37:0/672697138 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a441029af0 con 0x55a441188a20 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4f7dffb700 10 client.15231 handle_command_reply: tid=0 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 client.15231 shutdown 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a440f82520 msgr2=0x55a441122700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a440f82520 0x55a441122700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55a441106140 tx=0x7f4f8c014040 comp rx=0 tx=0).stop 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 shutdown_connections 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a441188a20 0x55a44118ae40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4410ff720 0x55a441120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a440f82520 0x55a441122700 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4f7dffb700 0 client.15231 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 --2- 172.21.15.37:0/672697138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a44106c1e0 0x55a441122c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 >> 172.21.15.37:0/672697138 conn(0x55a440fe2720 msgr2=0x55a441102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:06.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 shutdown_connections 2024-05-09T01:02:06.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 1 -- 172.21.15.37:0/672697138 wait complete. 2024-05-09T01:02:06.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.742+0000 7f4fab7aeb80 20 client.15231 trim_cache size 0 max 16384 2024-05-09T01:02:06.746 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:02:06.746 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:02:06.746 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "db7e1557-f8c0-4c10-bd10-345f9e1e0478", 2024-05-09T01:02:06.746 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:02:06.746 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f800b2880 msgr2=0x7f4f800b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f800b2880 0x7f4f800b4d90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007fd0 tx=0x7f4f90004ad0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f98108740 msgr2=0x7f4f9819f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f98108740 0x7f4f9819f600 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007ee0 tx=0x7f4f9000d3b0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 shutdown_connections 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f800b2880 0x7f4f800b4d90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f98108740 0x7f4f9819f600 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f981034c0 0x7f4f9819add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 --2- 172.21.15.37:0/3844208862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f98107df0 0x7f4f9819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:06.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 >> 172.21.15.37:0/3844208862 conn(0x7f4f980fedf0 msgr2=0x7f4f981096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:06.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 shutdown_connections 2024-05-09T01:02:06.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:06.743+0000 7f4f9cd98700 1 -- 172.21.15.37:0/3844208862 wait complete. 2024-05-09T01:02:07.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:02:07.809 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:08.218 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:08 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:02:08.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:08 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:02:08.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:08 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:02:08.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:08 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:02:08.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:08 smithi037 ceph-mon[30122]: pgmap v395: 97 pgs: 97 active+clean; 657 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-09T01:02:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:08 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:02:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:08 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:02:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:08 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:02:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:08 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:02:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:08 smithi136 ceph-mon[34110]: pgmap v395: 97 pgs: 97 active+clean; 657 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-09T01:02:08.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:08 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:02:08.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:08 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:02:08.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:08 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:02:08.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:08 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:02:08.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:08 smithi151 ceph-mon[34780]: pgmap v395: 97 pgs: 97 active+clean; 657 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.444+0000 7fbfb69d0700 1 -- 172.21.15.37:0/968736335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108020 msgr2=0x7fbfb0108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.444+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/968736335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108020 0x7fbfb0108430 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf980099c0 tx=0x7fbf98009cd0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 -- 172.21.15.37:0/968736335 shutdown_connections 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/968736335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb0108970 0x7fbfb01102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/968736335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfb0103c10 0x7fbfb0104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/968736335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108020 0x7fbfb0108430 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 -- 172.21.15.37:0/968736335 >> 172.21.15.37:0/968736335 conn(0x7fbfb00fe4e0 msgr2=0x7fbfb0100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 -- 172.21.15.37:0/968736335 shutdown_connections 2024-05-09T01:02:09.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 -- 172.21.15.37:0/968736335 wait complete. 2024-05-09T01:02:09.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.445+0000 7fbfb69d0700 1 Processor -- start 2024-05-09T01:02:09.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb69d0700 1 -- start start 2024-05-09T01:02:09.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb69d0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfb0103c10 0x7fbfb019b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb69d0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb0108020 0x7fbfb019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb69d0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108970 0x7fbfb019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb69d0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0113580 con 0x7fbfb0108970 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb69d0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0113400 con 0x7fbfb0103c10 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb69d0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb0113700 con 0x7fbfb0108020 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb4f6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108970 0x7fbfb019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb4f6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108970 0x7fbfb019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53690/0 (socket says 172.21.15.37:53690) 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfb0103c10 0x7fbfb019b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfb4f6d700 1 -- 172.21.15.37:0/420113969 learned_addr learned my addr 172.21.15.37:0/420113969 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb0108020 0x7fbfb019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfaffff700 1 -- 172.21.15.37:0/420113969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb0108020 msgr2=0x7fbfb019b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfaffff700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb0108020 0x7fbfb019b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfaffff700 1 -- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108970 msgr2=0x7fbfb019f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfaffff700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108970 0x7fbfb019f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.446+0000 7fbfaffff700 1 -- 172.21.15.37:0/420113969 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb019fea0 con 0x7fbfb0103c10 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.447+0000 7fbfaffff700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfb0103c10 0x7fbfb019b020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e9f0 tx=0x7fbfa000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.447+0000 7fbfadffb700 1 -- 172.21.15.37:0/420113969 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000c9c0 con 0x7fbfb0103c10 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.447+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb01a0190 con 0x7fbfb0103c10 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.447+0000 7fbfadffb700 1 -- 172.21.15.37:0/420113969 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa000cb60 con 0x7fbfb0103c10 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.447+0000 7fbfadffb700 1 -- 172.21.15.37:0/420113969 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0018680 con 0x7fbfb0103c10 2024-05-09T01:02:09.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.447+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb01a7ab0 con 0x7fbfb0103c10 2024-05-09T01:02:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.450+0000 7fbfadffb700 1 -- 172.21.15.37:0/420113969 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbfa0010430 con 0x7fbfb0103c10 2024-05-09T01:02:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.450+0000 7fbfadffb700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbf9c0b2900 0x7fbf9c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.450+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbf9c0b2900 0x7fbf9c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.450+0000 7fbfadffb700 1 -- 172.21.15.37:0/420113969 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbfa00e2250 con 0x7fbfb0103c10 2024-05-09T01:02:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 Processor -- start 2024-05-09T01:02:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 -- start start 2024-05-09T01:02:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbf9c0b2900 0x7fbf9c0b4e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000c00 tx=0x7fbf9801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1de4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1dde400 0x55d8b1dde810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1d010a0 con 0x55d8b1cdbd00 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1ca69a0 con 0x55d8b1c614a0 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1cfd060 con 0x55d8b1dde400 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53696/0 (socket says 172.21.15.37:53696) 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfaffff700 1 -- 172.21.15.37:0/1088315141 learned_addr learned my addr 172.21.15.37:0/1088315141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfb4f6d700 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1dde400 0x55d8b1dde810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.451+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1de4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfaffff700 1 -- 172.21.15.37:0/1088315141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1dde400 msgr2=0x55d8b1dde810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfaffff700 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1dde400 0x55d8b1dde810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfaffff700 1 -- 172.21.15.37:0/1088315141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 msgr2=0x55d8b1de4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfaffff700 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1de4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfaffff700 1 -- 172.21.15.37:0/1088315141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1c97500 con 0x55d8b1cdbd00 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1de4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfaffff700 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de4240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00a6b80 tx=0x7fbfa00b21a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc34024984381a94 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfa67fc700 1 -- 172.21.15.37:0/1088315141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00aa010 con 0x55d8b1cdbd00 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfa67fc700 1 -- 172.21.15.37:0/1088315141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa00a9910 con 0x55d8b1cdbd00 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.452+0000 7fbfa67fc700 1 -- 172.21.15.37:0/1088315141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00b22e0 con 0x55d8b1cdbd00 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1088315141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1cdbd00 msgr2=0x55d8b1de4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de4240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbfa00a6b80 tx=0x7fbfa00b21a0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1088315141 shutdown_connections 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1dde400 0x55d8b1dde810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de4240 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1088315141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1de4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1088315141 >> 172.21.15.37:0/1088315141 conn(0x55d8b1c64f70 msgr2=0x55d8b1dd9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1088315141 shutdown_connections 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1088315141 wait complete. 2024-05-09T01:02:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.453+0000 7fbfc53e6b80 1 -- start start 2024-05-09T01:02:09.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 1 Processor -- start 2024-05-09T01:02:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1de7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1de8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1ddf0a0 con 0x55d8b1dde400 2024-05-09T01:02:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1c9bb20 con 0x55d8b1cdbd00 2024-05-09T01:02:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d8b1ddf220 con 0x55d8b1c614a0 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfc53e6b80 10 client.0 _ll_register_callbacks cb 0x55d8b1b726c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfb4f6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1de8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1de7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfa7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfb4f6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1de8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53700/0 (socket says 172.21.15.37:53700) 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfb4f6d700 1 -- 172.21.15.37:0/83474726 learned_addr learned my addr 172.21.15.37:0/83474726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.454+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1de7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49458/0 (socket says 172.21.15.37:49458) 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfaffff700 1 -- 172.21.15.37:0/83474726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 msgr2=0x55d8b1de8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfaffff700 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfaffff700 1 -- 172.21.15.37:0/83474726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 msgr2=0x55d8b1de8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfaffff700 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1de8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfaffff700 1 -- 172.21.15.37:0/83474726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b1b7c490 con 0x55d8b1c614a0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfb4f6d700 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1de8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfaffff700 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1de7fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e9c0 tx=0x7fbfa00a58f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55904baa126f3b81 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbf8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/83474726 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00c2030 con 0x55d8b1c614a0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa00a9910 con 0x55d8b1c614a0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/83474726 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbfa00a5f00 con 0x55d8b1c614a0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/83474726 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbfa00adcc0 con 0x55d8b1c614a0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfc53e6b80 10 client.24979 fetch_fsmap learned FSMap version 29 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.455+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8b1ddf0a0 con 0x55d8b1c614a0 2024-05-09T01:02:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/83474726 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa00a9910 con 0x55d8b1c614a0 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/83474726 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbfa00107b0 con 0x55d8b1c614a0 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbfc53e6b80 10 client.24979 fetch_fsmap finished waiting for FSMap version 29 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbfc53e6b80 10 client.24979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbfc53e6b80 20 client.24979 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1df7c00 0x55d8b1dfa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbfc53e6b80 4 client.24979 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8b1d0ea80 con 0x55d8b1df7c00 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.456+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1df7c00 0x55d8b1dfa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.457+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1df7c00 0x55d8b1dfa020 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313d46d116f42138 server_cookie=bc4e0014d899936a in_seq=0 out_seq=0 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.457+0000 7fbf8f7fe700 10 client.24979 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/83474726 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d8b1d0ea80 con 0x55d8b1df7c00 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbf8f7fe700 10 client.24979 handle_command_reply: tid=0 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 client.24979 shutdown 2024-05-09T01:02:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 msgr2=0x55d8b1de7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1de7fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e9c0 tx=0x7fbfa00a58f0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 shutdown_connections 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1df7c00 0x55d8b1dfa020 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1de8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1de7fd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/83474726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1de8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 >> 172.21.15.37:0/83474726 conn(0x55d8b1c64f70 msgr2=0x55d8b1dd2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.458+0000 7fbf8f7fe700 0 client.24979 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.459+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 shutdown_connections 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.459+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/83474726 wait complete. 2024-05-09T01:02:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.459+0000 7fbfc53e6b80 20 client.24979 trim_cache size 0 max 16384 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.479+0000 7fbfc53e6b80 1 Processor -- start 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.479+0000 7fbfc53e6b80 1 -- start start 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1ddde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dea330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1df3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01aea20 con 0x55d8b1dde400 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01b0560 con 0x55d8b1c614a0 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01af0f0 con 0x55d8b1cdbd00 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1df3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1df3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53706/0 (socket says 172.21.15.37:53706) 2024-05-09T01:02:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 -- 172.21.15.37:0/1504828092 learned_addr learned my addr 172.21.15.37:0/1504828092 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfaffff700 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1ddde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 -- 172.21.15.37:0/1504828092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1cdbd00 msgr2=0x55d8b1dea330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dea330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 -- 172.21.15.37:0/1504828092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 msgr2=0x55d8b1ddde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1ddde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 -- 172.21.15.37:0/1504828092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b1dda1b0 con 0x55d8b1dde400 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:02:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfb4f6d700 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1df3d70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009550 tx=0x7fbfa80091b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a691018a5d6a95 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.480+0000 7fbfa5ffb700 1 -- 172.21.15.37:0/1504828092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8017820 con 0x55d8b1dde400 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfa5ffb700 1 -- 172.21.15.37:0/1504828092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa801b070 con 0x55d8b1dde400 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfa5ffb700 1 -- 172.21.15.37:0/1504828092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8020d80 con 0x55d8b1dde400 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1504828092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 msgr2=0x55d8b1df3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1df3d70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009550 tx=0x7fbfa80091b0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1504828092 shutdown_connections 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1df3d70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1c614a0 0x55d8b1ddde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1504828092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.481+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1504828092 >> 172.21.15.37:0/1504828092 conn(0x55d8b1c64f70 msgr2=0x55d8b1de8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.482+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1504828092 shutdown_connections 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.482+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1504828092 wait complete. 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.482+0000 7fbfc53e6b80 1 -- start start 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.482+0000 7fbfc53e6b80 1 Processor -- start 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.482+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1debda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.482+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfc53e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1dec820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01afe90 con 0x55d8b1dde400 2024-05-09T01:02:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01af7c0 con 0x55d8b1cdbd00 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfc53e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb01aca60 con 0x55d8b1c614a0 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfc53e6b80 10 client.0 _ll_register_callbacks cb 0x55d8b1b726c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dec2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56868/0 (socket says 172.21.15.37:56868) 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1653917114 learned_addr learned my addr 172.21.15.37:0/1653917114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfb4f6d700 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1dec820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfaffff700 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1debda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1653917114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 msgr2=0x55d8b1debda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1debda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1653917114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 msgr2=0x55d8b1dec820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1dec820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 -- 172.21.15.37:0/1653917114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b1e61200 con 0x55d8b1cdbd00 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfa7fff700 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dec2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbfb006c9e0 tx=0x7fbf98005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4990ed676d61e87a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbf8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/1653917114 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf980337d0 con 0x55d8b1cdbd00 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.483+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfa801b070 con 0x55d8b1cdbd00 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/1653917114 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbf98033970 con 0x55d8b1cdbd00 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/1653917114 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbf9800b790 con 0x55d8b1cdbd00 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 10 client.24971 fetch_fsmap learned FSMap version 29 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8b1e62470 con 0x55d8b1cdbd00 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/1653917114 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfa801b070 con 0x55d8b1cdbd00 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/1653917114 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbf98021070 con 0x55d8b1cdbd00 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 10 client.24971 fetch_fsmap finished waiting for FSMap version 29 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 10 client.24971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 20 client.24971 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1e62bb0 0x55d8b1e64fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 4 client.24971 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:02:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8b1d08b20 con 0x55d8b1e62bb0 2024-05-09T01:02:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.484+0000 7fbfaffff700 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1e62bb0 0x55d8b1e64fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.485+0000 7fbf8f7fe700 10 client.24971 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.485+0000 7fbfaffff700 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1e62bb0 0x55d8b1e64fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f90be45c134ee830 server_cookie=c656970aa4556478 in_seq=0 out_seq=0 2024-05-09T01:02:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbf8f7fe700 1 -- 172.21.15.37:0/1653917114 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d8b1d08b20 con 0x55d8b1e62bb0 2024-05-09T01:02:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbf8f7fe700 10 client.24971 handle_command_reply: tid=0 2024-05-09T01:02:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 client.24971 shutdown 2024-05-09T01:02:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 msgr2=0x55d8b1dec2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dec2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbfb006c9e0 tx=0x7fbf98005040 comp rx=0 tx=0).stop 2024-05-09T01:02:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 shutdown_connections 2024-05-09T01:02:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d8b1e62bb0 0x55d8b1e64fd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8b1dde400 0x55d8b1dec820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8b1c614a0 0x55d8b1debda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbf8f7fe700 0 client.24971 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 --2- 172.21.15.37:0/1653917114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8b1cdbd00 0x55d8b1dec2e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 >> 172.21.15.37:0/1653917114 conn(0x55d8b1c64f70 msgr2=0x55d8b1de1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 shutdown_connections 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.486+0000 7fbfc53e6b80 1 -- 172.21.15.37:0/1653917114 wait complete. 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfc53e6b80 20 client.24971 trim_cache size 0 max 16384 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:02:09.492 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout: "db7e1557-f8c0-4c10-bd10-345f9e1e0478": { 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "db7e1557-f8c0-4c10-bd10-345f9e1e0478", 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:02:09.493 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbf9c0b2900 msgr2=0x7fbf9c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbf9c0b2900 0x7fbf9c0b4e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000c00 tx=0x7fbf9801a040 comp rx=0 tx=0).stop 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfb0103c10 msgr2=0x7fbfb019b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfb0103c10 0x7fbfb019b020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000e9f0 tx=0x7fbfa000ed00 comp rx=0 tx=0).stop 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 shutdown_connections 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbf9c0b2900 0x7fbf9c0b4e10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfb0108970 0x7fbfb019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfb0103c10 0x7fbfb019b020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 --2- 172.21.15.37:0/420113969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfb0108020 0x7fbfb019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 >> 172.21.15.37:0/420113969 conn(0x7fbfb00fe4e0 msgr2=0x7fbfb0102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 shutdown_connections 2024-05-09T01:02:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:09.487+0000 7fbfb69d0700 1 -- 172.21.15.37:0/420113969 wait complete. 2024-05-09T01:02:10.130 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:10 smithi037 ceph-mon[30122]: pgmap v396: 97 pgs: 97 active+clean; 657 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T01:02:10.157 INFO:tasks.cephfs.filesystem:scrub status for tag:db7e1557-f8c0-4c10-bd10-345f9e1e0478 - {'path': '/', 'tag': 'db7e1557-f8c0-4c10-bd10-345f9e1e0478', 'options': 'recursive,force'} 2024-05-09T01:02:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:10 smithi136 ceph-mon[34110]: pgmap v396: 97 pgs: 97 active+clean; 657 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T01:02:10.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:10 smithi151 ceph-mon[34780]: pgmap v396: 97 pgs: 97 active+clean; 657 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T01:02:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:12 smithi136 ceph-mon[34110]: pgmap v397: 97 pgs: 97 active+clean; 7.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 588 KiB/s wr, 28 op/s 2024-05-09T01:02:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:12 smithi037 ceph-mon[30122]: pgmap v397: 97 pgs: 97 active+clean; 7.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 588 KiB/s wr, 28 op/s 2024-05-09T01:02:12.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:12 smithi151 ceph-mon[34780]: pgmap v397: 97 pgs: 97 active+clean; 7.4 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 588 KiB/s wr, 28 op/s 2024-05-09T01:02:13.235 INFO:teuthology.orchestra.run.smithi037.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-05-09T01:02:13.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 .. 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 data 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:total 35 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 . 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 .. 2024-05-09T01:02:13.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 base 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 May 9 01:02 global 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 log 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_commit_ts 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_dynshmem 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 9 01:02 pg_hba.conf 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 9 01:02 pg_ident.conf 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 pg_logical 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 pg_multixact 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_notify 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_replslot 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_serial 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_snapshots 2024-05-09T01:02:13.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_stat 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_stat_tmp 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 pg_subtrans 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_tblspc 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_twophase 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 pg_wal 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 pg_xact 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 9 01:02 postgresql.auto.conf 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 9 01:02 postgresql.conf 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base: 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 . 2024-05-09T01:02:13.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 1 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 13493 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 13494 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 . 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 .. 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 112 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 113 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 1247 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1247_fsm 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1247_vm 2024-05-09T01:02:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 9 01:02 1249 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1249_fsm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1249_vm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 9 01:02 1255 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1255_fsm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1255_vm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 9 01:02 1259 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1259_fsm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1259_vm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 9 01:02 13344 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13344_fsm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13344_vm 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13346 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13348 2024-05-09T01:02:13.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13349_fsm 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349_vm 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13351 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13353 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13354_fsm 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354_vm 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13356 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13358 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13359_fsm 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359_vm 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13361 2024-05-09T01:02:13.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13363 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1417 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1418 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 174 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 175 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2187 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2224 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2328 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2336 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2337 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2579 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2600 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2600_fsm 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2600_vm 2024-05-09T01:02:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2601_fsm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601_vm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2602 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2602_fsm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2602_vm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2603 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2603_fsm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2603_vm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2604 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2605 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2605_fsm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2605_vm 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606 2024-05-09T01:02:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2606_fsm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606_vm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2607 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2607_fsm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2607_vm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 9 01:02 2608 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2608_fsm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2608_vm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 9 01:02 2609 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2609_fsm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2609_vm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2610 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2610_fsm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2610_vm 2024-05-09T01:02:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2611 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2612_fsm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612_vm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2613 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2615_fsm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615_vm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2616 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2616_fsm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2616_vm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 9 01:02 2617 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2617_fsm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2617_vm 2024-05-09T01:02:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 9 01:02 2618 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2618_fsm 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2618_vm 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 9 01:02 2619 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2619_fsm 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2619_vm 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2620 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2650 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2651 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2652 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2653 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2654 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2655 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2656 2024-05-09T01:02:13.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2657 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 9 01:02 2658 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 2659 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2660 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2661 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2662 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2663 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2664 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2665 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2666 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2667 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2668 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2669 2024-05-09T01:02:13.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2670 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 9 01:02 2673 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 9 01:02 2674 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 9 01:02 2675 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2678 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2679 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2680 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2681 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2682 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2683 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2684 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2685 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2686 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2687 2024-05-09T01:02:13.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2688 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2689 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 9 01:02 2690 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 9 01:02 2691 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2692 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2693 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2696 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2699 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2701 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2702 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2703 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2704 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2753 2024-05-09T01:02:13.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2753_fsm 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2753_vm 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2754 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2755 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2756 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2757 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2830 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2831 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2832 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2833 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2834 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2835 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2836 2024-05-09T01:02:13.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2837 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 9 01:02 2838 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2838_fsm 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2838_vm 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2839 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840_fsm 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2840_vm 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2841 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2995 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2996 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3079_fsm 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079_vm 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3080 2024-05-09T01:02:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3081 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3085 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3118 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3119 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 9 01:02 3164 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3256 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3257 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3258 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3350 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3351 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3379 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3380 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3381 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3394 2024-05-09T01:02:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3394_fsm 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3394_vm 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3395 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3429 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3430 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3431 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3433 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3439 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3440 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3455 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 9 01:02 3456 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3456_fsm 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3456_vm 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3466 2024-05-09T01:02:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3467 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3468 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3501 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3502 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3503 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3534 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3541_fsm 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541_vm 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3542 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3574 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3575 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3576 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3596 2024-05-09T01:02:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3597 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3598 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3599 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3600_fsm 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600_vm 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3601_fsm 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601_vm 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3602_fsm 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602_vm 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603_fsm 2024-05-09T01:02:13.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3603_vm 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3604 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3605 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3606 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3607 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3608 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 3609 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3712 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3764_fsm 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764_vm 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3766 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3767 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3997 2024-05-09T01:02:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4143 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4144 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4145 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4146 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4147 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4148 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4149 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4150 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4151 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4152 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4153 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4154 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4155 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4156 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4157 2024-05-09T01:02:13.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4158 2024-05-09T01:02:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4159 2024-05-09T01:02:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4160 2024-05-09T01:02:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4161 2024-05-09T01:02:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4162 2024-05-09T01:02:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4163 2024-05-09T01:02:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4164 2024-05-09T01:02:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4165 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4166 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4167 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4168 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4169 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4170 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4171 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4172 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4173 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4174 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 5002 2024-05-09T01:02:13.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 548 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 549 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6102 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6104 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6106 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6110 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6111 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6112 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6113 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6117 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 826 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 827 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 828 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:02:13.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 . 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 .. 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 112 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 113 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 1247 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1247_fsm 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1247_vm 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 9 01:02 1249 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1249_fsm 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1249_vm 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 9 01:02 1255 2024-05-09T01:02:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1255_fsm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1255_vm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 9 01:02 1259 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1259_fsm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1259_vm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 9 01:02 13344 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13344_fsm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13344_vm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13346 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13348 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13349_fsm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349_vm 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13351 2024-05-09T01:02:13.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13353 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13354_fsm 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354_vm 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13356 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13358 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13359_fsm 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359_vm 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13361 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13363 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1417 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1418 2024-05-09T01:02:13.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 174 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 175 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2187 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2224 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2328 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2336 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2337 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2579 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2600 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2600_fsm 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2600_vm 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2601_fsm 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601_vm 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2602 2024-05-09T01:02:13.315 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2602_fsm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2602_vm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2603 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2603_fsm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2603_vm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2604 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2605 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2605_fsm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2605_vm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2606_fsm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606_vm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2607 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2607_fsm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2607_vm 2024-05-09T01:02:13.316 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 9 01:02 2608 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2608_fsm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2608_vm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 9 01:02 2609 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2609_fsm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2609_vm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2610 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2610_fsm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2610_vm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2611 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2612_fsm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612_vm 2024-05-09T01:02:13.317 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2613 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2615_fsm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615_vm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2616 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2616_fsm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2616_vm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 9 01:02 2617 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2617_fsm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2617_vm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 9 01:02 2618 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2618_fsm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2618_vm 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 9 01:02 2619 2024-05-09T01:02:13.318 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2619_fsm 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2619_vm 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2620 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2650 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2651 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2652 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2653 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2654 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2655 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2656 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2657 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 9 01:02 2658 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 2659 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2660 2024-05-09T01:02:13.319 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2661 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2662 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2663 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2664 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2665 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2666 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2667 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2668 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2669 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2670 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 9 01:02 2673 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 9 01:02 2674 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 9 01:02 2675 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2678 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2679 2024-05-09T01:02:13.320 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2680 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2681 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2682 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2683 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2684 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2685 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2686 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2687 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2688 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2689 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 9 01:02 2690 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 9 01:02 2691 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2692 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2693 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2696 2024-05-09T01:02:13.321 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2699 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2701 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2702 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2703 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2704 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2753 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2753_fsm 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2753_vm 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2754 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2755 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2756 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2757 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2830 2024-05-09T01:02:13.322 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2831 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2832 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2833 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2834 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2835 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2836 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2837 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 9 01:02 2838 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2838_fsm 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2838_vm 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2839 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840_fsm 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2840_vm 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2841 2024-05-09T01:02:13.323 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2995 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2996 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3079_fsm 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079_vm 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3080 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3081 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3085 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3118 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3119 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 9 01:02 3164 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3256 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3257 2024-05-09T01:02:13.324 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3258 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3350 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3351 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3379 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3380 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3381 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3394 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3394_fsm 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3394_vm 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3395 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3429 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3430 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3431 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3433 2024-05-09T01:02:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3439 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3440 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3455 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 9 01:02 3456 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3456_fsm 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3456_vm 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3466 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3467 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3468 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3501 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3502 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3503 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3534 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541 2024-05-09T01:02:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3541_fsm 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541_vm 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3542 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3574 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3575 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3576 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3596 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3597 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3598 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3599 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3600_fsm 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600_vm 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601 2024-05-09T01:02:13.327 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3601_fsm 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601_vm 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3602_fsm 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602_vm 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603_fsm 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3603_vm 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3604 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3605 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3606 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3607 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3608 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 3609 2024-05-09T01:02:13.328 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3712 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3764_fsm 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764_vm 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3766 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3767 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3997 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4143 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4144 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4145 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4146 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4147 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4148 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4149 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4150 2024-05-09T01:02:13.329 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4151 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4152 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4153 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4154 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4155 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4156 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4157 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4158 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4159 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4160 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4161 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4162 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4163 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4164 2024-05-09T01:02:13.330 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4165 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4166 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4167 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4168 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4169 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4170 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4171 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4172 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4173 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4174 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 5002 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 548 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 549 2024-05-09T01:02:13.331 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6102 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6104 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6106 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6110 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6111 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6112 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6113 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6117 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 826 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 827 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 828 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:02:13.332 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 . 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 .. 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 112 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 113 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 1247 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1247_fsm 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1247_vm 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 9 01:02 1249 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1249_fsm 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1249_vm 2024-05-09T01:02:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 9 01:02 1255 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1255_fsm 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1255_vm 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 9 01:02 1259 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1259_fsm 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1259_vm 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 9 01:02 13344 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13344_fsm 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13344_vm 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13346 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13348 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13349_fsm 2024-05-09T01:02:13.334 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349_vm 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13351 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13353 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13354_fsm 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354_vm 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13356 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13358 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13359_fsm 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359_vm 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13361 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13363 2024-05-09T01:02:13.335 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1417 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1418 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 174 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 175 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2187 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2224 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2328 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2336 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2337 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2579 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2600 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2600_fsm 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2600_vm 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2601_fsm 2024-05-09T01:02:13.336 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601_vm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2602 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2602_fsm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2602_vm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2603 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2603_fsm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2603_vm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2604 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2605 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2605_fsm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2605_vm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2606_fsm 2024-05-09T01:02:13.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606_vm 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2607 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2607_fsm 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2607_vm 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 9 01:02 2608 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2608_fsm 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2608_vm 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 9 01:02 2609 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2609_fsm 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2609_vm 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2610 2024-05-09T01:02:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2610_fsm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2610_vm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2611 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2612_fsm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612_vm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2613 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2615_fsm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615_vm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2616 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2616_fsm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2616_vm 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 9 01:02 2617 2024-05-09T01:02:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2617_fsm 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2617_vm 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 9 01:02 2618 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2618_fsm 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2618_vm 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 9 01:02 2619 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2619_fsm 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2619_vm 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2620 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2650 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2651 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2652 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2653 2024-05-09T01:02:13.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2654 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2655 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2656 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2657 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 9 01:02 2658 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 2659 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2660 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2661 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2662 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2663 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2664 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2665 2024-05-09T01:02:13.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2666 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2667 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2668 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2669 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2670 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 9 01:02 2673 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 9 01:02 2674 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 9 01:02 2675 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2678 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2679 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2680 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2681 2024-05-09T01:02:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2682 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2683 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2684 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2685 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2686 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2687 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2688 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2689 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 9 01:02 2690 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 9 01:02 2691 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2692 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2693 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2696 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2699 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2701 2024-05-09T01:02:13.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2702 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2703 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2704 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2753 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2753_fsm 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2753_vm 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2754 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2755 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2756 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2757 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2830 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2831 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2832 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2833 2024-05-09T01:02:13.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2834 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2835 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2836 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2837 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 9 01:02 2838 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2838_fsm 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2838_vm 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2839 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840_fsm 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2840_vm 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2841 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2995 2024-05-09T01:02:13.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2996 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3079_fsm 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079_vm 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3080 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3081 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3085 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3118 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3119 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 9 01:02 3164 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3256 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3257 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3258 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3350 2024-05-09T01:02:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3351 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3379 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3380 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3381 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3394 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3394_fsm 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3394_vm 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3395 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3429 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3430 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3431 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3433 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3439 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3440 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3455 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 9 01:02 3456 2024-05-09T01:02:13.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3456_fsm 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3456_vm 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3466 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3467 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3468 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3501 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3502 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3503 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3534 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3541_fsm 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541_vm 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3542 2024-05-09T01:02:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3574 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3575 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3576 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3596 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3597 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3598 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3599 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3600_fsm 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600_vm 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3601_fsm 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601_vm 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602 2024-05-09T01:02:13.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3602_fsm 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602_vm 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603_fsm 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3603_vm 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3604 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3605 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3606 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3607 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3608 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 3609 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3712 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764 2024-05-09T01:02:13.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3764_fsm 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764_vm 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3766 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3767 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3997 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4143 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4144 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4145 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4146 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4147 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4148 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4149 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4150 2024-05-09T01:02:13.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4151 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4152 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4153 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4154 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4155 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4156 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4157 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4158 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4159 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4160 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4161 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4162 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4163 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4164 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4165 2024-05-09T01:02:13.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4166 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4167 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4168 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4169 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4170 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4171 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4172 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4173 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4174 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 5002 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 548 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 549 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6102 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6104 2024-05-09T01:02:13.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6106 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6110 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6111 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6112 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6113 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6117 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 826 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 827 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 828 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/global: 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:total 537 2024-05-09T01:02:13.354 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 May 9 01:02 . 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1213 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1213_fsm 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1213_vm 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1214 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1214_fsm 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1214_vm 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 1232 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 1233 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1260 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1260_fsm 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1260_vm 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1261 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1261_fsm 2024-05-09T01:02:13.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1261_vm 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1262 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1262_fsm 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1262_vm 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2396 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2396_fsm 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2396_vm 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2397 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2671 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2672 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2676 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2677 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2694 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2695 2024-05-09T01:02:13.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2697 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2698 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2846 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2847 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2964 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2965 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2966 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2967 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3592 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3593 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4060 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4061 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4175 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4176 2024-05-09T01:02:13.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4177 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4178 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4181 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4182 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4183 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4184 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4185 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4186 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6000 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6001 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6002 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6100 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6114 2024-05-09T01:02:13.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6115 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 pg_control 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/log: 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:total 1 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 . 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 mappings 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 9 01:02 replorigin_checkpoint 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 snapshots 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-09T01:02:13.360 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 .. 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 .. 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 . 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 members 2024-05-09T01:02:13.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 offsets 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 .. 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 0000 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 .. 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 0000 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.362 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.363 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 0000 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.365 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:total 16384 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 . 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:02 000000010000000000000001 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 archive_status 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 .. 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:13.366 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-09T01:02:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-05-09T01:02:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:02:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 9 01:02 .. 2024-05-09T01:02:13.367 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 0000 2024-05-09T01:02:13.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-05-09T01:02:13.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-05-09T01:02:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:dropping old tables... 2024-05-09T01:02:13.552 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-05-09T01:02:13.552 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-05-09T01:02:13.552 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-05-09T01:02:13.552 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-05-09T01:02:13.552 INFO:teuthology.orchestra.run.smithi037.stderr:creating tables... 2024-05-09T01:02:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:generating data (client-side)... 2024-05-09T01:02:13.639 INFO:teuthology.orchestra.run.smithi037.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.79 s) 2024-05-09T01:02:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.24 s, remaining 3.54 s) 2024-05-09T01:02:13.912 INFO:teuthology.orchestra.run.smithi037.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.33 s, remaining 3.20 s) 2024-05-09T01:02:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.48 s, remaining 3.35 s) 2024-05-09T01:02:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.66 s, remaining 3.57 s) 2024-05-09T01:02:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:14 smithi136 ceph-mon[34110]: pgmap v398: 97 pgs: 97 active+clean; 16 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-05-09T01:02:14.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:14 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.82 s, remaining 3.56 s) 2024-05-09T01:02:14.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:14 smithi037 ceph-mon[30122]: pgmap v398: 97 pgs: 97 active+clean; 16 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-05-09T01:02:14.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:14 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:14.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:14 smithi151 ceph-mon[34780]: pgmap v398: 97 pgs: 97 active+clean; 16 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 1.3 MiB/s wr, 44 op/s 2024-05-09T01:02:14.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:14 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.90 s, remaining 3.23 s) 2024-05-09T01:02:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.09 s, remaining 3.28 s) 2024-05-09T01:02:14.834 INFO:teuthology.orchestra.run.smithi037.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.25 s, remaining 3.20 s) 2024-05-09T01:02:14.909 INFO:teuthology.orchestra.run.smithi037.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.33 s, remaining 2.92 s) 2024-05-09T01:02:15.074 INFO:teuthology.orchestra.run.smithi037.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.49 s, remaining 2.85 s) 2024-05-09T01:02:15.163 INFO:teuthology.orchestra.run.smithi037.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.58 s, remaining 2.64 s) 2024-05-09T01:02:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.73 s, remaining 2.53 s) 2024-05-09T01:02:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.96 s, remaining 2.52 s) 2024-05-09T01:02:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:1500000 of 3200000 tuples (46%) done (elapsed 2.04 s, remaining 2.31 s) 2024-05-09T01:02:15.803 INFO:teuthology.orchestra.run.smithi037.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.22 s, remaining 2.22 s) 2024-05-09T01:02:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.28 s, remaining 2.01 s) 2024-05-09T01:02:16.037 INFO:teuthology.orchestra.run.smithi037.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.46 s, remaining 1.91 s) 2024-05-09T01:02:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.62 s, remaining 1.79 s) 2024-05-09T01:02:16.299 INFO:teuthology.orchestra.run.smithi037.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.72 s, remaining 1.63 s) 2024-05-09T01:02:16.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:16 smithi136 ceph-mon[34110]: pgmap v399: 97 pgs: 97 active+clean; 58 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 7.4 MiB/s wr, 65 op/s 2024-05-09T01:02:16.449 INFO:teuthology.orchestra.run.smithi037.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.87 s, remaining 1.50 s) 2024-05-09T01:02:16.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:16 smithi037 ceph-mon[30122]: pgmap v399: 97 pgs: 97 active+clean; 58 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 7.4 MiB/s wr, 65 op/s 2024-05-09T01:02:16.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:16 smithi151 ceph-mon[34780]: pgmap v399: 97 pgs: 97 active+clean; 58 MiB data, 521 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 7.4 MiB/s wr, 65 op/s 2024-05-09T01:02:16.618 INFO:teuthology.orchestra.run.smithi037.stderr:2200000 of 3200000 tuples (68%) done (elapsed 3.04 s, remaining 1.38 s) 2024-05-09T01:02:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2300000 of 3200000 tuples (71%) done (elapsed 3.14 s, remaining 1.23 s) 2024-05-09T01:02:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.27 s, remaining 1.09 s) 2024-05-09T01:02:17.030 INFO:teuthology.orchestra.run.smithi037.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.45 s, remaining 0.97 s) 2024-05-09T01:02:17.137 INFO:teuthology.orchestra.run.smithi037.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.56 s, remaining 0.82 s) 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 -- 172.21.15.37:0/4010815528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 msgr2=0x7fcd2c1094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 --2- 172.21.15.37:0/4010815528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 0x7fcd2c1094c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009900 tx=0x7fcd1c02a410 comp rx=0 tx=0).stop 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 -- 172.21.15.37:0/4010815528 shutdown_connections 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 --2- 172.21.15.37:0/4010815528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c109a00 0x7fcd2c10be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 --2- 172.21.15.37:0/4010815528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 0x7fcd2c1094c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 --2- 172.21.15.37:0/4010815528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c104740 0x7fcd2c106b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 -- 172.21.15.37:0/4010815528 >> 172.21.15.37:0/4010815528 conn(0x7fcd2c0fdd40 msgr2=0x7fcd2c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 -- 172.21.15.37:0/4010815528 shutdown_connections 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.191+0000 7fcd3342b640 1 -- 172.21.15.37:0/4010815528 wait complete. 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 Processor -- start 2024-05-09T01:02:17.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 -- start start 2024-05-09T01:02:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c104740 0x7fcd2c19a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 0x7fcd2c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c109a00 0x7fcd2c1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c10f760 con 0x7fcd2c1070a0 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c10f5e0 con 0x7fcd2c104740 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd3342b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c10f8e0 con 0x7fcd2c109a00 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd311c7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c104740 0x7fcd2c19a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd311c7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c104740 0x7fcd2c19a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40074/0 (socket says 172.21.15.37:40074) 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd309c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 0x7fcd2c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd311c7640 1 -- 172.21.15.37:0/2169055252 learned_addr learned my addr 172.21.15.37:0/2169055252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c109a00 0x7fcd2c1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd311c7640 1 -- 172.21.15.37:0/2169055252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c109a00 msgr2=0x7fcd2c1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd311c7640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c109a00 0x7fcd2c1a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.192+0000 7fcd311c7640 1 -- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 msgr2=0x7fcd2c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd311c7640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 0x7fcd2c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd311c7640 1 -- 172.21.15.37:0/2169055252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c1a1ed0 con 0x7fcd2c104740 2024-05-09T01:02:17.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd309c6640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 0x7fcd2c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:02:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd311c7640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c104740 0x7fcd2c19a390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005fd0 tx=0x7fcd2800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd227fc640 1 -- 172.21.15.37:0/2169055252 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd28017070 con 0x7fcd2c104740 2024-05-09T01:02:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2c1a21c0 con 0x7fcd2c104740 2024-05-09T01:02:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd227fc640 1 -- 172.21.15.37:0/2169055252 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd28009c30 con 0x7fcd2c104740 2024-05-09T01:02:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd227fc640 1 -- 172.21.15.37:0/2169055252 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd28003d30 con 0x7fcd2c104740 2024-05-09T01:02:17.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.193+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2c1a2760 con 0x7fcd2c104740 2024-05-09T01:02:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd227fc640 1 -- 172.21.15.37:0/2169055252 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcd28003ed0 con 0x7fcd2c104740 2024-05-09T01:02:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 Processor -- start 2024-05-09T01:02:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 -- start start 2024-05-09T01:02:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5d61b0 0x56145b97e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b97ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 0x56145b985d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56145b8de7c0 con 0x56145b5ad2f0 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56145b87a0e0 con 0x56145b5d61b0 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56145b8da780 con 0x56145b5b54d0 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd319c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5d61b0 0x56145b97e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd309c6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 0x56145b985d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd319c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5d61b0 0x56145b97e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40076/0 (socket says 172.21.15.37:40076) 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd319c8640 1 -- 172.21.15.37:0/2366020166 learned_addr learned my addr 172.21.15.37:0/2366020166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.197+0000 7fcd311c7640 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b97ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd319c8640 1 -- 172.21.15.37:0/2366020166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 msgr2=0x56145b985d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 0x56145b985d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd319c8640 1 -- 172.21.15.37:0/2366020166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 msgr2=0x56145b97ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b97ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd227fc640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcd180b27e0 0x7fcd180b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd319c8640 1 -- 172.21.15.37:0/2366020166 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56145b8a37c0 con 0x56145b5d61b0 2024-05-09T01:02:17.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd311c7640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcd180b27e0 0x7fcd180b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5d61b0 0x56145b97e910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009f30 tx=0x7fcd240118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ec13950c4306c35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd227fc640 1 -- 172.21.15.37:0/2169055252 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcd280e1dd0 con 0x7fcd2c104740 2024-05-09T01:02:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd177fe640 1 -- 172.21.15.37:0/2366020166 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24004d20 con 0x56145b5d61b0 2024-05-09T01:02:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd177fe640 1 -- 172.21.15.37:0/2366020166 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd24004050 con 0x56145b5d61b0 2024-05-09T01:02:17.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.198+0000 7fcd177fe640 1 -- 172.21.15.37:0/2366020166 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24005280 con 0x56145b5d61b0 2024-05-09T01:02:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2366020166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5d61b0 msgr2=0x56145b97e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5d61b0 0x56145b97e910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009f30 tx=0x7fcd240118d0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd311c7640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcd180b27e0 0x7fcd180b4cf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009610 tx=0x7fcd28091040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2366020166 shutdown_connections 2024-05-09T01:02:17.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 0x56145b985d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b97ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2366020166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5d61b0 0x56145b97e910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2366020166 >> 172.21.15.37:0/2366020166 conn(0x56145b5ca300 msgr2=0x56145b975e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2366020166 shutdown_connections 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.199+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2366020166 wait complete. 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 -- start start 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 Processor -- start 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 0x56145b988670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5b54d0 0x56145b988bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5d61b0 0x56145b98fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56145b9867e0 con 0x56145b5b54d0 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56145b8659c0 con 0x56145b5ad2f0 2024-05-09T01:02:17.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56145b986960 con 0x56145b5d61b0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.200+0000 7fcd3a3be740 10 client.0 _ll_register_callbacks cb 0x56145b892020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5b54d0 0x56145b988bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5b54d0 0x56145b988bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48438/0 (socket says 172.21.15.37:48438) 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 -- 172.21.15.37:0/2827686363 learned_addr learned my addr 172.21.15.37:0/2827686363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 0x56145b988670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5d61b0 0x56145b98fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 -- 172.21.15.37:0/2827686363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5d61b0 msgr2=0x56145b98fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5d61b0 0x56145b98fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 -- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 msgr2=0x56145b988670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 0x56145b988670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 -- 172.21.15.37:0/2827686363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56145b88c1f0 con 0x56145b5b54d0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5d61b0 0x56145b98fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd309c6640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5b54d0 0x56145b988bb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c031440 tx=0x7fcd1c031910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8f2ff81af37c1d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:02:17.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd14ff9640 1 -- 172.21.15.37:0/2827686363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c035040 con 0x56145b5b54d0 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd14ff9640 1 -- 172.21.15.37:0/2827686363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcd1c0035f0 con 0x56145b5b54d0 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.201+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd24004050 con 0x56145b5b54d0 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd14ff9640 1 -- 172.21.15.37:0/2827686363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcd1c0037f0 con 0x56145b5b54d0 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 10 client.15261 fetch_fsmap learned FSMap version 30 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56145b641790 con 0x56145b5b54d0 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd14ff9640 1 -- 172.21.15.37:0/2827686363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd24004050 con 0x56145b5b54d0 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd14ff9640 1 -- 172.21.15.37:0/2827686363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fcd1c044070 con 0x56145b5b54d0 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 10 client.15261 fetch_fsmap finished waiting for FSMap version 30 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 10 client.15261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 20 client.15261 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b594d80 0x56145b995fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 4 client.15261 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56145b8ec3d0 con 0x56145b594d80 2024-05-09T01:02:17.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.202+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b594d80 0x56145b995fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.203+0000 7fcd14ff9640 10 client.15261 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.203+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b594d80 0x56145b995fd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc098003375a6c5 server_cookie=eed683094f13845f in_seq=0 out_seq=0 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd14ff9640 1 -- 172.21.15.37:0/2827686363 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56145b8ec3d0 con 0x56145b594d80 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd14ff9640 10 client.15261 handle_command_reply: tid=0 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 client.15261 shutdown 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5b54d0 msgr2=0x56145b988bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5b54d0 0x56145b988bb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c031440 tx=0x7fcd1c031910 comp rx=0 tx=0).stop 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 shutdown_connections 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b594d80 0x56145b995fd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5d61b0 0x56145b98fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5b54d0 0x56145b988bb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2827686363 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 0x56145b988670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd14ff9640 0 client.15261 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:17.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 >> 172.21.15.37:0/2827686363 conn(0x56145b5ca300 msgr2=0x56145b978da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 shutdown_connections 2024-05-09T01:02:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2827686363 wait complete. 2024-05-09T01:02:17.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.204+0000 7fcd3a3be740 20 client.15261 trim_cache size 0 max 16384 2024-05-09T01:02:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.225+0000 7fcd3a3be740 1 Processor -- start 2024-05-09T01:02:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd3a3be740 1 -- start start 2024-05-09T01:02:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b594d80 0x56145b99a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b99ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5b54d0 0x56145b99b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1a90c0 con 0x56145b5ad2f0 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1aac30 con 0x56145b5b54d0 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1a9790 con 0x56145b594d80 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd309c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b99ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd309c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b99ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48440/0 (socket says 172.21.15.37:48440) 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd309c6640 1 -- 172.21.15.37:0/2296643879 learned_addr learned my addr 172.21.15.37:0/2296643879 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b594d80 0x56145b99a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.226+0000 7fcd319c8640 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5b54d0 0x56145b99b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd309c6640 1 -- 172.21.15.37:0/2296643879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b594d80 msgr2=0x56145b99a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd309c6640 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b594d80 0x56145b99a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd309c6640 1 -- 172.21.15.37:0/2296643879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5b54d0 msgr2=0x56145b99b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd309c6640 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5b54d0 0x56145b99b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd309c6640 1 -- 172.21.15.37:0/2296643879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56145b6b85f0 con 0x56145b5ad2f0 2024-05-09T01:02:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd309c6640 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b99ad00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c005dd0 tx=0x7fcd1c0314c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99679aa4dc178b98 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd16ffd640 1 -- 172.21.15.37:0/2296643879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c055030 con 0x56145b5ad2f0 2024-05-09T01:02:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd16ffd640 1 -- 172.21.15.37:0/2296643879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd1c004310 con 0x56145b5ad2f0 2024-05-09T01:02:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.227+0000 7fcd16ffd640 1 -- 172.21.15.37:0/2296643879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c035040 con 0x56145b5ad2f0 2024-05-09T01:02:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2296643879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 msgr2=0x56145b99ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b99ad00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c005dd0 tx=0x7fcd1c0314c0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2296643879 shutdown_connections 2024-05-09T01:02:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5b54d0 0x56145b99b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b5ad2f0 0x56145b99ad00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/2296643879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b594d80 0x56145b99a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2296643879 >> 172.21.15.37:0/2296643879 conn(0x56145b5ca300 msgr2=0x56145b982af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2296643879 shutdown_connections 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 -- 172.21.15.37:0/2296643879 wait complete. 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 -- start start 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.229+0000 7fcd3a3be740 1 Processor -- start 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b594d80 0x56145b98c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 0x56145b98cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd3a3be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 0x56145b98d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1aa530 con 0x56145b594d80 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1a9e60 con 0x56145b5ad2f0 2024-05-09T01:02:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd3a3be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c1a70a0 con 0x56145b5b54d0 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd3a3be740 10 client.0 _ll_register_callbacks cb 0x7fcd1c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b594d80 0x56145b98c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b594d80 0x56145b98c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48454/0 (socket says 172.21.15.37:48454) 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 -- 172.21.15.37:0/3919084812 learned_addr learned my addr 172.21.15.37:0/3919084812 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 -- 172.21.15.37:0/3919084812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 msgr2=0x56145b98d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 0x56145b98d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 -- 172.21.15.37:0/3919084812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 msgr2=0x56145b98cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 0x56145b98cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.230+0000 7fcd319c8640 1 -- 172.21.15.37:0/3919084812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56145b8a2ed0 con 0x56145b594d80 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd319c8640 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b594d80 0x56145b98c570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009f30 tx=0x7fcd24005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8fc9631fa08e6d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd14ff9640 1 -- 172.21.15.37:0/3919084812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd24009820 con 0x56145b594d80 2024-05-09T01:02:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd14ff9640 1 -- 172.21.15.37:0/3919084812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcd240052d0 con 0x56145b594d80 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd1c004310 con 0x56145b594d80 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd14ff9640 1 -- 172.21.15.37:0/3919084812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcd240054d0 con 0x56145b594d80 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd3a3be740 10 client.15267 fetch_fsmap learned FSMap version 30 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56145b98eff0 con 0x56145b594d80 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd14ff9640 1 -- 172.21.15.37:0/3919084812 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd1c004310 con 0x56145b594d80 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.231+0000 7fcd14ff9640 1 -- 172.21.15.37:0/3919084812 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fcd24028450 con 0x56145b594d80 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.232+0000 7fcd3a3be740 10 client.15267 fetch_fsmap finished waiting for FSMap version 30 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.232+0000 7fcd3a3be740 10 client.15267 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.232+0000 7fcd3a3be740 20 client.15267 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.232+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b5d61b0 0x56145ba00550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.232+0000 7fcd3a3be740 4 client.15267 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.232+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56145b8e6240 con 0x56145b5d61b0 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.232+0000 7fcd309c6640 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b5d61b0 0x56145ba00550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.233+0000 7fcd14ff9640 10 client.15267 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.233+0000 7fcd309c6640 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b5d61b0 0x56145ba00550 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1718a4194918d537 server_cookie=5813c73594a956e8 in_seq=0 out_seq=0 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd14ff9640 1 -- 172.21.15.37:0/3919084812 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56145b8e6240 con 0x56145b5d61b0 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd14ff9640 10 client.15267 handle_command_reply: tid=0 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 client.15267 shutdown 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b594d80 msgr2=0x56145b98c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b594d80 0x56145b98c570 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcd24009f30 tx=0x7fcd24005bd0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 shutdown_connections 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56145b5d61b0 0x56145ba00550 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145b5b54d0 0x56145b98d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56145b5ad2f0 0x56145b98cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 --2- 172.21.15.37:0/3919084812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145b594d80 0x56145b98c570 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 >> 172.21.15.37:0/3919084812 conn(0x56145b5ca300 msgr2=0x56145b978c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd14ff9640 0 client.15267 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 shutdown_connections 2024-05-09T01:02:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 1 -- 172.21.15.37:0/3919084812 wait complete. 2024-05-09T01:02:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.414+0000 7fcd3a3be740 20 client.15267 trim_cache size 0 max 16384 2024-05-09T01:02:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:02:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:02:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:02:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcd180b27e0 msgr2=0x7fcd180b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcd180b27e0 0x7fcd180b4cf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009610 tx=0x7fcd28091040 comp rx=0 tx=0).stop 2024-05-09T01:02:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c104740 msgr2=0x7fcd2c19a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c104740 0x7fcd2c19a390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005fd0 tx=0x7fcd2800dde0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 shutdown_connections 2024-05-09T01:02:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c109a00 0x7fcd2c1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c1070a0 0x7fcd2c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcd180b27e0 0x7fcd180b4cf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 --2- 172.21.15.37:0/2169055252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd2c104740 0x7fcd2c19a390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 >> 172.21.15.37:0/2169055252 conn(0x7fcd2c0fdd40 msgr2=0x7fcd2c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 shutdown_connections 2024-05-09T01:02:17.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:17.415+0000 7fcd3342b640 1 -- 172.21.15.37:0/2169055252 wait complete. 2024-05-09T01:02:17.448 INFO:teuthology.orchestra.run.smithi037.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.87 s, remaining 0.72 s) 2024-05-09T01:02:17.611 INFO:teuthology.orchestra.run.smithi037.stderr:2800000 of 3200000 tuples (87%) done (elapsed 4.03 s, remaining 0.58 s) 2024-05-09T01:02:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2900000 of 3200000 tuples (90%) done (elapsed 4.09 s, remaining 0.42 s) 2024-05-09T01:02:17.847 INFO:teuthology.orchestra.run.smithi037.stderr:3000000 of 3200000 tuples (93%) done (elapsed 4.27 s, remaining 0.28 s) 2024-05-09T01:02:18.008 INFO:teuthology.orchestra.run.smithi037.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.43 s, remaining 0.14 s) 2024-05-09T01:02:18.089 INFO:teuthology.orchestra.run.smithi037.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.51 s, remaining 0.00 s) 2024-05-09T01:02:18.136 INFO:teuthology.orchestra.run.smithi037.stderr:vacuuming... 2024-05-09T01:02:18.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:18 smithi136 ceph-mon[34110]: pgmap v400: 97 pgs: 97 active+clean; 105 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 15 MiB/s wr, 116 op/s 2024-05-09T01:02:18.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:18 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:02:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:18 smithi037 ceph-mon[30122]: pgmap v400: 97 pgs: 97 active+clean; 105 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 15 MiB/s wr, 116 op/s 2024-05-09T01:02:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:18 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:02:18.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:18 smithi151 ceph-mon[34780]: pgmap v400: 97 pgs: 97 active+clean; 105 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 15 MiB/s wr, 116 op/s 2024-05-09T01:02:18.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:18 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:02:18.869 INFO:teuthology.orchestra.run.smithi037.stderr:creating primary keys... 2024-05-09T01:02:19.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:19 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:19.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:19 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:19.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:19 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:done in 6.59 s (drop tables 0.00 s, create tables 0.01 s, client-side generate 4.57 s, vacuum 0.73 s, primary keys 1.28 s). 2024-05-09T01:02:20.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-05-09T01:02:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:starting vacuum...end. 2024-05-09T01:02:20.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:20 smithi136 ceph-mon[34110]: pgmap v401: 97 pgs: 97 active+clean; 220 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 33 MiB/s wr, 156 op/s 2024-05-09T01:02:20.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:20 smithi037 ceph-mon[30122]: pgmap v401: 97 pgs: 97 active+clean; 220 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 33 MiB/s wr, 156 op/s 2024-05-09T01:02:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:20 smithi151 ceph-mon[34780]: pgmap v401: 97 pgs: 97 active+clean; 220 MiB data, 927 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 33 MiB/s wr, 156 op/s 2024-05-09T01:02:22.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:22 smithi136 ceph-mon[34110]: pgmap v402: 97 pgs: 97 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 52 MiB/s wr, 253 op/s 2024-05-09T01:02:22.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:22 smithi037 ceph-mon[30122]: pgmap v402: 97 pgs: 97 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 52 MiB/s wr, 253 op/s 2024-05-09T01:02:22.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:22 smithi151 ceph-mon[34780]: pgmap v402: 97 pgs: 97 active+clean; 345 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 52 MiB/s wr, 253 op/s 2024-05-09T01:02:23.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:23 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:23.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:23 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:23.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:23 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:02:24.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:24 smithi136 ceph-mon[34110]: pgmap v403: 97 pgs: 97 active+clean; 449 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 68 MiB/s wr, 364 op/s 2024-05-09T01:02:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:24 smithi037 ceph-mon[30122]: pgmap v403: 97 pgs: 97 active+clean; 449 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 68 MiB/s wr, 364 op/s 2024-05-09T01:02:24.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:24 smithi151 ceph-mon[34780]: pgmap v403: 97 pgs: 97 active+clean; 449 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 68 MiB/s wr, 364 op/s 2024-05-09T01:02:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 5.0 s, 5646.7 tps, lat 17.378 ms stddev 18.145 2024-05-09T01:02:26.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:26 smithi136 ceph-mon[34110]: pgmap v404: 97 pgs: 97 active+clean; 639 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 76 MiB/s wr, 445 op/s 2024-05-09T01:02:26.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:26 smithi037 ceph-mon[30122]: pgmap v404: 97 pgs: 97 active+clean; 639 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 76 MiB/s wr, 445 op/s 2024-05-09T01:02:26.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:26 smithi151 ceph-mon[34780]: pgmap v404: 97 pgs: 97 active+clean; 639 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 76 MiB/s wr, 445 op/s 2024-05-09T01:02:28.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:28 smithi136 ceph-mon[34110]: pgmap v405: 97 pgs: 97 active+clean; 813 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 71 MiB/s wr, 533 op/s 2024-05-09T01:02:28.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:28 smithi037 ceph-mon[30122]: pgmap v405: 97 pgs: 97 active+clean; 813 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 71 MiB/s wr, 533 op/s 2024-05-09T01:02:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:28 smithi151 ceph-mon[34780]: pgmap v405: 97 pgs: 97 active+clean; 813 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 71 MiB/s wr, 533 op/s 2024-05-09T01:02:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 10.0 s, 5437.4 tps, lat 18.412 ms stddev 20.224 2024-05-09T01:02:30.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:30 smithi136 ceph-mon[34110]: pgmap v406: 97 pgs: 97 active+clean; 907 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 67 MiB/s wr, 607 op/s 2024-05-09T01:02:30.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:30 smithi037 ceph-mon[30122]: pgmap v406: 97 pgs: 97 active+clean; 907 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 67 MiB/s wr, 607 op/s 2024-05-09T01:02:30.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:30 smithi151 ceph-mon[34780]: pgmap v406: 97 pgs: 97 active+clean; 907 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 67 MiB/s wr, 607 op/s 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.585+0000 7f7e625ba640 1 -- 172.21.15.37:0/3936497247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 msgr2=0x7f7e5c104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.585+0000 7f7e625ba640 1 --2- 172.21.15.37:0/3936497247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c104950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009be0 tx=0x7f7e5402a6c0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.586+0000 7f7e625ba640 1 -- 172.21.15.37:0/3936497247 shutdown_connections 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.586+0000 7f7e625ba640 1 --2- 172.21.15.37:0/3936497247 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e5c1077f0 0x7f7e5c107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.586+0000 7f7e625ba640 1 --2- 172.21.15.37:0/3936497247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e5c104e90 0x7f7e5c1072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.586+0000 7f7e625ba640 1 --2- 172.21.15.37:0/3936497247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c104950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.586+0000 7f7e625ba640 1 -- 172.21.15.37:0/3936497247 >> 172.21.15.37:0/3936497247 conn(0x7f7e5c0fdd40 msgr2=0x7f7e5c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.586+0000 7f7e625ba640 1 -- 172.21.15.37:0/3936497247 shutdown_connections 2024-05-09T01:02:30.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.586+0000 7f7e625ba640 1 -- 172.21.15.37:0/3936497247 wait complete. 2024-05-09T01:02:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.587+0000 7f7e625ba640 1 Processor -- start 2024-05-09T01:02:30.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.587+0000 7f7e625ba640 1 -- start start 2024-05-09T01:02:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e625ba640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c1a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e625ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e5c104e90 0x7f7e5c1a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e625ba640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e5c1077f0 0x7f7e5c1a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e625ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c115dc0 con 0x7f7e5c104e90 2024-05-09T01:02:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e625ba640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c115c40 con 0x7f7e5c1077f0 2024-05-09T01:02:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e625ba640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c115f40 con 0x7f7e5c102530 2024-05-09T01:02:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c1a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c1a09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48328/0 (socket says 172.21.15.37:48328) 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 -- 172.21.15.37:0/799895421 learned_addr learned my addr 172.21.15.37:0/799895421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 -- 172.21.15.37:0/799895421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e5c1077f0 msgr2=0x7f7e5c1a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e5c1077f0 0x7f7e5c1a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 -- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e5c104e90 msgr2=0x7f7e5c1a0f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e5c104e90 0x7f7e5c1a0f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.588+0000 7f7e5bfff640 1 -- 172.21.15.37:0/799895421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c1a8530 con 0x7f7e5c102530 2024-05-09T01:02:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.589+0000 7f7e5bfff640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c1a09f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e54034040 tx=0x7f7e54030c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.589+0000 7f7e597fa640 1 -- 172.21.15.37:0/799895421 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54041020 con 0x7f7e5c102530 2024-05-09T01:02:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.589+0000 7f7e597fa640 1 -- 172.21.15.37:0/799895421 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e54030eb0 con 0x7f7e5c102530 2024-05-09T01:02:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.590+0000 7f7e597fa640 1 -- 172.21.15.37:0/799895421 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54036040 con 0x7f7e5c102530 2024-05-09T01:02:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.590+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5c1a87c0 con 0x7f7e5c102530 2024-05-09T01:02:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.590+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5c1a8c60 con 0x7f7e5c102530 2024-05-09T01:02:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.594+0000 7f7e6946a740 1 Processor -- start 2024-05-09T01:02:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.594+0000 7f7e6946a740 1 -- start start 2024-05-09T01:02:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8a7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4da2f0 0x557b3a8a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e6946a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b3a80b7c0 con 0x557b3a4da2f0 2024-05-09T01:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e6946a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557b3a7a70e0 con 0x557b3a5031b0 2024-05-09T01:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e6946a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b3a807780 con 0x557b3a4e24d0 2024-05-09T01:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e5b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e5b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48332/0 (socket says 172.21.15.37:48332) 2024-05-09T01:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e5b7fe640 1 -- 172.21.15.37:0/868487908 learned_addr learned my addr 172.21.15.37:0/868487908 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.595+0000 7f7e60b57640 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e5b7fe640 1 -- 172.21.15.37:0/868487908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 msgr2=0x557b3a8a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8a7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e5b7fe640 1 -- 172.21.15.37:0/868487908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4da2f0 msgr2=0x557b3a8a7a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4da2f0 0x557b3a8a7a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e5b7fe640 1 -- 172.21.15.37:0/868487908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3a7d07c0 con 0x557b3a4e24d0 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8ae980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009b70 tx=0x7f7e50009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db011fe0e1c8a4d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e427fc640 1 -- 172.21.15.37:0/868487908 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5000ec90 con 0x557b3a4e24d0 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e427fc640 1 -- 172.21.15.37:0/868487908 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e5000ee30 con 0x557b3a4e24d0 2024-05-09T01:02:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.596+0000 7f7e427fc640 1 -- 172.21.15.37:0/868487908 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e50010430 con 0x557b3a4e24d0 2024-05-09T01:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.598+0000 7f7e6946a740 1 -- 172.21.15.37:0/868487908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 msgr2=0x557b3a8ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.598+0000 7f7e6946a740 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8ae980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009b70 tx=0x7f7e50009f70 comp rx=0 tx=0).stop 2024-05-09T01:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.598+0000 7f7e6946a740 1 -- 172.21.15.37:0/868487908 shutdown_connections 2024-05-09T01:02:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.598+0000 7f7e6946a740 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8ae980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.598+0000 7f7e6946a740 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4da2f0 0x557b3a8a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.598+0000 7f7e6946a740 1 --2- 172.21.15.37:0/868487908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.598+0000 7f7e6946a740 1 -- 172.21.15.37:0/868487908 >> 172.21.15.37:0/868487908 conn(0x557b3a4f7300 msgr2=0x557b3a8a2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.600+0000 7f7e597fa640 1 -- 172.21.15.37:0/799895421 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7e54044020 con 0x7f7e5c102530 2024-05-09T01:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.601+0000 7f7e6946a740 1 -- 172.21.15.37:0/868487908 shutdown_connections 2024-05-09T01:02:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.602+0000 7f7e597fa640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e440b2900 0x7f7e440b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.602+0000 7f7e597fa640 1 -- 172.21.15.37:0/799895421 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7e54102ec0 con 0x7f7e5c102530 2024-05-09T01:02:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.602+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e440b2900 0x7f7e440b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.602+0000 7f7e6946a740 1 -- 172.21.15.37:0/868487908 wait complete. 2024-05-09T01:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.603+0000 7f7e6946a740 1 -- start start 2024-05-09T01:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.603+0000 7f7e6946a740 1 Processor -- start 2024-05-09T01:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4e24d0 0x557b3a8b1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8b8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e6946a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b3a8af3d0 con 0x557b3a5031b0 2024-05-09T01:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e6946a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557b3a7929c0 con 0x557b3a4e24d0 2024-05-09T01:02:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e6946a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b3a8af550 con 0x557b3a4c1d80 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e6946a740 10 client.0 _ll_register_callbacks cb 0x557b3a7bf020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e60b57640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e60b57640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48334/0 (socket says 172.21.15.37:48334) 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e60b57640 1 -- 172.21.15.37:0/28343453 learned_addr learned my addr 172.21.15.37:0/28343453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.604+0000 7f7e60b57640 1 -- 172.21.15.37:0/28343453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4e24d0 msgr2=0x557b3a8b1450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e60b57640 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4e24d0 0x557b3a8b1450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e60b57640 1 -- 172.21.15.37:0/28343453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 msgr2=0x557b3a8b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e60b57640 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e60b57640 1 -- 172.21.15.37:0/28343453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3a7b91f0 con 0x557b3a4c1d80 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e440b2900 0x7f7e440b4e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009b40 tx=0x7f7e50009780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e60b57640 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8b8880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0116f0 tx=0x7f7e4c011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a56077982b1a1e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/28343453 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c004260 con 0x557b3a4c1d80 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e5000ee30 con 0x557b3a4c1d80 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/28343453 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7e4c004400 con 0x557b3a4c1d80 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/28343453 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7e4c00f8a0 con 0x557b3a4c1d80 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e6946a740 10 client.25012 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.605+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557b3a56e790 con 0x557b3a4c1d80 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/28343453 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e5000ee30 con 0x557b3a4c1d80 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/28343453 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f7e4c018070 con 0x557b3a4c1d80 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e6946a740 10 client.25012 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e6946a740 10 client.25012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e6946a740 20 client.25012 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e6946a740 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a4971c0 0x557b3a8cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e6946a740 4 client.25012 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:30.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.606+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b3a8193d0 con 0x557b3a4971c0 2024-05-09T01:02:30.610 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.607+0000 7f7e5bfff640 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a4971c0 0x557b3a8cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.608+0000 7f7e5bfff640 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a4971c0 0x557b3a8cff40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bd5fad62b36b41f server_cookie=edd6e0a5351524cb in_seq=0 out_seq=0 2024-05-09T01:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.608+0000 7f7e3b7fe640 10 client.25012 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.609+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/28343453 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557b3a8193d0 con 0x557b3a4971c0 2024-05-09T01:02:30.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.609+0000 7f7e3b7fe640 10 client.25012 handle_command_reply: tid=0 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.609+0000 7f7e6946a740 1 client.25012 shutdown 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.609+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 msgr2=0x557b3a8b8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.609+0000 7f7e6946a740 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8b8880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0116f0 tx=0x7f7e4c011bb0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 shutdown_connections 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a4971c0 0x557b3a8cff40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8b8880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 --2- 172.21.15.37:0/28343453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4e24d0 0x557b3a8b1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 >> 172.21.15.37:0/28343453 conn(0x557b3a4f7300 msgr2=0x557b3a8a2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e3b7fe640 0 client.25012 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 shutdown_connections 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 1 -- 172.21.15.37:0/28343453 wait complete. 2024-05-09T01:02:30.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.610+0000 7f7e6946a740 20 client.25012 trim_cache size 0 max 16384 2024-05-09T01:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.638+0000 7f7e6946a740 1 Processor -- start 2024-05-09T01:02:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.638+0000 7f7e6946a740 1 -- start start 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4e24d0 0x557b3a8affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e6946a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c06c860 con 0x557b3a4e24d0 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e6946a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c06e490 con 0x557b3a5031b0 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e6946a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c06cf30 con 0x557b3a4c1d80 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e5b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4e24d0 0x557b3a8affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e5b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4e24d0 0x557b3a8affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33074/0 (socket says 172.21.15.37:33074) 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e5b7fe640 1 -- 172.21.15.37:0/768176961 learned_addr learned my addr 172.21.15.37:0/768176961 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.639+0000 7f7e60b57640 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e60b57640 1 -- 172.21.15.37:0/768176961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 msgr2=0x557b3a8afa70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e60b57640 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8afa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e60b57640 1 -- 172.21.15.37:0/768176961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4e24d0 msgr2=0x557b3a8affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e60b57640 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4e24d0 0x557b3a8affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e60b57640 1 -- 172.21.15.37:0/768176961 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3a5e55f0 con 0x557b3a5031b0 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4e24d0 0x557b3a8affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e60b57640 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8b04f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0047c0 tx=0x7f7e4c004b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb31aa0f26881d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e41ffb640 1 -- 172.21.15.37:0/768176961 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c004260 con 0x557b3a5031b0 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e41ffb640 1 -- 172.21.15.37:0/768176961 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4c004400 con 0x557b3a5031b0 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.640+0000 7f7e41ffb640 1 -- 172.21.15.37:0/768176961 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c005540 con 0x557b3a5031b0 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.641+0000 7f7e6946a740 1 -- 172.21.15.37:0/768176961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 msgr2=0x557b3a8b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.641+0000 7f7e6946a740 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8b04f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0047c0 tx=0x7f7e4c004b30 comp rx=0 tx=0).stop 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.641+0000 7f7e6946a740 1 -- 172.21.15.37:0/768176961 shutdown_connections 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.641+0000 7f7e6946a740 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a5031b0 0x557b3a8b04f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.641+0000 7f7e6946a740 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a4e24d0 0x557b3a8affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.641+0000 7f7e6946a740 1 --2- 172.21.15.37:0/768176961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4c1d80 0x557b3a8afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.641+0000 7f7e6946a740 1 -- 172.21.15.37:0/768176961 >> 172.21.15.37:0/768176961 conn(0x557b3a4f7300 msgr2=0x557b3a8ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.642+0000 7f7e6946a740 1 -- 172.21.15.37:0/768176961 shutdown_connections 2024-05-09T01:02:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.642+0000 7f7e6946a740 1 -- 172.21.15.37:0/768176961 wait complete. 2024-05-09T01:02:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.642+0000 7f7e6946a740 1 -- start start 2024-05-09T01:02:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.642+0000 7f7e6946a740 1 Processor -- start 2024-05-09T01:02:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4c1d80 0x557b3a8b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e6946a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e6946a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c06dd00 con 0x557b3a5031b0 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e6946a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c06d630 con 0x557b3a4c1d80 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e6946a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c10f080 con 0x557b3a4e24d0 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e6946a740 10 client.0 _ll_register_callbacks cb 0x7f7e4c009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e60b57640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e5b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e60b57640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33080/0 (socket says 172.21.15.37:33080) 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.643+0000 7f7e60b57640 1 -- 172.21.15.37:0/3633133177 learned_addr learned my addr 172.21.15.37:0/3633133177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e60b57640 1 -- 172.21.15.37:0/3633133177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 msgr2=0x557b3a8b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e60b57640 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e60b57640 1 -- 172.21.15.37:0/3633133177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4c1d80 msgr2=0x557b3a8b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:30.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e60b57640 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4c1d80 0x557b3a8b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e60b57640 1 -- 172.21.15.37:0/3633133177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3a7cfed0 con 0x557b3a5031b0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e60b57640 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b6790 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c011bf0 tx=0x7f7e4c009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a2e2fa233de2fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.644+0000 7f7e5b7fe640 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.645+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/3633133177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c0052c0 con 0x557b3a5031b0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.645+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/3633133177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7e4c005460 con 0x557b3a5031b0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.645+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e4c004400 con 0x557b3a5031b0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.645+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/3633133177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7e4c00fa40 con 0x557b3a5031b0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.646+0000 7f7e6946a740 10 client.15279 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.646+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x557b3a8b7e10 con 0x557b3a5031b0 2024-05-09T01:02:30.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.646+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/3633133177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e4c004400 con 0x557b3a5031b0 2024-05-09T01:02:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.647+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/3633133177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f7e4c018070 con 0x557b3a5031b0 2024-05-09T01:02:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.647+0000 7f7e6946a740 10 client.15279 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.647+0000 7f7e6946a740 10 client.15279 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.647+0000 7f7e6946a740 20 client.15279 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.647+0000 7f7e6946a740 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a8bf080 0x557b3a8c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:30.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.647+0000 7f7e6946a740 4 client.15279 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:02:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.647+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b3a813240 con 0x557b3a8bf080 2024-05-09T01:02:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.648+0000 7f7e5bfff640 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a8bf080 0x557b3a8c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.649+0000 7f7e5bfff640 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a8bf080 0x557b3a8c14a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdba7779430c856d server_cookie=f7aef1619e1a7ae1 in_seq=0 out_seq=0 2024-05-09T01:02:30.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.649+0000 7f7e3b7fe640 10 client.15279 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:30.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.668+0000 7f7e3b7fe640 1 -- 172.21.15.37:0/3633133177 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557b3a813240 con 0x557b3a8bf080 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.668+0000 7f7e3b7fe640 10 client.15279 handle_command_reply: tid=0 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.668+0000 7f7e6946a740 1 client.15279 shutdown 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 msgr2=0x557b3a8b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b6790 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c011bf0 tx=0x7f7e4c009490 comp rx=0 tx=0).stop 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 shutdown_connections 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557b3a8bf080 0x557b3a8c14a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b3a5031b0 0x557b3a8b6790 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b3a4e24d0 0x557b3a8b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 --2- 172.21.15.37:0/3633133177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557b3a4c1d80 0x557b3a8b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 >> 172.21.15.37:0/3633133177 conn(0x557b3a4f7300 msgr2=0x557b3a8a5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:30.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e3b7fe640 0 client.15279 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 shutdown_connections 2024-05-09T01:02:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.669+0000 7f7e6946a740 1 -- 172.21.15.37:0/3633133177 wait complete. 2024-05-09T01:02:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.670+0000 7f7e6946a740 20 client.15279 trim_cache size 0 max 16384 2024-05-09T01:02:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:02:30.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:02:30.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:02:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.672+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e440b2900 msgr2=0x7f7e440b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.672+0000 7f7e625ba640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e440b2900 0x7f7e440b4e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009b40 tx=0x7f7e50009780 comp rx=0 tx=0).stop 2024-05-09T01:02:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.672+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 msgr2=0x7f7e5c1a09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:30.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.672+0000 7f7e625ba640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c1a09f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e54034040 tx=0x7f7e54030c80 comp rx=0 tx=0).stop 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 shutdown_connections 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e440b2900 0x7f7e440b4e10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e5c1077f0 0x7f7e5c1a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e5c104e90 0x7f7e5c1a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 --2- 172.21.15.37:0/799895421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e5c102530 0x7f7e5c1a09f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 >> 172.21.15.37:0/799895421 conn(0x7f7e5c0fdd40 msgr2=0x7f7e5c103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 shutdown_connections 2024-05-09T01:02:30.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:30.673+0000 7f7e625ba640 1 -- 172.21.15.37:0/799895421 wait complete. 2024-05-09T01:02:32.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:32 smithi037 ceph-mon[30122]: pgmap v407: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 51 MiB/s wr, 729 op/s 2024-05-09T01:02:32.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:32 smithi151 ceph-mon[34780]: pgmap v407: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 51 MiB/s wr, 729 op/s 2024-05-09T01:02:32.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:32 smithi136 ceph-mon[34110]: pgmap v407: 97 pgs: 97 active+clean; 923 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 51 MiB/s wr, 729 op/s 2024-05-09T01:02:34.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:34 smithi037 ceph-mon[30122]: pgmap v408: 97 pgs: 97 active+clean; 944 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 34 MiB/s wr, 857 op/s 2024-05-09T01:02:34.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:34 smithi151 ceph-mon[34780]: pgmap v408: 97 pgs: 97 active+clean; 944 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 34 MiB/s wr, 857 op/s 2024-05-09T01:02:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:34 smithi136 ceph-mon[34110]: pgmap v408: 97 pgs: 97 active+clean; 944 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 34 MiB/s wr, 857 op/s 2024-05-09T01:02:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 15.0 s, 5754.4 tps, lat 17.356 ms stddev 18.242 2024-05-09T01:02:36.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:36 smithi037 ceph-mon[30122]: pgmap v409: 97 pgs: 97 active+clean; 947 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 18 MiB/s wr, 805 op/s 2024-05-09T01:02:36.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:36 smithi151 ceph-mon[34780]: pgmap v409: 97 pgs: 97 active+clean; 947 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 18 MiB/s wr, 805 op/s 2024-05-09T01:02:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:36 smithi136 ceph-mon[34110]: pgmap v409: 97 pgs: 97 active+clean; 947 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 18 MiB/s wr, 805 op/s 2024-05-09T01:02:38.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:38 smithi037 ceph-mon[30122]: pgmap v410: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 965 op/s 2024-05-09T01:02:38.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:38 smithi151 ceph-mon[34780]: pgmap v410: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 965 op/s 2024-05-09T01:02:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:38 smithi136 ceph-mon[34110]: pgmap v410: 97 pgs: 97 active+clean; 949 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 965 op/s 2024-05-09T01:02:40.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:02:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 20.0 s, 4712.3 tps, lat 21.180 ms stddev 22.143 2024-05-09T01:02:40.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:40 smithi037 ceph-mon[30122]: pgmap v411: 97 pgs: 97 active+clean; 956 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-05-09T01:02:40.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:40 smithi151 ceph-mon[34780]: pgmap v411: 97 pgs: 97 active+clean; 956 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-05-09T01:02:40.591 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:40.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:40 smithi136 ceph-mon[34110]: pgmap v411: 97 pgs: 97 active+clean; 956 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-05-09T01:02:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:42 smithi037 ceph-mon[30122]: pgmap v412: 97 pgs: 97 active+clean; 966 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 MiB/s wr, 955 op/s 2024-05-09T01:02:42.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:42 smithi151 ceph-mon[34780]: pgmap v412: 97 pgs: 97 active+clean; 966 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 MiB/s wr, 955 op/s 2024-05-09T01:02:42.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:42 smithi136 ceph-mon[34110]: pgmap v412: 97 pgs: 97 active+clean; 966 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 MiB/s wr, 955 op/s 2024-05-09T01:02:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.101+0000 7fc16b095700 1 -- 172.21.15.37:0/1836951117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 msgr2=0x7fc1641100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.101+0000 7fc16b095700 1 --2- 172.21.15.37:0/1836951117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 0x7fc1641100a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009920 tx=0x7fc15c009c30 comp rx=0 tx=0).stop 2024-05-09T01:02:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.101+0000 7fc16b095700 1 -- 172.21.15.37:0/1836951117 shutdown_connections 2024-05-09T01:02:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.101+0000 7fc16b095700 1 --2- 172.21.15.37:0/1836951117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 0x7fc1641100a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.101+0000 7fc16b095700 1 --2- 172.21.15.37:0/1836951117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1641034c0 0x7fc1641038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.101+0000 7fc16b095700 1 --2- 172.21.15.37:0/1836951117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc164107df0 0x7fc164108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.101+0000 7fc16b095700 1 -- 172.21.15.37:0/1836951117 >> 172.21.15.37:0/1836951117 conn(0x7fc1640fedc0 msgr2=0x7fc1641011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.102+0000 7fc16b095700 1 -- 172.21.15.37:0/1836951117 shutdown_connections 2024-05-09T01:02:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.102+0000 7fc16b095700 1 -- 172.21.15.37:0/1836951117 wait complete. 2024-05-09T01:02:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.104+0000 7fc16b095700 1 Processor -- start 2024-05-09T01:02:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.104+0000 7fc16b095700 1 -- start start 2024-05-09T01:02:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.104+0000 7fc16b095700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641034c0 0x7fc16419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc16b095700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc164107df0 0x7fc16419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc168e31700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641034c0 0x7fc16419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc168e31700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641034c0 0x7fc16419ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48534/0 (socket says 172.21.15.37:48534) 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc168e31700 1 -- 172.21.15.37:0/608234694 learned_addr learned my addr 172.21.15.37:0/608234694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc15bfff700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc164107df0 0x7fc16419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc16b095700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 0x7fc16419f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641133e0 con 0x7fc164108740 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc164113260 con 0x7fc164107df0 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc169632700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 0x7fc16419f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.105+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc164113560 con 0x7fc1641034c0 2024-05-09T01:02:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.106+0000 7fc168e31700 1 -- 172.21.15.37:0/608234694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc164107df0 msgr2=0x7fc16419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.106+0000 7fc168e31700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc164107df0 0x7fc16419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.106+0000 7fc168e31700 1 -- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 msgr2=0x7fc16419f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.106+0000 7fc168e31700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 0x7fc16419f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.106+0000 7fc168e31700 1 -- 172.21.15.37:0/608234694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16419fcf0 con 0x7fc1641034c0 2024-05-09T01:02:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.106+0000 7fc169632700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 0x7fc16419f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:02:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.107+0000 7fc168e31700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641034c0 0x7fc16419ae20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c0c0 tx=0x7fc15400c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.107+0000 7fc1627fc700 1 -- 172.21.15.37:0/608234694 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1540092e0 con 0x7fc1641034c0 2024-05-09T01:02:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.107+0000 7fc1627fc700 1 -- 172.21.15.37:0/608234694 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1540075c0 con 0x7fc1641034c0 2024-05-09T01:02:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.109+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16419ff80 con 0x7fc1641034c0 2024-05-09T01:02:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.109+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1641a0490 con 0x7fc1641034c0 2024-05-09T01:02:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.109+0000 7fc1627fc700 1 -- 172.21.15.37:0/608234694 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1540146e0 con 0x7fc1641034c0 2024-05-09T01:02:43.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.116+0000 7fc1627fc700 1 -- 172.21.15.37:0/608234694 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc15401b070 con 0x7fc1641034c0 2024-05-09T01:02:43.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.119+0000 7fc1627fc700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1500b2750 0x7fc1500b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.119+0000 7fc1627fc700 1 -- 172.21.15.37:0/608234694 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc1540e1980 con 0x7fc1641034c0 2024-05-09T01:02:43.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.120+0000 7fc15bfff700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1500b2750 0x7fc1500b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.120+0000 7fc179aabb80 1 Processor -- start 2024-05-09T01:02:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.121+0000 7fc179aabb80 1 -- start start 2024-05-09T01:02:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.121+0000 7fc15bfff700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1500b2750 0x7fc1500b4c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc1641022d0 tx=0x7fc14c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.121+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816deb160 0x55d816e844f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e84a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e7e6a0 0x55d816e7ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e84a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e84a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56354/0 (socket says 172.21.15.37:56354) 2024-05-09T01:02:43.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc15bfff700 1 -- 172.21.15.37:0/417954846 learned_addr learned my addr 172.21.15.37:0/417954846 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d816da0ff0 con 0x55d816d014a0 2024-05-09T01:02:43.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d816d3f7f0 con 0x55d816e7e6a0 2024-05-09T01:02:43.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.122+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d816d9cfb0 con 0x55d816deb160 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.123+0000 7fc15bfff700 1 -- 172.21.15.37:0/417954846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816deb160 msgr2=0x55d816e844f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.123+0000 7fc15bfff700 1 --2- 172.21.15.37:0/417954846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816deb160 0x55d816e844f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.123+0000 7fc15bfff700 1 -- 172.21.15.37:0/417954846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e7e6a0 msgr2=0x55d816e7ead0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.123+0000 7fc15bfff700 1 --2- 172.21.15.37:0/417954846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e7e6a0 0x55d816e7ead0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.123+0000 7fc15bfff700 1 -- 172.21.15.37:0/417954846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d816d37370 con 0x55d816d014a0 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.123+0000 7fc15bfff700 1 --2- 172.21.15.37:0/417954846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e84a30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00e9b0 tx=0x7fc14c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac87cdd45d97fb17 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.124+0000 7fc15affd700 1 -- 172.21.15.37:0/417954846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c01b040 con 0x55d816d014a0 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.124+0000 7fc15affd700 1 -- 172.21.15.37:0/417954846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc14c024070 con 0x55d816d014a0 2024-05-09T01:02:43.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.124+0000 7fc15affd700 1 -- 172.21.15.37:0/417954846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c013760 con 0x55d816d014a0 2024-05-09T01:02:43.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.125+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 msgr2=0x55d816e84a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.126+0000 7fc179aabb80 1 --2- 172.21.15.37:0/417954846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e84a30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00e9b0 tx=0x7fc14c011000 comp rx=0 tx=0).stop 2024-05-09T01:02:43.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.127+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 shutdown_connections 2024-05-09T01:02:43.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.127+0000 7fc179aabb80 1 --2- 172.21.15.37:0/417954846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e7e6a0 0x55d816e7ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.127+0000 7fc179aabb80 1 --2- 172.21.15.37:0/417954846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816deb160 0x55d816e844f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.127+0000 7fc179aabb80 1 --2- 172.21.15.37:0/417954846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e84a30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.127+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 >> 172.21.15.37:0/417954846 conn(0x55d816d616a0 msgr2=0x55d816e79400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.127+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 shutdown_connections 2024-05-09T01:02:43.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.128+0000 7fc179aabb80 1 -- 172.21.15.37:0/417954846 wait complete. 2024-05-09T01:02:43.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.128+0000 7fc179aabb80 1 -- start start 2024-05-09T01:02:43.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.129+0000 7fc179aabb80 1 Processor -- start 2024-05-09T01:02:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.130+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e881d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.130+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816deb160 0x55d816e88710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.130+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816e88c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.130+0000 7fc179aabb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d816c1cba0 con 0x55d816d014a0 2024-05-09T01:02:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.130+0000 7fc179aabb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d816d5b150 con 0x55d816deb160 2024-05-09T01:02:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.130+0000 7fc179aabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d816e8b1d0 con 0x55d816e7e6a0 2024-05-09T01:02:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.130+0000 7fc179aabb80 10 client.0 _ll_register_callbacks cb 0x55d816c126c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816deb160 0x55d816e88710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc169632700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816e88c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816deb160 0x55d816e88710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35386/0 (socket says 172.21.15.37:35386) 2024-05-09T01:02:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 -- 172.21.15.37:0/3437936973 learned_addr learned my addr 172.21.15.37:0/3437936973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc168e31700 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 -- 172.21.15.37:0/3437936973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 msgr2=0x55d816e88c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816e88c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 -- 172.21.15.37:0/3437936973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 msgr2=0x55d816e881d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e881d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.131+0000 7fc15bfff700 1 -- 172.21.15.37:0/3437936973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d816c1c490 con 0x55d816deb160 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.132+0000 7fc15bfff700 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816deb160 0x55d816e88710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009810 tx=0x7fc14c015a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c5500b36ff0dcd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.132+0000 7fc143fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.132+0000 7fc143fff700 1 -- 172.21.15.37:0/3437936973 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14c02c030 con 0x55d816deb160 2024-05-09T01:02:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.132+0000 7fc143fff700 1 -- 172.21.15.37:0/3437936973 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc14c004280 con 0x55d816deb160 2024-05-09T01:02:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.132+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc14c024070 con 0x55d816deb160 2024-05-09T01:02:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.133+0000 7fc143fff700 1 -- 172.21.15.37:0/3437936973 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc14c037050 con 0x55d816deb160 2024-05-09T01:02:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.134+0000 7fc179aabb80 10 client.25004 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.134+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d816e9a080 con 0x55d816deb160 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.134+0000 7fc143fff700 1 -- 172.21.15.37:0/3437936973 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc14c024070 con 0x55d816deb160 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.134+0000 7fc143fff700 1 -- 172.21.15.37:0/3437936973 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fc14c01e030 con 0x55d816deb160 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.134+0000 7fc179aabb80 10 client.25004 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.134+0000 7fc179aabb80 10 client.25004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.134+0000 7fc179aabb80 20 client.25004 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.135+0000 7fc179aabb80 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816e9c5a0 0x55d816e9e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.135+0000 7fc179aabb80 4 client.25004 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.135+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d816dae9d0 con 0x55d816e9c5a0 2024-05-09T01:02:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.135+0000 7fc168e31700 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816e9c5a0 0x55d816e9e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.135+0000 7fc143fff700 10 client.25004 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.135+0000 7fc168e31700 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816e9c5a0 0x55d816e9e9c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b218ca302d43a5 server_cookie=e94373ea71d442b1 in_seq=0 out_seq=0 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.136+0000 7fc143fff700 1 -- 172.21.15.37:0/3437936973 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d816dae9d0 con 0x55d816e9c5a0 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.136+0000 7fc143fff700 10 client.25004 handle_command_reply: tid=0 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.136+0000 7fc179aabb80 1 client.25004 shutdown 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816deb160 msgr2=0x55d816e88710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816deb160 0x55d816e88710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009810 tx=0x7fc14c015a00 comp rx=0 tx=0).stop 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 shutdown_connections 2024-05-09T01:02:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816e9c5a0 0x55d816e9e9c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816e88c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e881d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 --2- 172.21.15.37:0/3437936973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816deb160 0x55d816e88710 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc14c009810 tx=0x7fc14c015a00 comp rx=0 tx=0).stop 2024-05-09T01:02:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 >> 172.21.15.37:0/3437936973 conn(0x55d816d616a0 msgr2=0x55d816e791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.137+0000 7fc143fff700 0 client.25004 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.138+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 shutdown_connections 2024-05-09T01:02:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.138+0000 7fc179aabb80 1 -- 172.21.15.37:0/3437936973 wait complete. 2024-05-09T01:02:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.138+0000 7fc179aabb80 20 client.25004 trim_cache size 0 max 16384 2024-05-09T01:02:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.182+0000 7fc179aabb80 1 Processor -- start 2024-05-09T01:02:43.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:02:43.183 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:43 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.184+0000 7fc179aabb80 1 -- start start 2024-05-09T01:02:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816d014a0 0x55d816e828a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816e7e6a0 0x55d816e94430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e99b50 0x55d816e86ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc179aabb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641ac750 con 0x55d816e7e6a0 2024-05-09T01:02:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc168e31700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816d014a0 0x55d816e828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc179aabb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641ae380 con 0x55d816d014a0 2024-05-09T01:02:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc169632700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e99b50 0x55d816e86ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc168e31700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816d014a0 0x55d816e828a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35398/0 (socket says 172.21.15.37:35398) 2024-05-09T01:02:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc168e31700 1 -- 172.21.15.37:0/1794872027 learned_addr learned my addr 172.21.15.37:0/1794872027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.185+0000 7fc179aabb80 1 -- 172.21.15.37:0/1794872027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641ace20 con 0x55d816e99b50 2024-05-09T01:02:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.186+0000 7fc15bfff700 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816e7e6a0 0x55d816e94430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.186+0000 7fc169632700 1 -- 172.21.15.37:0/1794872027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816d014a0 msgr2=0x55d816e828a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.186+0000 7fc169632700 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816d014a0 0x55d816e828a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.186+0000 7fc169632700 1 -- 172.21.15.37:0/1794872027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816e7e6a0 msgr2=0x55d816e94430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.186+0000 7fc169632700 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816e7e6a0 0x55d816e94430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.186+0000 7fc169632700 1 -- 172.21.15.37:0/1794872027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d816e72f60 con 0x55d816e99b50 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.186+0000 7fc15bfff700 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816e7e6a0 0x55d816e94430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.187+0000 7fc169632700 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e99b50 0x55d816e86ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c010 tx=0x7fc15c00bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77756e6b1f746eb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.187+0000 7fc15a7fc700 1 -- 172.21.15.37:0/1794872027 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00b760 con 0x55d816e99b50 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.187+0000 7fc15a7fc700 1 -- 172.21.15.37:0/1794872027 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc15c00f910 con 0x55d816e99b50 2024-05-09T01:02:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.187+0000 7fc15a7fc700 1 -- 172.21.15.37:0/1794872027 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0038e0 con 0x55d816e99b50 2024-05-09T01:02:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.188+0000 7fc179aabb80 1 -- 172.21.15.37:0/1794872027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e99b50 msgr2=0x55d816e86ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.188+0000 7fc179aabb80 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e99b50 0x55d816e86ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c010 tx=0x7fc15c00bf80 comp rx=0 tx=0).stop 2024-05-09T01:02:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.189+0000 7fc179aabb80 1 -- 172.21.15.37:0/1794872027 shutdown_connections 2024-05-09T01:02:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.189+0000 7fc179aabb80 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e99b50 0x55d816e86ac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.189+0000 7fc179aabb80 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816d014a0 0x55d816e828a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.189+0000 7fc179aabb80 1 --2- 172.21.15.37:0/1794872027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816e7e6a0 0x55d816e94430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.189+0000 7fc179aabb80 1 -- 172.21.15.37:0/1794872027 >> 172.21.15.37:0/1794872027 conn(0x55d816d616a0 msgr2=0x55d816e832b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.189+0000 7fc179aabb80 1 -- 172.21.15.37:0/1794872027 shutdown_connections 2024-05-09T01:02:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.189+0000 7fc179aabb80 1 -- 172.21.15.37:0/1794872027 wait complete. 2024-05-09T01:02:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.190+0000 7fc179aabb80 1 -- start start 2024-05-09T01:02:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.190+0000 7fc179aabb80 1 Processor -- start 2024-05-09T01:02:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e99410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816ea15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc179aabb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e99b50 0x55d816ea1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc179aabb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641adbf0 con 0x55d816d014a0 2024-05-09T01:02:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc179aabb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641ad520 con 0x55d816e99b50 2024-05-09T01:02:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc15bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816ea15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc169632700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e99b50 0x55d816ea1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc169632700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e99b50 0x55d816ea1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35414/0 (socket says 172.21.15.37:35414) 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc169632700 1 -- 172.21.15.37:0/4232583172 learned_addr learned my addr 172.21.15.37:0/4232583172 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc16410a550 con 0x55d816e7e6a0 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc179aabb80 10 client.0 _ll_register_callbacks cb 0x55d816c126c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.191+0000 7fc168e31700 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e99410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc169632700 1 -- 172.21.15.37:0/4232583172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 msgr2=0x55d816ea15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc169632700 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816ea15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc169632700 1 -- 172.21.15.37:0/4232583172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 msgr2=0x55d816e99410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc169632700 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e99410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc169632700 1 -- 172.21.15.37:0/4232583172 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d816e97110 con 0x55d816e99b50 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc168e31700 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e99410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:02:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc169632700 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e99b50 0x55d816ea1b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009600 tx=0x7fc15c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e809a60602dcb66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.192+0000 7fc143fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.193+0000 7fc143fff700 1 -- 172.21.15.37:0/4232583172 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c003680 con 0x55d816e99b50 2024-05-09T01:02:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.193+0000 7fc143fff700 1 -- 172.21.15.37:0/4232583172 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc15c003820 con 0x55d816e99b50 2024-05-09T01:02:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.193+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc15c00f910 con 0x55d816e99b50 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.193+0000 7fc143fff700 1 -- 172.21.15.37:0/4232583172 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc15c03a050 con 0x55d816e99b50 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.193+0000 7fc179aabb80 10 client.25010 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.193+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d816f0b480 con 0x55d816e99b50 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.194+0000 7fc143fff700 1 -- 172.21.15.37:0/4232583172 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc15c00f910 con 0x55d816e99b50 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.194+0000 7fc143fff700 1 -- 172.21.15.37:0/4232583172 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fc15c023b10 con 0x55d816e99b50 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.194+0000 7fc179aabb80 10 client.25010 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.194+0000 7fc179aabb80 10 client.25010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.194+0000 7fc179aabb80 20 client.25010 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.194+0000 7fc179aabb80 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816f0bb60 0x55d816f0df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.194+0000 7fc179aabb80 4 client.25010 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.195+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d816da8a70 con 0x55d816f0bb60 2024-05-09T01:02:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.195+0000 7fc168e31700 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816f0bb60 0x55d816f0df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.196+0000 7fc168e31700 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816f0bb60 0x55d816f0df80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e3ed8bf27166f99 server_cookie=dce3d6cc70ca2fae in_seq=0 out_seq=0 2024-05-09T01:02:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.196+0000 7fc143fff700 10 client.25010 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.196+0000 7fc143fff700 1 -- 172.21.15.37:0/4232583172 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d816da8a70 con 0x55d816f0bb60 2024-05-09T01:02:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.196+0000 7fc143fff700 10 client.25010 handle_command_reply: tid=0 2024-05-09T01:02:43.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.196+0000 7fc179aabb80 1 client.25010 shutdown 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.198+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e99b50 msgr2=0x55d816ea1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.198+0000 7fc179aabb80 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e99b50 0x55d816ea1b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009600 tx=0x7fc15c00f690 comp rx=0 tx=0).stop 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.199+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 shutdown_connections 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.199+0000 7fc179aabb80 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d816f0bb60 0x55d816f0df80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.199+0000 7fc179aabb80 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d816e99b50 0x55d816ea1b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.199+0000 7fc143fff700 0 client.25010 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.199+0000 7fc179aabb80 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d816d014a0 0x55d816e99410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.199+0000 7fc179aabb80 1 --2- 172.21.15.37:0/4232583172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d816e7e6a0 0x55d816ea15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.199+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 >> 172.21.15.37:0/4232583172 conn(0x55d816d616a0 msgr2=0x55d816e86ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.200+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 shutdown_connections 2024-05-09T01:02:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.200+0000 7fc179aabb80 1 -- 172.21.15.37:0/4232583172 wait complete. 2024-05-09T01:02:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.200+0000 7fc179aabb80 20 client.25010 trim_cache size 0 max 16384 2024-05-09T01:02:43.201 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:02:43.201 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:02:43.202 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:02:43.202 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:02:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1500b2750 msgr2=0x7fc1500b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1500b2750 0x7fc1500b4c60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc1641022d0 tx=0x7fc14c009190 comp rx=0 tx=0).stop 2024-05-09T01:02:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641034c0 msgr2=0x7fc16419ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641034c0 0x7fc16419ae20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c0c0 tx=0x7fc15400c3d0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 shutdown_connections 2024-05-09T01:02:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1500b2750 0x7fc1500b4c60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc164108740 0x7fc16419f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641034c0 0x7fc16419ae20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 --2- 172.21.15.37:0/608234694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc164107df0 0x7fc16419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 >> 172.21.15.37:0/608234694 conn(0x7fc1640fedc0 msgr2=0x7fc1641011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.202+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 shutdown_connections 2024-05-09T01:02:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:43.203+0000 7fc16b095700 1 -- 172.21.15.37:0/608234694 wait complete. 2024-05-09T01:02:43.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:02:43.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:43 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:02:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:43 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:43.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.850+0000 7f0de58b2640 1 -- 172.21.15.37:0/1373476565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 msgr2=0x7f0de010bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.850+0000 7f0de58b2640 1 --2- 172.21.15.37:0/1373476565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 0x7f0de010bf60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009860 tx=0x7f0dd002a340 comp rx=0 tx=0).stop 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.850+0000 7f0de58b2640 1 -- 172.21.15.37:0/1373476565 shutdown_connections 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.850+0000 7f0de58b2640 1 --2- 172.21.15.37:0/1373476565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 0x7f0de0112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.850+0000 7f0de58b2640 1 --2- 172.21.15.37:0/1373476565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 0x7f0de010bf60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.850+0000 7f0de58b2640 1 --2- 172.21.15.37:0/1373476565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de010ad50 0x7f0de010b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.850+0000 7f0de58b2640 1 -- 172.21.15.37:0/1373476565 >> 172.21.15.37:0/1373476565 conn(0x7f0de00708d0 msgr2=0x7f0de0072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.851+0000 7f0de58b2640 1 -- 172.21.15.37:0/1373476565 shutdown_connections 2024-05-09T01:02:43.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.851+0000 7f0de58b2640 1 -- 172.21.15.37:0/1373476565 wait complete. 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 Processor -- start 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 -- start start 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de010ad50 0x7f0de01a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 0x7f0de01a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 0x7f0de01ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0de0119fd0 con 0x7f0de010ad50 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0de0119e50 con 0x7f0de010bb50 2024-05-09T01:02:43.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.852+0000 7f0de58b2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0de011a150 con 0x7f0de0110850 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 0x7f0de01ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 0x7f0de01ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48558/0 (socket says 172.21.15.37:48558) 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 -- 172.21.15.37:0/193429587 learned_addr learned my addr 172.21.15.37:0/193429587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 0x7f0de01a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 -- 172.21.15.37:0/193429587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 msgr2=0x7f0de01a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 0x7f0de01a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 -- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de010ad50 msgr2=0x7f0de01a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de010ad50 0x7f0de01a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 -- 172.21.15.37:0/193429587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de01141b0 con 0x7f0de0110850 2024-05-09T01:02:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.853+0000 7f0de50b1640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 0x7f0de01ac0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8004410 tx=0x7f0dd80048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.854+0000 7f0dd5ffb640 1 -- 172.21.15.37:0/193429587 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8004b20 con 0x7f0de0110850 2024-05-09T01:02:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.854+0000 7f0dd5ffb640 1 -- 172.21.15.37:0/193429587 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dd8004cc0 con 0x7f0de0110850 2024-05-09T01:02:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.854+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de01144a0 con 0x7f0de0110850 2024-05-09T01:02:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.854+0000 7f0dd5ffb640 1 -- 172.21.15.37:0/193429587 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8015700 con 0x7f0de0110850 2024-05-09T01:02:43.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.854+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de01149f0 con 0x7f0de0110850 2024-05-09T01:02:43.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.858+0000 7f0ded9ca740 1 Processor -- start 2024-05-09T01:02:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.860+0000 7f0dd5ffb640 1 -- 172.21.15.37:0/193429587 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0dd80158a0 con 0x7f0de0110850 2024-05-09T01:02:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.860+0000 7f0ded9ca740 1 -- start start 2024-05-09T01:02:43.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.861+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c476c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.861+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c47c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.861+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c4eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.861+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd42bab7c0 con 0x55cd428a31b0 2024-05-09T01:02:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.861+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cd42b470e0 con 0x55cd428824d0 2024-05-09T01:02:43.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.861+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cd42ba7780 con 0x55cd4287a2f0 2024-05-09T01:02:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.862+0000 7f0de48b0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c47c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.862+0000 7f0dd7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c4eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.862+0000 7f0dd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.862+0000 7f0dd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56392/0 (socket says 172.21.15.37:56392) 2024-05-09T01:02:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.862+0000 7f0dd7fff640 1 -- 172.21.15.37:0/3002640053 learned_addr learned my addr 172.21.15.37:0/3002640053 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.863+0000 7f0dd7fff640 1 -- 172.21.15.37:0/3002640053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 msgr2=0x55cd42c47c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.863+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/3002640053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c47c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.863+0000 7f0dd7fff640 1 -- 172.21.15.37:0/3002640053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 msgr2=0x55cd42c4eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.863+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/3002640053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c4eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.863+0000 7f0dd7fff640 1 -- 172.21.15.37:0/3002640053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd42b707c0 con 0x55cd428a31b0 2024-05-09T01:02:43.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.865+0000 7f0dd5ffb640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0dc80b2930 0x7f0dc80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.865+0000 7f0dd5ffb640 1 -- 172.21.15.37:0/193429587 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0dd80e2730 con 0x7f0de0110850 2024-05-09T01:02:43.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.866+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/3002640053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c476c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00057c0 tx=0x7f0dd00303b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727b8eed51dc96d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.866+0000 7f0dc6ffd640 1 -- 172.21.15.37:0/3002640053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0037040 con 0x55cd428a31b0 2024-05-09T01:02:43.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.867+0000 7f0dc6ffd640 1 -- 172.21.15.37:0/3002640053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dd00046c0 con 0x55cd428a31b0 2024-05-09T01:02:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.867+0000 7f0de48b0640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0dc80b2930 0x7f0dc80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.868+0000 7f0dc6ffd640 1 -- 172.21.15.37:0/3002640053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0003850 con 0x55cd428a31b0 2024-05-09T01:02:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.868+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3002640053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 msgr2=0x55cd42c476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.868+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3002640053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c476c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00057c0 tx=0x7f0dd00303b0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.869+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3002640053 shutdown_connections 2024-05-09T01:02:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.870+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3002640053 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c4eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.870+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3002640053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c47c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.870+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3002640053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c476c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.870+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3002640053 >> 172.21.15.37:0/3002640053 conn(0x55cd42897300 msgr2=0x55cd42c43050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.870+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3002640053 shutdown_connections 2024-05-09T01:02:43.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.871+0000 7f0de48b0640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0dc80b2930 0x7f0dc80b4e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55cd42c48aa0 tx=0x7f0ddc00d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.871+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3002640053 wait complete. 2024-05-09T01:02:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.871+0000 7f0ded9ca740 1 -- start start 2024-05-09T01:02:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.871+0000 7f0ded9ca740 1 Processor -- start 2024-05-09T01:02:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c51a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c58970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd42c4f520 con 0x55cd428a31b0 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cd42b329c0 con 0x55cd428824d0 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cd42c4f6a0 con 0x55cd4287a2f0 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0ded9ca740 10 client.0 _ll_register_callbacks cb 0x55cd42b5f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0de48b0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0dd7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c51a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0de48b0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48582/0 (socket says 172.21.15.37:48582) 2024-05-09T01:02:43.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.872+0000 7f0de48b0640 1 -- 172.21.15.37:0/1418102333 learned_addr learned my addr 172.21.15.37:0/1418102333 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.873+0000 7f0de48b0640 1 -- 172.21.15.37:0/1418102333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 msgr2=0x55cd42c51a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.873+0000 7f0de48b0640 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c51a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.873+0000 7f0de48b0640 1 -- 172.21.15.37:0/1418102333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 msgr2=0x55cd42c58970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.873+0000 7f0de48b0640 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c58970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.873+0000 7f0de48b0640 1 -- 172.21.15.37:0/1418102333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd42b591f0 con 0x55cd4287a2f0 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.873+0000 7f0de48b0640 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c514d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc004540 tx=0x7f0ddc005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa5b3ee76f93615a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.873+0000 7f0dbffff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.874+0000 7f0dbffff640 1 -- 172.21.15.37:0/1418102333 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc026060 con 0x55cd4287a2f0 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.874+0000 7f0dbffff640 1 -- 172.21.15.37:0/1418102333 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0ddc021620 con 0x55cd4287a2f0 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.874+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dd00046c0 con 0x55cd4287a2f0 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.874+0000 7f0dbffff640 1 -- 172.21.15.37:0/1418102333 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0ddc01d040 con 0x55cd4287a2f0 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.875+0000 7f0ded9ca740 10 client.25036 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:43.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.875+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cd4290e790 con 0x55cd4287a2f0 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.875+0000 7f0dbffff640 1 -- 172.21.15.37:0/1418102333 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dd00046c0 con 0x55cd4287a2f0 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.875+0000 7f0dbffff640 1 -- 172.21.15.37:0/1418102333 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f0ddc02b070 con 0x55cd4287a2f0 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.876+0000 7f0ded9ca740 10 client.25036 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.876+0000 7f0ded9ca740 10 client.25036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.876+0000 7f0ded9ca740 20 client.25036 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.876+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd42861d80 0x55cd42c5f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.876+0000 7f0ded9ca740 4 client.25036 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:43.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.876+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd42bb93d0 con 0x55cd42861d80 2024-05-09T01:02:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.878+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd42861d80 0x55cd42c5f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.879+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd42861d80 0x55cd42c5f450 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af13439b7742aa6 server_cookie=582032b6f343aee4 in_seq=0 out_seq=0 2024-05-09T01:02:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.879+0000 7f0dbffff640 10 client.25036 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.880+0000 7f0dbffff640 1 -- 172.21.15.37:0/1418102333 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cd42bb93d0 con 0x55cd42861d80 2024-05-09T01:02:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.880+0000 7f0dbffff640 10 client.25036 handle_command_reply: tid=0 2024-05-09T01:02:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.880+0000 7f0ded9ca740 1 client.25036 shutdown 2024-05-09T01:02:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.881+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 msgr2=0x55cd42c514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.881+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c514d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc004540 tx=0x7f0ddc005f90 comp rx=0 tx=0).stop 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 shutdown_connections 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd42861d80 0x55cd42c5f450 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c58970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428824d0 0x55cd42c51a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1418102333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd4287a2f0 0x55cd42c514d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 >> 172.21.15.37:0/1418102333 conn(0x55cd42897300 msgr2=0x55cd42c42290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0dbffff640 0 client.25036 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.882+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 shutdown_connections 2024-05-09T01:02:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.883+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1418102333 wait complete. 2024-05-09T01:02:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.883+0000 7f0ded9ca740 20 client.25036 trim_cache size 0 max 16384 2024-05-09T01:02:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.920+0000 7f0ded9ca740 1 Processor -- start 2024-05-09T01:02:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.921+0000 7f0ded9ca740 1 -- start start 2024-05-09T01:02:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd4287a2f0 0x55cd42c501a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c58900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0de48b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd4287a2f0 0x55cd42c501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0de48b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd4287a2f0 0x55cd42c501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56418/0 (socket says 172.21.15.37:56418) 2024-05-09T01:02:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0de48b0640 1 -- 172.21.15.37:0/3697666938 learned_addr learned my addr 172.21.15.37:0/3697666938 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428a31b0 0x55cd42c58e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0de01ba070 con 0x55cd4287a2f0 2024-05-09T01:02:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0de01bbca0 con 0x55cd428a31b0 2024-05-09T01:02:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c58900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.922+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0de01ba740 con 0x55cd428824d0 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.923+0000 7f0dd7fff640 1 -- 172.21.15.37:0/3697666938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428a31b0 msgr2=0x55cd42c58e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.923+0000 7f0de50b1640 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428a31b0 0x55cd42c58e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.923+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428a31b0 0x55cd42c58e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.923+0000 7f0dd7fff640 1 -- 172.21.15.37:0/3697666938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd4287a2f0 msgr2=0x55cd42c501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.923+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd4287a2f0 0x55cd42c501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.923+0000 7f0dd7fff640 1 -- 172.21.15.37:0/3697666938 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd429855f0 con 0x55cd428824d0 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.923+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c58900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0dd002a930 tx=0x7f0dd002c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ece6cb2e94c5c2d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.924+0000 7f0dc67fc640 1 -- 172.21.15.37:0/3697666938 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0056070 con 0x55cd428824d0 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.924+0000 7f0dc67fc640 1 -- 172.21.15.37:0/3697666938 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dd0003ca0 con 0x55cd428824d0 2024-05-09T01:02:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.924+0000 7f0dc67fc640 1 -- 172.21.15.37:0/3697666938 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0050030 con 0x55cd428824d0 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.925+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 msgr2=0x55cd42c58900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.925+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c58900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0dd002a930 tx=0x7f0dd002c040 comp rx=0 tx=0).stop 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.925+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 shutdown_connections 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.926+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd428a31b0 0x55cd42c58e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.926+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c58900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.926+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/3697666938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd4287a2f0 0x55cd42c501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.926+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 >> 172.21.15.37:0/3697666938 conn(0x55cd42897300 msgr2=0x55cd42c4fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.926+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 shutdown_connections 2024-05-09T01:02:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.926+0000 7f0ded9ca740 1 -- 172.21.15.37:0/3697666938 wait complete. 2024-05-09T01:02:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.927+0000 7f0ded9ca740 1 -- start start 2024-05-09T01:02:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.927+0000 7f0ded9ca740 1 Processor -- start 2024-05-09T01:02:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.927+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd4287a2f0 0x55cd42c58ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.927+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c55640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0ded9ca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c55b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0dd7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c55640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0de01bb510 con 0x55cd428a31b0 2024-05-09T01:02:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0de01bae40 con 0x55cd4287a2f0 2024-05-09T01:02:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0ded9ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0de01b8050 con 0x55cd428824d0 2024-05-09T01:02:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0ded9ca740 10 client.0 _ll_register_callbacks cb 0x7f0ddc01a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0de50b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c55b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0de50b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c55b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56428/0 (socket says 172.21.15.37:56428) 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0de50b1640 1 -- 172.21.15.37:0/1601493254 learned_addr learned my addr 172.21.15.37:0/1601493254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.928+0000 7f0de48b0640 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd4287a2f0 0x55cd42c58ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.929+0000 7f0de48b0640 1 -- 172.21.15.37:0/1601493254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 msgr2=0x55cd42c55640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.929+0000 7f0de48b0640 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c55640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.929+0000 7f0de48b0640 1 -- 172.21.15.37:0/1601493254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 msgr2=0x55cd42c55b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.929+0000 7f0de48b0640 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c55b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.929+0000 7f0de48b0640 1 -- 172.21.15.37:0/1601493254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd42b6fed0 con 0x55cd4287a2f0 2024-05-09T01:02:43.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.929+0000 7f0de48b0640 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd4287a2f0 0x55cd42c58ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc004510 tx=0x7f0ddc0176a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950e57f66d2af531 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:43.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.930+0000 7f0dbffff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:43.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.930+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c55640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:02:43.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.930+0000 7f0dbffff640 1 -- 172.21.15.37:0/1601493254 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc039020 con 0x55cd4287a2f0 2024-05-09T01:02:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.930+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dd0003ca0 con 0x55cd4287a2f0 2024-05-09T01:02:43.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.930+0000 7f0dbffff640 1 -- 172.21.15.37:0/1601493254 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0ddc021620 con 0x55cd4287a2f0 2024-05-09T01:02:43.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0dbffff640 1 -- 172.21.15.37:0/1601493254 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0ddc031040 con 0x55cd4287a2f0 2024-05-09T01:02:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 10 client.25025 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:43.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55cd42cc6510 con 0x55cd4287a2f0 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0dbffff640 1 -- 172.21.15.37:0/1601493254 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dd0003ca0 con 0x55cd4287a2f0 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0dbffff640 1 -- 172.21.15.37:0/1601493254 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f0ddc034070 con 0x55cd4287a2f0 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 10 client.25025 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 10 client.25025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 20 client.25025 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd428371c0 0x55cd42cc8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 4 client.25025 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.931+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd42bb3240 con 0x55cd428371c0 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.932+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd428371c0 0x55cd42cc8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.933+0000 7f0dd7fff640 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd428371c0 0x55cd42cc8f30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83566f8b3212b171 server_cookie=3a34e5e3e4eedee9 in_seq=0 out_seq=0 2024-05-09T01:02:43.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.933+0000 7f0dbffff640 10 client.25025 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.948+0000 7f0dbffff640 1 -- 172.21.15.37:0/1601493254 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55cd42bb3240 con 0x55cd428371c0 2024-05-09T01:02:43.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.948+0000 7f0dbffff640 10 client.25025 handle_command_reply: tid=0 2024-05-09T01:02:43.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.948+0000 7f0ded9ca740 1 client.25025 shutdown 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.948+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd4287a2f0 msgr2=0x55cd42c58ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd4287a2f0 0x55cd42c58ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc004510 tx=0x7f0ddc0176a0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 shutdown_connections 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cd428371c0 0x55cd42cc8f30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd428a31b0 0x55cd42c55b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd428824d0 0x55cd42c55640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0ded9ca740 1 --2- 172.21.15.37:0/1601493254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cd4287a2f0 0x55cd42c58ac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 >> 172.21.15.37:0/1601493254 conn(0x55cd42897300 msgr2=0x55cd42c51030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.949+0000 7f0dbffff640 0 client.25025 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:43.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.950+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 shutdown_connections 2024-05-09T01:02:43.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.950+0000 7f0ded9ca740 1 -- 172.21.15.37:0/1601493254 wait complete. 2024-05-09T01:02:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.952+0000 7f0ded9ca740 20 client.25025 trim_cache size 0 max 16384 2024-05-09T01:02:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:02:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:02:43.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0dc80b2930 msgr2=0x7f0dc80b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0dc80b2930 0x7f0dc80b4e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55cd42c48aa0 tx=0x7f0ddc00d040 comp rx=0 tx=0).stop 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 msgr2=0x7f0de01ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 0x7f0de01ac0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8004410 tx=0x7f0dd80048d0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 shutdown_connections 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0de0110850 0x7f0de01ac0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0dc80b2930 0x7f0dc80b4e40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0de010bb50 0x7f0de01a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 --2- 172.21.15.37:0/193429587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de010ad50 0x7f0de01a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:43.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.955+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 >> 172.21.15.37:0/193429587 conn(0x7f0de00708d0 msgr2=0x7f0de010c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.956+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 shutdown_connections 2024-05-09T01:02:43.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:43.957+0000 7f0de58b2640 1 -- 172.21.15.37:0/193429587 wait complete. 2024-05-09T01:02:43.963 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:02:43.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:02:44.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:44 smithi037 ceph-mon[30122]: pgmap v413: 97 pgs: 97 active+clean; 973 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 929 op/s 2024-05-09T01:02:44.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:02:44.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:02:44.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:44.430 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:44 smithi151 ceph-mon[34780]: pgmap v413: 97 pgs: 97 active+clean; 973 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 929 op/s 2024-05-09T01:02:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:02:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:02:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:44 smithi136 ceph-mon[34110]: pgmap v413: 97 pgs: 97 active+clean; 973 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 12 MiB/s wr, 929 op/s 2024-05-09T01:02:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:02:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:02:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:02:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 25.0 s, 4751.6 tps, lat 21.073 ms stddev 22.487 2024-05-09T01:02:46.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:46 smithi037 ceph-mon[30122]: pgmap v414: 97 pgs: 97 active+clean; 973 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 838 op/s 2024-05-09T01:02:46.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:46 smithi151 ceph-mon[34780]: pgmap v414: 97 pgs: 97 active+clean; 973 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 838 op/s 2024-05-09T01:02:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 -- 172.21.15.37:0/3062114170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 msgr2=0x7f7a4c109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:46.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/3062114170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 0x7f7a4c109350 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400b0d0 tx=0x7f7a4400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 -- 172.21.15.37:0/3062114170 shutdown_connections 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/3062114170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a4c109890 0x7f7a4c1111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/3062114170 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a4c104610 0x7f7a4c104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/3062114170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 0x7f7a4c109350 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 -- 172.21.15.37:0/3062114170 >> 172.21.15.37:0/3062114170 conn(0x7f7a4c07af70 msgr2=0x7f7a4c07b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 -- 172.21.15.37:0/3062114170 shutdown_connections 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.514+0000 7f7a51cfb700 1 -- 172.21.15.37:0/3062114170 wait complete. 2024-05-09T01:02:46.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.515+0000 7f7a51cfb700 1 Processor -- start 2024-05-09T01:02:46.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.517+0000 7f7a51cfb700 1 -- start start 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a51cfb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a4c104610 0x7f7a4c075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a51cfb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 0x7f7a4c076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a51cfb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a4c109890 0x7f7a4c076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a51cfb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c1144f0 con 0x7f7a4c108f40 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a51cfb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c114370 con 0x7f7a4c104610 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a51cfb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c114670 con 0x7f7a4c109890 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a4affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 0x7f7a4c076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a4bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a4c109890 0x7f7a4c076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a4bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a4c109890 0x7f7a4c076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48604/0 (socket says 172.21.15.37:48604) 2024-05-09T01:02:46.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.518+0000 7f7a4bfff700 1 -- 172.21.15.37:0/563041950 learned_addr learned my addr 172.21.15.37:0/563041950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.519+0000 7f7a4affd700 1 -- 172.21.15.37:0/563041950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a4c109890 msgr2=0x7f7a4c076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.519+0000 7f7a4affd700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a4c109890 0x7f7a4c076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.519+0000 7f7a4affd700 1 -- 172.21.15.37:0/563041950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a4c104610 msgr2=0x7f7a4c075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.519+0000 7f7a4affd700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a4c104610 0x7f7a4c075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.519+0000 7f7a4affd700 1 -- 172.21.15.37:0/563041950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c1a9220 con 0x7f7a4c108f40 2024-05-09T01:02:46.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.519+0000 7f7a4affd700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 0x7f7a4c076000 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400b0d0 tx=0x7f7a44007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.521+0000 7f7a48ff9700 1 -- 172.21.15.37:0/563041950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44021070 con 0x7f7a4c108f40 2024-05-09T01:02:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.521+0000 7f7a48ff9700 1 -- 172.21.15.37:0/563041950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a44007db0 con 0x7f7a4c108f40 2024-05-09T01:02:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.521+0000 7f7a48ff9700 1 -- 172.21.15.37:0/563041950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44012950 con 0x7f7a4c108f40 2024-05-09T01:02:46.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.521+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c1a94b0 con 0x7f7a4c108f40 2024-05-09T01:02:46.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.521+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c1a9960 con 0x7f7a4c108f40 2024-05-09T01:02:46.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.522+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c0512c0 con 0x7f7a4c108f40 2024-05-09T01:02:46.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.526+0000 7f7a48ff9700 1 -- 172.21.15.37:0/563041950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7a44024070 con 0x7f7a4c108f40 2024-05-09T01:02:46.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.528+0000 7f7a48ff9700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7a340b2980 0x7f7a340b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:46.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.528+0000 7f7a4b7fe700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7a340b2980 0x7f7a340b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:46.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.528+0000 7f7a48ff9700 1 -- 172.21.15.37:0/563041950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7a4400f020 con 0x7f7a4c108f40 2024-05-09T01:02:46.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.529+0000 7f7a4b7fe700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7a340b2980 0x7f7a340b4e90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00a990 tx=0x7f7a3c005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:46.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:46.540+0000 7f7a48ff9700 1 -- 172.21.15.37:0/563041950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7a4402b020 con 0x7f7a4c108f40 2024-05-09T01:02:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:46 smithi136 ceph-mon[34110]: pgmap v414: 97 pgs: 97 active+clean; 973 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 838 op/s 2024-05-09T01:02:47.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.070+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a4c02e5f0 con 0x7f7a4c108f40 2024-05-09T01:02:47.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.072+0000 7f7a48ff9700 1 -- 172.21.15.37:0/563041950 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11944 (secure 0 0 0) 0x7f7a440ab0a0 con 0x7f7a4c108f40 2024-05-09T01:02:47.074 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:02:47.074 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:02:21.655821+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:02:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7a340b2980 msgr2=0x7f7a340b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:47.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7a340b2980 0x7f7a340b4e90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00a990 tx=0x7f7a3c005c80 comp rx=0 tx=0).stop 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 msgr2=0x7f7a4c076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 0x7f7a4c076000 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400b0d0 tx=0x7f7a44007ad0 comp rx=0 tx=0).stop 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 shutdown_connections 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7a340b2980 0x7f7a340b4e90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a4c109890 0x7f7a4c076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a4c104610 0x7f7a4c075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 --2- 172.21.15.37:0/563041950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c108f40 0x7f7a4c076000 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 >> 172.21.15.37:0/563041950 conn(0x7f7a4c07af70 msgr2=0x7f7a4c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:47.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 shutdown_connections 2024-05-09T01:02:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:47.077+0000 7f7a51cfb700 1 -- 172.21.15.37:0/563041950 wait complete. 2024-05-09T01:02:47.080 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2024-05-09T01:02:47.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:47 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/563041950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:02:47.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:47 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/563041950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:02:47.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:47 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/563041950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:02:48.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:48 smithi037 ceph-mon[30122]: pgmap v415: 97 pgs: 97 active+clean; 983 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 902 op/s 2024-05-09T01:02:48.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:48 smithi151 ceph-mon[34780]: pgmap v415: 97 pgs: 97 active+clean; 983 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 902 op/s 2024-05-09T01:02:48.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:02:48.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:48 smithi136 ceph-mon[34110]: pgmap v415: 97 pgs: 97 active+clean; 983 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 MiB/s wr, 902 op/s 2024-05-09T01:02:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 30.0 s, 4410.0 tps, lat 22.612 ms stddev 22.530 2024-05-09T01:02:50.299 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:50 smithi037 ceph-mon[30122]: pgmap v416: 97 pgs: 97 active+clean; 988 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 806 op/s 2024-05-09T01:02:50.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:50 smithi151 ceph-mon[34780]: pgmap v416: 97 pgs: 97 active+clean; 988 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 806 op/s 2024-05-09T01:02:50.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:50 smithi136 ceph-mon[34110]: pgmap v416: 97 pgs: 97 active+clean; 988 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 806 op/s 2024-05-09T01:02:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.041+0000 7f9d05124700 1 -- 172.21.15.37:0/879117326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 msgr2=0x7f9d00110a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.041+0000 7f9d05124700 1 --2- 172.21.15.37:0/879117326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d00110a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009990 tx=0x7f9ce8009ca0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.041+0000 7f9d05124700 1 -- 172.21.15.37:0/879117326 shutdown_connections 2024-05-09T01:02:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.041+0000 7f9d05124700 1 --2- 172.21.15.37:0/879117326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d00110fb0 0x7f9d001188f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.041+0000 7f9d05124700 1 --2- 172.21.15.37:0/879117326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d0010c840 0x7f9d0010cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.041+0000 7f9d05124700 1 --2- 172.21.15.37:0/879117326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d00110a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.041+0000 7f9d05124700 1 -- 172.21.15.37:0/879117326 >> 172.21.15.37:0/879117326 conn(0x7f9d0006f4d0 msgr2=0x7f9d0006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.043+0000 7f9d05124700 1 -- 172.21.15.37:0/879117326 shutdown_connections 2024-05-09T01:02:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.043+0000 7f9d05124700 1 -- 172.21.15.37:0/879117326 wait complete. 2024-05-09T01:02:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.044+0000 7f9d05124700 1 Processor -- start 2024-05-09T01:02:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.045+0000 7f9d05124700 1 -- start start 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.045+0000 7f9d05124700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d0010c840 0x7f9d001a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.045+0000 7f9d05124700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d001a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.045+0000 7f9d05124700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d00110fb0 0x7f9d001a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.045+0000 7f9d05124700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0011ab00 con 0x7f9d0010c840 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.045+0000 7f9d05124700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0011a980 con 0x7f9d00110660 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9d05124700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0011ac80 con 0x7f9d00110fb0 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d001a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d001a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35486/0 (socket says 172.21.15.37:35486) 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 -- 172.21.15.37:0/1677166584 learned_addr learned my addr 172.21.15.37:0/1677166584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cff59e700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d00110fb0 0x7f9d001a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d0010c840 0x7f9d001a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 -- 172.21.15.37:0/1677166584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d00110fb0 msgr2=0x7f9d001a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d00110fb0 0x7f9d001a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 -- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d0010c840 msgr2=0x7f9d001a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d0010c840 0x7f9d001a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 -- 172.21.15.37:0/1677166584 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d001a62c0 con 0x7f9d00110660 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d0010c840 0x7f9d001a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.046+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d001a1990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8006010 tx=0x7f9ce80047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.047+0000 7f9cfcd99700 1 -- 172.21.15.37:0/1677166584 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8027070 con 0x7f9d00110660 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.047+0000 7f9cfcd99700 1 -- 172.21.15.37:0/1677166584 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce8022470 con 0x7f9d00110660 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.047+0000 7f9cfcd99700 1 -- 172.21.15.37:0/1677166584 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8017650 con 0x7f9d00110660 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.047+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d001a6550 con 0x7f9d00110660 2024-05-09T01:02:51.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.047+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d001a6920 con 0x7f9d00110660 2024-05-09T01:02:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.051+0000 7f9cfcd99700 1 -- 172.21.15.37:0/1677166584 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9ce802a070 con 0x7f9d00110660 2024-05-09T01:02:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.053+0000 7f9cfcd99700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cec0b6d10 0x7f9cec0b9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.054+0000 7f9cfcd99700 1 -- 172.21.15.37:0/1677166584 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9ce80e2ed0 con 0x7f9d00110660 2024-05-09T01:02:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.054+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cec0b6d10 0x7f9cec0b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.055+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cec0b6d10 0x7f9cec0b9220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9d0010aa60 tx=0x7f9cf000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.055+0000 7f9d13b3ab80 1 Processor -- start 2024-05-09T01:02:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.055+0000 7f9d13b3ab80 1 -- start start 2024-05-09T01:02:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.056+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a536240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.056+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a536780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.056+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a530400 0x56490a530810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.056+0000 7f9d13b3ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56490a4530a0 con 0x56490a42dd00 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.056+0000 7f9d13b3ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56490a3f89a0 con 0x56490a3b34a0 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9d13b3ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56490a44f060 con 0x56490a530400 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a530400 0x56490a530810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a530400 0x56490a530810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48630/0 (socket says 172.21.15.37:48630) 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 -- 172.21.15.37:0/2441782754 learned_addr learned my addr 172.21.15.37:0/2441782754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a536780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 -- 172.21.15.37:0/2441782754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 msgr2=0x56490a536780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a536780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 -- 172.21.15.37:0/2441782754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 msgr2=0x56490a536240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a536240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.057+0000 7f9cff59e700 1 -- 172.21.15.37:0/2441782754 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490a3e9500 con 0x56490a530400 2024-05-09T01:02:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.058+0000 7f9cff59e700 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a530400 0x56490a530810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8011680 tx=0x7f9cf8009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b010fa2b9510699 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.058+0000 7f9cf57fa700 1 -- 172.21.15.37:0/2441782754 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8019030 con 0x56490a530400 2024-05-09T01:02:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.058+0000 7f9cf57fa700 1 -- 172.21.15.37:0/2441782754 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cf80093a0 con 0x56490a530400 2024-05-09T01:02:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.058+0000 7f9cf57fa700 1 -- 172.21.15.37:0/2441782754 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8007500 con 0x56490a530400 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.059+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2441782754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a530400 msgr2=0x56490a530810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.059+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a530400 0x56490a530810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8011680 tx=0x7f9cf8009920 comp rx=0 tx=0).stop 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.060+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2441782754 shutdown_connections 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.060+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a530400 0x56490a530810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.060+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a536240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.060+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2441782754 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a536780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.060+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2441782754 >> 172.21.15.37:0/2441782754 conn(0x56490a3b6f70 msgr2=0x56490a52b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.060+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2441782754 shutdown_connections 2024-05-09T01:02:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.060+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2441782754 wait complete. 2024-05-09T01:02:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.061+0000 7f9d13b3ab80 1 -- start start 2024-05-09T01:02:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.062+0000 7f9d13b3ab80 1 Processor -- start 2024-05-09T01:02:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.062+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b34a0 0x56490a53a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a53a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a530400 0x56490a53ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b34a0 0x56490a53a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b34a0 0x56490a53a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48638/0 (socket says 172.21.15.37:48638) 2024-05-09T01:02:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9cfed9d700 1 -- 172.21.15.37:0/22317387 learned_addr learned my addr 172.21.15.37:0/22317387 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a53a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9cff59e700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a530400 0x56490a53ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56490a531160 con 0x56490a42dd00 2024-05-09T01:02:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56490a3edb20 con 0x56490a530400 2024-05-09T01:02:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.063+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56490a53d020 con 0x56490a3b34a0 2024-05-09T01:02:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9d13b3ab80 10 client.0 _ll_register_callbacks cb 0x56490a2c46c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9cf7fff700 1 -- 172.21.15.37:0/22317387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b34a0 msgr2=0x56490a53a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b34a0 0x56490a53a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9cf7fff700 1 -- 172.21.15.37:0/22317387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a530400 msgr2=0x56490a53ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a530400 0x56490a53ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9cf7fff700 1 -- 172.21.15.37:0/22317387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490a2ce490 con 0x56490a42dd00 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9cff59e700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a530400 0x56490a53ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a53a650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80059d0 tx=0x7f9ce8022c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9fde9cbf22cb8d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.064+0000 7f9ce67fc700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.065+0000 7f9ce67fc700 1 -- 172.21.15.37:0/22317387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80aa090 con 0x56490a42dd00 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.065+0000 7f9ce67fc700 1 -- 172.21.15.37:0/22317387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9ce80b2ec0 con 0x56490a42dd00 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.065+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56490a460a80 con 0x56490a42dd00 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.065+0000 7f9ce67fc700 1 -- 172.21.15.37:0/22317387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9ce80aac80 con 0x56490a42dd00 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.065+0000 7f9d13b3ab80 10 client.15315 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.065+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56490a547ac0 con 0x56490a42dd00 2024-05-09T01:02:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.066+0000 7f9ce67fc700 1 -- 172.21.15.37:0/22317387 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56490a460a80 con 0x56490a42dd00 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.066+0000 7f9ce67fc700 1 -- 172.21.15.37:0/22317387 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f9ce80cb310 con 0x56490a42dd00 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.066+0000 7f9d13b3ab80 10 client.15315 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.066+0000 7f9d13b3ab80 10 client.15315 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.066+0000 7f9d13b3ab80 20 client.15315 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.066+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a54a080 0x56490a54c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.067+0000 7f9d13b3ab80 4 client.15315 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.067+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56490a45ab20 con 0x56490a54a080 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.067+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a54a080 0x56490a54c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.068+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a54a080 0x56490a54c4d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e1e983a3cbe071a0 server_cookie=e94f12e5678aa84b in_seq=0 out_seq=0 2024-05-09T01:02:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.068+0000 7f9ce67fc700 10 client.15315 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:02:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.069+0000 7f9ce67fc700 1 -- 172.21.15.37:0/22317387 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56490a45ab20 con 0x56490a54a080 2024-05-09T01:02:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.069+0000 7f9ce67fc700 10 client.15315 handle_command_reply: tid=0 2024-05-09T01:02:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.069+0000 7f9d13b3ab80 1 client.15315 shutdown 2024-05-09T01:02:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 msgr2=0x56490a53a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a53a650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80059d0 tx=0x7f9ce8022c20 comp rx=0 tx=0).stop 2024-05-09T01:02:51.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 shutdown_connections 2024-05-09T01:02:51.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a54a080 0x56490a54c4d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a530400 0x56490a53ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9ce67fc700 0 client.15315 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:02:51.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b34a0 0x56490a53a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/22317387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a53a650 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.070+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 >> 172.21.15.37:0/22317387 conn(0x56490a3b6f70 msgr2=0x56490a524ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:51.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.072+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 shutdown_connections 2024-05-09T01:02:51.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.072+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/22317387 wait complete. 2024-05-09T01:02:51.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.072+0000 7f9d13b3ab80 20 client.15315 trim_cache size 0 max 16384 2024-05-09T01:02:51.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.102+0000 7f9d13b3ab80 1 Processor -- start 2024-05-09T01:02:51.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.102+0000 7f9d13b3ab80 1 -- start start 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b6f70 0x56490a53a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a3b34a0 0x56490a525700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b6f70 0x56490a53a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9cf7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a3b34a0 0x56490a525700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9cf7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a3b34a0 0x56490a525700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56480/0 (socket says 172.21.15.37:56480) 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9cf7fff700 1 -- 172.21.15.37:0/2490022184 learned_addr learned my addr 172.21.15.37:0/2490022184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a42dd00 0x56490a533cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.103+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001b4fc0 con 0x56490a3b34a0 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001b6bf0 con 0x56490a3b6f70 2024-05-09T01:02:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001b5690 con 0x56490a42dd00 2024-05-09T01:02:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9cff59e700 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a42dd00 0x56490a533cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9cf7fff700 1 -- 172.21.15.37:0/2490022184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a42dd00 msgr2=0x56490a533cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a42dd00 0x56490a533cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9cf7fff700 1 -- 172.21.15.37:0/2490022184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b6f70 msgr2=0x56490a53a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b6f70 0x56490a53a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.104+0000 7f9cf7fff700 1 -- 172.21.15.37:0/2490022184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490a5279d0 con 0x56490a3b34a0 2024-05-09T01:02:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.106+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a3b34a0 0x56490a525700 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80aa510 tx=0x7f9ce80aab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b7576596b8e0e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.108+0000 7f9cf4ff9700 1 -- 172.21.15.37:0/2490022184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80a9ae0 con 0x56490a3b34a0 2024-05-09T01:02:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.108+0000 7f9cf4ff9700 1 -- 172.21.15.37:0/2490022184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce80ae930 con 0x56490a3b34a0 2024-05-09T01:02:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.108+0000 7f9cf4ff9700 1 -- 172.21.15.37:0/2490022184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80b3120 con 0x56490a3b34a0 2024-05-09T01:02:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.109+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a3b34a0 msgr2=0x56490a525700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.109+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a3b34a0 0x56490a525700 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80aa510 tx=0x7f9ce80aab20 comp rx=0 tx=0).stop 2024-05-09T01:02:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.111+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 shutdown_connections 2024-05-09T01:02:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.111+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a42dd00 0x56490a533cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.111+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b6f70 0x56490a53a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.111+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/2490022184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a3b34a0 0x56490a525700 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.111+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 >> 172.21.15.37:0/2490022184 conn(0x56490a52b520 msgr2=0x56490a524ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.114+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 shutdown_connections 2024-05-09T01:02:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.115+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/2490022184 wait complete. 2024-05-09T01:02:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.115+0000 7f9d13b3ab80 1 -- start start 2024-05-09T01:02:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.115+0000 7f9d13b3ab80 1 Processor -- start 2024-05-09T01:02:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a542630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b6f70 0x56490a551260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9d13b3ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a5517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a542630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9cfed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a542630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35522/0 (socket says 172.21.15.37:35522) 2024-05-09T01:02:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9cfed9d700 1 -- 172.21.15.37:0/220953884 learned_addr learned my addr 172.21.15.37:0/220953884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001b6460 con 0x56490a42dd00 2024-05-09T01:02:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001b5d90 con 0x56490a3b34a0 2024-05-09T01:02:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d001b2fc0 con 0x56490a3b6f70 2024-05-09T01:02:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.116+0000 7f9d13b3ab80 10 client.0 _ll_register_callbacks cb 0x56490a2c46c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.117+0000 7f9cfed9d700 1 -- 172.21.15.37:0/220953884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b6f70 msgr2=0x56490a551260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:02:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.117+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b6f70 0x56490a551260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.117+0000 7f9cfed9d700 1 -- 172.21.15.37:0/220953884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 msgr2=0x56490a5517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.117+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a5517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.117+0000 7f9cfed9d700 1 -- 172.21.15.37:0/220953884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490a536af0 con 0x56490a3b34a0 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.117+0000 7f9cfed9d700 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a542630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x56490a54cc00 tx=0x7f9cf0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53b7d102c3185057 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.117+0000 7f9ce67fc700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.118+0000 7f9ce67fc700 1 -- 172.21.15.37:0/220953884 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0003ab0 con 0x56490a3b34a0 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.118+0000 7f9ce67fc700 1 -- 172.21.15.37:0/220953884 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9cf0003c50 con 0x56490a3b34a0 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.118+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ce80ae930 con 0x56490a3b34a0 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.119+0000 7f9ce67fc700 1 -- 172.21.15.37:0/220953884 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9cf0003e50 con 0x56490a3b34a0 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.119+0000 7f9d13b3ab80 10 client.25043 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.119+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56490a5b4500 con 0x56490a3b34a0 2024-05-09T01:02:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.119+0000 7f9ce67fc700 1 -- 172.21.15.37:0/220953884 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce80ae930 con 0x56490a3b34a0 2024-05-09T01:02:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.119+0000 7f9ce67fc700 1 -- 172.21.15.37:0/220953884 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f9cf0025410 con 0x56490a3b34a0 2024-05-09T01:02:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.120+0000 7f9d13b3ab80 10 client.25043 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.120+0000 7f9d13b3ab80 10 client.25043 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:02:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.120+0000 7f9d13b3ab80 20 client.25043 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.120+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a530400 0x56490a5b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.120+0000 7f9d13b3ab80 4 client.25043 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:02:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.120+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56490a2ce970 con 0x56490a530400 2024-05-09T01:02:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.120+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a530400 0x56490a5b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.121+0000 7f9ce67fc700 10 client.25043 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:02:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.121+0000 7f9cf7fff700 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a530400 0x56490a5b6c80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb2b62844df714fb server_cookie=fb0405779df9d04e in_seq=0 out_seq=0 2024-05-09T01:02:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.121+0000 7f9ce67fc700 1 -- 172.21.15.37:0/220953884 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56490a2ce970 con 0x56490a530400 2024-05-09T01:02:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.121+0000 7f9ce67fc700 10 client.25043 handle_command_reply: tid=0 2024-05-09T01:02:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.121+0000 7f9d13b3ab80 1 client.25043 shutdown 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 msgr2=0x56490a542630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a542630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x56490a54cc00 tx=0x7f9cf0004750 comp rx=0 tx=0).stop 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 shutdown_connections 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56490a530400 0x56490a5b6c80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56490a42dd00 0x56490a5517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56490a3b34a0 0x56490a542630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 --2- 172.21.15.37:0/220953884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490a3b6f70 0x56490a551260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 >> 172.21.15.37:0/220953884 conn(0x56490a52b520 msgr2=0x56490a533cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9ce67fc700 0 client.25043 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:02:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 shutdown_connections 2024-05-09T01:02:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 1 -- 172.21.15.37:0/220953884 wait complete. 2024-05-09T01:02:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.122+0000 7f9d13b3ab80 20 client.25043 trim_cache size 0 max 16384 2024-05-09T01:02:51.126 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:02:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cec0b6d10 msgr2=0x7f9cec0b9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cec0b6d10 0x7f9cec0b9220 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9d0010aa60 tx=0x7f9cf000d040 comp rx=0 tx=0).stop 2024-05-09T01:02:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 msgr2=0x7f9d001a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d001a1990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8006010 tx=0x7f9ce80047b0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 shutdown_connections 2024-05-09T01:02:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9cec0b6d10 0x7f9cec0b9220 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d00110fb0 0x7f9d001a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d0010c840 0x7f9d001a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 --2- 172.21.15.37:0/1677166584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d00110660 0x7f9d001a1990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 >> 172.21.15.37:0/1677166584 conn(0x7f9d0006f4d0 msgr2=0x7f9d0010e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 shutdown_connections 2024-05-09T01:02:51.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:51.124+0000 7f9d05124700 1 -- 172.21.15.37:0/1677166584 wait complete. 2024-05-09T01:02:51.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:02:52.409 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:52.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:52 smithi037 ceph-mon[30122]: pgmap v417: 97 pgs: 97 active+clean; 993 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-05-09T01:02:52.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:52 smithi151 ceph-mon[34780]: pgmap v417: 97 pgs: 97 active+clean; 993 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-05-09T01:02:52.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:52 smithi136 ceph-mon[34110]: pgmap v417: 97 pgs: 97 active+clean; 993 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-05-09T01:02:54.461 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:54 smithi037 ceph-mon[30122]: pgmap v418: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 858 op/s 2024-05-09T01:02:54.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:54 smithi151 ceph-mon[34780]: pgmap v418: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 858 op/s 2024-05-09T01:02:54.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:54 smithi136 ceph-mon[34110]: pgmap v418: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 858 op/s 2024-05-09T01:02:54.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.932+0000 7f542b0f0700 1 -- 172.21.15.37:0/1401948792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5424110990 msgr2=0x7f5424110da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:54.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.932+0000 7f542b0f0700 1 --2- 172.21.15.37:0/1401948792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5424110990 0x7f5424110da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f541400b0a0 tx=0x7f541400b3b0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.934+0000 7f542b0f0700 1 -- 172.21.15.37:0/1401948792 shutdown_connections 2024-05-09T01:02:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.934+0000 7f542b0f0700 1 --2- 172.21.15.37:0/1401948792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542410b2b0 0x7f5424117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.935+0000 7f542b0f0700 1 --2- 172.21.15.37:0/1401948792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5424110990 0x7f5424110da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.935+0000 7f542b0f0700 1 --2- 172.21.15.37:0/1401948792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f542410a960 0x7f542410ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.935+0000 7f542b0f0700 1 -- 172.21.15.37:0/1401948792 >> 172.21.15.37:0/1401948792 conn(0x7f5424076d30 msgr2=0x7f5424077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.935+0000 7f542b0f0700 1 -- 172.21.15.37:0/1401948792 shutdown_connections 2024-05-09T01:02:54.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.935+0000 7f542b0f0700 1 -- 172.21.15.37:0/1401948792 wait complete. 2024-05-09T01:02:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.936+0000 7f542b0f0700 1 Processor -- start 2024-05-09T01:02:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.936+0000 7f542b0f0700 1 -- start start 2024-05-09T01:02:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.936+0000 7f542b0f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542410a960 0x7f5424075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.936+0000 7f542b0f0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f542410b2b0 0x7f542406e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.936+0000 7f542b0f0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424110990 0x7f542406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542b0f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f542411abb0 con 0x7f542410a960 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542b0f0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f542411aa30 con 0x7f5424110990 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542b0f0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f542411ad30 con 0x7f542410b2b0 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424110990 0x7f542406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424110990 0x7f542406eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37746/0 (socket says 172.21.15.37:37746) 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 -- 172.21.15.37:0/218233969 learned_addr learned my addr 172.21.15.37:0/218233969 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f5428e8c700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542410a960 0x7f5424075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 -- 172.21.15.37:0/218233969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f542410b2b0 msgr2=0x7f542406e500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f542410b2b0 0x7f542406e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 -- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542410a960 msgr2=0x7f5424075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542410a960 0x7f5424075380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f542968d700 1 -- 172.21.15.37:0/218233969 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5424072eb0 con 0x7f5424110990 2024-05-09T01:02:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.937+0000 7f5428e8c700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542410a960 0x7f5424075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:02:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.939+0000 7f542968d700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424110990 0x7f542406eb00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f541c00b550 tx=0x7f541c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:54.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.941+0000 7f54227fc700 1 -- 172.21.15.37:0/218233969 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c015020 con 0x7f5424110990 2024-05-09T01:02:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.941+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54240730e0 con 0x7f5424110990 2024-05-09T01:02:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.941+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5424073620 con 0x7f5424110990 2024-05-09T01:02:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.941+0000 7f54227fc700 1 -- 172.21.15.37:0/218233969 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f541c011ce0 con 0x7f5424110990 2024-05-09T01:02:54.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.941+0000 7f54227fc700 1 -- 172.21.15.37:0/218233969 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c010d40 con 0x7f5424110990 2024-05-09T01:02:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.947+0000 7f54227fc700 1 -- 172.21.15.37:0/218233969 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f541c018020 con 0x7f5424110990 2024-05-09T01:02:54.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.950+0000 7f5439b06b80 1 Processor -- start 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.950+0000 7f5439b06b80 1 -- start start 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b63a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b5dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f5439b06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ae16a7fff0 con 0x55ae169e04a0 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f5439b06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ae16a1e7f0 con 0x55ae16b5d6a0 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f5439b06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ae16a7bfb0 con 0x55ae16aca160 2024-05-09T01:02:54.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f541bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f541bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57496/0 (socket says 172.21.15.37:57496) 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f541bfff700 1 -- 172.21.15.37:0/3056586200 learned_addr learned my addr 172.21.15.37:0/3056586200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f541bfff700 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b5dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.951+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b63a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f54227fc700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54100b2a90 0x7f54100b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f541bfff700 1 -- 172.21.15.37:0/3056586200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 msgr2=0x55ae16b5dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f541bfff700 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b5dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f541bfff700 1 -- 172.21.15.37:0/3056586200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 msgr2=0x55ae16b63a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f541bfff700 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b63a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f541bfff700 1 -- 172.21.15.37:0/3056586200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae16a16370 con 0x55ae16aca160 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f542968d700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54100b2a90 0x7f54100b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f541bfff700 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b634f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f540c005950 tx=0x7f540c009730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1169f3a84085d5f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:54.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.952+0000 7f54227fc700 1 -- 172.21.15.37:0/218233969 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f541c0e1800 con 0x7f5424110990 2024-05-09T01:02:54.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.953+0000 7f541affd700 1 -- 172.21.15.37:0/3056586200 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c0132d0 con 0x55ae16aca160 2024-05-09T01:02:54.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.953+0000 7f541affd700 1 -- 172.21.15.37:0/3056586200 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f540c0044d0 con 0x55ae16aca160 2024-05-09T01:02:54.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.953+0000 7f541affd700 1 -- 172.21.15.37:0/3056586200 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c005020 con 0x55ae16aca160 2024-05-09T01:02:54.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 -- 172.21.15.37:0/3056586200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 msgr2=0x55ae16b634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:54.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b634f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f540c005950 tx=0x7f540c009730 comp rx=0 tx=0).stop 2024-05-09T01:02:54.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f542968d700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54100b2a90 0x7f54100b4fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f541c0a8b20 tx=0x7f541c09d6f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:54.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 -- 172.21.15.37:0/3056586200 shutdown_connections 2024-05-09T01:02:54.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b5dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b634f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3056586200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b63a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 -- 172.21.15.37:0/3056586200 >> 172.21.15.37:0/3056586200 conn(0x55ae16a406a0 msgr2=0x55ae16b58400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:54.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 -- 172.21.15.37:0/3056586200 shutdown_connections 2024-05-09T01:02:54.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.955+0000 7f5439b06b80 1 -- 172.21.15.37:0/3056586200 wait complete. 2024-05-09T01:02:54.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.956+0000 7f5439b06b80 1 -- start start 2024-05-09T01:02:54.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.956+0000 7f5439b06b80 1 Processor -- start 2024-05-09T01:02:54.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae169e04a0 0x55ae16b671a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16aca160 0x55ae16b676e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b67c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f5439b06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ae168fbba0 con 0x55ae16aca160 2024-05-09T01:02:54.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f5439b06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ae16a3a150 con 0x55ae16b5d6a0 2024-05-09T01:02:54.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f5439b06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ae16b6a1d0 con 0x55ae169e04a0 2024-05-09T01:02:54.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f5439b06b80 10 client.0 _ll_register_callbacks cb 0x55ae168f16c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:54.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f541bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae169e04a0 0x55ae16b671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f541bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae169e04a0 0x55ae16b671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57510/0 (socket says 172.21.15.37:57510) 2024-05-09T01:02:54.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.957+0000 7f541bfff700 1 -- 172.21.15.37:0/3920705007 learned_addr learned my addr 172.21.15.37:0/3920705007 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:54.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.958+0000 7f541bfff700 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b67c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.958+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16aca160 0x55ae16b676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5428e8c700 1 -- 172.21.15.37:0/3920705007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae169e04a0 msgr2=0x55ae16b671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:54.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae169e04a0 0x55ae16b671a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5428e8c700 1 -- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 msgr2=0x55ae16b67c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:54.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b67c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5428e8c700 1 -- 172.21.15.37:0/3920705007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae168fb490 con 0x55ae16aca160 2024-05-09T01:02:54.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16aca160 0x55ae16b676e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5414009fd0 tx=0x7f541400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe4b40ad84180b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5403fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5403fff700 1 -- 172.21.15.37:0/3920705007 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414004e60 con 0x55ae16aca160 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f540c0044d0 con 0x55ae16aca160 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.959+0000 7f5403fff700 1 -- 172.21.15.37:0/3920705007 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f54140075c0 con 0x55ae16aca160 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.960+0000 7f5403fff700 1 -- 172.21.15.37:0/3920705007 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5414007800 con 0x55ae16aca160 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.960+0000 7f5439b06b80 10 client.15324 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.960+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ae16b74c00 con 0x55ae16aca160 2024-05-09T01:02:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.960+0000 7f5403fff700 1 -- 172.21.15.37:0/3920705007 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f540c0044d0 con 0x55ae16aca160 2024-05-09T01:02:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.961+0000 7f5403fff700 1 -- 172.21.15.37:0/3920705007 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f5414011070 con 0x55ae16aca160 2024-05-09T01:02:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.961+0000 7f5439b06b80 10 client.15324 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.961+0000 7f5439b06b80 10 client.15324 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:02:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.961+0000 7f5439b06b80 20 client.15324 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.961+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b775d0 0x55ae16b79a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.961+0000 7f5439b06b80 4 client.15324 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.961+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae16a8d9d0 con 0x55ae16b775d0 2024-05-09T01:02:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.962+0000 7f541bfff700 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b775d0 0x55ae16b79a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.963+0000 7f5403fff700 10 client.15324 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:02:54.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.963+0000 7f541bfff700 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b775d0 0x55ae16b79a60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6c774740e3f2934b server_cookie=7d5fefbdd56b4fc5 in_seq=0 out_seq=0 2024-05-09T01:02:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.964+0000 7f5403fff700 1 -- 172.21.15.37:0/3920705007 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ae16a8d9d0 con 0x55ae16b775d0 2024-05-09T01:02:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.964+0000 7f5403fff700 10 client.15324 handle_command_reply: tid=0 2024-05-09T01:02:54.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 client.15324 shutdown 2024-05-09T01:02:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16aca160 msgr2=0x55ae16b676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16aca160 0x55ae16b676e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5414009fd0 tx=0x7f541400bce0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 shutdown_connections 2024-05-09T01:02:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b775d0 0x55ae16b79a60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b67c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae169e04a0 0x55ae16b671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3920705007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16aca160 0x55ae16b676e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:54.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 >> 172.21.15.37:0/3920705007 conn(0x55ae16a406a0 msgr2=0x55ae16b581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:54.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.965+0000 7f5403fff700 0 client.15324 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:02:54.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.966+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 shutdown_connections 2024-05-09T01:02:54.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.966+0000 7f5439b06b80 1 -- 172.21.15.37:0/3920705007 wait complete. 2024-05-09T01:02:54.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.966+0000 7f5439b06b80 20 client.15324 trim_cache size 0 max 16384 2024-05-09T01:02:54.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.997+0000 7f5439b06b80 1 Processor -- start 2024-05-09T01:02:54.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.997+0000 7f5439b06b80 1 -- start start 2024-05-09T01:02:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.997+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b61860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.997+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b5fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.998+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b72e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.998+0000 7f5439b06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f540400d230 con 0x55ae169e04a0 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.998+0000 7f5439b06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f540400ee60 con 0x55ae16b5d6a0 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.998+0000 7f5439b06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f540400d900 con 0x55ae16aca160 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.998+0000 7f5428e8c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b5fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.998+0000 7f5428e8c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b5fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57514/0 (socket says 172.21.15.37:57514) 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.998+0000 7f5428e8c700 1 -- 172.21.15.37:0/3820586098 learned_addr learned my addr 172.21.15.37:0/3820586098 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.999+0000 7f541bfff700 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b72e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.999+0000 7f541bfff700 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b61860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.999+0000 7f5428e8c700 1 -- 172.21.15.37:0/3820586098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 msgr2=0x55ae16b72e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.999+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b72e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.999+0000 7f5428e8c700 1 -- 172.21.15.37:0/3820586098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 msgr2=0x55ae16b61860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.999+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b61860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:54.999+0000 7f5428e8c700 1 -- 172.21.15.37:0/3820586098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae16b66f70 con 0x55ae16aca160 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.000+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b5fe00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54140098e0 tx=0x7f5414009960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98d3e8b09d580a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.000+0000 7f541a7fc700 1 -- 172.21.15.37:0/3820586098 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541400bd50 con 0x55ae16aca160 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.000+0000 7f541a7fc700 1 -- 172.21.15.37:0/3820586098 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5414005c60 con 0x55ae16aca160 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.000+0000 7f541a7fc700 1 -- 172.21.15.37:0/3820586098 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414007c00 con 0x55ae16aca160 2024-05-09T01:02:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.000+0000 7f541bfff700 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b72e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:02:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.001+0000 7f5439b06b80 1 -- 172.21.15.37:0/3820586098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 msgr2=0x55ae16b5fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.001+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b5fe00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54140098e0 tx=0x7f5414009960 comp rx=0 tx=0).stop 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.001+0000 7f5439b06b80 1 -- 172.21.15.37:0/3820586098 shutdown_connections 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.001+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae16b5d6a0 0x55ae16b72e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.001+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae169e04a0 0x55ae16b61860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.001+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3820586098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16aca160 0x55ae16b5fe00 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54140098e0 tx=0x7f5414009960 comp rx=0 tx=0).stop 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.001+0000 7f5439b06b80 1 -- 172.21.15.37:0/3820586098 >> 172.21.15.37:0/3820586098 conn(0x55ae16a406a0 msgr2=0x55ae16b795e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.003+0000 7f5439b06b80 1 -- 172.21.15.37:0/3820586098 shutdown_connections 2024-05-09T01:02:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.003+0000 7f5439b06b80 1 -- 172.21.15.37:0/3820586098 wait complete. 2024-05-09T01:02:55.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.003+0000 7f5439b06b80 1 -- start start 2024-05-09T01:02:55.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.004+0000 7f5439b06b80 1 Processor -- start 2024-05-09T01:02:55.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae169e04a0 0x55ae16b64bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:55.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16b5d6a0 0x55ae16b634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:55.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f5439b06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16b63a30 0x55ae16b63e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:55.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f5439b06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f540400e6d0 con 0x55ae16b5d6a0 2024-05-09T01:02:55.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f5439b06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f540400e000 con 0x55ae169e04a0 2024-05-09T01:02:55.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f5439b06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f540400b1d0 con 0x55ae16b63a30 2024-05-09T01:02:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f5439b06b80 10 client.0 _ll_register_callbacks cb 0x55ae168f16c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.005+0000 7f541bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae169e04a0 0x55ae16b64bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae169e04a0 0x55ae16b64bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37794/0 (socket says 172.21.15.37:37794) 2024-05-09T01:02:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 -- 172.21.15.37:0/3239075822 learned_addr learned my addr 172.21.15.37:0/3239075822 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16b63a30 0x55ae16b63e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16b5d6a0 0x55ae16b634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 -- 172.21.15.37:0/3239075822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16b63a30 msgr2=0x55ae16b63e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16b63a30 0x55ae16b63e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 -- 172.21.15.37:0/3239075822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16b5d6a0 msgr2=0x55ae16b634f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16b5d6a0 0x55ae16b634f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 -- 172.21.15.37:0/3239075822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae16b5dfd0 con 0x55ae169e04a0 2024-05-09T01:02:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f541bfff700 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae169e04a0 0x55ae16b64bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f540c001eb0 tx=0x7f540c009a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad7da1436fd8e729 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.006+0000 7f5403fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.007+0000 7f5403fff700 1 -- 172.21.15.37:0/3239075822 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c013250 con 0x55ae169e04a0 2024-05-09T01:02:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.007+0000 7f5403fff700 1 -- 172.21.15.37:0/3239075822 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f540c02ec70 con 0x55ae169e04a0 2024-05-09T01:02:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.007+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5414005c60 con 0x55ae169e04a0 2024-05-09T01:02:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.007+0000 7f5403fff700 1 -- 172.21.15.37:0/3239075822 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f540c004030 con 0x55ae169e04a0 2024-05-09T01:02:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 10 client.25061 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ae16b6ee80 con 0x55ae169e04a0 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5403fff700 1 -- 172.21.15.37:0/3239075822 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f540c02e3b0 con 0x55ae169e04a0 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5403fff700 1 -- 172.21.15.37:0/3239075822 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f540c003680 con 0x55ae169e04a0 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 10 client.25061 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 10 client.25061 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 20 client.25061 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b6f290 0x55ae16b6f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 4 client.25061 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5414005c60 con 0x55ae16b6f290 2024-05-09T01:02:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.008+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b6f290 0x55ae16b6f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.009+0000 7f5428e8c700 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b6f290 0x55ae16b6f6a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bafe1fce17c17c6 server_cookie=2cbeec72a22fa1cb in_seq=0 out_seq=0 2024-05-09T01:02:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.009+0000 7f5403fff700 10 client.25061 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:02:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.009+0000 7f5403fff700 1 -- 172.21.15.37:0/3239075822 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5414005c60 con 0x55ae16b6f290 2024-05-09T01:02:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.009+0000 7f5403fff700 10 client.25061 handle_command_reply: tid=0 2024-05-09T01:02:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.009+0000 7f5439b06b80 1 client.25061 shutdown 2024-05-09T01:02:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.010+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae169e04a0 msgr2=0x55ae16b64bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.010+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae169e04a0 0x55ae16b64bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f540c001eb0 tx=0x7f540c009a70 comp rx=0 tx=0).stop 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 shutdown_connections 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ae16b63a30 0x55ae16b63e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ae16b6f290 0x55ae16b6f6a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ae169e04a0 0x55ae16b64bd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5439b06b80 1 --2- 172.21.15.37:0/3239075822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae16b5d6a0 0x55ae16b634f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 >> 172.21.15.37:0/3239075822 conn(0x55ae16a406a0 msgr2=0x55ae16b62290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5403fff700 0 client.25061 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.011+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 shutdown_connections 2024-05-09T01:02:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.012+0000 7f5439b06b80 1 -- 172.21.15.37:0/3239075822 wait complete. 2024-05-09T01:02:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.012+0000 7f5439b06b80 20 client.25061 trim_cache size 0 max 16384 2024-05-09T01:02:55.014 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.013+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54100b2a90 msgr2=0x7f54100b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.013+0000 7f542b0f0700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54100b2a90 0x7f54100b4fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f541c0a8b20 tx=0x7f541c09d6f0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.013+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424110990 msgr2=0x7f542406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.013+0000 7f542b0f0700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424110990 0x7f542406eb00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f541c00b550 tx=0x7f541c00b910 comp rx=0 tx=0).stop 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.014+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 shutdown_connections 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.014+0000 7f542b0f0700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f54100b2a90 0x7f54100b4fa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.014+0000 7f542b0f0700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5424110990 0x7f542406eb00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.014+0000 7f542b0f0700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542410a960 0x7f5424075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.014+0000 7f542b0f0700 1 --2- 172.21.15.37:0/218233969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f542410b2b0 0x7f542406e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.014+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 >> 172.21.15.37:0/218233969 conn(0x7f5424076d30 msgr2=0x7f5424109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.014+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 shutdown_connections 2024-05-09T01:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:55.015+0000 7f542b0f0700 1 -- 172.21.15.37:0/218233969 wait complete. 2024-05-09T01:02:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 35.0 s, 4201.4 tps, lat 23.862 ms stddev 26.426 2024-05-09T01:02:55.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:02:56.162 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:02:56.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:56 smithi037 ceph-mon[30122]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 833 op/s 2024-05-09T01:02:56.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:56 smithi151 ceph-mon[34780]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 833 op/s 2024-05-09T01:02:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:56 smithi136 ceph-mon[34110]: pgmap v419: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 833 op/s 2024-05-09T01:02:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.125+0000 7fcde3ffa640 1 -- 172.21.15.37:0/3131458574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc109ba0 msgr2=0x7fcddc10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.125+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/3131458574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc109ba0 0x7fcddc10bfc0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4009ca0 tx=0x7fcdd402a8d0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.126+0000 7fcde3ffa640 1 -- 172.21.15.37:0/3131458574 shutdown_connections 2024-05-09T01:02:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.126+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/3131458574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc109ba0 0x7fcddc10bfc0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.126+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/3131458574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcddc104ea0 0x7fcddc1052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.126+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/3131458574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcddc103c60 0x7fcddc104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.126+0000 7fcde3ffa640 1 -- 172.21.15.37:0/3131458574 >> 172.21.15.37:0/3131458574 conn(0x7fcddc0fee50 msgr2=0x7fcddc101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.126+0000 7fcde3ffa640 1 -- 172.21.15.37:0/3131458574 shutdown_connections 2024-05-09T01:02:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.127+0000 7fcde3ffa640 1 -- 172.21.15.37:0/3131458574 wait complete. 2024-05-09T01:02:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.128+0000 7fcde3ffa640 1 Processor -- start 2024-05-09T01:02:57.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.128+0000 7fcde3ffa640 1 -- start start 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.128+0000 7fcde3ffa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc103c60 0x7fcddc1a0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde3ffa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcddc104ea0 0x7fcddc1a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde3ffa640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcddc109ba0 0x7fcddc1a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde1d96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc103c60 0x7fcddc1a0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde1d96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc103c60 0x7fcddc1a0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50756/0 (socket says 172.21.15.37:50756) 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde1d96640 1 -- 172.21.15.37:0/2558976050 learned_addr learned my addr 172.21.15.37:0/2558976050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde1595640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcddc104ea0 0x7fcddc1a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc076950 con 0x7fcddc103c60 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc0767d0 con 0x7fcddc104ea0 2024-05-09T01:02:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde2597640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcddc109ba0 0x7fcddc1a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.129+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc076ad0 con 0x7fcddc109ba0 2024-05-09T01:02:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.130+0000 7fcde1d96640 1 -- 172.21.15.37:0/2558976050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcddc109ba0 msgr2=0x7fcddc1a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.130+0000 7fcde1d96640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcddc109ba0 0x7fcddc1a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.130+0000 7fcde1d96640 1 -- 172.21.15.37:0/2558976050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcddc104ea0 msgr2=0x7fcddc1a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.130+0000 7fcde1d96640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcddc104ea0 0x7fcddc1a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.130+0000 7fcde1d96640 1 -- 172.21.15.37:0/2558976050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcddc1a8440 con 0x7fcddc103c60 2024-05-09T01:02:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.130+0000 7fcde1595640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcddc104ea0 0x7fcddc1a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:02:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.131+0000 7fcde1d96640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc103c60 0x7fcddc1a0900 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800d740 tx=0x7fcdd800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.132+0000 7fcdd2ffd640 1 -- 172.21.15.37:0/2558976050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8017070 con 0x7fcddc103c60 2024-05-09T01:02:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.132+0000 7fcdd2ffd640 1 -- 172.21.15.37:0/2558976050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdd800de50 con 0x7fcddc103c60 2024-05-09T01:02:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.132+0000 7fcdd2ffd640 1 -- 172.21.15.37:0/2558976050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8003c20 con 0x7fcddc103c60 2024-05-09T01:02:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.132+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcddc1a8730 con 0x7fcddc103c60 2024-05-09T01:02:57.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.132+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcddc1a8c30 con 0x7fcddc103c60 2024-05-09T01:02:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 Processor -- start 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 -- start start 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521216500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e492f0 0x565521216a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x56552121d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56552117a7c0 con 0x565520e514d0 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5655211160e0 con 0x565520e721b0 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.137+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x565521176780 con 0x565520e492f0 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521216500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde1595640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x56552121d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521216500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37828/0 (socket says 172.21.15.37:37828) 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 -- 172.21.15.37:0/632906452 learned_addr learned my addr 172.21.15.37:0/632906452 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:57.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde1595640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x56552121d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50764/0 (socket says 172.21.15.37:50764) 2024-05-09T01:02:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 -- 172.21.15.37:0/632906452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e492f0 msgr2=0x565521216a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:02:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 --2- 172.21.15.37:0/632906452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e492f0 0x565521216a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 -- 172.21.15.37:0/632906452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 msgr2=0x56552121d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 --2- 172.21.15.37:0/632906452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x56552121d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.138+0000 7fcde2597640 1 -- 172.21.15.37:0/632906452 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552113f7c0 con 0x565520e721b0 2024-05-09T01:02:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.139+0000 7fcde2597640 1 --2- 172.21.15.37:0/632906452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521216500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4035000 tx=0x7fcdd40094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c667457bb26ba433 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:57.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.139+0000 7fcdc7fff640 1 -- 172.21.15.37:0/632906452 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4031d40 con 0x565520e721b0 2024-05-09T01:02:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.139+0000 7fcdc7fff640 1 -- 172.21.15.37:0/632906452 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdd4036070 con 0x565520e721b0 2024-05-09T01:02:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.139+0000 7fcdc7fff640 1 -- 172.21.15.37:0/632906452 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4031d40 con 0x565520e721b0 2024-05-09T01:02:57.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.139+0000 7fcdd2ffd640 1 -- 172.21.15.37:0/2558976050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcdd8003dc0 con 0x7fcddc103c60 2024-05-09T01:02:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.141+0000 7fcdd2ffd640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcdc80b2860 0x7fcdc80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.141+0000 7fcdeaf83740 1 -- 172.21.15.37:0/632906452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 msgr2=0x565521216500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.141+0000 7fcdd2ffd640 1 -- 172.21.15.37:0/2558976050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcdd80e1b40 con 0x7fcddc103c60 2024-05-09T01:02:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.141+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/632906452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521216500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4035000 tx=0x7fcdd40094a0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.141+0000 7fcde1d96640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcdc80b2860 0x7fcdc80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.142+0000 7fcdeaf83740 1 -- 172.21.15.37:0/632906452 shutdown_connections 2024-05-09T01:02:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.142+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/632906452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x56552121d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.142+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/632906452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e492f0 0x565521216a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.142+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/632906452 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521216500 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.142+0000 7fcdeaf83740 1 -- 172.21.15.37:0/632906452 >> 172.21.15.37:0/632906452 conn(0x565520e66300 msgr2=0x565521211e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.142+0000 7fcde1d96640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcdc80b2860 0x7fcdc80b4d70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80a91a0 tx=0x7fcdd80a8c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.143+0000 7fcdeaf83740 1 -- 172.21.15.37:0/632906452 shutdown_connections 2024-05-09T01:02:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.143+0000 7fcdeaf83740 1 -- 172.21.15.37:0/632906452 wait complete. 2024-05-09T01:02:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.144+0000 7fcdeaf83740 1 -- start start 2024-05-09T01:02:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.144+0000 7fcdeaf83740 1 Processor -- start 2024-05-09T01:02:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e492f0 0x565521220120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x565521220660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e721b0 0x5655212275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56552121e370 con 0x565520e514d0 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5655211019c0 con 0x565520e492f0 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56552121e4f0 con 0x565520e721b0 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcdeaf83740 10 client.0 _ll_register_callbacks cb 0x56552112e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcde1595640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x565521220660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcde1595640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x565521220660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50776/0 (socket says 172.21.15.37:50776) 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcde1595640 1 -- 172.21.15.37:0/2253018298 learned_addr learned my addr 172.21.15.37:0/2253018298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.145+0000 7fcde2597640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e492f0 0x565521220120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.146+0000 7fcde2597640 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e721b0 0x5655212275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.146+0000 7fcde2597640 1 -- 172.21.15.37:0/2253018298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e721b0 msgr2=0x5655212275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.146+0000 7fcde2597640 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e721b0 0x5655212275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.146+0000 7fcde2597640 1 -- 172.21.15.37:0/2253018298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 msgr2=0x565521220660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.146+0000 7fcde2597640 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x565521220660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.146+0000 7fcde2597640 1 -- 172.21.15.37:0/2253018298 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655211281f0 con 0x565520e492f0 2024-05-09T01:02:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.146+0000 7fcde2597640 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e492f0 0x565521220120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40319e0 tx=0x7fcdd40099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc51f086fdc7fe18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.147+0000 7fcdc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.147+0000 7fcdc57fa640 1 -- 172.21.15.37:0/2253018298 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4031d40 con 0x565520e492f0 2024-05-09T01:02:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.147+0000 7fcdc57fa640 1 -- 172.21.15.37:0/2253018298 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcdd4004420 con 0x565520e492f0 2024-05-09T01:02:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.147+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdd4036070 con 0x565520e492f0 2024-05-09T01:02:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.148+0000 7fcdc57fa640 1 -- 172.21.15.37:0/2253018298 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcdd4004620 con 0x565520e492f0 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.148+0000 7fcdeaf83740 10 client.25073 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.148+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565520edd790 con 0x565520e492f0 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.148+0000 7fcdc57fa640 1 -- 172.21.15.37:0/2253018298 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdd4036070 con 0x565520e492f0 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcdc57fa640 1 -- 172.21.15.37:0/2253018298 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fcdd4043020 con 0x565520e492f0 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcdeaf83740 10 client.25073 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcdeaf83740 10 client.25073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcdeaf83740 20 client.25073 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e30d80 0x56552122d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcdeaf83740 4 client.25073 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5655211883d0 con 0x565520e30d80 2024-05-09T01:02:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.149+0000 7fcde1595640 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e30d80 0x56552122d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.150+0000 7fcde1595640 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e30d80 0x56552122d6c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe1e04aad1146fa server_cookie=43faedc10e33c91e in_seq=0 out_seq=0 2024-05-09T01:02:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.150+0000 7fcdc57fa640 10 client.25073 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.151+0000 7fcdc57fa640 1 -- 172.21.15.37:0/2253018298 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5655211883d0 con 0x565520e30d80 2024-05-09T01:02:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.151+0000 7fcdc57fa640 10 client.25073 handle_command_reply: tid=0 2024-05-09T01:02:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.151+0000 7fcdeaf83740 1 client.25073 shutdown 2024-05-09T01:02:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.152+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e492f0 msgr2=0x565521220120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.152+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e492f0 0x565521220120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40319e0 tx=0x7fcdd40099f0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.153+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 shutdown_connections 2024-05-09T01:02:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.153+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e30d80 0x56552122d6c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.153+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e721b0 0x5655212275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.153+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e514d0 0x565521220660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.153+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2253018298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e492f0 0x565521220120 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.153+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 >> 172.21.15.37:0/2253018298 conn(0x565520e66300 msgr2=0x565521214da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:57.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.153+0000 7fcdc57fa640 0 client.25073 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.154+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 shutdown_connections 2024-05-09T01:02:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.154+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2253018298 wait complete. 2024-05-09T01:02:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.155+0000 7fcdeaf83740 20 client.25073 trim_cache size 0 max 16384 2024-05-09T01:02:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.182+0000 7fcdeaf83740 1 Processor -- start 2024-05-09T01:02:57.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.182+0000 7fcdeaf83740 1 -- start start 2024-05-09T01:02:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x56552121a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521227550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x56552121aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc1b18a0 con 0x565520e492f0 2024-05-09T01:02:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc1b34d0 con 0x565520e721b0 2024-05-09T01:02:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcdeaf83740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc1b1f70 con 0x565520e514d0 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcde1595640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521227550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcde1595640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521227550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57556/0 (socket says 172.21.15.37:57556) 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcde1595640 1 -- 172.21.15.37:0/2722846064 learned_addr learned my addr 172.21.15.37:0/2722846064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.183+0000 7fcde2597640 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x56552121a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.184+0000 7fcde2597640 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x56552121aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.184+0000 7fcde1595640 1 -- 172.21.15.37:0/2722846064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 msgr2=0x56552121aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.184+0000 7fcde1595640 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x56552121aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.184+0000 7fcde1595640 1 -- 172.21.15.37:0/2722846064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 msgr2=0x56552121a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.184+0000 7fcde1595640 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x56552121a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.184+0000 7fcde1595640 1 -- 172.21.15.37:0/2722846064 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565520f545f0 con 0x565520e514d0 2024-05-09T01:02:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.184+0000 7fcde1595640 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521227550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x56552122ddc0 tx=0x7fcdcc00b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab35b5cbf9cd32d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.185+0000 7fcdc77fe640 1 -- 172.21.15.37:0/2722846064 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc004220 con 0x565520e514d0 2024-05-09T01:02:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.185+0000 7fcdc77fe640 1 -- 172.21.15.37:0/2722846064 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdcc0043c0 con 0x565520e514d0 2024-05-09T01:02:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.185+0000 7fcdc77fe640 1 -- 172.21.15.37:0/2722846064 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0047a0 con 0x565520e514d0 2024-05-09T01:02:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2722846064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 msgr2=0x565521227550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521227550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x56552122ddc0 tx=0x7fcdcc00b390 comp rx=0 tx=0).stop 2024-05-09T01:02:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2722846064 shutdown_connections 2024-05-09T01:02:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x56552121aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521227550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/2722846064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x56552121a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2722846064 >> 172.21.15.37:0/2722846064 conn(0x565520e66300 msgr2=0x56552121e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2722846064 shutdown_connections 2024-05-09T01:02:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.186+0000 7fcdeaf83740 1 -- 172.21.15.37:0/2722846064 wait complete. 2024-05-09T01:02:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.187+0000 7fcdeaf83740 1 -- start start 2024-05-09T01:02:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.187+0000 7fcdeaf83740 1 Processor -- start 2024-05-09T01:02:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x565521224650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521224b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcdeaf83740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521293a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcde1595640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521224b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcde1595640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521224b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57558/0 (socket says 172.21.15.37:57558) 2024-05-09T01:02:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcde1595640 1 -- 172.21.15.37:0/4202920110 learned_addr learned my addr 172.21.15.37:0/4202920110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc1b2d40 con 0x565520e492f0 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcde2597640 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521293a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc1b2670 con 0x565520e721b0 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.188+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcddc1af880 con 0x565520e514d0 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.189+0000 7fcdeaf83740 10 client.0 _ll_register_callbacks cb 0x7fcdd4031460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.189+0000 7fcde2597640 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x565521224650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.189+0000 7fcde2597640 1 -- 172.21.15.37:0/4202920110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 msgr2=0x565521224b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.189+0000 7fcde2597640 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521224b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.189+0000 7fcde2597640 1 -- 172.21.15.37:0/4202920110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 msgr2=0x565521224650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.190+0000 7fcde2597640 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x565521224650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.190+0000 7fcde2597640 1 -- 172.21.15.37:0/4202920110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552113eed0 con 0x565520e721b0 2024-05-09T01:02:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.190+0000 7fcde2597640 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521293a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcdd402f6e0 tx=0x7fcdd4005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab23f0dedccce45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.191+0000 7fcdc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:02:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.191+0000 7fcdc57fa640 1 -- 172.21.15.37:0/4202920110 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd402fe00 con 0x565520e721b0 2024-05-09T01:02:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.191+0000 7fcdc57fa640 1 -- 172.21.15.37:0/4202920110 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcdd4031b40 con 0x565520e721b0 2024-05-09T01:02:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.192+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdcc0043c0 con 0x565520e721b0 2024-05-09T01:02:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.192+0000 7fcdc57fa640 1 -- 172.21.15.37:0/4202920110 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcdd4068050 con 0x565520e721b0 2024-05-09T01:02:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.192+0000 7fcdeaf83740 10 client.25079 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.192+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x565521294fa0 con 0x565520e721b0 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.193+0000 7fcdc57fa640 1 -- 172.21.15.37:0/4202920110 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdd4036040 con 0x565520e721b0 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.193+0000 7fcdc57fa640 1 -- 172.21.15.37:0/4202920110 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fcdd4043070 con 0x565520e721b0 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.193+0000 7fcdeaf83740 10 client.25079 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.193+0000 7fcdeaf83740 10 client.25079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.193+0000 7fcdeaf83740 20 client.25079 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.193+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e061c0 0x565521297a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.194+0000 7fcdeaf83740 4 client.25079 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:02:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.194+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fcdcc0043c0 con 0x565520e061c0 2024-05-09T01:02:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.194+0000 7fcde1595640 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e061c0 0x565521297a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.195+0000 7fcde1595640 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e061c0 0x565521297a50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f924eed3eae756fa server_cookie=41354d279fe4cd67 in_seq=0 out_seq=0 2024-05-09T01:02:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.196+0000 7fcdc57fa640 10 client.25079 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.229+0000 7fcdc57fa640 1 -- 172.21.15.37:0/4202920110 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fcdcc0043c0 con 0x565520e061c0 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.229+0000 7fcdc57fa640 10 client.25079 handle_command_reply: tid=0 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.229+0000 7fcdeaf83740 1 client.25079 shutdown 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.229+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 msgr2=0x565521293a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.229+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521293a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcdd402f6e0 tx=0x7fcdd4005fd0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 shutdown_connections 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x565520e061c0 0x565521297a50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x565520e721b0 0x565521293a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565520e514d0 0x565521224b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 --2- 172.21.15.37:0/4202920110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565520e492f0 0x565521224650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 >> 172.21.15.37:0/4202920110 conn(0x565520e66300 msgr2=0x56552121e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdc57fa640 0 client.25079 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 shutdown_connections 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 1 -- 172.21.15.37:0/4202920110 wait complete. 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.230+0000 7fcdeaf83740 20 client.25079 trim_cache size 0 max 16384 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:02:57.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.231+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcdc80b2860 msgr2=0x7fcdc80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.231+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcdc80b2860 0x7fcdc80b4d70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80a91a0 tx=0x7fcdd80a8c90 comp rx=0 tx=0).stop 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc103c60 msgr2=0x7fcddc1a0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc103c60 0x7fcddc1a0900 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800d740 tx=0x7fcdd800dc00 comp rx=0 tx=0).stop 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 shutdown_connections 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcddc109ba0 0x7fcddc1a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcdc80b2860 0x7fcdc80b4d70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcddc104ea0 0x7fcddc1a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 --2- 172.21.15.37:0/2558976050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcddc103c60 0x7fcddc1a0900 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 >> 172.21.15.37:0/2558976050 conn(0x7fcddc0fee50 msgr2=0x7fcddc105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 shutdown_connections 2024-05-09T01:02:57.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:02:57.232+0000 7fcde3ffa640 1 -- 172.21.15.37:0/2558976050 wait complete. 2024-05-09T01:02:58.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:02:58 smithi037 ceph-mon[30122]: pgmap v420: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 944 op/s 2024-05-09T01:02:58.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:02:58 smithi151 ceph-mon[34780]: pgmap v420: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 944 op/s 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.580+0000 7f82ef9a0700 1 -- 172.21.15.37:0/1717631494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e8111bd0 msgr2=0x7f82e8111fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.580+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/1717631494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e8111bd0 0x7f82e8111fe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f82e40098f0 tx=0x7f82e4009c00 comp rx=0 tx=0).stop 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.580+0000 7f82ef9a0700 1 -- 172.21.15.37:0/1717631494 shutdown_connections 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.580+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/1717631494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e810b280 0x7f82e81198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.580+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/1717631494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e8111bd0 0x7f82e8111fe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.580+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/1717631494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e810a930 0x7f82e810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.580+0000 7f82ef9a0700 1 -- 172.21.15.37:0/1717631494 >> 172.21.15.37:0/1717631494 conn(0x7f82e806f4d0 msgr2=0x7f82e806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:58.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.581+0000 7f82ef9a0700 1 -- 172.21.15.37:0/1717631494 shutdown_connections 2024-05-09T01:02:58.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.581+0000 7f82ef9a0700 1 -- 172.21.15.37:0/1717631494 wait complete. 2024-05-09T01:02:58.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 Processor -- start 2024-05-09T01:02:58.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 -- start start 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e810a930 0x7f82e81af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e810b280 0x7f82e81afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8111bd0 0x7f82e81a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82e811aba0 con 0x7f82e8111bd0 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82e811aa20 con 0x7f82e810a930 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.582+0000 7f82ef9a0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82e811ad20 con 0x7f82e810b280 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8111bd0 0x7f82e81a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8111bd0 0x7f82e81a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50802/0 (socket says 172.21.15.37:50802) 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 -- 172.21.15.37:0/2511246580 learned_addr learned my addr 172.21.15.37:0/2511246580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e810b280 0x7f82e81afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82ed73c700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e810a930 0x7f82e81af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 -- 172.21.15.37:0/2511246580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e810b280 msgr2=0x7f82e81afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e810b280 0x7f82e81afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 -- 172.21.15.37:0/2511246580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e810a930 msgr2=0x7f82e81af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e810a930 0x7f82e81af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.583+0000 7f82edf3d700 1 -- 172.21.15.37:0/2511246580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e81aa1f0 con 0x7f82e8111bd0 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.584+0000 7f82edf3d700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8111bd0 0x7f82e81a9af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f82e00062a0 tx=0x7f82e0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.584+0000 7f82da7fc700 1 -- 172.21.15.37:0/2511246580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0004db0 con 0x7f82e8111bd0 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.584+0000 7f82da7fc700 1 -- 172.21.15.37:0/2511246580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82e000d9f0 con 0x7f82e8111bd0 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.584+0000 7f82da7fc700 1 -- 172.21.15.37:0/2511246580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e00045c0 con 0x7f82e8111bd0 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.584+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e81aa4e0 con 0x7f82e8111bd0 2024-05-09T01:02:58.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.584+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e81a1210 con 0x7f82e8111bd0 2024-05-09T01:02:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.589+0000 7f82da7fc700 1 -- 172.21.15.37:0/2511246580 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f82e0003a00 con 0x7f82e8111bd0 2024-05-09T01:02:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.589+0000 7f82fe3b6b80 1 Processor -- start 2024-05-09T01:02:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82fe3b6b80 1 -- start start 2024-05-09T01:02:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266b0d00 0x5616267b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266364a0 0x5616267b9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616267b3400 0x5616267b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616266d60a0 con 0x5616266b0d00 2024-05-09T01:02:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56162667b9a0 con 0x5616267b3400 2024-05-09T01:02:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5616266d2060 con 0x5616266364a0 2024-05-09T01:02:58.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82ecf3b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266b0d00 0x5616267b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82ecf3b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266b0d00 0x5616267b9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50818/0 (socket says 172.21.15.37:50818) 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82ecf3b700 1 -- 172.21.15.37:0/1303025141 learned_addr learned my addr 172.21.15.37:0/1303025141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.590+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616267b3400 0x5616267b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.591+0000 7f82ecf3b700 1 -- 172.21.15.37:0/1303025141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266364a0 msgr2=0x5616267b9780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.591+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266364a0 0x5616267b9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.591+0000 7f82ecf3b700 1 -- 172.21.15.37:0/1303025141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616267b3400 msgr2=0x5616267b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.591+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616267b3400 0x5616267b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.591+0000 7f82ecf3b700 1 -- 172.21.15.37:0/1303025141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162666c500 con 0x5616266b0d00 2024-05-09T01:02:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.591+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266b0d00 0x5616267b9240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00bf00 tx=0x7f82dc00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b2ec8b3cc68e7f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.592+0000 7f82d37fe700 1 -- 172.21.15.37:0/1303025141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc004830 con 0x5616266b0d00 2024-05-09T01:02:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.592+0000 7f82d37fe700 1 -- 172.21.15.37:0/1303025141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc005020 con 0x5616266b0d00 2024-05-09T01:02:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.592+0000 7f82d37fe700 1 -- 172.21.15.37:0/1303025141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc010660 con 0x5616266b0d00 2024-05-09T01:02:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.593+0000 7f82da7fc700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d40b2a10 0x7f82d40b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.593+0000 7f82ed73c700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d40b2a10 0x7f82d40b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.593+0000 7f82da7fc700 1 -- 172.21.15.37:0/2511246580 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82e00e1770 con 0x7f82e8111bd0 2024-05-09T01:02:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.594+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/1303025141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266b0d00 msgr2=0x5616267b9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.594+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266b0d00 0x5616267b9240 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00bf00 tx=0x7f82dc00b810 comp rx=0 tx=0).stop 2024-05-09T01:02:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.594+0000 7f82ed73c700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d40b2a10 0x7f82d40b4f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f82e40098c0 tx=0x7f82e4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/1303025141 shutdown_connections 2024-05-09T01:02:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616267b3400 0x5616267b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266b0d00 0x5616267b9240 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/1303025141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266364a0 0x5616267b9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/1303025141 >> 172.21.15.37:0/1303025141 conn(0x561626639f70 msgr2=0x5616267ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/1303025141 shutdown_connections 2024-05-09T01:02:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/1303025141 wait complete. 2024-05-09T01:02:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.595+0000 7f82fe3b6b80 1 -- start start 2024-05-09T01:02:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 1 Processor -- start 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266364a0 0x5616267bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266b0d00 0x5616267bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616267b3400 0x5616267bda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616267b4160 con 0x5616267b3400 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561626670b20 con 0x5616266364a0 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5616267c0020 con 0x5616266b0d00 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.596+0000 7f82fe3b6b80 10 client.0 _ll_register_callbacks cb 0x5616265476c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82edf3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616267b3400 0x5616267bda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ecf3b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266b0d00 0x5616267bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ecf3b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266b0d00 0x5616267bd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57594/0 (socket says 172.21.15.37:57594) 2024-05-09T01:02:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ecf3b700 1 -- 172.21.15.37:0/2109522490 learned_addr learned my addr 172.21.15.37:0/2109522490 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ed73c700 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266364a0 0x5616267bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ecf3b700 1 -- 172.21.15.37:0/2109522490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266364a0 msgr2=0x5616267bcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266364a0 0x5616267bcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ecf3b700 1 -- 172.21.15.37:0/2109522490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616267b3400 msgr2=0x5616267bda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.597+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616267b3400 0x5616267bda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.598+0000 7f82ecf3b700 1 -- 172.21.15.37:0/2109522490 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561626551490 con 0x5616266b0d00 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.598+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266b0d00 0x5616267bd510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82dc005400 tx=0x7f82dc005430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d945c166002488d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.598+0000 7f82d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.598+0000 7f82d0ff9700 1 -- 172.21.15.37:0/2109522490 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc027060 con 0x5616266b0d00 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.598+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82dc005020 con 0x5616266b0d00 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.598+0000 7f82d0ff9700 1 -- 172.21.15.37:0/2109522490 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82dc004440 con 0x5616266b0d00 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.599+0000 7f82d0ff9700 1 -- 172.21.15.37:0/2109522490 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f82dc005650 con 0x5616266b0d00 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.599+0000 7f82fe3b6b80 10 client.25102 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:58.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.599+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5616267ca9b0 con 0x5616266b0d00 2024-05-09T01:02:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.600+0000 7f82d0ff9700 1 -- 172.21.15.37:0/2109522490 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc005020 con 0x5616266b0d00 2024-05-09T01:02:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.600+0000 7f82d0ff9700 1 -- 172.21.15.37:0/2109522490 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f82dc02c070 con 0x5616266b0d00 2024-05-09T01:02:58.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.601+0000 7f82fe3b6b80 10 client.25102 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.601+0000 7f82fe3b6b80 10 client.25102 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:02:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.601+0000 7f82fe3b6b80 20 client.25102 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.601+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5616267ccf30 0x5616267cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.601+0000 7f82fe3b6b80 4 client.25102 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:02:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.601+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616266e3a80 con 0x5616267ccf30 2024-05-09T01:02:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.601+0000 7f82ed73c700 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5616267ccf30 0x5616267cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.602+0000 7f82ed73c700 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5616267ccf30 0x5616267cf350 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1abadc5558c4d4f server_cookie=4fda0c69a962eb80 in_seq=0 out_seq=0 2024-05-09T01:02:58.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.604+0000 7f82d0ff9700 10 client.25102 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:02:58.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.604+0000 7f82d0ff9700 1 -- 172.21.15.37:0/2109522490 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5616266e3a80 con 0x5616267ccf30 2024-05-09T01:02:58.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.604+0000 7f82d0ff9700 10 client.25102 handle_command_reply: tid=0 2024-05-09T01:02:58.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.604+0000 7f82fe3b6b80 1 client.25102 shutdown 2024-05-09T01:02:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.604+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266b0d00 msgr2=0x5616267bd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.604+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266b0d00 0x5616267bd510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82dc005400 tx=0x7f82dc005430 comp rx=0 tx=0).stop 2024-05-09T01:02:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 shutdown_connections 2024-05-09T01:02:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5616267ccf30 0x5616267cf350 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616267b3400 0x5616267bda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266364a0 0x5616267bcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2109522490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616266b0d00 0x5616267bd510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 >> 172.21.15.37:0/2109522490 conn(0x561626639f70 msgr2=0x5616267a7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:58.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82d0ff9700 0 client.25102 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:02:58.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 shutdown_connections 2024-05-09T01:02:58.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.605+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2109522490 wait complete. 2024-05-09T01:02:58.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.606+0000 7f82fe3b6b80 20 client.25102 trim_cache size 0 max 16384 2024-05-09T01:02:58.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:02:58 smithi136 ceph-mon[34110]: pgmap v420: 97 pgs: 97 active+clean; 1.0 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 944 op/s 2024-05-09T01:02:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.635+0000 7f82fe3b6b80 1 Processor -- start 2024-05-09T01:02:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.636+0000 7f82fe3b6b80 1 -- start start 2024-05-09T01:02:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81a84c0 con 0x5616266364a0 2024-05-09T01:02:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81c7e50 con 0x5616266b0d00 2024-05-09T01:02:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82fe3b6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81a8b90 con 0x5616267b3400 2024-05-09T01:02:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82edf3d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82edf3d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267a8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57604/0 (socket says 172.21.15.37:57604) 2024-05-09T01:02:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82edf3d700 1 -- 172.21.15.37:0/2578025843 learned_addr learned my addr 172.21.15.37:0/2578025843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.637+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82edf3d700 1 -- 172.21.15.37:0/2578025843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 msgr2=0x5616267bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82edf3d700 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82edf3d700 1 -- 172.21.15.37:0/2578025843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 msgr2=0x5616267bc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82edf3d700 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82edf3d700 1 -- 172.21.15.37:0/2578025843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616267aa9d0 con 0x5616267b3400 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82edf3d700 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267a8700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82e00a8a90 tx=0x7f82e00e1040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac60a695495cbc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82d2ffd700 1 -- 172.21.15.37:0/2578025843 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e001d030 con 0x5616267b3400 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82d2ffd700 1 -- 172.21.15.37:0/2578025843 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82e00a8d90 con 0x5616267b3400 2024-05-09T01:02:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.638+0000 7f82d2ffd700 1 -- 172.21.15.37:0/2578025843 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0004780 con 0x5616267b3400 2024-05-09T01:02:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2578025843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 msgr2=0x5616267a8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267a8700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f82e00a8a90 tx=0x7f82e00e1040 comp rx=0 tx=0).stop 2024-05-09T01:02:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2578025843 shutdown_connections 2024-05-09T01:02:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267a8700 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267bc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/2578025843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2578025843 >> 172.21.15.37:0/2578025843 conn(0x561626639f70 msgr2=0x5616267a7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.641+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2578025843 shutdown_connections 2024-05-09T01:02:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.642+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/2578025843 wait complete. 2024-05-09T01:02:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.643+0000 7f82fe3b6b80 1 -- start start 2024-05-09T01:02:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.643+0000 7f82fe3b6b80 1 Processor -- start 2024-05-09T01:02:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.644+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267c0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.644+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82ed73c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82fe3b6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267c4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82ed73c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267c0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50834/0 (socket says 172.21.15.37:50834) 2024-05-09T01:02:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82ed73c700 1 -- 172.21.15.37:0/3516401388 learned_addr learned my addr 172.21.15.37:0/3516401388 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:02:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81c7770 con 0x5616266364a0 2024-05-09T01:02:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82edf3d700 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267c4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82ecf3b700 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81a9290 con 0x5616266b0d00 2024-05-09T01:02:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82e81a6500 con 0x5616267b3400 2024-05-09T01:02:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.645+0000 7f82fe3b6b80 10 client.0 _ll_register_callbacks cb 0x5616265476c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:02:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82edf3d700 1 -- 172.21.15.37:0/3516401388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 msgr2=0x5616267c0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82edf3d700 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267c0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82edf3d700 1 -- 172.21.15.37:0/3516401388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 msgr2=0x5616267c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82edf3d700 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267c0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82edf3d700 1 -- 172.21.15.37:0/3516401388 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616267afe60 con 0x5616267b3400 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82edf3d700 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267c4ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82e0004b80 tx=0x7f82e000d8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b10fb754b95dfebc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82d0ff9700 1 -- 172.21.15.37:0/3516401388 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e001d040 con 0x5616267b3400 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82d0ff9700 1 -- 172.21.15.37:0/3516401388 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82e000dba0 con 0x5616267b3400 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.646+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82e00a8d90 con 0x5616267b3400 2024-05-09T01:02:58.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.647+0000 7f82d0ff9700 1 -- 172.21.15.37:0/3516401388 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f82e0004780 con 0x5616267b3400 2024-05-09T01:02:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.647+0000 7f82fe3b6b80 10 client.25108 fetch_fsmap learned FSMap version 32 2024-05-09T01:02:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.647+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561626836c30 con 0x5616267b3400 2024-05-09T01:02:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82d0ff9700 1 -- 172.21.15.37:0/3516401388 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82e00b1760 con 0x5616267b3400 2024-05-09T01:02:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82d0ff9700 1 -- 172.21.15.37:0/3516401388 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f82e00a7a60 con 0x5616267b3400 2024-05-09T01:02:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82fe3b6b80 10 client.25108 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:02:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82fe3b6b80 10 client.25108 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:02:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82fe3b6b80 20 client.25108 populate_metadata read hostname 'smithi037' 2024-05-09T01:02:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x561626837130 0x561626839550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:02:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82fe3b6b80 4 client.25108 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:02:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f82e00a8d90 con 0x561626837130 2024-05-09T01:02:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.648+0000 7f82ed73c700 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x561626837130 0x561626839550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:02:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.649+0000 7f82d0ff9700 10 client.25108 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:02:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.649+0000 7f82ed73c700 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x561626837130 0x561626839550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2d1896351df93be0 server_cookie=84b9819fcaf66a4a in_seq=0 out_seq=0 2024-05-09T01:02:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.649+0000 7f82d0ff9700 1 -- 172.21.15.37:0/3516401388 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f82e00a8d90 con 0x561626837130 2024-05-09T01:02:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.649+0000 7f82d0ff9700 10 client.25108 handle_command_reply: tid=0 2024-05-09T01:02:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.649+0000 7f82fe3b6b80 1 client.25108 shutdown 2024-05-09T01:02:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.651+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 msgr2=0x5616267c4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.651+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267c4ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f82e0004b80 tx=0x7f82e000d8a0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.653+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 shutdown_connections 2024-05-09T01:02:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.653+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x561626837130 0x561626839550 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.653+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616267b3400 0x5616267c4ba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.653+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616266364a0 0x5616267c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.653+0000 7f82fe3b6b80 1 --2- 172.21.15.37:0/3516401388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616266b0d00 0x5616267c0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.653+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 >> 172.21.15.37:0/3516401388 conn(0x561626639f70 msgr2=0x5616267a8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.653+0000 7f82d0ff9700 0 client.25108 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:02:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.654+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 shutdown_connections 2024-05-09T01:02:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.654+0000 7f82fe3b6b80 1 -- 172.21.15.37:0/3516401388 wait complete. 2024-05-09T01:02:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.654+0000 7f82fe3b6b80 20 client.25108 trim_cache size 0 max 16384 2024-05-09T01:02:58.655 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d40b2a10 msgr2=0x7f82d40b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d40b2a10 0x7f82d40b4f20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f82e40098c0 tx=0x7f82e4019040 comp rx=0 tx=0).stop 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8111bd0 msgr2=0x7f82e81a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8111bd0 0x7f82e81a9af0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f82e00062a0 tx=0x7f82e0007f90 comp rx=0 tx=0).stop 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 shutdown_connections 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d40b2a10 0x7f82d40b4f20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82e8111bd0 0x7f82e81a9af0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82e810a930 0x7f82e81af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 --2- 172.21.15.37:0/2511246580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e810b280 0x7f82e81afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:02:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 >> 172.21.15.37:0/2511246580 conn(0x7f82e806f4d0 msgr2=0x7f82e8110550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:02:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 shutdown_connections 2024-05-09T01:02:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:02:58.656+0000 7f82ef9a0700 1 -- 172.21.15.37:0/2511246580 wait complete. 2024-05-09T01:02:59.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:02:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 40.0 s, 4961.8 tps, lat 20.128 ms stddev 20.816 2024-05-09T01:03:00.376 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:00 smithi037 ceph-mon[30122]: pgmap v421: 97 pgs: 97 active+clean; 1014 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 18 MiB/s wr, 855 op/s 2024-05-09T01:03:00.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:00 smithi151 ceph-mon[34780]: pgmap v421: 97 pgs: 97 active+clean; 1014 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 18 MiB/s wr, 855 op/s 2024-05-09T01:03:00.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:00 smithi136 ceph-mon[34110]: pgmap v421: 97 pgs: 97 active+clean; 1014 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 18 MiB/s wr, 855 op/s 2024-05-09T01:03:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.897+0000 7f3eed924700 1 -- 172.21.15.37:0/2350295432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee810c2f0 msgr2=0x7f3ee8116b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.897+0000 7f3eed924700 1 --2- 172.21.15.37:0/2350295432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee810c2f0 0x7f3ee8116b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009990 tx=0x7f3edc009ca0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.898+0000 7f3eed924700 1 -- 172.21.15.37:0/2350295432 shutdown_connections 2024-05-09T01:03:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.898+0000 7f3eed924700 1 --2- 172.21.15.37:0/2350295432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee8117120 0x7f3ee81195e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.898+0000 7f3eed924700 1 --2- 172.21.15.37:0/2350295432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 0x7f3ee810bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.898+0000 7f3eed924700 1 --2- 172.21.15.37:0/2350295432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee810c2f0 0x7f3ee8116b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.898+0000 7f3eed924700 1 -- 172.21.15.37:0/2350295432 >> 172.21.15.37:0/2350295432 conn(0x7f3ee806f8f0 msgr2=0x7f3ee806fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.898+0000 7f3eed924700 1 -- 172.21.15.37:0/2350295432 shutdown_connections 2024-05-09T01:03:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.898+0000 7f3eed924700 1 -- 172.21.15.37:0/2350295432 wait complete. 2024-05-09T01:03:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.899+0000 7f3eed924700 1 Processor -- start 2024-05-09T01:03:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.900+0000 7f3eed924700 1 -- start start 2024-05-09T01:03:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.900+0000 7f3eed924700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 0x7f3ee81aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.900+0000 7f3eed924700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee810c2f0 0x7f3ee81aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.900+0000 7f3eed924700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee8117120 0x7f3ee81b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3eed924700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee811cd90 con 0x7f3ee810b9a0 2024-05-09T01:03:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3eed924700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee811cc10 con 0x7f3ee8117120 2024-05-09T01:03:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3eed924700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee811cf10 con 0x7f3ee810c2f0 2024-05-09T01:03:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 0x7f3ee81aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 0x7f3ee81aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34688/0 (socket says 172.21.15.37:34688) 2024-05-09T01:03:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1227072806 learned_addr learned my addr 172.21.15.37:0/1227072806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee67fc700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee810c2f0 0x7f3ee81aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee8117120 0x7f3ee81b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1227072806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee810c2f0 msgr2=0x7f3ee81aafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee810c2f0 0x7f3ee81aafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1227072806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee8117120 msgr2=0x7f3ee81b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee8117120 0x7f3ee81b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1227072806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee81b6030 con 0x7f3ee810b9a0 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.901+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee8117120 0x7f3ee81b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.902+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 0x7f3ee81aaa70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800e9a0 tx=0x7f3ed800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:01.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.903+0000 7f3eec922700 1 -- 172.21.15.37:0/1227072806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800ca10 con 0x7f3ee810b9a0 2024-05-09T01:03:01.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.903+0000 7f3eec922700 1 -- 172.21.15.37:0/1227072806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ed800cbb0 con 0x7f3ee810b9a0 2024-05-09T01:03:01.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.903+0000 7f3eec922700 1 -- 172.21.15.37:0/1227072806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8018680 con 0x7f3ee810b9a0 2024-05-09T01:03:01.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.904+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee81b6200 con 0x7f3ee810b9a0 2024-05-09T01:03:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.904+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee81b6660 con 0x7f3ee810b9a0 2024-05-09T01:03:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.911+0000 7f3eec922700 1 -- 172.21.15.37:0/1227072806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3ed8010430 con 0x7f3ee810b9a0 2024-05-09T01:03:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.911+0000 7f3efc33ab80 1 Processor -- start 2024-05-09T01:03:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.912+0000 7f3eec922700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ed00b2a90 0x7f3ed00b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.913+0000 7f3eec922700 1 -- 172.21.15.37:0/1227072806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3ed80e22d0 con 0x7f3ee810b9a0 2024-05-09T01:03:01.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.916+0000 7f3efc33ab80 1 -- start start 2024-05-09T01:03:01.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.916+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bb74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.917+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bb7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.917+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bb1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.917+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d801ad3ff0 con 0x55d801a344a0 2024-05-09T01:03:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.917+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d801a727f0 con 0x55d801bb16a0 2024-05-09T01:03:01.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.917+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d801acffb0 con 0x55d801b1e160 2024-05-09T01:03:01.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.918+0000 7f3ee6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bb74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.918+0000 7f3ee6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bb74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40070/0 (socket says 172.21.15.37:40070) 2024-05-09T01:03:01.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.918+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1573321397 learned_addr learned my addr 172.21.15.37:0/1573321397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:01.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1573321397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 msgr2=0x55d801bb1ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:03:01.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/1573321397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bb1ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1573321397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 msgr2=0x55d801bb7a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:03:01.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/1573321397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bb7a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/1573321397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d801a6a370 con 0x55d801b1e160 2024-05-09T01:03:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/1573321397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bb74f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80a9880 tx=0x7f3ed80a9370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a672009df347bf98 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ed00b2a90 0x7f3ed00b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ecdffb700 1 -- 172.21.15.37:0/1573321397 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a5050 con 0x55d801b1e160 2024-05-09T01:03:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ecdffb700 1 -- 172.21.15.37:0/1573321397 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ed80a98f0 con 0x55d801b1e160 2024-05-09T01:03:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.919+0000 7f3ecdffb700 1 -- 172.21.15.37:0/1573321397 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80b2520 con 0x55d801b1e160 2024-05-09T01:03:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.921+0000 7f3efc33ab80 1 -- 172.21.15.37:0/1573321397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 msgr2=0x55d801bb74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.922+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/1573321397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bb74f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80a9880 tx=0x7f3ed80a9370 comp rx=0 tx=0).stop 2024-05-09T01:03:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.922+0000 7f3efc33ab80 1 -- 172.21.15.37:0/1573321397 shutdown_connections 2024-05-09T01:03:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.922+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/1573321397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bb1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.922+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/1573321397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bb74f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.922+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/1573321397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bb7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.922+0000 7f3efc33ab80 1 -- 172.21.15.37:0/1573321397 >> 172.21.15.37:0/1573321397 conn(0x55d801a946a0 msgr2=0x55d801bac400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:01.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.924+0000 7f3efc33ab80 1 -- 172.21.15.37:0/1573321397 shutdown_connections 2024-05-09T01:03:01.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.924+0000 7f3efc33ab80 1 -- 172.21.15.37:0/1573321397 wait complete. 2024-05-09T01:03:01.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.925+0000 7f3efc33ab80 1 -- start start 2024-05-09T01:03:01.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.925+0000 7f3efc33ab80 1 Processor -- start 2024-05-09T01:03:01.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bbb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bbb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d80194fba0 con 0x55d801a344a0 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d801a8e150 con 0x55d801bb16a0 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d801bbe1d0 con 0x55d801b1e160 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3efc33ab80 10 client.0 _ll_register_callbacks cb 0x55d8019456c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3ee67fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bbb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3ee67fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bbb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40078/0 (socket says 172.21.15.37:40078) 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3ee67fc700 1 -- 172.21.15.37:0/3784821717 learned_addr learned my addr 172.21.15.37:0/3784821717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ed00b2a90 0x7f3ed00b4fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55d801bb80c0 tx=0x7f3ee000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.926+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bbb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee67fc700 1 -- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 msgr2=0x55d801bbbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee67fc700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee67fc700 1 -- 172.21.15.37:0/3784821717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 msgr2=0x55d801bbb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee67fc700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bbb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee67fc700 1 -- 172.21.15.37:0/3784821717 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d80194f490 con 0x55d801b1e160 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:01.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bbb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:01.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ee67fc700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bbb750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009990 tx=0x7f3edc005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1309728956934be server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:01.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.927+0000 7f3ec6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.928+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3784821717 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc003680 con 0x55d801b1e160 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.928+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3784821717 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3edc003820 con 0x55d801b1e160 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.928+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ed80a98f0 con 0x55d801b1e160 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.928+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3784821717 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3edc003a20 con 0x55d801b1e160 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.928+0000 7f3efc33ab80 10 client.25117 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.928+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d801bc8bf0 con 0x55d801b1e160 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3784821717 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ed80a98f0 con 0x55d801b1e160 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3784821717 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f3edc00fbb0 con 0x55d801b1e160 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3efc33ab80 10 client.25117 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3efc33ab80 10 client.25117 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3efc33ab80 20 client.25117 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801bcb550 0x55d801bcda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3efc33ab80 4 client.25117 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:01.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.929+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d801ae19d0 con 0x55d801bcb550 2024-05-09T01:03:01.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.930+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801bcb550 0x55d801bcda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.932+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801bcb550 0x55d801bcda20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20a1b98bb0b2a998 server_cookie=66ea8bebc567a662 in_seq=0 out_seq=0 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.932+0000 7f3ec6ffd700 10 client.25117 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.932+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3784821717 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d801ae19d0 con 0x55d801bcb550 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.932+0000 7f3ec6ffd700 10 client.25117 handle_command_reply: tid=0 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.932+0000 7f3efc33ab80 1 client.25117 shutdown 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 msgr2=0x55d801bbb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bbb750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009990 tx=0x7f3edc005810 comp rx=0 tx=0).stop 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 shutdown_connections 2024-05-09T01:03:01.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801bcb550 0x55d801bcda20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bbb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3784821717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801b1e160 0x55d801bbb750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 >> 172.21.15.37:0/3784821717 conn(0x55d801a946a0 msgr2=0x55d801bac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3ec6ffd700 0 client.25117 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 shutdown_connections 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3784821717 wait complete. 2024-05-09T01:03:01.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.933+0000 7f3efc33ab80 20 client.25117 trim_cache size 0 max 16384 2024-05-09T01:03:01.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.960+0000 7f3efc33ab80 1 Processor -- start 2024-05-09T01:03:01.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.960+0000 7f3efc33ab80 1 -- start start 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.960+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801a344a0 0x55d801bb5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.960+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801b1e160 0x55d801bb6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.960+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81bda20 con 0x55d801b1e160 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81bf650 con 0x55d801bb16a0 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81be0f0 con 0x55d801a344a0 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3ee6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801a344a0 0x55d801bb5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3ee6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801a344a0 0x55d801bb5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40080/0 (socket says 172.21.15.37:40080) 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/3294889076 learned_addr learned my addr 172.21.15.37:0/3294889076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3ee67fc700 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801b1e160 0x55d801bb6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/3294889076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 msgr2=0x55d801bbbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.961+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/3294889076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801b1e160 msgr2=0x55d801bb6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801b1e160 0x55d801bb6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ee6ffd700 1 -- 172.21.15.37:0/3294889076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d801bad110 con 0x55d801a344a0 2024-05-09T01:03:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ee67fc700 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801b1e160 0x55d801bb6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801a344a0 0x55d801bb5830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c2d0 tx=0x7f3ed80a9240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cabab280250f24 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ecd7fa700 1 -- 172.21.15.37:0/3294889076 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed80a98f0 con 0x55d801a344a0 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ecd7fa700 1 -- 172.21.15.37:0/3294889076 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ed80cc0d0 con 0x55d801a344a0 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.962+0000 7f3ecd7fa700 1 -- 172.21.15.37:0/3294889076 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8010720 con 0x55d801a344a0 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.963+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3294889076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801a344a0 msgr2=0x55d801bb5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.963+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801a344a0 0x55d801bb5830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800c2d0 tx=0x7f3ed80a9240 comp rx=0 tx=0).stop 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3294889076 shutdown_connections 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801bb16a0 0x55d801bbbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801a344a0 0x55d801bb5830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3294889076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801b1e160 0x55d801bb6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3294889076 >> 172.21.15.37:0/3294889076 conn(0x55d801a946a0 msgr2=0x55d801bb0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3294889076 shutdown_connections 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3294889076 wait complete. 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.964+0000 7f3efc33ab80 1 -- start start 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.965+0000 7f3efc33ab80 1 Processor -- start 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.965+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bc3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.965+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801b1e160 0x55d801bc6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3efc33ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801bb16a0 0x55d801bc67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81beec0 con 0x55d801a344a0 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81be7f0 con 0x55d801b1e160 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3efc33ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee81bb9e0 con 0x55d801bb16a0 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bc3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3efc33ab80 10 client.0 _ll_register_callbacks cb 0x55d8019456c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801bb16a0 0x55d801bc67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801bb16a0 0x55d801bc67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40096/0 (socket says 172.21.15.37:40096) 2024-05-09T01:03:01.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 -- 172.21.15.37:0/3341950088 learned_addr learned my addr 172.21.15.37:0/3341950088 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee67fc700 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801b1e160 0x55d801bc6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 -- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801b1e160 msgr2=0x55d801bc6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801b1e160 0x55d801bc6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 -- 172.21.15.37:0/3341950088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 msgr2=0x55d801bc3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bc3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.966+0000 7f3ee77fe700 1 -- 172.21.15.37:0/3341950088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d801bc6d00 con 0x55d801bb16a0 2024-05-09T01:03:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.967+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bc3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.968+0000 7f3ee77fe700 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801bb16a0 0x55d801bc67c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000d010 tx=0x7f3ee0004b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa7e214dd38d889 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.968+0000 7f3ec6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.968+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3341950088 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0021840 con 0x55d801bb16a0 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.968+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3341950088 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3ee00219e0 con 0x55d801bb16a0 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.968+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ed80cc0d0 con 0x55d801bb16a0 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.968+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3341950088 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3ee000ae20 con 0x55d801bb16a0 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.969+0000 7f3efc33ab80 10 client.25123 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:01.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.969+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d801c468b0 con 0x55d801bb16a0 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3341950088 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ed80cc0d0 con 0x55d801bb16a0 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3341950088 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f3ee00223e0 con 0x55d801bb16a0 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3efc33ab80 10 client.25123 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3efc33ab80 10 client.25123 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3efc33ab80 20 client.25123 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801c46ff0 0x55d801c49410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3efc33ab80 4 client.25123 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.970+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d801adba70 con 0x55d801c46ff0 2024-05-09T01:03:01.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.971+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801c46ff0 0x55d801c49410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.973+0000 7f3ec6ffd700 10 client.25123 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:03:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.973+0000 7f3ee6ffd700 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801c46ff0 0x55d801c49410 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64ec82ffb3684c1f server_cookie=e7ba1bf7b81f7bdf in_seq=0 out_seq=0 2024-05-09T01:03:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.974+0000 7f3ec6ffd700 1 -- 172.21.15.37:0/3341950088 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d801adba70 con 0x55d801c46ff0 2024-05-09T01:03:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.974+0000 7f3ec6ffd700 10 client.25123 handle_command_reply: tid=0 2024-05-09T01:03:01.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.974+0000 7f3efc33ab80 1 client.25123 shutdown 2024-05-09T01:03:01.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.974+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801bb16a0 msgr2=0x55d801bc67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.974+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801bb16a0 0x55d801bc67c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ee000d010 tx=0x7f3ee0004b80 comp rx=0 tx=0).stop 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.975+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 shutdown_connections 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.975+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d801bb16a0 0x55d801bc67c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.975+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d801c46ff0 0x55d801c49410 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.975+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d801a344a0 0x55d801bc3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.975+0000 7f3efc33ab80 1 --2- 172.21.15.37:0/3341950088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d801b1e160 0x55d801bc6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.975+0000 7f3ec6ffd700 0 client.25123 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.975+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 >> 172.21.15.37:0/3341950088 conn(0x55d801a946a0 msgr2=0x55d801bb5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:01.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.976+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 shutdown_connections 2024-05-09T01:03:01.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.977+0000 7f3efc33ab80 1 -- 172.21.15.37:0/3341950088 wait complete. 2024-05-09T01:03:01.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.977+0000 7f3efc33ab80 20 client.25123 trim_cache size 0 max 16384 2024-05-09T01:03:01.978 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:03:01.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ed00b2a90 msgr2=0x7f3ed00b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ed00b2a90 0x7f3ed00b4fa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55d801bb80c0 tx=0x7f3ee000d040 comp rx=0 tx=0).stop 2024-05-09T01:03:01.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 msgr2=0x7f3ee81aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 0x7f3ee81aaa70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800e9a0 tx=0x7f3ed800ecb0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 shutdown_connections 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ed00b2a90 0x7f3ed00b4fa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ee8117120 0x7f3ee81b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ee810b9a0 0x7f3ee81aaa70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 --2- 172.21.15.37:0/1227072806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee810c2f0 0x7f3ee81aafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.978+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 >> 172.21.15.37:0/1227072806 conn(0x7f3ee806f8f0 msgr2=0x7f3ee8073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.979+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 shutdown_connections 2024-05-09T01:03:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:01.979+0000 7f3eed924700 1 -- 172.21.15.37:0/1227072806 wait complete. 2024-05-09T01:03:02.227 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:02 smithi037 ceph-mon[30122]: pgmap v422: 97 pgs: 97 active+clean; 1014 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 17 MiB/s wr, 860 op/s 2024-05-09T01:03:02.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:02 smithi151 ceph-mon[34780]: pgmap v422: 97 pgs: 97 active+clean; 1014 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 17 MiB/s wr, 860 op/s 2024-05-09T01:03:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:02 smithi136 ceph-mon[34110]: pgmap v422: 97 pgs: 97 active+clean; 1014 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 17 MiB/s wr, 860 op/s 2024-05-09T01:03:02.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:03:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:04.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:04 smithi037 ceph-mon[30122]: pgmap v423: 97 pgs: 97 active+clean; 1019 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 18 MiB/s wr, 933 op/s 2024-05-09T01:03:04.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:04 smithi151 ceph-mon[34780]: pgmap v423: 97 pgs: 97 active+clean; 1019 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 18 MiB/s wr, 933 op/s 2024-05-09T01:03:04.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:04 smithi136 ceph-mon[34110]: pgmap v423: 97 pgs: 97 active+clean; 1019 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 18 MiB/s wr, 933 op/s 2024-05-09T01:03:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 45.0 s, 5472.6 tps, lat 18.248 ms stddev 18.703 2024-05-09T01:03:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.510+0000 7fae2959a700 1 -- 172.21.15.37:0/957835422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14003be0 con 0x7fae2c1034c0 2024-05-09T01:03:05.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.511+0000 7fae30d53700 1 -- 172.21.15.37:0/957835422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 msgr2=0x7fae2c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.511+0000 7fae30d53700 1 --2- 172.21.15.37:0/957835422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 0x7fae2c1038d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fae140099c0 tx=0x7fae14009cd0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.513+0000 7fae30d53700 1 -- 172.21.15.37:0/957835422 shutdown_connections 2024-05-09T01:03:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.513+0000 7fae30d53700 1 --2- 172.21.15.37:0/957835422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 0x7fae2c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.513+0000 7fae30d53700 1 --2- 172.21.15.37:0/957835422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 0x7fae2c1038d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.513+0000 7fae30d53700 1 --2- 172.21.15.37:0/957835422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae2c107df0 0x7fae2c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.513+0000 7fae30d53700 1 -- 172.21.15.37:0/957835422 >> 172.21.15.37:0/957835422 conn(0x7fae2c0fedc0 msgr2=0x7fae2c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.513+0000 7fae30d53700 1 -- 172.21.15.37:0/957835422 shutdown_connections 2024-05-09T01:03:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.513+0000 7fae30d53700 1 -- 172.21.15.37:0/957835422 wait complete. 2024-05-09T01:03:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.514+0000 7fae30d53700 1 Processor -- start 2024-05-09T01:03:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.514+0000 7fae30d53700 1 -- start start 2024-05-09T01:03:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae30d53700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 0x7fae2c19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae30d53700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae2c107df0 0x7fae2c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae30d53700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 0x7fae2c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae30d53700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c113410 con 0x7fae2c1034c0 2024-05-09T01:03:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae30d53700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c113290 con 0x7fae2c108740 2024-05-09T01:03:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae30d53700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c113590 con 0x7fae2c107df0 2024-05-09T01:03:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae2ad9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 0x7fae2c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae2c107df0 0x7fae2c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae2ad9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 0x7fae2c199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52098/0 (socket says 172.21.15.37:52098) 2024-05-09T01:03:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.515+0000 7fae2ad9d700 1 -- 172.21.15.37:0/1776519659 learned_addr learned my addr 172.21.15.37:0/1776519659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.516+0000 7fae2a59c700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 0x7fae2c19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.516+0000 7fae2ad9d700 1 -- 172.21.15.37:0/1776519659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae2c107df0 msgr2=0x7fae2c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.516+0000 7fae2ad9d700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae2c107df0 0x7fae2c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.516+0000 7fae2ad9d700 1 -- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 msgr2=0x7fae2c19f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.516+0000 7fae2ad9d700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 0x7fae2c19f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.516+0000 7fae2ad9d700 1 -- 172.21.15.37:0/1776519659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c19a0c0 con 0x7fae2c108740 2024-05-09T01:03:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.517+0000 7fae2ad9d700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 0x7fae2c199a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fae24007e60 tx=0x7fae2400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.517+0000 7fae237fe700 1 -- 172.21.15.37:0/1776519659 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24016070 con 0x7fae2c108740 2024-05-09T01:03:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.517+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c19a3b0 con 0x7fae2c108740 2024-05-09T01:03:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.517+0000 7fae237fe700 1 -- 172.21.15.37:0/1776519659 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae2400cd80 con 0x7fae2c108740 2024-05-09T01:03:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.517+0000 7fae237fe700 1 -- 172.21.15.37:0/1776519659 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae24012990 con 0x7fae2c108740 2024-05-09T01:03:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.517+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c06b610 con 0x7fae2c108740 2024-05-09T01:03:05.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.525+0000 7fae3f769b80 1 Processor -- start 2024-05-09T01:03:05.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.525+0000 7fae237fe700 1 -- 172.21.15.37:0/1776519659 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fae2400c8d0 con 0x7fae2c108740 2024-05-09T01:03:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.525+0000 7fae3f769b80 1 -- start start 2024-05-09T01:03:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.526+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.526+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.526+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.526+0000 7fae3f769b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f0cfdb0a0 con 0x556f0cfb5d00 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.526+0000 7fae3f769b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556f0cf809a0 con 0x556f0d0bc810 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.526+0000 7fae3f769b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556f0cfd7060 con 0x556f0cf3b4a0 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.526+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0bcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52112/0 (socket says 172.21.15.37:52112) 2024-05-09T01:03:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 -- 172.21.15.37:0/2961992065 learned_addr learned my addr 172.21.15.37:0/2961992065 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:05.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae237fe700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fae180b2980 0x7fae180b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae2a59c700 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 -- 172.21.15.37:0/2961992065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 msgr2=0x556f0d0c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 -- 172.21.15.37:0/2961992065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 msgr2=0x556f0d0c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.527+0000 7fae29d9b700 1 -- 172.21.15.37:0/2961992065 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0cf71500 con 0x556f0d0bc810 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.528+0000 7fae237fe700 1 -- 172.21.15.37:0/1776519659 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fae2400e4b0 con 0x7fae2c108740 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.528+0000 7fae2ad9d700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fae180b2980 0x7fae180b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.528+0000 7fae29d9b700 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0bcc20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fae1c012560 tx=0x7fae1c0073d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a5f6e0054ea5a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.529+0000 7fae20ff9700 1 -- 172.21.15.37:0/2961992065 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c004a30 con 0x556f0d0bc810 2024-05-09T01:03:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.529+0000 7fae20ff9700 1 -- 172.21.15.37:0/2961992065 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c0054d0 con 0x556f0d0bc810 2024-05-09T01:03:05.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.529+0000 7fae20ff9700 1 -- 172.21.15.37:0/2961992065 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c004a30 con 0x556f0d0bc810 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae3f769b80 1 -- 172.21.15.37:0/2961992065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 msgr2=0x556f0d0bcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0bcc20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fae1c012560 tx=0x7fae1c0073d0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae2ad9d700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fae180b2980 0x7fae180b4e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae240ab000 tx=0x7fae24007bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae3f769b80 1 -- 172.21.15.37:0/2961992065 shutdown_connections 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0bcc20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2961992065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.530+0000 7fae3f769b80 1 -- 172.21.15.37:0/2961992065 >> 172.21.15.37:0/2961992065 conn(0x556f0cf3ef70 msgr2=0x556f0d0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.531+0000 7fae3f769b80 1 -- 172.21.15.37:0/2961992065 shutdown_connections 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.531+0000 7fae3f769b80 1 -- 172.21.15.37:0/2961992065 wait complete. 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.531+0000 7fae3f769b80 1 -- start start 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 1 Processor -- start 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f0d0bd570 con 0x556f0cfb5d00 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556f0cf75b20 con 0x556f0d0bc810 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556f0d0c9430 con 0x556f0cf3b4a0 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.532+0000 7fae3f769b80 10 client.0 _ll_register_callbacks cb 0x556f0ce4c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34746/0 (socket says 172.21.15.37:34746) 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 -- 172.21.15.37:0/2891889182 learned_addr learned my addr 172.21.15.37:0/2891889182 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 -- 172.21.15.37:0/2891889182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 msgr2=0x556f0d0c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 -- 172.21.15.37:0/2891889182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 msgr2=0x556f0d0c6e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0c6e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.533+0000 7fae2a59c700 1 -- 172.21.15.37:0/2891889182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0ce56490 con 0x556f0cfb5d00 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.534+0000 7fae2a59c700 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fae14006010 tx=0x7fae14003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522cf96bc4a3b81c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.534+0000 7fae11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:03:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.534+0000 7fae11ffb700 1 -- 172.21.15.37:0/2891889182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1400b990 con 0x556f0cfb5d00 2024-05-09T01:03:05.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.534+0000 7fae11ffb700 1 -- 172.21.15.37:0/2891889182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fae1400bb30 con 0x556f0cfb5d00 2024-05-09T01:03:05.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.534+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1c0054d0 con 0x556f0cfb5d00 2024-05-09T01:03:05.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.535+0000 7fae11ffb700 1 -- 172.21.15.37:0/2891889182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fae140095d0 con 0x556f0cfb5d00 2024-05-09T01:03:05.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.535+0000 7fae3f769b80 10 client.15387 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:05.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.535+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556f0d0d3dc0 con 0x556f0cfb5d00 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.535+0000 7fae11ffb700 1 -- 172.21.15.37:0/2891889182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae14027070 con 0x556f0cfb5d00 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.535+0000 7fae11ffb700 1 -- 172.21.15.37:0/2891889182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fae1400fcc0 con 0x556f0cfb5d00 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.536+0000 7fae3f769b80 10 client.15387 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.536+0000 7fae3f769b80 10 client.15387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.536+0000 7fae3f769b80 20 client.15387 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.536+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0d64a0 0x556f0d0d88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.536+0000 7fae3f769b80 4 client.15387 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.536+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fae1c0054d0 con 0x556f0d0d64a0 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.536+0000 7fae29d9b700 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0d64a0 0x556f0d0d88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.537+0000 7fae11ffb700 10 client.15387 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.538+0000 7fae29d9b700 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0d64a0 0x556f0d0d88c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=491580a3a10c2b53 server_cookie=7ff6564b8b5fa179 in_seq=0 out_seq=0 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.539+0000 7fae11ffb700 1 -- 172.21.15.37:0/2891889182 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fae1c0054d0 con 0x556f0d0d64a0 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.539+0000 7fae11ffb700 10 client.15387 handle_command_reply: tid=0 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.539+0000 7fae3f769b80 1 client.15387 shutdown 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 msgr2=0x556f0d0c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fae14006010 tx=0x7fae14003f90 comp rx=0 tx=0).stop 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 shutdown_connections 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0d64a0 0x556f0d0d88c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0d0bc810 0x556f0d0c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 --2- 172.21.15.37:0/2891889182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6920 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 >> 172.21.15.37:0/2891889182 conn(0x556f0cf3ef70 msgr2=0x556f0d0acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae11ffb700 0 client.15387 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 shutdown_connections 2024-05-09T01:03:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 1 -- 172.21.15.37:0/2891889182 wait complete. 2024-05-09T01:03:05.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.540+0000 7fae3f769b80 20 client.15387 trim_cache size 0 max 16384 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.570+0000 7fae3f769b80 1 Processor -- start 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.570+0000 7fae3f769b80 1 -- start start 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae3f769b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1ac740 con 0x556f0cf3b4a0 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae3f769b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1ae370 con 0x556f0cfb5d00 2024-05-09T01:03:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae3f769b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1ace10 con 0x556f0d0bc810 2024-05-09T01:03:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40136/0 (socket says 172.21.15.37:40136) 2024-05-09T01:03:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.571+0000 7fae29d9b700 1 -- 172.21.15.37:0/3877888489 learned_addr learned my addr 172.21.15.37:0/3877888489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae29d9b700 1 -- 172.21.15.37:0/3877888489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 msgr2=0x556f0d0c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae29d9b700 1 --2- 172.21.15.37:0/3877888489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae29d9b700 1 -- 172.21.15.37:0/3877888489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 msgr2=0x556f0d0c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae29d9b700 1 --2- 172.21.15.37:0/3877888489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae29d9b700 1 -- 172.21.15.37:0/3877888489 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f0d0bd450 con 0x556f0d0bc810 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae29d9b700 1 --2- 172.21.15.37:0/3877888489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0ad700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae1c012500 tx=0x7fae1c005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f6a868f37a6c645 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae13fff700 1 -- 172.21.15.37:0/3877888489 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c004a30 con 0x556f0d0bc810 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae13fff700 1 -- 172.21.15.37:0/3877888489 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c0296e0 con 0x556f0d0bc810 2024-05-09T01:03:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.572+0000 7fae13fff700 1 -- 172.21.15.37:0/3877888489 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c010b20 con 0x556f0d0bc810 2024-05-09T01:03:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.574+0000 7fae3f769b80 1 -- 172.21.15.37:0/3877888489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 msgr2=0x556f0d0ad700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.574+0000 7fae3f769b80 1 --2- 172.21.15.37:0/3877888489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0ad700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae1c012500 tx=0x7fae1c005fd0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.574+0000 7fae3f769b80 1 -- 172.21.15.37:0/3877888489 shutdown_connections 2024-05-09T01:03:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.574+0000 7fae3f769b80 1 --2- 172.21.15.37:0/3877888489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0ad700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.574+0000 7fae3f769b80 1 --2- 172.21.15.37:0/3877888489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 0x556f0d0c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.574+0000 7fae3f769b80 1 --2- 172.21.15.37:0/3877888489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 0x556f0d0c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.574+0000 7fae3f769b80 1 -- 172.21.15.37:0/3877888489 >> 172.21.15.37:0/3877888489 conn(0x556f0cf3ef70 msgr2=0x556f0d0acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:05.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.576+0000 7fae3f769b80 1 -- 172.21.15.37:0/3877888489 shutdown_connections 2024-05-09T01:03:05.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.576+0000 7fae3f769b80 1 -- 172.21.15.37:0/3877888489 wait complete. 2024-05-09T01:03:05.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.577+0000 7fae3f769b80 1 -- start start 2024-05-09T01:03:05.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.577+0000 7fae3f769b80 1 Processor -- start 2024-05-09T01:03:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.578+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 0x556f0d0de480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.578+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 0x556f0d0dd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.578+0000 7fae3f769b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.578+0000 7fae3f769b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1adbe0 con 0x556f0cf3b4a0 2024-05-09T01:03:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.578+0000 7fae3f769b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1ad510 con 0x556f0cfb5d00 2024-05-09T01:03:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.578+0000 7fae3f769b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1aa6e0 con 0x556f0d0bc810 2024-05-09T01:03:05.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.578+0000 7fae3f769b80 10 client.0 _ll_register_callbacks cb 0x556f0ce4c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:05.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.581+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.581+0000 7fae29d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0dd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40152/0 (socket says 172.21.15.37:40152) 2024-05-09T01:03:05.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.581+0000 7fae29d9b700 1 -- 172.21.15.37:0/1789231274 learned_addr learned my addr 172.21.15.37:0/1789231274 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:05.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.582+0000 7fae2a59c700 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 0x556f0d0dd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.582+0000 7fae29d9b700 1 -- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 msgr2=0x556f0d0dd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:05.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.582+0000 7fae29d9b700 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 0x556f0d0dd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.582+0000 7fae29d9b700 1 -- 172.21.15.37:0/1789231274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 msgr2=0x556f0d0de480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:05.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.582+0000 7fae29d9b700 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 0x556f0d0de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.582+0000 7fae29d9b700 1 -- 172.21.15.37:0/1789231274 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0d0ddb30 con 0x556f0d0bc810 2024-05-09T01:03:05.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.583+0000 7fae29d9b700 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0dd5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fae1c007940 tx=0x7fae1c029890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=739197f5e8da8de6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:05.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.584+0000 7fae11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:05.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.584+0000 7fae11ffb700 1 -- 172.21.15.37:0/1789231274 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c03a060 con 0x556f0d0bc810 2024-05-09T01:03:05.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.584+0000 7fae11ffb700 1 -- 172.21.15.37:0/1789231274 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fae1c029430 con 0x556f0d0bc810 2024-05-09T01:03:05.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.584+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1c0296e0 con 0x556f0d0bc810 2024-05-09T01:03:05.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.584+0000 7fae11ffb700 1 -- 172.21.15.37:0/1789231274 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fae1c0107a0 con 0x556f0d0bc810 2024-05-09T01:03:05.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 10 client.25138 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556f0d0ce1c0 con 0x556f0d0bc810 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae11ffb700 1 -- 172.21.15.37:0/1789231274 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1c010df0 con 0x556f0d0bc810 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae11ffb700 1 -- 172.21.15.37:0/1789231274 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fae1c032bd0 con 0x556f0d0bc810 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 10 client.25138 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 10 client.25138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 20 client.25138 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0ce690 0x556f0d0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 4 client.25138 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:03:05.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.585+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fae1c0296e0 con 0x556f0d0ce690 2024-05-09T01:03:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.587+0000 7fae2a59c700 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0ce690 0x556f0d0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:05.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.587+0000 7fae2a59c700 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0ce690 0x556f0d0ceaa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fa1b65d851208b server_cookie=bc99c63bb4e6cffe in_seq=0 out_seq=0 2024-05-09T01:03:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae11ffb700 10 client.25138 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae11ffb700 1 -- 172.21.15.37:0/1789231274 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fae1c0296e0 con 0x556f0d0ce690 2024-05-09T01:03:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae11ffb700 10 client.25138 handle_command_reply: tid=0 2024-05-09T01:03:05.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 client.25138 shutdown 2024-05-09T01:03:05.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 msgr2=0x556f0d0dd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0dd5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fae1c007940 tx=0x7fae1c029890 comp rx=0 tx=0).stop 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 shutdown_connections 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f0d0ce690 0x556f0d0ceaa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f0d0bc810 0x556f0d0dd5f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f0cf3b4a0 0x556f0d0de480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 --2- 172.21.15.37:0/1789231274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f0cfb5d00 0x556f0d0dd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.588+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 >> 172.21.15.37:0/1789231274 conn(0x556f0cf3ef70 msgr2=0x556f0d0c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.589+0000 7fae11ffb700 0 client.25138 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.590+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 shutdown_connections 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.590+0000 7fae3f769b80 1 -- 172.21.15.37:0/1789231274 wait complete. 2024-05-09T01:03:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.590+0000 7fae3f769b80 20 client.25138 trim_cache size 0 max 16384 2024-05-09T01:03:05.592 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:03:05.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fae180b2980 msgr2=0x7fae180b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fae180b2980 0x7fae180b4e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fae240ab000 tx=0x7fae24007bc0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 msgr2=0x7fae2c199a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:05.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 0x7fae2c199a10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fae24007e60 tx=0x7fae2400c330 comp rx=0 tx=0).stop 2024-05-09T01:03:05.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 shutdown_connections 2024-05-09T01:03:05.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fae180b2980 0x7fae180b4e90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae2c108740 0x7fae2c199a10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae2c1034c0 0x7fae2c19f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 --2- 172.21.15.37:0/1776519659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae2c107df0 0x7fae2c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:05.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.591+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 >> 172.21.15.37:0/1776519659 conn(0x7fae2c0fedc0 msgr2=0x7fae2c107420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:05.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.592+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 shutdown_connections 2024-05-09T01:03:05.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:05.592+0000 7fae30d53700 1 -- 172.21.15.37:0/1776519659 wait complete. 2024-05-09T01:03:06.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:06 smithi037 ceph-mon[30122]: pgmap v424: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 957 op/s 2024-05-09T01:03:06.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:06 smithi151 ceph-mon[34780]: pgmap v424: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 957 op/s 2024-05-09T01:03:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:06 smithi136 ceph-mon[34110]: pgmap v424: 97 pgs: 97 active+clean; 1.0 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 15 MiB/s wr, 957 op/s 2024-05-09T01:03:07.436 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:03:07.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:03:07.823 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:08.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:08 smithi037 ceph-mon[30122]: pgmap v425: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 927 op/s 2024-05-09T01:03:08.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:08 smithi151 ceph-mon[34780]: pgmap v425: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 927 op/s 2024-05-09T01:03:08.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:08 smithi136 ceph-mon[34110]: pgmap v425: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 MiB/s wr, 927 op/s 2024-05-09T01:03:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 50.0 s, 5086.1 tps, lat 19.639 ms stddev 22.435 2024-05-09T01:03:10.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.258+0000 7f034559a700 1 -- 172.21.15.37:0/3952036484 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c017400 con 0x7f03481192c0 2024-05-09T01:03:10.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.260+0000 7f034cc4e700 1 -- 172.21.15.37:0/3952036484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03481192c0 msgr2=0x7f034811b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.260+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3952036484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03481192c0 0x7f034811b7d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f033c0098f0 tx=0x7f033c009c00 comp rx=0 tx=0).stop 2024-05-09T01:03:10.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.261+0000 7f034cc4e700 1 -- 172.21.15.37:0/3952036484 shutdown_connections 2024-05-09T01:03:10.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.261+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3952036484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03481192c0 0x7f034811b7d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.261+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3952036484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f034810abc0 0x7f034810afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.261+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3952036484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f034810b510 0x7f0348118c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.261+0000 7f034cc4e700 1 -- 172.21.15.37:0/3952036484 >> 172.21.15.37:0/3952036484 conn(0x7f034806f4d0 msgr2=0x7f034806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.263+0000 7f034cc4e700 1 -- 172.21.15.37:0/3952036484 shutdown_connections 2024-05-09T01:03:10.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.264+0000 7f034cc4e700 1 -- 172.21.15.37:0/3952036484 wait complete. 2024-05-09T01:03:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.265+0000 7f034cc4e700 1 Processor -- start 2024-05-09T01:03:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.265+0000 7f034cc4e700 1 -- start start 2024-05-09T01:03:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f034cc4e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f034810abc0 0x7f0348117680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f034cc4e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f034810b510 0x7f0348117be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f034cc4e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03481192c0 0x7f03481b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f034cc4e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f034810f470 con 0x7f034810b510 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f034cc4e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f034810f2f0 con 0x7f034810abc0 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f034cc4e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f034810f5f0 con 0x7f03481192c0 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f034659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f034810abc0 0x7f0348117680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f0346d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03481192c0 0x7f03481b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f0346d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03481192c0 0x7f03481b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40178/0 (socket says 172.21.15.37:40178) 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.266+0000 7f0346d9d700 1 -- 172.21.15.37:0/3237734755 learned_addr learned my addr 172.21.15.37:0/3237734755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.267+0000 7f0346d9d700 1 -- 172.21.15.37:0/3237734755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f034810abc0 msgr2=0x7f0348117680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.267+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f034810abc0 0x7f0348117680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.267+0000 7f0346d9d700 1 -- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f034810b510 msgr2=0x7f0348117be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.267+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f034810b510 0x7f0348117be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.267+0000 7f0346d9d700 1 -- 172.21.15.37:0/3237734755 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03481b5e60 con 0x7f03481192c0 2024-05-09T01:03:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.267+0000 7f034659c700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f034810abc0 0x7f0348117680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.267+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03481192c0 0x7f03481b57f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f033c009810 tx=0x7f033c00fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.268+0000 7f03377fe700 1 -- 172.21.15.37:0/3237734755 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c00fbc0 con 0x7f03481192c0 2024-05-09T01:03:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.268+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03481b60f0 con 0x7f03481192c0 2024-05-09T01:03:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.268+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03481b6520 con 0x7f03481192c0 2024-05-09T01:03:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.268+0000 7f03377fe700 1 -- 172.21.15.37:0/3237734755 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f033c0056d0 con 0x7f03481192c0 2024-05-09T01:03:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.269+0000 7f03377fe700 1 -- 172.21.15.37:0/3237734755 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c004930 con 0x7f03481192c0 2024-05-09T01:03:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.273+0000 7f03377fe700 1 -- 172.21.15.37:0/3237734755 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f033c00bc20 con 0x7f03481192c0 2024-05-09T01:03:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.275+0000 7f03377fe700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f03300b2a10 0x7f03300b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.275+0000 7f03377fe700 1 -- 172.21.15.37:0/3237734755 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f033c0e2c40 con 0x7f03481192c0 2024-05-09T01:03:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.276+0000 7f034659c700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f03300b2a10 0x7f03300b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.277+0000 7f034659c700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f03300b2a10 0x7f03300b4f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f03400094b0 tx=0x7f034000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.277+0000 7f035b664b80 1 Processor -- start 2024-05-09T01:03:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.277+0000 7f035b664b80 1 -- start start 2024-05-09T01:03:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.279+0000 7f035b664b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f842c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.279+0000 7f035b664b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444e01520 0x55e444f84800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f035b664b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f7e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f035b664b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e444ea1120 con 0x55e444e01520 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f035b664b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e444e46a20 con 0x55e444e7bd80 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f035b664b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e444e9d0e0 con 0x55e444f7e480 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f034659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f842c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0345d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444e01520 0x55e444f84800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f034659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f842c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52156/0 (socket says 172.21.15.37:52156) 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0345d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444e01520 0x55e444f84800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34812/0 (socket says 172.21.15.37:34812) 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f034659c700 1 -- 172.21.15.37:0/3320638214 learned_addr learned my addr 172.21.15.37:0/3320638214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f7e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0346d9d700 1 -- 172.21.15.37:0/3320638214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 msgr2=0x55e444f842c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f842c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0346d9d700 1 -- 172.21.15.37:0/3320638214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444e01520 msgr2=0x55e444f84800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444e01520 0x55e444f84800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.280+0000 7f0346d9d700 1 -- 172.21.15.37:0/3320638214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e444e37580 con 0x55e444f7e480 2024-05-09T01:03:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.281+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f7e890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f033c0098c0 tx=0x7f033c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a0bbee8ea18c37f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.281+0000 7f0334ff9700 1 -- 172.21.15.37:0/3320638214 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0af6d0 con 0x55e444f7e480 2024-05-09T01:03:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.281+0000 7f0334ff9700 1 -- 172.21.15.37:0/3320638214 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f033c0b40f0 con 0x55e444f7e480 2024-05-09T01:03:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.281+0000 7f0334ff9700 1 -- 172.21.15.37:0/3320638214 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b3ec0 con 0x55e444f7e480 2024-05-09T01:03:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.282+0000 7f035b664b80 1 -- 172.21.15.37:0/3320638214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 msgr2=0x55e444f7e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.282+0000 7f035b664b80 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f7e890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f033c0098c0 tx=0x7f033c009c00 comp rx=0 tx=0).stop 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.283+0000 7f035b664b80 1 -- 172.21.15.37:0/3320638214 shutdown_connections 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.283+0000 7f035b664b80 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f7e890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.283+0000 7f035b664b80 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f842c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.283+0000 7f035b664b80 1 --2- 172.21.15.37:0/3320638214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444e01520 0x55e444f84800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.283+0000 7f035b664b80 1 -- 172.21.15.37:0/3320638214 >> 172.21.15.37:0/3320638214 conn(0x55e444e04ff0 msgr2=0x55e444f792a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.283+0000 7f035b664b80 1 -- 172.21.15.37:0/3320638214 shutdown_connections 2024-05-09T01:03:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.283+0000 7f035b664b80 1 -- 172.21.15.37:0/3320638214 wait complete. 2024-05-09T01:03:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.284+0000 7f035b664b80 1 -- start start 2024-05-09T01:03:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.284+0000 7f035b664b80 1 Processor -- start 2024-05-09T01:03:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.285+0000 7f035b664b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f8dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.285+0000 7f035b664b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f8e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.285+0000 7f035b664b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f7e480 0x55e444f87ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.285+0000 7f034659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f8dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.285+0000 7f034659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f8dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40184/0 (socket says 172.21.15.37:40184) 2024-05-09T01:03:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.285+0000 7f034659c700 1 -- 172.21.15.37:0/678161877 learned_addr learned my addr 172.21.15.37:0/678161877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e444f7f030 con 0x55e444f7e480 2024-05-09T01:03:10.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e444e3bba0 con 0x55e444e7bd80 2024-05-09T01:03:10.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e444f7f1b0 con 0x55e444e01520 2024-05-09T01:03:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f0345d9b700 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f8e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f035b664b80 10 client.0 _ll_register_callbacks cb 0x55e444d12740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f0345d9b700 1 -- 172.21.15.37:0/678161877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 msgr2=0x55e444f8dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f0345d9b700 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f8dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f0345d9b700 1 -- 172.21.15.37:0/678161877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f7e480 msgr2=0x55e444f87ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f0345d9b700 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f7e480 0x55e444f87ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f0345d9b700 1 -- 172.21.15.37:0/678161877 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e444d1c510 con 0x55e444e7bd80 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.286+0000 7f0345d9b700 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f8e130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55e444f7ad10 tx=0x7f033800bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d402489a73d3b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.287+0000 7f032dffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.287+0000 7f032dffb700 1 -- 172.21.15.37:0/678161877 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338003d40 con 0x55e444e7bd80 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.287+0000 7f032dffb700 1 -- 172.21.15.37:0/678161877 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f033801a470 con 0x55e444e7bd80 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.287+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f033c0b40f0 con 0x55e444e7bd80 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.287+0000 7f032dffb700 1 -- 172.21.15.37:0/678161877 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f033801a670 con 0x55e444e7bd80 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.288+0000 7f035b664b80 10 client.25124 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.288+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e444f95670 con 0x55e444e7bd80 2024-05-09T01:03:10.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.288+0000 7f032dffb700 1 -- 172.21.15.37:0/678161877 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0338015070 con 0x55e444e7bd80 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.288+0000 7f032dffb700 1 -- 172.21.15.37:0/678161877 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f03380118d0 con 0x55e444e7bd80 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f035b664b80 10 client.25124 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f035b664b80 10 client.25124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f035b664b80 20 client.25124 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f035b664b80 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e444f97c00 0x55e444f9a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f035b664b80 4 client.25124 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f033c0b40f0 con 0x55e444f97c00 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f034659c700 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e444f97c00 0x55e444f9a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.289+0000 7f034659c700 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e444f97c00 0x55e444f9a040 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78d5ec3fe5bcceb1 server_cookie=c9895f0d8d5cc19e in_seq=0 out_seq=0 2024-05-09T01:03:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.290+0000 7f032dffb700 10 client.25124 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.290+0000 7f032dffb700 1 -- 172.21.15.37:0/678161877 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f033c0b40f0 con 0x55e444f97c00 2024-05-09T01:03:10.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.290+0000 7f032dffb700 10 client.25124 handle_command_reply: tid=0 2024-05-09T01:03:10.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.291+0000 7f035b664b80 1 client.25124 shutdown 2024-05-09T01:03:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 msgr2=0x55e444f8e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f8e130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55e444f7ad10 tx=0x7f033800bca0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 shutdown_connections 2024-05-09T01:03:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e444f97c00 0x55e444f9a040 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f7e480 0x55e444f87ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f8dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 --2- 172.21.15.37:0/678161877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e7bd80 0x55e444f8e130 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55e444f7ad10 tx=0x7f033800bca0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 >> 172.21.15.37:0/678161877 conn(0x55e444e04ff0 msgr2=0x55e444f73070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.292+0000 7f032dffb700 0 client.25124 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.293+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 shutdown_connections 2024-05-09T01:03:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.293+0000 7f035b664b80 1 -- 172.21.15.37:0/678161877 wait complete. 2024-05-09T01:03:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.293+0000 7f035b664b80 20 client.25124 trim_cache size 0 max 16384 2024-05-09T01:03:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.332+0000 7f035b664b80 1 Processor -- start 2024-05-09T01:03:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.332+0000 7f035b664b80 1 -- start start 2024-05-09T01:03:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.333+0000 7f035b664b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f82780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.334 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:10 smithi037 ceph-mon[30122]: pgmap v426: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-05-09T01:03:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.333+0000 7f035b664b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444f7e480 0x55e444f88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.333+0000 7f035b664b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f9fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.333+0000 7f034659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f82780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.333+0000 7f034659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f82780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40198/0 (socket says 172.21.15.37:40198) 2024-05-09T01:03:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.333+0000 7f034659c700 1 -- 172.21.15.37:0/3802174771 learned_addr learned my addr 172.21.15.37:0/3802174771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f032800d2f0 con 0x55e444f9f840 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f032800ef20 con 0x55e444f7e480 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f0346d9d700 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f9fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f032800d9c0 con 0x55e444e01520 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f0345d9b700 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444f7e480 0x55e444f88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f0345d9b700 1 -- 172.21.15.37:0/3802174771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 msgr2=0x55e444f82780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f0345d9b700 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f82780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f0345d9b700 1 -- 172.21.15.37:0/3802174771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 msgr2=0x55e444f9fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f0345d9b700 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f9fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f0345d9b700 1 -- 172.21.15.37:0/3802174771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e444f797e0 con 0x55e444f7e480 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.334+0000 7f034659c700 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f82780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.335+0000 7f0345d9b700 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444f7e480 0x55e444f88580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55e444f890b0 tx=0x7f0338005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f5ccd74adf6b50e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.335+0000 7f032ffff700 1 -- 172.21.15.37:0/3802174771 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338024420 con 0x55e444f7e480 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.335+0000 7f032ffff700 1 -- 172.21.15.37:0/3802174771 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0338015070 con 0x55e444f7e480 2024-05-09T01:03:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.335+0000 7f032ffff700 1 -- 172.21.15.37:0/3802174771 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03380116a0 con 0x55e444f7e480 2024-05-09T01:03:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.337+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444f7e480 msgr2=0x55e444f88580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.337+0000 7f035b664b80 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444f7e480 0x55e444f88580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55e444f890b0 tx=0x7f0338005d20 comp rx=0 tx=0).stop 2024-05-09T01:03:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.337+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 shutdown_connections 2024-05-09T01:03:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.337+0000 7f035b664b80 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f9fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.337+0000 7f035b664b80 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444e01520 0x55e444f82780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.337+0000 7f035b664b80 1 --2- 172.21.15.37:0/3802174771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444f7e480 0x55e444f88580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.337+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 >> 172.21.15.37:0/3802174771 conn(0x55e444e04ff0 msgr2=0x55e444f837c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.338+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 shutdown_connections 2024-05-09T01:03:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.338+0000 7f035b664b80 1 -- 172.21.15.37:0/3802174771 wait complete. 2024-05-09T01:03:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.339+0000 7f035b664b80 1 -- start start 2024-05-09T01:03:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.339+0000 7f035b664b80 1 Processor -- start 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.339+0000 7f035b664b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e01520 0x55e444f93c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.339+0000 7f035b664b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f94140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f035b664b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f92190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f035b664b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f032800e790 con 0x55e444f9f840 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f035b664b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f032800e0c0 con 0x55e444e01520 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f035b664b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f032800b290 con 0x55e444f7e480 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f035b664b80 10 client.0 _ll_register_callbacks cb 0x55e444d12740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f0345d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f94140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f034659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e01520 0x55e444f93c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f034659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e01520 0x55e444f93c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52194/0 (socket says 172.21.15.37:52194) 2024-05-09T01:03:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f034659c700 1 -- 172.21.15.37:0/1752384920 learned_addr learned my addr 172.21.15.37:0/1752384920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.340+0000 7f0346d9d700 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f92190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f034659c700 1 -- 172.21.15.37:0/1752384920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 msgr2=0x55e444f94140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f034659c700 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f94140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f034659c700 1 -- 172.21.15.37:0/1752384920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 msgr2=0x55e444f92190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f034659c700 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f92190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f034659c700 1 -- 172.21.15.37:0/1752384920 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e444f927d0 con 0x55e444e01520 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f034659c700 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e01520 0x55e444f93c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0340004260 tx=0x7f0340004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d291d85a7fe24224 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f032dffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f032dffb700 1 -- 172.21.15.37:0/1752384920 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03400294d0 con 0x55e444e01520 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.341+0000 7f032dffb700 1 -- 172.21.15.37:0/1752384920 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0340029670 con 0x55e444e01520 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.342+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0338015070 con 0x55e444e01520 2024-05-09T01:03:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.342+0000 7f032dffb700 1 -- 172.21.15.37:0/1752384920 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0340029870 con 0x55e444e01520 2024-05-09T01:03:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.342+0000 7f035b664b80 10 client.25130 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.342+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e445002f40 con 0x55e444e01520 2024-05-09T01:03:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.342+0000 7f032dffb700 1 -- 172.21.15.37:0/1752384920 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0340029a10 con 0x55e444e01520 2024-05-09T01:03:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.342+0000 7f032dffb700 1 -- 172.21.15.37:0/1752384920 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f0340030020 con 0x55e444e01520 2024-05-09T01:03:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.343+0000 7f035b664b80 10 client.25130 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.343+0000 7f035b664b80 10 client.25130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.343+0000 7f035b664b80 20 client.25130 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.343+0000 7f035b664b80 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e4450036f0 0x55e445005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.343+0000 7f035b664b80 4 client.25130 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:03:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.343+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f0338015070 con 0x55e4450036f0 2024-05-09T01:03:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.343+0000 7f0345d9b700 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e4450036f0 0x55e445005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.344+0000 7f032dffb700 10 client.25130 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.344+0000 7f0345d9b700 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e4450036f0 0x55e445005b10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46b886bcde4ab720 server_cookie=5fd3be868db590eb in_seq=0 out_seq=0 2024-05-09T01:03:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.345+0000 7f032dffb700 1 -- 172.21.15.37:0/1752384920 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f0338015070 con 0x55e4450036f0 2024-05-09T01:03:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.345+0000 7f032dffb700 10 client.25130 handle_command_reply: tid=0 2024-05-09T01:03:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.345+0000 7f035b664b80 1 client.25130 shutdown 2024-05-09T01:03:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.346+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e01520 msgr2=0x55e444f93c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.346+0000 7f035b664b80 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e01520 0x55e444f93c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0340004260 tx=0x7f0340004ad0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 shutdown_connections 2024-05-09T01:03:10.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e4450036f0 0x55e445005b10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e444f9f840 0x55e444f92190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f032dffb700 0 client.25130 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e444e01520 0x55e444f93c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 --2- 172.21.15.37:0/1752384920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e444f7e480 0x55e444f94140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 >> 172.21.15.37:0/1752384920 conn(0x55e444e04ff0 msgr2=0x55e444f837c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 shutdown_connections 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 1 -- 172.21.15.37:0/1752384920 wait complete. 2024-05-09T01:03:10.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.347+0000 7f035b664b80 20 client.25130 trim_cache size 0 max 16384 2024-05-09T01:03:10.349 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:03:10.349 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:03:10.349 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "1d9d3f73-328a-49f5-a6e1-6c0ae1dafa57", 2024-05-09T01:03:10.349 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:03:10.349 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.348+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f03300b2a10 msgr2=0x7f03300b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.348+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f03300b2a10 0x7f03300b4f20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f03400094b0 tx=0x7f034000b040 comp rx=0 tx=0).stop 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.348+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03481192c0 msgr2=0x7f03481b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.348+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03481192c0 0x7f03481b57f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f033c009810 tx=0x7f033c00fb20 comp rx=0 tx=0).stop 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.348+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 shutdown_connections 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.348+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f03300b2a10 0x7f03300b4f20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.349+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03481192c0 0x7f03481b57f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.349+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f034810abc0 0x7f0348117680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.349+0000 7f034cc4e700 1 --2- 172.21.15.37:0/3237734755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f034810b510 0x7f0348117be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.349+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 >> 172.21.15.37:0/3237734755 conn(0x7f034806f4d0 msgr2=0x7f0348119950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.349+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 shutdown_connections 2024-05-09T01:03:10.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:10.349+0000 7f034cc4e700 1 -- 172.21.15.37:0/3237734755 wait complete. 2024-05-09T01:03:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 -- 172.21.15.37:0/1504831158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 msgr2=0x7f94ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 --2- 172.21.15.37:0/1504831158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac06b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009be0 tx=0x7f94a402a6c0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 -- 172.21.15.37:0/1504831158 shutdown_connections 2024-05-09T01:03:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 --2- 172.21.15.37:0/1504831158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac06b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 --2- 172.21.15.37:0/1504831158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94ac103dc0 0x7f94ac1041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 --2- 172.21.15.37:0/1504831158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94ac102b80 0x7f94ac103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 -- 172.21.15.37:0/1504831158 >> 172.21.15.37:0/1504831158 conn(0x7f94ac0fdd90 msgr2=0x7f94ac100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.404+0000 7f94b1496640 1 -- 172.21.15.37:0/1504831158 shutdown_connections 2024-05-09T01:03:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.405+0000 7f94b1496640 1 -- 172.21.15.37:0/1504831158 wait complete. 2024-05-09T01:03:10.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.406+0000 7f94b1496640 1 Processor -- start 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.406+0000 7f94b1496640 1 -- start start 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94b1496640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac1a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94b1496640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94ac102b80 0x7f94ac1a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94b1496640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94ac103dc0 0x7f94ac1a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94b1496640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac10d500 con 0x7f94ac102b80 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94b1496640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac10d380 con 0x7f94ac103dc0 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94b1496640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac10d680 con 0x7f94ac06b340 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac1a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac1a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40236/0 (socket says 172.21.15.37:40236) 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 -- 172.21.15.37:0/454597259 learned_addr learned my addr 172.21.15.37:0/454597259 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aa7fc640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94ac102b80 0x7f94ac1a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94ac103dc0 0x7f94ac1a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 -- 172.21.15.37:0/454597259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94ac103dc0 msgr2=0x7f94ac1a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94ac103dc0 0x7f94ac1a7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 -- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94ac102b80 msgr2=0x7f94ac1a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94ac102b80 0x7f94ac1a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94aaffd640 1 -- 172.21.15.37:0/454597259 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac1a83a0 con 0x7f94ac06b340 2024-05-09T01:03:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.407+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94ac103dc0 0x7f94ac1a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:10.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.409+0000 7f94aaffd640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac1a0910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c970 tx=0x7f949c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.409+0000 7f9493fff640 1 -- 172.21.15.37:0/454597259 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c007c70 con 0x7f94ac06b340 2024-05-09T01:03:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.409+0000 7f9493fff640 1 -- 172.21.15.37:0/454597259 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f949c007e10 con 0x7f94ac06b340 2024-05-09T01:03:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.409+0000 7f9493fff640 1 -- 172.21.15.37:0/454597259 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0187b0 con 0x7f94ac06b340 2024-05-09T01:03:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.409+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ac1a8690 con 0x7f94ac06b340 2024-05-09T01:03:10.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.409+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ac1a8b30 con 0x7f94ac06b340 2024-05-09T01:03:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.414+0000 7f94b8429740 1 Processor -- start 2024-05-09T01:03:10.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.414+0000 7f9493fff640 1 -- 172.21.15.37:0/454597259 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f949c0213f0 con 0x7f94ac06b340 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.414+0000 7f94b8429740 1 -- start start 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94b8429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b023500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94b8429740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b023a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94b8429740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 0x55943b02a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94b8429740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55943af877c0 con 0x55943ac5e4d0 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94b8429740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55943af230e0 con 0x55943ac562f0 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94b8429740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55943af83780 con 0x55943ac7f1b0 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b023a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52220/0 (socket says 172.21.15.37:52220) 2024-05-09T01:03:10.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 -- 172.21.15.37:0/1155817588 learned_addr learned my addr 172.21.15.37:0/1155817588 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b023500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 -- 172.21.15.37:0/1155817588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 msgr2=0x55943b023500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b023500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 -- 172.21.15.37:0/1155817588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 msgr2=0x55943b02a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 0x55943b02a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.415+0000 7f94aaffd640 1 -- 172.21.15.37:0/1155817588 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55943af4c7c0 con 0x55943ac562f0 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.416+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b023a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f949c0ea480 tx=0x7f949c0ea570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=932fc3f27d161e1e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.416+0000 7f94917fa640 1 -- 172.21.15.37:0/1155817588 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0f5070 con 0x55943ac562f0 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.416+0000 7f94917fa640 1 -- 172.21.15.37:0/1155817588 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f949c0e42d0 con 0x55943ac562f0 2024-05-09T01:03:10.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.416+0000 7f94917fa640 1 -- 172.21.15.37:0/1155817588 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0f0730 con 0x55943ac562f0 2024-05-09T01:03:10.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.417+0000 7f9493fff640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94940b2860 0x7f94940b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.417+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94940b2860 0x7f94940b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.417+0000 7f9493fff640 1 -- 172.21.15.37:0/454597259 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f949c0e2150 con 0x7f94ac06b340 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.417+0000 7f94b8429740 1 -- 172.21.15.37:0/1155817588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 msgr2=0x55943b023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.417+0000 7f94b8429740 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b023a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f949c0ea480 tx=0x7f949c0ea570 comp rx=0 tx=0).stop 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94b8429740 1 -- 172.21.15.37:0/1155817588 shutdown_connections 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94b8429740 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 0x55943b02a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94b8429740 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b023a80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94b8429740 1 --2- 172.21.15.37:0/1155817588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b023500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94b8429740 1 -- 172.21.15.37:0/1155817588 >> 172.21.15.37:0/1155817588 conn(0x55943ac73300 msgr2=0x55943b01ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94b8429740 1 -- 172.21.15.37:0/1155817588 shutdown_connections 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94940b2860 0x7f94940b4d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94a402abe0 tx=0x7f94a4009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.418+0000 7f94b8429740 1 -- 172.21.15.37:0/1155817588 wait complete. 2024-05-09T01:03:10.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 -- start start 2024-05-09T01:03:10.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 Processor -- start 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b02d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac5e4d0 0x55943b02d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac7f1b0 0x55943b034790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55943b02b3d0 con 0x55943ac7f1b0 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55943af0e9c0 con 0x55943ac562f0 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55943b02b550 con 0x55943ac5e4d0 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.419+0000 7f94b8429740 10 client.0 _ll_register_callbacks cb 0x55943af3b020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac5e4d0 0x55943b02d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac5e4d0 0x55943b02d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40256/0 (socket says 172.21.15.37:40256) 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 -- 172.21.15.37:0/1108641998 learned_addr learned my addr 172.21.15.37:0/1108641998 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b02d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac7f1b0 0x55943b034790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 -- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 msgr2=0x55943b02d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b02d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 -- 172.21.15.37:0/1108641998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac7f1b0 msgr2=0x55943b034790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac7f1b0 0x55943b034790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 -- 172.21.15.37:0/1108641998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55943af351f0 con 0x55943ac5e4d0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac7f1b0 0x55943b034790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f94aa7fc640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac5e4d0 0x55943b02d830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94a0005c80 tx=0x7f94a000bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b30917bd67e380a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f948eff5640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.420+0000 7f948eff5640 1 -- 172.21.15.37:0/1108641998 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a001a470 con 0x55943ac5e4d0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.421+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f949c0e42d0 con 0x55943ac5e4d0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.421+0000 7f948eff5640 1 -- 172.21.15.37:0/1108641998 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f94a001a610 con 0x55943ac5e4d0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.421+0000 7f948eff5640 1 -- 172.21.15.37:0/1108641998 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f94a001a810 con 0x55943ac5e4d0 2024-05-09T01:03:10.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.421+0000 7f94b8429740 10 client.25168 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.422+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55943acea790 con 0x55943ac5e4d0 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f948eff5640 1 -- 172.21.15.37:0/1108641998 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f949c0e42d0 con 0x55943ac5e4d0 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f948eff5640 1 -- 172.21.15.37:0/1108641998 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f94a0011ae0 con 0x55943ac5e4d0 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f94b8429740 10 client.25168 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f94b8429740 10 client.25168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f94b8429740 20 client.25168 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f94b8429740 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac3dd80 0x55943b03b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f94b8429740 4 client.25168 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55943af953d0 con 0x55943ac3dd80 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.423+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac3dd80 0x55943b03b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.424+0000 7f948eff5640 10 client.25168 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.424+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac3dd80 0x55943b03b290 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ee8ddf2b93645 server_cookie=5ad7df26b998da0e in_seq=0 out_seq=0 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.425+0000 7f948eff5640 1 -- 172.21.15.37:0/1108641998 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55943af953d0 con 0x55943ac3dd80 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.425+0000 7f948eff5640 10 client.25168 handle_command_reply: tid=0 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.425+0000 7f94b8429740 1 client.25168 shutdown 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.425+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac5e4d0 msgr2=0x55943b02d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.425+0000 7f94b8429740 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac5e4d0 0x55943b02d830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94a0005c80 tx=0x7f94a000bda0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 shutdown_connections 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac3dd80 0x55943b03b290 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac7f1b0 0x55943b034790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac5e4d0 0x55943b02d830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 --2- 172.21.15.37:0/1108641998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac562f0 0x55943b02d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 >> 172.21.15.37:0/1108641998 conn(0x55943ac73300 msgr2=0x55943b01d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f948eff5640 0 client.25168 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 shutdown_connections 2024-05-09T01:03:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 1 -- 172.21.15.37:0/1108641998 wait complete. 2024-05-09T01:03:10.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.426+0000 7f94b8429740 20 client.25168 trim_cache size 0 max 16384 2024-05-09T01:03:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.453+0000 7f94b8429740 1 Processor -- start 2024-05-09T01:03:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.453+0000 7f94b8429740 1 -- start start 2024-05-09T01:03:10.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94b8429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac562f0 0x55943b0276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94b8429740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 0x55943b027c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94b8429740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac7f1b0 0x55943b0346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94b8429740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f949800e310 con 0x55943ac5e4d0 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94b8429740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f949800ff40 con 0x55943ac7f1b0 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94b8429740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f949800e9e0 con 0x55943ac562f0 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac562f0 0x55943b0276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94ab7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac7f1b0 0x55943b0346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94aaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac562f0 0x55943b0276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40264/0 (socket says 172.21.15.37:40264) 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.454+0000 7f94aaffd640 1 -- 172.21.15.37:0/1115104233 learned_addr learned my addr 172.21.15.37:0/1115104233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.455+0000 7f94aa7fc640 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 0x55943b027c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.455+0000 7f94ab7fe640 1 -- 172.21.15.37:0/1115104233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac562f0 msgr2=0x55943b0276c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.455+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac562f0 0x55943b0276c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.455+0000 7f94ab7fe640 1 -- 172.21.15.37:0/1115104233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 msgr2=0x55943b027c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.455+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 0x55943b027c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.456+0000 7f94ab7fe640 1 -- 172.21.15.37:0/1115104233 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55943ad615f0 con 0x55943ac7f1b0 2024-05-09T01:03:10.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.456+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac7f1b0 0x55943b0346b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94a4006010 tx=0x7f94a403d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639ba83df2180a57 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.457+0000 7f9490ff9640 1 -- 172.21.15.37:0/1115104233 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4036040 con 0x55943ac7f1b0 2024-05-09T01:03:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.457+0000 7f9490ff9640 1 -- 172.21.15.37:0/1115104233 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94a4050070 con 0x55943ac7f1b0 2024-05-09T01:03:10.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.457+0000 7f9490ff9640 1 -- 172.21.15.37:0/1115104233 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a40319e0 con 0x55943ac7f1b0 2024-05-09T01:03:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.459+0000 7f94b8429740 1 -- 172.21.15.37:0/1115104233 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac7f1b0 msgr2=0x55943b0346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.459+0000 7f94b8429740 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac7f1b0 0x55943b0346b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94a4006010 tx=0x7f94a403d000 comp rx=0 tx=0).stop 2024-05-09T01:03:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.461+0000 7f94b8429740 1 -- 172.21.15.37:0/1115104233 shutdown_connections 2024-05-09T01:03:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.461+0000 7f94b8429740 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac7f1b0 0x55943b0346b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.461+0000 7f94b8429740 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac5e4d0 0x55943b027c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.461+0000 7f94b8429740 1 --2- 172.21.15.37:0/1115104233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac562f0 0x55943b0276c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.461+0000 7f94b8429740 1 -- 172.21.15.37:0/1115104233 >> 172.21.15.37:0/1115104233 conn(0x55943ac73300 msgr2=0x55943b02b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.471+0000 7f94b8429740 1 -- 172.21.15.37:0/1115104233 shutdown_connections 2024-05-09T01:03:10.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:10 smithi151 ceph-mon[34780]: pgmap v426: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.473+0000 7f94b8429740 1 -- 172.21.15.37:0/1115104233 wait complete. 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 -- start start 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 Processor -- start 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac562f0 0x55943b02f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac5e4d0 0x55943b02fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f949800f7b0 con 0x55943ac562f0 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f949800f0e0 con 0x55943ac5e4d0 2024-05-09T01:03:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f949800c2f0 con 0x55943ac7f1b0 2024-05-09T01:03:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.474+0000 7f94b8429740 10 client.0 _ll_register_callbacks cb 0x7f94a0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.475+0000 7f94ab7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.475+0000 7f94ab7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b034aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40274/0 (socket says 172.21.15.37:40274) 2024-05-09T01:03:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.475+0000 7f94ab7fe640 1 -- 172.21.15.37:0/1601592793 learned_addr learned my addr 172.21.15.37:0/1601592793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:10.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.477+0000 7f94ab7fe640 1 -- 172.21.15.37:0/1601592793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac5e4d0 msgr2=0x55943b02fba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:03:10.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.477+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac5e4d0 0x55943b02fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.477+0000 7f94ab7fe640 1 -- 172.21.15.37:0/1601592793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac562f0 msgr2=0x55943b02f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:10.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.477+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac562f0 0x55943b02f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.477+0000 7f94ab7fe640 1 -- 172.21.15.37:0/1601592793 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55943af4bed0 con 0x55943ac7f1b0 2024-05-09T01:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.478+0000 7f94ab7fe640 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b034aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94a4032c70 tx=0x7f94a4032ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b434c1b99664b228 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.478+0000 7f948eff5640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.479+0000 7f948eff5640 1 -- 172.21.15.37:0/1601592793 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4036040 con 0x55943ac7f1b0 2024-05-09T01:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.479+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94a4050070 con 0x55943ac7f1b0 2024-05-09T01:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.479+0000 7f948eff5640 1 -- 172.21.15.37:0/1601592793 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f94a404b860 con 0x55943ac7f1b0 2024-05-09T01:03:10.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.479+0000 7f948eff5640 1 -- 172.21.15.37:0/1601592793 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f94a4066050 con 0x55943ac7f1b0 2024-05-09T01:03:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 10 client.25174 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:10.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55943b0b32c0 con 0x55943ac7f1b0 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f948eff5640 1 -- 172.21.15.37:0/1601592793 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94a4050070 con 0x55943ac7f1b0 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f948eff5640 1 -- 172.21.15.37:0/1601592793 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f94a403c040 con 0x55943ac7f1b0 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 10 client.25174 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 10 client.25174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 20 client.25174 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac131c0 0x55943b0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 4 client.25174 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:03:10.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.481+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55943af8f240 con 0x55943ac131c0 2024-05-09T01:03:10.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.482+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac131c0 0x55943b0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:10.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.483+0000 7f94aaffd640 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac131c0 0x55943b0b5dd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4653559ef91403f server_cookie=75def869ab93cdcb in_seq=0 out_seq=0 2024-05-09T01:03:10.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.484+0000 7f948eff5640 10 client.25174 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.498+0000 7f948eff5640 1 -- 172.21.15.37:0/1601592793 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55943af8f240 con 0x55943ac131c0 2024-05-09T01:03:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.498+0000 7f948eff5640 10 client.25174 handle_command_reply: tid=0 2024-05-09T01:03:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.498+0000 7f94b8429740 1 client.25174 shutdown 2024-05-09T01:03:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 msgr2=0x55943b034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b034aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f94a4032c70 tx=0x7f94a4032ca0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 shutdown_connections 2024-05-09T01:03:10.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55943ac131c0 0x55943b0b5dd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943ac7f1b0 0x55943b034aa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55943ac5e4d0 0x55943b02fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f948eff5640 0 client.25174 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 --2- 172.21.15.37:0/1601592793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55943ac562f0 0x55943b02f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 >> 172.21.15.37:0/1601592793 conn(0x55943ac73300 msgr2=0x55943b02d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 shutdown_connections 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.499+0000 7f94b8429740 1 -- 172.21.15.37:0/1601592793 wait complete. 2024-05-09T01:03:10.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.501+0000 7f94b8429740 20 client.25174 trim_cache size 0 max 16384 2024-05-09T01:03:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:03:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:03:10.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.502+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94940b2860 msgr2=0x7f94940b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.502+0000 7f94b1496640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94940b2860 0x7f94940b4d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94a402abe0 tx=0x7f94a4009280 comp rx=0 tx=0).stop 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.502+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 msgr2=0x7f94ac1a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.502+0000 7f94b1496640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac1a0910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f949c00c970 tx=0x7f949c00ce30 comp rx=0 tx=0).stop 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.503+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 shutdown_connections 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.503+0000 7f94b1496640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94940b2860 0x7f94940b4d70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.503+0000 7f94b1496640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f94ac103dc0 0x7f94ac1a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.503+0000 7f94b1496640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94ac102b80 0x7f94ac1a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.503+0000 7f94b1496640 1 --2- 172.21.15.37:0/454597259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94ac06b340 0x7f94ac1a0910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.503+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 >> 172.21.15.37:0/454597259 conn(0x7f94ac0fdd90 msgr2=0x7f94ac10de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.503+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 shutdown_connections 2024-05-09T01:03:10.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:10.504+0000 7f94b1496640 1 -- 172.21.15.37:0/454597259 wait complete. 2024-05-09T01:03:10.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:10 smithi136 ceph-mon[34110]: pgmap v426: 97 pgs: 97 active+clean; 1.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-05-09T01:03:11.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:11 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:11 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:03:11.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:11.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:11 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:12.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:12 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:03:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:12 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:12 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:12 smithi136 ceph-mon[34110]: pgmap v427: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-05-09T01:03:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:12 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:03:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:12 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:12 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:12 smithi037 ceph-mon[30122]: pgmap v427: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-05-09T01:03:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:12 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:03:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:12 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:12.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:12 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:03:12.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:12 smithi151 ceph-mon[34780]: pgmap v427: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-05-09T01:03:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 -- 172.21.15.37:0/1775530750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c10e8d0 msgr2=0x7f3e1c110db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 --2- 172.21.15.37:0/1775530750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c10e8d0 0x7f3e1c110db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3e10009990 tx=0x7f3e10009ca0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 -- 172.21.15.37:0/1775530750 shutdown_connections 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 --2- 172.21.15.37:0/1775530750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c10e8d0 0x7f3e1c110db0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 --2- 172.21.15.37:0/1775530750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e1c105460 0x7f3e1c105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 --2- 172.21.15.37:0/1775530750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 0x7f3e1c10e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 -- 172.21.15.37:0/1775530750 >> 172.21.15.37:0/1775530750 conn(0x7f3e1c0fedc0 msgr2=0x7f3e1c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 -- 172.21.15.37:0/1775530750 shutdown_connections 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.583+0000 7f3e21ada700 1 -- 172.21.15.37:0/1775530750 wait complete. 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.584+0000 7f3e21ada700 1 Processor -- start 2024-05-09T01:03:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.584+0000 7f3e21ada700 1 -- start start 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e21ada700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e1c105460 0x7f3e1c10c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e21ada700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 0x7f3e1c10cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e21ada700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c10e8d0 0x7f3e1c10d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e21ada700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c112250 con 0x7f3e1c105460 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e21ada700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1120d0 con 0x7f3e1c10e8d0 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e21ada700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1123d0 con 0x7f3e1c105db0 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 0x7f3e1c10cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 0x7f3e1c10cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46328/0 (socket says 172.21.15.37:46328) 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e1affd700 1 -- 172.21.15.37:0/2430310976 learned_addr learned my addr 172.21.15.37:0/2430310976 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.585+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e1c105460 0x7f3e1c10c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.586+0000 7f3e1affd700 1 -- 172.21.15.37:0/2430310976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c10e8d0 msgr2=0x7f3e1c10d2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.586+0000 7f3e1affd700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c10e8d0 0x7f3e1c10d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.586+0000 7f3e1affd700 1 -- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e1c105460 msgr2=0x7f3e1c10c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.586+0000 7f3e1affd700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e1c105460 0x7f3e1c10c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.586+0000 7f3e1affd700 1 -- 172.21.15.37:0/2430310976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c1ad520 con 0x7f3e1c105db0 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.586+0000 7f3e1affd700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 0x7f3e1c10cd60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00e9c0 tx=0x7f3e0c00ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.587+0000 7f3e18ff9700 1 -- 172.21.15.37:0/2430310976 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00cbd0 con 0x7f3e1c105db0 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.587+0000 7f3e18ff9700 1 -- 172.21.15.37:0/2430310976 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0c00cd70 con 0x7f3e1c105db0 2024-05-09T01:03:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.587+0000 7f3e18ff9700 1 -- 172.21.15.37:0/2430310976 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c010430 con 0x7f3e1c105db0 2024-05-09T01:03:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.587+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c1ad810 con 0x7f3e1c105db0 2024-05-09T01:03:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.587+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c1add00 con 0x7f3e1c105db0 2024-05-09T01:03:13.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.593+0000 7f3e304f0b80 1 Processor -- start 2024-05-09T01:03:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.594+0000 7f3e304f0b80 1 -- start start 2024-05-09T01:03:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.595+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3abd00 0x56276a4b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.595+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3314a0 0x56276a4b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.595+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4ae810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.595+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56276a3d10a0 con 0x56276a3314a0 2024-05-09T01:03:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.595+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56276a3769a0 con 0x56276a4ae400 2024-05-09T01:03:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.595+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56276a3cd060 con 0x56276a3abd00 2024-05-09T01:03:13.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.595+0000 7f3e18ff9700 1 -- 172.21.15.37:0/2430310976 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3e0c004750 con 0x7f3e1c105db0 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.596+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.596+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42148/0 (socket says 172.21.15.37:42148) 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.596+0000 7f3e1affd700 1 -- 172.21.15.37:0/57680123 learned_addr learned my addr 172.21.15.37:0/57680123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.596+0000 7f3e1affd700 1 -- 172.21.15.37:0/57680123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3abd00 msgr2=0x56276a4b4240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3abd00 0x56276a4b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e1affd700 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3abd00 0x56276a4b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e1affd700 1 -- 172.21.15.37:0/57680123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3314a0 msgr2=0x56276a4b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e1affd700 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3314a0 0x56276a4b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e1affd700 1 -- 172.21.15.37:0/57680123 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276a367500 con 0x56276a4ae400 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e18ff9700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e040b2980 0x7f3e040b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e1affd700 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4ae810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0ea400 tx=0x7f3e0c0ea430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790adda78c928d52 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e040b2980 0x7f3e040b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.597+0000 7f3e01ffb700 1 -- 172.21.15.37:0/57680123 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0f6070 con 0x56276a4ae400 2024-05-09T01:03:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.598+0000 7f3e18ff9700 1 -- 172.21.15.37:0/2430310976 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3e0c0e24e0 con 0x7f3e1c105db0 2024-05-09T01:03:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.598+0000 7f3e01ffb700 1 -- 172.21.15.37:0/57680123 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0c0a9610 con 0x56276a4ae400 2024-05-09T01:03:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.598+0000 7f3e01ffb700 1 -- 172.21.15.37:0/57680123 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0a9270 con 0x56276a4ae400 2024-05-09T01:03:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e304f0b80 1 -- 172.21.15.37:0/57680123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 msgr2=0x56276a4ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4ae810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0ea400 tx=0x7f3e0c0ea430 comp rx=0 tx=0).stop 2024-05-09T01:03:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e040b2980 0x7f3e040b4e90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000b2e0 tx=0x7f3e10005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:13.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e304f0b80 1 -- 172.21.15.37:0/57680123 shutdown_connections 2024-05-09T01:03:13.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4ae810 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3abd00 0x56276a4b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/57680123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3314a0 0x56276a4b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.599+0000 7f3e304f0b80 1 -- 172.21.15.37:0/57680123 >> 172.21.15.37:0/57680123 conn(0x56276a334f70 msgr2=0x56276a4a9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:13.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.601+0000 7f3e304f0b80 1 -- 172.21.15.37:0/57680123 shutdown_connections 2024-05-09T01:03:13.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.601+0000 7f3e304f0b80 1 -- 172.21.15.37:0/57680123 wait complete. 2024-05-09T01:03:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.602+0000 7f3e304f0b80 1 -- start start 2024-05-09T01:03:13.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.602+0000 7f3e304f0b80 1 Processor -- start 2024-05-09T01:03:13.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.603+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.603+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.603+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.603+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.603+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4b8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52304/0 (socket says 172.21.15.37:52304) 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1affd700 1 -- 172.21.15.37:0/2363939173 learned_addr learned my addr 172.21.15.37:0/2363939173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56276a4af160 con 0x56276a3abd00 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56276a36bb20 con 0x56276a4ae400 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56276a4bb020 con 0x56276a3314a0 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e304f0b80 10 client.0 _ll_register_callbacks cb 0x56276a2426c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1b7fe700 1 -- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 msgr2=0x56276a4b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1b7fe700 1 -- 172.21.15.37:0/2363939173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 msgr2=0x56276a4b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.604+0000 7f3e1b7fe700 1 -- 172.21.15.37:0/2363939173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276a24c490 con 0x56276a3314a0 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.605+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4b8000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56276a4aac90 tx=0x7f3e14007dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f3099aea2dd145 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.605+0000 7f3dfaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.605+0000 7f3dfaffd700 1 -- 172.21.15.37:0/2363939173 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1401a030 con 0x56276a3314a0 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.605+0000 7f3dfaffd700 1 -- 172.21.15.37:0/2363939173 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3e14003a00 con 0x56276a3314a0 2024-05-09T01:03:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.605+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e0c0a9610 con 0x56276a3314a0 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.606+0000 7f3dfaffd700 1 -- 172.21.15.37:0/2363939173 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3e14007e40 con 0x56276a3314a0 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.606+0000 7f3e304f0b80 10 client.25183 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.606+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56276a4c5b10 con 0x56276a3314a0 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3dfaffd700 1 -- 172.21.15.37:0/2363939173 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0c0a9610 con 0x56276a3314a0 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3dfaffd700 1 -- 172.21.15.37:0/2363939173 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f3e14015a40 con 0x56276a3314a0 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3e304f0b80 10 client.25183 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3e304f0b80 10 client.25183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3e304f0b80 20 client.25183 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a4c8220 0x56276a4ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3e304f0b80 4 client.25183 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56276a3dea80 con 0x56276a4c8220 2024-05-09T01:03:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.607+0000 7f3e1affd700 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a4c8220 0x56276a4ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.609+0000 7f3e1affd700 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a4c8220 0x56276a4ca670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75bcccb02552fbe3 server_cookie=c97dc7059b39897 in_seq=0 out_seq=0 2024-05-09T01:03:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.609+0000 7f3dfaffd700 10 client.25183 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3dfaffd700 1 -- 172.21.15.37:0/2363939173 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56276a3dea80 con 0x56276a4c8220 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3dfaffd700 10 client.25183 handle_command_reply: tid=0 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 client.25183 shutdown 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 msgr2=0x56276a4b8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4b8000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x56276a4aac90 tx=0x7f3e14007dd0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 shutdown_connections 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a4c8220 0x56276a4ca670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a4ae400 0x56276a4b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4b8000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2363939173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 >> 172.21.15.37:0/2363939173 conn(0x56276a334f70 msgr2=0x56276a4a2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3dfaffd700 0 client.25183 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 shutdown_connections 2024-05-09T01:03:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2363939173 wait complete. 2024-05-09T01:03:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.610+0000 7f3e304f0b80 20 client.25183 trim_cache size 0 max 16384 2024-05-09T01:03:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.644+0000 7f3e304f0b80 1 Processor -- start 2024-05-09T01:03:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.645+0000 7f3e304f0b80 1 -- start start 2024-05-09T01:03:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.645+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3314a0 0x56276a4b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a4ae400 0x56276a4b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1b51c0 con 0x56276a3abd00 2024-05-09T01:03:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1b6df0 con 0x56276a3314a0 2024-05-09T01:03:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e1b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3314a0 0x56276a4b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4a3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52312/0 (socket says 172.21.15.37:52312) 2024-05-09T01:03:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e1affd700 1 -- 172.21.15.37:0/2046368848 learned_addr learned my addr 172.21.15.37:0/2046368848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2046368848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1b5890 con 0x56276a4ae400 2024-05-09T01:03:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.646+0000 7f3e1bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a4ae400 0x56276a4b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.647+0000 7f3e1bfff700 1 -- 172.21.15.37:0/2046368848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3314a0 msgr2=0x56276a4b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.647+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3314a0 0x56276a4b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.647+0000 7f3e1bfff700 1 -- 172.21.15.37:0/2046368848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 msgr2=0x56276a4a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.648+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.648+0000 7f3e1bfff700 1 -- 172.21.15.37:0/2046368848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56276a4a59d0 con 0x56276a4ae400 2024-05-09T01:03:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.648+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3314a0 0x56276a4b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.648+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a4ae400 0x56276a4b88c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e10006010 tx=0x7f3e10018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc04573631e5395e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.649+0000 7f3e017fa700 1 -- 172.21.15.37:0/2046368848 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10033070 con 0x56276a4ae400 2024-05-09T01:03:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.649+0000 7f3e017fa700 1 -- 172.21.15.37:0/2046368848 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1000be60 con 0x56276a4ae400 2024-05-09T01:03:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.649+0000 7f3e017fa700 1 -- 172.21.15.37:0/2046368848 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e10004230 con 0x56276a4ae400 2024-05-09T01:03:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.650+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2046368848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a4ae400 msgr2=0x56276a4b88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.650+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a4ae400 0x56276a4b88c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e10006010 tx=0x7f3e10018000 comp rx=0 tx=0).stop 2024-05-09T01:03:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.653+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2046368848 shutdown_connections 2024-05-09T01:03:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.653+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a4ae400 0x56276a4b88c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.653+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3314a0 0x56276a4b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.653+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/2046368848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a3abd00 0x56276a4a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.653+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2046368848 >> 172.21.15.37:0/2046368848 conn(0x56276a334f70 msgr2=0x56276a4ad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.655+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2046368848 shutdown_connections 2024-05-09T01:03:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.655+0000 7f3e304f0b80 1 -- 172.21.15.37:0/2046368848 wait complete. 2024-05-09T01:03:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.656+0000 7f3e304f0b80 1 -- start start 2024-05-09T01:03:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.656+0000 7f3e304f0b80 1 Processor -- start 2024-05-09T01:03:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3abd00 0x56276a4cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e304f0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a4ae400 0x56276a4d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1b6660 con 0x56276a4ae400 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1b5f90 con 0x56276a3abd00 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e304f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1b3180 con 0x56276a3314a0 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e304f0b80 10 client.0 _ll_register_callbacks cb 0x56276a2426c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e1affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3abd00 0x56276a4cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.657+0000 7f3e1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.658+0000 7f3e1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46366/0 (socket says 172.21.15.37:46366) 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.658+0000 7f3e1b7fe700 1 -- 172.21.15.37:0/31876427 learned_addr learned my addr 172.21.15.37:0/31876427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.658+0000 7f3e1bfff700 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a4ae400 0x56276a4d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.659+0000 7f3e1b7fe700 1 -- 172.21.15.37:0/31876427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3abd00 msgr2=0x56276a4cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.659+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3abd00 0x56276a4cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.659+0000 7f3e1b7fe700 1 -- 172.21.15.37:0/31876427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a4ae400 msgr2=0x56276a4d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.659+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a4ae400 0x56276a4d0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.659+0000 7f3e1b7fe700 1 -- 172.21.15.37:0/31876427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56276a531a90 con 0x56276a3314a0 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.660+0000 7f3e1b7fe700 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4cf780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e140061e0 tx=0x7f3e14005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=401788cc91cf78f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.660+0000 7f3dfaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.660+0000 7f3dfaffd700 1 -- 172.21.15.37:0/31876427 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1401a040 con 0x56276a3314a0 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.660+0000 7f3dfaffd700 1 -- 172.21.15.37:0/31876427 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3e14010810 con 0x56276a3314a0 2024-05-09T01:03:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.660+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1000be60 con 0x56276a3314a0 2024-05-09T01:03:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3dfaffd700 1 -- 172.21.15.37:0/31876427 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3e14010a10 con 0x56276a3314a0 2024-05-09T01:03:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3e304f0b80 10 client.25189 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56276a532d00 con 0x56276a3314a0 2024-05-09T01:03:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3dfaffd700 1 -- 172.21.15.37:0/31876427 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1000be60 con 0x56276a3314a0 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3dfaffd700 1 -- 172.21.15.37:0/31876427 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f3e14030030 con 0x56276a3314a0 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3e304f0b80 10 client.25189 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3e304f0b80 10 client.25189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3e304f0b80 20 client.25189 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.661+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a533490 0x56276a5358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.662+0000 7f3e304f0b80 4 client.25189 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.662+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56276a3d8b20 con 0x56276a533490 2024-05-09T01:03:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.662+0000 7f3e1affd700 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a533490 0x56276a5358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.662+0000 7f3dfaffd700 10 client.25189 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.662+0000 7f3e1affd700 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a533490 0x56276a5358b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dc6874ed2a242af server_cookie=b320bf3709532fd4 in_seq=0 out_seq=0 2024-05-09T01:03:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.663+0000 7f3dfaffd700 1 -- 172.21.15.37:0/31876427 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56276a3d8b20 con 0x56276a533490 2024-05-09T01:03:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.663+0000 7f3dfaffd700 10 client.25189 handle_command_reply: tid=0 2024-05-09T01:03:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.663+0000 7f3e304f0b80 1 client.25189 shutdown 2024-05-09T01:03:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.663+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 msgr2=0x56276a4cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.663+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4cf780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e140061e0 tx=0x7f3e14005e60 comp rx=0 tx=0).stop 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 shutdown_connections 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56276a533490 0x56276a5358b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56276a4ae400 0x56276a4d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56276a3314a0 0x56276a4cf780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 --2- 172.21.15.37:0/31876427 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56276a3abd00 0x56276a4cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3dfaffd700 0 client.25189 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 >> 172.21.15.37:0/31876427 conn(0x56276a334f70 msgr2=0x56276a4a3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 shutdown_connections 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 1 -- 172.21.15.37:0/31876427 wait complete. 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.664+0000 7f3e304f0b80 20 client.25189 trim_cache size 0 max 16384 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: "1d9d3f73-328a-49f5-a6e1-6c0ae1dafa57": { 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "1d9d3f73-328a-49f5-a6e1-6c0ae1dafa57", 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:03:13.666 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:03:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e040b2980 msgr2=0x7f3e040b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e040b2980 0x7f3e040b4e90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000b2e0 tx=0x7f3e10005960 comp rx=0 tx=0).stop 2024-05-09T01:03:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 msgr2=0x7f3e1c10cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 0x7f3e1c10cd60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00e9c0 tx=0x7f3e0c00ed80 comp rx=0 tx=0).stop 2024-05-09T01:03:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 shutdown_connections 2024-05-09T01:03:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3e040b2980 0x7f3e040b4e90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e1c10e8d0 0x7f3e1c10d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e1c105460 0x7f3e1c10c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 --2- 172.21.15.37:0/2430310976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e1c105db0 0x7f3e1c10cd60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 >> 172.21.15.37:0/2430310976 conn(0x7f3e1c0fedc0 msgr2=0x7f3e1c1129f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 shutdown_connections 2024-05-09T01:03:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:13.666+0000 7f3e21ada700 1 -- 172.21.15.37:0/2430310976 wait complete. 2024-05-09T01:03:14.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:14 smithi037 ceph-mon[30122]: pgmap v428: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 961 op/s 2024-05-09T01:03:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:14 smithi136 ceph-mon[34110]: pgmap v428: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 961 op/s 2024-05-09T01:03:14.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:14 smithi151 ceph-mon[34780]: pgmap v428: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 12 MiB/s wr, 961 op/s 2024-05-09T01:03:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 55.0 s, 4048.8 tps, lat 24.614 ms stddev 28.091 2024-05-09T01:03:15.630 INFO:tasks.cephfs.filesystem:scrub status for tag:1d9d3f73-328a-49f5-a6e1-6c0ae1dafa57 - {'path': '/', 'tag': '1d9d3f73-328a-49f5-a6e1-6c0ae1dafa57', 'options': 'recursive,force'} 2024-05-09T01:03:16.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:16 smithi136 ceph-mon[34110]: pgmap v429: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 11 MiB/s wr, 905 op/s 2024-05-09T01:03:16.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:16 smithi037 ceph-mon[30122]: pgmap v429: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 11 MiB/s wr, 905 op/s 2024-05-09T01:03:16.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:16 smithi151 ceph-mon[34780]: pgmap v429: 97 pgs: 97 active+clean; 1.0 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 11 MiB/s wr, 905 op/s 2024-05-09T01:03:18.526 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:18 smithi037 ceph-mon[30122]: pgmap v430: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 10 MiB/s wr, 909 op/s 2024-05-09T01:03:18.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:18 smithi136 ceph-mon[34110]: pgmap v430: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 10 MiB/s wr, 909 op/s 2024-05-09T01:03:18.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:18 smithi151 ceph-mon[34780]: pgmap v430: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 10 MiB/s wr, 909 op/s 2024-05-09T01:03:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 60.0 s, 6093.4 tps, lat 16.491 ms stddev 17.737 2024-05-09T01:03:20.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:20 smithi136 ceph-mon[34110]: pgmap v431: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 10 MiB/s wr, 877 op/s 2024-05-09T01:03:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:20 smithi037 ceph-mon[30122]: pgmap v431: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 10 MiB/s wr, 877 op/s 2024-05-09T01:03:20.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:20 smithi151 ceph-mon[34780]: pgmap v431: 97 pgs: 97 active+clean; 1.0 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 10 MiB/s wr, 877 op/s 2024-05-09T01:03:22.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:22 smithi136 ceph-mon[34110]: pgmap v432: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-05-09T01:03:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:22 smithi037 ceph-mon[30122]: pgmap v432: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-05-09T01:03:22.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:22 smithi151 ceph-mon[34780]: pgmap v432: 97 pgs: 97 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-05-09T01:03:23.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:23 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:03:23.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:23 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:03:23.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:23 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:03:23.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:23 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:03:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 -- 172.21.15.37:0/1801147810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924104e90 msgr2=0x7f09241052a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 --2- 172.21.15.37:0/1801147810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924104e90 0x7f09241052a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f090c009900 tx=0x7f090c02a410 comp rx=0 tx=0).stop 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 -- 172.21.15.37:0/1801147810 shutdown_connections 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 --2- 172.21.15.37:0/1801147810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924109b90 0x7f092410bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 --2- 172.21.15.37:0/1801147810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924104e90 0x7f09241052a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 --2- 172.21.15.37:0/1801147810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0924103c50 0x7f0924104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 -- 172.21.15.37:0/1801147810 >> 172.21.15.37:0/1801147810 conn(0x7f09240fee40 msgr2=0x7f09241012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 -- 172.21.15.37:0/1801147810 shutdown_connections 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.657+0000 7f0929f94640 1 -- 172.21.15.37:0/1801147810 wait complete. 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.658+0000 7f0929f94640 1 Processor -- start 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.658+0000 7f0929f94640 1 -- start start 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.658+0000 7f0929f94640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924103c50 0x7f092419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.658+0000 7f0929f94640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0924104e90 0x7f092419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f0929f94640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924109b90 0x7f09241a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f0929f94640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f092410f7c0 con 0x7f0924109b90 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f0929f94640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f092410f640 con 0x7f0924103c50 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f0929f94640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f092410f940 con 0x7f0924104e90 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924103c50 0x7f092419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924103c50 0x7f092419a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56644/0 (socket says 172.21.15.37:56644) 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 -- 172.21.15.37:0/1540720698 learned_addr learned my addr 172.21.15.37:0/1540720698 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f0923fff640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924109b90 0x7f09241a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f091bfff640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0924104e90 0x7f092419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 -- 172.21.15.37:0/1540720698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0924104e90 msgr2=0x7f092419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0924104e90 0x7f092419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 -- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924109b90 msgr2=0x7f09241a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924109b90 0x7f09241a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 -- 172.21.15.37:0/1540720698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09241a1ec0 con 0x7f0924103c50 2024-05-09T01:03:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f0923fff640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924109b90 0x7f09241a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.659+0000 7f09237fe640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924103c50 0x7f092419a380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f091400e9f0 tx=0x7f091400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.660+0000 7f09217fa640 1 -- 172.21.15.37:0/1540720698 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091400ccc0 con 0x7f0924103c50 2024-05-09T01:03:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.660+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0924076070 con 0x7f0924103c50 2024-05-09T01:03:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.660+0000 7f09217fa640 1 -- 172.21.15.37:0/1540720698 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09140035f0 con 0x7f0924103c50 2024-05-09T01:03:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.660+0000 7f09217fa640 1 -- 172.21.15.37:0/1540720698 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091400ce60 con 0x7f0924103c50 2024-05-09T01:03:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.660+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09240765c0 con 0x7f0924103c50 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 Processor -- start 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 -- start start 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f09217fa640 1 -- 172.21.15.37:0/1540720698 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0914010690 con 0x7f0924103c50 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07358500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f8b2f0 0x55dc07358a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f934d0 0x55dc0735f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc072bc7c0 con 0x55dc06f934d0 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55dc072580e0 con 0x55dc06fb41b0 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.662+0000 7f0930e4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55dc072b8780 con 0x55dc06f8b2f0 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07358500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07358500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56658/0 (socket says 172.21.15.37:56658) 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 -- 172.21.15.37:0/3535340748 learned_addr learned my addr 172.21.15.37:0/3535340748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f091bfff640 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f934d0 0x55dc0735f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f09237fe640 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f8b2f0 0x55dc07358a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 -- 172.21.15.37:0/3535340748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f8b2f0 msgr2=0x55dc07358a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f8b2f0 0x55dc07358a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 -- 172.21.15.37:0/3535340748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f934d0 msgr2=0x55dc0735f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f934d0 0x55dc0735f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 -- 172.21.15.37:0/3535340748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc072817c0 con 0x55dc06fb41b0 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.663+0000 7f0923fff640 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07358500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f091c009fd0 tx=0x7f091c0108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eda0ea3508609834 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.664+0000 7f09217fa640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09100b27e0 0x7f09100b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.664+0000 7f0919ffb640 1 -- 172.21.15.37:0/3535340748 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c011760 con 0x55dc06fb41b0 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.664+0000 7f0919ffb640 1 -- 172.21.15.37:0/3535340748 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091c011db0 con 0x55dc06fb41b0 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.664+0000 7f0919ffb640 1 -- 172.21.15.37:0/3535340748 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c00e3c0 con 0x55dc06fb41b0 2024-05-09T01:03:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.664+0000 7f09217fa640 1 -- 172.21.15.37:0/1540720698 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f09140e2610 con 0x7f0924103c50 2024-05-09T01:03:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.664+0000 7f09237fe640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09100b27e0 0x7f09100b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 -- 172.21.15.37:0/3535340748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 msgr2=0x55dc07358500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07358500 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f091c009fd0 tx=0x7f091c0108e0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 -- 172.21.15.37:0/3535340748 shutdown_connections 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f934d0 0x55dc0735f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f8b2f0 0x55dc07358a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3535340748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07358500 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 -- 172.21.15.37:0/3535340748 >> 172.21.15.37:0/3535340748 conn(0x55dc06fa8300 msgr2=0x55dc07353e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 -- 172.21.15.37:0/3535340748 shutdown_connections 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.665+0000 7f0930e4f740 1 -- 172.21.15.37:0/3535340748 wait complete. 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.666+0000 7f0930e4f740 1 -- start start 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.666+0000 7f09237fe640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09100b27e0 0x7f09100b4cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09140a6f40 tx=0x7f09140e8530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.666+0000 7f0930e4f740 1 Processor -- start 2024-05-09T01:03:23.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07362230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc07362770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc073696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0930e4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc073603d0 con 0x55dc06f8b2f0 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0930e4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55dc072439c0 con 0x55dc06fb41b0 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0930e4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55dc07360550 con 0x55dc06f934d0 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0930e4f740 10 client.0 _ll_register_callbacks cb 0x55dc07270020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f091bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc07362770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0923fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc073696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f091bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc07362770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47322/0 (socket says 172.21.15.37:47322) 2024-05-09T01:03:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f091bfff640 1 -- 172.21.15.37:0/1492401932 learned_addr learned my addr 172.21.15.37:0/1492401932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.667+0000 7f0923fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc073696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56660/0 (socket says 172.21.15.37:56660) 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.668+0000 7f0923fff640 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07362230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.668+0000 7f091bfff640 1 -- 172.21.15.37:0/1492401932 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 msgr2=0x55dc073696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.668+0000 7f091bfff640 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc073696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.668+0000 7f091bfff640 1 -- 172.21.15.37:0/1492401932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 msgr2=0x55dc07362230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.668+0000 7f091bfff640 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07362230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.668+0000 7f091bfff640 1 -- 172.21.15.37:0/1492401932 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc0726a1f0 con 0x55dc06f934d0 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.668+0000 7f0923fff640 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07362230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f091bfff640 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc07362770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f090c009230 tx=0x7f090c004560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1243754c4c866200 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f0902ffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f0902ffd640 1 -- 172.21.15.37:0/1492401932 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c035070 con 0x55dc06f934d0 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f0902ffd640 1 -- 172.21.15.37:0/1492401932 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f090c0046c0 con 0x55dc06f934d0 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f091c011db0 con 0x55dc06f934d0 2024-05-09T01:03:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f0902ffd640 1 -- 172.21.15.37:0/1492401932 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f090c005590 con 0x55dc06f934d0 2024-05-09T01:03:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f0930e4f740 10 client.25201 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.669+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dc0701f790 con 0x55dc06f934d0 2024-05-09T01:03:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0902ffd640 1 -- 172.21.15.37:0/1492401932 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091c011db0 con 0x55dc06f934d0 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0902ffd640 1 -- 172.21.15.37:0/1492401932 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f090c04c030 con 0x55dc06f934d0 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0930e4f740 10 client.25201 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0930e4f740 10 client.25201 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0930e4f740 20 client.25201 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0930e4f740 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f72d80 0x55dc0736fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0930e4f740 4 client.25201 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc072ca3d0 con 0x55dc06f72d80 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.670+0000 7f0923fff640 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f72d80 0x55dc0736fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.671+0000 7f0902ffd640 10 client.25201 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.671+0000 7f0923fff640 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f72d80 0x55dc0736fc40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a25757fb9f6e0a9 server_cookie=f1c4571ddb5952cd in_seq=0 out_seq=0 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.671+0000 7f0902ffd640 1 -- 172.21.15.37:0/1492401932 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dc072ca3d0 con 0x55dc06f72d80 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.671+0000 7f0902ffd640 10 client.25201 handle_command_reply: tid=0 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.671+0000 7f0930e4f740 1 client.25201 shutdown 2024-05-09T01:03:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.671+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 msgr2=0x55dc07362770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.671+0000 7f0930e4f740 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc07362770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f090c009230 tx=0x7f090c004560 comp rx=0 tx=0).stop 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 shutdown_connections 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f72d80 0x55dc0736fc40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc073696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc07362770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 --2- 172.21.15.37:0/1492401932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07362230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 >> 172.21.15.37:0/1492401932 conn(0x55dc06fa8300 msgr2=0x55dc07356da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0902ffd640 0 client.25201 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 shutdown_connections 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 1 -- 172.21.15.37:0/1492401932 wait complete. 2024-05-09T01:03:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.672+0000 7f0930e4f740 20 client.25201 trim_cache size 0 max 16384 2024-05-09T01:03:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.692+0000 7f0930e4f740 1 Processor -- start 2024-05-09T01:03:23.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0930e4f740 1 -- start start 2024-05-09T01:03:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07353f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc073695f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07369b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0930e4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09241a9210 con 0x55dc06f8b2f0 2024-05-09T01:03:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0930e4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f09241aae40 con 0x55dc06fb41b0 2024-05-09T01:03:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0930e4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09241a98e0 con 0x55dc06f934d0 2024-05-09T01:03:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07353f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07353f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45534/0 (socket says 172.21.15.37:45534) 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0923fff640 1 -- 172.21.15.37:0/4118325498 learned_addr learned my addr 172.21.15.37:0/4118325498 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.693+0000 7f0923fff640 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07369b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f091bfff640 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc073695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f0923fff640 1 -- 172.21.15.37:0/4118325498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 msgr2=0x55dc073695f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f0923fff640 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc073695f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f0923fff640 1 -- 172.21.15.37:0/4118325498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 msgr2=0x55dc07369b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f0923fff640 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07369b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f0923fff640 1 -- 172.21.15.37:0/4118325498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc070965f0 con 0x55dc06f8b2f0 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f0923fff640 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07353f60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f091c010de0 tx=0x7f091c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ee673e21c1eb63 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f09197fa640 1 -- 172.21.15.37:0/4118325498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c024040 con 0x55dc06f8b2f0 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f09197fa640 1 -- 172.21.15.37:0/4118325498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f091c02c890 con 0x55dc06f8b2f0 2024-05-09T01:03:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.694+0000 7f09197fa640 1 -- 172.21.15.37:0/4118325498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c011850 con 0x55dc06f8b2f0 2024-05-09T01:03:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 -- 172.21.15.37:0/4118325498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 msgr2=0x55dc07353f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07353f60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f091c010de0 tx=0x7f091c005fd0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 -- 172.21.15.37:0/4118325498 shutdown_connections 2024-05-09T01:03:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06fb41b0 0x55dc07369b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06f934d0 0x55dc073695f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 --2- 172.21.15.37:0/4118325498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07353f60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 -- 172.21.15.37:0/4118325498 >> 172.21.15.37:0/4118325498 conn(0x55dc06fa8300 msgr2=0x55dc07353850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 -- 172.21.15.37:0/4118325498 shutdown_connections 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 -- 172.21.15.37:0/4118325498 wait complete. 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.695+0000 7f0930e4f740 1 -- start start 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 1 Processor -- start 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07366c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06f934d0 0x55dc073671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06fb41b0 0x55dc073de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09241aa6b0 con 0x55dc06f8b2f0 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f09241a9fe0 con 0x55dc06f934d0 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09241a71f0 con 0x55dc06fb41b0 2024-05-09T01:03:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f091bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06f934d0 0x55dc073671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f091bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06f934d0 0x55dc073671d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56678/0 (socket says 172.21.15.37:56678) 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f0930e4f740 10 client.0 _ll_register_callbacks cb 0x7f0914005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.696+0000 7f091bfff640 1 -- 172.21.15.37:0/3191656430 learned_addr learned my addr 172.21.15.37:0/3191656430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f091bfff640 1 -- 172.21.15.37:0/3191656430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06fb41b0 msgr2=0x55dc073de7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f091bfff640 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06fb41b0 0x55dc073de7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f091bfff640 1 -- 172.21.15.37:0/3191656430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 msgr2=0x55dc07366c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f0923fff640 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07366c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f091bfff640 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07366c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f091bfff640 1 -- 172.21.15.37:0/3191656430 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc07280ed0 con 0x55dc06f934d0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f0923fff640 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07366c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f091bfff640 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06f934d0 0x55dc073671d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f090c0092a0 tx=0x7f090c005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e664f22ac11d7e3f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.697+0000 7f0902ffd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.698+0000 7f0902ffd640 1 -- 172.21.15.37:0/3191656430 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c003d20 con 0x55dc06f934d0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.698+0000 7f0902ffd640 1 -- 172.21.15.37:0/3191656430 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f090c03a390 con 0x55dc06f934d0 2024-05-09T01:03:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.698+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f091c02c890 con 0x55dc06f934d0 2024-05-09T01:03:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.699+0000 7f0902ffd640 1 -- 172.21.15.37:0/3191656430 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f090c003640 con 0x55dc06f934d0 2024-05-09T01:03:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.699+0000 7f0930e4f740 10 client.25175 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.699+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55dc073dfc40 con 0x55dc06f934d0 2024-05-09T01:03:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0902ffd640 1 -- 172.21.15.37:0/3191656430 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f090c03aa40 con 0x55dc06f934d0 2024-05-09T01:03:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0902ffd640 1 -- 172.21.15.37:0/3191656430 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f090c04c040 con 0x55dc06f934d0 2024-05-09T01:03:23.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0930e4f740 10 client.25175 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0930e4f740 10 client.25175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0930e4f740 20 client.25175 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f481c0 0x55dc073e26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0930e4f740 4 client.25175 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f091c02c890 con 0x55dc06f481c0 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.700+0000 7f0923fff640 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f481c0 0x55dc073e26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.701+0000 7f0902ffd640 10 client.25175 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:23.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.701+0000 7f0923fff640 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f481c0 0x55dc073e26f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=476780a81ac27867 server_cookie=2b0865a0bc6f3155 in_seq=0 out_seq=0 2024-05-09T01:03:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.713+0000 7f0902ffd640 1 -- 172.21.15.37:0/3191656430 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f091c02c890 con 0x55dc06f481c0 2024-05-09T01:03:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.714+0000 7f0902ffd640 10 client.25175 handle_command_reply: tid=0 2024-05-09T01:03:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.714+0000 7f0930e4f740 1 client.25175 shutdown 2024-05-09T01:03:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.714+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06f934d0 msgr2=0x55dc073671d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.714+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06f934d0 0x55dc073671d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f090c0092a0 tx=0x7f090c005620 comp rx=0 tx=0).stop 2024-05-09T01:03:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.715+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 shutdown_connections 2024-05-09T01:03:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.715+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55dc06f481c0 0x55dc073e26f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.715+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc06fb41b0 0x55dc073de7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.715+0000 7f0902ffd640 0 client.25175 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.715+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55dc06f934d0 0x55dc073671d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.715+0000 7f0930e4f740 1 --2- 172.21.15.37:0/3191656430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc06f8b2f0 0x55dc07366c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.715+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 >> 172.21.15.37:0/3191656430 conn(0x55dc06fa8300 msgr2=0x55dc073608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.716+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 shutdown_connections 2024-05-09T01:03:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.716+0000 7f0930e4f740 1 -- 172.21.15.37:0/3191656430 wait complete. 2024-05-09T01:03:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.717+0000 7f0930e4f740 20 client.25175 trim_cache size 0 max 16384 2024-05-09T01:03:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:03:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:03:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09100b27e0 msgr2=0x7f09100b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09100b27e0 0x7f09100b4cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09140a6f40 tx=0x7f09140e8530 comp rx=0 tx=0).stop 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924103c50 msgr2=0x7f092419a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924103c50 0x7f092419a380 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f091400e9f0 tx=0x7f091400eeb0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 shutdown_connections 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0924109b90 0x7f09241a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0924104e90 0x7f092419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09100b27e0 0x7f09100b4cf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 --2- 172.21.15.37:0/1540720698 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0924103c50 0x7f092419a380 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.718+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 >> 172.21.15.37:0/1540720698 conn(0x7f09240fee40 msgr2=0x7f0924105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.719+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 shutdown_connections 2024-05-09T01:03:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:23.719+0000 7f0929f94640 1 -- 172.21.15.37:0/1540720698 wait complete. 2024-05-09T01:03:23.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:23 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:03:23.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:23 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:03:23.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:23 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:03:23.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:23 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:03:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:23 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:03:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:23 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:03:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:23 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:03:23.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:23 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:03:24.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:24 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:03:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:24 smithi136 ceph-mon[34110]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-05-09T01:03:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:24 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:03:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:24 smithi037 ceph-mon[30122]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-05-09T01:03:24.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:24 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:03:24.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:24 smithi151 ceph-mon[34780]: pgmap v433: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-05-09T01:03:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 65.0 s, 4243.2 tps, lat 23.500 ms stddev 26.448 2024-05-09T01:03:26.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:26 smithi136 ceph-mon[34110]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 13 MiB/s wr, 911 op/s 2024-05-09T01:03:26.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:26 smithi037 ceph-mon[30122]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 13 MiB/s wr, 911 op/s 2024-05-09T01:03:26.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:26 smithi151 ceph-mon[34780]: pgmap v434: 97 pgs: 97 active+clean; 1.1 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 13 MiB/s wr, 911 op/s 2024-05-09T01:03:28.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:28 smithi136 ceph-mon[34110]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 956 op/s 2024-05-09T01:03:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:28 smithi037 ceph-mon[30122]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 956 op/s 2024-05-09T01:03:28.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:28 smithi151 ceph-mon[34780]: pgmap v435: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 956 op/s 2024-05-09T01:03:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 70.0 s, 3800.6 tps, lat 26.332 ms stddev 26.461 2024-05-09T01:03:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:30 smithi136 ceph-mon[34110]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 835 op/s 2024-05-09T01:03:30.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:30 smithi037 ceph-mon[30122]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 835 op/s 2024-05-09T01:03:30.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:30 smithi151 ceph-mon[34780]: pgmap v436: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 13 MiB/s wr, 835 op/s 2024-05-09T01:03:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:32 smithi136 ceph-mon[34110]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 950 op/s 2024-05-09T01:03:32.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:32 smithi037 ceph-mon[30122]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 950 op/s 2024-05-09T01:03:32.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:32 smithi151 ceph-mon[34780]: pgmap v437: 97 pgs: 97 active+clean; 1.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 14 MiB/s wr, 950 op/s 2024-05-09T01:03:34.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:34 smithi136 ceph-mon[34110]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-05-09T01:03:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:34 smithi037 ceph-mon[30122]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-05-09T01:03:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:34 smithi151 ceph-mon[34780]: pgmap v438: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 820 op/s 2024-05-09T01:03:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 75.0 s, 5040.4 tps, lat 19.898 ms stddev 21.506 2024-05-09T01:03:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:36 smithi136 ceph-mon[34110]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 827 op/s 2024-05-09T01:03:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:36 smithi037 ceph-mon[30122]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 827 op/s 2024-05-09T01:03:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:36 smithi151 ceph-mon[34780]: pgmap v439: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 827 op/s 2024-05-09T01:03:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 -- 172.21.15.37:0/3616024091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c105e90 msgr2=0x7fc51c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 --2- 172.21.15.37:0/3616024091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c105e90 0x7fc51c106b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc514009900 tx=0x7fc51402a440 comp rx=0 tx=0).stop 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 -- 172.21.15.37:0/3616024091 shutdown_connections 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 --2- 172.21.15.37:0/3616024091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc51c10bdd0 0x7fc51c10e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 --2- 172.21.15.37:0/3616024091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 0x7fc51c1074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 --2- 172.21.15.37:0/3616024091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c105e90 0x7fc51c106b90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 -- 172.21.15.37:0/3616024091 >> 172.21.15.37:0/3616024091 conn(0x7fc51c101060 msgr2=0x7fc51c103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 -- 172.21.15.37:0/3616024091 shutdown_connections 2024-05-09T01:03:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.891+0000 7fc522de0640 1 -- 172.21.15.37:0/3616024091 wait complete. 2024-05-09T01:03:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.892+0000 7fc522de0640 1 Processor -- start 2024-05-09T01:03:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.892+0000 7fc522de0640 1 -- start start 2024-05-09T01:03:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc522de0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc51c105e90 0x7fc51c07a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc522de0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 0x7fc51c07ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc522de0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c10bdd0 0x7fc51c077490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc522de0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c1119c0 con 0x7fc51c1070d0 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc522de0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c111840 con 0x7fc51c10bdd0 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc522de0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c111b40 con 0x7fc51c105e90 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 0x7fc51c07ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 0x7fc51c07ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53958/0 (socket says 172.21.15.37:53958) 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 -- 172.21.15.37:0/2171057267 learned_addr learned my addr 172.21.15.37:0/2171057267 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc520b7c640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc51c105e90 0x7fc51c07a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc52137d640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c10bdd0 0x7fc51c077490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 -- 172.21.15.37:0/2171057267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc51c105e90 msgr2=0x7fc51c07a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc51c105e90 0x7fc51c07a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 -- 172.21.15.37:0/2171057267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c10bdd0 msgr2=0x7fc51c077490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c10bdd0 0x7fc51c077490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.893+0000 7fc51bfff640 1 -- 172.21.15.37:0/2171057267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c077c20 con 0x7fc51c1070d0 2024-05-09T01:03:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.894+0000 7fc51bfff640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 0x7fc51c07ae80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e9f0 tx=0x7fc51000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:36.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.894+0000 7fc519ffb640 1 -- 172.21.15.37:0/2171057267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51000cd80 con 0x7fc51c1070d0 2024-05-09T01:03:36.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.894+0000 7fc519ffb640 1 -- 172.21.15.37:0/2171057267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5100108e0 con 0x7fc51c1070d0 2024-05-09T01:03:36.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.894+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51c077f10 con 0x7fc51c1070d0 2024-05-09T01:03:36.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.894+0000 7fc519ffb640 1 -- 172.21.15.37:0/2171057267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc510018980 con 0x7fc51c1070d0 2024-05-09T01:03:36.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.894+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc51c1a8c70 con 0x7fc51c1070d0 2024-05-09T01:03:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.899+0000 7fc529d6e740 1 Processor -- start 2024-05-09T01:03:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.899+0000 7fc529d6e740 1 -- start start 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.900+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a020500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.900+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a020a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.900+0000 7fc52137d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a020500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.900+0000 7fc52137d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a020500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60084/0 (socket says 172.21.15.37:60084) 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.900+0000 7fc52137d640 1 -- 172.21.15.37:0/163037023 learned_addr learned my addr 172.21.15.37:0/163037023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.900+0000 7fc529d6e740 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c5b4d0 0x56330a027980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.900+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563309f847c0 con 0x563309c532f0 2024-05-09T01:03:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563309f200e0 con 0x563309c7c1b0 2024-05-09T01:03:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563309f80780 con 0x563309c5b4d0 2024-05-09T01:03:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc520b7c640 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a020a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc52137d640 1 -- 172.21.15.37:0/163037023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c5b4d0 msgr2=0x56330a027980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:03:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc52137d640 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c5b4d0 0x56330a027980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc52137d640 1 -- 172.21.15.37:0/163037023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 msgr2=0x56330a020a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc52137d640 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a020a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc52137d640 1 -- 172.21.15.37:0/163037023 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563309f497c0 con 0x563309c7c1b0 2024-05-09T01:03:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.901+0000 7fc520b7c640 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a020a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.902+0000 7fc519ffb640 1 -- 172.21.15.37:0/2171057267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc510010430 con 0x7fc51c1070d0 2024-05-09T01:03:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.902+0000 7fc52137d640 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a020500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc50c007f40 tx=0x7fc50c00f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6616c8012b1a544 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.903+0000 7fc502ffd640 1 -- 172.21.15.37:0/163037023 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c010900 con 0x563309c7c1b0 2024-05-09T01:03:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.903+0000 7fc502ffd640 1 -- 172.21.15.37:0/163037023 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc50c0183f0 con 0x563309c7c1b0 2024-05-09T01:03:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.903+0000 7fc502ffd640 1 -- 172.21.15.37:0/163037023 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c017600 con 0x563309c7c1b0 2024-05-09T01:03:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.903+0000 7fc519ffb640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5040b29b0 0x7fc5040b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.903+0000 7fc519ffb640 1 -- 172.21.15.37:0/2171057267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc5100e2320 con 0x7fc51c1070d0 2024-05-09T01:03:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.903+0000 7fc520b7c640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5040b29b0 0x7fc5040b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 msgr2=0x56330a020500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a020500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc50c007f40 tx=0x7fc50c00f850 comp rx=0 tx=0).stop 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 shutdown_connections 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c5b4d0 0x56330a027980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a020a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 --2- 172.21.15.37:0/163037023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a020500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 >> 172.21.15.37:0/163037023 conn(0x563309c70300 msgr2=0x56330a01be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 shutdown_connections 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.904+0000 7fc520b7c640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5040b29b0 0x7fc5040b4ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc51402a960 tx=0x7fc514000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.905+0000 7fc529d6e740 1 -- 172.21.15.37:0/163037023 wait complete. 2024-05-09T01:03:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.905+0000 7fc529d6e740 1 -- start start 2024-05-09T01:03:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.905+0000 7fc529d6e740 1 Processor -- start 2024-05-09T01:03:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c532f0 0x56330a02a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c5b4d0 0x56330a02a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a031890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc529d6e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56330a0283d0 con 0x563309c5b4d0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c5b4d0 0x56330a02a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc520b7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c532f0 0x56330a02a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c5b4d0 0x56330a02a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53970/0 (socket says 172.21.15.37:53970) 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc51bfff640 1 -- 172.21.15.37:0/1535793405 learned_addr learned my addr 172.21.15.37:0/1535793405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563309f0b9c0 con 0x563309c7c1b0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56330a028550 con 0x563309c532f0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc52137d640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a031890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.906+0000 7fc529d6e740 10 client.0 _ll_register_callbacks cb 0x563309f38020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc520b7c640 1 -- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 msgr2=0x56330a031890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc520b7c640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a031890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc520b7c640 1 -- 172.21.15.37:0/1535793405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c5b4d0 msgr2=0x56330a02a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc520b7c640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c5b4d0 0x56330a02a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc520b7c640 1 -- 172.21.15.37:0/1535793405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563309f321f0 con 0x563309c532f0 2024-05-09T01:03:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc51bfff640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c5b4d0 0x56330a02a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc52137d640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a031890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc520b7c640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c532f0 0x56330a02a3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc514009230 tx=0x7fc51402a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=327065349847d5b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc4fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc4fbfff640 1 -- 172.21.15.37:0/1535793405 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514005450 con 0x563309c532f0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc50c0183f0 con 0x563309c532f0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc4fbfff640 1 -- 172.21.15.37:0/1535793405 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc5140055f0 con 0x563309c532f0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc4fbfff640 1 -- 172.21.15.37:0/1535793405 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc514054440 con 0x563309c532f0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc529d6e740 10 client.25210 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.907+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563309ce7790 con 0x563309c532f0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc4fbfff640 1 -- 172.21.15.37:0/1535793405 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc50c0183f0 con 0x563309c532f0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc4fbfff640 1 -- 172.21.15.37:0/1535793405 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fc514052070 con 0x563309c532f0 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc529d6e740 10 client.25210 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc529d6e740 10 client.25210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc529d6e740 20 client.25210 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc529d6e740 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c3ad80 0x56330a037c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc529d6e740 4 client.25210 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563309f923d0 con 0x563309c3ad80 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc51bfff640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c3ad80 0x56330a037c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc4fbfff640 10 client.25210 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.908+0000 7fc51bfff640 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c3ad80 0x56330a037c20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d6455fb77199bb server_cookie=bea3185b909eef55 in_seq=0 out_seq=0 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.909+0000 7fc4fbfff640 1 -- 172.21.15.37:0/1535793405 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563309f923d0 con 0x563309c3ad80 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.909+0000 7fc4fbfff640 10 client.25210 handle_command_reply: tid=0 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.909+0000 7fc529d6e740 1 client.25210 shutdown 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.909+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c532f0 msgr2=0x56330a02a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.909+0000 7fc529d6e740 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c532f0 0x56330a02a3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc514009230 tx=0x7fc51402a440 comp rx=0 tx=0).stop 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 shutdown_connections 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c3ad80 0x56330a037c20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c7c1b0 0x56330a031890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc4fbfff640 0 client.25210 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c5b4d0 0x56330a02a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 --2- 172.21.15.37:0/1535793405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c532f0 0x56330a02a3f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 >> 172.21.15.37:0/1535793405 conn(0x563309c70300 msgr2=0x56330a01b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 shutdown_connections 2024-05-09T01:03:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 1 -- 172.21.15.37:0/1535793405 wait complete. 2024-05-09T01:03:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.910+0000 7fc529d6e740 20 client.25210 trim_cache size 0 max 16384 2024-05-09T01:03:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 Processor -- start 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 -- start start 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a031820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 0x56330a031d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800e320 con 0x563309c532f0 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800ff50 con 0x563309c5b4d0 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc529d6e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800e9f0 con 0x563309c3ad80 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a031820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc520b7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc520b7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53596/0 (socket says 172.21.15.37:53596) 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc520b7c640 1 -- 172.21.15.37:0/3934201948 learned_addr learned my addr 172.21.15.37:0/3934201948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.926+0000 7fc51bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a031820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53974/0 (socket says 172.21.15.37:53974) 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc52137d640 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 0x56330a031d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc520b7c640 1 -- 172.21.15.37:0/3934201948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 msgr2=0x56330a031d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc520b7c640 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 0x56330a031d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc520b7c640 1 -- 172.21.15.37:0/3934201948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 msgr2=0x56330a031820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc520b7c640 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a031820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc520b7c640 1 -- 172.21.15.37:0/3934201948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563309d5e5f0 con 0x563309c3ad80 2024-05-09T01:03:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc520b7c640 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02a6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc514004ae0 tx=0x7fc514031fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a24aea65bf9c6580 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc5027fc640 1 -- 172.21.15.37:0/3934201948 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5140314c0 con 0x563309c3ad80 2024-05-09T01:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc5027fc640 1 -- 172.21.15.37:0/3934201948 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc514031a40 con 0x563309c3ad80 2024-05-09T01:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.927+0000 7fc5027fc640 1 -- 172.21.15.37:0/3934201948 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514054760 con 0x563309c3ad80 2024-05-09T01:03:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.928+0000 7fc529d6e740 1 -- 172.21.15.37:0/3934201948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 msgr2=0x56330a02a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.928+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02a6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc514004ae0 tx=0x7fc514031fc0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.928+0000 7fc529d6e740 1 -- 172.21.15.37:0/3934201948 shutdown_connections 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.928+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 0x56330a031d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.928+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a031820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.928+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3934201948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02a6d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.928+0000 7fc529d6e740 1 -- 172.21.15.37:0/3934201948 >> 172.21.15.37:0/3934201948 conn(0x563309c70300 msgr2=0x56330a029fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.929+0000 7fc529d6e740 1 -- 172.21.15.37:0/3934201948 shutdown_connections 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.929+0000 7fc529d6e740 1 -- 172.21.15.37:0/3934201948 wait complete. 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.929+0000 7fc529d6e740 1 -- start start 2024-05-09T01:03:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.930+0000 7fc529d6e740 1 Processor -- start 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.930+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.930+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a02f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.930+0000 7fc529d6e740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 0x56330a09df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc529d6e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800f7c0 con 0x563309c532f0 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc529d6e740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800f0f0 con 0x563309c5b4d0 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc529d6e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc50800c300 con 0x563309c3ad80 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc529d6e740 10 client.0 _ll_register_callbacks cb 0x7fc514005ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc520b7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc520b7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53604/0 (socket says 172.21.15.37:53604) 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc520b7c640 1 -- 172.21.15.37:0/3463482801 learned_addr learned my addr 172.21.15.37:0/3463482801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc51bfff640 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a02f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc51bfff640 1 -- 172.21.15.37:0/3463482801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 msgr2=0x56330a02ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc51bfff640 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc51bfff640 1 -- 172.21.15.37:0/3463482801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 msgr2=0x56330a09df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc51bfff640 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 0x56330a09df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.931+0000 7fc51bfff640 1 -- 172.21.15.37:0/3463482801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563309f48ed0 con 0x563309c532f0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc51bfff640 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a02f360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc5100a6c60 tx=0x7fc5100cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffae486e178ef8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc4fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc4fbfff640 1 -- 172.21.15.37:0/3463482801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100a99f0 con 0x563309c532f0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc4fbfff640 1 -- 172.21.15.37:0/3463482801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc5100a8c50 con 0x563309c532f0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc514031a40 con 0x563309c532f0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc4fbfff640 1 -- 172.21.15.37:0/3463482801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc5100adcf0 con 0x563309c532f0 2024-05-09T01:03:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc529d6e740 10 client.15456 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56330a09f510 con 0x563309c532f0 2024-05-09T01:03:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.932+0000 7fc4fbfff640 1 -- 172.21.15.37:0/3463482801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5100b27a0 con 0x563309c532f0 2024-05-09T01:03:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.933+0000 7fc4fbfff640 1 -- 172.21.15.37:0/3463482801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fc5100a86c0 con 0x563309c532f0 2024-05-09T01:03:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.933+0000 7fc529d6e740 10 client.15456 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.933+0000 7fc529d6e740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.933+0000 7fc529d6e740 20 client.15456 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.933+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c7c1b0 0x56330a0a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.933+0000 7fc529d6e740 4 client.15456 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.933+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fc514031a40 con 0x563309c7c1b0 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.934+0000 7fc520b7c640 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c7c1b0 0x56330a0a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.935+0000 7fc4fbfff640 10 client.15456 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.935+0000 7fc520b7c640 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c7c1b0 0x56330a0a1f70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2270d951b4083b6 server_cookie=a94c0a3f593bee0e in_seq=0 out_seq=0 2024-05-09T01:03:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc4fbfff640 1 -- 172.21.15.37:0/3463482801 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fc514031a40 con 0x563309c7c1b0 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc4fbfff640 10 client.15456 handle_command_reply: tid=0 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 client.15456 shutdown 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 msgr2=0x56330a02f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a02f360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc5100a6c60 tx=0x7fc5100cc040 comp rx=0 tx=0).stop 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 shutdown_connections 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563309c7c1b0 0x56330a0a1f70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563309c5b4d0 0x56330a09df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc4fbfff640 0 client.15456 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563309c532f0 0x56330a02f360 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 --2- 172.21.15.37:0/3463482801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563309c3ad80 0x56330a02ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 >> 172.21.15.37:0/3463482801 conn(0x563309c70300 msgr2=0x56330a029f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 shutdown_connections 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 1 -- 172.21.15.37:0/3463482801 wait complete. 2024-05-09T01:03:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.961+0000 7fc529d6e740 20 client.15456 trim_cache size 0 max 16384 2024-05-09T01:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:03:36.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5040b29b0 msgr2=0x7fc5040b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5040b29b0 0x7fc5040b4ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc51402a960 tx=0x7fc514000bc0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 msgr2=0x7fc51c07ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 0x7fc51c07ae80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc51000e9f0 tx=0x7fc51000eeb0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 shutdown_connections 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc5040b29b0 0x7fc5040b4ec0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc51c10bdd0 0x7fc51c077490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c1070d0 0x7fc51c07ae80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 --2- 172.21.15.37:0/2171057267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc51c105e90 0x7fc51c07a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 >> 172.21.15.37:0/2171057267 conn(0x7fc51c101060 msgr2=0x7fc51c107db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 shutdown_connections 2024-05-09T01:03:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:36.962+0000 7fc522de0640 1 -- 172.21.15.37:0/2171057267 wait complete. 2024-05-09T01:03:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:38 smithi136 ceph-mon[34110]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.8 MiB/s wr, 797 op/s 2024-05-09T01:03:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:38 smithi037 ceph-mon[30122]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.8 MiB/s wr, 797 op/s 2024-05-09T01:03:38.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:38 smithi151 ceph-mon[34780]: pgmap v440: 97 pgs: 97 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.8 MiB/s wr, 797 op/s 2024-05-09T01:03:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 80.0 s, 5229.4 tps, lat 19.118 ms stddev 20.563 2024-05-09T01:03:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:40 smithi136 ceph-mon[34110]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 704 op/s 2024-05-09T01:03:40.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:40 smithi037 ceph-mon[30122]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 704 op/s 2024-05-09T01:03:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:40 smithi151 ceph-mon[34780]: pgmap v441: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 704 op/s 2024-05-09T01:03:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:42 smithi136 ceph-mon[34110]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 934 op/s 2024-05-09T01:03:42.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:42 smithi037 ceph-mon[30122]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 934 op/s 2024-05-09T01:03:42.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:42 smithi151 ceph-mon[34780]: pgmap v442: 97 pgs: 97 active+clean; 1.1 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 934 op/s 2024-05-09T01:03:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:44 smithi136 ceph-mon[34110]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-05-09T01:03:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:44 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:03:44.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:44 smithi037 ceph-mon[30122]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-05-09T01:03:44.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:44 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:03:44.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:44 smithi151 ceph-mon[34780]: pgmap v443: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 849 op/s 2024-05-09T01:03:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:44 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:03:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 85.0 s, 5184.1 tps, lat 19.308 ms stddev 20.992 2024-05-09T01:03:45.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:45 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:03:45.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:45 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:03:45.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:45 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:03:45.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:03:45.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:45 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:03:45.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:45 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:03:45.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:45 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:03:45.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:45 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:03:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:45 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:03:45.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:45 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:03:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:46.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:46 smithi037 ceph-mon[30122]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 863 op/s 2024-05-09T01:03:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:46 smithi136 ceph-mon[34110]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 863 op/s 2024-05-09T01:03:46.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:46 smithi151 ceph-mon[34780]: pgmap v444: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 863 op/s 2024-05-09T01:03:48.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.168+0000 7fec0b1a8700 1 -- 172.21.15.37:0/4027467944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 msgr2=0x7fec04110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.168+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/4027467944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec04110d80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7febec009990 tx=0x7febec009ca0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.170+0000 7fec0b1a8700 1 -- 172.21.15.37:0/4027467944 shutdown_connections 2024-05-09T01:03:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.170+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/4027467944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0410b2e0 0x7fec04117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.170+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/4027467944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec04110d80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.170+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/4027467944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec0410a990 0x7fec0410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.170+0000 7fec0b1a8700 1 -- 172.21.15.37:0/4027467944 >> 172.21.15.37:0/4027467944 conn(0x7fec04077c80 msgr2=0x7fec040780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:48.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.173+0000 7fec0b1a8700 1 -- 172.21.15.37:0/4027467944 shutdown_connections 2024-05-09T01:03:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.174+0000 7fec0b1a8700 1 -- 172.21.15.37:0/4027467944 wait complete. 2024-05-09T01:03:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.175+0000 7fec0b1a8700 1 Processor -- start 2024-05-09T01:03:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.175+0000 7fec0b1a8700 1 -- start start 2024-05-09T01:03:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.176+0000 7fec0b1a8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec0410a990 0x7fec04085360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.176+0000 7fec0b1a8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0410b2e0 0x7fec0407e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.176+0000 7fec0b1a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec0407eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.176+0000 7fec0b1a8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec0411aa70 con 0x7fec04110970 2024-05-09T01:03:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.176+0000 7fec0b1a8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec0411a8f0 con 0x7fec0410a990 2024-05-09T01:03:48.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.176+0000 7fec0b1a8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec0411abf0 con 0x7fec0410b2e0 2024-05-09T01:03:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.177+0000 7fec09745700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec0407eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.177+0000 7fec09745700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec0407eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45774/0 (socket says 172.21.15.37:45774) 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.177+0000 7fec09745700 1 -- 172.21.15.37:0/931721752 learned_addr learned my addr 172.21.15.37:0/931721752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.177+0000 7fec09745700 1 -- 172.21.15.37:0/931721752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0410b2e0 msgr2=0x7fec0407e490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.178+0000 7fec09745700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0410b2e0 0x7fec0407e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.178+0000 7fec09745700 1 -- 172.21.15.37:0/931721752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec0410a990 msgr2=0x7fec04085360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.178+0000 7fec09745700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec0410a990 0x7fec04085360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.178+0000 7fec09745700 1 -- 172.21.15.37:0/931721752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec04082e90 con 0x7fec04110970 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.178+0000 7fec09745700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec0407eb30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7febfc007ee0 tx=0x7febfc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.179+0000 7fec01ffb700 1 -- 172.21.15.37:0/931721752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc00dbd0 con 0x7fec04110970 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.179+0000 7fec01ffb700 1 -- 172.21.15.37:0/931721752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febfc00dd70 con 0x7fec04110970 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.179+0000 7fec01ffb700 1 -- 172.21.15.37:0/931721752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc005a30 con 0x7fec04110970 2024-05-09T01:03:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.180+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec04083180 con 0x7fec04110970 2024-05-09T01:03:48.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.180+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec04083670 con 0x7fec04110970 2024-05-09T01:03:48.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.192+0000 7fec19bbeb80 1 Processor -- start 2024-05-09T01:03:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.192+0000 7fec19bbeb80 1 -- start start 2024-05-09T01:03:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.193+0000 7fec01ffb700 1 -- 172.21.15.37:0/931721752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7febfc01a020 con 0x7fec04110970 2024-05-09T01:03:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.194+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34254f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.194+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3425a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.194+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd341fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.194+0000 7fec19bbeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561bd3341ff0 con 0x561bd338c160 2024-05-09T01:03:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.194+0000 7fec19bbeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561bd32e07f0 con 0x561bd341f6a0 2024-05-09T01:03:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.195+0000 7fec19bbeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561bd333dfb0 con 0x561bd32a24a0 2024-05-09T01:03:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.195+0000 7fec01ffb700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7febf00b2a50 0x7febf00b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.195+0000 7fec08f44700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3425a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.195+0000 7fec08f44700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3425a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54826/0 (socket says 172.21.15.37:54826) 2024-05-09T01:03:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.195+0000 7fec08f44700 1 -- 172.21.15.37:0/2445598035 learned_addr learned my addr 172.21.15.37:0/2445598035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.195+0000 7fec03fff700 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec03fff700 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd341fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec08f44700 1 -- 172.21.15.37:0/2445598035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 msgr2=0x561bd341fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec08f44700 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd341fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec08f44700 1 -- 172.21.15.37:0/2445598035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 msgr2=0x561bd34254f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec08f44700 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34254f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec08f44700 1 -- 172.21.15.37:0/2445598035 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd32d8370 con 0x561bd32a24a0 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec09745700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7febf00b2a50 0x7febf00b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.196+0000 7fec08f44700 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3425a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febec0098e0 tx=0x7febec005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=522208e5a8655daf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.197+0000 7febfaffd700 1 -- 172.21.15.37:0/2445598035 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec009590 con 0x561bd32a24a0 2024-05-09T01:03:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.197+0000 7febfaffd700 1 -- 172.21.15.37:0/2445598035 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec003d10 con 0x561bd32a24a0 2024-05-09T01:03:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.197+0000 7febfaffd700 1 -- 172.21.15.37:0/2445598035 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec00bb40 con 0x561bd32a24a0 2024-05-09T01:03:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec01ffb700 1 -- 172.21.15.37:0/931721752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7febfc0e1880 con 0x7fec04110970 2024-05-09T01:03:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2445598035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 msgr2=0x561bd3425a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3425a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febec0098e0 tx=0x7febec005ef0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec09745700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7febf00b2a50 0x7febf00b4f60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7febfc0a4fd0 tx=0x7febfc012000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2445598035 shutdown_connections 2024-05-09T01:03:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd341fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34254f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2445598035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3425a30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.199+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2445598035 >> 172.21.15.37:0/2445598035 conn(0x561bd33026a0 msgr2=0x561bd341a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.200+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2445598035 shutdown_connections 2024-05-09T01:03:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.201+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2445598035 wait complete. 2024-05-09T01:03:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.201+0000 7fec19bbeb80 1 -- start start 2024-05-09T01:03:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.202+0000 7fec19bbeb80 1 Processor -- start 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd32a24a0 0x561bd342bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd338c160 0x561bd3429000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec03fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd32a24a0 0x561bd342bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec03fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd32a24a0 0x561bd342bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45794/0 (socket says 172.21.15.37:45794) 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec03fff700 1 -- 172.21.15.37:0/4142279459 learned_addr learned my addr 172.21.15.37:0/4142279459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd341f6a0 0x561bd34296c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561bd31bdba0 con 0x561bd32a24a0 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561bd32fc150 con 0x561bd338c160 2024-05-09T01:03:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561bd342c1d0 con 0x561bd341f6a0 2024-05-09T01:03:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec19bbeb80 10 client.0 _ll_register_callbacks cb 0x561bd31b36c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.203+0000 7fec08f44700 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd338c160 0x561bd3429000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.204+0000 7fec03fff700 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd341f6a0 0x561bd34296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.206+0000 7fec03fff700 1 -- 172.21.15.37:0/4142279459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd341f6a0 msgr2=0x561bd34296c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.206+0000 7fec03fff700 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd341f6a0 0x561bd34296c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.206+0000 7fec03fff700 1 -- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd338c160 msgr2=0x561bd3429000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.206+0000 7fec03fff700 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd338c160 0x561bd3429000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.206+0000 7fec03fff700 1 -- 172.21.15.37:0/4142279459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd31bd490 con 0x561bd32a24a0 2024-05-09T01:03:48.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.208+0000 7fec03fff700 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd32a24a0 0x561bd342bc80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7febf40129b0 tx=0x7febf400da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819bdfe6baa3fc9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:48.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.208+0000 7febe3fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:03:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.209+0000 7febe3fff700 1 -- 172.21.15.37:0/4142279459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4012e30 con 0x561bd32a24a0 2024-05-09T01:03:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.209+0000 7febe3fff700 1 -- 172.21.15.37:0/4142279459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7febf4011a00 con 0x561bd32a24a0 2024-05-09T01:03:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.209+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febec003d10 con 0x561bd32a24a0 2024-05-09T01:03:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.210+0000 7febe3fff700 1 -- 172.21.15.37:0/4142279459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7febf4025050 con 0x561bd32a24a0 2024-05-09T01:03:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.210+0000 7fec19bbeb80 10 client.15468 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.210+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561bd3436b70 con 0x561bd32a24a0 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7febe3fff700 1 -- 172.21.15.37:0/4142279459 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec003d10 con 0x561bd32a24a0 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7febe3fff700 1 -- 172.21.15.37:0/4142279459 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7febf401e3d0 con 0x561bd32a24a0 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7fec19bbeb80 10 client.15468 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7fec19bbeb80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7fec19bbeb80 20 client.15468 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd3439200 0x561bd343b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7fec19bbeb80 4 client.15468 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:48.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.211+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bd334f9d0 con 0x561bd3439200 2024-05-09T01:03:48.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.212+0000 7fec08f44700 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd3439200 0x561bd343b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.214+0000 7febe3fff700 10 client.15468 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.214+0000 7fec08f44700 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd3439200 0x561bd343b670 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e92e7b1d30732eb4 server_cookie=70f84249b1b081de in_seq=0 out_seq=0 2024-05-09T01:03:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.215+0000 7febe3fff700 1 -- 172.21.15.37:0/4142279459 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561bd334f9d0 con 0x561bd3439200 2024-05-09T01:03:48.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.215+0000 7febe3fff700 10 client.15468 handle_command_reply: tid=0 2024-05-09T01:03:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.215+0000 7fec19bbeb80 1 client.15468 shutdown 2024-05-09T01:03:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd32a24a0 msgr2=0x561bd342bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd32a24a0 0x561bd342bc80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7febf40129b0 tx=0x7febf400da40 comp rx=0 tx=0).stop 2024-05-09T01:03:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 shutdown_connections 2024-05-09T01:03:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd3439200 0x561bd343b670 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd341f6a0 0x561bd34296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd32a24a0 0x561bd342bc80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/4142279459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd338c160 0x561bd3429000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 >> 172.21.15.37:0/4142279459 conn(0x561bd33026a0 msgr2=0x561bd341a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7febe3fff700 0 client.15468 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 shutdown_connections 2024-05-09T01:03:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.216+0000 7fec19bbeb80 1 -- 172.21.15.37:0/4142279459 wait complete. 2024-05-09T01:03:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.217+0000 7fec19bbeb80 20 client.15468 trim_cache size 0 max 16384 2024-05-09T01:03:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.260+0000 7fec19bbeb80 1 Processor -- start 2024-05-09T01:03:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.260+0000 7fec19bbeb80 1 -- start start 2024-05-09T01:03:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.260+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3423510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.260+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd3440e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec19bbeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7febe400d340 con 0x561bd338c160 2024-05-09T01:03:48.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec08f44700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3423510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3423510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54844/0 (socket says 172.21.15.37:54844) 2024-05-09T01:03:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec03fff700 1 -- 172.21.15.37:0/1218478005 learned_addr learned my addr 172.21.15.37:0/1218478005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec19bbeb80 1 -- 172.21.15.37:0/1218478005 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7febe400ef70 con 0x561bd341f6a0 2024-05-09T01:03:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec19bbeb80 1 -- 172.21.15.37:0/1218478005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7febe400da10 con 0x561bd32a24a0 2024-05-09T01:03:48.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.261+0000 7fec03fff700 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd3440e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.262+0000 7fec03fff700 1 -- 172.21.15.37:0/1218478005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 msgr2=0x561bd3440e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.262+0000 7fec03fff700 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd3440e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.262+0000 7fec03fff700 1 -- 172.21.15.37:0/1218478005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 msgr2=0x561bd34350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.262+0000 7fec03fff700 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.262+0000 7fec03fff700 1 -- 172.21.15.37:0/1218478005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd341bcc0 con 0x561bd32a24a0 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.262+0000 7fec08f44700 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.262+0000 7fec03fff700 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3423510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x561bd342a610 tx=0x7febf4005c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49108873949bdd6e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.263+0000 7febfa7fc700 1 -- 172.21.15.37:0/1218478005 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf401e3d0 con 0x561bd32a24a0 2024-05-09T01:03:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.263+0000 7febfa7fc700 1 -- 172.21.15.37:0/1218478005 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febf401e570 con 0x561bd32a24a0 2024-05-09T01:03:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.263+0000 7febfa7fc700 1 -- 172.21.15.37:0/1218478005 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40050d0 con 0x561bd32a24a0 2024-05-09T01:03:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 -- 172.21.15.37:0/1218478005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 msgr2=0x561bd3423510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3423510 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x561bd342a610 tx=0x7febf4005c20 comp rx=0 tx=0).stop 2024-05-09T01:03:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 -- 172.21.15.37:0/1218478005 shutdown_connections 2024-05-09T01:03:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd3440e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd32a24a0 0x561bd3423510 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x561bd342a610 tx=0x7febf4005c20 comp rx=0 tx=0).stop 2024-05-09T01:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/1218478005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd34350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 -- 172.21.15.37:0/1218478005 >> 172.21.15.37:0/1218478005 conn(0x561bd33026a0 msgr2=0x561bd3422e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.264+0000 7fec19bbeb80 1 -- 172.21.15.37:0/1218478005 shutdown_connections 2024-05-09T01:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.265+0000 7fec19bbeb80 1 -- 172.21.15.37:0/1218478005 wait complete. 2024-05-09T01:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.265+0000 7fec19bbeb80 1 -- start start 2024-05-09T01:03:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.265+0000 7fec19bbeb80 1 Processor -- start 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd3431470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd34319b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec19bbeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd342e440 0x561bd342e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec19bbeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7febe400e7e0 con 0x561bd338c160 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec19bbeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7febe400e110 con 0x561bd341f6a0 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec19bbeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7febe400b2e0 con 0x561bd342e440 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec08f44700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd34319b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd342e440 0x561bd342e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec08f44700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd34319b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56458/0 (socket says 172.21.15.37:56458) 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd342e440 0x561bd342e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54852/0 (socket says 172.21.15.37:54852) 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec08f44700 1 -- 172.21.15.37:0/2098331616 learned_addr learned my addr 172.21.15.37:0/2098331616 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec19bbeb80 10 client.0 _ll_register_callbacks cb 0x561bd31b36c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec08f44700 1 -- 172.21.15.37:0/2098331616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd342e440 msgr2=0x561bd342e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec03fff700 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd3431470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec08f44700 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd342e440 0x561bd342e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.267+0000 7fec08f44700 1 -- 172.21.15.37:0/2098331616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 msgr2=0x561bd3431470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.268+0000 7fec08f44700 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd3431470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.268+0000 7fec08f44700 1 -- 172.21.15.37:0/2098331616 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd342ed90 con 0x561bd341f6a0 2024-05-09T01:03:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.268+0000 7fec03fff700 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd3431470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.268+0000 7fec08f44700 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd34319b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7febec005790 tx=0x7febec005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d093b9c1e2ebd5d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.269+0000 7febe3fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:03:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.269+0000 7febe3fff700 1 -- 172.21.15.37:0/2098331616 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febec0052e0 con 0x561bd341f6a0 2024-05-09T01:03:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.269+0000 7febe3fff700 1 -- 172.21.15.37:0/2098331616 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7febec005480 con 0x561bd341f6a0 2024-05-09T01:03:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.269+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf401e570 con 0x561bd341f6a0 2024-05-09T01:03:48.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.270+0000 7febe3fff700 1 -- 172.21.15.37:0/2098331616 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7febec003860 con 0x561bd341f6a0 2024-05-09T01:03:48.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.270+0000 7fec19bbeb80 10 client.25205 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:48.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.270+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561bd34b5530 con 0x561bd341f6a0 2024-05-09T01:03:48.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.270+0000 7febe3fff700 1 -- 172.21.15.37:0/2098331616 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febec031070 con 0x561bd341f6a0 2024-05-09T01:03:48.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7febe3fff700 1 -- 172.21.15.37:0/2098331616 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7febec035030 con 0x561bd341f6a0 2024-05-09T01:03:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7fec19bbeb80 10 client.25205 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7fec19bbeb80 10 client.25205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7fec19bbeb80 20 client.25205 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd34b5760 0x561bd34b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7fec19bbeb80 4 client.25205 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:03:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7febf401e570 con 0x561bd34b5760 2024-05-09T01:03:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.271+0000 7fec03fff700 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd34b5760 0x561bd34b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.273+0000 7fec03fff700 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd34b5760 0x561bd34b7b80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a2bdfd3e43a888e server_cookie=48ab8f9f4c173219 in_seq=0 out_seq=0 2024-05-09T01:03:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.273+0000 7febe3fff700 10 client.25205 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.273+0000 7febe3fff700 1 -- 172.21.15.37:0/2098331616 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7febf401e570 con 0x561bd34b5760 2024-05-09T01:03:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.274+0000 7febe3fff700 10 client.25205 handle_command_reply: tid=0 2024-05-09T01:03:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.274+0000 7fec19bbeb80 1 client.25205 shutdown 2024-05-09T01:03:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 msgr2=0x561bd34319b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd34319b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7febec005790 tx=0x7febec005720 comp rx=0 tx=0).stop 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 shutdown_connections 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561bd34b5760 0x561bd34b7b80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561bd342e440 0x561bd342e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7febe3fff700 0 client.25205 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561bd338c160 0x561bd3431470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 --2- 172.21.15.37:0/2098331616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561bd341f6a0 0x561bd34319b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 >> 172.21.15.37:0/2098331616 conn(0x561bd33026a0 msgr2=0x561bd3424110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.275+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 shutdown_connections 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.276+0000 7fec19bbeb80 1 -- 172.21.15.37:0/2098331616 wait complete. 2024-05-09T01:03:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.276+0000 7fec19bbeb80 20 client.25205 trim_cache size 0 max 16384 2024-05-09T01:03:48.278 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:03:48.278 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:03:48.278 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:03:48.278 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:03:48.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7febf00b2a50 msgr2=0x7febf00b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7febf00b2a50 0x7febf00b4f60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7febfc0a4fd0 tx=0x7febfc012000 comp rx=0 tx=0).stop 2024-05-09T01:03:48.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 msgr2=0x7fec0407eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:48.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec0407eb30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7febfc007ee0 tx=0x7febfc00d3b0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 shutdown_connections 2024-05-09T01:03:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7febf00b2a50 0x7febf00b4f60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec04110970 0x7fec0407eb30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec0410a990 0x7fec04085360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 --2- 172.21.15.37:0/931721752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0410b2e0 0x7fec0407e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.277+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 >> 172.21.15.37:0/931721752 conn(0x7fec04077c80 msgr2=0x7fec0407bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.278+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 shutdown_connections 2024-05-09T01:03:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:48.278+0000 7fec0b1a8700 1 -- 172.21.15.37:0/931721752 wait complete. 2024-05-09T01:03:48.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:48 smithi037 ceph-mon[30122]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 913 op/s 2024-05-09T01:03:48.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:48 smithi136 ceph-mon[34110]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 913 op/s 2024-05-09T01:03:48.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:48 smithi151 ceph-mon[34780]: pgmap v445: 97 pgs: 97 active+clean; 1.1 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 913 op/s 2024-05-09T01:03:48.850 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:03:48.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 -- 172.21.15.37:0/839056559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934108ac0 msgr2=0x7f893410aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 --2- 172.21.15.37:0/839056559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934108ac0 0x7f893410aee0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f892c009be0 tx=0x7f892c02a6f0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 -- 172.21.15.37:0/839056559 shutdown_connections 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 --2- 172.21.15.37:0/839056559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934108ac0 0x7f893410aee0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 --2- 172.21.15.37:0/839056559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8934103dc0 0x7f89341041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 --2- 172.21.15.37:0/839056559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8934102b80 0x7f8934103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 -- 172.21.15.37:0/839056559 >> 172.21.15.37:0/839056559 conn(0x7f89340fdd90 msgr2=0x7f8934100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.116+0000 7f8939215640 1 -- 172.21.15.37:0/839056559 shutdown_connections 2024-05-09T01:03:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.117+0000 7f8939215640 1 -- 172.21.15.37:0/839056559 wait complete. 2024-05-09T01:03:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.118+0000 7f8939215640 1 Processor -- start 2024-05-09T01:03:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.118+0000 7f8939215640 1 -- start start 2024-05-09T01:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.118+0000 7f8939215640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934102b80 0x7f89341a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8939215640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8934103dc0 0x7f89341a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8939215640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8934108ac0 0x7f89341a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8939215640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f893410d620 con 0x7f8934102b80 2024-05-09T01:03:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8939215640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f893410d4a0 con 0x7f8934103dc0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8939215640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f893410d7a0 con 0x7f8934108ac0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934102b80 0x7f89341a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f893359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8934108ac0 0x7f89341a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934102b80 0x7f89341a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45834/0 (socket says 172.21.15.37:45834) 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.119+0000 7f8932d9d640 1 -- 172.21.15.37:0/3822911143 learned_addr learned my addr 172.21.15.37:0/3822911143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.120+0000 7f893359e640 1 -- 172.21.15.37:0/3822911143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8934103dc0 msgr2=0x7f89341a0e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.120+0000 7f893359e640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8934103dc0 0x7f89341a0e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.120+0000 7f893359e640 1 -- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934102b80 msgr2=0x7f89341a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.120+0000 7f893359e640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934102b80 0x7f89341a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.120+0000 7f893359e640 1 -- 172.21.15.37:0/3822911143 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89341a8490 con 0x7f8934108ac0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.120+0000 7f893359e640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8934108ac0 0x7f89341a7e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f892c009b30 tx=0x7f892c0305d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.121+0000 7f891bfff640 1 -- 172.21.15.37:0/3822911143 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c052020 con 0x7f8934108ac0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.121+0000 7f891bfff640 1 -- 172.21.15.37:0/3822911143 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f892c003e20 con 0x7f8934108ac0 2024-05-09T01:03:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.121+0000 7f891bfff640 1 -- 172.21.15.37:0/3822911143 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c036040 con 0x7f8934108ac0 2024-05-09T01:03:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.121+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8934192d00 con 0x7f8934108ac0 2024-05-09T01:03:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.121+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341930e0 con 0x7f8934108ac0 2024-05-09T01:03:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.125+0000 7f89401a5740 1 Processor -- start 2024-05-09T01:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.127+0000 7f891bfff640 1 -- 172.21.15.37:0/3822911143 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f892c055020 con 0x7f8934108ac0 2024-05-09T01:03:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.127+0000 7f89401a5740 1 -- start start 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f89401a5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb651b1b0 0x55efb68bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f89401a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f89401a5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f89401a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55efb68237c0 con 0x55efb64f22f0 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f89401a5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55efb67bf0e0 con 0x55efb64fa4d0 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f89401a5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55efb681f780 con 0x55efb651b1b0 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45840/0 (socket says 172.21.15.37:45840) 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f8932d9d640 1 -- 172.21.15.37:0/782246995 learned_addr learned my addr 172.21.15.37:0/782246995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f893259c640 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb651b1b0 0x55efb68bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.128+0000 7f893259c640 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f8932d9d640 1 -- 172.21.15.37:0/782246995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb651b1b0 msgr2=0x55efb68bf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f8932d9d640 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb651b1b0 0x55efb68bf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f8932d9d640 1 -- 172.21.15.37:0/782246995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 msgr2=0x55efb68c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f8932d9d640 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f8932d9d640 1 -- 172.21.15.37:0/782246995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb67e87c0 con 0x55efb64f22f0 2024-05-09T01:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f893259c640 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb651b1b0 0x55efb68bf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f891bfff640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f891c0b2920 0x7f891c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.129+0000 7f891bfff640 1 -- 172.21.15.37:0/3822911143 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f892c1031b0 con 0x7f8934108ac0 2024-05-09T01:03:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.131+0000 7f8932d9d640 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68bfa50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8924009d90 tx=0x7f8924011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa4e4b4d4b68e8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.131+0000 7f893259c640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f891c0b2920 0x7f891c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.131+0000 7f89197fa640 1 -- 172.21.15.37:0/782246995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892401e070 con 0x55efb64f22f0 2024-05-09T01:03:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.131+0000 7f89197fa640 1 -- 172.21.15.37:0/782246995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8924019ae0 con 0x55efb64f22f0 2024-05-09T01:03:50.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.131+0000 7f89197fa640 1 -- 172.21.15.37:0/782246995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892400ea90 con 0x55efb64f22f0 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f89401a5740 1 -- 172.21.15.37:0/782246995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 msgr2=0x55efb68bfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f89401a5740 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68bfa50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8924009d90 tx=0x7f8924011810 comp rx=0 tx=0).stop 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f893259c640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f891c0b2920 0x7f891c0b4e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55efb68c06a0 tx=0x7f89280046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f89401a5740 1 -- 172.21.15.37:0/782246995 shutdown_connections 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f89401a5740 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f89401a5740 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68bfa50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f89401a5740 1 --2- 172.21.15.37:0/782246995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb651b1b0 0x55efb68bf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.133+0000 7f89401a5740 1 -- 172.21.15.37:0/782246995 >> 172.21.15.37:0/782246995 conn(0x55efb650f300 msgr2=0x55efb68bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.135+0000 7f89401a5740 1 -- 172.21.15.37:0/782246995 shutdown_connections 2024-05-09T01:03:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.135+0000 7f89401a5740 1 -- 172.21.15.37:0/782246995 wait complete. 2024-05-09T01:03:50.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.136+0000 7f89401a5740 1 -- start start 2024-05-09T01:03:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.136+0000 7f89401a5740 1 Processor -- start 2024-05-09T01:03:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f89401a5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f89401a5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f89401a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb651b1b0 0x55efb68d0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54884/0 (socket says 172.21.15.37:54884) 2024-05-09T01:03:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f893259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f893259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56494/0 (socket says 172.21.15.37:56494) 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f89401a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55efb68c73a0 con 0x55efb651b1b0 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f89401a5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55efb67aa9c0 con 0x55efb64fa4d0 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f89401a5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55efb68c7520 con 0x55efb64f22f0 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f89401a5740 10 client.0 _ll_register_callbacks cb 0x55efb67d7020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.137+0000 7f8932d9d640 1 -- 172.21.15.37:0/370330500 learned_addr learned my addr 172.21.15.37:0/370330500 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f893359e640 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb651b1b0 0x55efb68d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8932d9d640 1 -- 172.21.15.37:0/370330500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 msgr2=0x55efb68c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8932d9d640 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8932d9d640 1 -- 172.21.15.37:0/370330500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb651b1b0 msgr2=0x55efb68d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8932d9d640 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb651b1b0 0x55efb68d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8932d9d640 1 -- 172.21.15.37:0/370330500 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb67d11f0 con 0x55efb64f22f0 2024-05-09T01:03:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8932d9d640 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c9260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8924009ac0 tx=0x7f8924009af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a147c87c5c0c00 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8916ff5640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:50.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.138+0000 7f8916ff5640 1 -- 172.21.15.37:0/370330500 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924026020 con 0x55efb64f22f0 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8924019ae0 con 0x55efb64f22f0 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f8916ff5640 1 -- 172.21.15.37:0/370330500 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f89240198c0 con 0x55efb64f22f0 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f8916ff5640 1 -- 172.21.15.37:0/370330500 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f892401e040 con 0x55efb64f22f0 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f89401a5740 10 client.25243 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55efb6586790 con 0x55efb64f22f0 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f8916ff5640 1 -- 172.21.15.37:0/370330500 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8924019ae0 con 0x55efb64f22f0 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f8916ff5640 1 -- 172.21.15.37:0/370330500 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f89240046c0 con 0x55efb64f22f0 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f89401a5740 10 client.25243 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.139+0000 7f89401a5740 10 client.25243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.140+0000 7f89401a5740 20 client.25243 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.140+0000 7f89401a5740 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64d9d80 0x55efb68d6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.140+0000 7f89401a5740 4 client.25243 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.140+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efb68313d0 con 0x55efb64d9d80 2024-05-09T01:03:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.140+0000 7f893259c640 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64d9d80 0x55efb68d6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.141+0000 7f8916ff5640 10 client.25243 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.141+0000 7f893259c640 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64d9d80 0x55efb68d6a50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=187dd88ffa32a466 server_cookie=e0ecde943a61cba2 in_seq=0 out_seq=0 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f8916ff5640 1 -- 172.21.15.37:0/370330500 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55efb68313d0 con 0x55efb64d9d80 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f8916ff5640 10 client.25243 handle_command_reply: tid=0 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 client.25243 shutdown 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 msgr2=0x55efb68c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c9260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8924009ac0 tx=0x7f8924009af0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 shutdown_connections 2024-05-09T01:03:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64d9d80 0x55efb68d6a50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb651b1b0 0x55efb68d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb64fa4d0 0x55efb68c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.142+0000 7f89401a5740 1 --2- 172.21.15.37:0/370330500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c9260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.143+0000 7f8916ff5640 0 client.25243 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.143+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 >> 172.21.15.37:0/370330500 conn(0x55efb650f300 msgr2=0x55efb68bdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.143+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 shutdown_connections 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.143+0000 7f89401a5740 1 -- 172.21.15.37:0/370330500 wait complete. 2024-05-09T01:03:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.143+0000 7f89401a5740 20 client.25243 trim_cache size 0 max 16384 2024-05-09T01:03:50.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 Processor -- start 2024-05-09T01:03:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 -- start start 2024-05-09T01:03:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64fa4d0 0x55efb68d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89341cb050 con 0x55efb64fa4d0 2024-05-09T01:03:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f89341ccc80 con 0x55efb651b1b0 2024-05-09T01:03:50.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.174+0000 7f89401a5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f89341cb720 con 0x55efb64f22f0 2024-05-09T01:03:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.175+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.175+0000 7f8932d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54894/0 (socket says 172.21.15.37:54894) 2024-05-09T01:03:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.175+0000 7f8932d9d640 1 -- 172.21.15.37:0/4280195061 learned_addr learned my addr 172.21.15.37:0/4280195061 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.175+0000 7f893259c640 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64fa4d0 0x55efb68d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.176+0000 7f8932d9d640 1 -- 172.21.15.37:0/4280195061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 msgr2=0x55efb68d0bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:03:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.176+0000 7f8932d9d640 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.176+0000 7f8932d9d640 1 -- 172.21.15.37:0/4280195061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64fa4d0 msgr2=0x55efb68d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.176+0000 7f8932d9d640 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64fa4d0 0x55efb68d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.176+0000 7f8932d9d640 1 -- 172.21.15.37:0/4280195061 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb65fd5f0 con 0x55efb64f22f0 2024-05-09T01:03:50.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.177+0000 7f8932d9d640 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c7fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8924009c90 tx=0x7f8924004e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695c8fc0d255540 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.179+0000 7f8918ff9640 1 -- 172.21.15.37:0/4280195061 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924026040 con 0x55efb64f22f0 2024-05-09T01:03:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.179+0000 7f8918ff9640 1 -- 172.21.15.37:0/4280195061 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89240053d0 con 0x55efb64f22f0 2024-05-09T01:03:50.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.179+0000 7f8918ff9640 1 -- 172.21.15.37:0/4280195061 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924019d30 con 0x55efb64f22f0 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 -- 172.21.15.37:0/4280195061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 msgr2=0x55efb68c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c7fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8924009c90 tx=0x7f8924004e80 comp rx=0 tx=0).stop 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 -- 172.21.15.37:0/4280195061 shutdown_connections 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64fa4d0 0x55efb68d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 --2- 172.21.15.37:0/4280195061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64f22f0 0x55efb68c7fd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 -- 172.21.15.37:0/4280195061 >> 172.21.15.37:0/4280195061 conn(0x55efb650f300 msgr2=0x55efb68c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 -- 172.21.15.37:0/4280195061 shutdown_connections 2024-05-09T01:03:50.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.180+0000 7f89401a5740 1 -- 172.21.15.37:0/4280195061 wait complete. 2024-05-09T01:03:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.181+0000 7f89401a5740 1 -- start start 2024-05-09T01:03:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.181+0000 7f89401a5740 1 Processor -- start 2024-05-09T01:03:50.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.181+0000 7f89401a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.181+0000 7f89401a5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64fa4d0 0x55efb68cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.181+0000 7f89401a5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.181+0000 7f89401a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89341cc4f0 con 0x55efb64f22f0 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f89401a5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f89341cbe20 con 0x55efb651b1b0 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f89401a5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8934199e10 con 0x55efb64fa4d0 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f89401a5740 10 client.0 _ll_register_callbacks cb 0x7f892401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f893259c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64fa4d0 0x55efb68cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f893359e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f893359e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56506/0 (socket says 172.21.15.37:56506) 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f893359e640 1 -- 172.21.15.37:0/3989335130 learned_addr learned my addr 172.21.15.37:0/3989335130 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:50.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f8932d9d640 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f8932d9d640 1 -- 172.21.15.37:0/3989335130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64fa4d0 msgr2=0x55efb68cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f8932d9d640 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64fa4d0 0x55efb68cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f8932d9d640 1 -- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 msgr2=0x55efb68d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f8932d9d640 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.182+0000 7f8932d9d640 1 -- 172.21.15.37:0/3989335130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb67e7ed0 con 0x55efb64f22f0 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.183+0000 7f893359e640 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.183+0000 7f8932d9d640 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68caf10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55efb68ca220 tx=0x7f8924009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799b16ec03912933 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.183+0000 7f8916ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.183+0000 7f8916ff5640 1 -- 172.21.15.37:0/3989335130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924026040 con 0x55efb64f22f0 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.183+0000 7f8916ff5640 1 -- 172.21.15.37:0/3989335130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f892400e530 con 0x55efb64f22f0 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.183+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89240053d0 con 0x55efb64f22f0 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.183+0000 7f8916ff5640 1 -- 172.21.15.37:0/3989335130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f8924004c60 con 0x55efb64f22f0 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.184+0000 7f89401a5740 10 client.15489 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:50.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.184+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55efb694e2b0 con 0x55efb64f22f0 2024-05-09T01:03:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.185+0000 7f8916ff5640 1 -- 172.21.15.37:0/3989335130 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89240053d0 con 0x55efb64f22f0 2024-05-09T01:03:50.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.185+0000 7f8916ff5640 1 -- 172.21.15.37:0/3989335130 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f892403e030 con 0x55efb64f22f0 2024-05-09T01:03:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.186+0000 7f89401a5740 10 client.15489 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.186+0000 7f89401a5740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:03:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.186+0000 7f89401a5740 20 client.15489 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.186+0000 7f89401a5740 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64af1c0 0x55efb6950d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.186+0000 7f89401a5740 4 client.15489 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:03:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.186+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55efb682b240 con 0x55efb64af1c0 2024-05-09T01:03:50.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.186+0000 7f893259c640 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64af1c0 0x55efb6950d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.187+0000 7f893259c640 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64af1c0 0x55efb6950d30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=707ecac3666a62a6 server_cookie=649f77d6b06d16f6 in_seq=0 out_seq=0 2024-05-09T01:03:50.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.187+0000 7f8916ff5640 10 client.15489 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.198+0000 7f8916ff5640 1 -- 172.21.15.37:0/3989335130 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55efb682b240 con 0x55efb64af1c0 2024-05-09T01:03:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.198+0000 7f8916ff5640 10 client.15489 handle_command_reply: tid=0 2024-05-09T01:03:50.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.198+0000 7f89401a5740 1 client.15489 shutdown 2024-05-09T01:03:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 msgr2=0x55efb68caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68caf10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55efb68ca220 tx=0x7f8924009b00 comp rx=0 tx=0).stop 2024-05-09T01:03:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 shutdown_connections 2024-05-09T01:03:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55efb64af1c0 0x55efb6950d30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55efb651b1b0 0x55efb68d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55efb64fa4d0 0x55efb68cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 --2- 172.21.15.37:0/3989335130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55efb64f22f0 0x55efb68caf10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 >> 172.21.15.37:0/3989335130 conn(0x55efb650f300 msgr2=0x55efb68c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f8916ff5640 0 client.15489 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 shutdown_connections 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 1 -- 172.21.15.37:0/3989335130 wait complete. 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.200+0000 7f89401a5740 20 client.15489 trim_cache size 0 max 16384 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:03:50.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:03:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f891c0b2920 msgr2=0x7f891c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f891c0b2920 0x7f891c0b4e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55efb68c06a0 tx=0x7f89280046c0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8934108ac0 msgr2=0x7f89341a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8934108ac0 0x7f89341a7e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f892c009b30 tx=0x7f892c0305d0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 shutdown_connections 2024-05-09T01:03:50.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8934108ac0 0x7f89341a7e20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f891c0b2920 0x7f891c0b4e30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8934103dc0 0x7f89341a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 --2- 172.21.15.37:0/3822911143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8934102b80 0x7f89341a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.201+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 >> 172.21.15.37:0/3822911143 conn(0x7f89340fdd90 msgr2=0x7f8934104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.202+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 shutdown_connections 2024-05-09T01:03:50.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:03:50.203+0000 7f8939215640 1 -- 172.21.15.37:0/3822911143 wait complete. 2024-05-09T01:03:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 90.0 s, 4843.1 tps, lat 20.535 ms stddev 22.147 2024-05-09T01:03:50.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:50 smithi037 ceph-mon[30122]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-05-09T01:03:50.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:50 smithi136 ceph-mon[34110]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-05-09T01:03:50.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:50 smithi151 ceph-mon[34780]: pgmap v446: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-05-09T01:03:51.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.334+0000 7fd091beb700 1 -- 172.21.15.37:0/4204755329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 msgr2=0x7fd08c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:51.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.334+0000 7fd091beb700 1 --2- 172.21.15.37:0/4204755329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 0x7fd08c109330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd080009990 tx=0x7fd080009ca0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.335+0000 7fd091beb700 1 -- 172.21.15.37:0/4204755329 shutdown_connections 2024-05-09T01:03:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.335+0000 7fd091beb700 1 --2- 172.21.15.37:0/4204755329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd08c109870 0x7fd08c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.335+0000 7fd091beb700 1 --2- 172.21.15.37:0/4204755329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd08c1045f0 0x7fd08c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.335+0000 7fd091beb700 1 --2- 172.21.15.37:0/4204755329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 0x7fd08c109330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.335+0000 7fd091beb700 1 -- 172.21.15.37:0/4204755329 >> 172.21.15.37:0/4204755329 conn(0x7fd08c100040 msgr2=0x7fd08c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.335+0000 7fd091beb700 1 -- 172.21.15.37:0/4204755329 shutdown_connections 2024-05-09T01:03:51.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.335+0000 7fd091beb700 1 -- 172.21.15.37:0/4204755329 wait complete. 2024-05-09T01:03:51.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.336+0000 7fd091beb700 1 Processor -- start 2024-05-09T01:03:51.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.336+0000 7fd091beb700 1 -- start start 2024-05-09T01:03:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd091beb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd08c1045f0 0x7fd08c19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd091beb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 0x7fd08c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd091beb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd08c109870 0x7fd08c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd091beb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c1144d0 con 0x7fd08c1045f0 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd091beb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c114350 con 0x7fd08c108f20 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd091beb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c114650 con 0x7fd08c109870 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd08affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 0x7fd08c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd08bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd08c109870 0x7fd08c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd08affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 0x7fd08c19b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56516/0 (socket says 172.21.15.37:56516) 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.337+0000 7fd08affd700 1 -- 172.21.15.37:0/3106018670 learned_addr learned my addr 172.21.15.37:0/3106018670 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.338+0000 7fd08bfff700 1 -- 172.21.15.37:0/3106018670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 msgr2=0x7fd08c19b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.338+0000 7fd08bfff700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 0x7fd08c19b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.338+0000 7fd08bfff700 1 -- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd08c1045f0 msgr2=0x7fd08c19aea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.338+0000 7fd08bfff700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd08c1045f0 0x7fd08c19aea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.338+0000 7fd08bfff700 1 -- 172.21.15.37:0/3106018670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c19fd70 con 0x7fd08c109870 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.338+0000 7fd08bfff700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd08c109870 0x7fd08c19f6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00e900 tx=0x7fd07c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.338+0000 7fd088ff9700 1 -- 172.21.15.37:0/3106018670 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c013be0 con 0x7fd08c109870 2024-05-09T01:03:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.339+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c1a0060 con 0x7fd08c109870 2024-05-09T01:03:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.339+0000 7fd088ff9700 1 -- 172.21.15.37:0/3106018670 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd07c00ee50 con 0x7fd08c109870 2024-05-09T01:03:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.339+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1a04e0 con 0x7fd08c109870 2024-05-09T01:03:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.340+0000 7fd088ff9700 1 -- 172.21.15.37:0/3106018670 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c003680 con 0x7fd08c109870 2024-05-09T01:03:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.341+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd078005330 con 0x7fd08c109870 2024-05-09T01:03:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.342+0000 7fd088ff9700 1 -- 172.21.15.37:0/3106018670 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd07c022020 con 0x7fd08c109870 2024-05-09T01:03:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.343+0000 7fd088ff9700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b2900 0x7fd0740b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.343+0000 7fd088ff9700 1 -- 172.21.15.37:0/3106018670 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd07c0e5e00 con 0x7fd08c109870 2024-05-09T01:03:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.343+0000 7fd08b7fe700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b2900 0x7fd0740b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.344+0000 7fd08b7fe700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b2900 0x7fd0740b4e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd08400e350 tx=0x7fd08400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.348+0000 7fd088ff9700 1 -- 172.21.15.37:0/3106018670 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd07c0adbc0 con 0x7fd08c109870 2024-05-09T01:03:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.816+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0780058f0 con 0x7fd08c109870 2024-05-09T01:03:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.817+0000 7fd088ff9700 1 -- 172.21.15.37:0/3106018670 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11944 (secure 0 0 0) 0x7fd07c0ad4c0 con 0x7fd08c109870 2024-05-09T01:03:51.817 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:03:51.817 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:02:21.655821+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.820+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b2900 msgr2=0x7fd0740b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.820+0000 7fd091beb700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b2900 0x7fd0740b4e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd08400e350 tx=0x7fd08400b040 comp rx=0 tx=0).stop 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.820+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd08c109870 msgr2=0x7fd08c19f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.820+0000 7fd091beb700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd08c109870 0x7fd08c19f6d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00e900 tx=0x7fd07c00ec10 comp rx=0 tx=0).stop 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.820+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 shutdown_connections 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.820+0000 7fd091beb700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b2900 0x7fd0740b4e10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.820+0000 7fd091beb700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd08c109870 0x7fd08c19f6d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.821+0000 7fd091beb700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd08c1045f0 0x7fd08c19aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.821+0000 7fd091beb700 1 --2- 172.21.15.37:0/3106018670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd08c108f20 0x7fd08c19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.821+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 >> 172.21.15.37:0/3106018670 conn(0x7fd08c100040 msgr2=0x7fd08c10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.821+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 shutdown_connections 2024-05-09T01:03:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:51.821+0000 7fd091beb700 1 -- 172.21.15.37:0/3106018670 wait complete. 2024-05-09T01:03:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2024-05-09T01:03:52.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:52 smithi037 ceph-mon[30122]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-05-09T01:03:52.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:52 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3106018670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:03:52.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:03:52.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:52 smithi136 ceph-mon[34110]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-05-09T01:03:52.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:52 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3106018670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:03:52.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:52 smithi151 ceph-mon[34780]: pgmap v447: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-05-09T01:03:52.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:52 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3106018670' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:03:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:54.447 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:54 smithi037 ceph-mon[30122]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-05-09T01:03:54.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:54 smithi136 ceph-mon[34110]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-05-09T01:03:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:54 smithi151 ceph-mon[34780]: pgmap v448: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 867 op/s 2024-05-09T01:03:55.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.138+0000 7f8267527700 1 -- 172.21.15.37:0/3555993913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 msgr2=0x7f8260108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.138+0000 7f8267527700 1 --2- 172.21.15.37:0/3555993913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 0x7f8260108200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8250009920 tx=0x7f8250009c30 comp rx=0 tx=0).stop 2024-05-09T01:03:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.139+0000 7f8267527700 1 -- 172.21.15.37:0/3555993913 shutdown_connections 2024-05-09T01:03:55.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.139+0000 7f8267527700 1 --2- 172.21.15.37:0/3555993913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 0x7f82601100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.139+0000 7f8267527700 1 --2- 172.21.15.37:0/3555993913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82601034c0 0x7f82601038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.139+0000 7f8267527700 1 --2- 172.21.15.37:0/3555993913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 0x7f8260108200 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.139+0000 7f8267527700 1 -- 172.21.15.37:0/3555993913 >> 172.21.15.37:0/3555993913 conn(0x7f82600fedc0 msgr2=0x7f82601011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.140+0000 7f8267527700 1 -- 172.21.15.37:0/3555993913 shutdown_connections 2024-05-09T01:03:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.140+0000 7f8267527700 1 -- 172.21.15.37:0/3555993913 wait complete. 2024-05-09T01:03:55.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.141+0000 7f8267527700 1 Processor -- start 2024-05-09T01:03:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.141+0000 7f8267527700 1 -- start start 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.142+0000 7f8267527700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82601034c0 0x7f82601a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.142+0000 7f8267527700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 0x7f82601a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.142+0000 7f8267527700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 0x7f82601a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.142+0000 7f8267527700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8260113350 con 0x7f8260107df0 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.142+0000 7f8267527700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82601131d0 con 0x7f8260108740 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.142+0000 7f8267527700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82601134d0 con 0x7f82601034c0 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 0x7f82601a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 0x7f82601a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49388/0 (socket says 172.21.15.37:49388) 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 -- 172.21.15.37:0/1189982886 learned_addr learned my addr 172.21.15.37:0/1189982886 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 0x7f82601a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.142+0000 7f82652c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82601034c0 0x7f82601a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 -- 172.21.15.37:0/1189982886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82601034c0 msgr2=0x7f82601a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82601034c0 0x7f82601a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 -- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 msgr2=0x7f82601a1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 0x7f82601a1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 -- 172.21.15.37:0/1189982886 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82601a6240 con 0x7f8260108740 2024-05-09T01:03:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 0x7f82601a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.143+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 0x7f82601a5c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8258007fd0 tx=0x7f825800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.144+0000 7f82567fc700 1 -- 172.21.15.37:0/1189982886 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258004bb0 con 0x7f8260108740 2024-05-09T01:03:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.144+0000 7f82567fc700 1 -- 172.21.15.37:0/1189982886 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8258004d50 con 0x7f8260108740 2024-05-09T01:03:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.144+0000 7f82567fc700 1 -- 172.21.15.37:0/1189982886 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82580059c0 con 0x7f8260108740 2024-05-09T01:03:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.144+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82601a6530 con 0x7f8260108740 2024-05-09T01:03:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.144+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82601a69f0 con 0x7f8260108740 2024-05-09T01:03:55.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.149+0000 7f82567fc700 1 -- 172.21.15.37:0/1189982886 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f825801a020 con 0x7f8260108740 2024-05-09T01:03:55.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.151+0000 7f8275f3db80 1 Processor -- start 2024-05-09T01:03:55.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.151+0000 7f82567fc700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f824c0b2900 0x7f824c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.151+0000 7f8275f3db80 1 -- start start 2024-05-09T01:03:55.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.151+0000 7f82567fc700 1 -- 172.21.15.37:0/1189982886 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82580e16c0 con 0x7f8260108740 2024-05-09T01:03:55.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c6c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c6ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c66ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8275f3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab09b88ff0 con 0x55ab09bd3160 2024-05-09T01:03:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8264ac2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c6ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8275f3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ab09b277f0 con 0x55ab09ae94a0 2024-05-09T01:03:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8275f3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab09b84fb0 con 0x55ab09c666a0 2024-05-09T01:03:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8265ac4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c66ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.152+0000 7f8264ac2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c6ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49400/0 (socket says 172.21.15.37:49400) 2024-05-09T01:03:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 -- 172.21.15.37:0/2598564832 learned_addr learned my addr 172.21.15.37:0/2598564832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f82652c3700 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c6c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f824c0b2900 0x7f824c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 -- 172.21.15.37:0/2598564832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 msgr2=0x55ab09c66ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c66ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 -- 172.21.15.37:0/2598564832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 msgr2=0x55ab09c6c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c6c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 -- 172.21.15.37:0/2598564832 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab09b1f370 con 0x55ab09ae94a0 2024-05-09T01:03:55.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.153+0000 7f8264ac2700 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c6ca30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8250009920 tx=0x7f825000bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96281d296e871010 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:55.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.154+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f824c0b2900 0x7f824c0b4e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8250016000 tx=0x7f8250021000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.154+0000 7f824b7fe700 1 -- 172.21.15.37:0/2598564832 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825002a070 con 0x55ab09ae94a0 2024-05-09T01:03:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.154+0000 7f824b7fe700 1 -- 172.21.15.37:0/2598564832 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82500053f0 con 0x55ab09ae94a0 2024-05-09T01:03:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.154+0000 7f824b7fe700 1 -- 172.21.15.37:0/2598564832 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250020040 con 0x55ab09ae94a0 2024-05-09T01:03:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.155+0000 7f8275f3db80 1 -- 172.21.15.37:0/2598564832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 msgr2=0x55ab09c6ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.155+0000 7f8275f3db80 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c6ca30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8250009920 tx=0x7f825000bcd0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 -- 172.21.15.37:0/2598564832 shutdown_connections 2024-05-09T01:03:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c66ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c6c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 --2- 172.21.15.37:0/2598564832 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c6ca30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 -- 172.21.15.37:0/2598564832 >> 172.21.15.37:0/2598564832 conn(0x55ab09b496a0 msgr2=0x55ab09c61400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 -- 172.21.15.37:0/2598564832 shutdown_connections 2024-05-09T01:03:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 -- 172.21.15.37:0/2598564832 wait complete. 2024-05-09T01:03:55.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.156+0000 7f8275f3db80 1 -- start start 2024-05-09T01:03:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 1 Processor -- start 2024-05-09T01:03:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c70c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab09a04ba0 con 0x55ab09bd3160 2024-05-09T01:03:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ab09b43150 con 0x55ab09ae94a0 2024-05-09T01:03:55.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab09c731d0 con 0x55ab09c666a0 2024-05-09T01:03:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f82652c3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f8275f3db80 10 client.0 _ll_register_callbacks cb 0x55ab099fa6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.157+0000 7f82652c3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c701d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49402/0 (socket says 172.21.15.37:49402) 2024-05-09T01:03:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f82652c3700 1 -- 172.21.15.37:0/1849469666 learned_addr learned my addr 172.21.15.37:0/1849469666 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c70c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f82652c3700 1 -- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 msgr2=0x55ab09c70c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f82652c3700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c70c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f82652c3700 1 -- 172.21.15.37:0/1849469666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 msgr2=0x55ab09c70710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f82652c3700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c70710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f82652c3700 1 -- 172.21.15.37:0/1849469666 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab09a04490 con 0x55ab09ae94a0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.158+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c70c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.159+0000 7f82652c3700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c701d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f825c012a70 tx=0x7f825c012d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=189350da7cf58985 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.159+0000 7f8248ff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.159+0000 7f8248ff9700 1 -- 172.21.15.37:0/1849469666 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c01f060 con 0x55ab09ae94a0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.159+0000 7f8248ff9700 1 -- 172.21.15.37:0/1849469666 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f825c010ad0 con 0x55ab09ae94a0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82500053f0 con 0x55ab09ae94a0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8248ff9700 1 -- 172.21.15.37:0/1849469666 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f825c00ae30 con 0x55ab09ae94a0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8275f3db80 10 client.25235 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ab09c7da40 con 0x55ab09ae94a0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8248ff9700 1 -- 172.21.15.37:0/1849469666 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f825c010cd0 con 0x55ab09ae94a0 2024-05-09T01:03:55.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8248ff9700 1 -- 172.21.15.37:0/1849469666 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f825c024070 con 0x55ab09ae94a0 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8275f3db80 10 client.25235 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.160+0000 7f8275f3db80 10 client.25235 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.161+0000 7f8275f3db80 20 client.25235 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.161+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09c80080 0x55ab09c824d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.161+0000 7f8275f3db80 4 client.25235 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.161+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f82500053f0 con 0x55ab09c80080 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.161+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09c80080 0x55ab09c824d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.163+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09c80080 0x55ab09c824d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42042abbb7139703 server_cookie=347ab03673a38c62 in_seq=0 out_seq=0 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.163+0000 7f8248ff9700 10 client.25235 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8248ff9700 1 -- 172.21.15.37:0/1849469666 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f82500053f0 con 0x55ab09c80080 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8248ff9700 10 client.25235 handle_command_reply: tid=0 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 client.25235 shutdown 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 msgr2=0x55ab09c701d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c701d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f825c012a70 tx=0x7f825c012d80 comp rx=0 tx=0).stop 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 shutdown_connections 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09c80080 0x55ab09c824d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c70c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09ae94a0 0x55ab09c701d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1849469666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09bd3160 0x55ab09c70710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 >> 172.21.15.37:0/1849469666 conn(0x55ab09b496a0 msgr2=0x55ab09c611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8248ff9700 0 client.25235 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 shutdown_connections 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.164+0000 7f8275f3db80 1 -- 172.21.15.37:0/1849469666 wait complete. 2024-05-09T01:03:55.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.165+0000 7f8275f3db80 20 client.25235 trim_cache size 0 max 16384 2024-05-09T01:03:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 Processor -- start 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 -- start start 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c6dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09bd3160 0x55ab09c70a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c7c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b4e60 con 0x55ab09ae94a0 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b6a90 con 0x55ab09bd3160 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.195+0000 7f8275f3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b5530 con 0x55ab09c666a0 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8264ac2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09bd3160 0x55ab09c70a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8264ac2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09bd3160 0x55ab09c70a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49412/0 (socket says 172.21.15.37:49412) 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8264ac2700 1 -- 172.21.15.37:0/1242605422 learned_addr learned my addr 172.21.15.37:0/1242605422 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c7c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f82652c3700 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c6dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8265ac4700 1 -- 172.21.15.37:0/1242605422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09bd3160 msgr2=0x55ab09c70a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09bd3160 0x55ab09c70a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8265ac4700 1 -- 172.21.15.37:0/1242605422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 msgr2=0x55ab09c6dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c6dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8265ac4700 1 -- 172.21.15.37:0/1242605422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab09c67640 con 0x55ab09c666a0 2024-05-09T01:03:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.196+0000 7f8264ac2700 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09bd3160 0x55ab09c70a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:03:55.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.197+0000 7f82652c3700 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c6dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.197+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c7c010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f82580df2b0 tx=0x7f825800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3007c635dcd5201 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.198+0000 7f824affd700 1 -- 172.21.15.37:0/1242605422 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82580a84f0 con 0x55ab09c666a0 2024-05-09T01:03:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.198+0000 7f824affd700 1 -- 172.21.15.37:0/1242605422 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82580a8890 con 0x55ab09c666a0 2024-05-09T01:03:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.198+0000 7f824affd700 1 -- 172.21.15.37:0/1242605422 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258020e20 con 0x55ab09c666a0 2024-05-09T01:03:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 -- 172.21.15.37:0/1242605422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 msgr2=0x55ab09c7c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c7c010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f82580df2b0 tx=0x7f825800b040 comp rx=0 tx=0).stop 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 -- 172.21.15.37:0/1242605422 shutdown_connections 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09c666a0 0x55ab09c7c010 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c6dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1242605422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09bd3160 0x55ab09c70a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 -- 172.21.15.37:0/1242605422 >> 172.21.15.37:0/1242605422 conn(0x55ab09b496a0 msgr2=0x55ab09c6eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 -- 172.21.15.37:0/1242605422 shutdown_connections 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 -- 172.21.15.37:0/1242605422 wait complete. 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 -- start start 2024-05-09T01:03:55.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.199+0000 7f8275f3db80 1 Processor -- start 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c86d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09bd3160 0x55ab09c87250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8275f3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09c666a0 0x55ab09ce88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8275f3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b6300 con 0x55ab09ae94a0 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8275f3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b5c30 con 0x55ab09c666a0 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8275f3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82601b2e80 con 0x55ab09bd3160 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8275f3db80 10 client.0 _ll_register_callbacks cb 0x55ab099fa6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8264ac2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09bd3160 0x55ab09c87250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8265ac4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09c666a0 0x55ab09ce88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8265ac4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09c666a0 0x55ab09ce88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49428/0 (socket says 172.21.15.37:49428) 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.200+0000 7f8265ac4700 1 -- 172.21.15.37:0/1445537225 learned_addr learned my addr 172.21.15.37:0/1445537225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.201+0000 7f8265ac4700 1 -- 172.21.15.37:0/1445537225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09bd3160 msgr2=0x55ab09c87250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.201+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09bd3160 0x55ab09c87250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.201+0000 7f8265ac4700 1 -- 172.21.15.37:0/1445537225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 msgr2=0x55ab09c86d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.201+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c86d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.201+0000 7f8265ac4700 1 -- 172.21.15.37:0/1445537225 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab09c87b30 con 0x55ab09c666a0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.201+0000 7f8265ac4700 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09c666a0 0x55ab09ce88c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f82580a4e00 tx=0x7f82580194f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=946bbc4b8881741c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.201+0000 7f8248ff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.202+0000 7f8248ff9700 1 -- 172.21.15.37:0/1445537225 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82580ad130 con 0x55ab09c666a0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.202+0000 7f8248ff9700 1 -- 172.21.15.37:0/1445537225 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82580a5370 con 0x55ab09c666a0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.202+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82580a8890 con 0x55ab09c666a0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.202+0000 7f8248ff9700 1 -- 172.21.15.37:0/1445537225 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f82580a9480 con 0x55ab09c666a0 2024-05-09T01:03:55.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.202+0000 7f8275f3db80 10 client.25241 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.202+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ab09ce9de0 con 0x55ab09c666a0 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.202+0000 7f8248ff9700 1 -- 172.21.15.37:0/1445537225 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82580c8070 con 0x55ab09c666a0 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f8248ff9700 1 -- 172.21.15.37:0/1445537225 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f8258090050 con 0x55ab09c666a0 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f8275f3db80 10 client.25241 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f8275f3db80 10 client.25241 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f8275f3db80 20 client.25241 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09cea430 0x55ab09cec850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f8275f3db80 4 client.25241 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f82580a8890 con 0x55ab09cea430 2024-05-09T01:03:55.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.203+0000 7f82652c3700 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09cea430 0x55ab09cec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f82652c3700 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09cea430 0x55ab09cec850 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4e516e11cede5e23 server_cookie=19b87b7a5683bcf2 in_seq=0 out_seq=0 2024-05-09T01:03:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8248ff9700 10 client.25241 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:03:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8248ff9700 1 -- 172.21.15.37:0/1445537225 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f82580a8890 con 0x55ab09cea430 2024-05-09T01:03:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8248ff9700 10 client.25241 handle_command_reply: tid=0 2024-05-09T01:03:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 client.25241 shutdown 2024-05-09T01:03:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09c666a0 msgr2=0x55ab09ce88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09c666a0 0x55ab09ce88c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f82580a4e00 tx=0x7f82580194f0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 shutdown_connections 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55ab09cea430 0x55ab09cec850 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ab09c666a0 0x55ab09ce88c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab09ae94a0 0x55ab09c86d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 --2- 172.21.15.37:0/1445537225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab09bd3160 0x55ab09c87250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.205+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 >> 172.21.15.37:0/1445537225 conn(0x55ab09b496a0 msgr2=0x55ab09c69e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.206+0000 7f8248ff9700 0 client.25241 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.206+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 shutdown_connections 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.206+0000 7f8275f3db80 1 -- 172.21.15.37:0/1445537225 wait complete. 2024-05-09T01:03:55.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.206+0000 7f8275f3db80 20 client.25241 trim_cache size 0 max 16384 2024-05-09T01:03:55.209 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:03:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f824c0b2900 msgr2=0x7f824c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f824c0b2900 0x7f824c0b4e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8250016000 tx=0x7f8250021000 comp rx=0 tx=0).stop 2024-05-09T01:03:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 msgr2=0x7f82601a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 0x7f82601a5c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8258007fd0 tx=0x7f825800d3b0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 shutdown_connections 2024-05-09T01:03:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f824c0b2900 0x7f824c0b4e10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260108740 0x7f82601a5c50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82601034c0 0x7f82601a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 --2- 172.21.15.37:0/1189982886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8260107df0 0x7f82601a1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.208+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 >> 172.21.15.37:0/1189982886 conn(0x7f82600fedc0 msgr2=0x7f826006b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.209+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 shutdown_connections 2024-05-09T01:03:55.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:55.209+0000 7f8267527700 1 -- 172.21.15.37:0/1189982886 wait complete. 2024-05-09T01:03:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 95.0 s, 3943.2 tps, lat 25.430 ms stddev 28.292 2024-05-09T01:03:56.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:03:56.439 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:03:56.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:56 smithi037 ceph-mon[30122]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-05-09T01:03:56.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:56 smithi136 ceph-mon[34110]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-05-09T01:03:56.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:56 smithi151 ceph-mon[34780]: pgmap v449: 97 pgs: 97 active+clean; 1.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-05-09T01:03:58.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.485+0000 7f660705c700 1 -- 172.21.15.37:0/3853493237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 msgr2=0x7f66001188f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.485+0000 7f660705c700 1 --2- 172.21.15.37:0/3853493237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001188f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009990 tx=0x7f65f0009ca0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.485+0000 7f660705c700 1 -- 172.21.15.37:0/3853493237 shutdown_connections 2024-05-09T01:03:58.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.485+0000 7f660705c700 1 --2- 172.21.15.37:0/3853493237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001188f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.485+0000 7f660705c700 1 --2- 172.21.15.37:0/3853493237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f660010c840 0x7f660010cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.485+0000 7f660705c700 1 --2- 172.21.15.37:0/3853493237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6600110660 0x7f6600110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.485+0000 7f660705c700 1 -- 172.21.15.37:0/3853493237 >> 172.21.15.37:0/3853493237 conn(0x7f660006f4d0 msgr2=0x7f660006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.486+0000 7f660705c700 1 -- 172.21.15.37:0/3853493237 shutdown_connections 2024-05-09T01:03:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.486+0000 7f660705c700 1 -- 172.21.15.37:0/3853493237 wait complete. 2024-05-09T01:03:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.487+0000 7f660705c700 1 Processor -- start 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.487+0000 7f660705c700 1 -- start start 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f660705c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f660010c840 0x7f66001a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f660705c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6600110660 0x7f66001a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f660705c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f660705c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f660011bbb0 con 0x7f6600110fb0 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f660705c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f660011ba30 con 0x7f6600110660 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f660705c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f660011bd30 con 0x7f660010c840 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f66055f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f66055f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001a6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52496/0 (socket says 172.21.15.37:52496) 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f66055f9700 1 -- 172.21.15.37:0/2928552052 learned_addr learned my addr 172.21.15.37:0/2928552052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.488+0000 7f65fffff700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6600110660 0x7f66001a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.489+0000 7f66055f9700 1 -- 172.21.15.37:0/2928552052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f660010c840 msgr2=0x7f66001a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.489+0000 7f66055f9700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f660010c840 0x7f66001a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.489+0000 7f66055f9700 1 -- 172.21.15.37:0/2928552052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6600110660 msgr2=0x7f66001a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.489+0000 7f66055f9700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6600110660 0x7f66001a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.489+0000 7f66055f9700 1 -- 172.21.15.37:0/2928552052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66001a7330 con 0x7f6600110fb0 2024-05-09T01:03:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.489+0000 7f65fffff700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6600110660 0x7f66001a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:58.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.490+0000 7f66055f9700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001a6c90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f65f0006010 tx=0x7f65f0005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.490+0000 7f65fdffb700 1 -- 172.21.15.37:0/2928552052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f002a070 con 0x7f6600110fb0 2024-05-09T01:03:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.491+0000 7f65fdffb700 1 -- 172.21.15.37:0/2928552052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f000f460 con 0x7f6600110fb0 2024-05-09T01:03:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.491+0000 7f65fdffb700 1 -- 172.21.15.37:0/2928552052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0025680 con 0x7f6600110fb0 2024-05-09T01:03:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.492+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66001a75c0 con 0x7f6600110fb0 2024-05-09T01:03:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.492+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66001a7a50 con 0x7f6600110fb0 2024-05-09T01:03:58.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 Processor -- start 2024-05-09T01:03:58.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f65fdffb700 1 -- 172.21.15.37:0/2928552052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f65f002d070 con 0x7f6600110fb0 2024-05-09T01:03:58.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 -- start start 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558bfea490a0 con 0x558bfea23d00 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558bfe9ee9a0 con 0x558bfe9a94a0 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.498+0000 7f6615a72b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558bfea45060 con 0x558bfeb2f1e0 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52498/0 (socket says 172.21.15.37:52498) 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 -- 172.21.15.37:0/4178227918 learned_addr learned my addr 172.21.15.37:0/4178227918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 -- 172.21.15.37:0/4178227918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 msgr2=0x558bfeb2f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 -- 172.21.15.37:0/4178227918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 msgr2=0x558bfeb2b030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:03:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.499+0000 7f65fffff700 1 -- 172.21.15.37:0/4178227918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfe9df500 con 0x558bfea23d00 2024-05-09T01:03:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.500+0000 7f65fffff700 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2aad0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f65f8021fa0 tx=0x7f65f8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8603f19d41c98364 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.500+0000 7f65fdffb700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f65e80b2900 0x7f65e80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.500+0000 7f65e6ffd700 1 -- 172.21.15.37:0/4178227918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8020dd0 con 0x558bfea23d00 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.500+0000 7f65fdffb700 1 -- 172.21.15.37:0/2928552052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f65f00e53b0 con 0x7f6600110fb0 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.501+0000 7f6604df8700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f65e80b2900 0x7f65e80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.501+0000 7f65e6ffd700 1 -- 172.21.15.37:0/4178227918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f80090d0 con 0x558bfea23d00 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.502+0000 7f65e6ffd700 1 -- 172.21.15.37:0/4178227918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8017ac0 con 0x558bfea23d00 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.502+0000 7f6615a72b80 1 -- 172.21.15.37:0/4178227918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 msgr2=0x558bfeb2aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.502+0000 7f6615a72b80 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2aad0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f65f8021fa0 tx=0x7f65f8009920 comp rx=0 tx=0).stop 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.502+0000 7f6604df8700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f65e80b2900 0x7f65e80b4e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005950 tx=0x7f65f40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.502+0000 7f6615a72b80 1 -- 172.21.15.37:0/4178227918 shutdown_connections 2024-05-09T01:03:58.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.503+0000 7f6615a72b80 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.503+0000 7f6615a72b80 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2aad0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.503+0000 7f6615a72b80 1 --2- 172.21.15.37:0/4178227918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.503+0000 7f6615a72b80 1 -- 172.21.15.37:0/4178227918 >> 172.21.15.37:0/4178227918 conn(0x558bfe9acf70 msgr2=0x558bfeb21220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.504+0000 7f6615a72b80 1 -- 172.21.15.37:0/4178227918 shutdown_connections 2024-05-09T01:03:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.504+0000 7f6615a72b80 1 -- 172.21.15.37:0/4178227918 wait complete. 2024-05-09T01:03:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.504+0000 7f6615a72b80 1 -- start start 2024-05-09T01:03:58.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.504+0000 7f6615a72b80 1 Processor -- start 2024-05-09T01:03:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.505+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfe9a94a0 0x558bfeb34c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfea23d00 0x558bfeb351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb29560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6615a72b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558bfeb2ff40 con 0x558bfe9a94a0 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6615a72b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558bfe9e3b20 con 0x558bfea23d00 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6615a72b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558bfeb26400 con 0x558bfeb2f1e0 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f65fffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfea23d00 0x558bfeb351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6604df8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfe9a94a0 0x558bfeb34c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f65fffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfea23d00 0x558bfeb351d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49470/0 (socket says 172.21.15.37:49470) 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f65fffff700 1 -- 172.21.15.37:0/348432628 learned_addr learned my addr 172.21.15.37:0/348432628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6604df8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfe9a94a0 0x558bfeb34c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52502/0 (socket says 172.21.15.37:52502) 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.506+0000 7f6615a72b80 10 client.0 _ll_register_callbacks cb 0x558bfe8ba6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65fffff700 1 -- 172.21.15.37:0/348432628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 msgr2=0x558bfeb29560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65fffff700 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb29560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65fffff700 1 -- 172.21.15.37:0/348432628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfe9a94a0 msgr2=0x558bfeb34c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:58.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65fffff700 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfe9a94a0 0x558bfeb34c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65fffff700 1 -- 172.21.15.37:0/348432628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bfe8c4490 con 0x558bfea23d00 2024-05-09T01:03:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65fffff700 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfea23d00 0x558bfeb351d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f65f80157f0 tx=0x7f65f8020e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f27c7d79ccdcf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65dffff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:03:58.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65dffff700 1 -- 172.21.15.37:0/348432628 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8030020 con 0x558bfea23d00 2024-05-09T01:03:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f65dffff700 1 -- 172.21.15.37:0/348432628 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f65f8017bb0 con 0x558bfea23d00 2024-05-09T01:03:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.507+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f80090d0 con 0x558bfea23d00 2024-05-09T01:03:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.508+0000 7f65dffff700 1 -- 172.21.15.37:0/348432628 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f65f8017db0 con 0x558bfea23d00 2024-05-09T01:03:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.508+0000 7f6615a72b80 10 client.25250 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.508+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558bfeb3d730 con 0x558bfea23d00 2024-05-09T01:03:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f65dffff700 1 -- 172.21.15.37:0/348432628 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f80090d0 con 0x558bfea23d00 2024-05-09T01:03:58.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f65dffff700 1 -- 172.21.15.37:0/348432628 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f65f802c620 con 0x558bfea23d00 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f6615a72b80 10 client.25250 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f6615a72b80 10 client.25250 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f6615a72b80 20 client.25250 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f6615a72b80 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeb3fc00 0x558bfeb42020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f6615a72b80 4 client.25250 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bfea56a80 con 0x558bfeb3fc00 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.509+0000 7f6604df8700 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeb3fc00 0x558bfeb42020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.510+0000 7f65dffff700 10 client.25250 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:03:58.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.510+0000 7f6604df8700 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeb3fc00 0x558bfeb42020 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=880493ba28ed38d4 server_cookie=2d13ee9fbadf4a24 in_seq=0 out_seq=0 2024-05-09T01:03:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.511+0000 7f65dffff700 1 -- 172.21.15.37:0/348432628 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558bfea56a80 con 0x558bfeb3fc00 2024-05-09T01:03:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.511+0000 7f65dffff700 10 client.25250 handle_command_reply: tid=0 2024-05-09T01:03:58.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.511+0000 7f6615a72b80 1 client.25250 shutdown 2024-05-09T01:03:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfea23d00 msgr2=0x558bfeb351d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfea23d00 0x558bfeb351d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f65f80157f0 tx=0x7f65f8020e80 comp rx=0 tx=0).stop 2024-05-09T01:03:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 shutdown_connections 2024-05-09T01:03:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb29560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfe9a94a0 0x558bfeb34c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeb3fc00 0x558bfeb42020 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 --2- 172.21.15.37:0/348432628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfea23d00 0x558bfeb351d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 >> 172.21.15.37:0/348432628 conn(0x558bfe9acf70 msgr2=0x558bfeb253f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f65dffff700 0 client.25250 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:03:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 shutdown_connections 2024-05-09T01:03:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.512+0000 7f6615a72b80 1 -- 172.21.15.37:0/348432628 wait complete. 2024-05-09T01:03:58.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.513+0000 7f6615a72b80 20 client.25250 trim_cache size 0 max 16384 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.542+0000 7f6615a72b80 1 Processor -- start 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.542+0000 7f6615a72b80 1 -- start start 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.542+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb30df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.542+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfea23d00 0x558bfeb29ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f6604df8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb30df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f6604df8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb30df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49472/0 (socket says 172.21.15.37:49472) 2024-05-09T01:03:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f65fffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfea23d00 0x558bfeb29ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f65fffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfea23d00 0x558bfeb29ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49276/0 (socket says 172.21.15.37:49276) 2024-05-09T01:03:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f6604df8700 1 -- 172.21.15.37:0/2883542814 learned_addr learned my addr 172.21.15.37:0/2883542814 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f66001b4fa0 con 0x558bfeb2f1e0 2024-05-09T01:03:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f66001b6bd0 con 0x558bfe9a94a0 2024-05-09T01:03:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f66001b5670 con 0x558bfea23d00 2024-05-09T01:03:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.543+0000 7f66055f9700 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.544+0000 7f6604df8700 1 -- 172.21.15.37:0/2883542814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfea23d00 msgr2=0x558bfeb29ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.544+0000 7f6604df8700 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfea23d00 0x558bfeb29ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.544+0000 7f6604df8700 1 -- 172.21.15.37:0/2883542814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfeb2f1e0 msgr2=0x558bfeb2d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.544+0000 7f6604df8700 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.544+0000 7f6604df8700 1 -- 172.21.15.37:0/2883542814 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bfeb1d9d0 con 0x558bfe9a94a0 2024-05-09T01:03:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.544+0000 7f6604df8700 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb30df0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009fd0 tx=0x7f65f4015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb96359136d8103b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.544+0000 7f65e67fc700 1 -- 172.21.15.37:0/2883542814 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4004a30 con 0x558bfe9a94a0 2024-05-09T01:03:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.545+0000 7f65e67fc700 1 -- 172.21.15.37:0/2883542814 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f40054d0 con 0x558bfe9a94a0 2024-05-09T01:03:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.545+0000 7f65e67fc700 1 -- 172.21.15.37:0/2883542814 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4025890 con 0x558bfe9a94a0 2024-05-09T01:03:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.546+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 msgr2=0x558bfeb30df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.546+0000 7f6615a72b80 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb30df0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009fd0 tx=0x7f65f4015000 comp rx=0 tx=0).stop 2024-05-09T01:03:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.547+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 shutdown_connections 2024-05-09T01:03:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.547+0000 7f6615a72b80 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.547+0000 7f6615a72b80 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb30df0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.547+0000 7f6615a72b80 1 --2- 172.21.15.37:0/2883542814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfea23d00 0x558bfeb29ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.547+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 >> 172.21.15.37:0/2883542814 conn(0x558bfe9acf70 msgr2=0x558bfeb211f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:58.549 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:03:58 smithi037 ceph-mon[30122]: pgmap v450: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-05-09T01:03:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.548+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 shutdown_connections 2024-05-09T01:03:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.548+0000 7f6615a72b80 1 -- 172.21.15.37:0/2883542814 wait complete. 2024-05-09T01:03:58.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.549+0000 7f6615a72b80 1 -- start start 2024-05-09T01:03:58.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.549+0000 7f6615a72b80 1 Processor -- start 2024-05-09T01:03:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6615a72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6615a72b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f66001b6440 con 0x558bfea23d00 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6615a72b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f66001b5d70 con 0x558bfe9a94a0 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6615a72b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f66001b2f60 con 0x558bfeb2f1e0 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6615a72b80 10 client.0 _ll_register_callbacks cb 0x558bfe8ba6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f66055f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f66055f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49292/0 (socket says 172.21.15.37:49292) 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f66055f9700 1 -- 172.21.15.37:0/1602893640 learned_addr learned my addr 172.21.15.37:0/1602893640 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f65fffff700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.550+0000 7f6604df8700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f66055f9700 1 -- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 msgr2=0x558bfeb2c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f66055f9700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f66055f9700 1 -- 172.21.15.37:0/1602893640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 msgr2=0x558bfeb2c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f66055f9700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f66055f9700 1 -- 172.21.15.37:0/1602893640 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bfeba8130 con 0x558bfeb2f1e0 2024-05-09T01:03:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f6604df8700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:03:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f65fffff700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:03:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f66055f9700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2ca80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f65f000b2e0 tx=0x7f65f00ac300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d669b84617dab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:03:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f65dffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:03:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f65dffff700 1 -- 172.21.15.37:0/1602893640 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00b5170 con 0x558bfeb2f1e0 2024-05-09T01:03:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.551+0000 7f65dffff700 1 -- 172.21.15.37:0/1602893640 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f65f00cf2d0 con 0x558bfeb2f1e0 2024-05-09T01:03:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.552+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f40054d0 con 0x558bfeb2f1e0 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f65dffff700 1 -- 172.21.15.37:0/1602893640 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f65f00ac570 con 0x558bfeb2f1e0 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 10 client.25282 fetch_fsmap learned FSMap version 32 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558bfeba9290 con 0x558bfeb2f1e0 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f65dffff700 1 -- 172.21.15.37:0/1602893640 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f00a8040 con 0x558bfeb2f1e0 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f65dffff700 1 -- 172.21.15.37:0/1602893640 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f65f00b30d0 con 0x558bfeb2f1e0 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 10 client.25282 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 10 client.25282 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:03:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 20 client.25282 populate_metadata read hostname 'smithi037' 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeba98d0 0x558bfebabcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 4 client.25282 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.553+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f65f40054d0 con 0x558bfeba98d0 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.554+0000 7f6604df8700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeba98d0 0x558bfebabcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f65dffff700 10 client.25282 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6604df8700 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeba98d0 0x558bfebabcf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c8c24ffdf71d77d7 server_cookie=856fc2acc2eedfc7 in_seq=0 out_seq=0 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f65dffff700 1 -- 172.21.15.37:0/1602893640 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f65f40054d0 con 0x558bfeba98d0 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f65dffff700 10 client.25282 handle_command_reply: tid=0 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 client.25282 shutdown 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 msgr2=0x558bfeb2ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2ca80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f65f000b2e0 tx=0x7f65f00ac300 comp rx=0 tx=0).stop 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 shutdown_connections 2024-05-09T01:03:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558bfeb2f1e0 0x558bfeb2ca80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x558bfeba98d0 0x558bfebabcf0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558bfe9a94a0 0x558bfeb2c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 --2- 172.21.15.37:0/1602893640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558bfea23d00 0x558bfeb2c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.555+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 >> 172.21.15.37:0/1602893640 conn(0x558bfe9acf70 msgr2=0x558bfeb211f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.556+0000 7f65dffff700 0 client.25282 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.556+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 shutdown_connections 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.556+0000 7f6615a72b80 1 -- 172.21.15.37:0/1602893640 wait complete. 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.556+0000 7f6615a72b80 20 client.25282 trim_cache size 0 max 16384 2024-05-09T01:03:58.559 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:03:58.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f65e80b2900 msgr2=0x7f65e80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f65e80b2900 0x7f65e80b4e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005950 tx=0x7f65f40058e0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 msgr2=0x7f66001a6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001a6c90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f65f0006010 tx=0x7f65f0005ea0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 shutdown_connections 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f65e80b2900 0x7f65e80b4e10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6600110fb0 0x7f66001a6c90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f660010c840 0x7f66001a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 --2- 172.21.15.37:0/2928552052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6600110660 0x7f66001a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 >> 172.21.15.37:0/2928552052 conn(0x7f660006f4d0 msgr2=0x7f660010e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.557+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 shutdown_connections 2024-05-09T01:03:58.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:03:58.558+0000 7f660705c700 1 -- 172.21.15.37:0/2928552052 wait complete. 2024-05-09T01:03:58.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:03:58 smithi136 ceph-mon[34110]: pgmap v450: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-05-09T01:03:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:03:58 smithi151 ceph-mon[34780]: pgmap v450: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-05-09T01:03:59.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:03:59.795 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 100.0 s, 4042.4 tps, lat 24.742 ms stddev 27.085 2024-05-09T01:04:00.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:00 smithi037 ceph-mon[30122]: pgmap v451: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 844 op/s 2024-05-09T01:04:00.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:00 smithi136 ceph-mon[34110]: pgmap v451: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 844 op/s 2024-05-09T01:04:00.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:00 smithi151 ceph-mon[34780]: pgmap v451: 97 pgs: 97 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 844 op/s 2024-05-09T01:04:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:02 smithi136 ceph-mon[34110]: pgmap v452: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-05-09T01:04:02.650 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:02 smithi037 ceph-mon[30122]: pgmap v452: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-05-09T01:04:02.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:02 smithi151 ceph-mon[34780]: pgmap v452: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 862 op/s 2024-05-09T01:04:02.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/1013810242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a741102a0 msgr2=0x7f9a74117c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/1013810242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a741102a0 0x7f9a74117c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009990 tx=0x7f9a6c009ca0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/1013810242 shutdown_connections 2024-05-09T01:04:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/1013810242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a741102a0 0x7f9a74117c00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/1013810242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a7410b020 0x7f9a7410b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/1013810242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7410f950 0x7f9a7410fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/1013810242 >> 172.21.15.37:0/1013810242 conn(0x7f9a7406f990 msgr2=0x7f9a7406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/1013810242 shutdown_connections 2024-05-09T01:04:02.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.837+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/1013810242 wait complete. 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.838+0000 7f9a7b6f0700 1 Processor -- start 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a7b6f0700 1 -- start start 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a7b6f0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7410b020 0x7f9a741176d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a7b6f0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a7410f950 0x7f9a74115880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a7b6f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a741102a0 0x7f9a74115dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a7b6f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7411b330 con 0x7f9a741102a0 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a7b6f0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7411b1b0 con 0x7f9a7410f950 2024-05-09T01:04:02.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a7b6f0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7411b4b0 con 0x7f9a7410b020 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.839+0000 7f9a78c8b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a7410f950 0x7f9a74115880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a7948c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7410b020 0x7f9a741176d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a7948c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7410b020 0x7f9a741176d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60268/0 (socket says 172.21.15.37:60268) 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a7948c700 1 -- 172.21.15.37:0/2233004967 learned_addr learned my addr 172.21.15.37:0/2233004967 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a79c8d700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a741102a0 0x7f9a74115dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a78c8b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a7410f950 0x7f9a74115880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41594/0 (socket says 172.21.15.37:41594) 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a78c8b700 1 -- 172.21.15.37:0/2233004967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7410b020 msgr2=0x7f9a741176d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7410b020 0x7f9a741176d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a78c8b700 1 -- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a741102a0 msgr2=0x7f9a74115dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a741102a0 0x7f9a74115dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a78c8b700 1 -- 172.21.15.37:0/2233004967 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a74116300 con 0x7f9a7410f950 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.840+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a7410f950 0x7f9a74115880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e9c0 tx=0x7f9a6000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.841+0000 7f9a727fc700 1 -- 172.21.15.37:0/2233004967 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000c9c0 con 0x7f9a7410f950 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.841+0000 7f9a727fc700 1 -- 172.21.15.37:0/2233004967 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a6000cb60 con 0x7f9a7410f950 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.841+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a741165f0 con 0x7f9a7410f950 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.841+0000 7f9a727fc700 1 -- 172.21.15.37:0/2233004967 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000c9c0 con 0x7f9a7410f950 2024-05-09T01:04:02.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.841+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a741b6620 con 0x7f9a7410f950 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.846+0000 7f9a727fc700 1 -- 172.21.15.37:0/2233004967 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9a60018420 con 0x7f9a7410f950 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.848+0000 7f9a8a106b80 1 Processor -- start 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.848+0000 7f9a727fc700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a640b2c70 0x7f9a640b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.849+0000 7f9a727fc700 1 -- 172.21.15.37:0/2233004967 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9a6000c7c0 con 0x7f9a7410f950 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.849+0000 7f9a8a106b80 1 -- start start 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.849+0000 7f9a79c8d700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a640b2c70 0x7f9a640b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.849+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e00b4d00 0x55a9e01bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.849+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e003a4a0 0x55a9e01bd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a7948c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e00b4d00 0x55a9e01bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e01b7400 0x55a9e01b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a9e00da0a0 con 0x55a9e003a4a0 2024-05-09T01:04:02.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a9e007f9a0 con 0x55a9e00b4d00 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a9e00d6060 con 0x55a9e01b7400 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a7948c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e00b4d00 0x55a9e01bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41606/0 (socket says 172.21.15.37:41606) 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a7948c700 1 -- 172.21.15.37:0/1034059268 learned_addr learned my addr 172.21.15.37:0/1034059268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e003a4a0 0x55a9e01bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a79c8d700 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e01b7400 0x55a9e01b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a79c8d700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a640b2c70 0x7f9a640b5180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00b790 tx=0x7f9a6c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1034059268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e01b7400 msgr2=0x55a9e01b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e01b7400 0x55a9e01b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1034059268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e00b4d00 msgr2=0x55a9e01bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e00b4d00 0x55a9e01bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.850+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1034059268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9e0070500 con 0x55a9e003a4a0 2024-05-09T01:04:02.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.851+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e003a4a0 0x55a9e01bd780 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9a600df8a0 tx=0x7f9a60010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a9a40fb1fd9e554 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.852+0000 7f9a5f7fe700 1 -- 172.21.15.37:0/1034059268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600a9a70 con 0x55a9e003a4a0 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.852+0000 7f9a5f7fe700 1 -- 172.21.15.37:0/1034059268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a600a9370 con 0x55a9e003a4a0 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.852+0000 7f9a5f7fe700 1 -- 172.21.15.37:0/1034059268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600a4ce0 con 0x55a9e003a4a0 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.853+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1034059268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e003a4a0 msgr2=0x55a9e01bd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.853+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e003a4a0 0x55a9e01bd780 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9a600df8a0 tx=0x7f9a60010c10 comp rx=0 tx=0).stop 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1034059268 shutdown_connections 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e01b7400 0x55a9e01b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e00b4d00 0x55a9e01bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1034059268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e003a4a0 0x55a9e01bd780 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1034059268 >> 172.21.15.37:0/1034059268 conn(0x55a9e003df70 msgr2=0x55a9e01b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1034059268 shutdown_connections 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1034059268 wait complete. 2024-05-09T01:04:02.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.854+0000 7f9a8a106b80 1 -- start start 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.855+0000 7f9a8a106b80 1 Processor -- start 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.856+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.856+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.856+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.856+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a9e01b8160 con 0x55a9e00b4d00 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.856+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a9e0074b20 con 0x55a9e01b7400 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.856+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a9e01c4020 con 0x55a9e003a4a0 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.856+0000 7f9a8a106b80 10 client.0 _ll_register_callbacks cb 0x55a9dff4b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01c1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54090/0 (socket says 172.21.15.37:54090) 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1262448959 learned_addr learned my addr 172.21.15.37:0/1262448959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a7948c700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a79c8d700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 msgr2=0x55a9e01c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1262448959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 msgr2=0x55a9e01c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01c1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1262448959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9dff55490 con 0x55a9e00b4d00 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a7948c700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01c1560 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000c5b0 tx=0x7f9a600b20d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faff2e9d22aa9db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:02.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.857+0000 7f9a5cff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:04:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.859+0000 7f9a5cff9700 1 -- 172.21.15.37:0/1262448959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600c2070 con 0x55a9e00b4d00 2024-05-09T01:04:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.859+0000 7f9a5cff9700 1 -- 172.21.15.37:0/1262448959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9a600a87e0 con 0x55a9e00b4d00 2024-05-09T01:04:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.859+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a600a9370 con 0x55a9e00b4d00 2024-05-09T01:04:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.859+0000 7f9a5cff9700 1 -- 172.21.15.37:0/1262448959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9a600a9a70 con 0x55a9e00b4d00 2024-05-09T01:04:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.859+0000 7f9a8a106b80 10 client.15534 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.859+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a9e01ce9f0 con 0x55a9e00b4d00 2024-05-09T01:04:02.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a5cff9700 1 -- 172.21.15.37:0/1262448959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a600a9370 con 0x55a9e00b4d00 2024-05-09T01:04:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a5cff9700 1 -- 172.21.15.37:0/1262448959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f9a60069ce0 con 0x55a9e00b4d00 2024-05-09T01:04:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a8a106b80 10 client.15534 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a8a106b80 10 client.15534 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:04:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a8a106b80 20 client.15534 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e01d0ec0 0x55a9e01d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a8a106b80 4 client.15534 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.860+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9e00e7a80 con 0x55a9e01d0ec0 2024-05-09T01:04:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.861+0000 7f9a7948c700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e01d0ec0 0x55a9e01d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.861+0000 7f9a7948c700 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e01d0ec0 0x55a9e01d32e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8793381a86461dc5 server_cookie=6534ff98601e59fe in_seq=0 out_seq=0 2024-05-09T01:04:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.861+0000 7f9a5cff9700 10 client.15534 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:04:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.862+0000 7f9a5cff9700 1 -- 172.21.15.37:0/1262448959 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a9e00e7a80 con 0x55a9e01d0ec0 2024-05-09T01:04:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.862+0000 7f9a5cff9700 10 client.15534 handle_command_reply: tid=0 2024-05-09T01:04:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.862+0000 7f9a8a106b80 1 client.15534 shutdown 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 msgr2=0x55a9e01c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01c1560 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000c5b0 tx=0x7f9a600b20d0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 shutdown_connections 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e01d0ec0 0x55a9e01d32e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1262448959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01c1560 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a5cff9700 0 client.15534 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:04:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 >> 172.21.15.37:0/1262448959 conn(0x55a9e003df70 msgr2=0x55a9e01abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 shutdown_connections 2024-05-09T01:04:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1262448959 wait complete. 2024-05-09T01:04:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.863+0000 7f9a8a106b80 20 client.15534 trim_cache size 0 max 16384 2024-05-09T01:04:02.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 Processor -- start 2024-05-09T01:04:02.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 -- start start 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01d6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01d6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a741bd8c0 con 0x55a9e00b4d00 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9a741bf4f0 con 0x55a9e01b7400 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a8a106b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a741bdf90 con 0x55a9e003a4a0 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a78c8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01d6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.898+0000 7f9a78c8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01d6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54092/0 (socket says 172.21.15.37:54092) 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1807117769 learned_addr learned my addr 172.21.15.37:0/1807117769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a79c8d700 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01d6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a7948c700 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1807117769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 msgr2=0x55a9e01c0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1807117769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 msgr2=0x55a9e01d6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01d6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a78c8b700 1 -- 172.21.15.37:0/1807117769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9e01b8600 con 0x55a9e00b4d00 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.899+0000 7f9a79c8d700 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01d6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.900+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01d6300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9a600a53f0 tx=0x7f9a60010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644f07c96fd8192 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.900+0000 7f9a5effd700 1 -- 172.21.15.37:0/1807117769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600c2070 con 0x55a9e00b4d00 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.901+0000 7f9a5effd700 1 -- 172.21.15.37:0/1807117769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a600a9370 con 0x55a9e00b4d00 2024-05-09T01:04:02.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.901+0000 7f9a5effd700 1 -- 172.21.15.37:0/1807117769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a600ca350 con 0x55a9e00b4d00 2024-05-09T01:04:02.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1807117769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 msgr2=0x55a9e01d6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01d6300 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9a600a53f0 tx=0x7f9a60010c10 comp rx=0 tx=0).stop 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1807117769 shutdown_connections 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e01b7400 0x55a9e01d6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e003a4a0 0x55a9e01c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/1807117769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e00b4d00 0x55a9e01d6300 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1807117769 >> 172.21.15.37:0/1807117769 conn(0x55a9e003df70 msgr2=0x55a9e01bf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1807117769 shutdown_connections 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.902+0000 7f9a8a106b80 1 -- 172.21.15.37:0/1807117769 wait complete. 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.903+0000 7f9a8a106b80 1 -- start start 2024-05-09T01:04:02.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.903+0000 7f9a8a106b80 1 Processor -- start 2024-05-09T01:04:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.903+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e003a4a0 0x55a9e01d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a8a106b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e00b4d00 0x55a9e01d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e003a4a0 0x55a9e01d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e003a4a0 0x55a9e01d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41620/0 (socket says 172.21.15.37:41620) 2024-05-09T01:04:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 -- 172.21.15.37:0/3818131623 learned_addr learned my addr 172.21.15.37:0/3818131623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e01b7400 0x55a9e0239400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a741bed60 con 0x55a9e01b7400 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9a741be690 con 0x55a9e003a4a0 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a741bb880 con 0x55a9e00b4d00 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a8a106b80 10 client.0 _ll_register_callbacks cb 0x55a9dff4b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e00b4d00 0x55a9e01d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 -- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e00b4d00 msgr2=0x55a9e01d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e00b4d00 0x55a9e01d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 -- 172.21.15.37:0/3818131623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e01b7400 msgr2=0x55a9e0239400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e01b7400 0x55a9e0239400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.904+0000 7f9a7948c700 1 -- 172.21.15.37:0/3818131623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9e0239940 con 0x55a9e003a4a0 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.905+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a600a9370 con 0x55a9e003a4a0 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.905+0000 7f9a7948c700 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e003a4a0 0x55a9e01d3580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55a9e00da1f0 tx=0x7f9a68007a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7767af171293245f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.905+0000 7f9a5cff9700 10 client.25271 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:04:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.905+0000 7f9a5cff9700 1 -- 172.21.15.37:0/3818131623 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a68020920 con 0x55a9e003a4a0 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.905+0000 7f9a5cff9700 1 -- 172.21.15.37:0/3818131623 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9a68003a00 con 0x55a9e003a4a0 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a5cff9700 1 -- 172.21.15.37:0/3818131623 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9a68003c40 con 0x55a9e003a4a0 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 10 client.25271 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55a9e023aa30 con 0x55a9e003a4a0 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a5cff9700 1 -- 172.21.15.37:0/3818131623 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f9a68020070 con 0x55a9e003a4a0 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 10 client.25271 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 10 client.25271 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 20 client.25271 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e023afb0 0x55a9e023d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 4 client.25271 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.906+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a9e00e1b20 con 0x55a9e023afb0 2024-05-09T01:04:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.907+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e023afb0 0x55a9e023d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:02.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.907+0000 7f9a78c8b700 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e023afb0 0x55a9e023d3f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b01b89547f3eb1c2 server_cookie=d992f214965de717 in_seq=0 out_seq=0 2024-05-09T01:04:02.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.907+0000 7f9a5cff9700 10 client.25271 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:04:02.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.908+0000 7f9a5cff9700 1 -- 172.21.15.37:0/3818131623 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a9e00e1b20 con 0x55a9e023afb0 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.908+0000 7f9a5cff9700 10 client.25271 handle_command_reply: tid=0 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.908+0000 7f9a8a106b80 1 client.25271 shutdown 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e003a4a0 msgr2=0x55a9e01d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e003a4a0 0x55a9e01d3580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55a9e00da1f0 tx=0x7f9a68007a90 comp rx=0 tx=0).stop 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 shutdown_connections 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55a9e023afb0 0x55a9e023d3f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9e01b7400 0x55a9e0239400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a9e003a4a0 0x55a9e01d3580 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 --2- 172.21.15.37:0/3818131623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e00b4d00 0x55a9e01d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 >> 172.21.15.37:0/3818131623 conn(0x55a9e003df70 msgr2=0x55a9e01abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.909+0000 7f9a5cff9700 0 client.25271 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.910+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 shutdown_connections 2024-05-09T01:04:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.910+0000 7f9a8a106b80 1 -- 172.21.15.37:0/3818131623 wait complete. 2024-05-09T01:04:02.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.910+0000 7f9a8a106b80 20 client.25271 trim_cache size 0 max 16384 2024-05-09T01:04:02.913 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:04:02.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a640b2c70 msgr2=0x7f9a640b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a640b2c70 0x7f9a640b5180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00b790 tx=0x7f9a6c005960 comp rx=0 tx=0).stop 2024-05-09T01:04:02.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a7410f950 msgr2=0x7f9a74115880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a7410f950 0x7f9a74115880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000e9c0 tx=0x7f9a6000ecd0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 shutdown_connections 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9a640b2c70 0x7f9a640b5180 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a741102a0 0x7f9a74115dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7410b020 0x7f9a741176d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 --2- 172.21.15.37:0/2233004967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a7410f950 0x7f9a74115880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.911+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 >> 172.21.15.37:0/2233004967 conn(0x7f9a7406f990 msgr2=0x7f9a7411c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.912+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 shutdown_connections 2024-05-09T01:04:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:02.912+0000 7f9a7b6f0700 1 -- 172.21.15.37:0/2233004967 wait complete. 2024-05-09T01:04:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.364+0000 7fe0c359e640 1 -- 172.21.15.37:0/264169424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410f890 msgr2=0x7fe0c4111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.364+0000 7fe0c359e640 1 --2- 172.21.15.37:0/264169424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410f890 0x7fe0c4111cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009900 tx=0x7fe0b802a410 comp rx=0 tx=0).stop 2024-05-09T01:04:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.365+0000 7fe0c359e640 1 -- 172.21.15.37:0/264169424 shutdown_connections 2024-05-09T01:04:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.365+0000 7fe0c359e640 1 --2- 172.21.15.37:0/264169424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0c41121f0 0x7fe0c4114610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.365+0000 7fe0c359e640 1 --2- 172.21.15.37:0/264169424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410f890 0x7fe0c4111cb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.365+0000 7fe0c359e640 1 --2- 172.21.15.37:0/264169424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c410a0f0 0x7fe0c410a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.365+0000 7fe0c359e640 1 -- 172.21.15.37:0/264169424 >> 172.21.15.37:0/264169424 conn(0x7fe0c4070460 msgr2=0x7fe0c4072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.365+0000 7fe0c359e640 1 -- 172.21.15.37:0/264169424 shutdown_connections 2024-05-09T01:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.366+0000 7fe0c359e640 1 -- 172.21.15.37:0/264169424 wait complete. 2024-05-09T01:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c359e640 1 Processor -- start 2024-05-09T01:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c359e640 1 -- start start 2024-05-09T01:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c359e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410a0f0 0x7fe0c41a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c410f890 0x7fe0c41a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0c41121f0 0x7fe0c41ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c410f890 0x7fe0c41a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410a0f0 0x7fe0c41a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.367+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410a0f0 0x7fe0c41a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41636/0 (socket says 172.21.15.37:41636) 2024-05-09T01:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c259c640 1 -- 172.21.15.37:0/2484900215 learned_addr learned my addr 172.21.15.37:0/2484900215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c4119fb0 con 0x7fe0c410f890 2024-05-09T01:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c4119e30 con 0x7fe0c410a0f0 2024-05-09T01:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0c41121f0 0x7fe0c41ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c411a130 con 0x7fe0c41121f0 2024-05-09T01:04:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c259c640 1 -- 172.21.15.37:0/2484900215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0c41121f0 msgr2=0x7fe0c41ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0c41121f0 0x7fe0c41ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c259c640 1 -- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c410f890 msgr2=0x7fe0c41a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c410f890 0x7fe0c41a50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.368+0000 7fe0c259c640 1 -- 172.21.15.37:0/2484900215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c41ac6c0 con 0x7fe0c410a0f0 2024-05-09T01:04:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.369+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410a0f0 0x7fe0c41a4b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400e9c0 tx=0x7fe0b400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.369+0000 7fe0b37fe640 1 -- 172.21.15.37:0/2484900215 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b400cd80 con 0x7fe0c410a0f0 2024-05-09T01:04:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.369+0000 7fe0b37fe640 1 -- 172.21.15.37:0/2484900215 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b40054d0 con 0x7fe0c410a0f0 2024-05-09T01:04:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.369+0000 7fe0b37fe640 1 -- 172.21.15.37:0/2484900215 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4010430 con 0x7fe0c410a0f0 2024-05-09T01:04:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.369+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c41ac9b0 con 0x7fe0c410a0f0 2024-05-09T01:04:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.369+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c4115080 con 0x7fe0c410a0f0 2024-05-09T01:04:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 Processor -- start 2024-05-09T01:04:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0b37fe640 1 -- 172.21.15.37:0/2484900215 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe0b4004fd0 con 0x7fe0c410a0f0 2024-05-09T01:04:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 -- start start 2024-05-09T01:04:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b2656c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b265c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aea04d0 0x563b5b26cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b5b1c97c0 con 0x563b5aea04d0 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563b5b1650e0 con 0x563b5ae982f0 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.374+0000 7fe0cf826740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563b5b1c5780 con 0x563b5aec11b0 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b2656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b265c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b2656c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60346/0 (socket says 172.21.15.37:60346) 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 -- 172.21.15.37:0/4107087214 learned_addr learned my addr 172.21.15.37:0/4107087214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c1d9b640 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aea04d0 0x563b5b26cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0b37fe640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0ac0b2860 0x7fe0ac0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 -- 172.21.15.37:0/4107087214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 msgr2=0x563b5b265c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b265c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 -- 172.21.15.37:0/4107087214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aea04d0 msgr2=0x563b5b26cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aea04d0 0x563b5b26cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0c2d9d640 1 -- 172.21.15.37:0/4107087214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b5b18e7c0 con 0x563b5aec11b0 2024-05-09T01:04:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.375+0000 7fe0b37fe640 1 -- 172.21.15.37:0/2484900215 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe0b40e2650 con 0x7fe0c410a0f0 2024-05-09T01:04:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.376+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0ac0b2860 0x7fe0ac0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.376+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b2656c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009ee0 tx=0x7fe0bc010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8b23d4bd8fc11f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.376+0000 7fe0b0ff9640 1 -- 172.21.15.37:0/4107087214 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc016070 con 0x563b5aec11b0 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.376+0000 7fe0b0ff9640 1 -- 172.21.15.37:0/4107087214 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0bc012c60 con 0x563b5aec11b0 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.376+0000 7fe0b0ff9640 1 -- 172.21.15.37:0/4107087214 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0113e0 con 0x563b5aec11b0 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 -- 172.21.15.37:0/4107087214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 msgr2=0x563b5b2656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b2656c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009ee0 tx=0x7fe0bc010740 comp rx=0 tx=0).stop 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0ac0b2860 0x7fe0ac0b4d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc01b000 tx=0x7fe0bc01bed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 -- 172.21.15.37:0/4107087214 shutdown_connections 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aea04d0 0x563b5b26cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b265c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 --2- 172.21.15.37:0/4107087214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b2656c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 -- 172.21.15.37:0/4107087214 >> 172.21.15.37:0/4107087214 conn(0x563b5aeb5300 msgr2=0x563b5b261050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.377+0000 7fe0cf826740 1 -- 172.21.15.37:0/4107087214 shutdown_connections 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.378+0000 7fe0cf826740 1 -- 172.21.15.37:0/4107087214 wait complete. 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.378+0000 7fe0cf826740 1 -- start start 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.378+0000 7fe0cf826740 1 Processor -- start 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.379+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5ae982f0 0x563b5b26f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.379+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5aea04d0 0x563b5b26f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.379+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b276810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.379+0000 7fe0cf826740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b5b26d630 con 0x563b5ae982f0 2024-05-09T01:04:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.379+0000 7fe0cf826740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563b5b1509c0 con 0x563b5aea04d0 2024-05-09T01:04:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.379+0000 7fe0cf826740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563b5b26d7b0 con 0x563b5aec11b0 2024-05-09T01:04:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.379+0000 7fe0cf826740 10 client.0 _ll_register_callbacks cb 0x563b5b17d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c1d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5aea04d0 0x563b5b26f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c2d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b276810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5ae982f0 0x563b5b26f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5ae982f0 0x563b5b26f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54138/0 (socket says 172.21.15.37:54138) 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c259c640 1 -- 172.21.15.37:0/2328413428 learned_addr learned my addr 172.21.15.37:0/2328413428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c2d9d640 1 -- 172.21.15.37:0/2328413428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5aea04d0 msgr2=0x563b5b26f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5aea04d0 0x563b5b26f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c2d9d640 1 -- 172.21.15.37:0/2328413428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5ae982f0 msgr2=0x563b5b26f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5ae982f0 0x563b5b26f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.380+0000 7fe0c2d9d640 1 -- 172.21.15.37:0/2328413428 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b5b1771f0 con 0x563b5aec11b0 2024-05-09T01:04:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.381+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b276810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc01baa0 tx=0x7fe0bc016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80be8833b6c808fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.381+0000 7fe0a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.381+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/2328413428 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0113e0 con 0x563b5aec11b0 2024-05-09T01:04:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.381+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0bc012c60 con 0x563b5aec11b0 2024-05-09T01:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.382+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/2328413428 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe0bc01b430 con 0x563b5aec11b0 2024-05-09T01:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.382+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/2328413428 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc012e10 con 0x563b5aec11b0 2024-05-09T01:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.382+0000 7fe0cf826740 10 client.25312 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.382+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563b5af2c790 con 0x563b5aec11b0 2024-05-09T01:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.382+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/2328413428 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0bc012c60 con 0x563b5aec11b0 2024-05-09T01:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.382+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/2328413428 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe0bc00f040 con 0x563b5aec11b0 2024-05-09T01:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.383+0000 7fe0cf826740 10 client.25312 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.383+0000 7fe0cf826740 10 client.25312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.383+0000 7fe0cf826740 20 client.25312 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.383+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae7fd80 0x563b5b27ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.383+0000 7fe0cf826740 4 client.25312 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.383+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b5b1d73d0 con 0x563b5ae7fd80 2024-05-09T01:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.383+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae7fd80 0x563b5b27ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.384+0000 7fe0a9ffb640 10 client.25312 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.384+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae7fd80 0x563b5b27ca90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c9c8065daf2b514 server_cookie=c7d960ac01515334 in_seq=0 out_seq=0 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/2328413428 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b5b1d73d0 con 0x563b5ae7fd80 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0a9ffb640 10 client.25312 handle_command_reply: tid=0 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 client.25312 shutdown 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 msgr2=0x563b5b276810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b276810 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc01baa0 tx=0x7fe0bc016000 comp rx=0 tx=0).stop 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 shutdown_connections 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae7fd80 0x563b5b27ca90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aec11b0 0x563b5b276810 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5aea04d0 0x563b5b26f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2328413428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5ae982f0 0x563b5b26f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 >> 172.21.15.37:0/2328413428 conn(0x563b5aeb5300 msgr2=0x563b5b260290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0a9ffb640 0 client.25312 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 shutdown_connections 2024-05-09T01:04:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.385+0000 7fe0cf826740 1 -- 172.21.15.37:0/2328413428 wait complete. 2024-05-09T01:04:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.386+0000 7fe0cf826740 20 client.25312 trim_cache size 0 max 16384 2024-05-09T01:04:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.416+0000 7fe0cf826740 1 Processor -- start 2024-05-09T01:04:03.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.416+0000 7fe0cf826740 1 -- start start 2024-05-09T01:04:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b264560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b264aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b282290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b264560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0cf826740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c41b9fb0 con 0x563b5aec11b0 2024-05-09T01:04:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0cf826740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c41bbbe0 con 0x563b5ae982f0 2024-05-09T01:04:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0cf826740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c41ba680 con 0x563b5aea04d0 2024-05-09T01:04:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b264560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41662/0 (socket says 172.21.15.37:41662) 2024-05-09T01:04:03.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.417+0000 7fe0c259c640 1 -- 172.21.15.37:0/2004783085 learned_addr learned my addr 172.21.15.37:0/2004783085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b282290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c1d9b640 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b264aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c259c640 1 -- 172.21.15.37:0/2004783085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 msgr2=0x563b5b264aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b264aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c259c640 1 -- 172.21.15.37:0/2004783085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 msgr2=0x563b5b282290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b282290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c259c640 1 -- 172.21.15.37:0/2004783085 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b5afa35f0 con 0x563b5ae982f0 2024-05-09T01:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c2d9d640 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b282290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0c259c640 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b264560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400cfd0 tx=0x7fe0b40e8530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=165412f77a027a99 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.418+0000 7fe0abfff640 1 -- 172.21.15.37:0/2004783085 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40a9660 con 0x563b5ae982f0 2024-05-09T01:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.419+0000 7fe0abfff640 1 -- 172.21.15.37:0/2004783085 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b40046c0 con 0x563b5ae982f0 2024-05-09T01:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.419+0000 7fe0abfff640 1 -- 172.21.15.37:0/2004783085 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40a9480 con 0x563b5ae982f0 2024-05-09T01:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.420+0000 7fe0cf826740 1 -- 172.21.15.37:0/2004783085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 msgr2=0x563b5b264560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.420+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b264560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400cfd0 tx=0x7fe0b40e8530 comp rx=0 tx=0).stop 2024-05-09T01:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.421+0000 7fe0cf826740 1 -- 172.21.15.37:0/2004783085 shutdown_connections 2024-05-09T01:04:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.421+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b282290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.421+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b264aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.421+0000 7fe0cf826740 1 --2- 172.21.15.37:0/2004783085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b264560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.421+0000 7fe0cf826740 1 -- 172.21.15.37:0/2004783085 >> 172.21.15.37:0/2004783085 conn(0x563b5aeb5300 msgr2=0x563b5b263e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.422+0000 7fe0cf826740 1 -- 172.21.15.37:0/2004783085 shutdown_connections 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.423+0000 7fe0cf826740 1 -- 172.21.15.37:0/2004783085 wait complete. 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.424+0000 7fe0cf826740 1 -- start start 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.424+0000 7fe0cf826740 1 Processor -- start 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b272580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b272ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0cf826740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b2759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0cf826740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c41bb450 con 0x563b5aec11b0 2024-05-09T01:04:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0cf826740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c41bad80 con 0x563b5ae982f0 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0cf826740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c41b7fb0 con 0x563b5aea04d0 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0cf826740 10 client.0 _ll_register_callbacks cb 0x7fe0b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b272580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0c259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b272580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41674/0 (socket says 172.21.15.37:41674) 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0c259c640 1 -- 172.21.15.37:0/679731110 learned_addr learned my addr 172.21.15.37:0/679731110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.425+0000 7fe0c1d9b640 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b272ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0c259c640 1 -- 172.21.15.37:0/679731110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 msgr2=0x563b5b272ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0c259c640 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b272ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0c259c640 1 -- 172.21.15.37:0/679731110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 msgr2=0x563b5b2759b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0c259c640 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b2759b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0c259c640 1 -- 172.21.15.37:0/679731110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b5b18ded0 con 0x563b5ae982f0 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0c1d9b640 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b272ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0c259c640 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b272580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40e29b0 tx=0x7fe0b40a9480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f315faef83c6e336 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/679731110 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40a9820 con 0x563b5ae982f0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/679731110 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe0b40c4320 con 0x563b5ae982f0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.426+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563b5b1d1240 con 0x563b5ae982f0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.427+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/679731110 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe0b40c9050 con 0x563b5ae982f0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.427+0000 7fe0cf826740 10 client.25289 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.427+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563b5b2770a0 con 0x563b5ae982f0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.427+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/679731110 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b40aa410 con 0x563b5ae982f0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.427+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/679731110 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe0b40e4b80 con 0x563b5ae982f0 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.428+0000 7fe0cf826740 10 client.25289 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.428+0000 7fe0cf826740 10 client.25289 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.428+0000 7fe0cf826740 20 client.25289 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.428+0000 7fe0cf826740 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae551c0 0x563b5b2e7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.428+0000 7fe0cf826740 4 client.25289 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:04:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.428+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563b5b1d1240 con 0x563b5ae551c0 2024-05-09T01:04:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.428+0000 7fe0c1d9b640 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae551c0 0x563b5b2e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.429+0000 7fe0c1d9b640 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae551c0 0x563b5b2e7450 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6855ee80220ef79 server_cookie=89c2b13172f5e5a9 in_seq=0 out_seq=0 2024-05-09T01:04:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.429+0000 7fe0a9ffb640 10 client.25289 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.438+0000 7fe0a9ffb640 1 -- 172.21.15.37:0/679731110 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563b5b1d1240 con 0x563b5ae551c0 2024-05-09T01:04:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.438+0000 7fe0a9ffb640 10 client.25289 handle_command_reply: tid=0 2024-05-09T01:04:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.439+0000 7fe0cf826740 1 client.25289 shutdown 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.439+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 msgr2=0x563b5b272580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.439+0000 7fe0cf826740 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b272580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40e29b0 tx=0x7fe0b40a9480 comp rx=0 tx=0).stop 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.439+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 shutdown_connections 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.439+0000 7fe0cf826740 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563b5ae551c0 0x563b5b2e7450 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.440+0000 7fe0cf826740 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b5aec11b0 0x563b5b2759b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.440+0000 7fe0cf826740 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b5aea04d0 0x563b5b272ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.440+0000 7fe0cf826740 1 --2- 172.21.15.37:0/679731110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ae982f0 0x563b5b272580 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.440+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 >> 172.21.15.37:0/679731110 conn(0x563b5aeb5300 msgr2=0x563b5b264880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.440+0000 7fe0a9ffb640 0 client.25289 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.440+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 shutdown_connections 2024-05-09T01:04:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.440+0000 7fe0cf826740 1 -- 172.21.15.37:0/679731110 wait complete. 2024-05-09T01:04:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.441+0000 7fe0cf826740 20 client.25289 trim_cache size 0 max 16384 2024-05-09T01:04:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:04:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:04:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:04:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0ac0b2860 msgr2=0x7fe0ac0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0ac0b2860 0x7fe0ac0b4d70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc01b000 tx=0x7fe0bc01bed0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410a0f0 msgr2=0x7fe0c41a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410a0f0 0x7fe0c41a4b80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400e9c0 tx=0x7fe0b400ee80 comp rx=0 tx=0).stop 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 shutdown_connections 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0c41121f0 0x7fe0c41ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c410f890 0x7fe0c41a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe0ac0b2860 0x7fe0ac0b4d70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 --2- 172.21.15.37:0/2484900215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0c410a0f0 0x7fe0c41a4b80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 >> 172.21.15.37:0/2484900215 conn(0x7fe0c4070460 msgr2=0x7fe0c4110790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 shutdown_connections 2024-05-09T01:04:03.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:03.443+0000 7fe0c359e640 1 -- 172.21.15.37:0/2484900215 wait complete. 2024-05-09T01:04:03.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:04:04.204 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:04.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:04 smithi136 ceph-mon[34110]: pgmap v453: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-05-09T01:04:04.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:04 smithi037 ceph-mon[30122]: pgmap v453: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-05-09T01:04:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:04 smithi151 ceph-mon[34780]: pgmap v453: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-05-09T01:04:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 105.0 s, 4435.8 tps, lat 22.522 ms stddev 25.252 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.206+0000 7f9785038700 1 -- 172.21.15.37:0/316776347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106ed0 msgr2=0x7f9780113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.206+0000 7f9785038700 1 --2- 172.21.15.37:0/316776347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106ed0 0x7f9780113360 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9778009f90 tx=0x7f977800b330 comp rx=0 tx=0).stop 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.207+0000 7f9785038700 1 -- 172.21.15.37:0/316776347 shutdown_connections 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.207+0000 7f9785038700 1 --2- 172.21.15.37:0/316776347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106ed0 0x7f9780113360 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.207+0000 7f9785038700 1 --2- 172.21.15.37:0/316776347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978010c5c0 0x7f978010c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.207+0000 7f9785038700 1 --2- 172.21.15.37:0/316776347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9780106580 0x7f9780106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.207+0000 7f9785038700 1 -- 172.21.15.37:0/316776347 >> 172.21.15.37:0/316776347 conn(0x7f9780102080 msgr2=0x7f97801044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.207+0000 7f9785038700 1 -- 172.21.15.37:0/316776347 shutdown_connections 2024-05-09T01:04:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.207+0000 7f9785038700 1 -- 172.21.15.37:0/316776347 wait complete. 2024-05-09T01:04:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.208+0000 7f9785038700 1 Processor -- start 2024-05-09T01:04:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.209+0000 7f9785038700 1 -- start start 2024-05-09T01:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.209+0000 7f9785038700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106580 0x7f9780112050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.209+0000 7f9785038700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9780106ed0 0x7f9780112590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.209+0000 7f9785038700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978010c5c0 0x7f97801a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.209+0000 7f9785038700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9780079da0 con 0x7f9780106ed0 2024-05-09T01:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.209+0000 7f9785038700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9780079c20 con 0x7f9780106580 2024-05-09T01:04:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.209+0000 7f9785038700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9780079f20 con 0x7f978010c5c0 2024-05-09T01:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106580 0x7f9780112050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106580 0x7f9780112050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41688/0 (socket says 172.21.15.37:41688) 2024-05-09T01:04:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 -- 172.21.15.37:0/2491566665 learned_addr learned my addr 172.21.15.37:0/2491566665 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977e59c700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9780106ed0 0x7f9780112590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977f59e700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978010c5c0 0x7f97801a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 -- 172.21.15.37:0/2491566665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978010c5c0 msgr2=0x7f97801a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978010c5c0 0x7f97801a5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 -- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9780106ed0 msgr2=0x7f9780112590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9780106ed0 0x7f9780112590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.210+0000 7f977ed9d700 1 -- 172.21.15.37:0/2491566665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97801a6380 con 0x7f9780106580 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.211+0000 7f977ed9d700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106580 0x7f9780112050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f977000e9f0 tx=0x7f977000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.211+0000 7f9767fff700 1 -- 172.21.15.37:0/2491566665 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977000c9c0 con 0x7f9780106580 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.211+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97801a6670 con 0x7f9780106580 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.211+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97801adef0 con 0x7f9780106580 2024-05-09T01:04:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.211+0000 7f9767fff700 1 -- 172.21.15.37:0/2491566665 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f977000cb60 con 0x7f9780106580 2024-05-09T01:04:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.211+0000 7f9767fff700 1 -- 172.21.15.37:0/2491566665 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770018680 con 0x7f9780106580 2024-05-09T01:04:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.215+0000 7f9767fff700 1 -- 172.21.15.37:0/2491566665 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9770018820 con 0x7f9780106580 2024-05-09T01:04:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.216+0000 7f9767fff700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97680b2930 0x7f97680b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.217+0000 7f977e59c700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97680b2930 0x7f97680b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.217+0000 7f9793a4eb80 1 Processor -- start 2024-05-09T01:04:06.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.217+0000 7f9767fff700 1 -- 172.21.15.37:0/2491566665 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97700e2440 con 0x7f9780106580 2024-05-09T01:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.218+0000 7f9793a4eb80 1 -- start start 2024-05-09T01:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.218+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.218+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f16e4a0 0x558f8f2f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.218+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f2eb6a0 0x558f8f2ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.218+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f8f20dff0 con 0x558f8f2eb6a0 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.218+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558f8f1ac7f0 con 0x558f8f16e4a0 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.218+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558f8f209fb0 con 0x558f8f258160 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60390/0 (socket says 172.21.15.37:60390) 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 -- 172.21.15.37:0/3281131327 learned_addr learned my addr 172.21.15.37:0/3281131327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977f59e700 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f2eb6a0 0x558f8f2ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977e59c700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97680b2930 0x7f97680b4e40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f978007be80 tx=0x7f9774009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 -- 172.21.15.37:0/3281131327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f16e4a0 msgr2=0x558f8f2f1a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f16e4a0 0x558f8f2f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 -- 172.21.15.37:0/3281131327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f2eb6a0 msgr2=0x558f8f2ebad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:06.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f2eb6a0 0x558f8f2ebad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977ed9d700 1 -- 172.21.15.37:0/3281131327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f8f1a4370 con 0x558f8f258160 2024-05-09T01:04:06.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.219+0000 7f977f59e700 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f2eb6a0 0x558f8f2ebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.220+0000 7f977ed9d700 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f14f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97700a5ae0 tx=0x7f9770010b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f5144cce3babcb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.221+0000 7f97657fa700 1 -- 172.21.15.37:0/3281131327 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770090e60 con 0x558f8f258160 2024-05-09T01:04:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.221+0000 7f97657fa700 1 -- 172.21.15.37:0/3281131327 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97700a5050 con 0x558f8f258160 2024-05-09T01:04:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f97657fa700 1 -- 172.21.15.37:0/3281131327 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97700a9f20 con 0x558f8f258160 2024-05-09T01:04:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 -- 172.21.15.37:0/3281131327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 msgr2=0x558f8f2f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f14f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97700a5ae0 tx=0x7f9770010b60 comp rx=0 tx=0).stop 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 -- 172.21.15.37:0/3281131327 shutdown_connections 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f2eb6a0 0x558f8f2ebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f14f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/3281131327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f16e4a0 0x558f8f2f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 -- 172.21.15.37:0/3281131327 >> 172.21.15.37:0/3281131327 conn(0x558f8f1ce6a0 msgr2=0x558f8f2e6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.222+0000 7f9793a4eb80 1 -- 172.21.15.37:0/3281131327 shutdown_connections 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.223+0000 7f9793a4eb80 1 -- 172.21.15.37:0/3281131327 wait complete. 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.223+0000 7f9793a4eb80 1 -- start start 2024-05-09T01:04:06.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.224+0000 7f9793a4eb80 1 Processor -- start 2024-05-09T01:04:06.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f2eb6a0 0x558f8f2f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f8f089ba0 con 0x558f8f16e4a0 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558f8f1c8150 con 0x558f8f2eb6a0 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558f8f2f81d0 con 0x558f8f258160 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f9793a4eb80 10 client.0 _ll_register_callbacks cb 0x558f8f07f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f977f59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f2eb6a0 0x558f8f2f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f977f59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f2eb6a0 0x558f8f2f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41700/0 (socket says 172.21.15.37:41700) 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.225+0000 7f977f59e700 1 -- 172.21.15.37:0/4179000400 learned_addr learned my addr 172.21.15.37:0/4179000400 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977ed9d700 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977f59e700 1 -- 172.21.15.37:0/4179000400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 msgr2=0x558f8f2f5770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977f59e700 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f5770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977f59e700 1 -- 172.21.15.37:0/4179000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 msgr2=0x558f8f2f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977f59e700 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977f59e700 1 -- 172.21.15.37:0/4179000400 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f8f089490 con 0x558f8f2eb6a0 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977ed9d700 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:06.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f977f59e700 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f2eb6a0 0x558f8f2f5cb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9778015000 tx=0x7f9778004da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e52be059b5582a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:06.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f9762ff5700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:04:06.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f9762ff5700 1 -- 172.21.15.37:0/4179000400 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977800bbf0 con 0x558f8f2eb6a0 2024-05-09T01:04:06.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.226+0000 7f9762ff5700 1 -- 172.21.15.37:0/4179000400 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f977800bd90 con 0x558f8f2eb6a0 2024-05-09T01:04:06.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.227+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97700a5050 con 0x558f8f2eb6a0 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.227+0000 7f9762ff5700 1 -- 172.21.15.37:0/4179000400 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f9778012870 con 0x558f8f2eb6a0 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.227+0000 7f9793a4eb80 10 client.25298 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.227+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558f8f302ab0 con 0x558f8f2eb6a0 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.227+0000 7f9762ff5700 1 -- 172.21.15.37:0/4179000400 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97700a5050 con 0x558f8f2eb6a0 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f9762ff5700 1 -- 172.21.15.37:0/4179000400 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f9778011070 con 0x558f8f2eb6a0 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f9793a4eb80 10 client.25298 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f9793a4eb80 10 client.25298 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:04:06.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f9793a4eb80 20 client.25298 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:06.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f305140 0x558f8f3075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f9793a4eb80 4 client.25298 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:06.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f8f21b9d0 con 0x558f8f305140 2024-05-09T01:04:06.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.228+0000 7f977ed9d700 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f305140 0x558f8f3075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.229+0000 7f9762ff5700 10 client.25298 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:04:06.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.229+0000 7f977ed9d700 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f305140 0x558f8f3075e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bff55ffd0d0f49df server_cookie=7c7e1ae8043a4701 in_seq=0 out_seq=0 2024-05-09T01:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.229+0000 7f9762ff5700 1 -- 172.21.15.37:0/4179000400 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558f8f21b9d0 con 0x558f8f305140 2024-05-09T01:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.229+0000 7f9762ff5700 10 client.25298 handle_command_reply: tid=0 2024-05-09T01:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.230+0000 7f9793a4eb80 1 client.25298 shutdown 2024-05-09T01:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.230+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f2eb6a0 msgr2=0x558f8f2f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.230+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f2eb6a0 0x558f8f2f5cb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9778015000 tx=0x7f9778004da0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.231+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 shutdown_connections 2024-05-09T01:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.231+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f2eb6a0 0x558f8f2f5cb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.231+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f305140 0x558f8f3075e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.231+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.231+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/4179000400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f258160 0x558f8f2f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.231+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 >> 172.21.15.37:0/4179000400 conn(0x558f8f1ce6a0 msgr2=0x558f8f2e61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:06.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.231+0000 7f9762ff5700 0 client.25298 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.232+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 shutdown_connections 2024-05-09T01:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.232+0000 7f9793a4eb80 1 -- 172.21.15.37:0/4179000400 wait complete. 2024-05-09T01:04:06.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.232+0000 7f9793a4eb80 20 client.25298 trim_cache size 0 max 16384 2024-05-09T01:04:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.260+0000 7f9793a4eb80 1 Processor -- start 2024-05-09T01:04:06.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.260+0000 7f9793a4eb80 1 -- start start 2024-05-09T01:04:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.261+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.261+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2ea690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.261+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f2eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.261+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97801b5110 con 0x558f8f16e4a0 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.261+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97801b6d40 con 0x558f8f258160 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.261+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97801b57e0 con 0x558f8f2eb6a0 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.261+0000 7f977e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2ea690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41710/0 (socket says 172.21.15.37:41710) 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977e59c700 1 -- 172.21.15.37:0/871739810 learned_addr learned my addr 172.21.15.37:0/871739810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977ed9d700 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977f59e700 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f2eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977e59c700 1 -- 172.21.15.37:0/871739810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 msgr2=0x558f8f2eabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977e59c700 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f2eabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977e59c700 1 -- 172.21.15.37:0/871739810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 msgr2=0x558f8f2f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977e59c700 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.262+0000 7f977e59c700 1 -- 172.21.15.37:0/871739810 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f8f2e7d00 con 0x558f8f258160 2024-05-09T01:04:06.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.263+0000 7f977e59c700 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2ea690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f978007bff0 tx=0x7f9774004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6739de70738f9026 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.263+0000 7f9764ff9700 1 -- 172.21.15.37:0/871739810 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9774015480 con 0x558f8f258160 2024-05-09T01:04:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.264+0000 7f9764ff9700 1 -- 172.21.15.37:0/871739810 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9774024070 con 0x558f8f258160 2024-05-09T01:04:06.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.264+0000 7f9764ff9700 1 -- 172.21.15.37:0/871739810 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97740139c0 con 0x558f8f258160 2024-05-09T01:04:06.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 -- 172.21.15.37:0/871739810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 msgr2=0x558f8f2ea690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2ea690 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f978007bff0 tx=0x7f9774004750 comp rx=0 tx=0).stop 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 -- 172.21.15.37:0/871739810 shutdown_connections 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f2eabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/871739810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2ea690 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 -- 172.21.15.37:0/871739810 >> 172.21.15.37:0/871739810 conn(0x558f8f1ce6a0 msgr2=0x558f8f2f0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 -- 172.21.15.37:0/871739810 shutdown_connections 2024-05-09T01:04:06.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.265+0000 7f9793a4eb80 1 -- 172.21.15.37:0/871739810 wait complete. 2024-05-09T01:04:06.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.266+0000 7f9793a4eb80 1 -- start start 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.266+0000 7f9793a4eb80 1 Processor -- start 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2fd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2fd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f9793a4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f30bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97801b65b0 con 0x558f8f16e4a0 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97801b5ee0 con 0x558f8f258160 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f9793a4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97801b30f0 con 0x558f8f2eb6a0 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f9793a4eb80 10 client.0 _ll_register_callbacks cb 0x558f8f07f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f30bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f30bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60410/0 (socket says 172.21.15.37:60410) 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 -- 172.21.15.37:0/1537705236 learned_addr learned my addr 172.21.15.37:0/1537705236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977ed9d700 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2fd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977e59c700 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2fd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 -- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 msgr2=0x558f8f2fd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2fd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 -- 172.21.15.37:0/1537705236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 msgr2=0x558f8f2fd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2fd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.267+0000 7f977f59e700 1 -- 172.21.15.37:0/1537705236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f8f30c570 con 0x558f8f2eb6a0 2024-05-09T01:04:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.269+0000 7f977f59e700 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f30bdd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9778007d30 tx=0x7f9778012cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a83e84489fd8455 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.269+0000 7f9762ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.270+0000 7f9762ff5700 1 -- 172.21.15.37:0/1537705236 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778035070 con 0x558f8f2eb6a0 2024-05-09T01:04:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.270+0000 7f9762ff5700 1 -- 172.21.15.37:0/1537705236 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9778007710 con 0x558f8f2eb6a0 2024-05-09T01:04:06.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.271+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9774024070 con 0x558f8f2eb6a0 2024-05-09T01:04:06.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.271+0000 7f9762ff5700 1 -- 172.21.15.37:0/1537705236 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f977803f050 con 0x558f8f2eb6a0 2024-05-09T01:04:06.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.272+0000 7f9793a4eb80 10 client.25333 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.272+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558f8f3803c0 con 0x558f8f2eb6a0 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9762ff5700 1 -- 172.21.15.37:0/1537705236 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9774024070 con 0x558f8f2eb6a0 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9762ff5700 1 -- 172.21.15.37:0/1537705236 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f9778011040 con 0x558f8f2eb6a0 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9793a4eb80 10 client.25333 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9793a4eb80 10 client.25333 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9793a4eb80 20 client.25333 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f380a90 0x558f8f382eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9793a4eb80 4 client.25333 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:04:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f8f215a70 con 0x558f8f380a90 2024-05-09T01:04:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.273+0000 7f977ed9d700 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f380a90 0x558f8f382eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.274+0000 7f9762ff5700 10 client.25333 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:04:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.274+0000 7f977ed9d700 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f380a90 0x558f8f382eb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19fee36bf20e5d89 server_cookie=8c499f9a39f7944 in_seq=0 out_seq=0 2024-05-09T01:04:06.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.274+0000 7f9762ff5700 1 -- 172.21.15.37:0/1537705236 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f8f215a70 con 0x558f8f380a90 2024-05-09T01:04:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.274+0000 7f9762ff5700 10 client.25333 handle_command_reply: tid=0 2024-05-09T01:04:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.274+0000 7f9793a4eb80 1 client.25333 shutdown 2024-05-09T01:04:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.274+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 msgr2=0x558f8f30bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.275+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f30bdd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9778007d30 tx=0x7f9778012cc0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 shutdown_connections 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8f2eb6a0 0x558f8f30bdd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x558f8f380a90 0x558f8f382eb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f8f16e4a0 0x558f8f2fd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 --2- 172.21.15.37:0/1537705236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558f8f258160 0x558f8f2fd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 >> 172.21.15.37:0/1537705236 conn(0x558f8f1ce6a0 msgr2=0x558f8f2f51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9762ff5700 0 client.25333 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 shutdown_connections 2024-05-09T01:04:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 1 -- 172.21.15.37:0/1537705236 wait complete. 2024-05-09T01:04:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.277+0000 7f9793a4eb80 20 client.25333 trim_cache size 0 max 16384 2024-05-09T01:04:06.279 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97680b2930 msgr2=0x7f97680b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97680b2930 0x7f97680b4e40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f978007be80 tx=0x7f9774009190 comp rx=0 tx=0).stop 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106580 msgr2=0x7f9780112050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106580 0x7f9780112050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f977000e9f0 tx=0x7f977000ed00 comp rx=0 tx=0).stop 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 shutdown_connections 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97680b2930 0x7f97680b4e40 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f978007be80 tx=0x7f9774009190 comp rx=0 tx=0).stop 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f978010c5c0 0x7f97801a5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9780106580 0x7f9780112050 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 --2- 172.21.15.37:0/2491566665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9780106ed0 0x7f9780112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:06.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.279+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 >> 172.21.15.37:0/2491566665 conn(0x7f9780102080 msgr2=0x7f97801052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.280+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 shutdown_connections 2024-05-09T01:04:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:06.280+0000 7f9785038700 1 -- 172.21.15.37:0/2491566665 wait complete. 2024-05-09T01:04:06.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:06 smithi136 ceph-mon[34110]: pgmap v454: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-05-09T01:04:06.684 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:06 smithi037 ceph-mon[30122]: pgmap v454: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-05-09T01:04:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:06 smithi151 ceph-mon[34780]: pgmap v454: 97 pgs: 97 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-05-09T01:04:07.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:04:07.815 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:08 smithi136 ceph-mon[34110]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 902 op/s 2024-05-09T01:04:08.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:08 smithi037 ceph-mon[30122]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 902 op/s 2024-05-09T01:04:08.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:08 smithi151 ceph-mon[34780]: pgmap v455: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 902 op/s 2024-05-09T01:04:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 -- 172.21.15.37:0/1459606940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 msgr2=0x7f2650108210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 --2- 172.21.15.37:0/1459606940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 0x7f2650108210 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f26400099c0 tx=0x7f2640009cd0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 -- 172.21.15.37:0/1459606940 shutdown_connections 2024-05-09T01:04:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 --2- 172.21.15.37:0/1459606940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2650108750 0x7f26501100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 --2- 172.21.15.37:0/1459606940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650103c60 0x7f2650104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 --2- 172.21.15.37:0/1459606940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 0x7f2650108210 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 -- 172.21.15.37:0/1459606940 >> 172.21.15.37:0/1459606940 conn(0x7f26500fe6f0 msgr2=0x7f2650100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 -- 172.21.15.37:0/1459606940 shutdown_connections 2024-05-09T01:04:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.824+0000 7f26579cb700 1 -- 172.21.15.37:0/1459606940 wait complete. 2024-05-09T01:04:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.825+0000 7f26579cb700 1 Processor -- start 2024-05-09T01:04:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.825+0000 7f26579cb700 1 -- start start 2024-05-09T01:04:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.825+0000 7f26579cb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2650103c60 0x7f265019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.825+0000 7f26579cb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 0x7f265019c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f26579cb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650108750 0x7f265019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f26579cb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2650113360 con 0x7f2650107e00 2024-05-09T01:04:09.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f26579cb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f26501131e0 con 0x7f2650103c60 2024-05-09T01:04:09.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f26579cb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f26501134e0 con 0x7f2650108750 2024-05-09T01:04:09.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2654f66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 0x7f265019c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650108750 0x7f265019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2654f66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 0x7f265019c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54212/0 (socket says 172.21.15.37:54212) 2024-05-09T01:04:09.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650108750 0x7f265019c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60428/0 (socket says 172.21.15.37:60428) 2024-05-09T01:04:09.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2654f66700 1 -- 172.21.15.37:0/4053524158 learned_addr learned my addr 172.21.15.37:0/4053524158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:09.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655767700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2650103c60 0x7f265019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 -- 172.21.15.37:0/4053524158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2650103c60 msgr2=0x7f265019bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2650103c60 0x7f265019bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 -- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 msgr2=0x7f265019c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 0x7f265019c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 -- 172.21.15.37:0/4053524158 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26501a7010 con 0x7f2650108750 2024-05-09T01:04:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.826+0000 7f2655f68700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650108750 0x7f265019c760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f264800efc0 tx=0x7f264800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:09.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.827+0000 7f26467fc700 1 -- 172.21.15.37:0/4053524158 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26480092e0 con 0x7f2650108750 2024-05-09T01:04:09.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.827+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26501a72a0 con 0x7f2650108750 2024-05-09T01:04:09.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.827+0000 7f26467fc700 1 -- 172.21.15.37:0/4053524158 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2648004bb0 con 0x7f2650108750 2024-05-09T01:04:09.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.827+0000 7f26467fc700 1 -- 172.21.15.37:0/4053524158 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2648004020 con 0x7f2650108750 2024-05-09T01:04:09.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.827+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26501a7790 con 0x7f2650108750 2024-05-09T01:04:09.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.830+0000 7f26467fc700 1 -- 172.21.15.37:0/4053524158 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f264801b030 con 0x7f2650108750 2024-05-09T01:04:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 Processor -- start 2024-05-09T01:04:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 -- start start 2024-05-09T01:04:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26467fc700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f263c0b2880 0x7f263c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f2654f66700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f263c0b2880 0x7f263c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627478514a0 0x5627479d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627478f0ff0 con 0x56274793b160 2024-05-09T01:04:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56274788f7f0 con 0x5627478514a0 2024-05-09T01:04:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26663e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627478ecfb0 con 0x5627479ce6a0 2024-05-09T01:04:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f2655767700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f26467fc700 1 -- 172.21.15.37:0/4053524158 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f26480e1c70 con 0x7f2650108750 2024-05-09T01:04:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f2654f66700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627478514a0 0x5627479d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f2655767700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479d44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54216/0 (socket says 172.21.15.37:54216) 2024-05-09T01:04:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.831+0000 7f2655767700 1 -- 172.21.15.37:0/119356840 learned_addr learned my addr 172.21.15.37:0/119356840 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2655f68700 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2654f66700 1 -- 172.21.15.37:0/119356840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 msgr2=0x5627479cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2654f66700 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2654f66700 1 -- 172.21.15.37:0/119356840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 msgr2=0x5627479d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2654f66700 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479d44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2654f66700 1 -- 172.21.15.37:0/119356840 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562747887370 con 0x5627478514a0 2024-05-09T01:04:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2655f68700 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2654f66700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f263c0b2880 0x7f263c0b4d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2650101e50 tx=0x7f2640005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2655767700 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f2654f66700 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627478514a0 0x5627479d4a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2640003760 tx=0x7f264002a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c85ca1eb51aa8df server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f263b7fe700 1 -- 172.21.15.37:0/119356840 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640021040 con 0x5627478514a0 2024-05-09T01:04:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f263b7fe700 1 -- 172.21.15.37:0/119356840 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f264002d070 con 0x5627478514a0 2024-05-09T01:04:09.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.832+0000 7f263b7fe700 1 -- 172.21.15.37:0/119356840 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264000f750 con 0x5627478514a0 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.833+0000 7f26663e1b80 1 -- 172.21.15.37:0/119356840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627478514a0 msgr2=0x5627479d4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.833+0000 7f26663e1b80 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627478514a0 0x5627479d4a30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2640003760 tx=0x7f264002a000 comp rx=0 tx=0).stop 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.833+0000 7f26663e1b80 1 -- 172.21.15.37:0/119356840 shutdown_connections 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.833+0000 7f26663e1b80 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.833+0000 7f26663e1b80 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.833+0000 7f26663e1b80 1 --2- 172.21.15.37:0/119356840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627478514a0 0x5627479d4a30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.833+0000 7f26663e1b80 1 -- 172.21.15.37:0/119356840 >> 172.21.15.37:0/119356840 conn(0x5627478b16a0 msgr2=0x5627479c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:09.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.834+0000 7f26663e1b80 1 -- 172.21.15.37:0/119356840 shutdown_connections 2024-05-09T01:04:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.834+0000 7f26663e1b80 1 -- 172.21.15.37:0/119356840 wait complete. 2024-05-09T01:04:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.834+0000 7f26663e1b80 1 -- start start 2024-05-09T01:04:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.834+0000 7f26663e1b80 1 Processor -- start 2024-05-09T01:04:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479d81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56274793b160 0x5627479d8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479d8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f26663e1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56274776cba0 con 0x5627478514a0 2024-05-09T01:04:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f26663e1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5627478ab150 con 0x5627479ce6a0 2024-05-09T01:04:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f26663e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627479df5e0 con 0x56274793b160 2024-05-09T01:04:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56274793b160 0x5627479d8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f26663e1b80 10 client.0 _ll_register_callbacks cb 0x5627477626c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:09.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2655767700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479d81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56274793b160 0x5627479d8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60436/0 (socket says 172.21.15.37:60436) 2024-05-09T01:04:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 -- 172.21.15.37:0/2170567171 learned_addr learned my addr 172.21.15.37:0/2170567171 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2655f68700 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479d8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 -- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 msgr2=0x5627479d8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479d8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 -- 172.21.15.37:0/2170567171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 msgr2=0x5627479d81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479d81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 -- 172.21.15.37:0/2170567171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56274776c490 con 0x56274793b160 2024-05-09T01:04:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2655767700 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479d81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.835+0000 7f2654f66700 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56274793b160 0x5627479d8720 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2640009d10 tx=0x7f2640003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26bd37c2063b0f1d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f2638ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:09.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f2638ff9700 1 -- 172.21.15.37:0/2170567171 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264000b790 con 0x56274793b160 2024-05-09T01:04:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f2638ff9700 1 -- 172.21.15.37:0/2170567171 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f264000b930 con 0x56274793b160 2024-05-09T01:04:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f264002d070 con 0x56274793b160 2024-05-09T01:04:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f2638ff9700 1 -- 172.21.15.37:0/2170567171 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f264000bb30 con 0x56274793b160 2024-05-09T01:04:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 10 client.25342 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5627479e9ea0 con 0x56274793b160 2024-05-09T01:04:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f2638ff9700 1 -- 172.21.15.37:0/2170567171 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f264000bcd0 con 0x56274793b160 2024-05-09T01:04:09.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f2638ff9700 1 -- 172.21.15.37:0/2170567171 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f26400294c0 con 0x56274793b160 2024-05-09T01:04:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 10 client.25342 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 10 client.25342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 20 client.25342 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5627479ec370 0x5627479ee790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 4 client.25342 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.836+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f264002d070 con 0x5627479ec370 2024-05-09T01:04:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.837+0000 7f2655767700 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5627479ec370 0x5627479ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.837+0000 7f2638ff9700 10 client.25342 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.837+0000 7f2655767700 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5627479ec370 0x5627479ee790 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10ae2d11f3a3c63 server_cookie=4a12853363852df7 in_seq=0 out_seq=0 2024-05-09T01:04:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f2638ff9700 1 -- 172.21.15.37:0/2170567171 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f264002d070 con 0x5627479ec370 2024-05-09T01:04:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f2638ff9700 10 client.25342 handle_command_reply: tid=0 2024-05-09T01:04:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 client.25342 shutdown 2024-05-09T01:04:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56274793b160 msgr2=0x5627479d8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56274793b160 0x5627479d8720 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2640009d10 tx=0x7f2640003c00 comp rx=0 tx=0).stop 2024-05-09T01:04:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 shutdown_connections 2024-05-09T01:04:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5627479ec370 0x5627479ee790 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479d8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479d81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2170567171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56274793b160 0x5627479d8720 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 >> 172.21.15.37:0/2170567171 conn(0x5627478b16a0 msgr2=0x5627479c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f2638ff9700 0 client.25342 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 shutdown_connections 2024-05-09T01:04:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 1 -- 172.21.15.37:0/2170567171 wait complete. 2024-05-09T01:04:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.838+0000 7f26663e1b80 20 client.25342 trim_cache size 0 max 16384 2024-05-09T01:04:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 Processor -- start 2024-05-09T01:04:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 -- start start 2024-05-09T01:04:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56274793b160 0x5627479d9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26501ac810 con 0x5627478514a0 2024-05-09T01:04:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f26501ae440 con 0x56274793b160 2024-05-09T01:04:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f26663e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f26501acee0 con 0x5627479ce6a0 2024-05-09T01:04:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.861+0000 7f2655767700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655767700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479e87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54238/0 (socket says 172.21.15.37:54238) 2024-05-09T01:04:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655767700 1 -- 172.21.15.37:0/2695815584 learned_addr learned my addr 172.21.15.37:0/2695815584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2654f66700 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56274793b160 0x5627479d9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655f68700 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655f68700 1 -- 172.21.15.37:0/2695815584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56274793b160 msgr2=0x5627479d9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655f68700 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56274793b160 0x5627479d9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655f68700 1 -- 172.21.15.37:0/2695815584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 msgr2=0x5627479e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655f68700 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479e87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655f68700 1 -- 172.21.15.37:0/2695815584 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627479c2f60 con 0x5627479ce6a0 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2654f66700 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56274793b160 0x5627479d9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655767700 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f2655f68700 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479f13a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26480df770 tx=0x7f2648004db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c9f54dfee7ee06a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f263affd700 1 -- 172.21.15.37:0/2695815584 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26480a9a20 con 0x5627479ce6a0 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f263affd700 1 -- 172.21.15.37:0/2695815584 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26480a9320 con 0x5627479ce6a0 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.862+0000 7f263affd700 1 -- 172.21.15.37:0/2695815584 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26480b1ec0 con 0x5627479ce6a0 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 -- 172.21.15.37:0/2695815584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 msgr2=0x5627479f13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479f13a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26480df770 tx=0x7f2648004db0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 -- 172.21.15.37:0/2695815584 shutdown_connections 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627479ce6a0 0x5627479f13a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627478514a0 0x5627479e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2695815584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56274793b160 0x5627479d9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 -- 172.21.15.37:0/2695815584 >> 172.21.15.37:0/2695815584 conn(0x5627478b16a0 msgr2=0x5627479d9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 -- 172.21.15.37:0/2695815584 shutdown_connections 2024-05-09T01:04:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.863+0000 7f26663e1b80 1 -- 172.21.15.37:0/2695815584 wait complete. 2024-05-09T01:04:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.864+0000 7f26663e1b80 1 -- start start 2024-05-09T01:04:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.864+0000 7f26663e1b80 1 Processor -- start 2024-05-09T01:04:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627478514a0 0x5627479f1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f26663e1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f26663e1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26501adcb0 con 0x56274793b160 2024-05-09T01:04:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f26663e1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f26501ad5e0 con 0x5627479ce6a0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f26663e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f26501aa830 con 0x5627478514a0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f26663e1b80 10 client.0 _ll_register_callbacks cb 0x5627477626c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f2655767700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627478514a0 0x5627479f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f2655767700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627478514a0 0x5627479f1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60460/0 (socket says 172.21.15.37:60460) 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f2655767700 1 -- 172.21.15.37:0/2895317249 learned_addr learned my addr 172.21.15.37:0/2895317249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f2654f66700 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.865+0000 7f2655f68700 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2655767700 1 -- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 msgr2=0x5627479f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2655767700 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2655767700 1 -- 172.21.15.37:0/2895317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 msgr2=0x5627479efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2655767700 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2655767700 1 -- 172.21.15.37:0/2895317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627479f0990 con 0x5627478514a0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2655767700 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627478514a0 0x5627479f1900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f264c0126f0 tx=0x7f264c012a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d448a6f88dd4ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2638ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2638ff9700 1 -- 172.21.15.37:0/2895317249 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c004520 con 0x5627478514a0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f2638ff9700 1 -- 172.21.15.37:0/2895317249 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f264c004830 con 0x5627478514a0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.866+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26480a9320 con 0x5627478514a0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f2638ff9700 1 -- 172.21.15.37:0/2895317249 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f264c004a30 con 0x5627478514a0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 10 client.25348 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x562747a55870 con 0x5627478514a0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f2638ff9700 1 -- 172.21.15.37:0/2895317249 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26480a9320 con 0x5627478514a0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f2638ff9700 1 -- 172.21.15.37:0/2895317249 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f264c003780 con 0x5627478514a0 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 10 client.25348 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 10 client.25348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 20 client.25348 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562747a56040 0x562747a58460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 4 client.25348 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.867+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5627478fe9d0 con 0x562747a56040 2024-05-09T01:04:09.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.868+0000 7f2654f66700 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562747a56040 0x562747a58460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f2654f66700 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562747a56040 0x562747a58460 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=861229d08ca81cd6 server_cookie=fc698abb7883e1bf in_seq=0 out_seq=0 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f2638ff9700 10 client.25348 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f2638ff9700 1 -- 172.21.15.37:0/2895317249 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5627478fe9d0 con 0x562747a56040 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f2638ff9700 10 client.25348 handle_command_reply: tid=0 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 client.25348 shutdown 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627478514a0 msgr2=0x5627479f1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627478514a0 0x5627479f1900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f264c0126f0 tx=0x7f264c012a00 comp rx=0 tx=0).stop 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 shutdown_connections 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562747a56040 0x562747a58460 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5627479ce6a0 0x5627479f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627478514a0 0x5627479f1900 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 --2- 172.21.15.37:0/2895317249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56274793b160 0x5627479efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 >> 172.21.15.37:0/2895317249 conn(0x5627478b16a0 msgr2=0x5627479cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.869+0000 7f2638ff9700 0 client.25348 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:09.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.870+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 shutdown_connections 2024-05-09T01:04:09.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.870+0000 7f26663e1b80 1 -- 172.21.15.37:0/2895317249 wait complete. 2024-05-09T01:04:09.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.870+0000 7f26663e1b80 20 client.25348 trim_cache size 0 max 16384 2024-05-09T01:04:09.876 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.870+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f263c0b2880 msgr2=0x7f263c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.870+0000 7f26579cb700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f263c0b2880 0x7f263c0b4d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2650101e50 tx=0x7f2640005fb0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.870+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650108750 msgr2=0x7f265019c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.870+0000 7f26579cb700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650108750 0x7f265019c760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f264800efc0 tx=0x7f264800c3a0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 shutdown_connections 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f263c0b2880 0x7f263c0b4d90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2650108750 0x7f265019c760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2650103c60 0x7f265019bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 --2- 172.21.15.37:0/4053524158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2650107e00 0x7f265019c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 >> 172.21.15.37:0/4053524158 conn(0x7f26500fe6f0 msgr2=0x7f26501096b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 shutdown_connections 2024-05-09T01:04:09.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:09.871+0000 7f26579cb700 1 -- 172.21.15.37:0/4053524158 wait complete. 2024-05-09T01:04:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 110.0 s, 3484.4 tps, lat 28.745 ms stddev 33.228 2024-05-09T01:04:10.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:10 smithi136 ceph-mon[34110]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 824 op/s 2024-05-09T01:04:10.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:10 smithi037 ceph-mon[30122]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 824 op/s 2024-05-09T01:04:10.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:10 smithi151 ceph-mon[34780]: pgmap v456: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 824 op/s 2024-05-09T01:04:11.720 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:04:11.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:04:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:12.528 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:12 smithi037 ceph-mon[30122]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 846 op/s 2024-05-09T01:04:12.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:12 smithi136 ceph-mon[34110]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 846 op/s 2024-05-09T01:04:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:12 smithi151 ceph-mon[34780]: pgmap v457: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 846 op/s 2024-05-09T01:04:14.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.156+0000 7fe979c70700 1 -- 172.21.15.37:0/616160358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97410a930 msgr2=0x7fe97410ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.156+0000 7fe979c70700 1 --2- 172.21.15.37:0/616160358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97410a930 0x7fe97410ad40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe968009990 tx=0x7fe968009ca0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.157+0000 7fe979c70700 1 -- 172.21.15.37:0/616160358 shutdown_connections 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.157+0000 7fe979c70700 1 --2- 172.21.15.37:0/616160358 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97410b280 0x7fe9741198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.157+0000 7fe979c70700 1 --2- 172.21.15.37:0/616160358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe974111bd0 0x7fe974111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.157+0000 7fe979c70700 1 --2- 172.21.15.37:0/616160358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97410a930 0x7fe97410ad40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.157+0000 7fe979c70700 1 -- 172.21.15.37:0/616160358 >> 172.21.15.37:0/616160358 conn(0x7fe97406f4d0 msgr2=0x7fe97406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.157+0000 7fe979c70700 1 -- 172.21.15.37:0/616160358 shutdown_connections 2024-05-09T01:04:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.157+0000 7fe979c70700 1 -- 172.21.15.37:0/616160358 wait complete. 2024-05-09T01:04:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.158+0000 7fe979c70700 1 Processor -- start 2024-05-09T01:04:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.160+0000 7fe979c70700 1 -- start start 2024-05-09T01:04:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.160+0000 7fe979c70700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97410a930 0x7fe97410e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.160+0000 7fe979c70700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97410b280 0x7fe97410c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.160+0000 7fe979c70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe974111bd0 0x7fe97410cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.160+0000 7fe979c70700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe97411ce30 con 0x7fe974111bd0 2024-05-09T01:04:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.160+0000 7fe979c70700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe97411ccb0 con 0x7fe97410b280 2024-05-09T01:04:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.160+0000 7fe979c70700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe97411cfb0 con 0x7fe97410a930 2024-05-09T01:04:14.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.161+0000 7fe973fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe974111bd0 0x7fe97410cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.161+0000 7fe973fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe974111bd0 0x7fe97410cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56672/0 (socket says 172.21.15.37:56672) 2024-05-09T01:04:14.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.161+0000 7fe973fff700 1 -- 172.21.15.37:0/2688483128 learned_addr learned my addr 172.21.15.37:0/2688483128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:14.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.161+0000 7fe972ffd700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97410b280 0x7fe97410c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.162+0000 7fe972ffd700 1 -- 172.21.15.37:0/2688483128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97410a930 msgr2=0x7fe97410e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.162+0000 7fe972ffd700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97410a930 0x7fe97410e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.162+0000 7fe972ffd700 1 -- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe974111bd0 msgr2=0x7fe97410cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.162+0000 7fe972ffd700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe974111bd0 0x7fe97410cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.162+0000 7fe972ffd700 1 -- 172.21.15.37:0/2688483128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97410d490 con 0x7fe97410b280 2024-05-09T01:04:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.166+0000 7fe972ffd700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97410b280 0x7fe97410c680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe968000c00 tx=0x7fe9680057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.168+0000 7fe970ff9700 1 -- 172.21.15.37:0/2688483128 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968026070 con 0x7fe97410b280 2024-05-09T01:04:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.168+0000 7fe970ff9700 1 -- 172.21.15.37:0/2688483128 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe968003f40 con 0x7fe97410b280 2024-05-09T01:04:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.170+0000 7fe970ff9700 1 -- 172.21.15.37:0/2688483128 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96800fd00 con 0x7fe97410b280 2024-05-09T01:04:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.170+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9741b6210 con 0x7fe97410b280 2024-05-09T01:04:14.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.171+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9741b65b0 con 0x7fe97410b280 2024-05-09T01:04:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.176+0000 7fe988686b80 1 Processor -- start 2024-05-09T01:04:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.177+0000 7fe988686b80 1 -- start start 2024-05-09T01:04:14.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.177+0000 7fe988686b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d82025f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.178+0000 7fe988686b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8200d1520 0x55d82025ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.178+0000 7fe988686b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d820264080 0x55d820264490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.178+0000 7fe988686b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d820171070 con 0x55d820264080 2024-05-09T01:04:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.178+0000 7fe988686b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d82010f870 con 0x55d8201bb1e0 2024-05-09T01:04:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.178+0000 7fe988686b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d82016d030 con 0x55d8200d1520 2024-05-09T01:04:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.179+0000 7fe9737fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8200d1520 0x55d82025ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.179+0000 7fe973fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d82025f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.179+0000 7fe9737fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8200d1520 0x55d82025ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48972/0 (socket says 172.21.15.37:48972) 2024-05-09T01:04:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.179+0000 7fe9737fe700 1 -- 172.21.15.37:0/2585021539 learned_addr learned my addr 172.21.15.37:0/2585021539 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:14.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.179+0000 7fe970ff9700 1 -- 172.21.15.37:0/2688483128 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe968003a90 con 0x7fe97410b280 2024-05-09T01:04:14.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.180+0000 7fe9737fe700 1 -- 172.21.15.37:0/2585021539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 msgr2=0x55d82025f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.180+0000 7fe9737fe700 1 --2- 172.21.15.37:0/2585021539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d82025f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.180+0000 7fe9737fe700 1 -- 172.21.15.37:0/2585021539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d820264080 msgr2=0x55d820264490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.180+0000 7fe9737fe700 1 --2- 172.21.15.37:0/2585021539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d820264080 0x55d820264490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.180+0000 7fe9737fe700 1 -- 172.21.15.37:0/2585021539 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8201073f0 con 0x55d8200d1520 2024-05-09T01:04:14.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.181+0000 7fe970ff9700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe95c0b28e0 0x7fe95c0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.182+0000 7fe970ff9700 1 -- 172.21.15.37:0/2688483128 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe9680e2970 con 0x7fe97410b280 2024-05-09T01:04:14.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.182+0000 7fe973fff700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe95c0b28e0 0x7fe95c0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.183+0000 7fe973fff700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe95c0b28e0 0x7fe95c0b4df0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe96c011420 tx=0x7fe96c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:14.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.183+0000 7fe9737fe700 1 --2- 172.21.15.37:0/2585021539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8200d1520 0x55d82025ff70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe964009840 tx=0x7fe964009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbdb1b72ac653a40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:14.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.185+0000 7fe959ffb700 1 -- 172.21.15.37:0/2585021539 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964015020 con 0x55d8200d1520 2024-05-09T01:04:14.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.185+0000 7fe959ffb700 1 -- 172.21.15.37:0/2585021539 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe964011ce0 con 0x55d8200d1520 2024-05-09T01:04:14.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.186+0000 7fe988686b80 1 -- 172.21.15.37:0/2585021539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8200d1520 msgr2=0x55d82025ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.186+0000 7fe988686b80 1 --2- 172.21.15.37:0/2585021539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8200d1520 0x55d82025ff70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe964009840 tx=0x7fe964009b50 comp rx=0 tx=0).stop 2024-05-09T01:04:14.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.188+0000 7fe988686b80 1 -- 172.21.15.37:0/2585021539 shutdown_connections 2024-05-09T01:04:14.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.188+0000 7fe988686b80 1 --2- 172.21.15.37:0/2585021539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d820264080 0x55d820264490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.188+0000 7fe988686b80 1 --2- 172.21.15.37:0/2585021539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d82025f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.188+0000 7fe988686b80 1 --2- 172.21.15.37:0/2585021539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8200d1520 0x55d82025ff70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.188+0000 7fe988686b80 1 -- 172.21.15.37:0/2585021539 >> 172.21.15.37:0/2585021539 conn(0x55d820131720 msgr2=0x55d820249480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.188+0000 7fe988686b80 1 -- 172.21.15.37:0/2585021539 shutdown_connections 2024-05-09T01:04:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.188+0000 7fe988686b80 1 -- 172.21.15.37:0/2585021539 wait complete. 2024-05-09T01:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.189+0000 7fe988686b80 1 -- start start 2024-05-09T01:04:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.190+0000 7fe988686b80 1 Processor -- start 2024-05-09T01:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.190+0000 7fe988686b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820269280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe988686b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d8202697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe9737fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820269280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe9737fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820269280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56688/0 (socket says 172.21.15.37:56688) 2024-05-09T01:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe9737fe700 1 -- 172.21.15.37:0/694847799 learned_addr learned my addr 172.21.15.37:0/694847799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe988686b80 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820269d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d81ffecc20 con 0x55d8200d1520 2024-05-09T01:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe972ffd700 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d8202697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d82012b1d0 con 0x55d8201bb1e0 2024-05-09T01:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe973fff700 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820269d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.191+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d820264e80 con 0x55d820264080 2024-05-09T01:04:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.192+0000 7fe988686b80 10 client.0 _ll_register_callbacks cb 0x55d81ffe2740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.192+0000 7fe9737fe700 1 -- 172.21.15.37:0/694847799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 msgr2=0x55d820269d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.192+0000 7fe9737fe700 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820269d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.192+0000 7fe9737fe700 1 -- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 msgr2=0x55d8202697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.192+0000 7fe9737fe700 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d8202697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.192+0000 7fe9737fe700 1 -- 172.21.15.37:0/694847799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d81ffec510 con 0x55d8200d1520 2024-05-09T01:04:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.192+0000 7fe9737fe700 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820269280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe964009f20 tx=0x7fe964011910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8559cc2581b5ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.193+0000 7fe952ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.193+0000 7fe952ffd700 1 -- 172.21.15.37:0/694847799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964020070 con 0x55d8200d1520 2024-05-09T01:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.193+0000 7fe952ffd700 1 -- 172.21.15.37:0/694847799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe96401a830 con 0x55d8200d1520 2024-05-09T01:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.193+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe964011ce0 con 0x55d8200d1520 2024-05-09T01:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.194+0000 7fe952ffd700 1 -- 172.21.15.37:0/694847799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe964015020 con 0x55d8200d1520 2024-05-09T01:04:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.194+0000 7fe988686b80 10 client.15591 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.194+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d820276970 con 0x55d8200d1520 2024-05-09T01:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe952ffd700 1 -- 172.21.15.37:0/694847799 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe964011ce0 con 0x55d8200d1520 2024-05-09T01:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe952ffd700 1 -- 172.21.15.37:0/694847799 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe9640248a0 con 0x55d8200d1520 2024-05-09T01:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe988686b80 10 client.15591 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe988686b80 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe988686b80 20 client.15591 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe988686b80 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d82027b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe988686b80 4 client.15591 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.195+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d82017ea50 con 0x55d820278f50 2024-05-09T01:04:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.196+0000 7fe972ffd700 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d82027b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.198+0000 7fe972ffd700 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d82027b370 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10d61e2d6f565493 server_cookie=b93388fa68009312 in_seq=0 out_seq=0 2024-05-09T01:04:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.198+0000 7fe952ffd700 10 client.15591 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.199+0000 7fe952ffd700 1 -- 172.21.15.37:0/694847799 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d82017ea50 con 0x55d820278f50 2024-05-09T01:04:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.199+0000 7fe952ffd700 10 client.15591 handle_command_reply: tid=0 2024-05-09T01:04:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.199+0000 7fe988686b80 1 client.15591 shutdown 2024-05-09T01:04:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.199+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 msgr2=0x55d820269280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.199+0000 7fe988686b80 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820269280 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe964009f20 tx=0x7fe964011910 comp rx=0 tx=0).stop 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.201+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 shutdown_connections 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.201+0000 7fe988686b80 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d82027b370 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe988686b80 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820269d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe952ffd700 0 client.15591 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe988686b80 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820269280 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe988686b80 1 --2- 172.21.15.37:0/694847799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d8202697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 >> 172.21.15.37:0/694847799 conn(0x55d820131720 msgr2=0x55d820249240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 shutdown_connections 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe988686b80 1 -- 172.21.15.37:0/694847799 wait complete. 2024-05-09T01:04:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.202+0000 7fe988686b80 20 client.15591 trim_cache size 0 max 16384 2024-05-09T01:04:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.235+0000 7fe988686b80 1 Processor -- start 2024-05-09T01:04:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.235+0000 7fe988686b80 1 -- start start 2024-05-09T01:04:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.236+0000 7fe988686b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d82024e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.236+0000 7fe988686b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820269b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.236+0000 7fe988686b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820275080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.236+0000 7fe988686b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9741ae820 con 0x55d8200d1520 2024-05-09T01:04:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.236+0000 7fe988686b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe9741b6b70 con 0x55d8201bb1e0 2024-05-09T01:04:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.236+0000 7fe988686b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9741aeef0 con 0x55d820264080 2024-05-09T01:04:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe972ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820269b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe972ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820269b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41898/0 (socket says 172.21.15.37:41898) 2024-05-09T01:04:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe972ffd700 1 -- 172.21.15.37:0/211640570 learned_addr learned my addr 172.21.15.37:0/211640570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe973fff700 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820275080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe973fff700 1 -- 172.21.15.37:0/211640570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 msgr2=0x55d820269b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe973fff700 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820269b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe9737fe700 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d82024e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe973fff700 1 -- 172.21.15.37:0/211640570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 msgr2=0x55d82024e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe973fff700 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d82024e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe973fff700 1 -- 172.21.15.37:0/211640570 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d820268910 con 0x55d820264080 2024-05-09T01:04:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.237+0000 7fe9737fe700 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d82024e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.238+0000 7fe973fff700 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820275080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009f50 tx=0x7fe96c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68ef0427a4391dcc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.238+0000 7fe9597fa700 1 -- 172.21.15.37:0/211640570 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c023650 con 0x55d820264080 2024-05-09T01:04:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.238+0000 7fe9597fa700 1 -- 172.21.15.37:0/211640570 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe96c028070 con 0x55d820264080 2024-05-09T01:04:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.238+0000 7fe9597fa700 1 -- 172.21.15.37:0/211640570 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c015c60 con 0x55d820264080 2024-05-09T01:04:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 -- 172.21.15.37:0/211640570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 msgr2=0x55d820275080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820275080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009f50 tx=0x7fe96c014000 comp rx=0 tx=0).stop 2024-05-09T01:04:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 -- 172.21.15.37:0/211640570 shutdown_connections 2024-05-09T01:04:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820275080 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d82024e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 --2- 172.21.15.37:0/211640570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820269b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 -- 172.21.15.37:0/211640570 >> 172.21.15.37:0/211640570 conn(0x55d820131720 msgr2=0x55d820268200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 -- 172.21.15.37:0/211640570 shutdown_connections 2024-05-09T01:04:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.240+0000 7fe988686b80 1 -- 172.21.15.37:0/211640570 wait complete. 2024-05-09T01:04:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.241+0000 7fe988686b80 1 -- start start 2024-05-09T01:04:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.241+0000 7fe988686b80 1 Processor -- start 2024-05-09T01:04:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.242+0000 7fe988686b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820261980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.242+0000 7fe988686b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820261ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe988686b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820262400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe9737fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820261980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe988686b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9741afcc0 con 0x55d8200d1520 2024-05-09T01:04:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe9737fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820261980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56708/0 (socket says 172.21.15.37:56708) 2024-05-09T01:04:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe988686b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe9741af5f0 con 0x55d8201bb1e0 2024-05-09T01:04:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe9737fe700 1 -- 172.21.15.37:0/2709096357 learned_addr learned my addr 172.21.15.37:0/2709096357 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9741ac860 con 0x55d820264080 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe988686b80 10 client.0 _ll_register_callbacks cb 0x55d81ffe2740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe973fff700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820262400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe972ffd700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820261ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe973fff700 1 -- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 msgr2=0x55d820261ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe973fff700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820261ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe973fff700 1 -- 172.21.15.37:0/2709096357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 msgr2=0x55d820261980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe973fff700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820261980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe973fff700 1 -- 172.21.15.37:0/2709096357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82026f710 con 0x55d820264080 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.243+0000 7fe9737fe700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820261980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.244+0000 7fe973fff700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820262400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55d8201796b0 tx=0x7fe96c023680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c3cec4636857308 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.244+0000 7fe952ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.244+0000 7fe952ffd700 1 -- 172.21.15.37:0/2709096357 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96c033070 con 0x55d820264080 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.244+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe96c028070 con 0x55d820264080 2024-05-09T01:04:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.244+0000 7fe952ffd700 1 -- 172.21.15.37:0/2709096357 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe96c023c80 con 0x55d820264080 2024-05-09T01:04:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.245+0000 7fe952ffd700 1 -- 172.21.15.37:0/2709096357 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe96c015410 con 0x55d820264080 2024-05-09T01:04:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.245+0000 7fe988686b80 10 client.25360 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.245+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d8202e36a0 con 0x55d820264080 2024-05-09T01:04:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe952ffd700 1 -- 172.21.15.37:0/2709096357 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe96c028070 con 0x55d820264080 2024-05-09T01:04:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe952ffd700 1 -- 172.21.15.37:0/2709096357 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe96c0373b0 con 0x55d820264080 2024-05-09T01:04:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe988686b80 10 client.25360 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe988686b80 10 client.25360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe988686b80 20 client.25360 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe988686b80 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d8202e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe988686b80 4 client.25360 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:04:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.247+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d820178af0 con 0x55d820278f50 2024-05-09T01:04:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.248+0000 7fe9737fe700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d8202e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.248+0000 7fe952ffd700 10 client.25360 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.249+0000 7fe9737fe700 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d8202e5db0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a829ce5600b1746 server_cookie=698063f332453a0 in_seq=0 out_seq=0 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.250+0000 7fe952ffd700 1 -- 172.21.15.37:0/2709096357 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d820178af0 con 0x55d820278f50 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.250+0000 7fe952ffd700 10 client.25360 handle_command_reply: tid=0 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.250+0000 7fe988686b80 1 client.25360 shutdown 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 msgr2=0x55d820262400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820262400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55d8201796b0 tx=0x7fe96c023680 comp rx=0 tx=0).stop 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 shutdown_connections 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d820278f50 0x55d8202e5db0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe952ffd700 0 client.25360 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d820264080 0x55d820262400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d8200d1520 0x55d820261980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 --2- 172.21.15.37:0/2709096357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d8201bb1e0 0x55d820261ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 >> 172.21.15.37:0/2709096357 conn(0x55d820131720 msgr2=0x55d820268200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 shutdown_connections 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 1 -- 172.21.15.37:0/2709096357 wait complete. 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.251+0000 7fe988686b80 20 client.25360 trim_cache size 0 max 16384 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "996e5af9-5ce7-4ee2-b271-bf2bf6a0a171", 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:04:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.252+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe95c0b28e0 msgr2=0x7fe95c0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.252+0000 7fe979c70700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe95c0b28e0 0x7fe95c0b4df0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe96c011420 tx=0x7fe96c00b040 comp rx=0 tx=0).stop 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.252+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97410b280 msgr2=0x7fe97410c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.252+0000 7fe979c70700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97410b280 0x7fe97410c680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe968000c00 tx=0x7fe9680057c0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.253+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 shutdown_connections 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.254+0000 7fe979c70700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe95c0b28e0 0x7fe95c0b4df0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.254+0000 7fe979c70700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe974111bd0 0x7fe97410cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.254+0000 7fe979c70700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97410a930 0x7fe97410e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.254+0000 7fe979c70700 1 --2- 172.21.15.37:0/2688483128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97410b280 0x7fe97410c680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.254+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 >> 172.21.15.37:0/2688483128 conn(0x7fe97406f4d0 msgr2=0x7fe974110600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:14.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.254+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 shutdown_connections 2024-05-09T01:04:14.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:14.254+0000 7fe979c70700 1 -- 172.21.15.37:0/2688483128 wait complete. 2024-05-09T01:04:14.508 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:14 smithi037 ceph-mon[30122]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 11 MiB/s wr, 873 op/s 2024-05-09T01:04:14.508 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:14 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:04:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:14 smithi136 ceph-mon[34110]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 11 MiB/s wr, 873 op/s 2024-05-09T01:04:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:14 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:04:14.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:14 smithi151 ceph-mon[34780]: pgmap v458: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 11 MiB/s wr, 873 op/s 2024-05-09T01:04:14.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:14 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:04:14.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:04:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 115.0 s, 4213.6 tps, lat 23.628 ms stddev 25.106 2024-05-09T01:04:15.410 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:04:15.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:15 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:04:15.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:04:15.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:04:15.705 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:15 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:04:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:04:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:04:15.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:15.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:15 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:04:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 -- 172.21.15.37:0/3582475699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 msgr2=0x7f754c103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 --2- 172.21.15.37:0/3582475699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c103840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f753c009860 tx=0x7f753c02a340 comp rx=0 tx=0).stop 2024-05-09T01:04:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 -- 172.21.15.37:0/3582475699 shutdown_connections 2024-05-09T01:04:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 --2- 172.21.15.37:0/3582475699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754c108a80 0x7f754c10aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 --2- 172.21.15.37:0/3582475699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754c103d80 0x7f754c104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 --2- 172.21.15.37:0/3582475699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c103840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 -- 172.21.15.37:0/3582475699 >> 172.21.15.37:0/3582475699 conn(0x7f754c0fdd30 msgr2=0x7f754c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 -- 172.21.15.37:0/3582475699 shutdown_connections 2024-05-09T01:04:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.607+0000 7f75543ce640 1 -- 172.21.15.37:0/3582475699 wait complete. 2024-05-09T01:04:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.608+0000 7f75543ce640 1 Processor -- start 2024-05-09T01:04:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.608+0000 7f75543ce640 1 -- start start 2024-05-09T01:04:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.608+0000 7f75543ce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c10ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f75543ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754c103d80 0x7f754c10b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f75543ce640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754c108a80 0x7f754c10ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f75543ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f754c10f720 con 0x7f754c103d80 2024-05-09T01:04:16.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f755216a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c10ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f755216a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c10ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49002/0 (socket says 172.21.15.37:49002) 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f755216a640 1 -- 172.21.15.37:0/997918571 learned_addr learned my addr 172.21.15.37:0/997918571 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f754c10f5a0 con 0x7f754c108a80 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f754c10f8a0 con 0x7f754c102b40 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f755296b640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754c108a80 0x7f754c10ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.609+0000 7f7551969640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754c103d80 0x7f754c10b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f755216a640 1 -- 172.21.15.37:0/997918571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754c108a80 msgr2=0x7f754c10ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f755216a640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754c108a80 0x7f754c10ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f755216a640 1 -- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754c103d80 msgr2=0x7f754c10b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f755216a640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754c103d80 0x7f754c10b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f755216a640 1 -- 172.21.15.37:0/997918571 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754c19e220 con 0x7f754c102b40 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f7551969640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754c103d80 0x7f754c10b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f755216a640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c10ce60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f753c0304b0 tx=0x7f753c032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f75437fe640 1 -- 172.21.15.37:0/997918571 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c037040 con 0x7f754c102b40 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f75437fe640 1 -- 172.21.15.37:0/997918571 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f753c030c10 con 0x7f754c102b40 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f75437fe640 1 -- 172.21.15.37:0/997918571 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753c003850 con 0x7f754c102b40 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754c10c040 con 0x7f754c102b40 2024-05-09T01:04:16.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.610+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754c1a8c40 con 0x7f754c102b40 2024-05-09T01:04:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.614+0000 7f755b282740 1 Processor -- start 2024-05-09T01:04:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.614+0000 7f755b282740 1 -- start start 2024-05-09T01:04:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f755b282740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48464500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f755b282740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea48464a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f755b282740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f755b282740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea483c87c0 con 0x55ea4809f4d0 2024-05-09T01:04:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f755b282740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea483640e0 con 0x55ea480972f0 2024-05-09T01:04:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f755b282740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea483c4780 con 0x55ea480c01b0 2024-05-09T01:04:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f7551969640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f755296b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48464500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f7551969640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56734/0 (socket says 172.21.15.37:56734) 2024-05-09T01:04:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.615+0000 7f7551969640 1 -- 172.21.15.37:0/2081333580 learned_addr learned my addr 172.21.15.37:0/2081333580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f755296b640 1 -- 172.21.15.37:0/2081333580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 msgr2=0x55ea48464a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f755296b640 1 --2- 172.21.15.37:0/2081333580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea48464a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f755296b640 1 -- 172.21.15.37:0/2081333580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 msgr2=0x55ea4846b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f755296b640 1 --2- 172.21.15.37:0/2081333580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f755296b640 1 -- 172.21.15.37:0/2081333580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4838d7c0 con 0x55ea480c01b0 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f75437fe640 1 -- 172.21.15.37:0/997918571 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f753c043020 con 0x7f754c102b40 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f755296b640 1 --2- 172.21.15.37:0/2081333580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48464500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f754400e450 tx=0x7f75440095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f2550dd992d68f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.616+0000 7f7540bfe640 1 -- 172.21.15.37:0/2081333580 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544004b20 con 0x55ea480c01b0 2024-05-09T01:04:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.617+0000 7f7540bfe640 1 -- 172.21.15.37:0/2081333580 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7544004cc0 con 0x55ea480c01b0 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.617+0000 7f75437fe640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f75380b28e0 0x7f75380b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.618+0000 7f75437fe640 1 -- 172.21.15.37:0/997918571 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f753c1016d0 con 0x7f754c102b40 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.618+0000 7f755216a640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f75380b28e0 0x7f75380b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.618+0000 7f755b282740 1 -- 172.21.15.37:0/2081333580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 msgr2=0x55ea48464500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.618+0000 7f755b282740 1 --2- 172.21.15.37:0/2081333580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48464500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f754400e450 tx=0x7f75440095c0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 -- 172.21.15.37:0/2081333580 shutdown_connections 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 --2- 172.21.15.37:0/2081333580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 --2- 172.21.15.37:0/2081333580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea48464a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 --2- 172.21.15.37:0/2081333580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48464500 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 -- 172.21.15.37:0/2081333580 >> 172.21.15.37:0/2081333580 conn(0x55ea480b4300 msgr2=0x55ea4845fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:16.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755216a640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f75380b28e0 0x7f75380b4df0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f753c035040 tx=0x7f753c005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:16.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 -- 172.21.15.37:0/2081333580 shutdown_connections 2024-05-09T01:04:16.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 -- 172.21.15.37:0/2081333580 wait complete. 2024-05-09T01:04:16.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.619+0000 7f755b282740 1 -- start start 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755b282740 1 Processor -- start 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755b282740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea4846e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755b282740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755296b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea4846e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755b282740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48475730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755296b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea4846e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41932/0 (socket says 172.21.15.37:41932) 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755296b640 1 -- 172.21.15.37:0/4294072700 learned_addr learned my addr 172.21.15.37:0/4294072700 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:16.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.620+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea4846c470 con 0x55ea4809f4d0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea4834f9c0 con 0x55ea480972f0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea4846c5f0 con 0x55ea480c01b0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755b282740 10 client.0 _ll_register_callbacks cb 0x55ea4837c020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f7551969640 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755296b640 1 -- 172.21.15.37:0/4294072700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 msgr2=0x55ea48475730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755296b640 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48475730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755296b640 1 -- 172.21.15.37:0/4294072700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 msgr2=0x55ea4846e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755296b640 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755296b640 1 -- 172.21.15.37:0/4294072700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea483761f0 con 0x55ea480972f0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f7551969640 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f755296b640 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea4846e290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f75440099d0 tx=0x7f7544004c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd9f84bef10cebe8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.621+0000 7f7535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.622+0000 7f7535ffb640 1 -- 172.21.15.37:0/4294072700 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544027020 con 0x55ea480972f0 2024-05-09T01:04:16.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.622+0000 7f7535ffb640 1 -- 172.21.15.37:0/4294072700 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7544003970 con 0x55ea480972f0 2024-05-09T01:04:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.622+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7544004cc0 con 0x55ea480972f0 2024-05-09T01:04:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.622+0000 7f7535ffb640 1 -- 172.21.15.37:0/4294072700 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f7544003b70 con 0x55ea480972f0 2024-05-09T01:04:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.622+0000 7f755b282740 10 client.25346 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:16.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.622+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ea4812b790 con 0x55ea480972f0 2024-05-09T01:04:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.622+0000 7f7535ffb640 1 -- 172.21.15.37:0/4294072700 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7544004cc0 con 0x55ea480972f0 2024-05-09T01:04:16.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f7535ffb640 1 -- 172.21.15.37:0/4294072700 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f754400b040 con 0x55ea480972f0 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f755b282740 10 client.25346 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f755b282740 10 client.25346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f755b282740 20 client.25346 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f755b282740 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea4807ed80 0x55ea4847b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f755b282740 4 client.25346 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f7551969640 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea4807ed80 0x55ea4847b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.623+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea483d63d0 con 0x55ea4807ed80 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.624+0000 7f7551969640 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea4807ed80 0x55ea4847b930 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96f1193f01da2c6 server_cookie=476ff0c0ee8faaaa in_seq=0 out_seq=0 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.624+0000 7f7535ffb640 10 client.25346 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.625+0000 7f7535ffb640 1 -- 172.21.15.37:0/4294072700 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ea483d63d0 con 0x55ea4807ed80 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.625+0000 7f7535ffb640 10 client.25346 handle_command_reply: tid=0 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.625+0000 7f755b282740 1 client.25346 shutdown 2024-05-09T01:04:16.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 msgr2=0x55ea4846e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea4846e290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f75440099d0 tx=0x7f7544004c10 comp rx=0 tx=0).stop 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 shutdown_connections 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea4807ed80 0x55ea4847b930 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea480c01b0 0x55ea48475730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea4809f4d0 0x55ea4846e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 --2- 172.21.15.37:0/4294072700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea4846e290 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 >> 172.21.15.37:0/4294072700 conn(0x55ea480b4300 msgr2=0x55ea48462da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f7535ffb640 0 client.25346 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 shutdown_connections 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 1 -- 172.21.15.37:0/4294072700 wait complete. 2024-05-09T01:04:16.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.626+0000 7f755b282740 20 client.25346 trim_cache size 0 max 16384 2024-05-09T01:04:16.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:16 smithi136 ceph-mon[34110]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 803 op/s 2024-05-09T01:04:16.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.657+0000 7f755b282740 1 Processor -- start 2024-05-09T01:04:16.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.657+0000 7f755b282740 1 -- start start 2024-05-09T01:04:16.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.658+0000 7f755b282740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea484685e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.658+0000 7f755b282740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48468b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.658+0000 7f755296b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea484685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.658+0000 7f755296b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea484685e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41948/0 (socket says 172.21.15.37:41948) 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.658+0000 7f755296b640 1 -- 172.21.15.37:0/3748605129 learned_addr learned my addr 172.21.15.37:0/3748605129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.658+0000 7f755b282740 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea484810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.658+0000 7f7551969640 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48468b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b1830 con 0x55ea480c01b0 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b3460 con 0x55ea480972f0 2024-05-09T01:04:16.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b1f00 con 0x55ea4809f4d0 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755296b640 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea484810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755296b640 1 -- 172.21.15.37:0/3748605129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 msgr2=0x55ea48468b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755296b640 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48468b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755296b640 1 -- 172.21.15.37:0/3748605129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 msgr2=0x55ea484810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755296b640 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea484810c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.659+0000 7f755296b640 1 -- 172.21.15.37:0/3748605129 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea481a25f0 con 0x55ea480972f0 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.660+0000 7f755296b640 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea484685e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7544009d50 tx=0x7f7544005ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c4d2f282da7d5c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:16.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.660+0000 7f7537fff640 1 -- 172.21.15.37:0/3748605129 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7544027040 con 0x55ea480972f0 2024-05-09T01:04:16.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.660+0000 7f7537fff640 1 -- 172.21.15.37:0/3748605129 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7544004d80 con 0x55ea480972f0 2024-05-09T01:04:16.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.662+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 msgr2=0x55ea484685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.662+0000 7f755b282740 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea484685e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7544009d50 tx=0x7f7544005ae0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.663+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 shutdown_connections 2024-05-09T01:04:16.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.663+0000 7f755b282740 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea484810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.663+0000 7f755b282740 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48468b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.663+0000 7f755b282740 1 --2- 172.21.15.37:0/3748605129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea484685e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.663+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 >> 172.21.15.37:0/3748605129 conn(0x55ea480b4300 msgr2=0x55ea4846e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:16.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.664+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 shutdown_connections 2024-05-09T01:04:16.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.664+0000 7f755b282740 1 -- 172.21.15.37:0/3748605129 wait complete. 2024-05-09T01:04:16.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 -- start start 2024-05-09T01:04:16.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 Processor -- start 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea48475e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48472a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea48473040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b2cd0 con 0x55ea480c01b0 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1b2600 con 0x55ea480972f0 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f754c1af810 con 0x55ea4809f4d0 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.665+0000 7f755b282740 10 client.0 _ll_register_callbacks cb 0x7f75480096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.666+0000 7f7551969640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48472a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.666+0000 7f7551969640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48472a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49032/0 (socket says 172.21.15.37:49032) 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.666+0000 7f7551969640 1 -- 172.21.15.37:0/3798444282 learned_addr learned my addr 172.21.15.37:0/3798444282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.666+0000 7f755296b640 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea48475e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.666+0000 7f755296b640 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea48473040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.668+0000 7f7551969640 1 -- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 msgr2=0x55ea48475e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:16.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.668+0000 7f7551969640 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea48475e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.668+0000 7f7551969640 1 -- 172.21.15.37:0/3798444282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 msgr2=0x55ea48473040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.668+0000 7f7551969640 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea48473040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.668+0000 7f7551969640 1 -- 172.21.15.37:0/3798444282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea4838ced0 con 0x55ea4809f4d0 2024-05-09T01:04:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.668+0000 7f7551969640 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48472a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55ea4846f070 tx=0x7f7548009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c764fccc50a5db3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.668+0000 7f7535ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.669+0000 7f7535ffb640 1 -- 172.21.15.37:0/3798444282 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548021020 con 0x55ea4809f4d0 2024-05-09T01:04:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.669+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea484680f0 con 0x55ea4809f4d0 2024-05-09T01:04:16.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.669+0000 7f7535ffb640 1 -- 172.21.15.37:0/3798444282 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7548004460 con 0x55ea4809f4d0 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.669+0000 7f7535ffb640 1 -- 172.21.15.37:0/3798444282 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f754801d340 con 0x55ea4809f4d0 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.669+0000 7f755b282740 10 client.25375 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ea484e2e30 con 0x55ea4809f4d0 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f7535ffb640 1 -- 172.21.15.37:0/3798444282 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ea484680f0 con 0x55ea4809f4d0 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f7535ffb640 1 -- 172.21.15.37:0/3798444282 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f7548003bc0 con 0x55ea4809f4d0 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f755b282740 10 client.25375 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f755b282740 10 client.25375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f755b282740 20 client.25375 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:16.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f755b282740 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea480541c0 0x55ea484e5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:16.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f755b282740 4 client.25375 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:04:16.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.670+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea483d0240 con 0x55ea480541c0 2024-05-09T01:04:16.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.671+0000 7f755296b640 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea480541c0 0x55ea484e5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.672+0000 7f755296b640 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea480541c0 0x55ea484e5940 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5007151ac1da437e server_cookie=7505905bac7c8ee0 in_seq=0 out_seq=0 2024-05-09T01:04:16.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.672+0000 7f7535ffb640 10 client.25375 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f7535ffb640 1 -- 172.21.15.37:0/3798444282 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ea483d0240 con 0x55ea480541c0 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f7535ffb640 10 client.25375 handle_command_reply: tid=0 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 client.25375 shutdown 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 msgr2=0x55ea48472a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48472a10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55ea4846f070 tx=0x7f7548009cc0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 shutdown_connections 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea480541c0 0x55ea484e5940 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea480c01b0 0x55ea48473040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea4809f4d0 0x55ea48472a10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 --2- 172.21.15.37:0/3798444282 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea480972f0 0x55ea48475e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 >> 172.21.15.37:0/3798444282 conn(0x55ea480b4300 msgr2=0x55ea4846e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f7535ffb640 0 client.25375 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 shutdown_connections 2024-05-09T01:04:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 1 -- 172.21.15.37:0/3798444282 wait complete. 2024-05-09T01:04:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.683+0000 7f755b282740 20 client.25375 trim_cache size 0 max 16384 2024-05-09T01:04:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:04:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:04:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:04:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f75380b28e0 msgr2=0x7f75380b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f75380b28e0 0x7f75380b4df0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f753c035040 tx=0x7f753c005c90 comp rx=0 tx=0).stop 2024-05-09T01:04:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 msgr2=0x7f754c10ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c10ce60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f753c0304b0 tx=0x7f753c032d20 comp rx=0 tx=0).stop 2024-05-09T01:04:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 shutdown_connections 2024-05-09T01:04:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f75380b28e0 0x7f75380b4df0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f754c108a80 0x7f754c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754c103d80 0x7f754c10b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 --2- 172.21.15.37:0/997918571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f754c102b40 0x7f754c10ce60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.685+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 >> 172.21.15.37:0/997918571 conn(0x7f754c0fdd30 msgr2=0x7f754c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.686+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 shutdown_connections 2024-05-09T01:04:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:16.686+0000 7f75543ce640 1 -- 172.21.15.37:0/997918571 wait complete. 2024-05-09T01:04:16.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:16 smithi037 ceph-mon[30122]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 803 op/s 2024-05-09T01:04:16.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:16 smithi151 ceph-mon[34780]: pgmap v459: 97 pgs: 97 active+clean; 1.2 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 803 op/s 2024-05-09T01:04:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3877763372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c1032e0 msgr2=0x7fc79c1036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3877763372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c1032e0 0x7fc79c1036f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc798009990 tx=0x7fc798009ca0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3877763372 shutdown_connections 2024-05-09T01:04:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3877763372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 0x7fc79c10fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3877763372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c1032e0 0x7fc79c1036f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3877763372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c107c10 0x7fc79c108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3877763372 >> 172.21.15.37:0/3877763372 conn(0x7fc79c078ac0 msgr2=0x7fc79c078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:17.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3877763372 shutdown_connections 2024-05-09T01:04:17.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.612+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3877763372 wait complete. 2024-05-09T01:04:17.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.613+0000 7fc7a2fd0700 1 Processor -- start 2024-05-09T01:04:17.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.613+0000 7fc7a2fd0700 1 -- start start 2024-05-09T01:04:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.613+0000 7fc7a2fd0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c1032e0 0x7fc79c19f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.613+0000 7fc7a2fd0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c107c10 0x7fc79c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.614+0000 7fc7a2fd0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 0x7fc79c197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.614+0000 7fc7a2fd0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c112140 con 0x7fc79c108560 2024-05-09T01:04:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.614+0000 7fc7a2fd0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c111fc0 con 0x7fc79c107c10 2024-05-09T01:04:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.614+0000 7fc7a2fd0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1122c0 con 0x7fc79c1032e0 2024-05-09T01:04:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.614+0000 7fc7a27cf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 0x7fc79c197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.614+0000 7fc7a27cf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 0x7fc79c197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56780/0 (socket says 172.21.15.37:56780) 2024-05-09T01:04:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.615+0000 7fc7a27cf700 1 -- 172.21.15.37:0/3533321467 learned_addr learned my addr 172.21.15.37:0/3533321467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.615+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c1032e0 0x7fc79c19f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.615+0000 7fc7a27cf700 1 -- 172.21.15.37:0/3533321467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c1032e0 msgr2=0x7fc79c19f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.615+0000 7fc7a27cf700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c1032e0 0x7fc79c19f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.615+0000 7fc7a27cf700 1 -- 172.21.15.37:0/3533321467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c107c10 msgr2=0x7fc79c197680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:04:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.615+0000 7fc7a27cf700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c107c10 0x7fc79c197680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.615+0000 7fc7a27cf700 1 -- 172.21.15.37:0/3533321467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79c1982c0 con 0x7fc79c108560 2024-05-09T01:04:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.616+0000 7fc7a27cf700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 0x7fc79c197bc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc79400ef30 tx=0x7fc79400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.616+0000 7fc792ffd700 1 -- 172.21.15.37:0/3533321467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7940092e0 con 0x7fc79c108560 2024-05-09T01:04:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.616+0000 7fc792ffd700 1 -- 172.21.15.37:0/3533321467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc794004bb0 con 0x7fc79c108560 2024-05-09T01:04:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.616+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79c1b6010 con 0x7fc79c108560 2024-05-09T01:04:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.616+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79c1b6410 con 0x7fc79c108560 2024-05-09T01:04:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.616+0000 7fc792ffd700 1 -- 172.21.15.37:0/3533321467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc794004280 con 0x7fc79c108560 2024-05-09T01:04:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.621+0000 7fc792ffd700 1 -- 172.21.15.37:0/3533321467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc79401b030 con 0x7fc79c108560 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.621+0000 7fc7b2c48b80 1 Processor -- start 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.622+0000 7fc7b2c48b80 1 -- start start 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.622+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dd50d00 0x55e67de59490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.622+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.622+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67de535e0 0x55e67de539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.622+0000 7fc7b2c48b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e67dd760a0 con 0x55e67dcd64a0 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.622+0000 7fc7a1fce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc792ffd700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7880b2960 0x7fc7880b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56782/0 (socket says 172.21.15.37:56782) 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1038974632 learned_addr learned my addr 172.21.15.37:0/1038974632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1038974632 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e67dd1b9a0 con 0x55e67de535e0 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1038974632 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e67dd72060 con 0x55e67dd50d00 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a27cf700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7880b2960 0x7fc7880b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dd50d00 0x55e67de59490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1038974632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dd50d00 msgr2=0x55e67de59490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dd50d00 0x55e67de59490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1038974632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67de535e0 msgr2=0x55e67de539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67de535e0 0x55e67de539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1038974632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67dd0c500 con 0x55e67dcd64a0 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dd50d00 0x55e67de59490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc792ffd700 1 -- 172.21.15.37:0/3533321467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc7940e1dc0 con 0x7fc79c108560 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.623+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de599d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc7980098e0 tx=0x7fc79800b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b78e889701d177 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.624+0000 7fc7a27cf700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7880b2960 0x7fc7880b4e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc79404c850 tx=0x7fc79409dd40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.624+0000 7fc787fff700 1 -- 172.21.15.37:0/1038974632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798049070 con 0x55e67dcd64a0 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.624+0000 7fc787fff700 1 -- 172.21.15.37:0/1038974632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79800bc50 con 0x55e67dcd64a0 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.625+0000 7fc787fff700 1 -- 172.21.15.37:0/1038974632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798044690 con 0x55e67dcd64a0 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.626+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1038974632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 msgr2=0x55e67de599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.626+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de599d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc7980098e0 tx=0x7fc79800b610 comp rx=0 tx=0).stop 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.627+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1038974632 shutdown_connections 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.627+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67de535e0 0x55e67de539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.627+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dd50d00 0x55e67de59490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.627+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1038974632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de599d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.627+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1038974632 >> 172.21.15.37:0/1038974632 conn(0x55e67dcd9f70 msgr2=0x55e67de4e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.627+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1038974632 shutdown_connections 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.627+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1038974632 wait complete. 2024-05-09T01:04:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.628+0000 7fc7b2c48b80 1 -- start start 2024-05-09T01:04:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.629+0000 7fc7b2c48b80 1 Processor -- start 2024-05-09T01:04:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.629+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dcd64a0 0x55e67de5fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.629+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de5d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de5d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7b2c48b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e67de54380 con 0x55e67de535e0 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7b2c48b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e67dd10b20 con 0x55e67dd50d00 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7b2c48b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e67de60200 con 0x55e67dcd64a0 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de5d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de5d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:41996/0 (socket says 172.21.15.37:41996) 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 -- 172.21.15.37:0/2491945035 learned_addr learned my addr 172.21.15.37:0/2491945035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7b2c48b80 10 client.0 _ll_register_callbacks cb 0x55e67dbe76c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 -- 172.21.15.37:0/2491945035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dcd64a0 msgr2=0x55e67de5fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dcd64a0 0x55e67de5fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 -- 172.21.15.37:0/2491945035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 msgr2=0x55e67de5d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de5d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.630+0000 7fc7a1fce700 1 -- 172.21.15.37:0/2491945035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67dbf1490 con 0x55e67dd50d00 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.631+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de5d000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc79800fac0 tx=0x7fc79800fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb37bbff435335a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.631+0000 7fc7857fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.632+0000 7fc7857fa700 1 -- 172.21.15.37:0/2491945035 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798049070 con 0x55e67dd50d00 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.632+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79800bc50 con 0x55e67dd50d00 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.632+0000 7fc7857fa700 1 -- 172.21.15.37:0/2491945035 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc79800fd30 con 0x55e67dd50d00 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.633+0000 7fc7857fa700 1 -- 172.21.15.37:0/2491945035 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc79804e440 con 0x55e67dd50d00 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.633+0000 7fc7b2c48b80 10 client.25358 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.633+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e67de6a7e0 con 0x55e67dd50d00 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.633+0000 7fc7857fa700 1 -- 172.21.15.37:0/2491945035 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79800bc50 con 0x55e67dd50d00 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.633+0000 7fc7857fa700 1 -- 172.21.15.37:0/2491945035 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fc798044760 con 0x55e67dd50d00 2024-05-09T01:04:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.634+0000 7fc7b2c48b80 10 client.25358 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.634+0000 7fc7b2c48b80 10 client.25358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.634+0000 7fc7b2c48b80 20 client.25358 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.634+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67de6cf50 0x55e67de6f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.634+0000 7fc7b2c48b80 4 client.25358 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.634+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e67dd83a80 con 0x55e67de6cf50 2024-05-09T01:04:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.635+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67de6cf50 0x55e67de6f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.636+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67de6cf50 0x55e67de6f3e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d474056cc867404 server_cookie=6ab0765923937668 in_seq=0 out_seq=0 2024-05-09T01:04:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.636+0000 7fc7857fa700 10 client.25358 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.636+0000 7fc7857fa700 1 -- 172.21.15.37:0/2491945035 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e67dd83a80 con 0x55e67de6cf50 2024-05-09T01:04:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.636+0000 7fc7857fa700 10 client.25358 handle_command_reply: tid=0 2024-05-09T01:04:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 client.25358 shutdown 2024-05-09T01:04:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 msgr2=0x55e67de5d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de5d000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc79800fac0 tx=0x7fc79800fba0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 shutdown_connections 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67de6cf50 0x55e67de6f3e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de5d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67dcd64a0 0x55e67de5fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2491945035 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de5d000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 >> 172.21.15.37:0/2491945035 conn(0x55e67dcd9f70 msgr2=0x55e67de4e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7857fa700 0 client.25358 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 shutdown_connections 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2491945035 wait complete. 2024-05-09T01:04:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.637+0000 7fc7b2c48b80 20 client.25358 trim_cache size 0 max 16384 2024-05-09T01:04:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.683+0000 7fc7b2c48b80 1 Processor -- start 2024-05-09T01:04:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.683+0000 7fc7b2c48b80 1 -- start start 2024-05-09T01:04:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.683+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de57710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.684+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de58870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.684+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de535e0 0x55e67de690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.684+0000 7fc7a1fce700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de58870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.684+0000 7fc7a1fce700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de58870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42006/0 (socket says 172.21.15.37:42006) 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.684+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1089708650 learned_addr learned my addr 172.21.15.37:0/1089708650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.684+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de535e0 0x55e67de690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.685+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c074100 con 0x55e67dcd64a0 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.685+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c1b6a10 con 0x55e67dd50d00 2024-05-09T01:04:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.685+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c0747d0 con 0x55e67de535e0 2024-05-09T01:04:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.685+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de57710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.685+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1089708650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de535e0 msgr2=0x55e67de690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.685+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de535e0 0x55e67de690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.685+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1089708650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 msgr2=0x55e67de57710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.686+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de57710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.686+0000 7fc7a1fce700 1 -- 172.21.15.37:0/1089708650 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67de5f8a0 con 0x55e67dd50d00 2024-05-09T01:04:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.686+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de57710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.686+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de58870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc798044cf0 tx=0x7fc798000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e871c3d7e81de501 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.686+0000 7fc7877fe700 1 -- 172.21.15.37:0/1089708650 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798049070 con 0x55e67dd50d00 2024-05-09T01:04:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.686+0000 7fc7877fe700 1 -- 172.21.15.37:0/1089708650 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79804a040 con 0x55e67dd50d00 2024-05-09T01:04:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.686+0000 7fc7877fe700 1 -- 172.21.15.37:0/1089708650 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79804ee10 con 0x55e67dd50d00 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.689+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 msgr2=0x55e67de58870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.689+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de58870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc798044cf0 tx=0x7fc798000bc0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.689+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 shutdown_connections 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.689+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de535e0 0x55e67de690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.689+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67dcd64a0 0x55e67de57710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.689+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/1089708650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dd50d00 0x55e67de58870 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc798044cf0 tx=0x7fc798000bc0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.690+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 >> 172.21.15.37:0/1089708650 conn(0x55e67dcd9f70 msgr2=0x55e67de58160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.690+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 shutdown_connections 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.690+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/1089708650 wait complete. 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.691+0000 7fc7b2c48b80 1 -- start start 2024-05-09T01:04:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.691+0000 7fc7b2c48b80 1 Processor -- start 2024-05-09T01:04:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.692+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dcd64a0 0x55e67de65a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.692+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de74190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.692+0000 7fc7b2c48b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de746d0 0x55e67de74b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.692+0000 7fc7b2c48b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c0755a0 con 0x55e67de535e0 2024-05-09T01:04:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.692+0000 7fc7b2c48b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c074ed0 con 0x55e67dcd64a0 2024-05-09T01:04:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.692+0000 7fc7b2c48b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc79c0720c0 con 0x55e67de746d0 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.692+0000 7fc7b2c48b80 10 client.0 _ll_register_callbacks cb 0x55e67dbe76c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dcd64a0 0x55e67de65a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de746d0 0x55e67de74b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dcd64a0 0x55e67de65a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42018/0 (socket says 172.21.15.37:42018) 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 -- 172.21.15.37:0/2251277469 learned_addr learned my addr 172.21.15.37:0/2251277469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de74190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 -- 172.21.15.37:0/2251277469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de746d0 msgr2=0x55e67de74b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de746d0 0x55e67de74b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 -- 172.21.15.37:0/2251277469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 msgr2=0x55e67de74190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.693+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de74190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.694+0000 7fc7a17cd700 1 -- 172.21.15.37:0/2251277469 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67de635f0 con 0x55e67dcd64a0 2024-05-09T01:04:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.694+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de74190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.694+0000 7fc7a17cd700 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dcd64a0 0x55e67de65a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000c00 tx=0x7fc78c005f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b77c907bc7f9224 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.694+0000 7fc7857fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:04:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.694+0000 7fc7857fa700 1 -- 172.21.15.37:0/2251277469 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c010630 con 0x55e67dcd64a0 2024-05-09T01:04:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.694+0000 7fc7857fa700 1 -- 172.21.15.37:0/2251277469 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc78c0107d0 con 0x55e67dcd64a0 2024-05-09T01:04:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.694+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79804a040 con 0x55e67dcd64a0 2024-05-09T01:04:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.695+0000 7fc7857fa700 1 -- 172.21.15.37:0/2251277469 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc78c0109d0 con 0x55e67dcd64a0 2024-05-09T01:04:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.695+0000 7fc7b2c48b80 10 client.25364 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.695+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55e67ded7a50 con 0x55e67dcd64a0 2024-05-09T01:04:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.695+0000 7fc7857fa700 1 -- 172.21.15.37:0/2251277469 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79804a040 con 0x55e67dcd64a0 2024-05-09T01:04:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7857fa700 1 -- 172.21.15.37:0/2251277469 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fc78c024060 con 0x55e67dcd64a0 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7b2c48b80 10 client.25364 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7b2c48b80 10 client.25364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7b2c48b80 20 client.25364 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67ded8220 0x55e67deda640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7b2c48b80 4 client.25364 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e67dd7db20 con 0x55e67ded8220 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.696+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67ded8220 0x55e67deda640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.697+0000 7fc7857fa700 10 client.25364 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.697+0000 7fc7a1fce700 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67ded8220 0x55e67deda640 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc1f97f1cc233c9 server_cookie=bb1fbeaa55c129eb in_seq=0 out_seq=0 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7857fa700 1 -- 172.21.15.37:0/2251277469 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e67dd7db20 con 0x55e67ded8220 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7857fa700 10 client.25364 handle_command_reply: tid=0 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 client.25364 shutdown 2024-05-09T01:04:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dcd64a0 msgr2=0x55e67de65a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dcd64a0 0x55e67de65a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000c00 tx=0x7fc78c005f30 comp rx=0 tx=0).stop 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 shutdown_connections 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e67ded8220 0x55e67deda640 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e67de746d0 0x55e67de74b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e67dcd64a0 0x55e67de65a90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.698+0000 7fc7b2c48b80 1 --2- 172.21.15.37:0/2251277469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e67de535e0 0x55e67de74190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.699+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 >> 172.21.15.37:0/2251277469 conn(0x55e67dcd9f70 msgr2=0x55e67de56de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.699+0000 7fc7857fa700 0 client.25364 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.699+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 shutdown_connections 2024-05-09T01:04:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.701+0000 7fc7b2c48b80 1 -- 172.21.15.37:0/2251277469 wait complete. 2024-05-09T01:04:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.701+0000 7fc7b2c48b80 20 client.25364 trim_cache size 0 max 16384 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: "996e5af9-5ce7-4ee2-b271-bf2bf6a0a171": { 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "996e5af9-5ce7-4ee2-b271-bf2bf6a0a171", 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:04:17.703 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7880b2960 msgr2=0x7fc7880b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7880b2960 0x7fc7880b4e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc79404c850 tx=0x7fc79409dd40 comp rx=0 tx=0).stop 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 msgr2=0x7fc79c197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 0x7fc79c197bc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc79400ef30 tx=0x7fc79400c450 comp rx=0 tx=0).stop 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 shutdown_connections 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7880b2960 0x7fc7880b4e70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79c108560 0x7fc79c197bc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc79c1032e0 0x7fc79c19f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 --2- 172.21.15.37:0/3533321467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc79c107c10 0x7fc79c197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.702+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 >> 172.21.15.37:0/3533321467 conn(0x7fc79c078ac0 msgr2=0x7fc79c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.703+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 shutdown_connections 2024-05-09T01:04:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:17.704+0000 7fc7a2fd0700 1 -- 172.21.15.37:0/3533321467 wait complete. 2024-05-09T01:04:18.459 INFO:tasks.cephfs.filesystem:scrub status for tag:996e5af9-5ce7-4ee2-b271-bf2bf6a0a171 - {'path': '/', 'tag': '996e5af9-5ce7-4ee2-b271-bf2bf6a0a171', 'options': 'recursive,force'} 2024-05-09T01:04:18.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:18 smithi136 ceph-mon[34110]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 10 MiB/s wr, 869 op/s 2024-05-09T01:04:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:18 smithi037 ceph-mon[30122]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 10 MiB/s wr, 869 op/s 2024-05-09T01:04:18.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:18 smithi151 ceph-mon[34780]: pgmap v460: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 10 MiB/s wr, 869 op/s 2024-05-09T01:04:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 120.0 s, 3797.1 tps, lat 26.423 ms stddev 29.429 2024-05-09T01:04:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:20 smithi136 ceph-mon[34110]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 8.2 MiB/s wr, 766 op/s 2024-05-09T01:04:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:20 smithi037 ceph-mon[30122]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 8.2 MiB/s wr, 766 op/s 2024-05-09T01:04:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:20 smithi151 ceph-mon[34780]: pgmap v461: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 8.2 MiB/s wr, 766 op/s 2024-05-09T01:04:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:22 smithi037 ceph-mon[30122]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 10 MiB/s wr, 880 op/s 2024-05-09T01:04:22.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:22 smithi151 ceph-mon[34780]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 10 MiB/s wr, 880 op/s 2024-05-09T01:04:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:22 smithi136 ceph-mon[34110]: pgmap v462: 97 pgs: 97 active+clean; 1.2 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 10 MiB/s wr, 880 op/s 2024-05-09T01:04:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:24 smithi037 ceph-mon[30122]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 11 MiB/s wr, 861 op/s 2024-05-09T01:04:24.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:24 smithi151 ceph-mon[34780]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 11 MiB/s wr, 861 op/s 2024-05-09T01:04:24.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:24 smithi136 ceph-mon[34110]: pgmap v463: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 11 MiB/s wr, 861 op/s 2024-05-09T01:04:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 125.0 s, 3478.8 tps, lat 28.748 ms stddev 35.976 2024-05-09T01:04:26.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:26 smithi037 ceph-mon[30122]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 11 MiB/s wr, 858 op/s 2024-05-09T01:04:26.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:26 smithi151 ceph-mon[34780]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 11 MiB/s wr, 858 op/s 2024-05-09T01:04:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:26 smithi136 ceph-mon[34110]: pgmap v464: 97 pgs: 97 active+clean; 1.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 11 MiB/s wr, 858 op/s 2024-05-09T01:04:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:28 smithi037 ceph-mon[30122]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-05-09T01:04:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:04:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:04:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:04:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:04:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:04:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:28 smithi151 ceph-mon[34780]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-05-09T01:04:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:04:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:04:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:04:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:04:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:04:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:28 smithi136 ceph-mon[34110]: pgmap v465: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 11 MiB/s wr, 833 op/s 2024-05-09T01:04:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:04:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:04:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:04:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:04:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:04:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.859+0000 7f015091f640 1 -- 172.21.15.37:0/1373162741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f014c10b480 msgr2=0x7f014c10b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.859+0000 7f015091f640 1 --2- 172.21.15.37:0/1373162741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f014c10b480 0x7f014c10b890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f013c009900 tx=0x7f013c02a410 comp rx=0 tx=0).stop 2024-05-09T01:04:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.860+0000 7f015091f640 1 -- 172.21.15.37:0/1373162741 shutdown_connections 2024-05-09T01:04:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.860+0000 7f015091f640 1 --2- 172.21.15.37:0/1373162741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c1101a0 0x7f014c1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.860+0000 7f015091f640 1 --2- 172.21.15.37:0/1373162741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f014c10b480 0x7f014c10b890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.860+0000 7f015091f640 1 --2- 172.21.15.37:0/1373162741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c10a550 0x7f014c10af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.860+0000 7f015091f640 1 -- 172.21.15.37:0/1373162741 >> 172.21.15.37:0/1373162741 conn(0x7f014c070670 msgr2=0x7f014c072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.864+0000 7f015091f640 1 -- 172.21.15.37:0/1373162741 shutdown_connections 2024-05-09T01:04:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.865+0000 7f015091f640 1 -- 172.21.15.37:0/1373162741 wait complete. 2024-05-09T01:04:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.867+0000 7f015091f640 1 Processor -- start 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.867+0000 7f015091f640 1 -- start start 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.867+0000 7f015091f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f014c10a550 0x7f014c1a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.867+0000 7f015091f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c10b480 0x7f014c1a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.867+0000 7f015091f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1101a0 0x7f014c1b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c10b480 0x7f014c1a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f014ad9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1101a0 0x7f014c1b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f014ad9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1101a0 0x7f014c1b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59344/0 (socket says 172.21.15.37:59344) 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f014ad9d640 1 -- 172.21.15.37:0/2159166243 learned_addr learned my addr 172.21.15.37:0/2159166243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f0149d9b640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c10b480 0x7f014c1a9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48130/0 (socket says 172.21.15.37:48130) 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f014c11e600 con 0x7f014c10b480 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f014c11e480 con 0x7f014c10a550 2024-05-09T01:04:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.868+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f014c11e780 con 0x7f014c1101a0 2024-05-09T01:04:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.869+0000 7f014ad9d640 1 -- 172.21.15.37:0/2159166243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f014c10a550 msgr2=0x7f014c1a91e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:04:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.869+0000 7f014ad9d640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f014c10a550 0x7f014c1a91e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.869+0000 7f014ad9d640 1 -- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c10b480 msgr2=0x7f014c1a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.869+0000 7f014ad9d640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c10b480 0x7f014c1a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.869+0000 7f014ad9d640 1 -- 172.21.15.37:0/2159166243 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014c111dc0 con 0x7f014c1101a0 2024-05-09T01:04:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.869+0000 7f0149d9b640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c10b480 0x7f014c1a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.869+0000 7f014ad9d640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1101a0 0x7f014c1b06b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f014400eaa0 tx=0x7f014400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.870+0000 7f013b7fe640 1 -- 172.21.15.37:0/2159166243 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014400cdb0 con 0x7f014c1101a0 2024-05-09T01:04:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.870+0000 7f013b7fe640 1 -- 172.21.15.37:0/2159166243 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0144005020 con 0x7f014c1101a0 2024-05-09T01:04:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.870+0000 7f013b7fe640 1 -- 172.21.15.37:0/2159166243 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01440116d0 con 0x7f014c1101a0 2024-05-09T01:04:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.871+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014c1120b0 con 0x7f014c1101a0 2024-05-09T01:04:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.871+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f014c1125b0 con 0x7f014c1101a0 2024-05-09T01:04:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.875+0000 7f01577d4740 1 Processor -- start 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.875+0000 7f01577d4740 1 -- start start 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.875+0000 7f01577d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5521b0 0x564c2f8f6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.875+0000 7f01577d4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f8f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.875+0000 7f01577d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5314d0 0x564c2f8fd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.876+0000 7f01577d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564c2f85a7c0 con 0x564c2f5314d0 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.876+0000 7f01577d4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c2f7f60e0 con 0x564c2f5292f0 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.876+0000 7f01577d4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564c2f856780 con 0x564c2f5521b0 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.876+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5521b0 0x564c2f8f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.876+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5521b0 0x564c2f8f6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59348/0 (socket says 172.21.15.37:59348) 2024-05-09T01:04:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.876+0000 7f0149d9b640 1 -- 172.21.15.37:0/4168013534 learned_addr learned my addr 172.21.15.37:0/4168013534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.878+0000 7f014a59c640 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f8f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.879+0000 7f0149d9b640 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5314d0 0x564c2f8fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.879+0000 7f014a59c640 1 -- 172.21.15.37:0/4168013534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5521b0 msgr2=0x564c2f8f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.879+0000 7f014a59c640 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5521b0 0x564c2f8f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.879+0000 7f014a59c640 1 -- 172.21.15.37:0/4168013534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5314d0 msgr2=0x564c2f8fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.880+0000 7f013b7fe640 1 -- 172.21.15.37:0/2159166243 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f01440054d0 con 0x7f014c1101a0 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.882+0000 7f014a59c640 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5314d0 0x564c2f8fd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.882+0000 7f014a59c640 1 -- 172.21.15.37:0/4168013534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2f81f7c0 con 0x564c2f5292f0 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.882+0000 7f0149d9b640 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5314d0 0x564c2f8fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.882+0000 7f014a59c640 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f8f6a80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0140005fd0 tx=0x7f014000bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5ccba25d07208a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.884+0000 7f013b7fe640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f01340b29b0 0x7f01340b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.884+0000 7f013b7fe640 1 -- 172.21.15.37:0/2159166243 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f01440e1f30 con 0x7f014c1101a0 2024-05-09T01:04:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.887+0000 7f0149d9b640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f01340b29b0 0x7f01340b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.888+0000 7f0138ff9640 1 -- 172.21.15.37:0/4168013534 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014000dc10 con 0x564c2f5292f0 2024-05-09T01:04:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.888+0000 7f0138ff9640 1 -- 172.21.15.37:0/4168013534 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f014000ddb0 con 0x564c2f5292f0 2024-05-09T01:04:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.888+0000 7f0138ff9640 1 -- 172.21.15.37:0/4168013534 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140010460 con 0x564c2f5292f0 2024-05-09T01:04:29.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.888+0000 7f0149d9b640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f01340b29b0 0x7f01340b4ec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f013c0096c0 tx=0x7f013c02a410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:29.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.889+0000 7f01577d4740 1 -- 172.21.15.37:0/4168013534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 msgr2=0x564c2f8f6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.889+0000 7f01577d4740 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f8f6a80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0140005fd0 tx=0x7f014000bf00 comp rx=0 tx=0).stop 2024-05-09T01:04:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.890+0000 7f01577d4740 1 -- 172.21.15.37:0/4168013534 shutdown_connections 2024-05-09T01:04:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.890+0000 7f01577d4740 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5314d0 0x564c2f8fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.890+0000 7f01577d4740 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f8f6a80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.890+0000 7f01577d4740 1 --2- 172.21.15.37:0/4168013534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5521b0 0x564c2f8f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.890+0000 7f01577d4740 1 -- 172.21.15.37:0/4168013534 >> 172.21.15.37:0/4168013534 conn(0x564c2f546300 msgr2=0x564c2f8f1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.891+0000 7f01577d4740 1 -- 172.21.15.37:0/4168013534 shutdown_connections 2024-05-09T01:04:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.891+0000 7f01577d4740 1 -- 172.21.15.37:0/4168013534 wait complete. 2024-05-09T01:04:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.892+0000 7f01577d4740 1 -- start start 2024-05-09T01:04:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.892+0000 7f01577d4740 1 Processor -- start 2024-05-09T01:04:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.893+0000 7f01577d4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f900290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.893+0000 7f01577d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5314d0 0x564c2f9007d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.893+0000 7f01577d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f907730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.894+0000 7f01577d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564c2f8fe3d0 con 0x564c2f5521b0 2024-05-09T01:04:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.894+0000 7f01577d4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c2f7e19c0 con 0x564c2f5292f0 2024-05-09T01:04:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.894+0000 7f01577d4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564c2f8fe550 con 0x564c2f5314d0 2024-05-09T01:04:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.894+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5314d0 0x564c2f9007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.894+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5314d0 0x564c2f9007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59356/0 (socket says 172.21.15.37:59356) 2024-05-09T01:04:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.894+0000 7f0149d9b640 1 -- 172.21.15.37:0/1923362715 learned_addr learned my addr 172.21.15.37:0/1923362715 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:29.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.894+0000 7f01577d4740 10 client.0 _ll_register_callbacks cb 0x564c2f80e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f014a59c640 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f900290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f0149d9b640 1 -- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 msgr2=0x564c2f900290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f0149d9b640 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f900290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f0149d9b640 1 -- 172.21.15.37:0/1923362715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 msgr2=0x564c2f907730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f0149d9b640 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f907730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f0149d9b640 1 -- 172.21.15.37:0/1923362715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2f8081f0 con 0x564c2f5314d0 2024-05-09T01:04:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f014a59c640 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f900290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f0149d9b640 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5314d0 0x564c2f9007d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f013c009230 tx=0x7f013c005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b6007130da38e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:29.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.895+0000 7f0131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.896+0000 7f0131ffb640 1 -- 172.21.15.37:0/1923362715 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c035020 con 0x564c2f5314d0 2024-05-09T01:04:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.896+0000 7f0131ffb640 1 -- 172.21.15.37:0/1923362715 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f013c032bf0 con 0x564c2f5314d0 2024-05-09T01:04:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.897+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f014000ddb0 con 0x564c2f5314d0 2024-05-09T01:04:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.897+0000 7f0131ffb640 1 -- 172.21.15.37:0/1923362715 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f013c032e10 con 0x564c2f5314d0 2024-05-09T01:04:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.897+0000 7f01577d4740 10 client.25396 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:29.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.897+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564c2f5bd790 con 0x564c2f5314d0 2024-05-09T01:04:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f0131ffb640 1 -- 172.21.15.37:0/1923362715 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f014000ddb0 con 0x564c2f5314d0 2024-05-09T01:04:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f0131ffb640 1 -- 172.21.15.37:0/1923362715 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f013c04f070 con 0x564c2f5314d0 2024-05-09T01:04:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f01577d4740 10 client.25396 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f01577d4740 10 client.25396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f01577d4740 20 client.25396 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:29.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f01577d4740 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f510d80 0x564c2f90dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f01577d4740 4 client.25396 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.899+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c2f8683d0 con 0x564c2f510d80 2024-05-09T01:04:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.900+0000 7f014a59c640 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f510d80 0x564c2f90dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.901+0000 7f0131ffb640 10 client.25396 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:29.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.901+0000 7f014a59c640 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f510d80 0x564c2f90dd70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85027167b2bf1265 server_cookie=3e27b2ff48133f69 in_seq=0 out_seq=0 2024-05-09T01:04:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.902+0000 7f0131ffb640 1 -- 172.21.15.37:0/1923362715 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564c2f8683d0 con 0x564c2f510d80 2024-05-09T01:04:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.902+0000 7f0131ffb640 10 client.25396 handle_command_reply: tid=0 2024-05-09T01:04:29.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.902+0000 7f01577d4740 1 client.25396 shutdown 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5314d0 msgr2=0x564c2f9007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5314d0 0x564c2f9007d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f013c009230 tx=0x7f013c005d50 comp rx=0 tx=0).stop 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 shutdown_connections 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f510d80 0x564c2f90dd70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f907730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5314d0 0x564c2f9007d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 --2- 172.21.15.37:0/1923362715 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5292f0 0x564c2f900290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 >> 172.21.15.37:0/1923362715 conn(0x564c2f546300 msgr2=0x564c2f8f0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:29.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.903+0000 7f0131ffb640 0 client.25396 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:29.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.904+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 shutdown_connections 2024-05-09T01:04:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.909+0000 7f01577d4740 1 -- 172.21.15.37:0/1923362715 wait complete. 2024-05-09T01:04:29.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.910+0000 7f01577d4740 20 client.25396 trim_cache size 0 max 16384 2024-05-09T01:04:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 Processor -- start 2024-05-09T01:04:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 -- start start 2024-05-09T01:04:29.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f912520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f907650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f907b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1c28f0 con 0x564c2f5521b0 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1c4520 con 0x564c2f5314d0 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.946+0000 7f01577d4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1c2fc0 con 0x564c2f5292f0 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f907650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f907650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39004/0 (socket says 172.21.15.37:39004) 2024-05-09T01:04:29.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 -- 172.21.15.37:0/1452239280 learned_addr learned my addr 172.21.15.37:0/1452239280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f014a59c640 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f912520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 -- 172.21.15.37:0/1452239280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 msgr2=0x564c2f912520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f912520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 -- 172.21.15.37:0/1452239280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 msgr2=0x564c2f907b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f907b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 -- 172.21.15.37:0/1452239280 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c2f6345f0 con 0x564c2f5314d0 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.947+0000 7f0149d9b640 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f907650 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f013c003dd0 tx=0x7f013c0464e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada8f7422960fe66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.948+0000 7f0133fff640 1 -- 172.21.15.37:0/1452239280 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c035040 con 0x564c2f5314d0 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.948+0000 7f0133fff640 1 -- 172.21.15.37:0/1452239280 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f013c032bf0 con 0x564c2f5314d0 2024-05-09T01:04:29.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.948+0000 7f0133fff640 1 -- 172.21.15.37:0/1452239280 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013c0046c0 con 0x564c2f5314d0 2024-05-09T01:04:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.949+0000 7f01577d4740 1 -- 172.21.15.37:0/1452239280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 msgr2=0x564c2f907650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.949+0000 7f01577d4740 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f907650 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f013c003dd0 tx=0x7f013c0464e0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.949+0000 7f01577d4740 1 -- 172.21.15.37:0/1452239280 shutdown_connections 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.949+0000 7f01577d4740 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f907b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.949+0000 7f01577d4740 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f907650 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.949+0000 7f01577d4740 1 --2- 172.21.15.37:0/1452239280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f912520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.949+0000 7f01577d4740 1 -- 172.21.15.37:0/1452239280 >> 172.21.15.37:0/1452239280 conn(0x564c2f546300 msgr2=0x564c2f8fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.950+0000 7f01577d4740 1 -- 172.21.15.37:0/1452239280 shutdown_connections 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.950+0000 7f01577d4740 1 -- 172.21.15.37:0/1452239280 wait complete. 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.950+0000 7f01577d4740 1 -- start start 2024-05-09T01:04:29.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.951+0000 7f01577d4740 1 Processor -- start 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.951+0000 7f01577d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f904b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.951+0000 7f01577d4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f905070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.951+0000 7f014a59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f904b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.952+0000 7f014a59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f904b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59374/0 (socket says 172.21.15.37:59374) 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.952+0000 7f01577d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f9740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.952+0000 7f014a59c640 1 -- 172.21.15.37:0/3344646583 learned_addr learned my addr 172.21.15.37:0/3344646583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.952+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1c3d90 con 0x564c2f5521b0 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.952+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f014c1c36c0 con 0x564c2f5314d0 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.952+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f014c119170 con 0x564c2f5292f0 2024-05-09T01:04:29.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.952+0000 7f01577d4740 10 client.0 _ll_register_callbacks cb 0x7f013c005870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f014ad9d640 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f9740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f0149d9b640 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f905070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f014a59c640 1 -- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 msgr2=0x564c2f905070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f014a59c640 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f905070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f014a59c640 1 -- 172.21.15.37:0/3344646583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 msgr2=0x564c2f9740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f014a59c640 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f9740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f014a59c640 1 -- 172.21.15.37:0/3344646583 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c2f81eed0 con 0x564c2f5292f0 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f014a59c640 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f904b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x564c2f8f78e0 tx=0x7f014000b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f81f61d5482658dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f0131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f0131ffb640 1 -- 172.21.15.37:0/3344646583 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01400052d0 con 0x564c2f5292f0 2024-05-09T01:04:29.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f0131ffb640 1 -- 172.21.15.37:0/3344646583 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0140005470 con 0x564c2f5292f0 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.953+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f013c032bf0 con 0x564c2f5292f0 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f0131ffb640 1 -- 172.21.15.37:0/3344646583 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0140005690 con 0x564c2f5292f0 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 10 client.25402 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564c2f975320 con 0x564c2f5292f0 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f0131ffb640 1 -- 172.21.15.37:0/3344646583 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0140025860 con 0x564c2f5292f0 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f0131ffb640 1 -- 172.21.15.37:0/3344646583 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f014002f050 con 0x564c2f5292f0 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 10 client.25402 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 10 client.25402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 20 client.25402 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f4e61c0 0x564c2f977b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 4 client.25402 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.954+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f013c032bf0 con 0x564c2f4e61c0 2024-05-09T01:04:29.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.955+0000 7f0149d9b640 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f4e61c0 0x564c2f977b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.956+0000 7f0131ffb640 10 client.25402 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:29.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.956+0000 7f0149d9b640 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f4e61c0 0x564c2f977b30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09e8dd8506dde81 server_cookie=7753fd2478d29cb2 in_seq=0 out_seq=0 2024-05-09T01:04:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.966+0000 7f0131ffb640 1 -- 172.21.15.37:0/3344646583 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f013c032bf0 con 0x564c2f4e61c0 2024-05-09T01:04:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.966+0000 7f0131ffb640 10 client.25402 handle_command_reply: tid=0 2024-05-09T01:04:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.966+0000 7f01577d4740 1 client.25402 shutdown 2024-05-09T01:04:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 msgr2=0x564c2f904b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f904b30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x564c2f8f78e0 tx=0x7f014000b690 comp rx=0 tx=0).stop 2024-05-09T01:04:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 shutdown_connections 2024-05-09T01:04:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564c2f4e61c0 0x564c2f977b30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c2f5521b0 0x564c2f9740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c2f5314d0 0x564c2f905070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 --2- 172.21.15.37:0/3344646583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c2f5292f0 0x564c2f904b30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 >> 172.21.15.37:0/3344646583 conn(0x564c2f546300 msgr2=0x564c2f8f4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f0131ffb640 0 client.25402 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.967+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 shutdown_connections 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.968+0000 7f01577d4740 1 -- 172.21.15.37:0/3344646583 wait complete. 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.968+0000 7f01577d4740 20 client.25402 trim_cache size 0 max 16384 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:04:29.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:04:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.968+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f01340b29b0 msgr2=0x7f01340b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.968+0000 7f015091f640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f01340b29b0 0x7f01340b4ec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f013c0096c0 tx=0x7f013c02a410 comp rx=0 tx=0).stop 2024-05-09T01:04:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.968+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1101a0 msgr2=0x7f014c1b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:29.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.968+0000 7f015091f640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1101a0 0x7f014c1b06b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f014400eaa0 tx=0x7f014400ef60 comp rx=0 tx=0).stop 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.969+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 shutdown_connections 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.969+0000 7f015091f640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f014c1101a0 0x7f014c1b06b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.969+0000 7f015091f640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f014c10b480 0x7f014c1a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.969+0000 7f015091f640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f01340b29b0 0x7f01340b4ec0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.970+0000 7f015091f640 1 --2- 172.21.15.37:0/2159166243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f014c10a550 0x7f014c1a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.970+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 >> 172.21.15.37:0/2159166243 conn(0x7f014c070670 msgr2=0x7f014c10c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.970+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 shutdown_connections 2024-05-09T01:04:29.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:29.970+0000 7f015091f640 1 -- 172.21.15.37:0/2159166243 wait complete. 2024-05-09T01:04:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 130.0 s, 3544.0 tps, lat 28.175 ms stddev 32.585 2024-05-09T01:04:30.679 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:30 smithi136 ceph-mon[34110]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 859 op/s 2024-05-09T01:04:30.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:30 smithi037 ceph-mon[30122]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 859 op/s 2024-05-09T01:04:30.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:30 smithi151 ceph-mon[34780]: pgmap v466: 97 pgs: 97 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 12 MiB/s wr, 859 op/s 2024-05-09T01:04:32.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:32 smithi037 ceph-mon[30122]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 919 op/s 2024-05-09T01:04:32.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:32 smithi151 ceph-mon[34780]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 919 op/s 2024-05-09T01:04:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:32 smithi136 ceph-mon[34110]: pgmap v467: 97 pgs: 97 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 MiB/s wr, 919 op/s 2024-05-09T01:04:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:34 smithi037 ceph-mon[30122]: pgmap v468: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 936 op/s 2024-05-09T01:04:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:34 smithi151 ceph-mon[34780]: pgmap v468: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 936 op/s 2024-05-09T01:04:34.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:34 smithi136 ceph-mon[34110]: pgmap v468: 97 pgs: 97 active+clean; 1.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 936 op/s 2024-05-09T01:04:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 135.0 s, 3277.0 tps, lat 30.511 ms stddev 36.446 2024-05-09T01:04:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:36 smithi037 ceph-mon[30122]: pgmap v469: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 891 op/s 2024-05-09T01:04:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:36 smithi151 ceph-mon[34780]: pgmap v469: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 891 op/s 2024-05-09T01:04:36.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:36 smithi136 ceph-mon[34110]: pgmap v469: 97 pgs: 97 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 MiB/s wr, 891 op/s 2024-05-09T01:04:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:38 smithi037 ceph-mon[30122]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 919 op/s 2024-05-09T01:04:38.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:38 smithi151 ceph-mon[34780]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 919 op/s 2024-05-09T01:04:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:38 smithi136 ceph-mon[34110]: pgmap v470: 97 pgs: 97 active+clean; 1.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 38 MiB/s wr, 919 op/s 2024-05-09T01:04:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 140.0 s, 3350.6 tps, lat 29.842 ms stddev 35.264 2024-05-09T01:04:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:40 smithi037 ceph-mon[30122]: pgmap v471: 97 pgs: 97 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 898 op/s 2024-05-09T01:04:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:40 smithi151 ceph-mon[34780]: pgmap v471: 97 pgs: 97 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 898 op/s 2024-05-09T01:04:40.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:40 smithi136 ceph-mon[34110]: pgmap v471: 97 pgs: 97 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 MiB/s wr, 898 op/s 2024-05-09T01:04:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:42 smithi037 ceph-mon[30122]: pgmap v472: 97 pgs: 97 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 883 op/s 2024-05-09T01:04:42.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:42 smithi151 ceph-mon[34780]: pgmap v472: 97 pgs: 97 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 883 op/s 2024-05-09T01:04:42.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:42 smithi136 ceph-mon[34110]: pgmap v472: 97 pgs: 97 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 43 MiB/s wr, 883 op/s 2024-05-09T01:04:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.118+0000 7f0e29ffb640 1 -- 172.21.15.37:0/2127125838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2402f340 con 0x7f0e2c10a550 2024-05-09T01:04:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.118+0000 7f0e31900640 1 -- 172.21.15.37:0/2127125838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10a550 msgr2=0x7f0e2c10af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.118+0000 7f0e31900640 1 --2- 172.21.15.37:0/2127125838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10a550 0x7f0e2c10af40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009ca0 tx=0x7f0e2402a8f0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.119+0000 7f0e31900640 1 -- 172.21.15.37:0/2127125838 shutdown_connections 2024-05-09T01:04:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.119+0000 7f0e31900640 1 --2- 172.21.15.37:0/2127125838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 0x7f0e2c1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.119+0000 7f0e31900640 1 --2- 172.21.15.37:0/2127125838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c10b480 0x7f0e2c10b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.119+0000 7f0e31900640 1 --2- 172.21.15.37:0/2127125838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10a550 0x7f0e2c10af40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.119+0000 7f0e31900640 1 -- 172.21.15.37:0/2127125838 >> 172.21.15.37:0/2127125838 conn(0x7f0e2c070670 msgr2=0x7f0e2c072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.120+0000 7f0e31900640 1 -- 172.21.15.37:0/2127125838 shutdown_connections 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.121+0000 7f0e31900640 1 -- 172.21.15.37:0/2127125838 wait complete. 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 Processor -- start 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 -- start start 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c10a550 0x7f0e2c117200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10b480 0x7f0e2c117740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 0x7f0e2c1186a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c11e750 con 0x7f0e2c10b480 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c11e5d0 con 0x7f0e2c1101a0 2024-05-09T01:04:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.122+0000 7f0e31900640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c11e8d0 con 0x7f0e2c10a550 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.123+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c10a550 0x7f0e2c117200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.123+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c10a550 0x7f0e2c117200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34482/0 (socket says 172.21.15.37:34482) 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.123+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 0x7f0e2c1186a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.123+0000 7f0e2b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 0x7f0e2c1186a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40946/0 (socket says 172.21.15.37:40946) 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.123+0000 7f0e2affd640 1 -- 172.21.15.37:0/3945550709 learned_addr learned my addr 172.21.15.37:0/3945550709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10b480 0x7f0e2c117740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2b7fe640 1 -- 172.21.15.37:0/3945550709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c10a550 msgr2=0x7f0e2c117200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2b7fe640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c10a550 0x7f0e2c117200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2b7fe640 1 -- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10b480 msgr2=0x7f0e2c117740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2b7fe640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10b480 0x7f0e2c117740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2b7fe640 1 -- 172.21.15.37:0/3945550709 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c118d10 con 0x7f0e2c1101a0 2024-05-09T01:04:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10b480 0x7f0e2c117740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.124+0000 7f0e2b7fe640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 0x7f0e2c1186a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b3e0 tx=0x7f0e1c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.125+0000 7f0e308fe640 1 -- 172.21.15.37:0/3945550709 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c015020 con 0x7f0e2c1101a0 2024-05-09T01:04:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.125+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c119000 con 0x7f0e2c1101a0 2024-05-09T01:04:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.125+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c1195d0 con 0x7f0e2c1101a0 2024-05-09T01:04:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.125+0000 7f0e308fe640 1 -- 172.21.15.37:0/3945550709 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e1c011ce0 con 0x7f0e2c1101a0 2024-05-09T01:04:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.127+0000 7f0e308fe640 1 -- 172.21.15.37:0/3945550709 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c015020 con 0x7f0e2c1101a0 2024-05-09T01:04:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.129+0000 7f0e387bc740 1 Processor -- start 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.130+0000 7f0e387bc740 1 -- start start 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c3c1b0 0x563196fe0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fe0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fe7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e387bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563196f447c0 con 0x563196c3c1b0 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e387bc740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563196ee00e0 con 0x563196c1b4d0 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e387bc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563196f40780 con 0x563196c132f0 2024-05-09T01:04:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e308fe640 1 -- 172.21.15.37:0/3945550709 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0e1c018020 con 0x7f0e2c1101a0 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e2a7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fe7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e2a7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fe7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40954/0 (socket says 172.21.15.37:40954) 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/3926881259 learned_addr learned my addr 172.21.15.37:0/3926881259 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.131+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c3c1b0 0x563196fe0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e2affd640 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fe0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/3926881259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 msgr2=0x563196fe0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fe0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/3926881259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c3c1b0 msgr2=0x563196fe0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:43.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c3c1b0 0x563196fe0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/3926881259 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563196f097c0 con 0x563196c1b4d0 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fe7980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000cfd0 tx=0x7f0e2000c1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67e3fe9fb337ff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e11ffb640 1 -- 172.21.15.37:0/3926881259 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000f040 con 0x563196c1b4d0 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e11ffb640 1 -- 172.21.15.37:0/3926881259 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e20003690 con 0x563196c1b4d0 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e308fe640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0e140b2aa0 0x7f0e140b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.132+0000 7f0e11ffb640 1 -- 172.21.15.37:0/3926881259 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200186d0 con 0x563196c1b4d0 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.133+0000 7f0e308fe640 1 -- 172.21.15.37:0/3945550709 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0e1c0e1550 con 0x7f0e2c1101a0 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.133+0000 7f0e2affd640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0e140b2aa0 0x7f0e140b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 -- 172.21.15.37:0/3926881259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 msgr2=0x563196fe7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fe7980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0e2000cfd0 tx=0x7f0e2000c1f0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 -- 172.21.15.37:0/3926881259 shutdown_connections 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fe7980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fe0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3926881259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c3c1b0 0x563196fe0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 -- 172.21.15.37:0/3926881259 >> 172.21.15.37:0/3926881259 conn(0x563196c30300 msgr2=0x563196fdbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 -- 172.21.15.37:0/3926881259 shutdown_connections 2024-05-09T01:04:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.134+0000 7f0e387bc740 1 -- 172.21.15.37:0/3926881259 wait complete. 2024-05-09T01:04:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.135+0000 7f0e387bc740 1 -- start start 2024-05-09T01:04:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.135+0000 7f0e2affd640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0e140b2aa0 0x7f0e140b4fb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x563196fe18e0 tx=0x7f0e24031a50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.135+0000 7f0e387bc740 1 Processor -- start 2024-05-09T01:04:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196fea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c1b4d0 0x563196fea830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c3c1b0 0x563196ff1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196fea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e387bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563196fe8370 con 0x563196c1b4d0 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196fea2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40964/0 (socket says 172.21.15.37:40964) 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c1b4d0 0x563196fea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 -- 172.21.15.37:0/3948465595 learned_addr learned my addr 172.21.15.37:0/3948465595 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563196ecb9c0 con 0x563196c132f0 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563196fe84f0 con 0x563196c3c1b0 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2b7fe640 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c3c1b0 0x563196ff1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e387bc740 10 client.0 _ll_register_callbacks cb 0x563196ef8020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 -- 172.21.15.37:0/3948465595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c3c1b0 msgr2=0x563196ff1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c3c1b0 0x563196ff1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 -- 172.21.15.37:0/3948465595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c1b4d0 msgr2=0x563196fea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c1b4d0 0x563196fea830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.136+0000 7f0e2affd640 1 -- 172.21.15.37:0/3948465595 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563196ef21f0 con 0x563196c132f0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.137+0000 7f0e2affd640 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196fea2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e240097f0 tx=0x7f0e2402a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf52dd22b536baf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.137+0000 7f0e0affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.137+0000 7f0e0affd640 1 -- 172.21.15.37:0/3948465595 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24004310 con 0x563196c132f0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.137+0000 7f0e0affd640 1 -- 172.21.15.37:0/3948465595 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0e240044b0 con 0x563196c132f0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.138+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e20003690 con 0x563196c132f0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.138+0000 7f0e0affd640 1 -- 172.21.15.37:0/3948465595 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e240046b0 con 0x563196c132f0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.138+0000 7f0e387bc740 10 client.25385 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.138+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x563196ca7790 con 0x563196c132f0 2024-05-09T01:04:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.139+0000 7f0e0affd640 1 -- 172.21.15.37:0/3948465595 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e20003690 con 0x563196c132f0 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e0affd640 1 -- 172.21.15.37:0/3948465595 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f0e24051070 con 0x563196c132f0 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e387bc740 10 client.25385 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e387bc740 10 client.25385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e387bc740 20 client.25385 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196bfad80 0x563196ff7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e387bc740 4 client.25385 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563196f523d0 con 0x563196bfad80 2024-05-09T01:04:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196bfad80 0x563196ff7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196bfad80 0x563196ff7e30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bfa972f91cf0b4b server_cookie=72a76681cdd9e56e in_seq=0 out_seq=0 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.140+0000 7f0e0affd640 10 client.25385 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.141+0000 7f0e0affd640 1 -- 172.21.15.37:0/3948465595 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563196f523d0 con 0x563196bfad80 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.141+0000 7f0e0affd640 10 client.25385 handle_command_reply: tid=0 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.141+0000 7f0e387bc740 1 client.25385 shutdown 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 msgr2=0x563196fea2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196fea2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e240097f0 tx=0x7f0e2402a8f0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 shutdown_connections 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196bfad80 0x563196ff7e30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c3c1b0 0x563196ff1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196c1b4d0 0x563196fea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e0affd640 0 client.25385 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.142+0000 7f0e387bc740 1 --2- 172.21.15.37:0/3948465595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196fea2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.143+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 >> 172.21.15.37:0/3948465595 conn(0x563196c30300 msgr2=0x563196fdeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.143+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 shutdown_connections 2024-05-09T01:04:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.143+0000 7f0e387bc740 1 -- 172.21.15.37:0/3948465595 wait complete. 2024-05-09T01:04:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.143+0000 7f0e387bc740 20 client.25385 trim_cache size 0 max 16384 2024-05-09T01:04:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.165+0000 7f0e387bc740 1 Processor -- start 2024-05-09T01:04:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.165+0000 7f0e387bc740 1 -- start start 2024-05-09T01:04:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196fdec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196ff1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c1b4d0 0x563196fdf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e387bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800e3f0 con 0x563196bfad80 2024-05-09T01:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e387bc740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0e18010020 con 0x563196c132f0 2024-05-09T01:04:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e387bc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800eac0 con 0x563196c1b4d0 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196fdec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196fdec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57156/0 (socket says 172.21.15.37:57156) 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 -- 172.21.15.37:0/1662839619 learned_addr learned my addr 172.21.15.37:0/1662839619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 -- 172.21.15.37:0/1662839619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c1b4d0 msgr2=0x563196fdf1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 --2- 172.21.15.37:0/1662839619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c1b4d0 0x563196fdf1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 -- 172.21.15.37:0/1662839619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 msgr2=0x563196ff1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 --2- 172.21.15.37:0/1662839619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196ff1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.166+0000 7f0e2affd640 1 -- 172.21.15.37:0/1662839619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563196d1e5f0 con 0x563196bfad80 2024-05-09T01:04:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.167+0000 7f0e2affd640 1 --2- 172.21.15.37:0/1662839619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196fdec90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0e24058040 tx=0x7f0e24030fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9312d0ed245bcc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.167+0000 7f0e117fa640 1 -- 172.21.15.37:0/1662839619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24004310 con 0x563196bfad80 2024-05-09T01:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.167+0000 7f0e117fa640 1 -- 172.21.15.37:0/1662839619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e24036050 con 0x563196bfad80 2024-05-09T01:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.167+0000 7f0e117fa640 1 -- 172.21.15.37:0/1662839619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2402fde0 con 0x563196bfad80 2024-05-09T01:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 -- 172.21.15.37:0/1662839619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 msgr2=0x563196fdec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1662839619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196fdec90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0e24058040 tx=0x7f0e24030fd0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 -- 172.21.15.37:0/1662839619 shutdown_connections 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1662839619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c1b4d0 0x563196fdf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1662839619 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c132f0 0x563196ff1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1662839619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196fdec90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 -- 172.21.15.37:0/1662839619 >> 172.21.15.37:0/1662839619 conn(0x563196c30300 msgr2=0x563196fe0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.168+0000 7f0e387bc740 1 -- 172.21.15.37:0/1662839619 shutdown_connections 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.169+0000 7f0e387bc740 1 -- 172.21.15.37:0/1662839619 wait complete. 2024-05-09T01:04:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.169+0000 7f0e387bc740 1 -- start start 2024-05-09T01:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.169+0000 7f0e387bc740 1 Processor -- start 2024-05-09T01:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196ff1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fee320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e387bc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fee950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e2a7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e2a7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34508/0 (socket says 172.21.15.37:34508) 2024-05-09T01:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e387bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800f890 con 0x563196bfad80 2024-05-09T01:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e387bc740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800f1c0 con 0x563196c1b4d0 2024-05-09T01:04:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e387bc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1800c3d0 con 0x563196c132f0 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/1110481138 learned_addr learned my addr 172.21.15.37:0/1110481138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e2affd640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196ff1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e387bc740 10 client.0 _ll_register_callbacks cb 0x7f0e240318e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.171+0000 7f0e2b7fe640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 msgr2=0x563196fee950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fee950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/1110481138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 msgr2=0x563196ff1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196ff1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e2a7fc640 1 -- 172.21.15.37:0/1110481138 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563196f08ed0 con 0x563196c132f0 2024-05-09T01:04:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e2affd640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196ff1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e2a7fc640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fee320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e200155f0 tx=0x7f0e2000c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d49803093d880dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e0affd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e0affd640 1 -- 172.21.15.37:0/1110481138 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2002a250 con 0x563196c132f0 2024-05-09T01:04:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e0affd640 1 -- 172.21.15.37:0/1110481138 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0e2000f040 con 0x563196c132f0 2024-05-09T01:04:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.172+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e24036050 con 0x563196c132f0 2024-05-09T01:04:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.173+0000 7f0e0affd640 1 -- 172.21.15.37:0/1110481138 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e20005970 con 0x563196c132f0 2024-05-09T01:04:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.173+0000 7f0e387bc740 10 client.25414 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.173+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56319705f2a0 con 0x563196c132f0 2024-05-09T01:04:43.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.173+0000 7f0e0affd640 1 -- 172.21.15.37:0/1110481138 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e24036050 con 0x563196c132f0 2024-05-09T01:04:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e0affd640 1 -- 172.21.15.37:0/1110481138 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f0e2002ace0 con 0x563196c132f0 2024-05-09T01:04:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e387bc740 10 client.25414 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e387bc740 10 client.25414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e387bc740 20 client.25414 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196c3c1b0 0x563197061ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e387bc740 4 client.25414 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:04:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563196f4c240 con 0x563196c3c1b0 2024-05-09T01:04:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.175+0000 7f0e2affd640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196c3c1b0 0x563197061ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.176+0000 7f0e0affd640 10 client.25414 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.176+0000 7f0e2affd640 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196c3c1b0 0x563197061ab0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3273990fbcf2f95 server_cookie=f8207f54da911e39 in_seq=0 out_seq=0 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.185+0000 7f0e0affd640 1 -- 172.21.15.37:0/1110481138 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x563196f4c240 con 0x563196c3c1b0 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.185+0000 7f0e0affd640 10 client.25414 handle_command_reply: tid=0 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.185+0000 7f0e387bc740 1 client.25414 shutdown 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.185+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 msgr2=0x563196fee320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.185+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fee320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e200155f0 tx=0x7f0e2000c7c0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 shutdown_connections 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563196c3c1b0 0x563197061ab0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563196c1b4d0 0x563196fee950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563196c132f0 0x563196fee320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 --2- 172.21.15.37:0/1110481138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563196bfad80 0x563196ff1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 >> 172.21.15.37:0/1110481138 conn(0x563196c30300 msgr2=0x563196fea290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e0affd640 0 client.25414 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 shutdown_connections 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 1 -- 172.21.15.37:0/1110481138 wait complete. 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.186+0000 7f0e387bc740 20 client.25414 trim_cache size 0 max 16384 2024-05-09T01:04:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:04:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0e140b2aa0 msgr2=0x7f0e140b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0e140b2aa0 0x7f0e140b4fb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x563196fe18e0 tx=0x7f0e24031a50 comp rx=0 tx=0).stop 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 msgr2=0x7f0e2c1186a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 0x7f0e2c1186a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b3e0 tx=0x7f0e1c00b8a0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 shutdown_connections 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0e140b2aa0 0x7f0e140b4fb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0e2c1101a0 0x7f0e2c1186a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c10b480 0x7f0e2c117740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 --2- 172.21.15.37:0/3945550709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c10a550 0x7f0e2c117200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 >> 172.21.15.37:0/3945550709 conn(0x7f0e2c070670 msgr2=0x7f0e2c10c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 shutdown_connections 2024-05-09T01:04:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:43.187+0000 7f0e31900640 1 -- 172.21.15.37:0/3945550709 wait complete. 2024-05-09T01:04:44.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:44 smithi037 ceph-mon[30122]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 43 MiB/s wr, 851 op/s 2024-05-09T01:04:44.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:44 smithi151 ceph-mon[34780]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 43 MiB/s wr, 851 op/s 2024-05-09T01:04:44.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:44 smithi136 ceph-mon[34110]: pgmap v473: 97 pgs: 97 active+clean; 1.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 43 MiB/s wr, 851 op/s 2024-05-09T01:04:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 145.0 s, 4170.8 tps, lat 23.901 ms stddev 27.273 2024-05-09T01:04:45.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:45 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:04:45.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:45 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:04:45.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:45 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:04:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:46 smithi151 ceph-mon[34780]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 40 MiB/s wr, 798 op/s 2024-05-09T01:04:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:04:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:04:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:46 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:04:46.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:46 smithi037 ceph-mon[30122]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 40 MiB/s wr, 798 op/s 2024-05-09T01:04:46.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:04:46.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:04:46.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:46 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:04:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:46 smithi136 ceph-mon[34110]: pgmap v474: 97 pgs: 97 active+clean; 1.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 40 MiB/s wr, 798 op/s 2024-05-09T01:04:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:04:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:04:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:46 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:04:48.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:04:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:48 smithi037 ceph-mon[30122]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 818 op/s 2024-05-09T01:04:48.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:48 smithi151 ceph-mon[34780]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 818 op/s 2024-05-09T01:04:48.739 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:48 smithi136 ceph-mon[34110]: pgmap v475: 97 pgs: 97 active+clean; 1.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 39 MiB/s wr, 818 op/s 2024-05-09T01:04:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 150.0 s, 1540.7 tps, lat 57.711 ms stddev 179.431 2024-05-09T01:04:50.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:50 smithi037 ceph-mon[30122]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 775 op/s 2024-05-09T01:04:50.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:50 smithi151 ceph-mon[34780]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 775 op/s 2024-05-09T01:04:50.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:50 smithi136 ceph-mon[34110]: pgmap v476: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 775 op/s 2024-05-09T01:04:51.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/1006573179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c141034c0 msgr2=0x7f2c141038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/1006573179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c141034c0 0x7f2c141038d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2c100099c0 tx=0x7f2c10009cd0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/1006573179 shutdown_connections 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/1006573179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c14108740 0x7f2c141100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/1006573179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c141034c0 0x7f2c141038d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/1006573179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14107df0 0x7f2c14108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/1006573179 >> 172.21.15.37:0/1006573179 conn(0x7f2c140fedc0 msgr2=0x7f2c141011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/1006573179 shutdown_connections 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.141+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/1006573179 wait complete. 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 Processor -- start 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 -- start start 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c141034c0 0x7f2c140ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14107df0 0x7f2c140ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c14108740 0x7f2c140ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14113390 con 0x7f2c14108740 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14113210 con 0x7f2c141034c0 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.142+0000 7f2c1bc3b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14113510 con 0x7f2c14107df0 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c14108740 0x7f2c140ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c14108740 0x7f2c140ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57178/0 (socket says 172.21.15.37:57178) 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/636187037 learned_addr learned my addr 172.21.15.37:0/636187037 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c191d6700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14107df0 0x7f2c140ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c199d7700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c141034c0 0x7f2c140ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/636187037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14107df0 msgr2=0x7f2c140ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14107df0 0x7f2c140ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/636187037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c141034c0 msgr2=0x7f2c140ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c141034c0 0x7f2c140ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/636187037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c141a91d0 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c191d6700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14107df0 0x7f2c140ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c14108740 0x7f2c140ffd20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007ee0 tx=0x7f2c0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c0affd700 1 -- 172.21.15.37:0/636187037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00dd20 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c0affd700 1 -- 172.21.15.37:0/636187037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c0c004020 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c141a94c0 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c0affd700 1 -- 172.21.15.37:0/636187037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c015660 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.143+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c141a9a50 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.146+0000 7f2c0affd700 1 -- 172.21.15.37:0/636187037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2c0c0041d0 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.147+0000 7f2c0affd700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c000b2900 0x7f2c000b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.147+0000 7f2c199d7700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c000b2900 0x7f2c000b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c0affd700 1 -- 172.21.15.37:0/636187037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2c0c0e1a80 con 0x7f2c14108740 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 Processor -- start 2024-05-09T01:04:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 -- start start 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c199d7700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c000b2900 0x7f2c000b4e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2c10000c00 tx=0x7f2c1001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f6c8400 0x55620f6c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55620f5eb0a0 con 0x55620f5c5d00 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55620f5909a0 con 0x55620f54b4a0 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55620f5e7060 con 0x55620f6c8400 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c199d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c191d6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c199d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57188/0 (socket says 172.21.15.37:57188) 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c199d7700 1 -- 172.21.15.37:0/3580024415 learned_addr learned my addr 172.21.15.37:0/3580024415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.148+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f6c8400 0x55620f6c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2c191d6700 1 -- 172.21.15.37:0/3580024415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f6c8400 msgr2=0x55620f6c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2c191d6700 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f6c8400 0x55620f6c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2c191d6700 1 -- 172.21.15.37:0/3580024415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 msgr2=0x55620f6ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2c191d6700 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2c191d6700 1 -- 172.21.15.37:0/3580024415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55620f581500 con 0x55620f54b4a0 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f6c8400 0x55620f6c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2c191d6700 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6ce780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c14076ab0 tx=0x7f2c040117a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89924a81206be4f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2bfffff700 1 -- 172.21.15.37:0/3580024415 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04004310 con 0x55620f54b4a0 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2bfffff700 1 -- 172.21.15.37:0/3580024415 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c040044b0 con 0x55620f54b4a0 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.149+0000 7f2bfffff700 1 -- 172.21.15.37:0/3580024415 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04003680 con 0x55620f54b4a0 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3580024415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 msgr2=0x55620f6ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6ce780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2c14076ab0 tx=0x7f2c040117a0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3580024415 shutdown_connections 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f6c8400 0x55620f6c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3580024415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6ce780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3580024415 >> 172.21.15.37:0/3580024415 conn(0x55620f54ef70 msgr2=0x55620f6c3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3580024415 shutdown_connections 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.150+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3580024415 wait complete. 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.151+0000 7f2c2a651b80 1 -- start start 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.151+0000 7f2c2a651b80 1 Processor -- start 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f54b4a0 0x55620f6d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55620f6c9160 con 0x55620f5c5d00 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55620f585b20 con 0x55620f6c8400 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55620f6d5020 con 0x55620f54b4a0 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c2a651b80 10 client.0 _ll_register_callbacks cb 0x55620f45c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c191d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c199d7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f54b4a0 0x55620f6d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c191d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6d24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57194/0 (socket says 172.21.15.37:57194) 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c191d6700 1 -- 172.21.15.37:0/1062782110 learned_addr learned my addr 172.21.15.37:0/1062782110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c199d7700 1 -- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 msgr2=0x55620f6d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c199d7700 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c199d7700 1 -- 172.21.15.37:0/1062782110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 msgr2=0x55620f6d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c199d7700 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c199d7700 1 -- 172.21.15.37:0/1062782110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55620f466490 con 0x55620f54b4a0 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c191d6700 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2c199d7700 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f54b4a0 0x55620f6d1fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000a010 tx=0x7f2c10009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=587ff2130ddd13de server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2bfd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.152+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/1062782110 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000bde0 con 0x55620f54b4a0 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/1062782110 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2c10025470 con 0x55620f54b4a0 2024-05-09T01:04:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c040044b0 con 0x55620f54b4a0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/1062782110 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2c10025670 con 0x55620f54b4a0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 10 client.25426 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55620f6df990 con 0x55620f54b4a0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/1062782110 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c040044b0 con 0x55620f54b4a0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/1062782110 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f2c10039050 con 0x55620f54b4a0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 10 client.25426 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 10 client.25426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 20 client.25426 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f6e1fc0 0x55620f6e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 4 client.25426 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.153+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55620f5f8a80 con 0x55620f6e1fc0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.154+0000 7f2c191d6700 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f6e1fc0 0x55620f6e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.154+0000 7f2c191d6700 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f6e1fc0 0x55620f6e43e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8f96ac979c1bbdb server_cookie=de4aaebb7903e934 in_seq=0 out_seq=0 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.154+0000 7f2bfd7fa700 10 client.25426 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:51.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/1062782110 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55620f5f8a80 con 0x55620f6e1fc0 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2bfd7fa700 10 client.25426 handle_command_reply: tid=0 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 client.25426 shutdown 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f54b4a0 msgr2=0x55620f6d1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f54b4a0 0x55620f6d1fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000a010 tx=0x7f2c10009310 comp rx=0 tx=0).stop 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 shutdown_connections 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f6e1fc0 0x55620f6e43e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f54b4a0 0x55620f6d1fb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/1062782110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f5c5d00 0x55620f6d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2bfd7fa700 0 client.25426 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 >> 172.21.15.37:0/1062782110 conn(0x55620f54ef70 msgr2=0x55620f6bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 shutdown_connections 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 1 -- 172.21.15.37:0/1062782110 wait complete. 2024-05-09T01:04:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.155+0000 7f2c2a651b80 20 client.25426 trim_cache size 0 max 16384 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.175+0000 7f2c2a651b80 1 Processor -- start 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.175+0000 7f2c2a651b80 1 -- start start 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f54b4a0 0x55620f6d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6dde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141b0cb0 con 0x55620f54b4a0 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141b28e0 con 0x55620f6c8400 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141b1380 con 0x55620f5c5d00 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f54b4a0 0x55620f6d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f54b4a0 0x55620f6d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57208/0 (socket says 172.21.15.37:57208) 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 -- 172.21.15.37:0/2825202460 learned_addr learned my addr 172.21.15.37:0/2825202460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c191d6700 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 -- 172.21.15.37:0/2825202460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 msgr2=0x55620f6bd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6bd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 -- 172.21.15.37:0/2825202460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 msgr2=0x55620f6dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 -- 172.21.15.37:0/2825202460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55620f6bf510 con 0x55620f54b4a0 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2c199d7700 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f54b4a0 0x55620f6d0f10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098e0 tx=0x7f2c10025600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f9bc9f31b68b29 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2bff7fe700 1 -- 172.21.15.37:0/2825202460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1003f030 con 0x55620f54b4a0 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2bff7fe700 1 -- 172.21.15.37:0/2825202460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c10025cc0 con 0x55620f54b4a0 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.176+0000 7f2bff7fe700 1 -- 172.21.15.37:0/2825202460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000be40 con 0x55620f54b4a0 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 -- 172.21.15.37:0/2825202460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f54b4a0 msgr2=0x55620f6d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f54b4a0 0x55620f6d0f10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098e0 tx=0x7f2c10025600 comp rx=0 tx=0).stop 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 -- 172.21.15.37:0/2825202460 shutdown_connections 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f6c8400 0x55620f6dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f54b4a0 0x55620f6d0f10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/2825202460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6bd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 -- 172.21.15.37:0/2825202460 >> 172.21.15.37:0/2825202460 conn(0x55620f54ef70 msgr2=0x55620f6bcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 -- 172.21.15.37:0/2825202460 shutdown_connections 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.177+0000 7f2c2a651b80 1 -- 172.21.15.37:0/2825202460 wait complete. 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 -- start start 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 Processor -- start 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6da480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f6c8400 0x55620f6cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141b2150 con 0x55620f6c8400 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141b1a80 con 0x55620f54b4a0 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141aec70 con 0x55620f5c5d00 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.178+0000 7f2c2a651b80 10 client.0 _ll_register_callbacks cb 0x55620f45c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f6c8400 0x55620f6cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f6c8400 0x55620f6cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57224/0 (socket says 172.21.15.37:57224) 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c199d7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/3790873907 learned_addr learned my addr 172.21.15.37:0/3790873907 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c191d6700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/3790873907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 msgr2=0x55620f6ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 msgr2=0x55620f6da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6da480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 -- 172.21.15.37:0/3790873907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55620f6cf360 con 0x55620f6c8400 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c191d6700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c199d7700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6da480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c1a1d8700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f6c8400 0x55620f6cee20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0df580 tx=0x7f2c0c004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e42a5aada24aba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2bfd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:04:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/3790873907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c0c3060 con 0x55620f6c8400 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/3790873907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2c0c004bd0 con 0x55620f6c8400 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c10025cc0 con 0x55620f6c8400 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/3790873907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2c0c0a90a0 con 0x55620f6c8400 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c2a651b80 10 client.15663 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.179+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55620f74c3f0 con 0x55620f6c8400 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/3790873907 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c10025cc0 con 0x55620f6c8400 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/3790873907 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f2c0c0a4a10 con 0x55620f6c8400 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c2a651b80 10 client.15663 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c2a651b80 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c2a651b80 20 client.15663 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f74cbc0 0x55620f74efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c2a651b80 4 client.15663 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55620f5f2b20 con 0x55620f74cbc0 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c199d7700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f74cbc0 0x55620f74efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:51.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2bfd7fa700 10 client.15663 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.180+0000 7f2c199d7700 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f74cbc0 0x55620f74efe0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf6f1139cbfffae server_cookie=de49f52a19d9124a in_seq=0 out_seq=0 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2bfd7fa700 1 -- 172.21.15.37:0/3790873907 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55620f5f2b20 con 0x55620f74cbc0 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2bfd7fa700 10 client.15663 handle_command_reply: tid=0 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 client.15663 shutdown 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f6c8400 msgr2=0x55620f6cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f6c8400 0x55620f6cee20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0df580 tx=0x7f2c0c004720 comp rx=0 tx=0).stop 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 shutdown_connections 2024-05-09T01:04:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55620f74cbc0 0x55620f74efe0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55620f6c8400 0x55620f6cee20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55620f54b4a0 0x55620f6da480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 --2- 172.21.15.37:0/3790873907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55620f5c5d00 0x55620f6ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2bfd7fa700 0 client.15663 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 >> 172.21.15.37:0/3790873907 conn(0x55620f54ef70 msgr2=0x55620f6cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 shutdown_connections 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:04:51.471 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 1 -- 172.21.15.37:0/3790873907 wait complete. 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.181+0000 7f2c2a651b80 20 client.15663 trim_cache size 0 max 16384 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c000b2900 msgr2=0x7f2c000b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c000b2900 0x7f2c000b4e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2c10000c00 tx=0x7f2c1001a040 comp rx=0 tx=0).stop 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c14108740 msgr2=0x7f2c140ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c14108740 0x7f2c140ffd20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c007ee0 tx=0x7f2c0c00d3b0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 shutdown_connections 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2c000b2900 0x7f2c000b4e10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c14108740 0x7f2c140ffd20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c141034c0 0x7f2c140ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 --2- 172.21.15.37:0/636187037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c14107df0 0x7f2c140ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 >> 172.21.15.37:0/636187037 conn(0x7f2c140fedc0 msgr2=0x7f2c141063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 shutdown_connections 2024-05-09T01:04:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:51.182+0000 7f2c1bc3b700 1 -- 172.21.15.37:0/636187037 wait complete. 2024-05-09T01:04:52.324 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:04:52.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:04:52.590 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:52.713 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:52 smithi037 ceph-mon[30122]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 901 op/s 2024-05-09T01:04:52.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:52 smithi151 ceph-mon[34780]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 901 op/s 2024-05-09T01:04:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:52 smithi136 ceph-mon[34110]: pgmap v477: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 MiB/s wr, 901 op/s 2024-05-09T01:04:53.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:53 smithi037 ceph-mon[30122]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 41 MiB/s wr, 1.04k op/s 2024-05-09T01:04:53.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:53 smithi151 ceph-mon[34780]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 41 MiB/s wr, 1.04k op/s 2024-05-09T01:04:53.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:53 smithi136 ceph-mon[34110]: pgmap v478: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 41 MiB/s wr, 1.04k op/s 2024-05-09T01:04:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 -- 172.21.15.37:0/1162543403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c108740 msgr2=0x7f347c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 --2- 172.21.15.37:0/1162543403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c108740 0x7f347c1100a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f347400b0d0 tx=0x7f347400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 -- 172.21.15.37:0/1162543403 shutdown_connections 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 --2- 172.21.15.37:0/1162543403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c108740 0x7f347c1100a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 --2- 172.21.15.37:0/1162543403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f347c1034c0 0x7f347c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 --2- 172.21.15.37:0/1162543403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f347c107df0 0x7f347c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 -- 172.21.15.37:0/1162543403 >> 172.21.15.37:0/1162543403 conn(0x7f347c0fedc0 msgr2=0x7f347c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 -- 172.21.15.37:0/1162543403 shutdown_connections 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.500+0000 7f3483ae5700 1 -- 172.21.15.37:0/1162543403 wait complete. 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 Processor -- start 2024-05-09T01:04:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 -- start start 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f347c1034c0 0x7f347c19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c107df0 0x7f347c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f347c108740 0x7f347c19f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1144c0 con 0x7f347c107df0 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f347c114340 con 0x7f347c108740 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3483ae5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f347c114640 con 0x7f347c1034c0 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c107df0 0x7f347c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c107df0 0x7f347c19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39252/0 (socket says 172.21.15.37:39252) 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 -- 172.21.15.37:0/372151465 learned_addr learned my addr 172.21.15.37:0/372151465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3482082700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f347c108740 0x7f347c19f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481881700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f347c1034c0 0x7f347c19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 -- 172.21.15.37:0/372151465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f347c1034c0 msgr2=0x7f347c19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f347c1034c0 0x7f347c19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 -- 172.21.15.37:0/372151465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f347c108740 msgr2=0x7f347c19f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f347c108740 0x7f347c19f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.501+0000 7f3481080700 1 -- 172.21.15.37:0/372151465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c19fc80 con 0x7f347c107df0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.502+0000 7f3481080700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c107df0 0x7f347c19b350 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e970 tx=0x7f346c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.502+0000 7f3472ffd700 1 -- 172.21.15.37:0/372151465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c00cbd0 con 0x7f347c107df0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.502+0000 7f3472ffd700 1 -- 172.21.15.37:0/372151465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f346c00cd70 con 0x7f347c107df0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.502+0000 7f3472ffd700 1 -- 172.21.15.37:0/372151465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c005680 con 0x7f347c107df0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.502+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c19ff70 con 0x7f347c107df0 2024-05-09T01:04:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.502+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c1a7890 con 0x7f347c107df0 2024-05-09T01:04:54.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.503+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347c0512c0 con 0x7f347c107df0 2024-05-09T01:04:54.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.505+0000 7f3472ffd700 1 -- 172.21.15.37:0/372151465 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f346c004750 con 0x7f347c107df0 2024-05-09T01:04:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.506+0000 7f3472ffd700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34680b2880 0x7f34680b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.506+0000 7f3481881700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34680b2880 0x7f34680b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.506+0000 7f3472ffd700 1 -- 172.21.15.37:0/372151465 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f346c0e28e0 con 0x7f347c107df0 2024-05-09T01:04:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.507+0000 7f3481881700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34680b2880 0x7f34680b4d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3478009bf0 tx=0x7f3478009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.510+0000 7f3472ffd700 1 -- 172.21.15.37:0/372151465 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f346c0aa600 con 0x7f347c107df0 2024-05-09T01:04:54.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.773+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f347c19c140 con 0x7f347c107df0 2024-05-09T01:04:54.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.774+0000 7f3472ffd700 1 -- 172.21.15.37:0/372151465 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11944 (secure 0 0 0) 0x7f347c19c140 con 0x7f347c107df0 2024-05-09T01:04:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:04:54.775 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:02:21.655821+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:04:54.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34680b2880 msgr2=0x7f34680b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:54.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34680b2880 0x7f34680b4d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3478009bf0 tx=0x7f3478009260 comp rx=0 tx=0).stop 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c107df0 msgr2=0x7f347c19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c107df0 0x7f347c19b350 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e970 tx=0x7f346c00ec80 comp rx=0 tx=0).stop 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 shutdown_connections 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34680b2880 0x7f34680b4d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f347c108740 0x7f347c19f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f347c1034c0 0x7f347c19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 --2- 172.21.15.37:0/372151465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f347c107df0 0x7f347c19b350 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.776+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 >> 172.21.15.37:0/372151465 conn(0x7f347c0fedc0 msgr2=0x7f347c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.777+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 shutdown_connections 2024-05-09T01:04:54.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:54.777+0000 7f3483ae5700 1 -- 172.21.15.37:0/372151465 wait complete. 2024-05-09T01:04:54.779 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2024-05-09T01:04:55.098 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:54 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/372151465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:04:55.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:54 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/372151465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:04:55.225 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:54 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/372151465' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:04:55.235 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 155.0 s, 0.8 tps, lat 903.761 ms stddev 35.600 2024-05-09T01:04:55.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:04:55.858 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:04:56.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:55 smithi037 ceph-mon[30122]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 43 MiB/s wr, 1.08k op/s 2024-05-09T01:04:56.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:55 smithi136 ceph-mon[34110]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 43 MiB/s wr, 1.08k op/s 2024-05-09T01:04:56.224 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:55 smithi151 ceph-mon[34780]: pgmap v479: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 43 MiB/s wr, 1.08k op/s 2024-05-09T01:04:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 -- 172.21.15.37:0/358043523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8103c70 msgr2=0x7ff1a8104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 --2- 172.21.15.37:0/358043523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8103c70 0x7ff1a8104970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009900 tx=0x7ff1a402a410 comp rx=0 tx=0).stop 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 -- 172.21.15.37:0/358043523 shutdown_connections 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 --2- 172.21.15.37:0/358043523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1a8109bb0 0x7ff1a810bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 --2- 172.21.15.37:0/358043523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1a8104eb0 0x7ff1a81052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 --2- 172.21.15.37:0/358043523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8103c70 0x7ff1a8104970 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 -- 172.21.15.37:0/358043523 >> 172.21.15.37:0/358043523 conn(0x7ff1a80fee60 msgr2=0x7ff1a8101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 -- 172.21.15.37:0/358043523 shutdown_connections 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.297+0000 7ff1b0334640 1 -- 172.21.15.37:0/358043523 wait complete. 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 Processor -- start 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 -- start start 2024-05-09T01:04:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1a8103c70 0x7ff1a819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8104eb0 0x7ff1a819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1a8109bb0 0x7ff1a81a3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a810f7c0 con 0x7ff1a8104eb0 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a810f640 con 0x7ff1a8109bb0 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1b0334640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a810f940 con 0x7ff1a8103c70 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1ad8cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8104eb0 0x7ff1a819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1ad8cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8104eb0 0x7ff1a819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39264/0 (socket says 172.21.15.37:39264) 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/2147927262 learned_addr learned my addr 172.21.15.37:0/2147927262 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1a8109bb0 0x7ff1a81a3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.298+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1a8103c70 0x7ff1a819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/2147927262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1a8103c70 msgr2=0x7ff1a819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1a8103c70 0x7ff1a819c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/2147927262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1a8109bb0 msgr2=0x7ff1a81a3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1a8109bb0 0x7ff1a81a3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/2147927262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a81a40f0 con 0x7ff1a8104eb0 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8104eb0 0x7ff1a819caf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff19800e9f0 tx=0x7ff19800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff19f7fe640 1 -- 172.21.15.37:0/2147927262 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19800cd80 con 0x7ff1a8104eb0 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff19f7fe640 1 -- 172.21.15.37:0/2147927262 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1980108e0 con 0x7ff1a8104eb0 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff19f7fe640 1 -- 172.21.15.37:0/2147927262 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198018980 con 0x7ff1a8104eb0 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a81a43e0 con 0x7ff1a8104eb0 2024-05-09T01:04:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.299+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a81a4980 con 0x7ff1a8104eb0 2024-05-09T01:04:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.302+0000 7ff1b71e1740 1 Processor -- start 2024-05-09T01:04:56.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.302+0000 7ff1b71e1740 1 -- start start 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.302+0000 7ff19f7fe640 1 -- 172.21.15.37:0/2147927262 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff198010430 con 0x7ff1a8104eb0 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.302+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f241500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.302+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee742f0 0x56359f241a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee7c4d0 0x56359f248980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56359f1a57c0 con 0x56359ee7c4d0 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56359f1410e0 con 0x56359ee9d1b0 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56359f1a1780 con 0x56359ee742f0 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ad8cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee7c4d0 0x56359f248980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f241500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f241500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44016/0 (socket says 172.21.15.37:44016) 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/4008765426 learned_addr learned my addr 172.21.15.37:0/4008765426 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:56.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee742f0 0x56359f241a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/4008765426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee742f0 msgr2=0x56359f241a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee742f0 0x56359f241a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/4008765426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee7c4d0 msgr2=0x56359f248980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee7c4d0 0x56359f248980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/4008765426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359f16a7c0 con 0x56359ee9d1b0 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff19f7fe640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff1940b2860 0x7ff1940b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f241500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009fd0 tx=0x7ff1a00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=672e82049ffb94e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff1940b2860 0x7ff1940b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.303+0000 7ff19f7fe640 1 -- 172.21.15.37:0/2147927262 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff1980e24b0 con 0x7ff1a8104eb0 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff19cbfe640 1 -- 172.21.15.37:0/4008765426 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0004d20 con 0x56359ee9d1b0 2024-05-09T01:04:56.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff19cbfe640 1 -- 172.21.15.37:0/4008765426 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a0004050 con 0x56359ee9d1b0 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff19cbfe640 1 -- 172.21.15.37:0/4008765426 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0005280 con 0x56359ee9d1b0 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff1b71e1740 1 -- 172.21.15.37:0/4008765426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 msgr2=0x56359f241500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f241500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009fd0 tx=0x7ff1a00118d0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff1940b2860 0x7ff1940b4d70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff1a402aa00 tx=0x7ff1a4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff1b71e1740 1 -- 172.21.15.37:0/4008765426 shutdown_connections 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee7c4d0 0x56359f248980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.304+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee742f0 0x56359f241a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/4008765426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f241500 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 -- 172.21.15.37:0/4008765426 >> 172.21.15.37:0/4008765426 conn(0x56359ee91300 msgr2=0x56359f23ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 -- 172.21.15.37:0/4008765426 shutdown_connections 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 -- 172.21.15.37:0/4008765426 wait complete. 2024-05-09T01:04:56.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 -- start start 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 Processor -- start 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f24b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee7c4d0 0x56359f24b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f252760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56359f2493d0 con 0x56359ee742f0 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56359f12c9c0 con 0x56359ee9d1b0 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56359f249550 con 0x56359ee7c4d0 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1ae0d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f24b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.305+0000 7ff1b71e1740 10 client.0 _ll_register_callbacks cb 0x56359f159020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f24b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39286/0 (socket says 172.21.15.37:39286) 2024-05-09T01:04:56.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 -- 172.21.15.37:0/3781689516 learned_addr learned my addr 172.21.15.37:0/3781689516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f252760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee7c4d0 0x56359f24b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 -- 172.21.15.37:0/3781689516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee7c4d0 msgr2=0x56359f24b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee7c4d0 0x56359f24b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 -- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 msgr2=0x56359f252760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f252760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 -- 172.21.15.37:0/3781689516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359f1531f0 con 0x56359ee742f0 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f24b2c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8103540 tx=0x7ff1a402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476d3cb08ba32c62 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff191ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff191ffb640 1 -- 172.21.15.37:0/3781689516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a404c070 con 0x56359ee742f0 2024-05-09T01:04:56.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff191ffb640 1 -- 172.21.15.37:0/3781689516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff1a4004ad0 con 0x56359ee742f0 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1a0004050 con 0x56359ee742f0 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff191ffb640 1 -- 172.21.15.37:0/3781689516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1a4058050 con 0x56359ee742f0 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1b71e1740 10 client.15681 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.306+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56359ef08790 con 0x56359ee742f0 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff191ffb640 1 -- 172.21.15.37:0/3781689516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a0004050 con 0x56359ee742f0 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff191ffb640 1 -- 172.21.15.37:0/3781689516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7ff1a40325b0 con 0x56359ee742f0 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff1b71e1740 10 client.15681 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff1b71e1740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff1b71e1740 20 client.15681 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee5bd80 0x56359f258ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff1b71e1740 4 client.15681 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56359f1b33d0 con 0x56359ee5bd80 2024-05-09T01:04:56.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.307+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee5bd80 0x56359f258ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.308+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee5bd80 0x56359f258ce0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d92cc640b240e1 server_cookie=5a57b10e7cf4fcf5 in_seq=0 out_seq=0 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.308+0000 7ff191ffb640 10 client.15681 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.308+0000 7ff191ffb640 1 -- 172.21.15.37:0/3781689516 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56359f1b33d0 con 0x56359ee5bd80 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.308+0000 7ff191ffb640 10 client.15681 handle_command_reply: tid=0 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.308+0000 7ff1b71e1740 1 client.15681 shutdown 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 msgr2=0x56359f24b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f24b2c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8103540 tx=0x7ff1a402a410 comp rx=0 tx=0).stop 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 shutdown_connections 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee5bd80 0x56359f258ce0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff191ffb640 0 client.15681 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee9d1b0 0x56359f252760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee7c4d0 0x56359f24b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3781689516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f24b2c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 >> 172.21.15.37:0/3781689516 conn(0x56359ee91300 msgr2=0x56359f23b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 shutdown_connections 2024-05-09T01:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3781689516 wait complete. 2024-05-09T01:04:56.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.309+0000 7ff1b71e1740 20 client.15681 trim_cache size 0 max 16384 2024-05-09T01:04:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 Processor -- start 2024-05-09T01:04:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 -- start start 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f23bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f24b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f2526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81ad520 con 0x56359ee742f0 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81af150 con 0x56359ee5bd80 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81adbf0 con 0x56359ee91300 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.324+0000 7ff1ae8d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f2526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f2526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39288/0 (socket says 172.21.15.37:39288) 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/3581033399 learned_addr learned my addr 172.21.15.37:0/3581033399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f23bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f24b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/3581033399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 msgr2=0x56359f23bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f23bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/3581033399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 msgr2=0x56359f24b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f24b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 -- 172.21.15.37:0/3581033399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359ef7f5f0 con 0x56359ee742f0 2024-05-09T01:04:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f23bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:04:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f2526f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009fd0 tx=0x7ff1a0009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c7988f82c6f5ce server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff193fff640 1 -- 172.21.15.37:0/3581033399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0003a30 con 0x56359ee742f0 2024-05-09T01:04:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff193fff640 1 -- 172.21.15.37:0/3581033399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a0004db0 con 0x56359ee742f0 2024-05-09T01:04:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.325+0000 7ff193fff640 1 -- 172.21.15.37:0/3581033399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0005030 con 0x56359ee742f0 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3581033399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 msgr2=0x56359f2526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f2526f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009fd0 tx=0x7ff1a0009cc0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3581033399 shutdown_connections 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f2526f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f24b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/3581033399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f23bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3581033399 >> 172.21.15.37:0/3581033399 conn(0x56359f245f20 msgr2=0x56359f24ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3581033399 shutdown_connections 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 -- 172.21.15.37:0/3581033399 wait complete. 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.326+0000 7ff1b71e1740 1 -- start start 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 1 Processor -- start 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f250210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f250750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f251680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81ae9c0 con 0x56359ee742f0 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81ae2f0 con 0x56359ee5bd80 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81ab500 con 0x56359ee91300 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1b71e1740 10 client.0 _ll_register_callbacks cb 0x7ff198005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f250750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f250750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39302/0 (socket says 172.21.15.37:39302) 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/1999117096 learned_addr learned my addr 172.21.15.37:0/1999117096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f250210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ae8d1640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f251680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/1999117096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 msgr2=0x56359f251680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f251680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 msgr2=0x56359f250210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f250210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 -- 172.21.15.37:0/1999117096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359f169ed0 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f250210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff1ad8cf640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f250750 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff1980a6de0 tx=0x7ff1980e8060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b116fe5374cd017a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.327+0000 7ff191ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff191ffb640 1 -- 172.21.15.37:0/1999117096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198010720 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff191ffb640 1 -- 172.21.15.37:0/1999117096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff1980c41f0 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1a0004db0 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff191ffb640 1 -- 172.21.15.37:0/1999117096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff1980b2310 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 10 client.15687 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56359f252d70 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff191ffb640 1 -- 172.21.15.37:0/1999117096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a0004db0 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff191ffb640 1 -- 172.21.15.37:0/1999117096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7ff1980a5e00 con 0x56359ee742f0 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 10 client.15687 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 10 client.15687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:04:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 20 client.15687 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee7c4d0 0x56359f2c3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 4 client.15687 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:04:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.328+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56359f1ad240 con 0x56359ee7c4d0 2024-05-09T01:04:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.329+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee7c4d0 0x56359f2c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.329+0000 7ff191ffb640 10 client.15687 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:56.329+0000 7ff1ae0d0640 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee7c4d0 0x56359f2c3440 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14da24ef27f55120 server_cookie=65b1526f2275a72 in_seq=0 out_seq=0 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 -- 172.21.15.37:0/956099292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe608107df0 msgr2=0x7fe608108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 --2- 172.21.15.37:0/956099292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe608107df0 0x7fe608108200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80099c0 tx=0x7fe5f8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 -- 172.21.15.37:0/956099292 shutdown_connections 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 --2- 172.21.15.37:0/956099292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe608108740 0x7fe6081100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 --2- 172.21.15.37:0/956099292 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6081034c0 0x7fe6081038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 --2- 172.21.15.37:0/956099292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe608107df0 0x7fe608108200 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 -- 172.21.15.37:0/956099292 >> 172.21.15.37:0/956099292 conn(0x7fe6080fedc0 msgr2=0x7fe6081011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 -- 172.21.15.37:0/956099292 shutdown_connections 2024-05-09T01:04:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.688+0000 7fe610636700 1 -- 172.21.15.37:0/956099292 wait complete. 2024-05-09T01:04:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 Processor -- start 2024-05-09T01:04:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 -- start start 2024-05-09T01:04:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6081034c0 0x7fe60819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe608107df0 0x7fe60819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe608108740 0x7fe60819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe608113350 con 0x7fe6081034c0 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081131d0 con 0x7fe608108740 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe610636700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081134d0 con 0x7fe608107df0 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6081034c0 0x7fe60819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6081034c0 0x7fe60819ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39326/0 (socket says 172.21.15.37:39326) 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 -- 172.21.15.37:0/104091169 learned_addr learned my addr 172.21.15.37:0/104091169 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe608107df0 0x7fe60819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60ebd3700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe608108740 0x7fe60819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 -- 172.21.15.37:0/104091169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe608107df0 msgr2=0x7fe60819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe608107df0 0x7fe60819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 -- 172.21.15.37:0/104091169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe608108740 msgr2=0x7fe60819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe608108740 0x7fe60819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60e3d2700 1 -- 172.21.15.37:0/104091169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60819fce0 con 0x7fe6081034c0 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.689+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe608107df0 0x7fe60819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.690+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6081034c0 0x7fe60819ae10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe60400e9a0 tx=0x7fe60400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.690+0000 7fe5ff7fe700 1 -- 172.21.15.37:0/104091169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60400cbd0 con 0x7fe6081034c0 2024-05-09T01:04:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.690+0000 7fe5ff7fe700 1 -- 172.21.15.37:0/104091169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe60400cd70 con 0x7fe6081034c0 2024-05-09T01:04:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.690+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60819ffd0 con 0x7fe6081034c0 2024-05-09T01:04:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.690+0000 7fe5ff7fe700 1 -- 172.21.15.37:0/104091169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604018680 con 0x7fe6081034c0 2024-05-09T01:04:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.690+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6081a78f0 con 0x7fe6081034c0 2024-05-09T01:04:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.693+0000 7fe5ff7fe700 1 -- 172.21.15.37:0/104091169 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe604018820 con 0x7fe6081034c0 2024-05-09T01:04:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.693+0000 7fe5ff7fe700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5f40b2900 0x7fe5f40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.693+0000 7fe61f04cb80 1 Processor -- start 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.693+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5f40b2900 0x7fe5f40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe5ff7fe700 1 -- 172.21.15.37:0/104091169 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe6040e2560 con 0x7fe6081034c0 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe61f04cb80 1 -- start start 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cc44160 0x55734ccdbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccdc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734cce0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55734cbf9ff0 con 0x55734cc44160 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55734cb987f0 con 0x55734cb5a4a0 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55734cbf5fb0 con 0x55734cce0400 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5f40b2900 0x7fe5f40b4e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8000c00 tx=0x7fe5f801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cc44160 0x55734ccdbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cc44160 0x55734ccdbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39338/0 (socket says 172.21.15.37:39338) 2024-05-09T01:04:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3787899484 learned_addr learned my addr 172.21.15.37:0/3787899484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60ebd3700 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734cce0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccdc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3787899484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 msgr2=0x55734cce0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.694+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734cce0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3787899484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 msgr2=0x55734ccdc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccdc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3787899484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734cb90370 con 0x55734cc44160 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccdc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cc44160 0x55734ccdbd50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c5b0 tx=0x7fe6040b23f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6378512f54ea12 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe5fcff9700 1 -- 172.21.15.37:0/3787899484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040adf30 con 0x55734cc44160 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe5fcff9700 1 -- 172.21.15.37:0/3787899484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6040b29e0 con 0x55734cc44160 2024-05-09T01:04:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.695+0000 7fe5fcff9700 1 -- 172.21.15.37:0/3787899484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040a9de0 con 0x55734cc44160 2024-05-09T01:04:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3787899484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cc44160 msgr2=0x55734ccdbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cc44160 0x55734ccdbd50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c5b0 tx=0x7fe6040b23f0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3787899484 shutdown_connections 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734cce0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cc44160 0x55734ccdbd50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3787899484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccdc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3787899484 >> 172.21.15.37:0/3787899484 conn(0x55734cbba6a0 msgr2=0x55734ccd2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3787899484 shutdown_connections 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3787899484 wait complete. 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.696+0000 7fe61f04cb80 1 -- start start 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 1 Processor -- start 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734cce5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cce0400 0x55734cce61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55734ca75ba0 con 0x55734cb5a4a0 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55734cbb4150 con 0x55734cce0400 2024-05-09T01:04:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55734cce1150 con 0x55734cc44160 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe61f04cb80 10 client.0 _ll_register_callbacks cb 0x55734ca6b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39342/0 (socket says 172.21.15.37:39342) 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3638165275 learned_addr learned my addr 172.21.15.37:0/3638165275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734cce5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60ebd3700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cce0400 0x55734cce61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 msgr2=0x55734cce5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734cce5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3638165275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cce0400 msgr2=0x55734cce61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cce0400 0x55734cce61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3638165275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55734ca75490 con 0x55734cb5a4a0 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.697+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734cce5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce5750 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe6040e2430 tx=0x7fe6040a5b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37ba07c44df30d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:57.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe5f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/3638165275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040c2070 con 0x55734cb5a4a0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/3638165275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe6040a9ff0 con 0x55734cb5a4a0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6040b29e0 con 0x55734cb5a4a0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/3638165275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe6040b2550 con 0x55734cb5a4a0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 10 client.15699 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55734ccf2f10 con 0x55734cb5a4a0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/3638165275 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6040b29e0 con 0x55734cb5a4a0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/3638165275 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe6040a5580 con 0x55734cb5a4a0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 10 client.15699 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 10 client.15699 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 20 client.15699 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734ccf53e0 0x55734ccf7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 4 client.15699 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.698+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55734cc079d0 con 0x55734ccf53e0 2024-05-09T01:04:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.699+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734ccf53e0 0x55734ccf7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.699+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734ccf53e0 0x55734ccf7800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6149df746cb49f91 server_cookie=f8b39453c8d3ad86 in_seq=0 out_seq=0 2024-05-09T01:04:57.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.699+0000 7fe5f1ffb700 10 client.15699 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:04:57.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.700+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/3638165275 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55734cc079d0 con 0x55734ccf53e0 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.700+0000 7fe5f1ffb700 10 client.15699 handle_command_reply: tid=0 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.700+0000 7fe61f04cb80 1 client.15699 shutdown 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.700+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 msgr2=0x55734cce5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.700+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce5750 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe6040e2430 tx=0x7fe6040a5b70 comp rx=0 tx=0).stop 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.700+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 shutdown_connections 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.700+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734ccf53e0 0x55734ccf7800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cce0400 0x55734cce61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce5750 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3638165275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734cce5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 >> 172.21.15.37:0/3638165275 conn(0x55734cbba6a0 msgr2=0x55734ccd21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe5f1ffb700 0 client.15699 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 shutdown_connections 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3638165275 wait complete. 2024-05-09T01:04:57.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.701+0000 7fe61f04cb80 20 client.15699 trim_cache size 0 max 16384 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 Processor -- start 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 -- start start 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cc44160 0x55734cce4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734ccf15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081ac980 con 0x55734cb5a4a0 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081ae5b0 con 0x55734cc44160 2024-05-09T01:04:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081ad050 con 0x55734cce0400 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe60e3d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39352/0 (socket says 172.21.15.37:39352) 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3325036336 learned_addr learned my addr 172.21.15.37:0/3325036336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe60ebd3700 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734ccf15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.716+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cc44160 0x55734cce4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3325036336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 msgr2=0x55734ccf15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734ccf15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3325036336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cc44160 msgr2=0x55734cce4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cc44160 0x55734cce4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe60e3d2700 1 -- 172.21.15.37:0/3325036336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55734ccd3390 con 0x55734cb5a4a0 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce6010 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c5b0 tx=0x7fe60401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916c1cfc5c17f74 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe5f3fff700 1 -- 172.21.15.37:0/3325036336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040c2070 con 0x55734cb5a4a0 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe5f3fff700 1 -- 172.21.15.37:0/3325036336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6040a9ff0 con 0x55734cb5a4a0 2024-05-09T01:04:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.717+0000 7fe5f3fff700 1 -- 172.21.15.37:0/3325036336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040a54f0 con 0x55734cb5a4a0 2024-05-09T01:04:57.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3325036336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 msgr2=0x55734cce6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce6010 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c5b0 tx=0x7fe60401f000 comp rx=0 tx=0).stop 2024-05-09T01:04:57.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3325036336 shutdown_connections 2024-05-09T01:04:57.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cce0400 0x55734ccf15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cb5a4a0 0x55734cce6010 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/3325036336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cc44160 0x55734cce4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3325036336 >> 172.21.15.37:0/3325036336 conn(0x55734cbba6a0 msgr2=0x55734cce4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3325036336 shutdown_connections 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 -- 172.21.15.37:0/3325036336 wait complete. 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 -- start start 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.718+0000 7fe61f04cb80 1 Processor -- start 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccf73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734ccf7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe61f04cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cce0400 0x55734cd5d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081ade20 con 0x55734cce0400 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081ad750 con 0x55734cb5a4a0 2024-05-09T01:04:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe61f04cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081aa960 con 0x55734cc44160 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe61f04cb80 10 client.0 _ll_register_callbacks cb 0x55734ca6b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cce0400 0x55734cd5d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cce0400 0x55734cd5d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39356/0 (socket says 172.21.15.37:39356) 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 -- 172.21.15.37:0/1469384562 learned_addr learned my addr 172.21.15.37:0/1469384562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60dbd1700 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734ccf7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccf73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 -- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 msgr2=0x55734ccf7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734ccf7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 -- 172.21.15.37:0/1469384562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 msgr2=0x55734ccf73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccf73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 -- 172.21.15.37:0/1469384562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55734ccf81e0 con 0x55734cce0400 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe60ebd3700 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cce0400 0x55734cd5d920 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe6000078c0 tx=0x7fe600007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6663e4efb7086d00 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.719+0000 7fe5f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/1469384562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60001c030 con 0x55734cce0400 2024-05-09T01:04:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6040a9ff0 con 0x55734cce0400 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/1469384562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe600012040 con 0x55734cce0400 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/1469384562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fe600015700 con 0x55734cce0400 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 10 client.15705 fetch_fsmap learned FSMap version 32 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55734cd5efa0 con 0x55734cce0400 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/1469384562 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6040a9ff0 con 0x55734cce0400 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/1469384562 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fe600018a60 con 0x55734cce0400 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 10 client.15705 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 10 client.15705 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 20 client.15705 populate_metadata read hostname 'smithi037' 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734cd5f710 0x55734cd61b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 4 client.15705 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55734cc01a70 con 0x55734cd5f710 2024-05-09T01:04:57.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.720+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734cd5f710 0x55734cd61b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe5f1ffb700 10 client.15705 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe60e3d2700 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734cd5f710 0x55734cd61b30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=34325d9c5c76dd94 server_cookie=fcaf1b66a5a941b in_seq=0 out_seq=0 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe5f1ffb700 1 -- 172.21.15.37:0/1469384562 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55734cc01a70 con 0x55734cd5f710 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe5f1ffb700 10 client.15705 handle_command_reply: tid=0 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 client.15705 shutdown 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cce0400 msgr2=0x55734cd5d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cce0400 0x55734cd5d920 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe6000078c0 tx=0x7fe600007bd0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 shutdown_connections 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55734cd5f710 0x55734cd61b30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55734cce0400 0x55734cd5d920 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe5f1ffb700 0 client.15705 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55734cb5a4a0 0x55734ccf73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 --2- 172.21.15.37:0/1469384562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734cc44160 0x55734ccf7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 >> 172.21.15.37:0/1469384562 conn(0x55734cbba6a0 msgr2=0x55734ccdf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 shutdown_connections 2024-05-09T01:04:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 1 -- 172.21.15.37:0/1469384562 wait complete. 2024-05-09T01:04:57.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.721+0000 7fe61f04cb80 20 client.15705 trim_cache size 0 max 16384 2024-05-09T01:04:57.728 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:04:57.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5f40b2900 msgr2=0x7fe5f40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5f40b2900 0x7fe5f40b4e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8000c00 tx=0x7fe5f801a040 comp rx=0 tx=0).stop 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6081034c0 msgr2=0x7fe60819ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6081034c0 0x7fe60819ae10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe60400e9a0 tx=0x7fe60400ed60 comp rx=0 tx=0).stop 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 shutdown_connections 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5f40b2900 0x7fe5f40b4e10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe608108740 0x7fe60819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6081034c0 0x7fe60819ae10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 --2- 172.21.15.37:0/104091169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe608107df0 0x7fe60819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 >> 172.21.15.37:0/104091169 conn(0x7fe6080fedc0 msgr2=0x7fe60806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 shutdown_connections 2024-05-09T01:04:57.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:04:57.722+0000 7fe610636700 1 -- 172.21.15.37:0/104091169 wait complete. 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.243+0000 7ff191ffb640 1 -- 172.21.15.37:0/1999117096 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56359f1ad240 con 0x56359ee7c4d0 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.243+0000 7ff191ffb640 10 client.15687 handle_command_reply: tid=0 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.243+0000 7ff1b71e1740 1 client.15687 shutdown 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 msgr2=0x56359f250750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f250750 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff1980a6de0 tx=0x7ff1980e8060 comp rx=0 tx=0).stop 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 shutdown_connections 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56359ee7c4d0 0x56359f2c3440 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359ee91300 0x56359f251680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56359ee742f0 0x56359f250750 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 --2- 172.21.15.37:0/1999117096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56359ee5bd80 0x56359f250210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 >> 172.21.15.37:0/1999117096 conn(0x56359f245f20 msgr2=0x56359f24ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff191ffb640 0 client.15687 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 shutdown_connections 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 1 -- 172.21.15.37:0/1999117096 wait complete. 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.244+0000 7ff1b71e1740 20 client.15687 trim_cache size 0 max 16384 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:04:58.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff1940b2860 msgr2=0x7ff1940b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff1940b2860 0x7ff1940b4d70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff1a402aa00 tx=0x7ff1a4000bc0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8104eb0 msgr2=0x7ff1a819caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8104eb0 0x7ff1a819caf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff19800e9f0 tx=0x7ff19800eeb0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 shutdown_connections 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff1940b2860 0x7ff1940b4d70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1a8109bb0 0x7ff1a81a3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a8104eb0 0x7ff1a819caf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 --2- 172.21.15.37:0/2147927262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1a8103c70 0x7ff1a819c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:04:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.245+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 >> 172.21.15.37:0/2147927262 conn(0x7ff1a80fee60 msgr2=0x7ff1a80ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:04:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.246+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 shutdown_connections 2024-05-09T01:04:58.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:04:58.246+0000 7ff1b0334640 1 -- 172.21.15.37:0/2147927262 wait complete. 2024-05-09T01:04:58.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:04:58 smithi136 ceph-mon[34110]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 46 MiB/s wr, 1.10k op/s 2024-05-09T01:04:58.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:04:58 smithi037 ceph-mon[30122]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 46 MiB/s wr, 1.10k op/s 2024-05-09T01:04:58.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:04:58 smithi151 ceph-mon[34780]: pgmap v480: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 46 MiB/s wr, 1.10k op/s 2024-05-09T01:04:58.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:04:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 160.0 s, 1592.3 tps, lat 132.323 ms stddev 956.387 2024-05-09T01:05:00.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:00 smithi136 ceph-mon[34110]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 965 op/s 2024-05-09T01:05:00.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:00 smithi037 ceph-mon[30122]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 965 op/s 2024-05-09T01:05:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:00 smithi151 ceph-mon[34780]: pgmap v481: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 40 MiB/s wr, 965 op/s 2024-05-09T01:05:00.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.890+0000 7f1384ed5700 1 -- 172.21.15.37:0/229247892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f138010a990 msgr2=0x7f138010ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.890+0000 7f1384ed5700 1 --2- 172.21.15.37:0/229247892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f138010a990 0x7f138010ada0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1374009990 tx=0x7f1374009ca0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.891+0000 7f1384ed5700 1 -- 172.21.15.37:0/229247892 shutdown_connections 2024-05-09T01:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.891+0000 7f1384ed5700 1 --2- 172.21.15.37:0/229247892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010b2e0 0x7f1380117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.891+0000 7f1384ed5700 1 --2- 172.21.15.37:0/229247892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1380110970 0x7f1380110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.891+0000 7f1384ed5700 1 --2- 172.21.15.37:0/229247892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f138010a990 0x7f138010ada0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.891+0000 7f1384ed5700 1 -- 172.21.15.37:0/229247892 >> 172.21.15.37:0/229247892 conn(0x7f1380077c80 msgr2=0x7f13800780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.891+0000 7f1384ed5700 1 -- 172.21.15.37:0/229247892 shutdown_connections 2024-05-09T01:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.891+0000 7f1384ed5700 1 -- 172.21.15.37:0/229247892 wait complete. 2024-05-09T01:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.892+0000 7f1384ed5700 1 Processor -- start 2024-05-09T01:05:00.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.892+0000 7f1384ed5700 1 -- start start 2024-05-09T01:05:00.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f1384ed5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010a990 0x7f13801a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f1384ed5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f138010b2e0 0x7f13801a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f137e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010a990 0x7f13801a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f137e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010a990 0x7f13801a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46216/0 (socket says 172.21.15.37:46216) 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f137e59c700 1 -- 172.21.15.37:0/1066750221 learned_addr learned my addr 172.21.15.37:0/1066750221 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f1384ed5700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1380110970 0x7f13801a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f137dd9b700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f138010b2e0 0x7f13801a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f138011abb0 con 0x7f1380110970 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f138011aa30 con 0x7f138010b2e0 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.894+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f138011ad30 con 0x7f138010a990 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.895+0000 7f137e59c700 1 -- 172.21.15.37:0/1066750221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f138010b2e0 msgr2=0x7f13801a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.895+0000 7f137e59c700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f138010b2e0 0x7f13801a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.895+0000 7f137e59c700 1 -- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1380110970 msgr2=0x7f13801a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.895+0000 7f137e59c700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1380110970 0x7f13801a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.895+0000 7f137e59c700 1 -- 172.21.15.37:0/1066750221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13801a63d0 con 0x7f138010a990 2024-05-09T01:05:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.895+0000 7f137e59c700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010a990 0x7f13801a1500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f137000e970 tx=0x7f137000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.897+0000 7f136f7fe700 1 -- 172.21.15.37:0/1066750221 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137000cb50 con 0x7f138010a990 2024-05-09T01:05:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.897+0000 7f136f7fe700 1 -- 172.21.15.37:0/1066750221 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f137000ccf0 con 0x7f138010a990 2024-05-09T01:05:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.897+0000 7f136f7fe700 1 -- 172.21.15.37:0/1066750221 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13700055d0 con 0x7f138010a990 2024-05-09T01:05:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.897+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13801a66c0 con 0x7f138010a990 2024-05-09T01:05:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.897+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13801adfe0 con 0x7f138010a990 2024-05-09T01:05:00.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.903+0000 7f13938ebb80 1 Processor -- start 2024-05-09T01:05:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.903+0000 7f13938ebb80 1 -- start start 2024-05-09T01:05:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.903+0000 7f136f7fe700 1 -- 172.21.15.37:0/1066750221 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1370021440 con 0x7f138010a990 2024-05-09T01:05:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff25071160 0x55ff2510a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff24f874a0 0x55ff2510aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25104ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f13938ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff25026ff0 con 0x55ff251046a0 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f13938ebb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ff24fc57f0 con 0x55ff25071160 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f13938ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ff25022fb0 con 0x55ff24f874a0 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25104ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25104ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39380/0 (socket says 172.21.15.37:39380) 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 -- 172.21.15.37:0/2848278793 learned_addr learned my addr 172.21.15.37:0/2848278793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137ed9d700 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff25071160 0x55ff2510a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 -- 172.21.15.37:0/2848278793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff24f874a0 msgr2=0x55ff2510aa30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff24f874a0 0x55ff2510aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 -- 172.21.15.37:0/2848278793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff25071160 msgr2=0x55ff2510a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff25071160 0x55ff2510a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 -- 172.21.15.37:0/2848278793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff24fbd370 con 0x55ff251046a0 2024-05-09T01:05:00.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.904+0000 7f137dd9b700 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25104ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1374009990 tx=0x7f1374005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d983402689c7ae3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:00.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.905+0000 7f136cff9700 1 -- 172.21.15.37:0/2848278793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374005630 con 0x55ff251046a0 2024-05-09T01:05:00.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.905+0000 7f136cff9700 1 -- 172.21.15.37:0/2848278793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13740095d0 con 0x55ff251046a0 2024-05-09T01:05:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.905+0000 7f136cff9700 1 -- 172.21.15.37:0/2848278793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374003dc0 con 0x55ff251046a0 2024-05-09T01:05:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.905+0000 7f136f7fe700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f13680b29c0 0x7f13680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.906+0000 7f136f7fe700 1 -- 172.21.15.37:0/1066750221 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f13700e2410 con 0x7f138010a990 2024-05-09T01:05:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.906+0000 7f137ed9d700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f13680b29c0 0x7f13680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f13938ebb80 1 -- 172.21.15.37:0/2848278793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 msgr2=0x55ff25104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25104ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1374009990 tx=0x7f1374005ad0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f137ed9d700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f13680b29c0 0x7f13680b4ed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f137800f560 tx=0x7f137800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f13938ebb80 1 -- 172.21.15.37:0/2848278793 shutdown_connections 2024-05-09T01:05:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25104ad0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff25071160 0x55ff2510a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2848278793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff24f874a0 0x55ff2510aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.907+0000 7f13938ebb80 1 -- 172.21.15.37:0/2848278793 >> 172.21.15.37:0/2848278793 conn(0x55ff24fe76a0 msgr2=0x55ff250ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:00.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.908+0000 7f13938ebb80 1 -- 172.21.15.37:0/2848278793 shutdown_connections 2024-05-09T01:05:00.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.908+0000 7f13938ebb80 1 -- 172.21.15.37:0/2848278793 wait complete. 2024-05-09T01:05:00.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.908+0000 7f13938ebb80 1 -- start start 2024-05-09T01:05:00.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.908+0000 7f13938ebb80 1 Processor -- start 2024-05-09T01:05:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.909+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2510e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.909+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2510e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff2510ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2510e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2510e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44142/0 (socket says 172.21.15.37:44142) 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2510e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff24ea2ba0 con 0x55ff251046a0 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137e59c700 1 -- 172.21.15.37:0/3906765361 learned_addr learned my addr 172.21.15.37:0/3906765361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ff24fe1150 con 0x55ff24f874a0 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ff251111d0 con 0x55ff25071160 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f13938ebb80 10 client.0 _ll_register_callbacks cb 0x55ff24e986c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137ed9d700 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff2510ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137dd9b700 1 -- 172.21.15.37:0/3906765361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 msgr2=0x55ff2510e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137dd9b700 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2510e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137dd9b700 1 -- 172.21.15.37:0/3906765361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 msgr2=0x55ff2510ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137dd9b700 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff2510ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.910+0000 7f137dd9b700 1 -- 172.21.15.37:0/3906765361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff24ea2490 con 0x55ff25071160 2024-05-09T01:05:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f137dd9b700 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2510e740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f137400b2e0 tx=0x7f1374005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9927b83418c043ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:00.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f1365ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f1365ffb700 1 -- 172.21.15.37:0/3906765361 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374027040 con 0x55ff25071160 2024-05-09T01:05:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13740095d0 con 0x55ff25071160 2024-05-09T01:05:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f1365ffb700 1 -- 172.21.15.37:0/3906765361 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1374004d90 con 0x55ff25071160 2024-05-09T01:05:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f1365ffb700 1 -- 172.21.15.37:0/3906765361 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f137400b7f0 con 0x55ff25071160 2024-05-09T01:05:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f13938ebb80 10 client.25477 fetch_fsmap learned FSMap version 32 2024-05-09T01:05:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ff2511b9b0 con 0x55ff25071160 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.911+0000 7f1365ffb700 1 -- 172.21.15.37:0/3906765361 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13740095d0 con 0x55ff25071160 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.912+0000 7f1365ffb700 1 -- 172.21.15.37:0/3906765361 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f137402a070 con 0x55ff25071160 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.912+0000 7f13938ebb80 10 client.25477 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.912+0000 7f13938ebb80 10 client.25477 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.912+0000 7f13938ebb80 20 client.25477 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.912+0000 7f13938ebb80 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff251202a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.912+0000 7f13938ebb80 4 client.25477 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.912+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff250349d0 con 0x55ff2511de80 2024-05-09T01:05:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.913+0000 7f137e59c700 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff251202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.914+0000 7f137e59c700 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff251202a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=63b87bd53ab3791a server_cookie=32d932d3d7cd6eb in_seq=0 out_seq=0 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.914+0000 7f1365ffb700 10 client.25477 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f1365ffb700 1 -- 172.21.15.37:0/3906765361 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ff250349d0 con 0x55ff2511de80 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f1365ffb700 10 client.25477 handle_command_reply: tid=0 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 client.25477 shutdown 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 msgr2=0x55ff2510e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2510e740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f137400b2e0 tx=0x7f1374005760 comp rx=0 tx=0).stop 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 shutdown_connections 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff2510ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff251202a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f1365ffb700 0 client.25477 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2510e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 --2- 172.21.15.37:0/3906765361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2510e740 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 >> 172.21.15.37:0/3906765361 conn(0x55ff24fe76a0 msgr2=0x55ff250ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:00.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 shutdown_connections 2024-05-09T01:05:00.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 1 -- 172.21.15.37:0/3906765361 wait complete. 2024-05-09T01:05:00.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.915+0000 7f13938ebb80 20 client.25477 trim_cache size 0 max 16384 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.942+0000 7f13938ebb80 1 Processor -- start 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.942+0000 7f13938ebb80 1 -- start start 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff24f874a0 0x55ff251040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2511a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff251046a0 0x55ff2510f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f13938ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13801b5040 con 0x55ff24f874a0 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f13938ebb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13801b6c70 con 0x55ff251046a0 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f13938ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f13801b5710 con 0x55ff25071160 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff24f874a0 0x55ff251040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff251046a0 0x55ff2510f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff24f874a0 0x55ff251040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39396/0 (socket says 172.21.15.37:39396) 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137e59c700 1 -- 172.21.15.37:0/2778753060 learned_addr learned my addr 172.21.15.37:0/2778753060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:00.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137dd9b700 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2511a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137ed9d700 1 -- 172.21.15.37:0/2778753060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 msgr2=0x55ff2511a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137ed9d700 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2511a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137ed9d700 1 -- 172.21.15.37:0/2778753060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff24f874a0 msgr2=0x55ff251040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137ed9d700 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff24f874a0 0x55ff251040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137ed9d700 1 -- 172.21.15.37:0/2778753060 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff25111000 con 0x55ff251046a0 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.943+0000 7f137e59c700 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff24f874a0 0x55ff251040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.944+0000 7f137ed9d700 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff251046a0 0x55ff2510f8b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f137800fcb0 tx=0x7f1378014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6719816d5a9be281 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.944+0000 7f1367fff700 1 -- 172.21.15.37:0/2778753060 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378026070 con 0x55ff251046a0 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.944+0000 7f1367fff700 1 -- 172.21.15.37:0/2778753060 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f137801b030 con 0x55ff251046a0 2024-05-09T01:05:00.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.944+0000 7f1367fff700 1 -- 172.21.15.37:0/2778753060 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378017440 con 0x55ff251046a0 2024-05-09T01:05:00.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.945+0000 7f13938ebb80 1 -- 172.21.15.37:0/2778753060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff251046a0 msgr2=0x55ff2510f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.945+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff251046a0 0x55ff2510f8b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f137800fcb0 tx=0x7f1378014000 comp rx=0 tx=0).stop 2024-05-09T01:05:00.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.945+0000 7f13938ebb80 1 -- 172.21.15.37:0/2778753060 shutdown_connections 2024-05-09T01:05:00.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.945+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff251046a0 0x55ff2510f8b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.945+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff24f874a0 0x55ff251040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.945+0000 7f13938ebb80 1 --2- 172.21.15.37:0/2778753060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff2511a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.945+0000 7f13938ebb80 1 -- 172.21.15.37:0/2778753060 >> 172.21.15.37:0/2778753060 conn(0x55ff24fe76a0 msgr2=0x55ff25108470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:00.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.957+0000 7f13938ebb80 1 -- 172.21.15.37:0/2778753060 shutdown_connections 2024-05-09T01:05:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.957+0000 7f13938ebb80 1 -- 172.21.15.37:0/2778753060 wait complete. 2024-05-09T01:05:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.958+0000 7f13938ebb80 1 -- start start 2024-05-09T01:05:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.958+0000 7f13938ebb80 1 Processor -- start 2024-05-09T01:05:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.959+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2511ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.961+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff251204e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.961+0000 7f13938ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25120a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.962+0000 7f13938ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13801b64e0 con 0x55ff251046a0 2024-05-09T01:05:00.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.962+0000 7f13938ebb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13801b5e10 con 0x55ff24f874a0 2024-05-09T01:05:00.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.962+0000 7f13938ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f13801b3020 con 0x55ff25071160 2024-05-09T01:05:00.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.962+0000 7f13938ebb80 10 client.0 _ll_register_callbacks cb 0x55ff24e986c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:00.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.967+0000 7f137e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2511ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.967+0000 7f137e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2511ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44154/0 (socket says 172.21.15.37:44154) 2024-05-09T01:05:00.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.967+0000 7f137e59c700 1 -- 172.21.15.37:0/4010757860 learned_addr learned my addr 172.21.15.37:0/4010757860 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:00.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.967+0000 7f137ed9d700 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.968+0000 7f137dd9b700 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff251204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.968+0000 7f137ed9d700 1 -- 172.21.15.37:0/4010757860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 msgr2=0x55ff251204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.968+0000 7f137ed9d700 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff251204e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.968+0000 7f137ed9d700 1 -- 172.21.15.37:0/4010757860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 msgr2=0x55ff2511ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.968+0000 7f137ed9d700 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2511ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.968+0000 7f137ed9d700 1 -- 172.21.15.37:0/4010757860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff25186470 con 0x55ff251046a0 2024-05-09T01:05:00.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.969+0000 7f137ed9d700 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25120a20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f137800fcb0 tx=0x7f1378004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5562bd04357c717 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:00.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.969+0000 7f1365ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:05:00.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.969+0000 7f1365ffb700 1 -- 172.21.15.37:0/4010757860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378038060 con 0x55ff251046a0 2024-05-09T01:05:00.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.969+0000 7f1365ffb700 1 -- 172.21.15.37:0/4010757860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1378003f10 con 0x55ff251046a0 2024-05-09T01:05:00.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.970+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f137801b030 con 0x55ff251046a0 2024-05-09T01:05:00.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.970+0000 7f1365ffb700 1 -- 172.21.15.37:0/4010757860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1378026040 con 0x55ff251046a0 2024-05-09T01:05:00.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.974+0000 7f13938ebb80 10 client.15720 fetch_fsmap learned FSMap version 32 2024-05-09T01:05:00.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.974+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ff251876b0 con 0x55ff251046a0 2024-05-09T01:05:00.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.976+0000 7f1365ffb700 1 -- 172.21.15.37:0/4010757860 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13780178f0 con 0x55ff251046a0 2024-05-09T01:05:00.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.976+0000 7f1365ffb700 1 -- 172.21.15.37:0/4010757860 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f1378032030 con 0x55ff251046a0 2024-05-09T01:05:00.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.976+0000 7f13938ebb80 10 client.15720 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:05:00.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.976+0000 7f13938ebb80 10 client.15720 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:05:00.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.976+0000 7f13938ebb80 20 client.15720 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:00.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.976+0000 7f13938ebb80 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff25189c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:00.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.976+0000 7f13938ebb80 4 client.15720 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:05:00.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.977+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f137801b030 con 0x55ff2511de80 2024-05-09T01:05:00.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.977+0000 7f137e59c700 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff25189c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:00.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.980+0000 7f137e59c700 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff25189c40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4cbfa9e3c357db95 server_cookie=d871915fae3b9442 in_seq=0 out_seq=0 2024-05-09T01:05:00.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.980+0000 7f1365ffb700 10 client.15720 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:05:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.981+0000 7f1365ffb700 1 -- 172.21.15.37:0/4010757860 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f137801b030 con 0x55ff2511de80 2024-05-09T01:05:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.981+0000 7f1365ffb700 10 client.15720 handle_command_reply: tid=0 2024-05-09T01:05:00.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.981+0000 7f13938ebb80 1 client.15720 shutdown 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 msgr2=0x55ff25120a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25120a20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f137800fcb0 tx=0x7f1378004210 comp rx=0 tx=0).stop 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 shutdown_connections 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff251046a0 0x55ff25120a20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55ff2511de80 0x55ff25189c40 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ff24f874a0 0x55ff2511ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 --2- 172.21.15.37:0/4010757860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff25071160 0x55ff251204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 >> 172.21.15.37:0/4010757860 conn(0x55ff24fe76a0 msgr2=0x55ff25108470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.984+0000 7f1365ffb700 0 client.15720 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:05:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.985+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 shutdown_connections 2024-05-09T01:05:00.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.985+0000 7f13938ebb80 1 -- 172.21.15.37:0/4010757860 wait complete. 2024-05-09T01:05:00.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.985+0000 7f13938ebb80 20 client.15720 trim_cache size 0 max 16384 2024-05-09T01:05:00.987 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.986+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f13680b29c0 msgr2=0x7f13680b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.986+0000 7f1384ed5700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f13680b29c0 0x7f13680b4ed0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f137800f560 tx=0x7f137800b040 comp rx=0 tx=0).stop 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.986+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010a990 msgr2=0x7f13801a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.986+0000 7f1384ed5700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010a990 0x7f13801a1500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f137000e970 tx=0x7f137000ec80 comp rx=0 tx=0).stop 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.986+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 shutdown_connections 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.986+0000 7f1384ed5700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f13680b29c0 0x7f13680b4ed0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.986+0000 7f1384ed5700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1380110970 0x7f13801a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.987+0000 7f1384ed5700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f138010a990 0x7f13801a1500 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.987+0000 7f1384ed5700 1 --2- 172.21.15.37:0/1066750221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f138010b2e0 0x7f13801a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:00.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.987+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 >> 172.21.15.37:0/1066750221 conn(0x7f1380077c80 msgr2=0x7f138007b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.987+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 shutdown_connections 2024-05-09T01:05:00.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:00.987+0000 7f1384ed5700 1 -- 172.21.15.37:0/1066750221 wait complete. 2024-05-09T01:05:01.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:05:02.199 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:02.337 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:02 smithi037 ceph-mon[30122]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 943 op/s 2024-05-09T01:05:02.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:02 smithi136 ceph-mon[34110]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 943 op/s 2024-05-09T01:05:02.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:02 smithi151 ceph-mon[34780]: pgmap v482: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 39 MiB/s wr, 943 op/s 2024-05-09T01:05:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.229+0000 7f3a4ec60700 1 -- 172.21.15.37:0/3528961594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a48110970 msgr2=0x7f3a48110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.229+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/3528961594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a48110970 0x7f3a48110d80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000b0a0 tx=0x7f3a4000b3b0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.230+0000 7f3a4ec60700 1 -- 172.21.15.37:0/3528961594 shutdown_connections 2024-05-09T01:05:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.230+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/3528961594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a4810b2e0 0x7f3a48117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.230+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/3528961594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a48110970 0x7f3a48110d80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.230+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/3528961594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a4810a990 0x7f3a4810ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.230+0000 7f3a4ec60700 1 -- 172.21.15.37:0/3528961594 >> 172.21.15.37:0/3528961594 conn(0x7f3a48077c80 msgr2=0x7f3a480780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.230+0000 7f3a4ec60700 1 -- 172.21.15.37:0/3528961594 shutdown_connections 2024-05-09T01:05:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.230+0000 7f3a4ec60700 1 -- 172.21.15.37:0/3528961594 wait complete. 2024-05-09T01:05:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 Processor -- start 2024-05-09T01:05:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 -- start start 2024-05-09T01:05:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a4810a990 0x7f3a481a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4810b2e0 0x7f3a481a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a48110970 0x7f3a481a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4811aac0 con 0x7f3a4810b2e0 2024-05-09T01:05:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4811a940 con 0x7f3a4810a990 2024-05-09T01:05:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.231+0000 7f3a4ec60700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4811ac40 con 0x7f3a48110970 2024-05-09T01:05:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4d1fd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a48110970 0x7f3a481a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a4810a990 0x7f3a481a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4d1fd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a48110970 0x7f3a481a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54394/0 (socket says 172.21.15.37:54394) 2024-05-09T01:05:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a4810a990 0x7f3a481a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36804/0 (socket says 172.21.15.37:36804) 2024-05-09T01:05:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4c9fc700 1 -- 172.21.15.37:0/2059502924 learned_addr learned my addr 172.21.15.37:0/2059502924 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4d1fd700 1 -- 172.21.15.37:0/2059502924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a4810a990 msgr2=0x7f3a481a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a4810a990 0x7f3a481a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4d1fd700 1 -- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4810b2e0 msgr2=0x7f3a481a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4810b2e0 0x7f3a481a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.233+0000 7f3a4d1fd700 1 -- 172.21.15.37:0/2059502924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a481a6390 con 0x7f3a48110970 2024-05-09T01:05:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.234+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a48110970 0x7f3a481a5cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800e970 tx=0x7f3a3800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.234+0000 7f3a45ffb700 1 -- 172.21.15.37:0/2059502924 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800cbd0 con 0x7f3a48110970 2024-05-09T01:05:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.234+0000 7f3a45ffb700 1 -- 172.21.15.37:0/2059502924 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a3800ee60 con 0x7f3a48110970 2024-05-09T01:05:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.234+0000 7f3a45ffb700 1 -- 172.21.15.37:0/2059502924 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38005020 con 0x7f3a48110970 2024-05-09T01:05:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.234+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a481a6680 con 0x7f3a48110970 2024-05-09T01:05:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.235+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a481adfa0 con 0x7f3a48110970 2024-05-09T01:05:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.239+0000 7f3a45ffb700 1 -- 172.21.15.37:0/2059502924 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3a380051c0 con 0x7f3a48110970 2024-05-09T01:05:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 Processor -- start 2024-05-09T01:05:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 -- start start 2024-05-09T01:05:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a45ffb700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3a300b2900 0x7f3a300b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a47fff700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3a300b2900 0x7f3a300b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a45ffb700 1 -- 172.21.15.37:0/2059502924 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3a380e1ef0 con 0x7f3a48110970 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc8178ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556dc809aff0 con 0x556dc81786a0 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556dc80397f0 con 0x556dc80e5160 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.240+0000 7f3a5d676b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556dc8096fb0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.241+0000 7f3a4d1fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc8178ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.241+0000 7f3a4d1fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc8178ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56466/0 (socket says 172.21.15.37:56466) 2024-05-09T01:05:04.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.241+0000 7f3a4d1fd700 1 -- 172.21.15.37:0/471615751 learned_addr learned my addr 172.21.15.37:0/471615751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.241+0000 7f3a47fff700 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.242+0000 7f3a4d1fd700 1 -- 172.21.15.37:0/471615751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 msgr2=0x556dc817ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.242+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.242+0000 7f3a4d1fd700 1 -- 172.21.15.37:0/471615751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 msgr2=0x556dc817e4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.242+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817e4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.242+0000 7f3a4d1fd700 1 -- 172.21.15.37:0/471615751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc8031370 con 0x556dc81786a0 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.242+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc8178ad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a380a5630 tx=0x7f3a38004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba149a6e5504e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:04.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.243+0000 7f3a2effd700 1 -- 172.21.15.37:0/471615751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3801c070 con 0x556dc81786a0 2024-05-09T01:05:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.243+0000 7f3a2effd700 1 -- 172.21.15.37:0/471615751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a380a95b0 con 0x556dc81786a0 2024-05-09T01:05:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.243+0000 7f3a2effd700 1 -- 172.21.15.37:0/471615751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3801c070 con 0x556dc81786a0 2024-05-09T01:05:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.244+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471615751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 msgr2=0x556dc8178ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.244+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc8178ad0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a380a5630 tx=0x7f3a38004a10 comp rx=0 tx=0).stop 2024-05-09T01:05:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.245+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471615751 shutdown_connections 2024-05-09T01:05:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.245+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc8178ad0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.245+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.245+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471615751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.245+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471615751 >> 172.21.15.37:0/471615751 conn(0x556dc805b6a0 msgr2=0x556dc8173400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.246+0000 7f3a47fff700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3a300b2900 0x7f3a300b4e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c005950 tx=0x7f3a3c0146f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.246+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471615751 shutdown_connections 2024-05-09T01:05:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.246+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471615751 wait complete. 2024-05-09T01:05:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.246+0000 7f3a5d676b80 1 -- start start 2024-05-09T01:05:04.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.247+0000 7f3a5d676b80 1 Processor -- start 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.247+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc7ffb4a0 0x556dc81821b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.247+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc81826f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.247+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc81786a0 0x556dc8182c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.247+0000 7f3a5d676b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556dc7f16ba0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a5d676b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556dc8055150 con 0x556dc80e5160 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a5d676b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556dc81851d0 con 0x556dc81786a0 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc7ffb4a0 0x556dc81821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc7ffb4a0 0x556dc81821b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56472/0 (socket says 172.21.15.37:56472) 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a4c9fc700 1 -- 172.21.15.37:0/471998863 learned_addr learned my addr 172.21.15.37:0/471998863 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a47fff700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc81826f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc81786a0 0x556dc8182c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a5d676b80 10 client.0 _ll_register_callbacks cb 0x556dc7f0c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:04.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a47fff700 1 -- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc81786a0 msgr2=0x556dc8182c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a47fff700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc81786a0 0x556dc8182c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a47fff700 1 -- 172.21.15.37:0/471998863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc7ffb4a0 msgr2=0x556dc81821b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a47fff700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc7ffb4a0 0x556dc81821b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a47fff700 1 -- 172.21.15.37:0/471998863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc7f16490 con 0x556dc80e5160 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.248+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc81786a0 0x556dc8182c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.249+0000 7f3a47fff700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc81826f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x556dc8174ed0 tx=0x7f3a3c005d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985e4a5fcb530796 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.249+0000 7f3a27fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.250+0000 7f3a27fff700 1 -- 172.21.15.37:0/471998863 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c022070 con 0x556dc80e5160 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.250+0000 7f3a27fff700 1 -- 172.21.15.37:0/471998863 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3a3c01e840 con 0x556dc80e5160 2024-05-09T01:05:04.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.250+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a380a95b0 con 0x556dc80e5160 2024-05-09T01:05:04.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.250+0000 7f3a27fff700 1 -- 172.21.15.37:0/471998863 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a3c02c050 con 0x556dc80e5160 2024-05-09T01:05:04.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.251+0000 7f3a5d676b80 10 client.25469 fetch_fsmap learned FSMap version 32 2024-05-09T01:05:04.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.251+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556dc818fb30 con 0x556dc80e5160 2024-05-09T01:05:04.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.251+0000 7f3a27fff700 1 -- 172.21.15.37:0/471998863 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a380a95b0 con 0x556dc80e5160 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.251+0000 7f3a27fff700 1 -- 172.21.15.37:0/471998863 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f3a3c027ab0 con 0x556dc80e5160 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.252+0000 7f3a5d676b80 10 client.25469 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.252+0000 7f3a5d676b80 10 client.25469 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.252+0000 7f3a5d676b80 20 client.25469 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.252+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc8192170 0x556dc81945d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.252+0000 7f3a5d676b80 4 client.25469 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.252+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dc80a89d0 con 0x556dc8192170 2024-05-09T01:05:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.252+0000 7f3a4c9fc700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc8192170 0x556dc81945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.253+0000 7f3a4c9fc700 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc8192170 0x556dc81945d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e497e9e0d09b3902 server_cookie=d87b3e38247a5461 in_seq=0 out_seq=0 2024-05-09T01:05:04.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.253+0000 7f3a27fff700 10 client.25469 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:05:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.254+0000 7f3a27fff700 1 -- 172.21.15.37:0/471998863 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556dc80a89d0 con 0x556dc8192170 2024-05-09T01:05:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.254+0000 7f3a27fff700 10 client.25469 handle_command_reply: tid=0 2024-05-09T01:05:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.254+0000 7f3a5d676b80 1 client.25469 shutdown 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.255+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 msgr2=0x556dc81826f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.255+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc81826f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x556dc8174ed0 tx=0x7f3a3c005d20 comp rx=0 tx=0).stop 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 shutdown_connections 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc8192170 0x556dc81945d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc81786a0 0x556dc8182c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc7ffb4a0 0x556dc81821b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/471998863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc81826f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 >> 172.21.15.37:0/471998863 conn(0x556dc805b6a0 msgr2=0x556dc81731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a27fff700 0 client.25469 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:05:04.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 shutdown_connections 2024-05-09T01:05:04.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 1 -- 172.21.15.37:0/471998863 wait complete. 2024-05-09T01:05:04.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.256+0000 7f3a5d676b80 20 client.25469 trim_cache size 0 max 16384 2024-05-09T01:05:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.282+0000 7f3a5d676b80 1 Processor -- start 2024-05-09T01:05:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a5d676b80 1 -- start start 2024-05-09T01:05:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc817d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54428/0 (socket says 172.21.15.37:54428) 2024-05-09T01:05:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a4c9fc700 1 -- 172.21.15.37:0/3095798913 learned_addr learned my addr 172.21.15.37:0/3095798913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481b52f0 con 0x556dc81786a0 2024-05-09T01:05:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a47fff700 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481b6f20 con 0x556dc80e5160 2024-05-09T01:05:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.283+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481b59c0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.284+0000 7f3a47fff700 1 -- 172.21.15.37:0/3095798913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 msgr2=0x556dc817e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.284+0000 7f3a47fff700 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.284+0000 7f3a47fff700 1 -- 172.21.15.37:0/3095798913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 msgr2=0x556dc817d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.284+0000 7f3a47fff700 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc817d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.284+0000 7f3a47fff700 1 -- 172.21.15.37:0/3095798913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc81814f0 con 0x556dc80e5160 2024-05-09T01:05:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.284+0000 7f3a4c9fc700 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.284+0000 7f3a47fff700 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817c7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c005d90 tx=0x7f3a3c0058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b4a1db7f0a74e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.285+0000 7f3a2e7fc700 1 -- 172.21.15.37:0/3095798913 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c035070 con 0x556dc80e5160 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.285+0000 7f3a2e7fc700 1 -- 172.21.15.37:0/3095798913 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a3c011d40 con 0x556dc80e5160 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.285+0000 7f3a2e7fc700 1 -- 172.21.15.37:0/3095798913 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c022040 con 0x556dc80e5160 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 msgr2=0x556dc817c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817c7c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c005d90 tx=0x7f3a3c0058e0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 shutdown_connections 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc81786a0 0x556dc817d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc817e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/3095798913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc80e5160 0x556dc817c7c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 >> 172.21.15.37:0/3095798913 conn(0x556dc805b6a0 msgr2=0x556dc817d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 shutdown_connections 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.286+0000 7f3a5d676b80 1 -- 172.21.15.37:0/3095798913 wait complete. 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.287+0000 7f3a5d676b80 1 -- start start 2024-05-09T01:05:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.287+0000 7f3a5d676b80 1 Processor -- start 2024-05-09T01:05:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc81991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc80e5160 0x556dc81996e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc81991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a4c9fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc81991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54436/0 (socket says 172.21.15.37:54436) 2024-05-09T01:05:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a5d676b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc81786a0 0x556dc8189330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a4c9fc700 1 -- 172.21.15.37:0/1186152757 learned_addr learned my addr 172.21.15.37:0/1186152757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a47fff700 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc80e5160 0x556dc81996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481b6790 con 0x556dc80e5160 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481b60c0 con 0x556dc81786a0 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a481b32b0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a5d676b80 10 client.0 _ll_register_callbacks cb 0x556dc7f0c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.288+0000 7f3a4d1fd700 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc81786a0 0x556dc8189330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.289+0000 7f3a4c9fc700 1 -- 172.21.15.37:0/1186152757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc81786a0 msgr2=0x556dc8189330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.289+0000 7f3a4c9fc700 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc81786a0 0x556dc8189330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.289+0000 7f3a4c9fc700 1 -- 172.21.15.37:0/1186152757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc80e5160 msgr2=0x556dc81996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.289+0000 7f3a4c9fc700 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc80e5160 0x556dc81996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.289+0000 7f3a4c9fc700 1 -- 172.21.15.37:0/1186152757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc81898a0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.289+0000 7f3a4c9fc700 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc81991a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x556dc8181a30 tx=0x7f3a4000bc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64081af81026628a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:04.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a27fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:04.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a27fff700 1 -- 172.21.15.37:0/1186152757 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40003a00 con 0x556dc7ffb4a0 2024-05-09T01:05:04.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a27fff700 1 -- 172.21.15.37:0/1186152757 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3a40003ba0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a3c011d40 con 0x556dc7ffb4a0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a27fff700 1 -- 172.21.15.37:0/1186152757 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3a40003da0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a5d676b80 10 client.25501 fetch_fsmap learned FSMap version 32 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x556dc818aae0 con 0x556dc7ffb4a0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.290+0000 7f3a27fff700 1 -- 172.21.15.37:0/1186152757 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a3c011d40 con 0x556dc7ffb4a0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a27fff700 1 -- 172.21.15.37:0/1186152757 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7f3a40026030 con 0x556dc7ffb4a0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a5d676b80 10 client.25501 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a5d676b80 10 client.25501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a5d676b80 20 client.25501 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc81fcaf0 0x556dc81fef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a5d676b80 4 client.25501 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556dc80a2a70 con 0x556dc81fcaf0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.291+0000 7f3a47fff700 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc81fcaf0 0x556dc81fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.292+0000 7f3a27fff700 10 client.25501 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.292+0000 7f3a47fff700 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc81fcaf0 0x556dc81fef10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af1486899cca0106 server_cookie=bb2ea050f786979b in_seq=0 out_seq=0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.292+0000 7f3a27fff700 1 -- 172.21.15.37:0/1186152757 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556dc80a2a70 con 0x556dc81fcaf0 2024-05-09T01:05:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.292+0000 7f3a27fff700 10 client.25501 handle_command_reply: tid=0 2024-05-09T01:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.292+0000 7f3a5d676b80 1 client.25501 shutdown 2024-05-09T01:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 msgr2=0x556dc81991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc81991a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x556dc8181a30 tx=0x7f3a4000bc40 comp rx=0 tx=0).stop 2024-05-09T01:05:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 shutdown_connections 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556dc81fcaf0 0x556dc81fef10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a27fff700 0 client.25501 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556dc81786a0 0x556dc8189330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dc7ffb4a0 0x556dc81991a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 --2- 172.21.15.37:0/1186152757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556dc80e5160 0x556dc81996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 >> 172.21.15.37:0/1186152757 conn(0x556dc805b6a0 msgr2=0x556dc817be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 shutdown_connections 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 1 -- 172.21.15.37:0/1186152757 wait complete. 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.294+0000 7f3a5d676b80 20 client.25501 trim_cache size 0 max 16384 2024-05-09T01:05:04.296 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3a300b2900 msgr2=0x7f3a300b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3a300b2900 0x7f3a300b4e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c005950 tx=0x7f3a3c0146f0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a48110970 msgr2=0x7f3a481a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a48110970 0x7f3a481a5cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800e970 tx=0x7f3a3800ec80 comp rx=0 tx=0).stop 2024-05-09T01:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 shutdown_connections 2024-05-09T01:05:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3a300b2900 0x7f3a300b4e10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a48110970 0x7f3a481a5cf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a4810a990 0x7f3a481a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 --2- 172.21.15.37:0/2059502924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a4810b2e0 0x7f3a481a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 >> 172.21.15.37:0/2059502924 conn(0x7f3a48077c80 msgr2=0x7f3a4807bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.295+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 shutdown_connections 2024-05-09T01:05:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:04.297+0000 7f3a4ec60700 1 -- 172.21.15.37:0/2059502924 wait complete. 2024-05-09T01:05:04.316 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:04 smithi037 ceph-mon[30122]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 37 MiB/s wr, 888 op/s 2024-05-09T01:05:04.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:04 smithi136 ceph-mon[34110]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 37 MiB/s wr, 888 op/s 2024-05-09T01:05:04.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:04 smithi151 ceph-mon[34780]: pgmap v483: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 37 MiB/s wr, 888 op/s 2024-05-09T01:05:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 165.0 s, 3667.8 tps, lat 27.232 ms stddev 29.081 2024-05-09T01:05:05.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:05:05.717 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:06.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:06 smithi037 ceph-mon[30122]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 703 op/s 2024-05-09T01:05:06.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:06 smithi136 ceph-mon[34110]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 703 op/s 2024-05-09T01:05:06.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:06 smithi151 ceph-mon[34780]: pgmap v484: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 703 op/s 2024-05-09T01:05:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 -- 172.21.15.37:0/4161448671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a810a3e0 msgr2=0x7fd6a810a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/4161448671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a810a3e0 0x7fd6a810a7f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009990 tx=0x7fd6a4009ca0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 -- 172.21.15.37:0/4161448671 shutdown_connections 2024-05-09T01:05:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/4161448671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a8103130 0x7fd6a8111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/4161448671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a810a3e0 0x7fd6a810a7f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/4161448671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a81027e0 0x7fd6a8102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 -- 172.21.15.37:0/4161448671 >> 172.21.15.37:0/4161448671 conn(0x7fd6a80fe6f0 msgr2=0x7fd6a8100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 -- 172.21.15.37:0/4161448671 shutdown_connections 2024-05-09T01:05:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.834+0000 7fd6b07a6700 1 -- 172.21.15.37:0/4161448671 wait complete. 2024-05-09T01:05:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.835+0000 7fd6b07a6700 1 Processor -- start 2024-05-09T01:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.836+0000 7fd6b07a6700 1 -- start start 2024-05-09T01:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.836+0000 7fd6b07a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a81027e0 0x7fd6a8105560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.836+0000 7fd6b07a6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a8103130 0x7fd6a81039c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.836+0000 7fd6b07a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a810a3e0 0x7fd6a8103fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.836+0000 7fd6b07a6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81144d0 con 0x7fd6a81027e0 2024-05-09T01:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.836+0000 7fd6b07a6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8114350 con 0x7fd6a8103130 2024-05-09T01:05:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.836+0000 7fd6b07a6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8114650 con 0x7fd6a810a3e0 2024-05-09T01:05:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a8103130 0x7fd6a81039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a8103130 0x7fd6a81039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36872/0 (socket says 172.21.15.37:36872) 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 -- 172.21.15.37:0/1678868276 learned_addr learned my addr 172.21.15.37:0/1678868276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6aed43700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a810a3e0 0x7fd6a8103fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6ae542700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a81027e0 0x7fd6a8105560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 -- 172.21.15.37:0/1678868276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a810a3e0 msgr2=0x7fd6a8103fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a810a3e0 0x7fd6a8103fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 -- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a81027e0 msgr2=0x7fd6a8105560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a81027e0 0x7fd6a8105560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 -- 172.21.15.37:0/1678868276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a81047d0 con 0x7fd6a8103130 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd6add41700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a8103130 0x7fd6a81039c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e970 tx=0x7fd69800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.837+0000 7fd69f7fe700 1 -- 172.21.15.37:0/1678868276 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698004a30 con 0x7fd6a8103130 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.838+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a81ad930 con 0x7fd6a8103130 2024-05-09T01:05:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.838+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a81ade90 con 0x7fd6a8103130 2024-05-09T01:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.838+0000 7fd69f7fe700 1 -- 172.21.15.37:0/1678868276 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd69800cc90 con 0x7fd6a8103130 2024-05-09T01:05:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.838+0000 7fd69f7fe700 1 -- 172.21.15.37:0/1678868276 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698005610 con 0x7fd6a8103130 2024-05-09T01:05:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.844+0000 7fd69f7fe700 1 -- 172.21.15.37:0/1678868276 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd69800c7e0 con 0x7fd6a8103130 2024-05-09T01:05:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.845+0000 7fd69f7fe700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6940b2980 0x7fd6940b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.845+0000 7fd6ae542700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6940b2980 0x7fd6940b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.845+0000 7fd69f7fe700 1 -- 172.21.15.37:0/1678868276 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd6980e24f0 con 0x7fd6a8103130 2024-05-09T01:05:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.846+0000 7fd6bf1bcb80 1 Processor -- start 2024-05-09T01:05:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.846+0000 7fd6ae542700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6940b2980 0x7fd6940b4e90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400b2e0 tx=0x7fd6a4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.846+0000 7fd6bf1bcb80 1 -- start start 2024-05-09T01:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 0x55b77d12a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77cfa74a0 0x55b77d12a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 0x55b77d124810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b77d0470a0 con 0x55b77d124400 2024-05-09T01:05:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b77cfec9a0 con 0x55b77cfa74a0 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b77d043060 con 0x55b77d021d00 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77cfa74a0 0x55b77d12a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77cfa74a0 0x55b77d12a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36874/0 (socket says 172.21.15.37:36874) 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.847+0000 7fd6add41700 1 -- 172.21.15.37:0/332388742 learned_addr learned my addr 172.21.15.37:0/332388742 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.848+0000 7fd6add41700 1 -- 172.21.15.37:0/332388742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 msgr2=0x55b77d12a240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.848+0000 7fd6add41700 1 --2- 172.21.15.37:0/332388742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 0x55b77d12a240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.848+0000 7fd6add41700 1 -- 172.21.15.37:0/332388742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 msgr2=0x55b77d124810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.848+0000 7fd6add41700 1 --2- 172.21.15.37:0/332388742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 0x55b77d124810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.848+0000 7fd6add41700 1 -- 172.21.15.37:0/332388742 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b77cfdd500 con 0x55b77cfa74a0 2024-05-09T01:05:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.849+0000 7fd6add41700 1 --2- 172.21.15.37:0/332388742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77cfa74a0 0x55b77d12a780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6980a9810 tx=0x7fd69800efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb2a1b76263c60ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.849+0000 7fd69cff9700 1 -- 172.21.15.37:0/332388742 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6980a52a0 con 0x55b77cfa74a0 2024-05-09T01:05:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.849+0000 7fd69cff9700 1 -- 172.21.15.37:0/332388742 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6980b22c0 con 0x55b77cfa74a0 2024-05-09T01:05:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.850+0000 7fd69cff9700 1 -- 172.21.15.37:0/332388742 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6980adec0 con 0x55b77cfa74a0 2024-05-09T01:05:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/332388742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77cfa74a0 msgr2=0x55b77d12a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/332388742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77cfa74a0 0x55b77d12a780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd6980a9810 tx=0x7fd69800efd0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/332388742 shutdown_connections 2024-05-09T01:05:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/332388742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 0x55b77d124810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/332388742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 0x55b77d12a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/332388742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77cfa74a0 0x55b77d12a780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/332388742 >> 172.21.15.37:0/332388742 conn(0x55b77cfaaf70 msgr2=0x55b77d11f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.851+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/332388742 shutdown_connections 2024-05-09T01:05:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.852+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/332388742 wait complete. 2024-05-09T01:05:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.852+0000 7fd6bf1bcb80 1 -- start start 2024-05-09T01:05:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.853+0000 7fd6bf1bcb80 1 Processor -- start 2024-05-09T01:05:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.853+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.853+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d12e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.853+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d124400 0x55b77d12eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b77d1250a0 con 0x55b77cfa74a0 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b77cfe1b20 con 0x55b77d021d00 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b77d125220 con 0x55b77d124400 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6ae542700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d12e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6bf1bcb80 10 client.0 _ll_register_callbacks cb 0x55b77ceb86c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d12e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36890/0 (socket says 172.21.15.37:36890) 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 -- 172.21.15.37:0/2584871355 learned_addr learned my addr 172.21.15.37:0/2584871355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6aed43700 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d124400 0x55b77d12eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 -- 172.21.15.37:0/2584871355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d124400 msgr2=0x55b77d12eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d124400 0x55b77d12eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 -- 172.21.15.37:0/2584871355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 msgr2=0x55b77d12e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.854+0000 7fd6add41700 1 -- 172.21.15.37:0/2584871355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b77cec2490 con 0x55b77d021d00 2024-05-09T01:05:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.855+0000 7fd6add41700 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d12e5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6980ac040 tx=0x7fd698004e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef03279bb431ccc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.855+0000 7fd691ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.856+0000 7fd691ffb700 1 -- 172.21.15.37:0/2584871355 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69800ce40 con 0x55b77d021d00 2024-05-09T01:05:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.856+0000 7fd691ffb700 1 -- 172.21.15.37:0/2584871355 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd6980a9f80 con 0x55b77d021d00 2024-05-09T01:05:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.857+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6980b22c0 con 0x55b77d021d00 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.857+0000 7fd691ffb700 1 -- 172.21.15.37:0/2584871355 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd6980aa210 con 0x55b77d021d00 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.857+0000 7fd6bf1bcb80 10 client.25487 fetch_fsmap learned FSMap version 32 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.857+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b77d13b960 con 0x55b77d021d00 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.857+0000 7fd691ffb700 1 -- 172.21.15.37:0/2584871355 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6980b22c0 con 0x55b77d021d00 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd691ffb700 1 -- 172.21.15.37:0/2584871355 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fd6980a5480 con 0x55b77d021d00 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd6bf1bcb80 10 client.25487 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd6bf1bcb80 10 client.25487 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd6bf1bcb80 20 client.25487 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd6bf1bcb80 4 client.25487 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b77d054a80 con 0x55b77d13de30 2024-05-09T01:05:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.858+0000 7fd6ae542700 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.859+0000 7fd691ffb700 10 client.25487 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:05:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.859+0000 7fd6ae542700 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d140250 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b680206251b4dbd server_cookie=9e70854be0beda08 in_seq=0 out_seq=0 2024-05-09T01:05:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.859+0000 7fd691ffb700 1 -- 172.21.15.37:0/2584871355 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b77d054a80 con 0x55b77d13de30 2024-05-09T01:05:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.859+0000 7fd691ffb700 10 client.25487 handle_command_reply: tid=0 2024-05-09T01:05:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.860+0000 7fd6bf1bcb80 1 client.25487 shutdown 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.860+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 msgr2=0x55b77d12e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.860+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d12e5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6980ac040 tx=0x7fd698004e90 comp rx=0 tx=0).stop 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.860+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 shutdown_connections 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.860+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d124400 0x55b77d12eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.860+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d140250 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.861+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.861+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2584871355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d12e5c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.861+0000 7fd691ffb700 0 client.25487 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:05:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.861+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 >> 172.21.15.37:0/2584871355 conn(0x55b77cfaaf70 msgr2=0x55b77d118ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.861+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 shutdown_connections 2024-05-09T01:05:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.861+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2584871355 wait complete. 2024-05-09T01:05:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.861+0000 7fd6bf1bcb80 20 client.25487 trim_cache size 0 max 16384 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.886+0000 7fd6bf1bcb80 1 Processor -- start 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.886+0000 7fd6bf1bcb80 1 -- start start 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 0x55b77d1298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d124400 0x55b77d13a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81b51e0 con 0x55b77cfa74a0 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81b6e10 con 0x55b77d124400 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81b58b0 con 0x55b77d021d00 2024-05-09T01:05:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56536/0 (socket says 172.21.15.37:56536) 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 -- 172.21.15.37:0/4209547376 learned_addr learned my addr 172.21.15.37:0/4209547376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6aed43700 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d124400 0x55b77d13a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6add41700 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 0x55b77d1298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 -- 172.21.15.37:0/4209547376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 msgr2=0x55b77d1298a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 0x55b77d1298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 -- 172.21.15.37:0/4209547376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d124400 msgr2=0x55b77d13a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d124400 0x55b77d13a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6ae542700 1 -- 172.21.15.37:0/4209547376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b77d12de50 con 0x55b77cfa74a0 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.887+0000 7fd6aed43700 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d124400 0x55b77d13a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.888+0000 7fd6ae542700 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12bcf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009990 tx=0x7fd6a401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8933792d7fe5a7ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.888+0000 7fd693fff700 1 -- 172.21.15.37:0/4209547376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4039070 con 0x55b77cfa74a0 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.888+0000 7fd693fff700 1 -- 172.21.15.37:0/4209547376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6a4003d30 con 0x55b77cfa74a0 2024-05-09T01:05:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.888+0000 7fd693fff700 1 -- 172.21.15.37:0/4209547376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400fcb0 con 0x55b77cfa74a0 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.889+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/4209547376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 msgr2=0x55b77d12bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.889+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12bcf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009990 tx=0x7fd6a401e000 comp rx=0 tx=0).stop 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/4209547376 shutdown_connections 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d124400 0x55b77d13a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77cfa74a0 0x55b77d12bcf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/4209547376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77d021d00 0x55b77d1298a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/4209547376 >> 172.21.15.37:0/4209547376 conn(0x55b77cfaaf70 msgr2=0x55b77d129190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/4209547376 shutdown_connections 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/4209547376 wait complete. 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.890+0000 7fd6bf1bcb80 1 -- start start 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 1 Processor -- start 2024-05-09T01:05:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77cfa74a0 0x55b77d140250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d140790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 0x55b77d140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81b6680 con 0x55b77d124400 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81b5fb0 con 0x55b77d021d00 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a81b31c0 con 0x55b77cfa74a0 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6add41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d140790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36900/0 (socket says 172.21.15.37:36900) 2024-05-09T01:05:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6add41700 1 -- 172.21.15.37:0/2203486032 learned_addr learned my addr 172.21.15.37:0/2203486032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6bf1bcb80 10 client.0 _ll_register_callbacks cb 0x55b77ceb86c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6ae542700 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77cfa74a0 0x55b77d140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.891+0000 7fd6aed43700 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 0x55b77d140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd6add41700 1 -- 172.21.15.37:0/2203486032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77cfa74a0 msgr2=0x55b77d140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd6add41700 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77cfa74a0 0x55b77d140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd6add41700 1 -- 172.21.15.37:0/2203486032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 msgr2=0x55b77d140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd6add41700 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 0x55b77d140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd6add41700 1 -- 172.21.15.37:0/2203486032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b77d1a63f0 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd6add41700 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d140790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd698005950 tx=0x7fd6980050b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cccc7abbd5f2b53 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd691ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd691ffb700 1 -- 172.21.15.37:0/2203486032 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69800ce40 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.892+0000 7fd691ffb700 1 -- 172.21.15.37:0/2203486032 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd6980a8d70 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.893+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6a4003d30 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.893+0000 7fd691ffb700 1 -- 172.21.15.37:0/2203486032 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fd6980a8850 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.893+0000 7fd6bf1bcb80 10 client.25493 fetch_fsmap learned FSMap version 32 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.893+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55b77d1a63f0 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd691ffb700 1 -- 172.21.15.37:0/2203486032 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6980b8030 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd691ffb700 1 -- 172.21.15.37:0/2203486032 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 32) ==== 8374+0+0 (secure 0 0 0) 0x7fd6980af050 con 0x55b77d021d00 2024-05-09T01:05:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd6bf1bcb80 10 client.25493 fetch_fsmap finished waiting for FSMap version 32 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd6bf1bcb80 10 client.25493 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd6bf1bcb80 20 client.25493 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d1a9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd6bf1bcb80 4 client.25493 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.894+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd6a4003d30 con 0x55b77d13de30 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.895+0000 7fd6ae542700 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d1a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.895+0000 7fd691ffb700 10 client.25493 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.895+0000 7fd6ae542700 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d1a9910 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc1224b3a609863 server_cookie=ba7ea92cb931ba7f in_seq=0 out_seq=0 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd691ffb700 1 -- 172.21.15.37:0/2203486032 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd6a4003d30 con 0x55b77d13de30 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd691ffb700 10 client.25493 handle_command_reply: tid=0 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 client.25493 shutdown 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 msgr2=0x55b77d140790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d140790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd698005950 tx=0x7fd6980050b0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 shutdown_connections 2024-05-09T01:05:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b77d13de30 0x55b77d1a9910 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b77d124400 0x55b77d140cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b77cfa74a0 0x55b77d140250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 --2- 172.21.15.37:0/2203486032 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b77d021d00 0x55b77d140790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd691ffb700 0 client.25493 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 >> 172.21.15.37:0/2203486032 conn(0x55b77cfaaf70 msgr2=0x55b77d12c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 shutdown_connections 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 1 -- 172.21.15.37:0/2203486032 wait complete. 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.896+0000 7fd6bf1bcb80 20 client.25493 trim_cache size 0 max 16384 2024-05-09T01:05:07.899 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.897+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6940b2980 msgr2=0x7fd6940b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.897+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6940b2980 0x7fd6940b4e90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400b2e0 tx=0x7fd6a4005fd0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.897+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a8103130 msgr2=0x7fd6a81039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.897+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a8103130 0x7fd6a81039c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e970 tx=0x7fd69800ec80 comp rx=0 tx=0).stop 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 shutdown_connections 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6940b2980 0x7fd6940b4e90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a810a3e0 0x7fd6a8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6a81027e0 0x7fd6a8105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 --2- 172.21.15.37:0/1678868276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6a8103130 0x7fd6a81039c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 >> 172.21.15.37:0/1678868276 conn(0x7fd6a80fe6f0 msgr2=0x7fd6a8100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 shutdown_connections 2024-05-09T01:05:07.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:07.898+0000 7fd6b07a6700 1 -- 172.21.15.37:0/1678868276 wait complete. 2024-05-09T01:05:08.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:08 smithi136 ceph-mon[34110]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 629 op/s 2024-05-09T01:05:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:08 smithi037 ceph-mon[30122]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 629 op/s 2024-05-09T01:05:08.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:08 smithi151 ceph-mon[34780]: pgmap v485: 97 pgs: 97 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 19 MiB/s wr, 629 op/s 2024-05-09T01:05:08.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:05:09.065 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:09.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:09 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:09.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:09 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:09.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:09 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 170.0 s, 3097.8 tps, lat 32.348 ms stddev 35.409 2024-05-09T01:05:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:10 smithi136 ceph-mon[34110]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 555 op/s 2024-05-09T01:05:10.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:10 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:10 smithi037 ceph-mon[30122]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 555 op/s 2024-05-09T01:05:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:10 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:10.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:10 smithi151 ceph-mon[34780]: pgmap v486: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 13 MiB/s wr, 555 op/s 2024-05-09T01:05:10.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:10 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.190+0000 7f21ea0c1700 1 -- 172.21.15.37:0/98438778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21e41034c0 msgr2=0x7f21e41038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.190+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/98438778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21e41034c0 0x7f21e41038d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009990 tx=0x7f21d4009ca0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.190+0000 7f21ea0c1700 1 -- 172.21.15.37:0/98438778 shutdown_connections 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.190+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/98438778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e4108740 0x7f21e406b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.190+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/98438778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21e41034c0 0x7f21e41038d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.190+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/98438778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 0x7f21e4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.190+0000 7f21ea0c1700 1 -- 172.21.15.37:0/98438778 >> 172.21.15.37:0/98438778 conn(0x7f21e40fedc0 msgr2=0x7f21e41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.191+0000 7f21ea0c1700 1 -- 172.21.15.37:0/98438778 shutdown_connections 2024-05-09T01:05:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.191+0000 7f21ea0c1700 1 -- 172.21.15.37:0/98438778 wait complete. 2024-05-09T01:05:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.192+0000 7f21ea0c1700 1 Processor -- start 2024-05-09T01:05:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.193+0000 7f21ea0c1700 1 -- start start 2024-05-09T01:05:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.193+0000 7f21ea0c1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21e41034c0 0x7f21e41a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.193+0000 7f21ea0c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 0x7f21e41aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.193+0000 7f21ea0c1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e4108740 0x7f21e41ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.193+0000 7f21ea0c1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21e4112430 con 0x7f21e4107df0 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.193+0000 7f21ea0c1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41122b0 con 0x7f21e41034c0 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.193+0000 7f21ea0c1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41125b0 con 0x7f21e4108740 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 0x7f21e41aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 0x7f21e41aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56556/0 (socket says 172.21.15.37:56556) 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 -- 172.21.15.37:0/3745868965 learned_addr learned my addr 172.21.15.37:0/3745868965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e3fff700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e4108740 0x7f21e41ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 -- 172.21.15.37:0/3745868965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e4108740 msgr2=0x7f21e41ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e4108740 0x7f21e41ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 -- 172.21.15.37:0/3745868965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21e41034c0 msgr2=0x7f21e41a9d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21e41034c0 0x7f21e41a9d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.194+0000 7f21e2ffd700 1 -- 172.21.15.37:0/3745868965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e41aec10 con 0x7f21e4107df0 2024-05-09T01:05:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.195+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 0x7f21e41aa2e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f21d800bfa0 tx=0x7f21d80094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.195+0000 7f21e0ff9700 1 -- 172.21.15.37:0/3745868965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8004830 con 0x7f21e4107df0 2024-05-09T01:05:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.195+0000 7f21e0ff9700 1 -- 172.21.15.37:0/3745868965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d8005020 con 0x7f21e4107df0 2024-05-09T01:05:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.195+0000 7f21e0ff9700 1 -- 172.21.15.37:0/3745868965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8011450 con 0x7f21e4107df0 2024-05-09T01:05:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.196+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e41aef00 con 0x7f21e4107df0 2024-05-09T01:05:11.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.196+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e41af390 con 0x7f21e4107df0 2024-05-09T01:05:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.202+0000 7f21e0ff9700 1 -- 172.21.15.37:0/3745868965 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f21d8019020 con 0x7f21e4107df0 2024-05-09T01:05:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.202+0000 7f21f8ad7b80 1 Processor -- start 2024-05-09T01:05:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.202+0000 7f21f8ad7b80 1 -- start start 2024-05-09T01:05:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.203+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b317240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.203+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b317780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.203+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b311400 0x564a7b311810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.203+0000 7f21f8ad7b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564a7b2340a0 con 0x564a7b1944a0 2024-05-09T01:05:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.203+0000 7f21f8ad7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564a7b1d99a0 con 0x564a7b20ed00 2024-05-09T01:05:11.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.203+0000 7f21f8ad7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564a7b230060 con 0x564a7b311400 2024-05-09T01:05:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.203+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b317240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.204+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b317240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36920/0 (socket says 172.21.15.37:36920) 2024-05-09T01:05:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.204+0000 7f21e3fff700 1 -- 172.21.15.37:0/3832429836 learned_addr learned my addr 172.21.15.37:0/3832429836 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.204+0000 7f21e0ff9700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f21cc0b2980 0x7f21cc0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.204+0000 7f21e0ff9700 1 -- 172.21.15.37:0/3745868965 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f21d80e20f0 con 0x7f21e4107df0 2024-05-09T01:05:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e3fff700 1 -- 172.21.15.37:0/3832429836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b311400 msgr2=0x564a7b311810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e37fe700 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b317780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b311400 0x564a7b311810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e3fff700 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b311400 0x564a7b311810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e3fff700 1 -- 172.21.15.37:0/3832429836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 msgr2=0x564a7b317780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e3fff700 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b317780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e3fff700 1 -- 172.21.15.37:0/3832429836 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b1ca500 con 0x564a7b20ed00 2024-05-09T01:05:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e37fe700 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b317780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b311400 0x564a7b311810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e3fff700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f21cc0b2980 0x7f21cc0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.205+0000 7f21e3fff700 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b317240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a5b0 tx=0x7f21dc00a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be9863e7932f69c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.206+0000 7f21c9ffb700 1 -- 172.21.15.37:0/3832429836 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc016b60 con 0x564a7b20ed00 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.206+0000 7f21c9ffb700 1 -- 172.21.15.37:0/3832429836 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21dc016d80 con 0x564a7b20ed00 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.206+0000 7f21c9ffb700 1 -- 172.21.15.37:0/3832429836 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc015840 con 0x564a7b20ed00 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/3832429836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 msgr2=0x564a7b317240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21e3fff700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f21cc0b2980 0x7f21cc0b4e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21dc01b000 tx=0x7f21dc015b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b317240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a5b0 tx=0x7f21dc00a8c0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/3832429836 shutdown_connections 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b311400 0x564a7b311810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b317240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/3832429836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b317780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.207+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/3832429836 >> 172.21.15.37:0/3832429836 conn(0x564a7b197f70 msgr2=0x564a7b30c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.208+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/3832429836 shutdown_connections 2024-05-09T01:05:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.208+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/3832429836 wait complete. 2024-05-09T01:05:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.208+0000 7f21f8ad7b80 1 -- start start 2024-05-09T01:05:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.209+0000 7f21f8ad7b80 1 Processor -- start 2024-05-09T01:05:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.209+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b31af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b20ed00 0x564a7b31b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b31af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b31af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54536/0 (socket says 172.21.15.37:54536) 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21e37fe700 1 -- 172.21.15.37:0/1474373204 learned_addr learned my addr 172.21.15.37:0/1474373204 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b20ed00 0x564a7b31b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564a7b312200 con 0x564a7b20ed00 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564a7b1ceb20 con 0x564a7b311400 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564a7b31e020 con 0x564a7b1944a0 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21f8ad7b80 10 client.0 _ll_register_callbacks cb 0x564a7b0a56c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.210+0000 7f21e3fff700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.211+0000 7f21e2ffd700 1 -- 172.21.15.37:0/1474373204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 msgr2=0x564a7b31af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.211+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b31af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.211+0000 7f21e2ffd700 1 -- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 msgr2=0x564a7b31b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.211+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.211+0000 7f21e2ffd700 1 -- 172.21.15.37:0/1474373204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7b0af490 con 0x564a7b20ed00 2024-05-09T01:05:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.211+0000 7f21e3fff700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.212+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b20ed00 0x564a7b31b4a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f21d8021000 tx=0x7f21d80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d22c52996f520c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.212+0000 7f21c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.212+0000 7f21c2ffd700 1 -- 172.21.15.37:0/1474373204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80c3060 con 0x564a7b20ed00 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.212+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21dc016d80 con 0x564a7b20ed00 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.213+0000 7f21c2ffd700 1 -- 172.21.15.37:0/1474373204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f21d80a9970 con 0x564a7b20ed00 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.213+0000 7f21c2ffd700 1 -- 172.21.15.37:0/1474373204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f21d80c8050 con 0x564a7b20ed00 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.213+0000 7f21f8ad7b80 10 client.15756 fetch_fsmap learned FSMap version 34 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.213+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564a7b328930 con 0x564a7b20ed00 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21c2ffd700 1 -- 172.21.15.37:0/1474373204 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21dc016d80 con 0x564a7b20ed00 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21c2ffd700 1 -- 172.21.15.37:0/1474373204 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f21d80b20e0 con 0x564a7b20ed00 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21f8ad7b80 10 client.15756 fetch_fsmap finished waiting for FSMap version 34 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21f8ad7b80 10 client.15756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21f8ad7b80 20 client.15756 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b32af10 0x564a7b32d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21f8ad7b80 4 client.15756 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a7b241a80 con 0x564a7b32af10 2024-05-09T01:05:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.214+0000 7f21e37fe700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b32af10 0x564a7b32d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.216+0000 7f21e37fe700 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b32af10 0x564a7b32d360 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=561a6f086a76d0e0 server_cookie=97567264fb88e56 in_seq=0 out_seq=0 2024-05-09T01:05:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.216+0000 7f21c2ffd700 10 client.15756 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21c2ffd700 1 -- 172.21.15.37:0/1474373204 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564a7b241a80 con 0x564a7b32af10 2024-05-09T01:05:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21c2ffd700 10 client.15756 handle_command_reply: tid=0 2024-05-09T01:05:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 client.15756 shutdown 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b20ed00 msgr2=0x564a7b31b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b20ed00 0x564a7b31b4a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f21d8021000 tx=0x7f21d80057b0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 shutdown_connections 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b32af10 0x564a7b32d360 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b31af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/1474373204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b20ed00 0x564a7b31b4a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 >> 172.21.15.37:0/1474373204 conn(0x564a7b197f70 msgr2=0x564a7b305ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21c2ffd700 0 client.15756 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 shutdown_connections 2024-05-09T01:05:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.217+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/1474373204 wait complete. 2024-05-09T01:05:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.218+0000 7f21f8ad7b80 20 client.15756 trim_cache size 0 max 16384 2024-05-09T01:05:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21f8ad7b80 1 Processor -- start 2024-05-09T01:05:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21f8ad7b80 1 -- start start 2024-05-09T01:05:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b316420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b30c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b311400 0x564a7b31b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b316420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b316420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54546/0 (socket says 172.21.15.37:54546) 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b30c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.244+0000 7f21e2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b30c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36928/0 (socket says 172.21.15.37:36928) 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e37fe700 1 -- 172.21.15.37:0/2900965405 learned_addr learned my addr 172.21.15.37:0/2900965405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41bd9a0 con 0x564a7b311400 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41bf5d0 con 0x564a7b20ed00 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41be070 con 0x564a7b1944a0 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e3fff700 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b311400 0x564a7b31b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e37fe700 1 -- 172.21.15.37:0/2900965405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 msgr2=0x564a7b30c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e37fe700 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b30c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e37fe700 1 -- 172.21.15.37:0/2900965405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b311400 msgr2=0x564a7b31b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e37fe700 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b311400 0x564a7b31b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e37fe700 1 -- 172.21.15.37:0/2900965405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7b316c40 con 0x564a7b1944a0 2024-05-09T01:05:11.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.245+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b30c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:11.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.246+0000 7f21e37fe700 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b316420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009ce0 tx=0x7f21d400b2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4f15e49311a4c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.246+0000 7f21c97fa700 1 -- 172.21.15.37:0/2900965405 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d40050d0 con 0x564a7b1944a0 2024-05-09T01:05:11.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.246+0000 7f21c97fa700 1 -- 172.21.15.37:0/2900965405 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d402b020 con 0x564a7b1944a0 2024-05-09T01:05:11.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.246+0000 7f21c97fa700 1 -- 172.21.15.37:0/2900965405 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4003d90 con 0x564a7b1944a0 2024-05-09T01:05:11.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.248+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 msgr2=0x564a7b316420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.248+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b316420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009ce0 tx=0x7f21d400b2a0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.248+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 shutdown_connections 2024-05-09T01:05:11.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.248+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b311400 0x564a7b31b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.248+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b1944a0 0x564a7b316420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.248+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/2900965405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b20ed00 0x564a7b30c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.248+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 >> 172.21.15.37:0/2900965405 conn(0x564a7b197f70 msgr2=0x564a7b319850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.249+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 shutdown_connections 2024-05-09T01:05:11.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.249+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/2900965405 wait complete. 2024-05-09T01:05:11.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.250+0000 7f21f8ad7b80 1 -- start start 2024-05-09T01:05:11.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.250+0000 7f21f8ad7b80 1 Processor -- start 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.251+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b323970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.251+0000 7f21f8ad7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b20ed00 0x564a7b31e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.251+0000 7f21e37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b323970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.251+0000 7f21e37fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b323970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56600/0 (socket says 172.21.15.37:56600) 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.251+0000 7f21e37fe700 1 -- 172.21.15.37:0/402846935 learned_addr learned my addr 172.21.15.37:0/402846935 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.251+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41bee70 con 0x564a7b1944a0 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21e3fff700 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41be770 con 0x564a7b311400 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21e2ffd700 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b20ed00 0x564a7b31e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41bb980 con 0x564a7b20ed00 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21e3fff700 1 -- 172.21.15.37:0/402846935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b20ed00 msgr2=0x564a7b31e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21e3fff700 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b20ed00 0x564a7b31e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21e3fff700 1 -- 172.21.15.37:0/402846935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 msgr2=0x564a7b323970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21e3fff700 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b323970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.252+0000 7f21e3fff700 1 -- 172.21.15.37:0/402846935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7b31f050 con 0x564a7b311400 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21f8ad7b80 10 client.0 _ll_register_callbacks cb 0x564a7b0a56c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21e3fff700 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31e8d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f21dc016f70 tx=0x7f21dc022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1540e5225a3d2f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21d402b020 con 0x564a7b311400 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21c2ffd700 10 client.25508 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21c2ffd700 1 -- 172.21.15.37:0/402846935 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc035020 con 0x564a7b311400 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21c2ffd700 1 -- 172.21.15.37:0/402846935 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f21dc016920 con 0x564a7b311400 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21c2ffd700 1 -- 172.21.15.37:0/402846935 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f21dc016b20 con 0x564a7b311400 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21f8ad7b80 10 client.25508 fetch_fsmap learned FSMap version 34 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.253+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=34}) -- 0x564a7b394560 con 0x564a7b311400 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21c2ffd700 1 -- 172.21.15.37:0/402846935 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f21dc01e4c0 con 0x564a7b311400 2024-05-09T01:05:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21f8ad7b80 10 client.25508 fetch_fsmap finished waiting for FSMap version 34 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21f8ad7b80 10 client.25508 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21f8ad7b80 20 client.25508 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b394ac0 0x564a7b396f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21f8ad7b80 4 client.25508 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a7b23bb20 con 0x564a7b394ac0 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.254+0000 7f21e37fe700 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b394ac0 0x564a7b396f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.256+0000 7f21e37fe700 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b394ac0 0x564a7b396f00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc2d5ce19bd990b server_cookie=997d6d9a0d59e580 in_seq=0 out_seq=0 2024-05-09T01:05:11.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.256+0000 7f21c2ffd700 10 client.25508 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21c2ffd700 1 -- 172.21.15.37:0/402846935 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a7b23bb20 con 0x564a7b394ac0 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21c2ffd700 10 client.25508 handle_command_reply: tid=0 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 client.25508 shutdown 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 msgr2=0x564a7b31e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31e8d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f21dc016f70 tx=0x7f21dc022040 comp rx=0 tx=0).stop 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 shutdown_connections 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564a7b394ac0 0x564a7b396f00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564a7b311400 0x564a7b31e8d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a7b1944a0 0x564a7b323970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 --2- 172.21.15.37:0/402846935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a7b20ed00 0x564a7b31e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 >> 172.21.15.37:0/402846935 conn(0x564a7b197f70 msgr2=0x564a7b315460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.257+0000 7f21c2ffd700 0 client.25508 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.259+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 shutdown_connections 2024-05-09T01:05:11.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.259+0000 7f21f8ad7b80 1 -- 172.21.15.37:0/402846935 wait complete. 2024-05-09T01:05:11.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.259+0000 7f21f8ad7b80 20 client.25508 trim_cache size 0 max 16384 2024-05-09T01:05:11.260 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:05:11.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f21cc0b2980 msgr2=0x7f21cc0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f21cc0b2980 0x7f21cc0b4e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f21dc01b000 tx=0x7f21dc015b70 comp rx=0 tx=0).stop 2024-05-09T01:05:11.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 msgr2=0x7f21e41aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 0x7f21e41aa2e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f21d800bfa0 tx=0x7f21d80094c0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 shutdown_connections 2024-05-09T01:05:11.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f21cc0b2980 0x7f21cc0b4e90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e4108740 0x7f21e41ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21e41034c0 0x7f21e41a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 --2- 172.21.15.37:0/3745868965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e4107df0 0x7f21e41aa2e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 >> 172.21.15.37:0/3745868965 conn(0x7f21e40fedc0 msgr2=0x7f21e4106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 shutdown_connections 2024-05-09T01:05:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:11.260+0000 7f21ea0c1700 1 -- 172.21.15.37:0/3745868965 wait complete. 2024-05-09T01:05:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.425+0000 7f82f1469640 1 -- 172.21.15.37:0/4184380913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec10b480 msgr2=0x7f82ec10b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.425+0000 7f82f1469640 1 --2- 172.21.15.37:0/4184380913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec10b480 0x7f82ec10b890 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009900 tx=0x7f82dc02a3f0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.425+0000 7f82f1469640 1 -- 172.21.15.37:0/4184380913 shutdown_connections 2024-05-09T01:05:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.425+0000 7f82f1469640 1 --2- 172.21.15.37:0/4184380913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ec1101a0 0x7f82ec1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.425+0000 7f82f1469640 1 --2- 172.21.15.37:0/4184380913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec10b480 0x7f82ec10b890 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009900 tx=0x7f82dc02a3f0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.425+0000 7f82f1469640 1 --2- 172.21.15.37:0/4184380913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 0x7f82ec10af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.425+0000 7f82f1469640 1 -- 172.21.15.37:0/4184380913 >> 172.21.15.37:0/4184380913 conn(0x7f82ec070670 msgr2=0x7f82ec072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.428+0000 7f82f1469640 1 -- 172.21.15.37:0/4184380913 shutdown_connections 2024-05-09T01:05:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.428+0000 7f82f1469640 1 -- 172.21.15.37:0/4184380913 wait complete. 2024-05-09T01:05:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 Processor -- start 2024-05-09T01:05:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 -- start start 2024-05-09T01:05:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 0x7f82ec1a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec1101a0 0x7f82ec1a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ec078f20 0x7f82ec07b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec11e6b0 con 0x7f82ec078f20 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec11e530 con 0x7f82ec1101a0 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.429+0000 7f82f1469640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec11e830 con 0x7f82ec10a550 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.430+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 0x7f82ec1a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.430+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 0x7f82ec1a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54558/0 (socket says 172.21.15.37:54558) 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.430+0000 7f82eaffd640 1 -- 172.21.15.37:0/1904492517 learned_addr learned my addr 172.21.15.37:0/1904492517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.431+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec1101a0 0x7f82ec1a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.432+0000 7f82eaffd640 1 -- 172.21.15.37:0/1904492517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec1101a0 msgr2=0x7f82ec1a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.432+0000 7f82eaffd640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec1101a0 0x7f82ec1a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.432+0000 7f82eaffd640 1 -- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ec078f20 msgr2=0x7f82ec07b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.432+0000 7f82eaffd640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ec078f20 0x7f82ec07b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.432+0000 7f82eaffd640 1 -- 172.21.15.37:0/1904492517 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ec07ba70 con 0x7f82ec10a550 2024-05-09T01:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.432+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec1101a0 0x7f82ec1a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.434+0000 7f82eaffd640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 0x7f82ec1a92f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f82e400ea80 tx=0x7f82e400ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.435+0000 7f82e3fff640 1 -- 172.21.15.37:0/1904492517 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e400ce40 con 0x7f82ec10a550 2024-05-09T01:05:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.435+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ec07bd60 con 0x7f82ec10a550 2024-05-09T01:05:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.435+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ec07c330 con 0x7f82ec10a550 2024-05-09T01:05:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.436+0000 7f82e3fff640 1 -- 172.21.15.37:0/1904492517 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82e4011920 con 0x7f82ec10a550 2024-05-09T01:05:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.436+0000 7f82e3fff640 1 -- 172.21.15.37:0/1904492517 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e401aa20 con 0x7f82ec10a550 2024-05-09T01:05:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.442+0000 7f82e3fff640 1 -- 172.21.15.37:0/1904492517 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f82e401ac60 con 0x7f82ec10a550 2024-05-09T01:05:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.444+0000 7f82e3fff640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d80b29f0 0x7f82d80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.445+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d80b29f0 0x7f82d80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.445+0000 7f82e3fff640 1 -- 172.21.15.37:0/1904492517 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82e40e2aa0 con 0x7f82ec10a550 2024-05-09T01:05:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.446+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d80b29f0 0x7f82d80b4f00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009850 tx=0x7f82dc031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.447+0000 7f82f83f4740 1 Processor -- start 2024-05-09T01:05:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.447+0000 7f82f83f4740 1 -- start start 2024-05-09T01:05:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 0x55c814b61500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b61a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b68980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82f83f4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c814ac57c0 con 0x55c8147bd1b0 2024-05-09T01:05:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82f83f4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c814a610e0 con 0x55c81479c4d0 2024-05-09T01:05:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82f83f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c814ac1780 con 0x55c8147942f0 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b68980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82ea7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b61a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b68980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36970/0 (socket says 172.21.15.37:36970) 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82eb7fe640 1 -- 172.21.15.37:0/3424865095 learned_addr learned my addr 172.21.15.37:0/3424865095 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.448+0000 7f82eaffd640 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 0x55c814b61500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3424865095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 msgr2=0x55c814b68980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b68980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3424865095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 msgr2=0x55c814b61500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 0x55c814b61500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3424865095 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c814a8a7c0 con 0x55c8147942f0 2024-05-09T01:05:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82eb7fe640 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b68980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b61a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f82dc008000 tx=0x7f82dc03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c27cb92a0ad8070 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82e17fa640 1 -- 172.21.15.37:0/3424865095 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc04d070 con 0x55c8147942f0 2024-05-09T01:05:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.449+0000 7f82e17fa640 1 -- 172.21.15.37:0/3424865095 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc004c10 con 0x55c8147942f0 2024-05-09T01:05:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.450+0000 7f82e17fa640 1 -- 172.21.15.37:0/3424865095 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc035040 con 0x55c8147942f0 2024-05-09T01:05:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.451+0000 7f82f83f4740 1 -- 172.21.15.37:0/3424865095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 msgr2=0x55c814b61a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.451+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b61a80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f82dc008000 tx=0x7f82dc03d000 comp rx=0 tx=0).stop 2024-05-09T01:05:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.451+0000 7f82f83f4740 1 -- 172.21.15.37:0/3424865095 shutdown_connections 2024-05-09T01:05:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.451+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b68980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.451+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b61a80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.451+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3424865095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 0x55c814b61500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.451+0000 7f82f83f4740 1 -- 172.21.15.37:0/3424865095 >> 172.21.15.37:0/3424865095 conn(0x55c8147b1300 msgr2=0x55c814b5ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.452+0000 7f82f83f4740 1 -- 172.21.15.37:0/3424865095 shutdown_connections 2024-05-09T01:05:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.452+0000 7f82f83f4740 1 -- 172.21.15.37:0/3424865095 wait complete. 2024-05-09T01:05:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.452+0000 7f82f83f4740 1 -- start start 2024-05-09T01:05:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.452+0000 7f82f83f4740 1 Processor -- start 2024-05-09T01:05:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.453+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b6b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.453+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b6b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.453+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 0x55c814b72650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.453+0000 7f82f83f4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c814b69370 con 0x55c8147bd1b0 2024-05-09T01:05:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.453+0000 7f82f83f4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c814a4c9c0 con 0x55c8147942f0 2024-05-09T01:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.453+0000 7f82f83f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c814b694f0 con 0x55c81479c4d0 2024-05-09T01:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.453+0000 7f82ea7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b6b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b6b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54586/0 (socket says 172.21.15.37:54586) 2024-05-09T01:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3349165675 learned_addr learned my addr 172.21.15.37:0/3349165675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82eaffd640 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b6b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82f83f4740 10 client.0 _ll_register_callbacks cb 0x55c814a79020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 msgr2=0x55c814b6b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b6b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3349165675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 msgr2=0x55c814b72650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 0x55c814b72650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3349165675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c814a731f0 con 0x55c81479c4d0 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b6b6f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0096c0 tx=0x7f82dc005130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9392b815bc9edb47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.454+0000 7f82d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.455+0000 7f82d27fc640 1 -- 172.21.15.37:0/3349165675 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc05a030 con 0x55c81479c4d0 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.455+0000 7f82d27fc640 1 -- 172.21.15.37:0/3349165675 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82dc003800 con 0x55c81479c4d0 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.455+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82dc004c10 con 0x55c81479c4d0 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.455+0000 7f82d27fc640 1 -- 172.21.15.37:0/3349165675 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f82dc065050 con 0x55c81479c4d0 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.455+0000 7f82f83f4740 10 client.25534 fetch_fsmap learned FSMap version 34 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.455+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c814828790 con 0x55c81479c4d0 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82d27fc640 1 -- 172.21.15.37:0/3349165675 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc004c10 con 0x55c81479c4d0 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82d27fc640 1 -- 172.21.15.37:0/3349165675 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f82dc052450 con 0x55c81479c4d0 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82f83f4740 10 client.25534 fetch_fsmap finished waiting for FSMap version 34 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82f83f4740 10 client.25534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82f83f4740 20 client.25534 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c81477bd80 0x55c814b78830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82f83f4740 4 client.25534 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c814ad33d0 con 0x55c81477bd80 2024-05-09T01:05:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.456+0000 7f82eaffd640 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c81477bd80 0x55c814b78830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.457+0000 7f82d27fc640 10 client.25534 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.458+0000 7f82eaffd640 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c81477bd80 0x55c814b78830 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ec8bb18fdc537a3 server_cookie=3df900c6d560d164 in_seq=0 out_seq=0 2024-05-09T01:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.459+0000 7f82d27fc640 1 -- 172.21.15.37:0/3349165675 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c814ad33d0 con 0x55c81477bd80 2024-05-09T01:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.459+0000 7f82d27fc640 10 client.25534 handle_command_reply: tid=0 2024-05-09T01:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.459+0000 7f82f83f4740 1 client.25534 shutdown 2024-05-09T01:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.460+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 msgr2=0x55c814b6b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.460+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b6b6f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0096c0 tx=0x7f82dc005130 comp rx=0 tx=0).stop 2024-05-09T01:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.460+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 shutdown_connections 2024-05-09T01:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.461+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c81477bd80 0x55c814b78830 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82d27fc640 0 client.25534 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c8147bd1b0 0x55c814b72650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b6b6f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3349165675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b6b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 >> 172.21.15.37:0/3349165675 conn(0x55c8147b1300 msgr2=0x55c814b5b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 shutdown_connections 2024-05-09T01:05:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82f83f4740 1 -- 172.21.15.37:0/3349165675 wait complete. 2024-05-09T01:05:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.462+0000 7f82f83f4740 20 client.25534 trim_cache size 0 max 16384 2024-05-09T01:05:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.504+0000 7f82f83f4740 1 Processor -- start 2024-05-09T01:05:11.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.505+0000 7f82f83f4740 1 -- start start 2024-05-09T01:05:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.506+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b5b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.506+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b5bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.506+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b72570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.506+0000 7f82f83f4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc00e330 con 0x55c81477bd80 2024-05-09T01:05:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.506+0000 7f82f83f4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc00ff60 con 0x55c8147942f0 2024-05-09T01:05:11.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.506+0000 7f82f83f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc00ea00 con 0x55c81479c4d0 2024-05-09T01:05:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.508+0000 7f82ea7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b5bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.508+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b5b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.508+0000 7f82eaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b5b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56650/0 (socket says 172.21.15.37:56650) 2024-05-09T01:05:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.508+0000 7f82ea7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b5bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36982/0 (socket says 172.21.15.37:36982) 2024-05-09T01:05:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.508+0000 7f82eaffd640 1 -- 172.21.15.37:0/3454959971 learned_addr learned my addr 172.21.15.37:0/3454959971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.508+0000 7f82eb7fe640 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b72570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.509+0000 7f82eb7fe640 1 -- 172.21.15.37:0/3454959971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 msgr2=0x55c814b5bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.509+0000 7f82eb7fe640 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b5bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.509+0000 7f82eb7fe640 1 -- 172.21.15.37:0/3454959971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 msgr2=0x55c814b5b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.509+0000 7f82eb7fe640 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b5b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.509+0000 7f82eb7fe640 1 -- 172.21.15.37:0/3454959971 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c81489f5f0 con 0x55c81479c4d0 2024-05-09T01:05:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.509+0000 7f82eb7fe640 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b72570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009790 tx=0x7f82d4009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e9a9e0d97945219 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.510+0000 7f82e0ff9640 1 -- 172.21.15.37:0/3454959971 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4017070 con 0x55c81479c4d0 2024-05-09T01:05:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.510+0000 7f82e0ff9640 1 -- 172.21.15.37:0/3454959971 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82d400ed70 con 0x55c81479c4d0 2024-05-09T01:05:11.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.510+0000 7f82e0ff9640 1 -- 172.21.15.37:0/3454959971 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4013e10 con 0x55c81479c4d0 2024-05-09T01:05:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.512+0000 7f82f83f4740 1 -- 172.21.15.37:0/3454959971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 msgr2=0x55c814b72570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.512+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b72570 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009790 tx=0x7f82d4009c50 comp rx=0 tx=0).stop 2024-05-09T01:05:11.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.513+0000 7f82f83f4740 1 -- 172.21.15.37:0/3454959971 shutdown_connections 2024-05-09T01:05:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.513+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c81479c4d0 0x55c814b72570 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.513+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c8147942f0 0x55c814b5bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.513+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3454959971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b5b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.513+0000 7f82f83f4740 1 -- 172.21.15.37:0/3454959971 >> 172.21.15.37:0/3454959971 conn(0x55c8147b1300 msgr2=0x55c814b65640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.514+0000 7f82f83f4740 1 -- 172.21.15.37:0/3454959971 shutdown_connections 2024-05-09T01:05:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.514+0000 7f82f83f4740 1 -- 172.21.15.37:0/3454959971 wait complete. 2024-05-09T01:05:11.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.515+0000 7f82f83f4740 1 -- start start 2024-05-09T01:05:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.515+0000 7f82f83f4740 1 Processor -- start 2024-05-09T01:05:11.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b6fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b70430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82f83f4740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b71360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82f83f4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc00f800 con 0x55c81477bd80 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82f83f4740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc00f100 con 0x55c81479c4d0 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82f83f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f82cc00c310 con 0x55c8147942f0 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82f83f4740 10 client.0 _ll_register_callbacks cb 0x7f82e401a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b71360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82eb7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b71360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36996/0 (socket says 172.21.15.37:36996) 2024-05-09T01:05:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82eb7fe640 1 -- 172.21.15.37:0/3847392389 learned_addr learned my addr 172.21.15.37:0/3847392389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.516+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b70430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.517+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3847392389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 msgr2=0x55c814b71360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.517+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b71360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.517+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3847392389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 msgr2=0x55c814b6fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.517+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b6fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.517+0000 7f82ea7fc640 1 -- 172.21.15.37:0/3847392389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c814a89ed0 con 0x55c8147942f0 2024-05-09T01:05:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.517+0000 7f82ea7fc640 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b70430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82dc004650 tx=0x7f82dc0045a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28b5aac23ae54f22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.518+0000 7f82d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.518+0000 7f82d27fc640 1 -- 172.21.15.37:0/3847392389 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc06e020 con 0x55c8147942f0 2024-05-09T01:05:11.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.519+0000 7f82d27fc640 1 -- 172.21.15.37:0/3847392389 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f82dc003800 con 0x55c8147942f0 2024-05-09T01:05:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.519+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82d400ed70 con 0x55c8147942f0 2024-05-09T01:05:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.519+0000 7f82d27fc640 1 -- 172.21.15.37:0/3847392389 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f82dc040070 con 0x55c8147942f0 2024-05-09T01:05:11.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.519+0000 7f82f83f4740 10 client.25540 fetch_fsmap learned FSMap version 34 2024-05-09T01:05:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.520+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c814b729c0 con 0x55c8147942f0 2024-05-09T01:05:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.520+0000 7f82d27fc640 1 -- 172.21.15.37:0/3847392389 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc0325b0 con 0x55c8147942f0 2024-05-09T01:05:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.520+0000 7f82d27fc640 1 -- 172.21.15.37:0/3847392389 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8374+0+0 (secure 0 0 0) 0x7f82dc049450 con 0x55c8147942f0 2024-05-09T01:05:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.520+0000 7f82f83f4740 10 client.25540 fetch_fsmap finished waiting for FSMap version 34 2024-05-09T01:05:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.520+0000 7f82f83f4740 10 client.25540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.520+0000 7f82f83f4740 20 client.25540 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.521+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c8147bd1b0 0x55c814be2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.521+0000 7f82f83f4740 4 client.25540 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:05:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.521+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f82d400ed70 con 0x55c8147bd1b0 2024-05-09T01:05:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.521+0000 7f82eaffd640 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c8147bd1b0 0x55c814be2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.522+0000 7f82d27fc640 10 client.25540 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.522+0000 7f82eaffd640 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c8147bd1b0 0x55c814be2cb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4094c12aca02a4c server_cookie=d263b7c657e11b2d in_seq=0 out_seq=0 2024-05-09T01:05:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82d27fc640 1 -- 172.21.15.37:0/3847392389 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f82d400ed70 con 0x55c8147bd1b0 2024-05-09T01:05:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82d27fc640 10 client.25540 handle_command_reply: tid=0 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 client.25540 shutdown 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 msgr2=0x55c814b70430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b70430 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f82dc004650 tx=0x7f82dc0045a0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 shutdown_connections 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c8147bd1b0 0x55c814be2cb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c81479c4d0 0x55c814b71360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c8147942f0 0x55c814b70430 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 --2- 172.21.15.37:0/3847392389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c81477bd80 0x55c814b6fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 >> 172.21.15.37:0/3847392389 conn(0x55c8147b1300 msgr2=0x55c814b5b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.534+0000 7f82d27fc640 0 client.25540 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.535+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 shutdown_connections 2024-05-09T01:05:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.535+0000 7f82f83f4740 1 -- 172.21.15.37:0/3847392389 wait complete. 2024-05-09T01:05:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.535+0000 7f82f83f4740 20 client.25540 trim_cache size 0 max 16384 2024-05-09T01:05:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:05:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:05:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:05:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d80b29f0 msgr2=0x7f82d80b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d80b29f0 0x7f82d80b4f00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009850 tx=0x7f82dc031400 comp rx=0 tx=0).stop 2024-05-09T01:05:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 msgr2=0x7f82ec1a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 0x7f82ec1a92f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f82e400ea80 tx=0x7f82e400ef40 comp rx=0 tx=0).stop 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 shutdown_connections 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82ec078f20 0x7f82ec07b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f82d80b29f0 0x7f82d80b4f00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82ec1101a0 0x7f82ec1a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 --2- 172.21.15.37:0/1904492517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82ec10a550 0x7f82ec1a92f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.537+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 >> 172.21.15.37:0/1904492517 conn(0x7f82ec070670 msgr2=0x7f82ec10c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.538+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 shutdown_connections 2024-05-09T01:05:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:11.538+0000 7f82f1469640 1 -- 172.21.15.37:0/1904492517 wait complete. 2024-05-09T01:05:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:12 smithi136 ceph-mon[34110]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 691 op/s 2024-05-09T01:05:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:12 smithi037 ceph-mon[30122]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 691 op/s 2024-05-09T01:05:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:12 smithi151 ceph-mon[34780]: pgmap v487: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 691 op/s 2024-05-09T01:05:13.066 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:05:13.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:05:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:13.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:13 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:13.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:13 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:13.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:13 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:14 smithi037 ceph-mon[30122]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 718 op/s 2024-05-09T01:05:14.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:14 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:14.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:14 smithi151 ceph-mon[34780]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 718 op/s 2024-05-09T01:05:14.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:14 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:14.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:14 smithi136 ceph-mon[34110]: pgmap v488: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 718 op/s 2024-05-09T01:05:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:14 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 175.0 s, 3847.6 tps, lat 25.745 ms stddev 28.701 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.537+0000 7f8fd959a700 1 -- 172.21.15.37:0/1864295024 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc003c00 con 0x7f8fdc104610 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/1864295024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 msgr2=0x7f8fdc104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/1864295024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 0x7f8fdc104a20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0099c0 tx=0x7f8fcc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/1864295024 shutdown_connections 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/1864295024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc109890 0x7f8fdc1111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/1864295024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 0x7f8fdc104a20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/1864295024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc108f40 0x7f8fdc109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/1864295024 >> 172.21.15.37:0/1864295024 conn(0x7f8fdc07af70 msgr2=0x7f8fdc07b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/1864295024 shutdown_connections 2024-05-09T01:05:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.538+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/1864295024 wait complete. 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.539+0000 7f8fe0ceb700 1 Processor -- start 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.539+0000 7f8fe0ceb700 1 -- start start 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.539+0000 7f8fe0ceb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 0x7f8fdc0752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.539+0000 7f8fe0ceb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc108f40 0x7f8fdc06e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.539+0000 7f8fe0ceb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc109890 0x7f8fdc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fe0ceb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1145e0 con 0x7f8fdc109890 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fe0ceb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc114460 con 0x7f8fdc108f40 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fe0ceb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc114760 con 0x7f8fdc104610 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fdad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc109890 0x7f8fdc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc108f40 0x7f8fdc06e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc108f40 0x7f8fdc06e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59746/0 (socket says 172.21.15.37:59746) 2024-05-09T01:05:15.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/2119308551 learned_addr learned my addr 172.21.15.37:0/2119308551 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:15.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fda59c700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 0x7f8fdc0752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.540+0000 7f8fda59c700 1 -- 172.21.15.37:0/2119308551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc108f40 msgr2=0x7f8fdc06e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.541+0000 7f8fda59c700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc108f40 0x7f8fdc06e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.541+0000 7f8fda59c700 1 -- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc109890 msgr2=0x7f8fdc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.541+0000 7f8fda59c700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc109890 0x7f8fdc06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.541+0000 7f8fda59c700 1 -- 172.21.15.37:0/2119308551 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc06f1a0 con 0x7f8fdc104610 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.541+0000 7f8fda59c700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 0x7f8fdc0752d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc000c00 tx=0x7f8fcc005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.541+0000 7f8fcb7fe700 1 -- 172.21.15.37:0/2119308551 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc026070 con 0x7f8fdc104610 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.541+0000 7f8fcb7fe700 1 -- 172.21.15.37:0/2119308551 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fcc003f20 con 0x7f8fdc104610 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.542+0000 7f8fcb7fe700 1 -- 172.21.15.37:0/2119308551 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00fab0 con 0x7f8fdc104610 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.542+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc072e60 con 0x7f8fdc104610 2024-05-09T01:05:15.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.542+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc0732f0 con 0x7f8fdc104610 2024-05-09T01:05:15.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.548+0000 7f8fef701b80 1 Processor -- start 2024-05-09T01:05:15.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.548+0000 7f8fef701b80 1 -- start start 2024-05-09T01:05:15.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.548+0000 7f8fcb7fe700 1 -- 172.21.15.37:0/2119308551 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8fcc029070 con 0x7f8fdc104610 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.548+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.548+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a2fd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.548+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a301890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fdad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fef701b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56361a21b070 con 0x56361a2651e0 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a301890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fef701b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56361a1b9870 con 0x56361a17b520 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fef701b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56361a217030 con 0x56361a301480 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fdad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2fcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46212/0 (socket says 172.21.15.37:46212) 2024-05-09T01:05:15.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fdad9d700 1 -- 172.21.15.37:0/49508528 learned_addr learned my addr 172.21.15.37:0/49508528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/49508528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 msgr2=0x56361a2fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fda59c700 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a2fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a2fd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/49508528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 msgr2=0x56361a2fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.549+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.550+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/49508528 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361a1b13f0 con 0x56361a301480 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.550+0000 7f8fda59c700 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a2fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.550+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a301890 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000bcf0 tx=0x7f8fd00103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=270be0fbdd90668c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.550+0000 7f8fc8ff9700 1 -- 172.21.15.37:0/49508528 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0010d10 con 0x56361a301480 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.550+0000 7f8fcb7fe700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8fc40b2940 0x7f8fc40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.550+0000 7f8fc8ff9700 1 -- 172.21.15.37:0/49508528 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd00044e0 con 0x56361a301480 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.551+0000 7f8fc8ff9700 1 -- 172.21.15.37:0/49508528 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011440 con 0x56361a301480 2024-05-09T01:05:15.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.551+0000 7f8fdad9d700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8fc40b2940 0x7f8fc40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.551+0000 7f8fcb7fe700 1 -- 172.21.15.37:0/2119308551 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8fcc0e29b0 con 0x7f8fdc104610 2024-05-09T01:05:15.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 -- 172.21.15.37:0/49508528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 msgr2=0x56361a301890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fdad9d700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8fc40b2940 0x7f8fc40b4e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400a510 tx=0x7f8fd400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a301890 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000bcf0 tx=0x7f8fd00103d0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 -- 172.21.15.37:0/49508528 shutdown_connections 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a301890 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 --2- 172.21.15.37:0/49508528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a2fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 -- 172.21.15.37:0/49508528 >> 172.21.15.37:0/49508528 conn(0x56361a1db720 msgr2=0x56361a2f3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 -- 172.21.15.37:0/49508528 shutdown_connections 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.552+0000 7f8fef701b80 1 -- 172.21.15.37:0/49508528 wait complete. 2024-05-09T01:05:15.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.553+0000 7f8fef701b80 1 -- start start 2024-05-09T01:05:15.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.553+0000 7f8fef701b80 1 Processor -- start 2024-05-09T01:05:15.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.554+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a17b520 0x56361a306640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.554+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a2651e0 0x56361a306b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.554+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a301480 0x56361a3070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.554+0000 7f8fef701b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56361a096c20 con 0x56361a17b520 2024-05-09T01:05:15.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.554+0000 7f8fef701b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56361a1d51d0 con 0x56361a301480 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fda59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a17b520 0x56361a306640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fef701b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56361a302280 con 0x56361a2651e0 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fda59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a17b520 0x56361a306640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46218/0 (socket says 172.21.15.37:46218) 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fda59c700 1 -- 172.21.15.37:0/3735829518 learned_addr learned my addr 172.21.15.37:0/3735829518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fef701b80 10 client.0 _ll_register_callbacks cb 0x56361a08c740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a2651e0 0x56361a306b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fdad9d700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a301480 0x56361a3070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a301480 msgr2=0x56361a3070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a301480 0x56361a3070c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/3735829518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a17b520 msgr2=0x56361a306640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.555+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a17b520 0x56361a306640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.556+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/3735829518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361a096510 con 0x56361a2651e0 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.557+0000 7f8fdad9d700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a301480 0x56361a3070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.557+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a2651e0 0x56361a306b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000bcf0 tx=0x7f8fd00038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b567ac687d35e29 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.557+0000 7f8fc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3735829518 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd002a060 con 0x56361a2651e0 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3735829518 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8fd0004000 con 0x56361a2651e0 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fd00044e0 con 0x56361a2651e0 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3735829518 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8fd0004200 con 0x56361a2651e0 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fef701b80 10 client.25552 fetch_fsmap learned FSMap version 36 2024-05-09T01:05:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56361a313ed0 con 0x56361a2651e0 2024-05-09T01:05:15.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3735829518 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd00044e0 con 0x56361a2651e0 2024-05-09T01:05:15.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.558+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3735829518 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f8fd002f070 con 0x56361a2651e0 2024-05-09T01:05:15.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fef701b80 10 client.25552 fetch_fsmap finished waiting for FSMap version 36 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fef701b80 10 client.25552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fef701b80 20 client.25552 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a3187c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fef701b80 4 client.25552 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56361a228a50 con 0x56361a3163a0 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fda59c700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a3187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.559+0000 7f8fc1ffb700 10 client.25552 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.560+0000 7f8fda59c700 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a3187c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7acb644b131f24e1 server_cookie=a774b5ffa0e11350 in_seq=0 out_seq=0 2024-05-09T01:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.560+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3735829518 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56361a228a50 con 0x56361a3163a0 2024-05-09T01:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.560+0000 7f8fc1ffb700 10 client.25552 handle_command_reply: tid=0 2024-05-09T01:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.560+0000 7f8fef701b80 1 client.25552 shutdown 2024-05-09T01:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.561+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a2651e0 msgr2=0x56361a306b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.561+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a2651e0 0x56361a306b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000bcf0 tx=0x7f8fd00038b0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.561+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 shutdown_connections 2024-05-09T01:05:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.561+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a3187c0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.562+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a301480 0x56361a3070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.562+0000 7f8fc1ffb700 0 client.25552 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.562+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a17b520 0x56361a306640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.562+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3735829518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a2651e0 0x56361a306b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.562+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 >> 172.21.15.37:0/3735829518 conn(0x56361a1db720 msgr2=0x56361a2f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:15.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.563+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 shutdown_connections 2024-05-09T01:05:15.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.563+0000 7f8fef701b80 1 -- 172.21.15.37:0/3735829518 wait complete. 2024-05-09T01:05:15.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.563+0000 7f8fef701b80 20 client.25552 trim_cache size 0 max 16384 2024-05-09T01:05:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 Processor -- start 2024-05-09T01:05:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 -- start start 2024-05-09T01:05:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a312810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2f8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a306f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1b4ff0 con 0x56361a2651e0 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1b6bc0 con 0x56361a17b520 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fef701b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1b56c0 con 0x56361a301480 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.600+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46232/0 (socket says 172.21.15.37:46232) 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/1222483225 learned_addr learned my addr 172.21.15.37:0/1222483225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fda59c700 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a312810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fdad9d700 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a306f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/1222483225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 msgr2=0x56361a306f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a306f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/1222483225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 msgr2=0x56361a312810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a312810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.601+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/1222483225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361a304bb0 con 0x56361a2651e0 2024-05-09T01:05:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.602+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2f8140 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000bc40 tx=0x7f8fd000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd434860a39cdbf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.602+0000 7f8fc3fff700 1 -- 172.21.15.37:0/1222483225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0035030 con 0x56361a2651e0 2024-05-09T01:05:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.602+0000 7f8fc3fff700 1 -- 172.21.15.37:0/1222483225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd0003f70 con 0x56361a2651e0 2024-05-09T01:05:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.602+0000 7f8fc3fff700 1 -- 172.21.15.37:0/1222483225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0011440 con 0x56361a2651e0 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.603+0000 7f8fef701b80 1 -- 172.21.15.37:0/1222483225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 msgr2=0x56361a2f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.603+0000 7f8fef701b80 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2f8140 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000bc40 tx=0x7f8fd000b480 comp rx=0 tx=0).stop 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 -- 172.21.15.37:0/1222483225 shutdown_connections 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a306f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a312810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 --2- 172.21.15.37:0/1222483225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a2f8140 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 -- 172.21.15.37:0/1222483225 >> 172.21.15.37:0/1222483225 conn(0x56361a1db720 msgr2=0x56361a300d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 -- 172.21.15.37:0/1222483225 shutdown_connections 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 -- 172.21.15.37:0/1222483225 wait complete. 2024-05-09T01:05:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 -- start start 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.604+0000 7f8fef701b80 1 Processor -- start 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.605+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a31b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.605+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a31bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fef701b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a3187c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fef701b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1b6490 con 0x56361a2651e0 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fef701b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1b5d90 con 0x56361a17b520 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fef701b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc1b2ff0 con 0x56361a301480 2024-05-09T01:05:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fef701b80 10 client.0 _ll_register_callbacks cb 0x56361a08c740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a31bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fd9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a31bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46244/0 (socket says 172.21.15.37:46244) 2024-05-09T01:05:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.606+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/3801193096 learned_addr learned my addr 172.21.15.37:0/3801193096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.607+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/3801193096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 msgr2=0x56361a3187c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.607+0000 7f8fdad9d700 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a3187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.607+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a3187c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.607+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/3801193096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 msgr2=0x56361a31b7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:05:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.607+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a31b7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.607+0000 7f8fd9d9b700 1 -- 172.21.15.37:0/3801193096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361a318d30 con 0x56361a2651e0 2024-05-09T01:05:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.607+0000 7f8fdad9d700 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a3187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.608+0000 7f8fd9d9b700 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a31bd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00038f0 tx=0x7f8fd0004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b93fd83339ad06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.608+0000 7f8fc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.608+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3801193096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0035040 con 0x56361a2651e0 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.608+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3801193096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8fd0010b10 con 0x56361a2651e0 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.608+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fd0003f70 con 0x56361a2651e0 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.608+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3801193096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8fd0010d10 con 0x56361a2651e0 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 10 client.15786 fetch_fsmap learned FSMap version 36 2024-05-09T01:05:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56361a3810d0 con 0x56361a2651e0 2024-05-09T01:05:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3801193096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd0003f70 con 0x56361a2651e0 2024-05-09T01:05:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3801193096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7f8fd0041030 con 0x56361a2651e0 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 10 client.15786 fetch_fsmap finished waiting for FSMap version 36 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 20 client.15786 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a383740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 4 client.15786 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.609+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56361a222af0 con 0x56361a3163a0 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.610+0000 7f8fda59c700 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a383740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.610+0000 7f8fc1ffb700 10 client.15786 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.611+0000 7f8fda59c700 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a383740 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11046ce7af024486 server_cookie=740f677d6e6ae22 in_seq=0 out_seq=0 2024-05-09T01:05:15.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.612+0000 7f8fc1ffb700 1 -- 172.21.15.37:0/3801193096 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56361a222af0 con 0x56361a3163a0 2024-05-09T01:05:15.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.612+0000 7f8fc1ffb700 10 client.15786 handle_command_reply: tid=0 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.612+0000 7f8fef701b80 1 client.15786 shutdown 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 msgr2=0x56361a31bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a31bd30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00038f0 tx=0x7f8fd0004120 comp rx=0 tx=0).stop 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 shutdown_connections 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56361a3163a0 0x56361a383740 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361a301480 0x56361a3187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56361a17b520 0x56361a31b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 --2- 172.21.15.37:0/3801193096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56361a2651e0 0x56361a31bd30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fc1ffb700 0 client.15786 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 >> 172.21.15.37:0/3801193096 conn(0x56361a1db720 msgr2=0x56361a300d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.613+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 shutdown_connections 2024-05-09T01:05:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.617+0000 7f8fef701b80 1 -- 172.21.15.37:0/3801193096 wait complete. 2024-05-09T01:05:15.624 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:05:15.624 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:05:15.624 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "1aff63c3-e55c-4b40-ad14-544e15fe063f", 2024-05-09T01:05:15.624 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:05:15.624 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:05:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.620+0000 7f8fef701b80 20 client.15786 trim_cache size 0 max 16384 2024-05-09T01:05:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.627+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8fc40b2940 msgr2=0x7f8fc40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.627+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8fc40b2940 0x7f8fc40b4e50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400a510 tx=0x7f8fd400d040 comp rx=0 tx=0).stop 2024-05-09T01:05:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.627+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 msgr2=0x7f8fdc0752d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.627+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 0x7f8fdc0752d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc000c00 tx=0x7f8fcc005e10 comp rx=0 tx=0).stop 2024-05-09T01:05:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.631+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 shutdown_connections 2024-05-09T01:05:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.631+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8fc40b2940 0x7f8fc40b4e50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.631+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fdc109890 0x7f8fdc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.631+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fdc104610 0x7f8fdc0752d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.631+0000 7f8fe0ceb700 1 --2- 172.21.15.37:0/2119308551 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8fdc108f40 0x7f8fdc06e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.631+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 >> 172.21.15.37:0/2119308551 conn(0x7f8fdc07af70 msgr2=0x7f8fdc1029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.632+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 shutdown_connections 2024-05-09T01:05:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:15.632+0000 7f8fe0ceb700 1 -- 172.21.15.37:0/2119308551 wait complete. 2024-05-09T01:05:16.128 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:05:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:05:15.667+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans/ auth{2=1,3=1,4=1} v686 ap=2 f(v10 m2024-05-09T01:04:59.133192+0000 1=1+0) n(v11 rc2024-05-09T01:04:59.133192+0000 2=1+1) (inest sync->mix g=2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@24} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8371600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v316>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v686>,<0x10000000005/data v334>,<0x100000001fb/postgres v157>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v173>,<0x10000000001/sv_1 v196>,<0x10000000000/qa v185>,<0x1/volumes v169>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:04:59.098192+0000 11=11+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:04:59.133192+0000 2=1+1)","memory_value.dirstat":"f(v10 m2024-05-09T01:04:59.133192+0000 1=1+0)","memory_value.rstat":"n(v11 rc2024-05-09T01:04:59.133192+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:05:16.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:16 smithi037 ceph-mon[30122]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-05-09T01:05:16.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:16 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:05:16.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:16 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:05:16.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:16 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:05:16.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:16 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.464 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:16 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.465 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:16 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:16 smithi151 ceph-mon[34780]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-05-09T01:05:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:16 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:05:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:16 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:05:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:16 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:05:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:16 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:16 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:16 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:05:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:16 smithi136 ceph-mon[34110]: pgmap v489: 97 pgs: 97 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 10 MiB/s wr, 719 op/s 2024-05-09T01:05:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:16 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:05:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:16 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:05:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:16 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:05:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:16 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:16 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:16 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:17.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:17 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:05:17.343 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:17 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:17 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:05:17.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:17 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:05:17.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:17 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:05:17.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:17 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:17 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:17 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:05:17.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:17 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:17 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:05:17.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:17 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:05:17.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:17 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:05:17.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:17 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:17 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:17 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:05:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:17 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:17 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:05:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:17 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:05:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:17 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:05:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:17 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:17.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:17 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:05:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:18 smithi037 ceph-mon[30122]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-05-09T01:05:18.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:18 smithi151 ceph-mon[34780]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-05-09T01:05:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:18 smithi136 ceph-mon[34110]: pgmap v490: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 11 MiB/s wr, 785 op/s 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.961+0000 7fbe81d6e700 1 -- 172.21.15.37:0/3179950077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740b8320 msgr2=0x7fbe740ba740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.961+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/3179950077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740b8320 0x7fbe740ba740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009990 tx=0x7fbe70009ca0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.961+0000 7fbe81d6e700 1 -- 172.21.15.37:0/3179950077 shutdown_connections 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.961+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/3179950077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740b8320 0x7fbe740ba740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.961+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/3179950077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe740a53c0 0x7fbe740a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.961+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/3179950077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe740a5d10 0x7fbe740b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.961+0000 7fbe81d6e700 1 -- 172.21.15.37:0/3179950077 >> 172.21.15.37:0/3179950077 conn(0x7fbe7401af20 msgr2=0x7fbe7401b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.962+0000 7fbe81d6e700 1 -- 172.21.15.37:0/3179950077 shutdown_connections 2024-05-09T01:05:18.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.963+0000 7fbe81d6e700 1 -- 172.21.15.37:0/3179950077 wait complete. 2024-05-09T01:05:18.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.964+0000 7fbe81d6e700 1 Processor -- start 2024-05-09T01:05:18.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.964+0000 7fbe81d6e700 1 -- start start 2024-05-09T01:05:18.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe81d6e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740a53c0 0x7fbe74144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe81d6e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe740a5d10 0x7fbe74144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe81d6e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe740b8320 0x7fbe74148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe81d6e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740bdd00 con 0x7fbe740b8320 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe81d6e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740bdb80 con 0x7fbe740a53c0 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe81d6e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740bde80 con 0x7fbe740a5d10 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740a53c0 0x7fbe74144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740a53c0 0x7fbe74144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59804/0 (socket says 172.21.15.37:59804) 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2590871309 learned_addr learned my addr 172.21.15.37:0/2590871309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe740a5d10 0x7fbe74144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.965+0000 7fbe8156d700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe740b8320 0x7fbe74148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.966+0000 7fbe7bfff700 1 -- 172.21.15.37:0/2590871309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740a53c0 msgr2=0x7fbe74144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.966+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740a53c0 0x7fbe74144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.966+0000 7fbe7bfff700 1 -- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe740b8320 msgr2=0x7fbe74148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.966+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe740b8320 0x7fbe74148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.966+0000 7fbe7bfff700 1 -- 172.21.15.37:0/2590871309 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe74149540 con 0x7fbe740a5d10 2024-05-09T01:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.966+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe740a5d10 0x7fbe74144c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9c0 tx=0x7fbe6800ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.967+0000 7fbe79ffb700 1 -- 172.21.15.37:0/2590871309 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800eea0 con 0x7fbe740a5d10 2024-05-09T01:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.967+0000 7fbe79ffb700 1 -- 172.21.15.37:0/2590871309 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe6800cbd0 con 0x7fbe740a5d10 2024-05-09T01:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.967+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe74149830 con 0x7fbe740a5d10 2024-05-09T01:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.968+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe74151150 con 0x7fbe740a5d10 2024-05-09T01:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.968+0000 7fbe79ffb700 1 -- 172.21.15.37:0/2590871309 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68018680 con 0x7fbe740a5d10 2024-05-09T01:05:18.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 Processor -- start 2024-05-09T01:05:18.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 -- start start 2024-05-09T01:05:18.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe79ffb700 1 -- 172.21.15.37:0/2590871309 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbe68018820 con 0x7fbe740a5d10 2024-05-09T01:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e465a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e465f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e471960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb1e3880a0 con 0x55cb1e362d00 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cb1e32d9a0 con 0x55cb1e2e84a0 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.973+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb1e384060 con 0x55cb1e46f540 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e465f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e465f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59810/0 (socket says 172.21.15.37:59810) 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe80d6c700 1 -- 172.21.15.37:0/3089783322 learned_addr learned my addr 172.21.15.37:0/3089783322 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e471960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe8156d700 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e465a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe7bfff700 1 -- 172.21.15.37:0/3089783322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 msgr2=0x55cb1e465f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e465f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe7bfff700 1 -- 172.21.15.37:0/3089783322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 msgr2=0x55cb1e465a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e465a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe7bfff700 1 -- 172.21.15.37:0/3089783322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb1e31e500 con 0x55cb1e46f540 2024-05-09T01:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.974+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e465f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:18.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.975+0000 7fbe79ffb700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbe6c0b2a50 0x7fbe6c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.975+0000 7fbe79ffb700 1 -- 172.21.15.37:0/2590871309 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbe680e21f0 con 0x7fbe740a5d10 2024-05-09T01:05:18.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.975+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e471960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe680dfc90 tx=0x7fbe680ea5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f4c4e97b846f21b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:18.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.976+0000 7fbe66ffd700 1 -- 172.21.15.37:0/3089783322 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe680a56d0 con 0x55cb1e46f540 2024-05-09T01:05:18.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.976+0000 7fbe66ffd700 1 -- 172.21.15.37:0/3089783322 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe680a9320 con 0x55cb1e46f540 2024-05-09T01:05:18.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.977+0000 7fbe8156d700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbe6c0b2a50 0x7fbe6c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.977+0000 7fbe66ffd700 1 -- 172.21.15.37:0/3089783322 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe680a8f80 con 0x55cb1e46f540 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3089783322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 msgr2=0x55cb1e471960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e471960 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe680dfc90 tx=0x7fbe680ea5d0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe8156d700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbe6c0b2a50 0x7fbe6c0b4f60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55cb1e461110 tx=0x7fbe70009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3089783322 shutdown_connections 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e471960 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e465a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3089783322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e465f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3089783322 >> 172.21.15.37:0/3089783322 conn(0x55cb1e2ebf70 msgr2=0x55cb1e460760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3089783322 shutdown_connections 2024-05-09T01:05:18.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.978+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3089783322 wait complete. 2024-05-09T01:05:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.979+0000 7fbe919e6b80 1 -- start start 2024-05-09T01:05:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.979+0000 7fbe919e6b80 1 Processor -- start 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e46c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e46ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e46cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb1e471f60 con 0x55cb1e362d00 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55cb1e322b20 con 0x55cb1e2e84a0 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e46c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb1e4720e0 con 0x55cb1e46f540 2024-05-09T01:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e46c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59812/0 (socket says 172.21.15.37:59812) 2024-05-09T01:05:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2622059395 learned_addr learned my addr 172.21.15.37:0/2622059395 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e46ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.980+0000 7fbe919e6b80 10 client.0 _ll_register_callbacks cb 0x55cb1e1f96c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2622059395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 msgr2=0x55cb1e46cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe8156d700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e46cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e46cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2622059395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 msgr2=0x55cb1e46ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e46ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2622059395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb1e203490 con 0x55cb1e2e84a0 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe8156d700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e46cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e46c500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c052d10 tx=0x7fbe7c077710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6932d6716caa3d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2622059395 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c06be00 con 0x55cb1e2e84a0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe680a9320 con 0x55cb1e2e84a0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.981+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2622059395 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbe7c0765d0 con 0x55cb1e2e84a0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2622059395 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbe7c0767d0 con 0x55cb1e2e84a0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 10 client.25544 fetch_fsmap learned FSMap version 36 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55cb1e47cc60 con 0x55cb1e2e84a0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2622059395 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe680a9320 con 0x55cb1e2e84a0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2622059395 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fbe7c081ba0 con 0x55cb1e2e84a0 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 10 client.25544 fetch_fsmap finished waiting for FSMap version 36 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 10 client.25544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 20 client.25544 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e47f290 0x55cb1e481730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 4 client.25544 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb1e395a80 con 0x55cb1e47f290 2024-05-09T01:05:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.982+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e47f290 0x55cb1e481730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.985+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e47f290 0x55cb1e481730 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f3daf2b18794d5e server_cookie=40ecad3be110cee4 in_seq=0 out_seq=0 2024-05-09T01:05:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.985+0000 7fbe5bfff700 10 client.25544 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2622059395 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cb1e395a80 con 0x55cb1e47f290 2024-05-09T01:05:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe5bfff700 10 client.25544 handle_command_reply: tid=0 2024-05-09T01:05:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 client.25544 shutdown 2024-05-09T01:05:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 msgr2=0x55cb1e46c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e46c500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c052d10 tx=0x7fbe7c077710 comp rx=0 tx=0).stop 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 shutdown_connections 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e47f290 0x55cb1e481730 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e46f540 0x55cb1e46cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e2e84a0 0x55cb1e46c500 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c052d10 tx=0x7fbe7c077710 comp rx=0 tx=0).stop 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2622059395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e362d00 0x55cb1e46ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 >> 172.21.15.37:0/2622059395 conn(0x55cb1e2ebf70 msgr2=0x55cb1e460250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe5bfff700 0 client.25544 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.986+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 shutdown_connections 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.987+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2622059395 wait complete. 2024-05-09T01:05:18.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:18.987+0000 7fbe919e6b80 20 client.25544 trim_cache size 0 max 16384 2024-05-09T01:05:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.030+0000 7fbe919e6b80 1 Processor -- start 2024-05-09T01:05:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.031+0000 7fbe919e6b80 1 -- start start 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.031+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e362d00 0x55cb1e46cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e467aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e481970 0x55cb1e47b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6000d230 con 0x55cb1e46f540 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6000ee00 con 0x55cb1e362d00 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6000d900 con 0x55cb1e481970 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe8156d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e481970 0x55cb1e47b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e467aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e467aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46292/0 (socket says 172.21.15.37:46292) 2024-05-09T01:05:19.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe7bfff700 1 -- 172.21.15.37:0/3665052213 learned_addr learned my addr 172.21.15.37:0/3665052213 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:19.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.032+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e362d00 0x55cb1e46cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.033+0000 7fbe8156d700 1 -- 172.21.15.37:0/3665052213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e362d00 msgr2=0x55cb1e46cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.033+0000 7fbe8156d700 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e362d00 0x55cb1e46cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.033+0000 7fbe8156d700 1 -- 172.21.15.37:0/3665052213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 msgr2=0x55cb1e467aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.033+0000 7fbe8156d700 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e467aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.033+0000 7fbe8156d700 1 -- 172.21.15.37:0/3665052213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb1e46eda0 con 0x55cb1e481970 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.033+0000 7fbe8156d700 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e481970 0x55cb1e47b070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000b2e0 tx=0x7fbe70020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23cc940388e13b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.034+0000 7fbe667fc700 1 -- 172.21.15.37:0/3665052213 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70003880 con 0x55cb1e481970 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.034+0000 7fbe667fc700 1 -- 172.21.15.37:0/3665052213 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7000be60 con 0x55cb1e481970 2024-05-09T01:05:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.034+0000 7fbe667fc700 1 -- 172.21.15.37:0/3665052213 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000fd60 con 0x55cb1e481970 2024-05-09T01:05:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.035+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3665052213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e481970 msgr2=0x55cb1e47b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.035+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e481970 0x55cb1e47b070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000b2e0 tx=0x7fbe70020000 comp rx=0 tx=0).stop 2024-05-09T01:05:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.035+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3665052213 shutdown_connections 2024-05-09T01:05:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.035+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e481970 0x55cb1e47b070 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.035+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e362d00 0x55cb1e46cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.035+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/3665052213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e467aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.035+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3665052213 >> 172.21.15.37:0/3665052213 conn(0x55cb1e2ebf70 msgr2=0x55cb1e467390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.036+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3665052213 shutdown_connections 2024-05-09T01:05:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.036+0000 7fbe919e6b80 1 -- 172.21.15.37:0/3665052213 wait complete. 2024-05-09T01:05:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.036+0000 7fbe919e6b80 1 -- start start 2024-05-09T01:05:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.036+0000 7fbe919e6b80 1 Processor -- start 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e362d00 0x55cb1e473020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e473560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe919e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e481970 0x55cb1e473aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e362d00 0x55cb1e473020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6000e6d0 con 0x55cb1e46f540 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe80d6c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e362d00 0x55cb1e473020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51276/0 (socket says 172.21.15.37:51276) 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe919e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6000dfd0 con 0x55cb1e481970 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2096475108 learned_addr learned my addr 172.21.15.37:0/2096475108 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6000b1d0 con 0x55cb1e362d00 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe919e6b80 10 client.0 _ll_register_callbacks cb 0x55cb1e1f96c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.037+0000 7fbe8156d700 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e481970 0x55cb1e473aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e473560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e481970 msgr2=0x55cb1e473aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e481970 0x55cb1e473aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2096475108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 msgr2=0x55cb1e473560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e473560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe80d6c700 1 -- 172.21.15.37:0/2096475108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb1e4e8aa0 con 0x55cb1e362d00 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe80d6c700 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e362d00 0x55cb1e473020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c066760 tx=0x7fbe7c069fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4be4308db506650 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2096475108 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c09a060 con 0x55cb1e362d00 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.038+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2096475108 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbe7c06be00 con 0x55cb1e362d00 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7000be60 con 0x55cb1e362d00 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2096475108 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbe7c091040 con 0x55cb1e362d00 2024-05-09T01:05:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe919e6b80 10 client.25570 fetch_fsmap learned FSMap version 36 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55cb1e4e9cf0 con 0x55cb1e362d00 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2096475108 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe7c0765d0 con 0x55cb1e362d00 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2096475108 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 36) ==== 8366+0+0 (secure 0 0 0) 0x7fbe7c081420 con 0x55cb1e362d00 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe919e6b80 10 client.25570 fetch_fsmap finished waiting for FSMap version 36 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.039+0000 7fbe919e6b80 10 client.25570 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.040+0000 7fbe919e6b80 20 client.25570 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.040+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e4ea3b0 0x55cb1e4ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.040+0000 7fbe919e6b80 4 client.25570 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.040+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e4ea3b0 0x55cb1e4ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:19.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.040+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fbe7000be60 con 0x55cb1e4ea3b0 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.040+0000 7fbe5bfff700 10 client.25570 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.040+0000 7fbe7bfff700 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e4ea3b0 0x55cb1e4ec7d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67b7c61f8583163d server_cookie=e50957147c46667f in_seq=0 out_seq=0 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe5bfff700 1 -- 172.21.15.37:0/2096475108 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fbe7000be60 con 0x55cb1e4ea3b0 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe5bfff700 10 client.25570 handle_command_reply: tid=0 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 client.25570 shutdown 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e362d00 msgr2=0x55cb1e473020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e362d00 0x55cb1e473020 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c066760 tx=0x7fbe7c069fd0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 shutdown_connections 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55cb1e4ea3b0 0x55cb1e4ec7d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55cb1e481970 0x55cb1e473aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb1e362d00 0x55cb1e473020 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 --2- 172.21.15.37:0/2096475108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb1e46f540 0x55cb1e473560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe5bfff700 0 client.25570 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.041+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 >> 172.21.15.37:0/2096475108 conn(0x55cb1e2ebf70 msgr2=0x55cb1e45fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.042+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 shutdown_connections 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.042+0000 7fbe919e6b80 1 -- 172.21.15.37:0/2096475108 wait complete. 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.042+0000 7fbe919e6b80 20 client.25570 trim_cache size 0 max 16384 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:05:19.046 INFO:teuthology.orchestra.run.smithi037.stdout: "1aff63c3-e55c-4b40-ad14-544e15fe063f": { 2024-05-09T01:05:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:05:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "1aff63c3-e55c-4b40-ad14-544e15fe063f", 2024-05-09T01:05:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:05:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:05:19.047 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:05:19.047 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbe6c0b2a50 msgr2=0x7fbe6c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbe6c0b2a50 0x7fbe6c0b4f60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55cb1e461110 tx=0x7fbe70009510 comp rx=0 tx=0).stop 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe740a5d10 msgr2=0x7fbe74144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe740a5d10 0x7fbe74144c10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9c0 tx=0x7fbe6800ed80 comp rx=0 tx=0).stop 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 shutdown_connections 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbe6c0b2a50 0x7fbe6c0b4f60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe740b8320 0x7fbe74148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbe740a53c0 0x7fbe74144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 --2- 172.21.15.37:0/2590871309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe740a5d10 0x7fbe74144c10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 >> 172.21.15.37:0/2590871309 conn(0x7fbe7401af20 msgr2=0x7fbe740b5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 shutdown_connections 2024-05-09T01:05:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:19.043+0000 7fbe81d6e700 1 -- 172.21.15.37:0/2590871309 wait complete. 2024-05-09T01:05:19.958 INFO:tasks.cephfs.filesystem:scrub status for tag:1aff63c3-e55c-4b40-ad14-544e15fe063f - {'path': '/', 'tag': '1aff63c3-e55c-4b40-ad14-544e15fe063f', 'options': 'recursive,force'} 2024-05-09T01:05:20.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:20 smithi037 ceph-mon[30122]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-05-09T01:05:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 180.0 s, 2252.4 tps, lat 44.480 ms stddev 81.330 2024-05-09T01:05:20.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:20 smithi151 ceph-mon[34780]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-05-09T01:05:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:20 smithi136 ceph-mon[34110]: pgmap v491: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 767 op/s 2024-05-09T01:05:22.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:22 smithi037 ceph-mon[30122]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-05-09T01:05:22.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:22 smithi151 ceph-mon[34780]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-05-09T01:05:22.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:22 smithi136 ceph-mon[34110]: pgmap v492: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 11 MiB/s wr, 871 op/s 2024-05-09T01:05:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:24 smithi037 ceph-mon[30122]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 11 MiB/s wr, 848 op/s 2024-05-09T01:05:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:24 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:24.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:24 smithi151 ceph-mon[34780]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 11 MiB/s wr, 848 op/s 2024-05-09T01:05:24.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:24 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:24 smithi136 ceph-mon[34110]: pgmap v493: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 11 MiB/s wr, 848 op/s 2024-05-09T01:05:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:24 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 -- 172.21.15.37:0/3155297633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718104cf0 msgr2=0x7f4718105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 --2- 172.21.15.37:0/3155297633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718104cf0 0x7f4718105100 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4700009900 tx=0x7f470002a410 comp rx=0 tx=0).stop 2024-05-09T01:05:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 -- 172.21.15.37:0/3155297633 shutdown_connections 2024-05-09T01:05:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 --2- 172.21.15.37:0/3155297633 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f47181099f0 0x7f471810be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 --2- 172.21.15.37:0/3155297633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718104cf0 0x7f4718105100 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 --2- 172.21.15.37:0/3155297633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4718103ab0 0x7f47181047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 -- 172.21.15.37:0/3155297633 >> 172.21.15.37:0/3155297633 conn(0x7f47180fecc0 msgr2=0x7f4718101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 -- 172.21.15.37:0/3155297633 shutdown_connections 2024-05-09T01:05:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.687+0000 7f471c914640 1 -- 172.21.15.37:0/3155297633 wait complete. 2024-05-09T01:05:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.688+0000 7f471c914640 1 Processor -- start 2024-05-09T01:05:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.688+0000 7f471c914640 1 -- start start 2024-05-09T01:05:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.689+0000 7f471c914640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718103ab0 0x7f4718199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.689+0000 7f471c914640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4718104cf0 0x7f471819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.689+0000 7f471c914640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47181099f0 0x7f47181a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.689+0000 7f471c914640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f471810f600 con 0x7f4718103ab0 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f4716d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718103ab0 0x7f4718199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47181099f0 0x7f47181a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47181099f0 0x7f47181a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48522/0 (socket says 172.21.15.37:48522) 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 -- 172.21.15.37:0/2250858117 learned_addr learned my addr 172.21.15.37:0/2250858117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f470ffff640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4718104cf0 0x7f471819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f471810f480 con 0x7f4718104cf0 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f471810f780 con 0x7f47181099f0 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 -- 172.21.15.37:0/2250858117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4718104cf0 msgr2=0x7f471819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4718104cf0 0x7f471819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 -- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718103ab0 msgr2=0x7f4718199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718103ab0 0x7f4718199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.690+0000 7f471759e640 1 -- 172.21.15.37:0/2250858117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47181a1b30 con 0x7f47181099f0 2024-05-09T01:05:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.691+0000 7f471759e640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47181099f0 0x7f47181a14c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f471000eb10 tx=0x7f471000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.691+0000 7f4714d99640 1 -- 172.21.15.37:0/2250858117 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710004b20 con 0x7f47181099f0 2024-05-09T01:05:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.691+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47181a1e20 con 0x7f47181099f0 2024-05-09T01:05:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.691+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47181a2290 con 0x7f47181099f0 2024-05-09T01:05:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.691+0000 7f4714d99640 1 -- 172.21.15.37:0/2250858117 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4710004cc0 con 0x7f47181099f0 2024-05-09T01:05:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.691+0000 7f4714d99640 1 -- 172.21.15.37:0/2250858117 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710010670 con 0x7f47181099f0 2024-05-09T01:05:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.695+0000 7f4723fc5740 1 Processor -- start 2024-05-09T01:05:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.695+0000 7f4714d99640 1 -- 172.21.15.37:0/2250858117 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4710010810 con 0x7f47181099f0 2024-05-09T01:05:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.695+0000 7f4723fc5740 1 -- start start 2024-05-09T01:05:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.696+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e4a1b0 0x5640841ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.696+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e212f0 0x5640841eec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.696+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640841f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.696+0000 7f4723fc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5640841527c0 con 0x564083e4a1b0 2024-05-09T01:05:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.696+0000 7f4723fc5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5640840ee0e0 con 0x564083e294d0 2024-05-09T01:05:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.696+0000 7f4723fc5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56408414e780 con 0x564083e212f0 2024-05-09T01:05:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f470ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e4a1b0 0x5640841ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f470ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e4a1b0 0x5640841ee6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41000/0 (socket says 172.21.15.37:41000) 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f470ffff640 1 -- 172.21.15.37:0/1860770720 learned_addr learned my addr 172.21.15.37:0/1860770720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f4716d9d640 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e212f0 0x5640841eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f470ffff640 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640841f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f4716d9d640 1 -- 172.21.15.37:0/1860770720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 msgr2=0x5640841f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f4716d9d640 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640841f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f4716d9d640 1 -- 172.21.15.37:0/1860770720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e4a1b0 msgr2=0x5640841ee6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f4716d9d640 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e4a1b0 0x5640841ee6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.697+0000 7f4716d9d640 1 -- 172.21.15.37:0/1860770720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640841177c0 con 0x564083e212f0 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.698+0000 7f470ffff640 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640841f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.698+0000 7f4716d9d640 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e212f0 0x5640841eec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4718103380 tx=0x7f4708011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628dbaf083a2c85b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:24.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.698+0000 7f4714d99640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47040b2860 0x7f47040b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.698+0000 7f470d7fa640 1 -- 172.21.15.37:0/1860770720 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708004230 con 0x564083e212f0 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.698+0000 7f470ffff640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47040b2860 0x7f47040b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.698+0000 7f4714d99640 1 -- 172.21.15.37:0/2250858117 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f47100e25f0 con 0x7f47181099f0 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.698+0000 7f470d7fa640 1 -- 172.21.15.37:0/1860770720 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4708009e10 con 0x564083e212f0 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.699+0000 7f470d7fa640 1 -- 172.21.15.37:0/1860770720 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708019750 con 0x564083e212f0 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.699+0000 7f4723fc5740 1 -- 172.21.15.37:0/1860770720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e212f0 msgr2=0x5640841eec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.699+0000 7f470ffff640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47040b2860 0x7f47040b4d70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4700032fd0 tx=0x7f4700005890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.699+0000 7f4723fc5740 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e212f0 0x5640841eec40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4718103380 tx=0x7f4708011810 comp rx=0 tx=0).stop 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 -- 172.21.15.37:0/1860770720 shutdown_connections 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640841f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e212f0 0x5640841eec40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 --2- 172.21.15.37:0/1860770720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e4a1b0 0x5640841ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 -- 172.21.15.37:0/1860770720 >> 172.21.15.37:0/1860770720 conn(0x564083e3e300 msgr2=0x5640841ea050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:24.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 -- 172.21.15.37:0/1860770720 shutdown_connections 2024-05-09T01:05:24.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 -- 172.21.15.37:0/1860770720 wait complete. 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.700+0000 7f4723fc5740 1 -- start start 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4723fc5740 1 Processor -- start 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e212f0 0x564084200c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640842011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4716d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e212f0 0x564084200c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4716d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e212f0 0x564084200c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41006/0 (socket says 172.21.15.37:41006) 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4716d9d640 1 -- 172.21.15.37:0/2343792537 learned_addr learned my addr 172.21.15.37:0/2343792537 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4723fc5740 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e4a1b0 0x564084208120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5640841f65e0 con 0x564083e212f0 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5640840d99c0 con 0x564083e294d0 2024-05-09T01:05:24.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5640841f6760 con 0x564083e4a1b0 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.701+0000 7f470ffff640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640842011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4723fc5740 10 client.0 _ll_register_callbacks cb 0x564084106020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f471759e640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e4a1b0 0x564084208120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4716d9d640 1 -- 172.21.15.37:0/2343792537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e4a1b0 msgr2=0x564084208120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4716d9d640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e4a1b0 0x564084208120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4716d9d640 1 -- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 msgr2=0x5640842011c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4716d9d640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640842011c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4716d9d640 1 -- 172.21.15.37:0/2343792537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640841001f0 con 0x564083e212f0 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f471759e640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e4a1b0 0x564084208120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f470ffff640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640842011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4716d9d640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e212f0 0x564084200c80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4708005250 tx=0x7f4708005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3343cfd887d756 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f46fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:05:24.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f46fe7fc640 1 -- 172.21.15.37:0/2343792537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4708028070 con 0x564083e212f0 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f46fe7fc640 1 -- 172.21.15.37:0/2343792537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f47080035f0 con 0x564083e212f0 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4708009e10 con 0x564083e212f0 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.702+0000 7f46fe7fc640 1 -- 172.21.15.37:0/2343792537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f4708034050 con 0x564083e212f0 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 10 client.15813 fetch_fsmap learned FSMap version 37 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564083eb5790 con 0x564083e212f0 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f46fe7fc640 1 -- 172.21.15.37:0/2343792537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4708009e10 con 0x564083e212f0 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f46fe7fc640 1 -- 172.21.15.37:0/2343792537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f4708004b80 con 0x564083e212f0 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 10 client.15813 fetch_fsmap finished waiting for FSMap version 37 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 20 client.15813 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e08d80 0x56408420e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 4 client.15813 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.703+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640841603d0 con 0x564083e08d80 2024-05-09T01:05:24.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.704+0000 7f470ffff640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e08d80 0x56408420e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.705+0000 7f470ffff640 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e08d80 0x56408420e200 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eed00a2bfd5b3bd1 server_cookie=1c15f7015bbf8965 in_seq=0 out_seq=0 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.705+0000 7f46fe7fc640 10 client.15813 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f46fe7fc640 1 -- 172.21.15.37:0/2343792537 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5640841603d0 con 0x564083e08d80 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f46fe7fc640 10 client.15813 handle_command_reply: tid=0 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 client.15813 shutdown 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e212f0 msgr2=0x564084200c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e212f0 0x564084200c80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4708005250 tx=0x7f4708005280 comp rx=0 tx=0).stop 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 shutdown_connections 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e08d80 0x56408420e200 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f46fe7fc640 0 client.15813 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e4a1b0 0x564084208120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e294d0 0x5640842011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 --2- 172.21.15.37:0/2343792537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e212f0 0x564084200c80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.706+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 >> 172.21.15.37:0/2343792537 conn(0x564083e3e300 msgr2=0x5640841e8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.707+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 shutdown_connections 2024-05-09T01:05:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.707+0000 7f4723fc5740 1 -- 172.21.15.37:0/2343792537 wait complete. 2024-05-09T01:05:24.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.707+0000 7f4723fc5740 20 client.15813 trim_cache size 0 max 16384 2024-05-09T01:05:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.728+0000 7f4723fc5740 1 Processor -- start 2024-05-09T01:05:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.728+0000 7f4723fc5740 1 -- start start 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084200f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x5640842080b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x5640842085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f4723fc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47181a8ca0 con 0x564083e08d80 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f4723fc5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f47181aa840 con 0x564083e212f0 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f4723fc5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f47181a9370 con 0x564083e294d0 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f471759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x5640842085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f471759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x5640842085f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48534/0 (socket says 172.21.15.37:48534) 2024-05-09T01:05:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f471759e640 1 -- 172.21.15.37:0/3601495529 learned_addr learned my addr 172.21.15.37:0/3601495529 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f4716d9d640 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084200f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.729+0000 7f470ffff640 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x5640842080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f471759e640 1 -- 172.21.15.37:0/3601495529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 msgr2=0x5640842080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f471759e640 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x5640842080b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f471759e640 1 -- 172.21.15.37:0/3601495529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 msgr2=0x564084200f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f471759e640 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084200f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f471759e640 1 -- 172.21.15.37:0/3601495529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564083f2c5f0 con 0x564083e294d0 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f470ffff640 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x5640842080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f471759e640 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x5640842085f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47100a5d30 tx=0x7f471000efd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d89ddac4e4977aa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f470cff9640 1 -- 172.21.15.37:0/3601495529 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100a97c0 con 0x564083e294d0 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f470cff9640 1 -- 172.21.15.37:0/3601495529 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47100aa3b0 con 0x564083e294d0 2024-05-09T01:05:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.730+0000 7f470cff9640 1 -- 172.21.15.37:0/3601495529 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100b2680 con 0x564083e294d0 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 -- 172.21.15.37:0/3601495529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 msgr2=0x5640842085f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x5640842085f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47100a5d30 tx=0x7f471000efd0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 -- 172.21.15.37:0/3601495529 shutdown_connections 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x5640842085f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x5640842080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3601495529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084200f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 -- 172.21.15.37:0/3601495529 >> 172.21.15.37:0/3601495529 conn(0x564083e3e300 msgr2=0x564084200850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.731+0000 7f4723fc5740 1 -- 172.21.15.37:0/3601495529 shutdown_connections 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.732+0000 7f4723fc5740 1 -- 172.21.15.37:0/3601495529 wait complete. 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.732+0000 7f4723fc5740 1 -- start start 2024-05-09T01:05:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.732+0000 7f4723fc5740 1 Processor -- start 2024-05-09T01:05:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084208300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x564084208840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4723fc5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x564084204fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4716d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084208300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4716d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084208300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41016/0 (socket says 172.21.15.37:41016) 2024-05-09T01:05:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f470ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x564084208840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f470ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x564084208840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46240/0 (socket says 172.21.15.37:46240) 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f470ffff640 1 -- 172.21.15.37:0/3320225376 learned_addr learned my addr 172.21.15.37:0/3320225376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47181aa140 con 0x564083e08d80 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f471759e640 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x564084204fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f47181a9a40 con 0x564083e212f0 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f47181a6ca0 con 0x564083e294d0 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.733+0000 7f4723fc5740 10 client.0 _ll_register_callbacks cb 0x7f4708005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4716d9d640 1 -- 172.21.15.37:0/3320225376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 msgr2=0x564084204fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4716d9d640 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x564084204fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4716d9d640 1 -- 172.21.15.37:0/3320225376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 msgr2=0x564084208840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4716d9d640 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x564084208840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4716d9d640 1 -- 172.21.15.37:0/3320225376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564084116ed0 con 0x564083e08d80 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4716d9d640 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084208300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4708006010 tx=0x7f4708011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c144c67a8f7565a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f46fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:05:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f46fe7fc640 1 -- 172.21.15.37:0/3320225376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470803d060 con 0x564083e08d80 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47100aa3b0 con 0x564083e08d80 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f46fe7fc640 1 -- 172.21.15.37:0/3320225376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4708019aa0 con 0x564083e08d80 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f46fe7fc640 1 -- 172.21.15.37:0/3320225376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f4708028040 con 0x564083e08d80 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4723fc5740 10 client.15819 fetch_fsmap learned FSMap version 37 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.734+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564084275110 con 0x564083e08d80 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f46fe7fc640 1 -- 172.21.15.37:0/3320225376 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47100aa3b0 con 0x564083e08d80 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f46fe7fc640 1 -- 172.21.15.37:0/3320225376 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f4708004520 con 0x564083e08d80 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f4723fc5740 10 client.15819 fetch_fsmap finished waiting for FSMap version 37 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f4723fc5740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f4723fc5740 20 client.15819 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e4a1b0 0x564084277aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f4723fc5740 4 client.15819 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56408415a240 con 0x564083e4a1b0 2024-05-09T01:05:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.735+0000 7f470ffff640 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e4a1b0 0x564084277aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.736+0000 7f470ffff640 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e4a1b0 0x564084277aa0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56a969d43e21b46b server_cookie=383a7f46300a9adb in_seq=0 out_seq=0 2024-05-09T01:05:24.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.736+0000 7f46fe7fc640 10 client.15819 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:24.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.745+0000 7f46fe7fc640 1 -- 172.21.15.37:0/3320225376 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56408415a240 con 0x564083e4a1b0 2024-05-09T01:05:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.745+0000 7f46fe7fc640 10 client.15819 handle_command_reply: tid=0 2024-05-09T01:05:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.745+0000 7f4723fc5740 1 client.15819 shutdown 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.745+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 msgr2=0x564084208300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.745+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084208300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4708006010 tx=0x7f4708011d80 comp rx=0 tx=0).stop 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.745+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 shutdown_connections 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.745+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564083e4a1b0 0x564084277aa0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564083e294d0 0x564084204fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f46fe7fc640 0 client.15819 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564083e212f0 0x564084208840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f4723fc5740 1 --2- 172.21.15.37:0/3320225376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564083e08d80 0x564084208300 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 >> 172.21.15.37:0/3320225376 conn(0x564083e3e300 msgr2=0x5640841ea0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 shutdown_connections 2024-05-09T01:05:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f4723fc5740 1 -- 172.21.15.37:0/3320225376 wait complete. 2024-05-09T01:05:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.746+0000 7f4723fc5740 20 client.15819 trim_cache size 0 max 16384 2024-05-09T01:05:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:05:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:05:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47040b2860 msgr2=0x7f47040b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47040b2860 0x7f47040b4d70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4700032fd0 tx=0x7f4700005890 comp rx=0 tx=0).stop 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47181099f0 msgr2=0x7f47181a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47181099f0 0x7f47181a14c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f471000eb10 tx=0x7f471000c2d0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 shutdown_connections 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47181099f0 0x7f47181a14c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f47040b2860 0x7f47040b4d70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4718104cf0 0x7f471819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 --2- 172.21.15.37:0/2250858117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4718103ab0 0x7f4718199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 >> 172.21.15.37:0/2250858117 conn(0x7f47180fecc0 msgr2=0x7f47181010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.748+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 shutdown_connections 2024-05-09T01:05:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:24.749+0000 7f471c914640 1 -- 172.21.15.37:0/2250858117 wait complete. 2024-05-09T01:05:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 185.0 s, 3371.6 tps, lat 29.885 ms stddev 38.283 2024-05-09T01:05:26.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:26 smithi037 ceph-mon[30122]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 10 MiB/s wr, 857 op/s 2024-05-09T01:05:26.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:26 smithi151 ceph-mon[34780]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 10 MiB/s wr, 857 op/s 2024-05-09T01:05:26.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:26 smithi136 ceph-mon[34110]: pgmap v494: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 10 MiB/s wr, 857 op/s 2024-05-09T01:05:28.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:28 smithi037 ceph-mon[30122]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 11 MiB/s wr, 879 op/s 2024-05-09T01:05:28.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:05:28.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:05:28.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:05:28.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:28 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:05:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:28 smithi151 ceph-mon[34780]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 11 MiB/s wr, 879 op/s 2024-05-09T01:05:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:05:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:05:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:05:28.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:28 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:05:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:28 smithi136 ceph-mon[34110]: pgmap v495: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 11 MiB/s wr, 879 op/s 2024-05-09T01:05:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:05:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:05:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:05:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:28 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:05:29.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:29 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:05:29.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:29 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:29.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:29 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:05:29.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:29 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:29 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:05:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:29 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:05:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 190.0 s, 2969.8 tps, lat 33.671 ms stddev 41.655 2024-05-09T01:05:30.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:30 smithi037 ceph-mon[30122]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 10 MiB/s wr, 825 op/s 2024-05-09T01:05:30.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:30 smithi151 ceph-mon[34780]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 10 MiB/s wr, 825 op/s 2024-05-09T01:05:30.528 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:30 smithi136 ceph-mon[34110]: pgmap v496: 97 pgs: 97 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 10 MiB/s wr, 825 op/s 2024-05-09T01:05:32.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:32 smithi037 ceph-mon[30122]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-05-09T01:05:32.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:32 smithi151 ceph-mon[34780]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-05-09T01:05:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:32 smithi136 ceph-mon[34110]: pgmap v497: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-05-09T01:05:34.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:34 smithi037 ceph-mon[30122]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-05-09T01:05:34.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:34 smithi151 ceph-mon[34780]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-05-09T01:05:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:34 smithi136 ceph-mon[34110]: pgmap v498: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 11 MiB/s wr, 813 op/s 2024-05-09T01:05:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 195.0 s, 3486.2 tps, lat 28.580 ms stddev 31.822 2024-05-09T01:05:36.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:36 smithi037 ceph-mon[30122]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 796 op/s 2024-05-09T01:05:36.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:36 smithi151 ceph-mon[34780]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 796 op/s 2024-05-09T01:05:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:36 smithi136 ceph-mon[34110]: pgmap v499: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 796 op/s 2024-05-09T01:05:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.907+0000 7f40aaa3b640 1 -- 172.21.15.37:0/3503809218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 msgr2=0x7f40a410d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.907+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/3503809218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 0x7f40a410d140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4094009900 tx=0x7f409402a410 comp rx=0 tx=0).stop 2024-05-09T01:05:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.908+0000 7f40aaa3b640 1 -- 172.21.15.37:0/3503809218 shutdown_connections 2024-05-09T01:05:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.908+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/3503809218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40a4112380 0x7f40a41147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.908+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/3503809218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a410d680 0x7f40a410da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.908+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/3503809218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 0x7f40a410d140 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.908+0000 7f40aaa3b640 1 -- 172.21.15.37:0/3503809218 >> 172.21.15.37:0/3503809218 conn(0x7f40a4072860 msgr2=0x7f40a4109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.908+0000 7f40aaa3b640 1 -- 172.21.15.37:0/3503809218 shutdown_connections 2024-05-09T01:05:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.908+0000 7f40aaa3b640 1 -- 172.21.15.37:0/3503809218 wait complete. 2024-05-09T01:05:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.909+0000 7f40aaa3b640 1 Processor -- start 2024-05-09T01:05:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.909+0000 7f40aaa3b640 1 -- start start 2024-05-09T01:05:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40aaa3b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 0x7f40a41a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40aaa3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40a410d680 0x7f40a41a3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40aaa3b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a4112380 0x7f40a41aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40aaa3b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4117fe0 con 0x7f40a410d680 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40aaa3b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4117e60 con 0x7f40a4112380 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40aaa3b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4118160 con 0x7f40a410c440 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a4112380 0x7f40a41aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40a410d680 0x7f40a41a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a4112380 0x7f40a41aa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50004/0 (socket says 172.21.15.37:50004) 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 -- 172.21.15.37:0/73898483 learned_addr learned my addr 172.21.15.37:0/73898483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a3fff640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 0x7f40a41a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 -- 172.21.15.37:0/73898483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 msgr2=0x7f40a41a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 0x7f40a41a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 -- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40a410d680 msgr2=0x7f40a41a3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40a410d680 0x7f40a41a3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.910+0000 7f40a8fd8640 1 -- 172.21.15.37:0/73898483 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a41aa750 con 0x7f40a4112380 2024-05-09T01:05:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.911+0000 7f40a8fd8640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a4112380 0x7f40a41aa0e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f409c00eb10 tx=0x7f409c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.911+0000 7f40a17fa640 1 -- 172.21.15.37:0/73898483 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c004b20 con 0x7f40a4112380 2024-05-09T01:05:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.911+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a406ca40 con 0x7f40a4112380 2024-05-09T01:05:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.911+0000 7f40a17fa640 1 -- 172.21.15.37:0/73898483 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c004cc0 con 0x7f40a4112380 2024-05-09T01:05:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.911+0000 7f40a17fa640 1 -- 172.21.15.37:0/73898483 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c010690 con 0x7f40a4112380 2024-05-09T01:05:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.911+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a406d010 con 0x7f40a4112380 2024-05-09T01:05:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.916+0000 7f40b19c9740 1 Processor -- start 2024-05-09T01:05:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40a17fa640 1 -- 172.21.15.37:0/73898483 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f409c0108f0 con 0x7f40a4112380 2024-05-09T01:05:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40b19c9740 1 -- start start 2024-05-09T01:05:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986c11b0 0x555898a65500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986982f0 0x555898a65a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40b19c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5558989c97c0 con 0x5558986a04d0 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40b19c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5558989650e0 con 0x5558986c11b0 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.917+0000 7f40b19c9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5558989c5780 con 0x5558986982f0 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986c11b0 0x555898a65500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986c11b0 0x555898a65500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50016/0 (socket says 172.21.15.37:50016) 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 -- 172.21.15.37:0/3250452844 learned_addr learned my addr 172.21.15.37:0/3250452844 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 -- 172.21.15.37:0/3250452844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986982f0 msgr2=0x555898a65a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:05:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986982f0 0x555898a65a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 -- 172.21.15.37:0/3250452844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 msgr2=0x555898a6c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 -- 172.21.15.37:0/3250452844 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589898e7c0 con 0x5558986c11b0 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.918+0000 7f40a37fe640 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986c11b0 0x555898a65500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4098019a40 tx=0x7f409800d980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec9be378aa7a2f2b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.919+0000 7f40a17fa640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f408c0b27e0 0x7f408c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.919+0000 7f408a7fc640 1 -- 172.21.15.37:0/3250452844 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098022070 con 0x5558986c11b0 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.919+0000 7f408a7fc640 1 -- 172.21.15.37:0/3250452844 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4098012c00 con 0x5558986c11b0 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.919+0000 7f40a17fa640 1 -- 172.21.15.37:0/73898483 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f409c0e2770 con 0x7f40a4112380 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.919+0000 7f408a7fc640 1 -- 172.21.15.37:0/3250452844 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409801da90 con 0x5558986c11b0 2024-05-09T01:05:37.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.920+0000 7f40a3fff640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f408c0b27e0 0x7f408c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.920+0000 7f40b19c9740 1 -- 172.21.15.37:0/3250452844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986c11b0 msgr2=0x555898a65500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.920+0000 7f40b19c9740 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986c11b0 0x555898a65500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4098019a40 tx=0x7f409800d980 comp rx=0 tx=0).stop 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.920+0000 7f40b19c9740 1 -- 172.21.15.37:0/3250452844 shutdown_connections 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.920+0000 7f40b19c9740 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.921+0000 7f40b19c9740 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986982f0 0x555898a65a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.921+0000 7f40b19c9740 1 --2- 172.21.15.37:0/3250452844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986c11b0 0x555898a65500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.921+0000 7f40b19c9740 1 -- 172.21.15.37:0/3250452844 >> 172.21.15.37:0/3250452844 conn(0x5558986b5300 msgr2=0x555898a60e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.921+0000 7f40a3fff640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f408c0b27e0 0x7f408c0b4cf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4094009230 tx=0x7f4094031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.921+0000 7f40b19c9740 1 -- 172.21.15.37:0/3250452844 shutdown_connections 2024-05-09T01:05:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.921+0000 7f40b19c9740 1 -- 172.21.15.37:0/3250452844 wait complete. 2024-05-09T01:05:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.922+0000 7f40b19c9740 1 -- start start 2024-05-09T01:05:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.923+0000 7f40b19c9740 1 Processor -- start 2024-05-09T01:05:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.923+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a6f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986c11b0 0x555898a76840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40a3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a6f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40b19c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555898a6d3c0 con 0x5558986a04d0 2024-05-09T01:05:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40b19c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5558989509c0 con 0x5558986982f0 2024-05-09T01:05:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40a3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a6f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50030/0 (socket says 172.21.15.37:50030) 2024-05-09T01:05:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40a3fff640 1 -- 172.21.15.37:0/2584638553 learned_addr learned my addr 172.21.15.37:0/2584638553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40a37fe640 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555898a6d540 con 0x5558986c11b0 2024-05-09T01:05:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.924+0000 7f40b19c9740 10 client.0 _ll_register_callbacks cb 0x55589897d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40a8fd8640 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986c11b0 0x555898a76840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40a3fff640 1 -- 172.21.15.37:0/2584638553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986c11b0 msgr2=0x555898a76840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40a3fff640 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986c11b0 0x555898a76840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40a3fff640 1 -- 172.21.15.37:0/2584638553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 msgr2=0x555898a6f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40a3fff640 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40a3fff640 1 -- 172.21.15.37:0/2584638553 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558989771f0 con 0x5558986982f0 2024-05-09T01:05:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40a3fff640 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a6f3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40a410bd10 tx=0x7f4094009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6588d5585ef6a0a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.925+0000 7f40837fe640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.926+0000 7f40837fe640 1 -- 172.21.15.37:0/2584638553 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409404b020 con 0x5558986982f0 2024-05-09T01:05:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.926+0000 7f40837fe640 1 -- 172.21.15.37:0/2584638553 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4094004310 con 0x5558986982f0 2024-05-09T01:05:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.926+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4098012c00 con 0x5558986982f0 2024-05-09T01:05:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.926+0000 7f40837fe640 1 -- 172.21.15.37:0/2584638553 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4094035050 con 0x5558986982f0 2024-05-09T01:05:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.926+0000 7f40b19c9740 10 client.25577 fetch_fsmap learned FSMap version 38 2024-05-09T01:05:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.926+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55589872c790 con 0x5558986982f0 2024-05-09T01:05:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40837fe640 1 -- 172.21.15.37:0/2584638553 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40940054f0 con 0x5558986982f0 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40837fe640 1 -- 172.21.15.37:0/2584638553 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f40940035f0 con 0x5558986982f0 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40b19c9740 10 client.25577 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40b19c9740 10 client.25577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40b19c9740 20 client.25577 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40b19c9740 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55589867fd80 0x555898a7ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40b19c9740 4 client.25577 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.927+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4098012c00 con 0x55589867fd80 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.928+0000 7f40a37fe640 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55589867fd80 0x555898a7ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.928+0000 7f40837fe640 10 client.25577 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.929+0000 7f40a37fe640 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55589867fd80 0x555898a7ca90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3201433a19c4d35b server_cookie=6db2fc9dcd039871 in_seq=0 out_seq=0 2024-05-09T01:05:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.930+0000 7f40837fe640 1 -- 172.21.15.37:0/2584638553 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f4098012c00 con 0x55589867fd80 2024-05-09T01:05:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.930+0000 7f40837fe640 10 client.25577 handle_command_reply: tid=0 2024-05-09T01:05:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.930+0000 7f40b19c9740 1 client.25577 shutdown 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 msgr2=0x555898a6f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a6f3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f40a410bd10 tx=0x7f4094009260 comp rx=0 tx=0).stop 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 shutdown_connections 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55589867fd80 0x555898a7ca90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986c11b0 0x555898a76840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986a04d0 0x555898a6f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 --2- 172.21.15.37:0/2584638553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a6f3a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40837fe640 0 client.25577 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 >> 172.21.15.37:0/2584638553 conn(0x5558986b5300 msgr2=0x555898a63da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:37.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.931+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 shutdown_connections 2024-05-09T01:05:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.932+0000 7f40b19c9740 1 -- 172.21.15.37:0/2584638553 wait complete. 2024-05-09T01:05:37.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.932+0000 7f40b19c9740 20 client.25577 trim_cache size 0 max 16384 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.962+0000 7f40b19c9740 1 Processor -- start 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40b19c9740 1 -- start start 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a68ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a6dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 0x555898a60710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40b19c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40a41b19b0 con 0x5558986c11b0 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40b19c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40a41b3520 con 0x5558986982f0 2024-05-09T01:05:37.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40b19c9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f40a41b2080 con 0x5558986a04d0 2024-05-09T01:05:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a6dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a6dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40736/0 (socket says 172.21.15.37:40736) 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40a37fe640 1 -- 172.21.15.37:0/565195444 learned_addr learned my addr 172.21.15.37:0/565195444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.963+0000 7f40a8fd8640 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 0x555898a60710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f40a3fff640 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a68ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f40a37fe640 1 -- 172.21.15.37:0/565195444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 msgr2=0x555898a68ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f40a37fe640 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a68ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f40a37fe640 1 -- 172.21.15.37:0/565195444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 msgr2=0x555898a60710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f40a37fe640 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 0x555898a60710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f40a37fe640 1 -- 172.21.15.37:0/565195444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558987a35f0 con 0x5558986a04d0 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f40a37fe640 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a6dff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4098020040 tx=0x7f409800d320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f691b84cd7727c50 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f4089ffb640 1 -- 172.21.15.37:0/565195444 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409802d020 con 0x5558986a04d0 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.964+0000 7f4089ffb640 1 -- 172.21.15.37:0/565195444 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4098012750 con 0x5558986a04d0 2024-05-09T01:05:37.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.965+0000 7f4089ffb640 1 -- 172.21.15.37:0/565195444 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098022040 con 0x5558986a04d0 2024-05-09T01:05:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.966+0000 7f40b19c9740 1 -- 172.21.15.37:0/565195444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 msgr2=0x555898a6dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.966+0000 7f40b19c9740 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a6dff0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4098020040 tx=0x7f409800d320 comp rx=0 tx=0).stop 2024-05-09T01:05:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.966+0000 7f40b19c9740 1 -- 172.21.15.37:0/565195444 shutdown_connections 2024-05-09T01:05:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.966+0000 7f40b19c9740 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 0x555898a60710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.966+0000 7f40b19c9740 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a6dff0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.966+0000 7f40b19c9740 1 --2- 172.21.15.37:0/565195444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a68ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.966+0000 7f40b19c9740 1 -- 172.21.15.37:0/565195444 >> 172.21.15.37:0/565195444 conn(0x5558986b5300 msgr2=0x555898a6d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.967+0000 7f40b19c9740 1 -- 172.21.15.37:0/565195444 shutdown_connections 2024-05-09T01:05:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.967+0000 7f40b19c9740 1 -- 172.21.15.37:0/565195444 wait complete. 2024-05-09T01:05:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.967+0000 7f40b19c9740 1 -- start start 2024-05-09T01:05:37.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 1 Processor -- start 2024-05-09T01:05:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a73e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a74360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 0x555898aeb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40a41b2e50 con 0x5558986c11b0 2024-05-09T01:05:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40a41b2750 con 0x5558986982f0 2024-05-09T01:05:37.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f40a41afa10 con 0x5558986a04d0 2024-05-09T01:05:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40b19c9740 10 client.0 _ll_register_callbacks cb 0x7f409403f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a74360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40a37fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a74360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40738/0 (socket says 172.21.15.37:40738) 2024-05-09T01:05:37.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.968+0000 7f40a37fe640 1 -- 172.21.15.37:0/499730252 learned_addr learned my addr 172.21.15.37:0/499730252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.969+0000 7f40a37fe640 1 -- 172.21.15.37:0/499730252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 msgr2=0x555898a73e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.969+0000 7f40a37fe640 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a73e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.969+0000 7f40a37fe640 1 -- 172.21.15.37:0/499730252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 msgr2=0x555898aeb640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.969+0000 7f40a37fe640 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 0x555898aeb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.969+0000 7f40a37fe640 1 -- 172.21.15.37:0/499730252 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55589898ded0 con 0x5558986a04d0 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.969+0000 7f40a37fe640 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a74360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f409800d7a0 tx=0x7f4098006e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46ba560a4be54c09 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.969+0000 7f40837fe640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.970+0000 7f40837fe640 1 -- 172.21.15.37:0/499730252 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098022070 con 0x5558986a04d0 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.970+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4098012750 con 0x5558986a04d0 2024-05-09T01:05:37.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.970+0000 7f40837fe640 1 -- 172.21.15.37:0/499730252 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4098012b10 con 0x5558986a04d0 2024-05-09T01:05:37.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40837fe640 1 -- 172.21.15.37:0/499730252 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f4098012d10 con 0x5558986a04d0 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 10 client.25597 fetch_fsmap learned FSMap version 38 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x555898aeca20 con 0x5558986a04d0 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40837fe640 1 -- 172.21.15.37:0/499730252 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4098012750 con 0x5558986a04d0 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40837fe640 1 -- 172.21.15.37:0/499730252 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f4098003af0 con 0x5558986a04d0 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 10 client.25597 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 10 client.25597 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 20 client.25597 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5558986551c0 0x555898aef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 4 client.25597 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.971+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5558989d73d0 con 0x5558986551c0 2024-05-09T01:05:37.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.972+0000 7f40a3fff640 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5558986551c0 0x555898aef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.973+0000 7f40a3fff640 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5558986551c0 0x555898aef340 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63ad8f5f208abcf3 server_cookie=5813218a3fb2f27a in_seq=0 out_seq=0 2024-05-09T01:05:37.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.973+0000 7f40837fe640 10 client.25597 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40837fe640 1 -- 172.21.15.37:0/499730252 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5558989d73d0 con 0x5558986551c0 2024-05-09T01:05:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40837fe640 10 client.25597 handle_command_reply: tid=0 2024-05-09T01:05:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 client.25597 shutdown 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 msgr2=0x555898a74360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a74360 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f409800d7a0 tx=0x7f4098006e70 comp rx=0 tx=0).stop 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 shutdown_connections 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5558986551c0 0x555898aef340 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558986c11b0 0x555898aeb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5558986a04d0 0x555898a74360 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 --2- 172.21.15.37:0/499730252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5558986982f0 0x555898a73e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40837fe640 0 client.25597 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.983+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 >> 172.21.15.37:0/499730252 conn(0x5558986b5300 msgr2=0x555898a6ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.984+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 shutdown_connections 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.984+0000 7f40b19c9740 1 -- 172.21.15.37:0/499730252 wait complete. 2024-05-09T01:05:37.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.984+0000 7f40b19c9740 20 client.25597 trim_cache size 0 max 16384 2024-05-09T01:05:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:05:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:05:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:05:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.984+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f408c0b27e0 msgr2=0x7f408c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.984+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f408c0b27e0 0x7f408c0b4cf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4094009230 tx=0x7f4094031400 comp rx=0 tx=0).stop 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a4112380 msgr2=0x7f40a41aa0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a4112380 0x7f40a41aa0e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f409c00eb10 tx=0x7f409c00c2d0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 shutdown_connections 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f408c0b27e0 0x7f408c0b4cf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40a4112380 0x7f40a41aa0e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40a410d680 0x7f40a41a3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 --2- 172.21.15.37:0/73898483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a410c440 0x7f40a41a2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.985+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 >> 172.21.15.37:0/73898483 conn(0x7f40a4072860 msgr2=0x7f40a410e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.986+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 shutdown_connections 2024-05-09T01:05:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:37.986+0000 7f40aaa3b640 1 -- 172.21.15.37:0/73898483 wait complete. 2024-05-09T01:05:38.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:38 smithi037 ceph-mon[30122]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 750 op/s 2024-05-09T01:05:38.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:38 smithi151 ceph-mon[34780]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 750 op/s 2024-05-09T01:05:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:38 smithi136 ceph-mon[34110]: pgmap v500: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 MiB/s wr, 750 op/s 2024-05-09T01:05:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 200.0 s, 4030.8 tps, lat 24.851 ms stddev 28.724 2024-05-09T01:05:40.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:40 smithi037 ceph-mon[30122]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 745 op/s 2024-05-09T01:05:40.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:40 smithi151 ceph-mon[34780]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 745 op/s 2024-05-09T01:05:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:40 smithi136 ceph-mon[34110]: pgmap v501: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 745 op/s 2024-05-09T01:05:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:42 smithi037 ceph-mon[30122]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 MiB/s wr, 742 op/s 2024-05-09T01:05:42.486 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:42 smithi151 ceph-mon[34780]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 MiB/s wr, 742 op/s 2024-05-09T01:05:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:42 smithi136 ceph-mon[34110]: pgmap v502: 97 pgs: 97 active+clean; 1.5 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 MiB/s wr, 742 op/s 2024-05-09T01:05:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:44 smithi037 ceph-mon[30122]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 816 op/s 2024-05-09T01:05:44.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:44 smithi151 ceph-mon[34780]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 816 op/s 2024-05-09T01:05:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:44 smithi136 ceph-mon[34110]: pgmap v503: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 816 op/s 2024-05-09T01:05:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 205.0 s, 3469.8 tps, lat 28.746 ms stddev 31.187 2024-05-09T01:05:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:46 smithi136 ceph-mon[34110]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-05-09T01:05:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:46 smithi037 ceph-mon[30122]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-05-09T01:05:46.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:46 smithi151 ceph-mon[34780]: pgmap v504: 97 pgs: 97 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-05-09T01:05:47.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:47 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:05:47.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:47 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:05:47.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:47 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:05:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:48 smithi037 ceph-mon[30122]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 767 op/s 2024-05-09T01:05:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:48 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:05:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:48 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:05:48.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:48 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:05:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:48 smithi136 ceph-mon[34110]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 767 op/s 2024-05-09T01:05:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:48 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:05:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:48 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:05:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:48 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:05:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:48 smithi151 ceph-mon[34780]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 767 op/s 2024-05-09T01:05:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:48 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:05:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:48 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:05:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:48 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:05:49.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:05:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 210.0 s, 2815.6 tps, lat 35.442 ms stddev 44.677 2024-05-09T01:05:50.331 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:50.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:50 smithi037 ceph-mon[30122]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.6 MiB/s wr, 761 op/s 2024-05-09T01:05:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:50 smithi136 ceph-mon[34110]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.6 MiB/s wr, 761 op/s 2024-05-09T01:05:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:50 smithi151 ceph-mon[34780]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.6 MiB/s wr, 761 op/s 2024-05-09T01:05:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.148+0000 7f9b7868b640 1 -- 172.21.15.37:0/143952457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b70104ec0 msgr2=0x7f9b701052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.148+0000 7f9b7868b640 1 --2- 172.21.15.37:0/143952457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b70104ec0 0x7f9b701052d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009900 tx=0x7f9b6c02a410 comp rx=0 tx=0).stop 2024-05-09T01:05:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.149+0000 7f9b7868b640 1 -- 172.21.15.37:0/143952457 shutdown_connections 2024-05-09T01:05:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.149+0000 7f9b7868b640 1 --2- 172.21.15.37:0/143952457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 0x7f9b7010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.149+0000 7f9b7868b640 1 --2- 172.21.15.37:0/143952457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b70104ec0 0x7f9b701052d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.149+0000 7f9b7868b640 1 --2- 172.21.15.37:0/143952457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b70103c80 0x7f9b70104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.149+0000 7f9b7868b640 1 -- 172.21.15.37:0/143952457 >> 172.21.15.37:0/143952457 conn(0x7f9b700fee50 msgr2=0x7f9b70101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.152+0000 7f9b7868b640 1 -- 172.21.15.37:0/143952457 shutdown_connections 2024-05-09T01:05:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.153+0000 7f9b7868b640 1 -- 172.21.15.37:0/143952457 wait complete. 2024-05-09T01:05:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 Processor -- start 2024-05-09T01:05:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 -- start start 2024-05-09T01:05:51.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b70103c80 0x7f9b70197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b70104ec0 0x7f9b701984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 0x7f9b7019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7010f850 con 0x7f9b70103c80 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7010f6d0 con 0x7f9b70104ec0 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.154+0000 7f9b7868b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7010f9d0 con 0x7f9b70109bc0 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.155+0000 7f9b76c28640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 0x7f9b7019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.155+0000 7f9b76c28640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 0x7f9b7019f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:50774/0 (socket says 172.21.15.37:50774) 2024-05-09T01:05:51.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.155+0000 7f9b76c28640 1 -- 172.21.15.37:0/1236244125 learned_addr learned my addr 172.21.15.37:0/1236244125 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.155+0000 7f9b75c26640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b70104ec0 0x7f9b701984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.157+0000 7f9b76c28640 1 -- 172.21.15.37:0/1236244125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b70104ec0 msgr2=0x7f9b701984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.157+0000 7f9b76c28640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b70104ec0 0x7f9b701984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.157+0000 7f9b76c28640 1 -- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b70103c80 msgr2=0x7f9b70197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.157+0000 7f9b76c28640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b70103c80 0x7f9b70197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.157+0000 7f9b76c28640 1 -- 172.21.15.37:0/1236244125 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7019fad0 con 0x7f9b70109bc0 2024-05-09T01:05:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.157+0000 7f9b76c28640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 0x7f9b7019f460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800b970 tx=0x7f9b6800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.162+0000 7f9b677fe640 1 -- 172.21.15.37:0/1236244125 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b68019070 con 0x7f9b70109bc0 2024-05-09T01:05:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.162+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7019fdc0 con 0x7f9b70109bc0 2024-05-09T01:05:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.163+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b701a0390 con 0x7f9b70109bc0 2024-05-09T01:05:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.163+0000 7f9b677fe640 1 -- 172.21.15.37:0/1236244125 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b68014440 con 0x7f9b70109bc0 2024-05-09T01:05:51.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.164+0000 7f9b677fe640 1 -- 172.21.15.37:0/1236244125 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b680075d0 con 0x7f9b70109bc0 2024-05-09T01:05:51.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.168+0000 7f9b7f614740 1 Processor -- start 2024-05-09T01:05:51.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.172+0000 7f9b7f614740 1 -- start start 2024-05-09T01:05:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.173+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193d71b0 0x55eb1977b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.173+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193ae2f0 0x55eb1977ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.173+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193b64d0 0x55eb19782980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.175+0000 7f9b75c26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193d71b0 0x55eb1977b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.175+0000 7f9b75c26640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193d71b0 0x55eb1977b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33416/0 (socket says 172.21.15.37:33416) 2024-05-09T01:05:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.175+0000 7f9b76427640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193ae2f0 0x55eb1977ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.176+0000 7f9b76427640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193ae2f0 0x55eb1977ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:50776/0 (socket says 172.21.15.37:50776) 2024-05-09T01:05:51.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.176+0000 7f9b677fe640 1 -- 172.21.15.37:0/1236244125 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9b6801c070 con 0x7f9b70109bc0 2024-05-09T01:05:51.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.177+0000 7f9b677fe640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b5c0b28d0 0x7f9b5c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.178+0000 7f9b75c26640 1 -- 172.21.15.37:0/3525573362 learned_addr learned my addr 172.21.15.37:0/3525573362 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.178+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb196df7c0 con 0x55eb193d71b0 2024-05-09T01:05:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.178+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55eb1967b0e0 con 0x55eb193b64d0 2024-05-09T01:05:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.178+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55eb196db780 con 0x55eb193ae2f0 2024-05-09T01:05:51.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.178+0000 7f9b677fe640 1 -- 172.21.15.37:0/1236244125 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9b680e1620 con 0x7f9b70109bc0 2024-05-09T01:05:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.179+0000 7f9b75c26640 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193b64d0 0x55eb19782980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.179+0000 7f9b76427640 1 -- 172.21.15.37:0/3525573362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193b64d0 msgr2=0x55eb19782980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.179+0000 7f9b76427640 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193b64d0 0x55eb19782980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.179+0000 7f9b76427640 1 -- 172.21.15.37:0/3525573362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193d71b0 msgr2=0x55eb1977b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.179+0000 7f9b76427640 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193d71b0 0x55eb1977b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.179+0000 7f9b76427640 1 -- 172.21.15.37:0/3525573362 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb196a47c0 con 0x55eb193ae2f0 2024-05-09T01:05:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.180+0000 7f9b76c28640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b5c0b28d0 0x7f9b5c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.180+0000 7f9b75c26640 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193b64d0 0x55eb19782980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.181+0000 7f9b76427640 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193ae2f0 0x55eb1977ba80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9b70103550 tx=0x7f9b6000e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915f30953b62ec60 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:51.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.182+0000 7f9b76c28640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b5c0b28d0 0x7f9b5c0b4de0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b680a8c80 tx=0x7f9b68004b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.182+0000 7f9b64bfe640 1 -- 172.21.15.37:0/3525573362 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000ed80 con 0x55eb193ae2f0 2024-05-09T01:05:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.182+0000 7f9b64bfe640 1 -- 172.21.15.37:0/3525573362 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b600054d0 con 0x55eb193ae2f0 2024-05-09T01:05:51.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.182+0000 7f9b64bfe640 1 -- 172.21.15.37:0/3525573362 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60010690 con 0x55eb193ae2f0 2024-05-09T01:05:51.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.183+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193ae2f0 msgr2=0x55eb1977ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.183+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193ae2f0 0x55eb1977ba80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9b70103550 tx=0x7f9b6000e350 comp rx=0 tx=0).stop 2024-05-09T01:05:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.183+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 shutdown_connections 2024-05-09T01:05:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.183+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193b64d0 0x55eb19782980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.184+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193ae2f0 0x55eb1977ba80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.184+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3525573362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193d71b0 0x55eb1977b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.184+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 >> 172.21.15.37:0/3525573362 conn(0x55eb193cb300 msgr2=0x55eb19776e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:51.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.185+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 shutdown_connections 2024-05-09T01:05:51.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.185+0000 7f9b7f614740 1 -- 172.21.15.37:0/3525573362 wait complete. 2024-05-09T01:05:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.189+0000 7f9b7f614740 1 -- start start 2024-05-09T01:05:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.189+0000 7f9b7f614740 1 Processor -- start 2024-05-09T01:05:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193ae2f0 0x55eb197852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193b64d0 0x55eb19785800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193d71b0 0x55eb1978c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b7f614740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb197833d0 con 0x55eb193ae2f0 2024-05-09T01:05:51.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b7f614740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55eb196669c0 con 0x55eb193d71b0 2024-05-09T01:05:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b7f614740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55eb19783550 con 0x55eb193b64d0 2024-05-09T01:05:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b7f614740 10 client.0 _ll_register_callbacks cb 0x55eb19693020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b75c26640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193d71b0 0x55eb1978c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b75c26640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193d71b0 0x55eb1978c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49086/0 (socket says 172.21.15.37:49086) 2024-05-09T01:05:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.190+0000 7f9b75c26640 1 -- 172.21.15.37:0/3446766815 learned_addr learned my addr 172.21.15.37:0/3446766815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.191+0000 7f9b76427640 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193b64d0 0x55eb19785800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.191+0000 7f9b75c26640 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193ae2f0 0x55eb197852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.191+0000 7f9b76427640 1 -- 172.21.15.37:0/3446766815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193d71b0 msgr2=0x55eb1978c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.191+0000 7f9b76427640 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193d71b0 0x55eb1978c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.191+0000 7f9b76427640 1 -- 172.21.15.37:0/3446766815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193ae2f0 msgr2=0x55eb197852c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.191+0000 7f9b76427640 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193ae2f0 0x55eb197852c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.191+0000 7f9b76427640 1 -- 172.21.15.37:0/3446766815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb1968d1f0 con 0x55eb193b64d0 2024-05-09T01:05:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.192+0000 7f9b76427640 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193b64d0 0x55eb19785800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b60005710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a12add140587d64a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.192+0000 7f9b59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:05:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.192+0000 7f9b59ffb640 1 -- 172.21.15.37:0/3446766815 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60025020 con 0x55eb193b64d0 2024-05-09T01:05:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.192+0000 7f9b59ffb640 1 -- 172.21.15.37:0/3446766815 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9b60005230 con 0x55eb193b64d0 2024-05-09T01:05:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.193+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b600054d0 con 0x55eb193b64d0 2024-05-09T01:05:51.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.193+0000 7f9b59ffb640 1 -- 172.21.15.37:0/3446766815 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9b6000eb80 con 0x55eb193b64d0 2024-05-09T01:05:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.194+0000 7f9b7f614740 10 client.25606 fetch_fsmap learned FSMap version 38 2024-05-09T01:05:51.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.194+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55eb19442790 con 0x55eb193b64d0 2024-05-09T01:05:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.195+0000 7f9b59ffb640 1 -- 172.21.15.37:0/3446766815 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b600054d0 con 0x55eb193b64d0 2024-05-09T01:05:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.195+0000 7f9b59ffb640 1 -- 172.21.15.37:0/3446766815 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f9b60018c20 con 0x55eb193b64d0 2024-05-09T01:05:51.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.196+0000 7f9b7f614740 10 client.25606 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:05:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.196+0000 7f9b7f614740 10 client.25606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.196+0000 7f9b7f614740 20 client.25606 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:51.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.196+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb19395d80 0x55eb197a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.197+0000 7f9b7f614740 4 client.25606 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:51.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.197+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb196ed3d0 con 0x55eb19395d80 2024-05-09T01:05:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.197+0000 7f9b75c26640 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb19395d80 0x55eb197a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.198+0000 7f9b75c26640 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb19395d80 0x55eb197a39e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=315c89aa9f32c0b7 server_cookie=b0be1185d9eb6538 in_seq=0 out_seq=0 2024-05-09T01:05:51.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.198+0000 7f9b59ffb640 10 client.25606 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:51.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.198+0000 7f9b59ffb640 1 -- 172.21.15.37:0/3446766815 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55eb196ed3d0 con 0x55eb19395d80 2024-05-09T01:05:51.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.198+0000 7f9b59ffb640 10 client.25606 handle_command_reply: tid=0 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.198+0000 7f9b7f614740 1 client.25606 shutdown 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193b64d0 msgr2=0x55eb19785800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193b64d0 0x55eb19785800 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b60005710 comp rx=0 tx=0).stop 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 shutdown_connections 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb19395d80 0x55eb197a39e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193d71b0 0x55eb1978c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b59ffb640 0 client.25606 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb193b64d0 0x55eb19785800 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.199+0000 7f9b7f614740 1 --2- 172.21.15.37:0/3446766815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193ae2f0 0x55eb197852c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.200+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 >> 172.21.15.37:0/3446766815 conn(0x55eb193cb300 msgr2=0x55eb19775700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.200+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 shutdown_connections 2024-05-09T01:05:51.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.200+0000 7f9b7f614740 1 -- 172.21.15.37:0/3446766815 wait complete. 2024-05-09T01:05:51.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.201+0000 7f9b7f614740 20 client.25606 trim_cache size 0 max 16384 2024-05-09T01:05:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.227+0000 7f9b7f614740 1 Processor -- start 2024-05-09T01:05:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b7f614740 1 -- start start 2024-05-09T01:05:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb19776f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb19783980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 0x55eb19783ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b7f614740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5400e310 con 0x55eb193b64d0 2024-05-09T01:05:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b7f614740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5400fe80 con 0x55eb193ae2f0 2024-05-09T01:05:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b7f614740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5400e9e0 con 0x55eb19395d80 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b75c26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb19776f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b75c26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb19776f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:50788/0 (socket says 172.21.15.37:50788) 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b75c26640 1 -- 172.21.15.37:0/2674887499 learned_addr learned my addr 172.21.15.37:0/2674887499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b76427640 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb19783980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.228+0000 7f9b75c26640 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 0x55eb19783ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b76427640 1 -- 172.21.15.37:0/2674887499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 msgr2=0x55eb19776f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b76427640 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb19776f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b76427640 1 -- 172.21.15.37:0/2674887499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 msgr2=0x55eb19783ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b76427640 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 0x55eb19783ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b76427640 1 -- 172.21.15.37:0/2674887499 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb194b95f0 con 0x55eb193ae2f0 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b75c26640 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb19776f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:05:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b76427640 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb19783980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009b00 tx=0x7f9b6000e850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9d2c97e94109ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b5bfff640 1 -- 172.21.15.37:0/2674887499 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60036020 con 0x55eb193ae2f0 2024-05-09T01:05:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b5bfff640 1 -- 172.21.15.37:0/2674887499 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b600097e0 con 0x55eb193ae2f0 2024-05-09T01:05:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.229+0000 7f9b5bfff640 1 -- 172.21.15.37:0/2674887499 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60025040 con 0x55eb193ae2f0 2024-05-09T01:05:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 -- 172.21.15.37:0/2674887499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 msgr2=0x55eb19783980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb19783980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009b00 tx=0x7f9b6000e850 comp rx=0 tx=0).stop 2024-05-09T01:05:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 -- 172.21.15.37:0/2674887499 shutdown_connections 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 0x55eb19783ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb19783980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 --2- 172.21.15.37:0/2674887499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb19776f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 -- 172.21.15.37:0/2674887499 >> 172.21.15.37:0/2674887499 conn(0x55eb193cb300 msgr2=0x55eb19776850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 -- 172.21.15.37:0/2674887499 shutdown_connections 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.230+0000 7f9b7f614740 1 -- 172.21.15.37:0/2674887499 wait complete. 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.231+0000 7f9b7f614740 1 -- start start 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.231+0000 7f9b7f614740 1 Processor -- start 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.231+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb1978a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb1978ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b7f614740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 0x55eb19809c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b7f614740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5400f7b0 con 0x55eb193b64d0 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b7f614740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5400f0b0 con 0x55eb193ae2f0 2024-05-09T01:05:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b7f614740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9b5400c2f0 con 0x55eb19395d80 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb1978ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb1978ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49112/0 (socket says 172.21.15.37:49112) 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 -- 172.21.15.37:0/1938971977 learned_addr learned my addr 172.21.15.37:0/1938971977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b7f614740 10 client.0 _ll_register_callbacks cb 0x7f9b60009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 -- 172.21.15.37:0/1938971977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 msgr2=0x55eb1978a930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb1978a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 -- 172.21.15.37:0/1938971977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 msgr2=0x55eb19809c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 0x55eb19809c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.232+0000 7f9b76427640 1 -- 172.21.15.37:0/1938971977 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb196a3ed0 con 0x55eb193ae2f0 2024-05-09T01:05:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.233+0000 7f9b76427640 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb1978ae70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000eda0 tx=0x7f9b60009420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dead1f1874f7fb7b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.233+0000 7f9b59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b59ffb640 1 -- 172.21.15.37:0/1938971977 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60040060 con 0x55eb193ae2f0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b59ffb640 1 -- 172.21.15.37:0/1938971977 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9b60005230 con 0x55eb193ae2f0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eb196e7240 con 0x55eb193ae2f0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b59ffb640 1 -- 172.21.15.37:0/1938971977 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9b60036030 con 0x55eb193ae2f0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b7f614740 10 client.25595 fetch_fsmap learned FSMap version 38 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55eb1980afe0 con 0x55eb193ae2f0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b59ffb640 1 -- 172.21.15.37:0/1938971977 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55eb196e7240 con 0x55eb193ae2f0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b59ffb640 1 -- 172.21.15.37:0/1938971977 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f9b60045070 con 0x55eb193ae2f0 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b7f614740 10 client.25595 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b7f614740 10 client.25595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b7f614740 20 client.25595 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.234+0000 7f9b7f614740 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb193d71b0 0x55eb1980d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.235+0000 7f9b7f614740 4 client.25595 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:05:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.235+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb19662350 con 0x55eb193d71b0 2024-05-09T01:05:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.235+0000 7f9b75c26640 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb193d71b0 0x55eb1980d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.235+0000 7f9b75c26640 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb193d71b0 0x55eb1980d970 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbdab54237fc3a9b server_cookie=5417c187f6e7e62b in_seq=0 out_seq=0 2024-05-09T01:05:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.235+0000 7f9b59ffb640 10 client.25595 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b59ffb640 1 -- 172.21.15.37:0/1938971977 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55eb19662350 con 0x55eb193d71b0 2024-05-09T01:05:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b59ffb640 10 client.25595 handle_command_reply: tid=0 2024-05-09T01:05:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 client.25595 shutdown 2024-05-09T01:05:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 msgr2=0x55eb1978ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb1978ae70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000eda0 tx=0x7f9b60009420 comp rx=0 tx=0).stop 2024-05-09T01:05:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 shutdown_connections 2024-05-09T01:05:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eb193d71b0 0x55eb1980d970 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb193b64d0 0x55eb19809c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eb193ae2f0 0x55eb1978ae70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b59ffb640 0 client.25595 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 --2- 172.21.15.37:0/1938971977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eb19395d80 0x55eb1978a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 >> 172.21.15.37:0/1938971977 conn(0x55eb193cb300 msgr2=0x55eb19783980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 shutdown_connections 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 1 -- 172.21.15.37:0/1938971977 wait complete. 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.245+0000 7f9b7f614740 20 client.25595 trim_cache size 0 max 16384 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:05:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b5c0b28d0 msgr2=0x7f9b5c0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b5c0b28d0 0x7f9b5c0b4de0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9b680a8c80 tx=0x7f9b68004b50 comp rx=0 tx=0).stop 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 msgr2=0x7f9b7019f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 0x7f9b7019f460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b6800b970 tx=0x7f9b6800be30 comp rx=0 tx=0).stop 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 shutdown_connections 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b70109bc0 0x7f9b7019f460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9b5c0b28d0 0x7f9b5c0b4de0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9b70104ec0 0x7f9b701984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 --2- 172.21.15.37:0/1236244125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b70103c80 0x7f9b70197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 >> 172.21.15.37:0/1236244125 conn(0x7f9b700fee50 msgr2=0x7f9b700ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 shutdown_connections 2024-05-09T01:05:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:05:51.246+0000 7f9b7868b640 1 -- 172.21.15.37:0/1236244125 wait complete. 2024-05-09T01:05:52.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:52 smithi037 ceph-mon[30122]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 807 op/s 2024-05-09T01:05:52.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.441+0000 7f8bdca5d700 1 -- 172.21.15.37:0/3545419310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 msgr2=0x7f8bd810fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.441+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/3545419310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 0x7f8bd810fd60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc007510 tx=0x7f8bcc00af90 comp rx=0 tx=0).stop 2024-05-09T01:05:52.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.443+0000 7f8bdca5d700 1 -- 172.21.15.37:0/3545419310 shutdown_connections 2024-05-09T01:05:52.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.443+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/3545419310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd81102a0 0x7f8bd8117c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.443+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/3545419310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd810b020 0x7f8bd810b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.443+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/3545419310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 0x7f8bd810fd60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.443+0000 7f8bdca5d700 1 -- 172.21.15.37:0/3545419310 >> 172.21.15.37:0/3545419310 conn(0x7f8bd806f990 msgr2=0x7f8bd806fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:52.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.443+0000 7f8bdca5d700 1 -- 172.21.15.37:0/3545419310 shutdown_connections 2024-05-09T01:05:52.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.443+0000 7f8bdca5d700 1 -- 172.21.15.37:0/3545419310 wait complete. 2024-05-09T01:05:52.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.445+0000 7f8bdca5d700 1 Processor -- start 2024-05-09T01:05:52.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.445+0000 7f8bdca5d700 1 -- start start 2024-05-09T01:05:52.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.446+0000 7f8bdca5d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd810b020 0x7f8bd8115120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.446+0000 7f8bdca5d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 0x7f8bd8115660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.446+0000 7f8bdca5d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd81102a0 0x7f8bd8115ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bd659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd810b020 0x7f8bd8115120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bd659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd810b020 0x7f8bd8115120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42540/0 (socket says 172.21.15.37:42540) 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bd5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 0x7f8bd8115660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bd5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 0x7f8bd8115660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53430/0 (socket says 172.21.15.37:53430) 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bd659c700 1 -- 172.21.15.37:0/1631669116 learned_addr learned my addr 172.21.15.37:0/1631669116 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd811a780 con 0x7f8bd81102a0 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd811a600 con 0x7f8bd810b020 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd81102a0 0x7f8bd8115ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.447+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd811a900 con 0x7f8bd810f950 2024-05-09T01:05:52.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.448+0000 7f8bd659c700 1 -- 172.21.15.37:0/1631669116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 msgr2=0x7f8bd8115660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.448+0000 7f8bd659c700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 0x7f8bd8115660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.449+0000 7f8bd659c700 1 -- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd81102a0 msgr2=0x7f8bd8115ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.449+0000 7f8bd659c700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd81102a0 0x7f8bd8115ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.449+0000 7f8bd659c700 1 -- 172.21.15.37:0/1631669116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd81b5d80 con 0x7f8bd810b020 2024-05-09T01:05:52.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.449+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd81102a0 0x7f8bd8115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:52.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.451+0000 7f8bd659c700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd810b020 0x7f8bd8115120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800e9a0 tx=0x7f8bc800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:52.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.452+0000 7f8bc77fe700 1 -- 172.21.15.37:0/1631669116 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc800cbd0 con 0x7f8bd810b020 2024-05-09T01:05:52.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.452+0000 7f8bc77fe700 1 -- 172.21.15.37:0/1631669116 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc800cd70 con 0x7f8bd810b020 2024-05-09T01:05:52.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.452+0000 7f8bc77fe700 1 -- 172.21.15.37:0/1631669116 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8018680 con 0x7f8bd810b020 2024-05-09T01:05:52.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.452+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd81b6070 con 0x7f8bd810b020 2024-05-09T01:05:52.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.452+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd81b64a0 con 0x7f8bd810b020 2024-05-09T01:05:52.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.457+0000 7f8bc77fe700 1 -- 172.21.15.37:0/1631669116 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8bc8010430 con 0x7f8bd810b020 2024-05-09T01:05:52.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.457+0000 7f8beb473b80 1 Processor -- start 2024-05-09T01:05:52.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.458+0000 7f8beb473b80 1 -- start start 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.458+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 0x560fd50c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.458+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.458+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd50bc6a0 0x560fd50bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.458+0000 7f8beb473b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560fd4fdeff0 con 0x560fd5029160 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.458+0000 7f8beb473b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560fd4f7d7f0 con 0x560fd50bc6a0 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.458+0000 7f8beb473b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560fd4fdafb0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53446/0 (socket says 172.21.15.37:53446) 2024-05-09T01:05:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 -- 172.21.15.37:0/263800640 learned_addr learned my addr 172.21.15.37:0/263800640 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd50bc6a0 0x560fd50bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 -- 172.21.15.37:0/263800640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd50bc6a0 msgr2=0x560fd50bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd50bc6a0 0x560fd50bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 -- 172.21.15.37:0/263800640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 msgr2=0x560fd50c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 0x560fd50c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.459+0000 7f8bd659c700 1 -- 172.21.15.37:0/263800640 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fd4f75370 con 0x560fd4f3f4a0 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.460+0000 7f8bd659c700 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c2a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80dfe60 tx=0x7f8bc80ea840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e564bbbd5b33b911 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.460+0000 7f8bc4ff9700 1 -- 172.21.15.37:0/263800640 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80f6070 con 0x560fd4f3f4a0 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.460+0000 7f8bc4ff9700 1 -- 172.21.15.37:0/263800640 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc80e2dc0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.460+0000 7f8bc4ff9700 1 -- 172.21.15.37:0/263800640 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80eeaf0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 -- 172.21.15.37:0/263800640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 msgr2=0x560fd50c2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c2a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80dfe60 tx=0x7f8bc80ea840 comp rx=0 tx=0).stop 2024-05-09T01:05:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 -- 172.21.15.37:0/263800640 shutdown_connections 2024-05-09T01:05:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd50bc6a0 0x560fd50bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 0x560fd50c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 --2- 172.21.15.37:0/263800640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c2a30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8bc77fe700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8bc00b2900 0x7f8bc00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 -- 172.21.15.37:0/263800640 >> 172.21.15.37:0/263800640 conn(0x560fd4f9f6a0 msgr2=0x560fd50b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8bc77fe700 1 -- 172.21.15.37:0/1631669116 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8bc80e2380 con 0x7f8bd810b020 2024-05-09T01:05:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.462+0000 7f8beb473b80 1 -- 172.21.15.37:0/263800640 shutdown_connections 2024-05-09T01:05:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.463+0000 7f8beb473b80 1 -- 172.21.15.37:0/263800640 wait complete. 2024-05-09T01:05:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.463+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8bc00b2900 0x7f8bc00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.463+0000 7f8beb473b80 1 -- start start 2024-05-09T01:05:52.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 1 Processor -- start 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd4f3f4a0 0x560fd50c6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 0x560fd50c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd50bc6a0 0x560fd50c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560fd4e5aba0 con 0x560fd5029160 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560fd4f99150 con 0x560fd4f3f4a0 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560fd50c91d0 con 0x560fd50bc6a0 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.464+0000 7f8beb473b80 10 client.0 _ll_register_callbacks cb 0x560fd4e506c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd4f3f4a0 0x560fd50c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd4f3f4a0 0x560fd50c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42546/0 (socket says 172.21.15.37:42546) 2024-05-09T01:05:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 -- 172.21.15.37:0/3400901401 learned_addr learned my addr 172.21.15.37:0/3400901401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 0x560fd50c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd50bc6a0 0x560fd50c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 -- 172.21.15.37:0/3400901401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd50bc6a0 msgr2=0x560fd50c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd50bc6a0 0x560fd50c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 -- 172.21.15.37:0/3400901401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 msgr2=0x560fd50c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 0x560fd50c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.465+0000 7f8bd659c700 1 -- 172.21.15.37:0/3400901401 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fd4e5a490 con 0x560fd4f3f4a0 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.466+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd50bc6a0 0x560fd50c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.466+0000 7f8bd659c700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd4f3f4a0 0x560fd50c6180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80a9740 tx=0x7f8bc80ea150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d5fa2d2edf8705e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.466+0000 7f8bbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.466+0000 7f8bbdffb700 1 -- 172.21.15.37:0/3400901401 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80b2040 con 0x560fd4f3f4a0 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.466+0000 7f8bbdffb700 1 -- 172.21.15.37:0/3400901401 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8bc80e2bc0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.466+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bc80e2dc0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.466+0000 7f8bbdffb700 1 -- 172.21.15.37:0/3400901401 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8bc80a5900 con 0x560fd4f3f4a0 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.467+0000 7f8beb473b80 10 client.25607 fetch_fsmap learned FSMap version 38 2024-05-09T01:05:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.467+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560fd50d3c30 con 0x560fd4f3f4a0 2024-05-09T01:05:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.467+0000 7f8bbdffb700 1 -- 172.21.15.37:0/3400901401 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bc80e2dc0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.467+0000 7f8bbdffb700 1 -- 172.21.15.37:0/3400901401 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f8bc80b2410 con 0x560fd4f3f4a0 2024-05-09T01:05:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.468+0000 7f8beb473b80 10 client.25607 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:05:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.468+0000 7f8beb473b80 10 client.25607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.468+0000 7f8beb473b80 20 client.25607 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.468+0000 7f8beb473b80 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd50d6100 0x560fd50d8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.468+0000 7f8beb473b80 4 client.25607 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.468+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fd4fec9d0 con 0x560fd50d6100 2024-05-09T01:05:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.468+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd50d6100 0x560fd50d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.469+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd50d6100 0x560fd50d8520 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbef352c5b5e860a server_cookie=175c42a676c6d13e in_seq=0 out_seq=0 2024-05-09T01:05:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.469+0000 7f8bbdffb700 10 client.25607 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.470+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8bc00b2900 0x7f8bc00b4e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00060b0 tx=0x7f8bd000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.470+0000 7f8bbdffb700 1 -- 172.21.15.37:0/3400901401 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560fd4fec9d0 con 0x560fd50d6100 2024-05-09T01:05:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.470+0000 7f8bbdffb700 10 client.25607 handle_command_reply: tid=0 2024-05-09T01:05:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.470+0000 7f8beb473b80 1 client.25607 shutdown 2024-05-09T01:05:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.470+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd4f3f4a0 msgr2=0x560fd50c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.470+0000 7f8beb473b80 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd4f3f4a0 0x560fd50c6180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80a9740 tx=0x7f8bc80ea150 comp rx=0 tx=0).stop 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.472+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 shutdown_connections 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.472+0000 7f8beb473b80 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd50d6100 0x560fd50d8520 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.472+0000 7f8beb473b80 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd50bc6a0 0x560fd50c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.472+0000 7f8beb473b80 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd4f3f4a0 0x560fd50c6180 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.472+0000 7f8beb473b80 1 --2- 172.21.15.37:0/3400901401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd5029160 0x560fd50c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.472+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 >> 172.21.15.37:0/3400901401 conn(0x560fd4f9f6a0 msgr2=0x560fd50b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.473+0000 7f8bbdffb700 0 client.25607 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.473+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 shutdown_connections 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.473+0000 7f8beb473b80 1 -- 172.21.15.37:0/3400901401 wait complete. 2024-05-09T01:05:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.473+0000 7f8beb473b80 20 client.25607 trim_cache size 0 max 16384 2024-05-09T01:05:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.509+0000 7f8beb473b80 1 Processor -- start 2024-05-09T01:05:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8beb473b80 1 -- start start 2024-05-09T01:05:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50bc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8beb473b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81bdb20 con 0x560fd50bc6a0 2024-05-09T01:05:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8beb473b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81bf690 con 0x560fd5029160 2024-05-09T01:05:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8beb473b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81be1f0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.510+0000 7f8bd5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50bc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50bc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42562/0 (socket says 172.21.15.37:42562) 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/1169275542 learned_addr learned my addr 172.21.15.37:0/1169275542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd659c700 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/1169275542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 msgr2=0x560fd50c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/1169275542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 msgr2=0x560fd50d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/1169275542 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fd50c5f50 con 0x560fd5029160 2024-05-09T01:05:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd659c700 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:05:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd6d9d700 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.511+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50bc0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc007510 tx=0x7f8bcc005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bfdf5150bd3fc07 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.512+0000 7f8bbffff700 1 -- 172.21.15.37:0/1169275542 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc018070 con 0x560fd5029160 2024-05-09T01:05:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.512+0000 7f8bbffff700 1 -- 172.21.15.37:0/1169275542 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bcc02a070 con 0x560fd5029160 2024-05-09T01:05:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.512+0000 7f8bbffff700 1 -- 172.21.15.37:0/1169275542 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc005240 con 0x560fd5029160 2024-05-09T01:05:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.514+0000 7f8beb473b80 1 -- 172.21.15.37:0/1169275542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 msgr2=0x560fd50bc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.514+0000 7f8beb473b80 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50bc0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc007510 tx=0x7f8bcc005fb0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.514+0000 7f8beb473b80 1 -- 172.21.15.37:0/1169275542 shutdown_connections 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.514+0000 7f8beb473b80 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.514+0000 7f8beb473b80 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.514+0000 7f8beb473b80 1 --2- 172.21.15.37:0/1169275542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50bc0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.514+0000 7f8beb473b80 1 -- 172.21.15.37:0/1169275542 >> 172.21.15.37:0/1169275542 conn(0x560fd4f9f6a0 msgr2=0x560fd50c67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 -- 172.21.15.37:0/1169275542 shutdown_connections 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 -- 172.21.15.37:0/1169275542 wait complete. 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 -- start start 2024-05-09T01:05:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 Processor -- start 2024-05-09T01:05:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50db800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50d6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81befc0 con 0x560fd50bc6a0 2024-05-09T01:05:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81be8c0 con 0x560fd5029160 2024-05-09T01:05:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.515+0000 7f8beb473b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd81bbac0 con 0x560fd4f3f4a0 2024-05-09T01:05:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.516+0000 7f8beb473b80 10 client.0 _ll_register_callbacks cb 0x560fd4e506c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.516+0000 7f8bd5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50d6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.516+0000 7f8bd5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50d6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42578/0 (socket says 172.21.15.37:42578) 2024-05-09T01:05:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.516+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/2440553895 learned_addr learned my addr 172.21.15.37:0/2440553895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.516+0000 7f8bd659c700 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50db800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/2440553895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 msgr2=0x560fd50db800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50db800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/2440553895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 msgr2=0x560fd50d71b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d71b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bd5d9b700 1 -- 172.21.15.37:0/2440553895 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fd50d7950 con 0x560fd5029160 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bd659c700 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50db800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bd5d9b700 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50d6b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc000c00 tx=0x7f8bcc003920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699d38017b1ca983 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bbdffb700 1 -- 172.21.15.37:0/2440553895 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc018070 con 0x560fd5029160 2024-05-09T01:05:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.517+0000 7f8bbdffb700 1 -- 172.21.15.37:0/2440553895 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8bcc024040 con 0x560fd5029160 2024-05-09T01:05:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.518+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bcc02a070 con 0x560fd5029160 2024-05-09T01:05:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.518+0000 7f8bbdffb700 1 -- 172.21.15.37:0/2440553895 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8bcc007d80 con 0x560fd5029160 2024-05-09T01:05:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.518+0000 7f8beb473b80 10 client.25613 fetch_fsmap learned FSMap version 38 2024-05-09T01:05:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.518+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x560fd5140600 con 0x560fd5029160 2024-05-09T01:05:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8bbdffb700 1 -- 172.21.15.37:0/2440553895 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bcc02a070 con 0x560fd5029160 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8bbdffb700 1 -- 172.21.15.37:0/2440553895 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f8bcc025ce0 con 0x560fd5029160 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8beb473b80 10 client.25613 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8beb473b80 10 client.25613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8beb473b80 20 client.25613 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8beb473b80 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd5140b70 0x560fd5142f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8beb473b80 4 client.25613 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560fd4fe6a70 con 0x560fd5140b70 2024-05-09T01:05:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.519+0000 7f8bd659c700 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd5140b70 0x560fd5142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.520+0000 7f8bd659c700 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd5140b70 0x560fd5142f90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3448d97d645acfb5 server_cookie=61046afc4e078c9a in_seq=0 out_seq=0 2024-05-09T01:05:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.520+0000 7f8bbdffb700 10 client.25613 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.520+0000 7f8bbdffb700 1 -- 172.21.15.37:0/2440553895 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560fd4fe6a70 con 0x560fd5140b70 2024-05-09T01:05:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.520+0000 7f8bbdffb700 10 client.25613 handle_command_reply: tid=0 2024-05-09T01:05:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.520+0000 7f8beb473b80 1 client.25613 shutdown 2024-05-09T01:05:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.520+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 msgr2=0x560fd50d6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.520+0000 7f8beb473b80 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50d6b60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc000c00 tx=0x7f8bcc003920 comp rx=0 tx=0).stop 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 shutdown_connections 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560fd5140b70 0x560fd5142f90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560fd50bc6a0 0x560fd50d71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560fd4f3f4a0 0x560fd50db800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 --2- 172.21.15.37:0/2440553895 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560fd5029160 0x560fd50d6b60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 >> 172.21.15.37:0/2440553895 conn(0x560fd4f9f6a0 msgr2=0x560fd50bfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8bbdffb700 0 client.25613 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 shutdown_connections 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 1 -- 172.21.15.37:0/2440553895 wait complete. 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.521+0000 7f8beb473b80 20 client.25613 trim_cache size 0 max 16384 2024-05-09T01:05:52.523 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:05:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:05:52.524 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:05:52.524 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:05:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8bc00b2900 msgr2=0x7f8bc00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8bc00b2900 0x7f8bc00b4e10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00060b0 tx=0x7f8bd000b040 comp rx=0 tx=0).stop 2024-05-09T01:05:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd810b020 msgr2=0x7f8bd8115120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd810b020 0x7f8bd8115120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800e9a0 tx=0x7f8bc800ecb0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 shutdown_connections 2024-05-09T01:05:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8bc00b2900 0x7f8bc00b4e10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd81102a0 0x7f8bd8115ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bd810b020 0x7f8bd8115120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 --2- 172.21.15.37:0/1631669116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bd810f950 0x7f8bd8115660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 >> 172.21.15.37:0/1631669116 conn(0x7f8bd806f990 msgr2=0x7f8bd810d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.523+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 shutdown_connections 2024-05-09T01:05:52.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:52.524+0000 7f8bdca5d700 1 -- 172.21.15.37:0/1631669116 wait complete. 2024-05-09T01:05:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:52 smithi136 ceph-mon[34110]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 807 op/s 2024-05-09T01:05:52.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:52 smithi151 ceph-mon[34780]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 807 op/s 2024-05-09T01:05:53.316 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:05:53.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:05:53.677 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:54.461 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:54 smithi037 ceph-mon[30122]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 789 op/s 2024-05-09T01:05:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:54 smithi136 ceph-mon[34110]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 789 op/s 2024-05-09T01:05:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:54 smithi151 ceph-mon[34780]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 789 op/s 2024-05-09T01:05:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 215.0 s, 3244.0 tps, lat 30.932 ms stddev 37.289 2024-05-09T01:05:56.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.049+0000 7fe2646f0700 1 -- 172.21.15.37:0/134343210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c1086d0 msgr2=0x7fe25c110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:56.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.049+0000 7fe2646f0700 1 --2- 172.21.15.37:0/134343210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c1086d0 0x7fe25c110030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b080 tx=0x7fe25400b390 comp rx=0 tx=0).stop 2024-05-09T01:05:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.050+0000 7fe2646f0700 1 -- 172.21.15.37:0/134343210 shutdown_connections 2024-05-09T01:05:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.050+0000 7fe2646f0700 1 --2- 172.21.15.37:0/134343210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c1086d0 0x7fe25c110030 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.050+0000 7fe2646f0700 1 --2- 172.21.15.37:0/134343210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c103a00 0x7fe25c103e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.050+0000 7fe2646f0700 1 --2- 172.21.15.37:0/134343210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe25c107d80 0x7fe25c108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.050+0000 7fe2646f0700 1 -- 172.21.15.37:0/134343210 >> 172.21.15.37:0/134343210 conn(0x7fe25c078370 msgr2=0x7fe25c0787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.051+0000 7fe2646f0700 1 -- 172.21.15.37:0/134343210 shutdown_connections 2024-05-09T01:05:56.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.051+0000 7fe2646f0700 1 -- 172.21.15.37:0/134343210 wait complete. 2024-05-09T01:05:56.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.053+0000 7fe2646f0700 1 Processor -- start 2024-05-09T01:05:56.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.054+0000 7fe2646f0700 1 -- start start 2024-05-09T01:05:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.054+0000 7fe2646f0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c103a00 0x7fe25c118e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:56.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.054+0000 7fe2646f0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe25c107d80 0x7fe25c112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:56.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.054+0000 7fe2646f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c1086d0 0x7fe25c113600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:56.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe26248c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c103a00 0x7fe25c118e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:56.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe26248c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c103a00 0x7fe25c118e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53490/0 (socket says 172.21.15.37:53490) 2024-05-09T01:05:56.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe26248c700 1 -- 172.21.15.37:0/1977213515 learned_addr learned my addr 172.21.15.37:0/1977213515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:56.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1114b0 con 0x7fe25c1086d0 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe261c8b700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe25c107d80 0x7fe25c112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c111330 con 0x7fe25c107d80 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c111630 con 0x7fe25c103a00 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.055+0000 7fe262c8d700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c1086d0 0x7fe25c113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.056+0000 7fe262c8d700 1 -- 172.21.15.37:0/1977213515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c103a00 msgr2=0x7fe25c118e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.056+0000 7fe262c8d700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c103a00 0x7fe25c118e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.056+0000 7fe262c8d700 1 -- 172.21.15.37:0/1977213515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe25c107d80 msgr2=0x7fe25c112f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.056+0000 7fe262c8d700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe25c107d80 0x7fe25c112f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.056+0000 7fe262c8d700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c113da0 con 0x7fe25c1086d0 2024-05-09T01:05:56.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.057+0000 7fe262c8d700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c1086d0 0x7fe25c113600 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe254016000 tx=0x7fe254007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:56.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.059+0000 7fe2537fe700 1 -- 172.21.15.37:0/1977213515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254007cb0 con 0x7fe25c1086d0 2024-05-09T01:05:56.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.059+0000 7fe2537fe700 1 -- 172.21.15.37:0/1977213515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe25401d070 con 0x7fe25c1086d0 2024-05-09T01:05:56.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.059+0000 7fe2537fe700 1 -- 172.21.15.37:0/1977213515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2540116c0 con 0x7fe25c1086d0 2024-05-09T01:05:56.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.060+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c1b5f90 con 0x7fe25c1086d0 2024-05-09T01:05:56.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.061+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c1b6330 con 0x7fe25c1086d0 2024-05-09T01:05:56.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.062+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe25c104990 con 0x7fe25c1086d0 2024-05-09T01:05:56.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.064+0000 7fe2537fe700 1 -- 172.21.15.37:0/1977213515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe254011860 con 0x7fe25c1086d0 2024-05-09T01:05:56.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.065+0000 7fe2537fe700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2480b29c0 0x7fe2480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:56.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.065+0000 7fe2537fe700 1 -- 172.21.15.37:0/1977213515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe2540e30f0 con 0x7fe25c1086d0 2024-05-09T01:05:56.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.065+0000 7fe26248c700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2480b29c0 0x7fe2480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:56.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.066+0000 7fe26248c700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2480b29c0 0x7fe2480b4ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00acf0 tx=0x7fe24c00a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:56.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.069+0000 7fe2537fe700 1 -- 172.21.15.37:0/1977213515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe254015020 con 0x7fe25c1086d0 2024-05-09T01:05:56.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.466+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe25c114460 con 0x7fe25c1086d0 2024-05-09T01:05:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:05:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:05:27.452852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24446,24467,24445,24491,24454]},"id":1}]} 2024-05-09T01:05:56.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.467+0000 7fe2537fe700 1 -- 172.21.15.37:0/1977213515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11937 (secure 0 0 0) 0x7fe2540aafc0 con 0x7fe25c1086d0 2024-05-09T01:05:56.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.471+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2480b29c0 msgr2=0x7fe2480b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.471+0000 7fe2646f0700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2480b29c0 0x7fe2480b4ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00acf0 tx=0x7fe24c00a400 comp rx=0 tx=0).stop 2024-05-09T01:05:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.471+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c1086d0 msgr2=0x7fe25c113600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:56.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.471+0000 7fe2646f0700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c1086d0 0x7fe25c113600 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe254016000 tx=0x7fe254007730 comp rx=0 tx=0).stop 2024-05-09T01:05:56.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 shutdown_connections 2024-05-09T01:05:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2480b29c0 0x7fe2480b4ed0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c1086d0 0x7fe25c113600 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe25c103a00 0x7fe25c118e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 --2- 172.21.15.37:0/1977213515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe25c107d80 0x7fe25c112f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 >> 172.21.15.37:0/1977213515 conn(0x7fe25c078370 msgr2=0x7fe25c0ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 shutdown_connections 2024-05-09T01:05:56.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:56.473+0000 7fe2646f0700 1 -- 172.21.15.37:0/1977213515 wait complete. 2024-05-09T01:05:56.481 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2024-05-09T01:05:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:56 smithi136 ceph-mon[34110]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 675 op/s 2024-05-09T01:05:56.709 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:56 smithi037 ceph-mon[30122]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 675 op/s 2024-05-09T01:05:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:56 smithi151 ceph-mon[34780]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 675 op/s 2024-05-09T01:05:57.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:05:57.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:57 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1977213515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:05:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:05:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:57 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1977213515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:05:57.733 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:57 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1977213515' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:05:58.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:05:58 smithi037 ceph-mon[30122]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 746 op/s 2024-05-09T01:05:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:05:58 smithi136 ceph-mon[34110]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 746 op/s 2024-05-09T01:05:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:05:58 smithi151 ceph-mon[34780]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 746 op/s 2024-05-09T01:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.947+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1367299936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc109860 msgr2=0x7fa9dc1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.947+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1367299936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc109860 0x7fa9dc1111c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009fc0 tx=0x7fa9d400b330 comp rx=0 tx=0).stop 2024-05-09T01:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.947+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1367299936 shutdown_connections 2024-05-09T01:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.947+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1367299936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc109860 0x7fa9dc1111c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.947+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1367299936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9dc1045e0 0x7fa9dc1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.947+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1367299936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9dc108f10 0x7fa9dc109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.947+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1367299936 >> 172.21.15.37:0/1367299936 conn(0x7fa9dc0ffe70 msgr2=0x7fa9dc1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.948+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1367299936 shutdown_connections 2024-05-09T01:05:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.948+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1367299936 wait complete. 2024-05-09T01:05:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.949+0000 7fa9e3c65700 1 Processor -- start 2024-05-09T01:05:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.950+0000 7fa9e3c65700 1 -- start start 2024-05-09T01:05:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.950+0000 7fa9e3c65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9dc1045e0 0x7fa9dc199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e3c65700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc108f10 0x7fa9dc199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e3c65700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9dc109860 0x7fa9dc1a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e3c65700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc114490 con 0x7fa9dc1045e0 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e3c65700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc114310 con 0x7fa9dc109860 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e3c65700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc114610 con 0x7fa9dc108f10 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1a01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9dc1045e0 0x7fa9dc199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc108f10 0x7fa9dc199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc108f10 0x7fa9dc199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53504/0 (socket says 172.21.15.37:53504) 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1a01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9dc1045e0 0x7fa9dc199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53562/0 (socket says 172.21.15.37:53562) 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 -- 172.21.15.37:0/1981962041 learned_addr learned my addr 172.21.15.37:0/1981962041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e2202700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9dc109860 0x7fa9dc1a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 -- 172.21.15.37:0/1981962041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9dc109860 msgr2=0x7fa9dc1a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9dc109860 0x7fa9dc1a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 -- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9dc1045e0 msgr2=0x7fa9dc199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9dc1045e0 0x7fa9dc199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.951+0000 7fa9e1200700 1 -- 172.21.15.37:0/1981962041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc19a7a0 con 0x7fa9dc108f10 2024-05-09T01:05:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.952+0000 7fa9e1200700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc108f10 0x7fa9dc199ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00ec70 tx=0x7fa9cc00ef80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.952+0000 7fa9d2ffd700 1 -- 172.21.15.37:0/1981962041 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00cc90 con 0x7fa9dc108f10 2024-05-09T01:05:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.952+0000 7fa9d2ffd700 1 -- 172.21.15.37:0/1981962041 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9cc00ce30 con 0x7fa9dc108f10 2024-05-09T01:05:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.952+0000 7fa9d2ffd700 1 -- 172.21.15.37:0/1981962041 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc010430 con 0x7fa9dc108f10 2024-05-09T01:05:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.952+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9dc1a1020 con 0x7fa9dc108f10 2024-05-09T01:05:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.952+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9dc1a1510 con 0x7fa9dc108f10 2024-05-09T01:05:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.955+0000 7fa9d2ffd700 1 -- 172.21.15.37:0/1981962041 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa9cc003680 con 0x7fa9dc108f10 2024-05-09T01:05:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.958+0000 7fa9d2ffd700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9c80b2880 0x7fa9c80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.958+0000 7fa9d2ffd700 1 -- 172.21.15.37:0/1981962041 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa9cc0e2420 con 0x7fa9dc108f10 2024-05-09T01:05:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.958+0000 7fa9e1a01700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9c80b2880 0x7fa9c80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.959+0000 7fa9e1a01700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9c80b2880 0x7fa9c80b4d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8005950 tx=0x7fa9d800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:59.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.959+0000 7fa9f267bb80 1 Processor -- start 2024-05-09T01:05:59.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.960+0000 7fa9f267bb80 1 -- start start 2024-05-09T01:05:59.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.960+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ebb9d00 0x56459ecc2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.960+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecc2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.960+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecbc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.960+0000 7fa9f267bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56459ebdf0a0 con 0x56459ebb9d00 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.960+0000 7fa9f267bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56459eb849a0 con 0x56459eb3f4a0 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.960+0000 7fa9f267bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56459ebdb060 con 0x56459ecbc400 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecc2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1a01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ebb9d00 0x56459ecc2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecc2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42626/0 (socket says 172.21.15.37:42626) 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 -- 172.21.15.37:0/3826185321 learned_addr learned my addr 172.21.15.37:0/3826185321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:59.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e2202700 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecbc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 -- 172.21.15.37:0/3826185321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 msgr2=0x56459ecbc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:59.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecbc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 -- 172.21.15.37:0/3826185321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ebb9d00 msgr2=0x56459ecc2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:59.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ebb9d00 0x56459ecc2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 -- 172.21.15.37:0/3826185321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56459eb75500 con 0x56459eb3f4a0 2024-05-09T01:05:59.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.961+0000 7fa9e1200700 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecc2780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0a9a70 tx=0x7fa9cc0a9430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5ebd352438e5f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:59.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.962+0000 7fa9c7fff700 1 -- 172.21.15.37:0/3826185321 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0a95f0 con 0x56459eb3f4a0 2024-05-09T01:05:59.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.962+0000 7fa9c7fff700 1 -- 172.21.15.37:0/3826185321 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9cc0aa1e0 con 0x56459eb3f4a0 2024-05-09T01:05:59.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.962+0000 7fa9c7fff700 1 -- 172.21.15.37:0/3826185321 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0b24b0 con 0x56459eb3f4a0 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 -- 172.21.15.37:0/3826185321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 msgr2=0x56459ecc2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecc2780 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0a9a70 tx=0x7fa9cc0a9430 comp rx=0 tx=0).stop 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 -- 172.21.15.37:0/3826185321 shutdown_connections 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecbc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ebb9d00 0x56459ecc2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/3826185321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecc2780 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 -- 172.21.15.37:0/3826185321 >> 172.21.15.37:0/3826185321 conn(0x56459eb42f70 msgr2=0x56459ecb7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 -- 172.21.15.37:0/3826185321 shutdown_connections 2024-05-09T01:05:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.963+0000 7fa9f267bb80 1 -- 172.21.15.37:0/3826185321 wait complete. 2024-05-09T01:05:59.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.964+0000 7fa9f267bb80 1 -- start start 2024-05-09T01:05:59.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.964+0000 7fa9f267bb80 1 Processor -- start 2024-05-09T01:05:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecc6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ecbc400 0x56459ecc6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9f267bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56459ecbd160 con 0x56459eb3f4a0 2024-05-09T01:05:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9f267bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56459eb79b20 con 0x56459ecbc400 2024-05-09T01:05:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9f267bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56459ecc9020 con 0x56459ebb9d00 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9f267bb80 10 client.0 _ll_register_callbacks cb 0x56459ea506c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9e2202700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ecbc400 0x56459ecc6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9e2202700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ecbc400 0x56459ecc6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42630/0 (socket says 172.21.15.37:42630) 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9e2202700 1 -- 172.21.15.37:0/2496291859 learned_addr learned my addr 172.21.15.37:0/2496291859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.966+0000 7fa9e1a01700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e2202700 1 -- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 msgr2=0x56459ecc6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e1200700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecc6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e2202700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecc6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e2202700 1 -- 172.21.15.37:0/2496291859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 msgr2=0x56459ecc6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e2202700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e2202700 1 -- 172.21.15.37:0/2496291859 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56459ea5a490 con 0x56459ecbc400 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e1200700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecc6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:05:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9e2202700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ecbc400 0x56459ecc6aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4003e30 tx=0x7fa9d4003e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f2722ea0831097 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.967+0000 7fa9c57fa700 1 -- 172.21.15.37:0/2496291859 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4007700 con 0x56459ecbc400 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.968+0000 7fa9c57fa700 1 -- 172.21.15.37:0/2496291859 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa9d40078a0 con 0x56459ecbc400 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.968+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9cc0aa1e0 con 0x56459ecbc400 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.968+0000 7fa9c57fa700 1 -- 172.21.15.37:0/2496291859 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa9d400be40 con 0x56459ecbc400 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.968+0000 7fa9f267bb80 10 client.25628 fetch_fsmap learned FSMap version 38 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.968+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56459ecd39d0 con 0x56459ecbc400 2024-05-09T01:05:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.969+0000 7fa9c57fa700 1 -- 172.21.15.37:0/2496291859 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d4005040 con 0x56459ecbc400 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9c57fa700 1 -- 172.21.15.37:0/2496291859 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fa9d4024070 con 0x56459ecbc400 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9f267bb80 10 client.25628 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9f267bb80 10 client.25628 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9f267bb80 20 client.25628 populate_metadata read hostname 'smithi037' 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ecd6000 0x56459ecd8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9f267bb80 4 client.25628 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa9cc0aa1e0 con 0x56459ecd6000 2024-05-09T01:05:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9e1a01700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ecd6000 0x56459ecd8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:05:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9c57fa700 10 client.25628 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:05:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.970+0000 7fa9e1a01700 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ecd6000 0x56459ecd8420 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=44bba4cde3941900 server_cookie=b32db6dc2fcc3493 in_seq=0 out_seq=0 2024-05-09T01:05:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.971+0000 7fa9c57fa700 1 -- 172.21.15.37:0/2496291859 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fa9cc0aa1e0 con 0x56459ecd6000 2024-05-09T01:05:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.971+0000 7fa9c57fa700 10 client.25628 handle_command_reply: tid=0 2024-05-09T01:05:59.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.971+0000 7fa9f267bb80 1 client.25628 shutdown 2024-05-09T01:05:59.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.972+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ecbc400 msgr2=0x56459ecc6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:05:59.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ecbc400 0x56459ecc6aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4003e30 tx=0x7fa9d4003e60 comp rx=0 tx=0).stop 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 shutdown_connections 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ecd6000 0x56459ecd8420 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ecbc400 0x56459ecc6aa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/2496291859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecc6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9c57fa700 0 client.25628 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 >> 172.21.15.37:0/2496291859 conn(0x56459eb42f70 msgr2=0x56459ecb0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 shutdown_connections 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 1 -- 172.21.15.37:0/2496291859 wait complete. 2024-05-09T01:05:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:05:59.973+0000 7fa9f267bb80 20 client.25628 trim_cache size 0 max 16384 2024-05-09T01:06:00.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.001+0000 7fa9f267bb80 1 Processor -- start 2024-05-09T01:06:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.001+0000 7fa9f267bb80 1 -- start start 2024-05-09T01:06:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ebb9d00 0x56459ecc03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9e1a01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9e1a01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53582/0 (socket says 172.21.15.37:53582) 2024-05-09T01:06:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9e1a01700 1 -- 172.21.15.37:0/264776578 learned_addr learned my addr 172.21.15.37:0/264776578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:00.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecd1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1bd8f0 con 0x56459eb3f4a0 2024-05-09T01:06:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1bf460 con 0x56459ebb9d00 2024-05-09T01:06:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1bdfc0 con 0x56459ecbc400 2024-05-09T01:06:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9e2202700 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecd1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.002+0000 7fa9e1200700 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ebb9d00 0x56459ecc03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9e1200700 1 -- 172.21.15.37:0/264776578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 msgr2=0x56459ecd1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9e1200700 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecd1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9e1200700 1 -- 172.21.15.37:0/264776578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 msgr2=0x56459ecc5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9e1200700 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9e1200700 1 -- 172.21.15.37:0/264776578 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56459ecc88c0 con 0x56459ebb9d00 2024-05-09T01:06:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9e1200700 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ebb9d00 0x56459ecc03e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x56459ecbce40 tx=0x7fa9cc003a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29944392e3706f71 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9c77fe700 1 -- 172.21.15.37:0/264776578 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0a95f0 con 0x56459ebb9d00 2024-05-09T01:06:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9c77fe700 1 -- 172.21.15.37:0/264776578 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9cc0aa1e0 con 0x56459ebb9d00 2024-05-09T01:06:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.003+0000 7fa9c77fe700 1 -- 172.21.15.37:0/264776578 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc06f570 con 0x56459ebb9d00 2024-05-09T01:06:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.004+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ebb9d00 msgr2=0x56459ecc03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.004+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ebb9d00 0x56459ecc03e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x56459ecbce40 tx=0x7fa9cc003a20 comp rx=0 tx=0).stop 2024-05-09T01:06:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.004+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 shutdown_connections 2024-05-09T01:06:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.004+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ecbc400 0x56459ecd1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.004+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459eb3f4a0 0x56459ecc5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.004+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/264776578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459ebb9d00 0x56459ecc03e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.005+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 >> 172.21.15.37:0/264776578 conn(0x56459eb42f70 msgr2=0x56459ecbfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.005+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 shutdown_connections 2024-05-09T01:06:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.005+0000 7fa9f267bb80 1 -- 172.21.15.37:0/264776578 wait complete. 2024-05-09T01:06:00.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.006+0000 7fa9f267bb80 1 -- start start 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.006+0000 7fa9f267bb80 1 Processor -- start 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecde1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9f267bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ecbc400 0x56459ecce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1a01700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecde1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1a01700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecde1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42650/0 (socket says 172.21.15.37:42650) 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecce100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53540/0 (socket says 172.21.15.37:53540) 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 -- 172.21.15.37:0/1613537046 learned_addr learned my addr 172.21.15.37:0/1613537046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1bed90 con 0x56459ecbc400 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1be690 con 0x56459eb3f4a0 2024-05-09T01:06:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1bb890 con 0x56459ebb9d00 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9f267bb80 10 client.0 _ll_register_callbacks cb 0x56459ea506c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e2202700 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ecbc400 0x56459ecce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 -- 172.21.15.37:0/1613537046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 msgr2=0x56459ecde1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecde1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 -- 172.21.15.37:0/1613537046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ecbc400 msgr2=0x56459ecce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ecbc400 0x56459ecce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.007+0000 7fa9e1200700 1 -- 172.21.15.37:0/1613537046 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56459ecdcc70 con 0x56459ebb9d00 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.008+0000 7fa9e1200700 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecce100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0aa390 tx=0x7fa9cc0b26e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf1944b9ab7bdcfa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.008+0000 7fa9c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.008+0000 7fa9c57fa700 1 -- 172.21.15.37:0/1613537046 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0a95f0 con 0x56459ebb9d00 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.008+0000 7fa9c57fa700 1 -- 172.21.15.37:0/1613537046 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa9cc0a8f50 con 0x56459ebb9d00 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.008+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9cc0aa1e0 con 0x56459ebb9d00 2024-05-09T01:06:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.009+0000 7fa9c57fa700 1 -- 172.21.15.37:0/1613537046 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa9cc0a9430 con 0x56459ebb9d00 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.009+0000 7fa9f267bb80 10 client.25645 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.009+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56459ed3fa70 con 0x56459ebb9d00 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9c57fa700 1 -- 172.21.15.37:0/1613537046 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9cc0b2940 con 0x56459ebb9d00 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9c57fa700 1 -- 172.21.15.37:0/1613537046 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fa9cc0a5450 con 0x56459ebb9d00 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9f267bb80 10 client.25645 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9f267bb80 10 client.25645 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9f267bb80 20 client.25645 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ed3fd90 0x56459ed421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9f267bb80 4 client.25645 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa9cc0aa1e0 con 0x56459ed3fd90 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.010+0000 7fa9e1a01700 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ed3fd90 0x56459ed421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.011+0000 7fa9c57fa700 10 client.25645 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.011+0000 7fa9e1a01700 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ed3fd90 0x56459ed421b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb3974148504971 server_cookie=1a21ea58e8b9a52f in_seq=0 out_seq=0 2024-05-09T01:06:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.011+0000 7fa9c57fa700 1 -- 172.21.15.37:0/1613537046 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa9cc0aa1e0 con 0x56459ed3fd90 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.011+0000 7fa9c57fa700 10 client.25645 handle_command_reply: tid=0 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.011+0000 7fa9f267bb80 1 client.25645 shutdown 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.012+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 msgr2=0x56459ecce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecce100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0aa390 tx=0x7fa9cc0b26e0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 shutdown_connections 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56459ed3fd90 0x56459ed421b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56459ecbc400 0x56459ecce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56459eb3f4a0 0x56459ecde1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 --2- 172.21.15.37:0/1613537046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56459ebb9d00 0x56459ecce100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 >> 172.21.15.37:0/1613537046 conn(0x56459eb42f70 msgr2=0x56459ecb0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9c57fa700 0 client.25645 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:06:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 shutdown_connections 2024-05-09T01:06:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.013+0000 7fa9f267bb80 1 -- 172.21.15.37:0/1613537046 wait complete. 2024-05-09T01:06:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.014+0000 7fa9f267bb80 20 client.25645 trim_cache size 0 max 16384 2024-05-09T01:06:00.021 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:06:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9c80b2880 msgr2=0x7fa9c80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9c80b2880 0x7fa9c80b4d90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8005950 tx=0x7fa9d800a300 comp rx=0 tx=0).stop 2024-05-09T01:06:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc108f10 msgr2=0x7fa9dc199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc108f10 0x7fa9dc199ea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00ec70 tx=0x7fa9cc00ef80 comp rx=0 tx=0).stop 2024-05-09T01:06:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 shutdown_connections 2024-05-09T01:06:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9c80b2880 0x7fa9c80b4d90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9dc109860 0x7fa9dc1a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9dc1045e0 0x7fa9dc199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 --2- 172.21.15.37:0/1981962041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc108f10 0x7fa9dc199ea0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 >> 172.21.15.37:0/1981962041 conn(0x7fa9dc0ffe70 msgr2=0x7fa9dc076050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 shutdown_connections 2024-05-09T01:06:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:00.016+0000 7fa9e3c65700 1 -- 172.21.15.37:0/1981962041 wait complete. 2024-05-09T01:06:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 220.0 s, 2951.6 tps, lat 33.953 ms stddev 38.330 2024-05-09T01:06:00.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:00 smithi136 ceph-mon[34110]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.7 MiB/s wr, 728 op/s 2024-05-09T01:06:00.715 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:00 smithi037 ceph-mon[30122]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.7 MiB/s wr, 728 op/s 2024-05-09T01:06:00.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:00 smithi151 ceph-mon[34780]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.7 MiB/s wr, 728 op/s 2024-05-09T01:06:01.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:06:01.574 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:02.526 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:02 smithi151 ceph-mon[34780]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 809 op/s 2024-05-09T01:06:02.613 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:02 smithi037 ceph-mon[30122]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 809 op/s 2024-05-09T01:06:02.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:02 smithi136 ceph-mon[34110]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 MiB/s wr, 809 op/s 2024-05-09T01:06:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.641+0000 7f96da970700 1 -- 172.21.15.37:0/4163050610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d4103310 msgr2=0x7f96d410f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.641+0000 7f96da970700 1 --2- 172.21.15.37:0/4163050610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d4103310 0x7f96d410f890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009990 tx=0x7f96cc009ca0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.641+0000 7f96da970700 1 -- 172.21.15.37:0/4163050610 shutdown_connections 2024-05-09T01:06:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.641+0000 7f96da970700 1 --2- 172.21.15.37:0/4163050610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d4103310 0x7f96d410f890 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.641+0000 7f96da970700 1 --2- 172.21.15.37:0/4163050610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96d41089f0 0x7f96d4108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.641+0000 7f96da970700 1 --2- 172.21.15.37:0/4163050610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41029c0 0x7f96d4102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.641+0000 7f96da970700 1 -- 172.21.15.37:0/4163050610 >> 172.21.15.37:0/4163050610 conn(0x7f96d40fe4e0 msgr2=0x7f96d4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.642+0000 7f96da970700 1 -- 172.21.15.37:0/4163050610 shutdown_connections 2024-05-09T01:06:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.642+0000 7f96da970700 1 -- 172.21.15.37:0/4163050610 wait complete. 2024-05-09T01:06:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.643+0000 7f96da970700 1 Processor -- start 2024-05-09T01:06:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.643+0000 7f96da970700 1 -- start start 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96da970700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96d41029c0 0x7f96d4075300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96da970700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d4103310 0x7f96d406e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96da970700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41089f0 0x7f96d406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96da970700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41133b0 con 0x7f96d4103310 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96da970700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4113230 con 0x7f96d41089f0 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96da970700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4113530 con 0x7f96d41029c0 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96d8f0d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41089f0 0x7f96d406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96d8f0d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41089f0 0x7f96d406ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59996/0 (socket says 172.21.15.37:59996) 2024-05-09T01:06:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96d8f0d700 1 -- 172.21.15.37:0/3040870671 learned_addr learned my addr 172.21.15.37:0/3040870671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96d8f0d700 1 -- 172.21.15.37:0/3040870671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96d41029c0 msgr2=0x7f96d4075300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96d8f0d700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96d41029c0 0x7f96d4075300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96d8f0d700 1 -- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d4103310 msgr2=0x7f96d406e480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:06:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.644+0000 7f96d8f0d700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d4103310 0x7f96d406e480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.645+0000 7f96d8f0d700 1 -- 172.21.15.37:0/3040870671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d406f260 con 0x7f96d41089f0 2024-05-09T01:06:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.645+0000 7f96d8f0d700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41089f0 0x7f96d406ea00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0057c0 tx=0x7f96cc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.645+0000 7f96d1ffb700 1 -- 172.21.15.37:0/3040870671 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc027070 con 0x7f96d41089f0 2024-05-09T01:06:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.645+0000 7f96d1ffb700 1 -- 172.21.15.37:0/3040870671 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96cc022470 con 0x7f96d41089f0 2024-05-09T01:06:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.645+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d4072e90 con 0x7f96d41089f0 2024-05-09T01:06:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.646+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d4073370 con 0x7f96d41089f0 2024-05-09T01:06:03.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.646+0000 7f96d1ffb700 1 -- 172.21.15.37:0/3040870671 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc017650 con 0x7f96d41089f0 2024-05-09T01:06:03.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.650+0000 7f96d1ffb700 1 -- 172.21.15.37:0/3040870671 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f96cc02a070 con 0x7f96d41089f0 2024-05-09T01:06:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.650+0000 7f96d1ffb700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96c00b29d0 0x7f96c00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.651+0000 7f96d3fff700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96c00b29d0 0x7f96c00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.651+0000 7f96d1ffb700 1 -- 172.21.15.37:0/3040870671 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f96cc0e2ed0 con 0x7f96d41089f0 2024-05-09T01:06:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.651+0000 7f96d3fff700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96c00b29d0 0x7f96c00b4ee0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f96d406fc80 tx=0x7f96c400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.651+0000 7f96e9386b80 1 Processor -- start 2024-05-09T01:06:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.651+0000 7f96e9386b80 1 -- start start 2024-05-09T01:06:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.652+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 0x5624b241e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.652+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.652+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b2418d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.652+0000 7f96e9386b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624b233b0a0 con 0x5624b2315d00 2024-05-09T01:06:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.652+0000 7f96e9386b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5624b22e09a0 con 0x5624b229b4a0 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.652+0000 7f96e9386b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5624b2337060 con 0x5624b2418940 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.652+0000 7f96cb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59998/0 (socket says 172.21.15.37:59998) 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 -- 172.21.15.37:0/3254813206 learned_addr learned my addr 172.21.15.37:0/3254813206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 -- 172.21.15.37:0/3254813206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 msgr2=0x5624b2418d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/3254813206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b2418d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 -- 172.21.15.37:0/3254813206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 msgr2=0x5624b241e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/3254813206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 0x5624b241e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 -- 172.21.15.37:0/3254813206 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624b22d1500 con 0x5624b229b4a0 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.653+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/3254813206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009bd0 tx=0x7f96bc009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b76e948c9ec01d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.654+0000 7f96ca7fc700 1 -- 172.21.15.37:0/3254813206 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00eb60 con 0x5624b229b4a0 2024-05-09T01:06:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.654+0000 7f96ca7fc700 1 -- 172.21.15.37:0/3254813206 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96bc004ce0 con 0x5624b229b4a0 2024-05-09T01:06:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.655+0000 7f96e9386b80 1 -- 172.21.15.37:0/3254813206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 msgr2=0x5624b2418400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.655+0000 7f96e9386b80 1 --2- 172.21.15.37:0/3254813206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009bd0 tx=0x7f96bc009ee0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.655+0000 7f96e9386b80 1 -- 172.21.15.37:0/3254813206 shutdown_connections 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.655+0000 7f96e9386b80 1 --2- 172.21.15.37:0/3254813206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b2418d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.655+0000 7f96e9386b80 1 --2- 172.21.15.37:0/3254813206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 0x5624b241e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.655+0000 7f96e9386b80 1 --2- 172.21.15.37:0/3254813206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.655+0000 7f96e9386b80 1 -- 172.21.15.37:0/3254813206 >> 172.21.15.37:0/3254813206 conn(0x5624b229ef70 msgr2=0x5624b2413220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.656+0000 7f96e9386b80 1 -- 172.21.15.37:0/3254813206 shutdown_connections 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.656+0000 7f96e9386b80 1 -- 172.21.15.37:0/3254813206 wait complete. 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.656+0000 7f96e9386b80 1 -- start start 2024-05-09T01:06:03.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.656+0000 7f96e9386b80 1 Processor -- start 2024-05-09T01:06:03.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b229b4a0 0x5624b242a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b242a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96e9386b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624b242d5f0 con 0x5624b229b4a0 2024-05-09T01:06:03.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96e9386b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5624b22d5b20 con 0x5624b2315d00 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96e9386b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5624b242d770 con 0x5624b2418940 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96e9386b80 10 client.0 _ll_register_callbacks cb 0x5624b21ac6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96d8f0d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b229b4a0 0x5624b242a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96d8f0d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49920/0 (socket says 172.21.15.37:49920) 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96d8f0d700 1 -- 172.21.15.37:0/4160670307 learned_addr learned my addr 172.21.15.37:0/4160670307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.657+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b242a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96d8f0d700 1 -- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 msgr2=0x5624b242a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96d8f0d700 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b242a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96d8f0d700 1 -- 172.21.15.37:0/4160670307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b229b4a0 msgr2=0x5624b242a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96d8f0d700 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b229b4a0 0x5624b242a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96d8f0d700 1 -- 172.21.15.37:0/4160670307 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624b21b6490 con 0x5624b2418940 2024-05-09T01:06:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96d3fff700 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b229b4a0 0x5624b242a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96d8f0d700 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ad30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0a6600 tx=0x7f96cc0a9ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5274742b6d54d80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96b37fe700 1 -- 172.21.15.37:0/4160670307 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0aac80 con 0x5624b2418940 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96b37fe700 1 -- 172.21.15.37:0/4160670307 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f96cc0aa9f0 con 0x5624b2418940 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.658+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96bc004ce0 con 0x5624b2418940 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.659+0000 7f96b37fe700 1 -- 172.21.15.37:0/4160670307 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f96cc0aa580 con 0x5624b2418940 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.659+0000 7f96e9386b80 10 client.25651 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.659+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5624b242d6a0 con 0x5624b2418940 2024-05-09T01:06:03.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.659+0000 7f96b37fe700 1 -- 172.21.15.37:0/4160670307 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96bc004ce0 con 0x5624b2418940 2024-05-09T01:06:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96b37fe700 1 -- 172.21.15.37:0/4160670307 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f96cc0a97e0 con 0x5624b2418940 2024-05-09T01:06:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96e9386b80 10 client.25651 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96e9386b80 10 client.25651 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:06:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96e9386b80 20 client.25651 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96e9386b80 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b243cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96e9386b80 4 client.25651 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624b2348a80 con 0x5624b243a820 2024-05-09T01:06:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.660+0000 7f96d3fff700 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b243cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.661+0000 7f96b37fe700 10 client.25651 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:06:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.661+0000 7f96d3fff700 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b243cc70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a05d45bf95a9d98a server_cookie=f4406f49139652c7 in_seq=0 out_seq=0 2024-05-09T01:06:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.663+0000 7f96b37fe700 1 -- 172.21.15.37:0/4160670307 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5624b2348a80 con 0x5624b243a820 2024-05-09T01:06:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.663+0000 7f96b37fe700 10 client.25651 handle_command_reply: tid=0 2024-05-09T01:06:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 client.25651 shutdown 2024-05-09T01:06:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 msgr2=0x5624b242ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ad30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0a6600 tx=0x7f96cc0a9ed0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 shutdown_connections 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ad30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b229b4a0 0x5624b242a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b243cc70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 --2- 172.21.15.37:0/4160670307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b242a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96b37fe700 0 client.25651 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.664+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 >> 172.21.15.37:0/4160670307 conn(0x5624b229ef70 msgr2=0x5624b24173f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.665+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 shutdown_connections 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.665+0000 7f96e9386b80 1 -- 172.21.15.37:0/4160670307 wait complete. 2024-05-09T01:06:03.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.665+0000 7f96e9386b80 20 client.25651 trim_cache size 0 max 16384 2024-05-09T01:06:03.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.690+0000 7f96e9386b80 1 Processor -- start 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.692+0000 7f96e9386b80 1 -- start start 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.692+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.692+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 0x5624b2429210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.692+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.692+0000 7f96e9386b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41b5050 con 0x5624b2315d00 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.692+0000 7f96e9386b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41b6bc0 con 0x5624b229b4a0 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.692+0000 7f96e9386b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41b5720 con 0x5624b2418940 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.695+0000 7f96d8f0d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.696+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.696+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60022/0 (socket says 172.21.15.37:60022) 2024-05-09T01:06:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.696+0000 7f96d3fff700 1 -- 172.21.15.37:0/1242975481 learned_addr learned my addr 172.21.15.37:0/1242975481 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.698+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 0x5624b2429210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.698+0000 7f96d3fff700 1 -- 172.21.15.37:0/1242975481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 msgr2=0x5624b242ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.698+0000 7f96d3fff700 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.698+0000 7f96d3fff700 1 -- 172.21.15.37:0/1242975481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 msgr2=0x5624b2429210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.698+0000 7f96d3fff700 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 0x5624b2429210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.698+0000 7f96d3fff700 1 -- 172.21.15.37:0/1242975481 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624b240f9d0 con 0x5624b229b4a0 2024-05-09T01:06:03.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.703+0000 7f96d3fff700 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5624b2429b30 tx=0x7f96c4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25be35bbbe7b24b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.705+0000 7f96c9ffb700 1 -- 172.21.15.37:0/1242975481 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c40271f0 con 0x5624b229b4a0 2024-05-09T01:06:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.705+0000 7f96c9ffb700 1 -- 172.21.15.37:0/1242975481 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96c4027840 con 0x5624b229b4a0 2024-05-09T01:06:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.706+0000 7f96e9386b80 1 -- 172.21.15.37:0/1242975481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 msgr2=0x5624b2418400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.706+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x5624b2429b30 tx=0x7f96c4011000 comp rx=0 tx=0).stop 2024-05-09T01:06:03.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.708+0000 7f96e9386b80 1 -- 172.21.15.37:0/1242975481 shutdown_connections 2024-05-09T01:06:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.708+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b2418940 0x5624b242ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.708+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b229b4a0 0x5624b2418400 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.708+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1242975481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2315d00 0x5624b2429210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.708+0000 7f96e9386b80 1 -- 172.21.15.37:0/1242975481 >> 172.21.15.37:0/1242975481 conn(0x5624b229ef70 msgr2=0x5624b241d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:03.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.708+0000 7f96e9386b80 1 -- 172.21.15.37:0/1242975481 shutdown_connections 2024-05-09T01:06:03.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.709+0000 7f96e9386b80 1 -- 172.21.15.37:0/1242975481 wait complete. 2024-05-09T01:06:03.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.709+0000 7f96e9386b80 1 -- start start 2024-05-09T01:06:03.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.709+0000 7f96e9386b80 1 Processor -- start 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.713+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b229b4a0 0x5624b2432ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.713+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b2433020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.713+0000 7f96e9386b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2418940 0x5624b2441440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.713+0000 7f96e9386b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41b64f0 con 0x5624b2418940 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.713+0000 7f96e9386b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41b5df0 con 0x5624b2315d00 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.713+0000 7f96e9386b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41b3010 con 0x5624b229b4a0 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.713+0000 7f96e9386b80 10 client.0 _ll_register_callbacks cb 0x5624b21ac6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.714+0000 7f96cb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b2433020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.714+0000 7f96cb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b2433020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60036/0 (socket says 172.21.15.37:60036) 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.714+0000 7f96cb7fe700 1 -- 172.21.15.37:0/1003844609 learned_addr learned my addr 172.21.15.37:0/1003844609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.714+0000 7f96d3fff700 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b229b4a0 0x5624b2432ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.716+0000 7f96cb7fe700 1 -- 172.21.15.37:0/1003844609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b229b4a0 msgr2=0x5624b2432ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.716+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b229b4a0 0x5624b2432ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.716+0000 7f96cb7fe700 1 -- 172.21.15.37:0/1003844609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2418940 msgr2=0x5624b2441440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:06:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.716+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2418940 0x5624b2441440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.716+0000 7f96cb7fe700 1 -- 172.21.15.37:0/1003844609 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624b2441ab0 con 0x5624b2315d00 2024-05-09T01:06:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.716+0000 7f96cb7fe700 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b2433020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f96bc000c00 tx=0x7f96bc003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb284cdf190018cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:03.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.720+0000 7f96b37fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:03.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.720+0000 7f96b37fe700 1 -- 172.21.15.37:0/1003844609 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc027070 con 0x5624b2315d00 2024-05-09T01:06:03.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.720+0000 7f96b37fe700 1 -- 172.21.15.37:0/1003844609 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f96bc003b80 con 0x5624b2315d00 2024-05-09T01:06:03.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.721+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96c4027840 con 0x5624b2315d00 2024-05-09T01:06:03.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.722+0000 7f96b37fe700 1 -- 172.21.15.37:0/1003844609 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f96bc01d040 con 0x5624b2315d00 2024-05-09T01:06:03.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.723+0000 7f96e9386b80 10 client.25652 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:03.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.723+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5624b24a48c0 con 0x5624b2315d00 2024-05-09T01:06:03.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96b37fe700 1 -- 172.21.15.37:0/1003844609 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96c4027840 con 0x5624b2315d00 2024-05-09T01:06:03.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96b37fe700 1 -- 172.21.15.37:0/1003844609 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f96bc02a020 con 0x5624b2315d00 2024-05-09T01:06:03.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96e9386b80 10 client.25652 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:03.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96e9386b80 10 client.25652 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:06:03.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96e9386b80 20 client.25652 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:03.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b24a6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:03.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96e9386b80 4 client.25652 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:06:03.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.725+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624b2342b20 con 0x5624b243a820 2024-05-09T01:06:03.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.726+0000 7f96d3fff700 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b24a6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.730+0000 7f96d3fff700 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b24a6f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=409a83fc3e3563b5 server_cookie=8f1368f5ca54976a in_seq=0 out_seq=0 2024-05-09T01:06:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.730+0000 7f96b37fe700 10 client.25652 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:06:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.730+0000 7f96b37fe700 1 -- 172.21.15.37:0/1003844609 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624b2342b20 con 0x5624b243a820 2024-05-09T01:06:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.730+0000 7f96b37fe700 10 client.25652 handle_command_reply: tid=0 2024-05-09T01:06:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.730+0000 7f96e9386b80 1 client.25652 shutdown 2024-05-09T01:06:03.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 msgr2=0x5624b2433020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b2433020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f96bc000c00 tx=0x7f96bc003960 comp rx=0 tx=0).stop 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 shutdown_connections 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624b2418940 0x5624b2441440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624b229b4a0 0x5624b2432ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5624b243a820 0x5624b24a6f50 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 --2- 172.21.15.37:0/1003844609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5624b2315d00 0x5624b2433020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 >> 172.21.15.37:0/1003844609 conn(0x5624b229ef70 msgr2=0x5624b241bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.731+0000 7f96b37fe700 0 client.25652 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:06:03.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.732+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 shutdown_connections 2024-05-09T01:06:03.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.732+0000 7f96e9386b80 1 -- 172.21.15.37:0/1003844609 wait complete. 2024-05-09T01:06:03.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.732+0000 7f96e9386b80 20 client.25652 trim_cache size 0 max 16384 2024-05-09T01:06:03.734 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:06:03.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.733+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96c00b29d0 msgr2=0x7f96c00b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.733+0000 7f96da970700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96c00b29d0 0x7f96c00b4ee0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f96d406fc80 tx=0x7f96c400d040 comp rx=0 tx=0).stop 2024-05-09T01:06:03.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.733+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41089f0 msgr2=0x7f96d406ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:03.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.733+0000 7f96da970700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41089f0 0x7f96d406ea00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0057c0 tx=0x7f96cc0057f0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.734+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 shutdown_connections 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.734+0000 7f96da970700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96c00b29d0 0x7f96c00b4ee0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.734+0000 7f96da970700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96d41089f0 0x7f96d406ea00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.734+0000 7f96da970700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96d41029c0 0x7f96d4075300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.734+0000 7f96da970700 1 --2- 172.21.15.37:0/3040870671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d4103310 0x7f96d406e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.734+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 >> 172.21.15.37:0/3040870671 conn(0x7f96d40fe4e0 msgr2=0x7f96d4106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.735+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 shutdown_connections 2024-05-09T01:06:03.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:03.735+0000 7f96da970700 1 -- 172.21.15.37:0/3040870671 wait complete. 2024-05-09T01:06:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.390+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3127291597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010f890 msgr2=0x7fbfc0111cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.390+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3127291597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010f890 0x7fbfc0111cb0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009900 tx=0x7fbfb802a410 comp rx=0 tx=0).stop 2024-05-09T01:06:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.391+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3127291597 shutdown_connections 2024-05-09T01:06:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.391+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3127291597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc01121f0 0x7fbfc0114690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.391+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3127291597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010f890 0x7fbfc0111cb0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.391+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3127291597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfc010a0f0 0x7fbfc010a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.391+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3127291597 >> 172.21.15.37:0/3127291597 conn(0x7fbfc0070a90 msgr2=0x7fbfc0072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.391+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3127291597 shutdown_connections 2024-05-09T01:06:04.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.391+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3127291597 wait complete. 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.392+0000 7fbfc5a61640 1 Processor -- start 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.392+0000 7fbfc5a61640 1 -- start start 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfc5a61640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010a0f0 0x7fbfc01a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfc5a61640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfc010f890 0x7fbfc01a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfc5a61640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc01121f0 0x7fbfc01ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfc5a61640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc010bed0 con 0x7fbfc010a0f0 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfc5a61640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc010bd50 con 0x7fbfc010f890 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfc5a61640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc010c050 con 0x7fbfc01121f0 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010a0f0 0x7fbfc01a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc01121f0 0x7fbfc01ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010a0f0 0x7fbfc01a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36238/0 (socket says 172.21.15.37:36238) 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbe7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfc010f890 0x7fbfc01a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbeffd640 1 -- 172.21.15.37:0/3134827381 learned_addr learned my addr 172.21.15.37:0/3134827381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/3134827381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc01121f0 msgr2=0x7fbfc01ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc01121f0 0x7fbfc01ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010a0f0 msgr2=0x7fbfc01a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010a0f0 0x7fbfc01a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/3134827381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc01aca00 con 0x7fbfc010f890 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.393+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010a0f0 0x7fbfc01a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.394+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfc010f890 0x7fbfc01a5400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8031500 tx=0x7fbfb8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.394+0000 7fbfc4a5f640 1 -- 172.21.15.37:0/3134827381 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb803f070 con 0x7fbfc010f890 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.394+0000 7fbfc4a5f640 1 -- 172.21.15.37:0/3134827381 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfb8003ca0 con 0x7fbfc010f890 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.394+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc01acc90 con 0x7fbfc010f890 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.394+0000 7fbfc4a5f640 1 -- 172.21.15.37:0/3134827381 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8035070 con 0x7fbfc010f890 2024-05-09T01:06:04.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.394+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01ad1d0 con 0x7fbfc010f890 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.397+0000 7fbfc4a5f640 1 -- 172.21.15.37:0/3134827381 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbfb8043400 con 0x7fbfc010f890 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.397+0000 7fbfcc9ed740 1 Processor -- start 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfcc9ed740 1 -- start start 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b5039fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5036262f0 0x55b5039fc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50362e4d0 0x55b503a03190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b5039577c0 con 0x55b50364f1b0 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b5038f30e0 con 0x55b5036262f0 2024-05-09T01:06:04.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b503953780 con 0x55b50362e4d0 2024-05-09T01:06:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfbf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b5039fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfbf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b5039fbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36250/0 (socket says 172.21.15.37:36250) 2024-05-09T01:06:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfbf7fe640 1 -- 172.21.15.37:0/3740830541 learned_addr learned my addr 172.21.15.37:0/3740830541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50362e4d0 0x55b503a03190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.398+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5036262f0 0x55b5039fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.399+0000 7fbfc4a5f640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfa00b28e0 0x7fbfa00b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.399+0000 7fbfc4a5f640 1 -- 172.21.15.37:0/3134827381 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbfb8102670 con 0x7fbfc010f890 2024-05-09T01:06:04.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/3740830541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5036262f0 msgr2=0x55b5039fc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:04.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5036262f0 0x55b5039fc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/3740830541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 msgr2=0x55b5039fbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:04.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b5039fbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/3740830541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50391c7c0 con 0x55b50362e4d0 2024-05-09T01:06:04.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfbf7fe640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfa00b28e0 0x7fbfa00b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50362e4d0 0x55b503a03190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8000c00 tx=0x7fbfb802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d7e91092aceddb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:04.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.400+0000 7fbfb5ffb640 1 -- 172.21.15.37:0/3740830541 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8048070 con 0x55b50362e4d0 2024-05-09T01:06:04.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.401+0000 7fbfb5ffb640 1 -- 172.21.15.37:0/3740830541 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfb80d2430 con 0x55b50362e4d0 2024-05-09T01:06:04.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.401+0000 7fbfb5ffb640 1 -- 172.21.15.37:0/3740830541 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb80c9880 con 0x55b50362e4d0 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.401+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3740830541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50362e4d0 msgr2=0x55b503a03190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.401+0000 7fbfbf7fe640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfa00b28e0 0x7fbfa00b4df0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55b5039fcee0 tx=0x7fbfa80046e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.401+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50362e4d0 0x55b503a03190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8000c00 tx=0x7fbfb802a410 comp rx=0 tx=0).stop 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3740830541 shutdown_connections 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50362e4d0 0x55b503a03190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b5036262f0 0x55b5039fc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3740830541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b5039fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3740830541 >> 172.21.15.37:0/3740830541 conn(0x55b503643300 msgr2=0x55b5039eee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3740830541 shutdown_connections 2024-05-09T01:06:04.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3740830541 wait complete. 2024-05-09T01:06:04.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.402+0000 7fbfcc9ed740 1 -- start start 2024-05-09T01:06:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 1 Processor -- start 2024-05-09T01:06:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a05710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a05c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfbeffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a05710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfbeffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a05710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49984/0 (socket says 172.21.15.37:49984) 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfbeffd640 1 -- 172.21.15.37:0/4123358020 learned_addr learned my addr 172.21.15.37:0/4123358020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b503a039a0 con 0x55b50362e4d0 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b5038de9c0 con 0x55b50364f1b0 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b503a03b20 con 0x55b5036262f0 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.403+0000 7fbfcc9ed740 10 client.0 _ll_register_callbacks cb 0x55b50390b020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbeffd640 1 -- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 msgr2=0x55b503a0cbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbf7fe640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a05c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbeffd640 1 -- 172.21.15.37:0/4123358020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 msgr2=0x55b503a05c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a05c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbeffd640 1 -- 172.21.15.37:0/4123358020 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5039051f0 con 0x55b5036262f0 2024-05-09T01:06:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5039653d0 con 0x55b5036262f0 2024-05-09T01:06:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a05c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbf7fe640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.404+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a05710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000fe60 tx=0x7fbfb0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54497309f31abbf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:04.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.405+0000 7fbfaeffd640 10 client.25663 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:06:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.405+0000 7fbfaeffd640 1 -- 172.21.15.37:0/4123358020 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb001f060 con 0x55b5036262f0 2024-05-09T01:06:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.405+0000 7fbfaeffd640 1 -- 172.21.15.37:0/4123358020 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbfb0003970 con 0x55b5036262f0 2024-05-09T01:06:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.405+0000 7fbfaeffd640 1 -- 172.21.15.37:0/4123358020 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbfb0003bb0 con 0x55b5036262f0 2024-05-09T01:06:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.405+0000 7fbfcc9ed740 10 client.25663 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:04.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.405+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=38}) -- 0x55b5036ba790 con 0x55b5036262f0 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.405+0000 7fbfaeffd640 1 -- 172.21.15.37:0/4123358020 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fbfb0019070 con 0x55b5036262f0 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfcc9ed740 10 client.25663 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfcc9ed740 10 client.25663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfcc9ed740 20 client.25663 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b50360dd80 0x55b503a12f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfcc9ed740 4 client.25663 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b50395f240 con 0x55b50360dd80 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b50360dd80 0x55b503a12f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b50360dd80 0x55b503a12f30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=832776b01b26b0f3 server_cookie=b520ca572307c921 in_seq=0 out_seq=0 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.406+0000 7fbfaeffd640 10 client.25663 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:04.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfaeffd640 1 -- 172.21.15.37:0/4123358020 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b50395f240 con 0x55b50360dd80 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfaeffd640 10 client.25663 handle_command_reply: tid=0 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 client.25663 shutdown 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 msgr2=0x55b503a05710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a05710 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000fe60 tx=0x7fbfb0011810 comp rx=0 tx=0).stop 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 shutdown_connections 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b50360dd80 0x55b503a12f30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfaeffd640 0 client.25663 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a05c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4123358020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a05710 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 >> 172.21.15.37:0/4123358020 conn(0x55b503643300 msgr2=0x55b5039f1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 shutdown_connections 2024-05-09T01:06:04.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.407+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4123358020 wait complete. 2024-05-09T01:06:04.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.408+0000 7fbfcc9ed740 20 client.25663 trim_cache size 0 max 16384 2024-05-09T01:06:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 Processor -- start 2024-05-09T01:06:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 -- start start 2024-05-09T01:06:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b5039ee710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a0cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b1960 con 0x55b50362e4d0 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b34d0 con 0x55b50364f1b0 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.430+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b2030 con 0x55b5036262f0 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.431+0000 7fbfbe7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a0cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.431+0000 7fbfbe7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a0cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36274/0 (socket says 172.21.15.37:36274) 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.431+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/4114397688 learned_addr learned my addr 172.21.15.37:0/4114397688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:04.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.431+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b5039ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfbeffd640 1 -- 172.21.15.37:0/4114397688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 msgr2=0x55b503a0d010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:06:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfbeffd640 1 -- 172.21.15.37:0/4114397688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 msgr2=0x55b503a0cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a0cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfbeffd640 1 -- 172.21.15.37:0/4114397688 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5037315f0 con 0x55b5036262f0 2024-05-09T01:06:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b5039ee710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000fe30 tx=0x7fbfb0018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a3ccef2737aa8a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:04.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfb57fa640 1 -- 172.21.15.37:0/4114397688 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00041c0 con 0x55b5036262f0 2024-05-09T01:06:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfb57fa640 1 -- 172.21.15.37:0/4114397688 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b5039653d0 con 0x55b5036262f0 2024-05-09T01:06:04.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.432+0000 7fbfb57fa640 1 -- 172.21.15.37:0/4114397688 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000ed00 con 0x55b5036262f0 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.433+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4114397688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 msgr2=0x55b5039ee710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.433+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b5039ee710 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000fe30 tx=0x7fbfb0018000 comp rx=0 tx=0).stop 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.433+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4114397688 shutdown_connections 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.433+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50364f1b0 0x55b503a0d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.433+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50362e4d0 0x55b503a0cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.433+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/4114397688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b5039ee710 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.433+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4114397688 >> 172.21.15.37:0/4114397688 conn(0x55b503643300 msgr2=0x55b503a04cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.434+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4114397688 shutdown_connections 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.434+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/4114397688 wait complete. 2024-05-09T01:06:04.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.434+0000 7fbfcc9ed740 1 -- start start 2024-05-09T01:06:04.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.434+0000 7fbfcc9ed740 1 Processor -- start 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a0abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50362e4d0 0x55b503a0b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfcc9ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b503a0c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b2e00 con 0x55b50364f1b0 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01b2700 con 0x55b50362e4d0 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfcc9ed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01af980 con 0x55b5036262f0 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfcc9ed740 10 client.0 _ll_register_callbacks cb 0x7fbfb000f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfbeffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a0abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfbe7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50362e4d0 0x55b503a0b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfbe7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50362e4d0 0x55b503a0b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60110/0 (socket says 172.21.15.37:60110) 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfbe7fc640 1 -- 172.21.15.37:0/3414616353 learned_addr learned my addr 172.21.15.37:0/3414616353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.435+0000 7fbfbf7fe640 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b503a0c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfbeffd640 1 -- 172.21.15.37:0/3414616353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50362e4d0 msgr2=0x55b503a0b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50362e4d0 0x55b503a0b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfbeffd640 1 -- 172.21.15.37:0/3414616353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 msgr2=0x55b503a0c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b503a0c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfbeffd640 1 -- 172.21.15.37:0/3414616353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50391bed0 con 0x55b5036262f0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfbeffd640 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a0abf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00040c0 tx=0x7fbfb000efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff675751b5be690 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfaeffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfaeffd640 1 -- 172.21.15.37:0/3414616353 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb003b060 con 0x55b5036262f0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfaeffd640 1 -- 172.21.15.37:0/3414616353 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbfb0032040 con 0x55b5036262f0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.436+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5039653d0 con 0x55b5036262f0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfaeffd640 1 -- 172.21.15.37:0/3414616353 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbfb001f020 con 0x55b5036262f0 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 10 client.25669 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55b503a7b330 con 0x55b5036262f0 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfaeffd640 1 -- 172.21.15.37:0/3414616353 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfb00058f0 con 0x55b5036262f0 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfaeffd640 1 -- 172.21.15.37:0/3414616353 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fbfb0019040 con 0x55b5036262f0 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 10 client.25669 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 10 client.25669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 20 client.25669 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b5035e31c0 0x55b503a7dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 4 client.25669 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5039653d0 con 0x55b5035e31c0 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.437+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b5035e31c0 0x55b503a7dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.438+0000 7fbfaeffd640 10 client.25669 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.438+0000 7fbfbe7fc640 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b5035e31c0 0x55b503a7dad0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98eec82ce5774c6c server_cookie=a0aa2c5b85e656f1 in_seq=0 out_seq=0 2024-05-09T01:06:04.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfaeffd640 1 -- 172.21.15.37:0/3414616353 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b5039653d0 con 0x55b5035e31c0 2024-05-09T01:06:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfaeffd640 10 client.25669 handle_command_reply: tid=0 2024-05-09T01:06:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 client.25669 shutdown 2024-05-09T01:06:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 msgr2=0x55b503a0abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a0abf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00040c0 tx=0x7fbfb000efb0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 shutdown_connections 2024-05-09T01:06:04.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b5035e31c0 0x55b503a7dad0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b50364f1b0 0x55b503a0c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b50362e4d0 0x55b503a0b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfaeffd640 0 client.25669 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 --2- 172.21.15.37:0/3414616353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5036262f0 0x55b503a0abf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 >> 172.21.15.37:0/3414616353 conn(0x55b503643300 msgr2=0x55b503a05720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.449+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 shutdown_connections 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.450+0000 7fbfcc9ed740 1 -- 172.21.15.37:0/3414616353 wait complete. 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.450+0000 7fbfcc9ed740 20 client.25669 trim_cache size 0 max 16384 2024-05-09T01:06:04.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:06:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:06:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:06:04.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfa00b28e0 msgr2=0x7fbfa00b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfa00b28e0 0x7fbfa00b4df0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55b5039fcee0 tx=0x7fbfa80046e0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfc010f890 msgr2=0x7fbfc01a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfc010f890 0x7fbfc01a5400 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8031500 tx=0x7fbfb8004270 comp rx=0 tx=0).stop 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 shutdown_connections 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc01121f0 0x7fbfc01ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfa00b28e0 0x7fbfa00b4df0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfc010f890 0x7fbfc01a5400 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 --2- 172.21.15.37:0/3134827381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc010a0f0 0x7fbfc01a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 >> 172.21.15.37:0/3134827381 conn(0x7fbfc0070a90 msgr2=0x7fbfc0072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 shutdown_connections 2024-05-09T01:06:04.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:04.451+0000 7fbfc5a61640 1 -- 172.21.15.37:0/3134827381 wait complete. 2024-05-09T01:06:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:04 smithi136 ceph-mon[34110]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-05-09T01:06:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:04 smithi037 ceph-mon[30122]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-05-09T01:06:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:04 smithi151 ceph-mon[34780]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.3 MiB/s wr, 764 op/s 2024-05-09T01:06:04.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:06:05.221 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 225.0 s, 3617.4 tps, lat 27.504 ms stddev 32.260 2024-05-09T01:06:06.613 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:06 smithi037 ceph-mon[30122]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-05-09T01:06:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:06 smithi136 ceph-mon[34110]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-05-09T01:06:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:06 smithi151 ceph-mon[34780]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 767 op/s 2024-05-09T01:06:07.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.348+0000 7fe564f96700 1 -- 172.21.15.37:0/1797519759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe560107df0 msgr2=0x7fe560108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.348+0000 7fe564f96700 1 --2- 172.21.15.37:0/1797519759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe560107df0 0x7fe560108200 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe55800b0a0 tx=0x7fe55800b3b0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.348+0000 7fe564f96700 1 -- 172.21.15.37:0/1797519759 shutdown_connections 2024-05-09T01:06:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.348+0000 7fe564f96700 1 --2- 172.21.15.37:0/1797519759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe560108740 0x7fe5601100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.348+0000 7fe564f96700 1 --2- 172.21.15.37:0/1797519759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5601034c0 0x7fe5601038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.348+0000 7fe564f96700 1 --2- 172.21.15.37:0/1797519759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe560107df0 0x7fe560108200 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe55800b0a0 tx=0x7fe55800b3b0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.348+0000 7fe564f96700 1 -- 172.21.15.37:0/1797519759 >> 172.21.15.37:0/1797519759 conn(0x7fe5600fedc0 msgr2=0x7fe5601011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.349+0000 7fe564f96700 1 -- 172.21.15.37:0/1797519759 shutdown_connections 2024-05-09T01:06:07.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.352+0000 7fe564f96700 1 -- 172.21.15.37:0/1797519759 wait complete. 2024-05-09T01:06:07.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.354+0000 7fe564f96700 1 Processor -- start 2024-05-09T01:06:07.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.356+0000 7fe564f96700 1 -- start start 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.356+0000 7fe564f96700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5601034c0 0x7fe560112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.356+0000 7fe564f96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe560108740 0x7fe5601131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.356+0000 7fe564f96700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe560113710 0x7fe560073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.356+0000 7fe564f96700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe560111080 con 0x7fe560108740 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.356+0000 7fe564f96700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe560110f00 con 0x7fe5601034c0 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.356+0000 7fe564f96700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe560111200 con 0x7fe560113710 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe560113710 0x7fe560073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe560113710 0x7fe560073210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:50012/0 (socket says 172.21.15.37:50012) 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55ed9d700 1 -- 172.21.15.37:0/204183295 learned_addr learned my addr 172.21.15.37:0/204183295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55e59c700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5601034c0 0x7fe560112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55e59c700 1 -- 172.21.15.37:0/204183295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe560113710 msgr2=0x7fe560073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55e59c700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe560113710 0x7fe560073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55e59c700 1 -- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe560108740 msgr2=0x7fe5601131d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:06:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55e59c700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe560108740 0x7fe5601131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.357+0000 7fe55e59c700 1 -- 172.21.15.37:0/204183295 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe560073750 con 0x7fe5601034c0 2024-05-09T01:06:07.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.359+0000 7fe55e59c700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5601034c0 0x7fe560112c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe55400e9f0 tx=0x7fe55400edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.361+0000 7fe54f7fe700 1 -- 172.21.15.37:0/204183295 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55400cbd0 con 0x7fe5601034c0 2024-05-09T01:06:07.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.361+0000 7fe54f7fe700 1 -- 172.21.15.37:0/204183295 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe55400cd70 con 0x7fe5601034c0 2024-05-09T01:06:07.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.361+0000 7fe54f7fe700 1 -- 172.21.15.37:0/204183295 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554018680 con 0x7fe5601034c0 2024-05-09T01:06:07.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.361+0000 7fe564f96700 1 -- 172.21.15.37:0/204183295 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe560073a40 con 0x7fe5601034c0 2024-05-09T01:06:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.361+0000 7fe564f96700 1 -- 172.21.15.37:0/204183295 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe560073f80 con 0x7fe5601034c0 2024-05-09T01:06:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.367+0000 7fe5739acb80 1 Processor -- start 2024-05-09T01:06:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.367+0000 7fe5739acb80 1 -- start start 2024-05-09T01:06:07.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.367+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d95f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.368+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 0x56116d95fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.368+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d959ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.368+0000 7fe5739acb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56116d87bff0 con 0x56116d7dc4a0 2024-05-09T01:06:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.369+0000 7fe5739acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56116d81a7f0 con 0x56116d9596a0 2024-05-09T01:06:07.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.369+0000 7fe5739acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56116d877fb0 con 0x56116d8c6160 2024-05-09T01:06:07.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.369+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d959ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.369+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d959ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60136/0 (socket says 172.21.15.37:60136) 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.369+0000 7fe55dd9b700 1 -- 172.21.15.37:0/953093940 learned_addr learned my addr 172.21.15.37:0/953093940 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.370+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d95f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.370+0000 7fe55dd9b700 1 -- 172.21.15.37:0/953093940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 msgr2=0x56116d95f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.370+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d95f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.370+0000 7fe55dd9b700 1 -- 172.21.15.37:0/953093940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 msgr2=0x56116d95fa20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.370+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 0x56116d95fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.370+0000 7fe55dd9b700 1 -- 172.21.15.37:0/953093940 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56116d812370 con 0x56116d9596a0 2024-05-09T01:06:07.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.371+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d959ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe55800d010 tx=0x7fe5580098c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa11438bfe90e61b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:07.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.373+0000 7fe564f96700 1 -- 172.21.15.37:0/953093940 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55800bab0 con 0x56116d9596a0 2024-05-09T01:06:07.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.373+0000 7fe564f96700 1 -- 172.21.15.37:0/953093940 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe55800bc50 con 0x56116d9596a0 2024-05-09T01:06:07.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.373+0000 7fe564f96700 1 -- 172.21.15.37:0/953093940 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558007cc0 con 0x56116d9596a0 2024-05-09T01:06:07.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.373+0000 7fe54f7fe700 1 -- 172.21.15.37:0/204183295 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe554010430 con 0x7fe5601034c0 2024-05-09T01:06:07.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.374+0000 7fe5739acb80 1 -- 172.21.15.37:0/953093940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 msgr2=0x56116d959ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.374+0000 7fe5739acb80 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d959ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe55800d010 tx=0x7fe5580098c0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.374+0000 7fe54f7fe700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5480b2a40 0x7fe5480b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.375+0000 7fe54f7fe700 1 -- 172.21.15.37:0/204183295 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe5540e2800 con 0x7fe5601034c0 2024-05-09T01:06:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.375+0000 7fe5739acb80 1 -- 172.21.15.37:0/953093940 shutdown_connections 2024-05-09T01:06:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.375+0000 7fe5739acb80 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d959ab0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.375+0000 7fe5739acb80 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d95f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.375+0000 7fe5739acb80 1 --2- 172.21.15.37:0/953093940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 0x56116d95fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.375+0000 7fe5739acb80 1 -- 172.21.15.37:0/953093940 >> 172.21.15.37:0/953093940 conn(0x56116d83c6a0 msgr2=0x56116d954a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:07.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.376+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5480b2a40 0x7fe5480b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.377+0000 7fe5739acb80 1 -- 172.21.15.37:0/953093940 shutdown_connections 2024-05-09T01:06:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.377+0000 7fe5739acb80 1 -- 172.21.15.37:0/953093940 wait complete. 2024-05-09T01:06:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.377+0000 7fe5739acb80 1 -- start start 2024-05-09T01:06:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.378+0000 7fe5739acb80 1 Processor -- start 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.378+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5480b2a40 0x7fe5480b4f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe55000cc10 tx=0x7fe550005f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.378+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d7dc4a0 0x56116d963100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.378+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d8c6160 0x56116d963640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d963b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe5739acb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56116d6f7ba0 con 0x56116d8c6160 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe5739acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56116d836150 con 0x56116d9596a0 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe5739acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56116d95a430 con 0x56116d7dc4a0 2024-05-09T01:06:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe5739acb80 10 client.0 _ll_register_callbacks cb 0x56116d6ed6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d963b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d963b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60140/0 (socket says 172.21.15.37:60140) 2024-05-09T01:06:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 -- 172.21.15.37:0/3238540390 learned_addr learned my addr 172.21.15.37:0/3238540390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55e59c700 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d7dc4a0 0x56116d963100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 -- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d7dc4a0 msgr2=0x56116d963100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d7dc4a0 0x56116d963100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 -- 172.21.15.37:0/3238540390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d8c6160 msgr2=0x56116d963640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d8c6160 0x56116d963640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.379+0000 7fe55ed9d700 1 -- 172.21.15.37:0/3238540390 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56116d6f7490 con 0x56116d9596a0 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.380+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d963b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5500119c0 tx=0x7fe550004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff97a035f8d3c9eb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.380+0000 7fe545ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.380+0000 7fe545ffb700 1 -- 172.21.15.37:0/3238540390 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55000ec60 con 0x56116d9596a0 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.380+0000 7fe545ffb700 1 -- 172.21.15.37:0/3238540390 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe55000ee00 con 0x56116d9596a0 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.380+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe55800bc50 con 0x56116d9596a0 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe545ffb700 1 -- 172.21.15.37:0/3238540390 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe55001e420 con 0x56116d9596a0 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 10 client.25676 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56116d9707e0 con 0x56116d9596a0 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe545ffb700 1 -- 172.21.15.37:0/3238540390 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe55800bc50 con 0x56116d9596a0 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe545ffb700 1 -- 172.21.15.37:0/3238540390 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fe5500266c0 con 0x56116d9596a0 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 10 client.25676 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 10 client.25676 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 20 client.25676 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d972e20 0x56116d9752d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 4 client.25676 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.381+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56116d8899d0 con 0x56116d972e20 2024-05-09T01:06:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.382+0000 7fe55e59c700 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d972e20 0x56116d9752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.383+0000 7fe545ffb700 10 client.25676 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:06:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.383+0000 7fe55e59c700 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d972e20 0x56116d9752d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e397e5a2846e4410 server_cookie=4a48a789a6bd1d0a in_seq=0 out_seq=0 2024-05-09T01:06:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.384+0000 7fe545ffb700 1 -- 172.21.15.37:0/3238540390 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56116d8899d0 con 0x56116d972e20 2024-05-09T01:06:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.384+0000 7fe545ffb700 10 client.25676 handle_command_reply: tid=0 2024-05-09T01:06:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.384+0000 7fe5739acb80 1 client.25676 shutdown 2024-05-09T01:06:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.384+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 msgr2=0x56116d963b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.384+0000 7fe5739acb80 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d963b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5500119c0 tx=0x7fe550004750 comp rx=0 tx=0).stop 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 shutdown_connections 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d972e20 0x56116d9752d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d963b80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d7dc4a0 0x56116d963100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 --2- 172.21.15.37:0/3238540390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d8c6160 0x56116d963640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 >> 172.21.15.37:0/3238540390 conn(0x56116d83c6a0 msgr2=0x56116d954550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe545ffb700 0 client.25676 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 shutdown_connections 2024-05-09T01:06:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 1 -- 172.21.15.37:0/3238540390 wait complete. 2024-05-09T01:06:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.385+0000 7fe5739acb80 20 client.25676 trim_cache size 0 max 16384 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.414+0000 7fe5739acb80 1 Processor -- start 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe5739acb80 1 -- start start 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 0x56116d95e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d954a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d97aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe5739acb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601c6990 con 0x56116d7dc4a0 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe5739acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601c8500 con 0x56116d9596a0 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe5739acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601c7060 con 0x56116d8c6160 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.415+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d954a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d97aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d954a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:50038/0 (socket says 172.21.15.37:50038) 2024-05-09T01:06:07.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 -- 172.21.15.37:0/1107929812 learned_addr learned my addr 172.21.15.37:0/1107929812 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:07.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d97aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60148/0 (socket says 172.21.15.37:60148) 2024-05-09T01:06:07.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55e59c700 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 0x56116d95e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 -- 172.21.15.37:0/1107929812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 msgr2=0x56116d97aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:07.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d97aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 -- 172.21.15.37:0/1107929812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 msgr2=0x56116d95e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:07.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 0x56116d95e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 -- 172.21.15.37:0/1107929812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56116d964110 con 0x56116d8c6160 2024-05-09T01:06:07.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.416+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d954a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe558009fc0 tx=0x7fe55800b780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc5026e57319d94 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:07.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.417+0000 7fe547fff700 1 -- 172.21.15.37:0/1107929812 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55801f070 con 0x56116d8c6160 2024-05-09T01:06:07.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.417+0000 7fe547fff700 1 -- 172.21.15.37:0/1107929812 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe558009360 con 0x56116d8c6160 2024-05-09T01:06:07.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.417+0000 7fe547fff700 1 -- 172.21.15.37:0/1107929812 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5580077e0 con 0x56116d8c6160 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.418+0000 7fe5739acb80 1 -- 172.21.15.37:0/1107929812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 msgr2=0x56116d954a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.418+0000 7fe5739acb80 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d954a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe558009fc0 tx=0x7fe55800b780 comp rx=0 tx=0).stop 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.418+0000 7fe5739acb80 1 -- 172.21.15.37:0/1107929812 shutdown_connections 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.418+0000 7fe5739acb80 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d9596a0 0x56116d97aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.418+0000 7fe5739acb80 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d7dc4a0 0x56116d95e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.418+0000 7fe5739acb80 1 --2- 172.21.15.37:0/1107929812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d954a50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.418+0000 7fe5739acb80 1 -- 172.21.15.37:0/1107929812 >> 172.21.15.37:0/1107929812 conn(0x56116d83c6a0 msgr2=0x56116d95e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.419+0000 7fe5739acb80 1 -- 172.21.15.37:0/1107929812 shutdown_connections 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.419+0000 7fe5739acb80 1 -- 172.21.15.37:0/1107929812 wait complete. 2024-05-09T01:06:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.419+0000 7fe5739acb80 1 -- start start 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.419+0000 7fe5739acb80 1 Processor -- start 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d7dc4a0 0x56116d96b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d96db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe5739acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d9596a0 0x56116d96e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe5739acb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601c7e30 con 0x56116d9596a0 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe5739acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601c7730 con 0x56116d7dc4a0 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe5739acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601c4970 con 0x56116d8c6160 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe5739acb80 10 client.0 _ll_register_callbacks cb 0x56116d6ed6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe55e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d7dc4a0 0x56116d96b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe55e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d7dc4a0 0x56116d96b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60154/0 (socket says 172.21.15.37:60154) 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe55e59c700 1 -- 172.21.15.37:0/2741274340 learned_addr learned my addr 172.21.15.37:0/2741274340 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d9596a0 0x56116d96e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55e59c700 1 -- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 msgr2=0x56116d96db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.420+0000 7fe55dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d96db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55e59c700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d96db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55e59c700 1 -- 172.21.15.37:0/2741274340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d9596a0 msgr2=0x56116d96e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55e59c700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d9596a0 0x56116d96e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55e59c700 1 -- 172.21.15.37:0/2741274340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56116d96e650 con 0x56116d7dc4a0 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55ed9d700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d9596a0 0x56116d96e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d96db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:07.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe55e59c700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d7dc4a0 0x56116d96b300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe55400e9c0 tx=0x7fe554010d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2192128273b2854f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.421+0000 7fe545ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.424+0000 7fe545ffb700 1 -- 172.21.15.37:0/2741274340 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5540c8070 con 0x56116d7dc4a0 2024-05-09T01:06:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.424+0000 7fe545ffb700 1 -- 172.21.15.37:0/2741274340 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe5540b2a00 con 0x56116d7dc4a0 2024-05-09T01:06:07.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.424+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe558009360 con 0x56116d7dc4a0 2024-05-09T01:06:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.425+0000 7fe545ffb700 1 -- 172.21.15.37:0/2741274340 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe5540ae1d0 con 0x56116d7dc4a0 2024-05-09T01:06:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.425+0000 7fe5739acb80 10 client.25682 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.425+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56116d9fe650 con 0x56116d7dc4a0 2024-05-09T01:06:07.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.425+0000 7fe545ffb700 1 -- 172.21.15.37:0/2741274340 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe558009360 con 0x56116d7dc4a0 2024-05-09T01:06:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe545ffb700 1 -- 172.21.15.37:0/2741274340 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fe5540a5820 con 0x56116d7dc4a0 2024-05-09T01:06:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe5739acb80 10 client.25682 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe5739acb80 10 client.25682 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:06:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe5739acb80 20 client.25682 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe5739acb80 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d9fec70 0x56116da01090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe5739acb80 4 client.25682 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:06:07.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56116d883a70 con 0x56116d9fec70 2024-05-09T01:06:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.426+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d9fec70 0x56116da01090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.427+0000 7fe55dd9b700 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d9fec70 0x56116da01090 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=19f63f13037550c6 server_cookie=2ff0c0a78e2e1b64 in_seq=0 out_seq=0 2024-05-09T01:06:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.427+0000 7fe545ffb700 10 client.25682 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:06:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.427+0000 7fe545ffb700 1 -- 172.21.15.37:0/2741274340 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56116d883a70 con 0x56116d9fec70 2024-05-09T01:06:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.427+0000 7fe545ffb700 10 client.25682 handle_command_reply: tid=0 2024-05-09T01:06:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.427+0000 7fe5739acb80 1 client.25682 shutdown 2024-05-09T01:06:07.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d7dc4a0 msgr2=0x56116d96b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d7dc4a0 0x56116d96b300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe55400e9c0 tx=0x7fe554010d20 comp rx=0 tx=0).stop 2024-05-09T01:06:07.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 shutdown_connections 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x56116d9fec70 0x56116da01090 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56116d9596a0 0x56116d96e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56116d7dc4a0 0x56116d96b300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 --2- 172.21.15.37:0/2741274340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56116d8c6160 0x56116d96db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 >> 172.21.15.37:0/2741274340 conn(0x56116d83c6a0 msgr2=0x56116d95cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe545ffb700 0 client.25682 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 shutdown_connections 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 1 -- 172.21.15.37:0/2741274340 wait complete. 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.428+0000 7fe5739acb80 20 client.25682 trim_cache size 0 max 16384 2024-05-09T01:06:07.430 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:06:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.429+0000 7fe54d7fa700 1 -- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5480b2a40 msgr2=0x7fe5480b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.429+0000 7fe54d7fa700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5480b2a40 0x7fe5480b4f50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe55000cc10 tx=0x7fe550005f10 comp rx=0 tx=0).stop 2024-05-09T01:06:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.429+0000 7fe54d7fa700 1 -- 172.21.15.37:0/204183295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5601034c0 msgr2=0x7fe560112c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.429+0000 7fe54d7fa700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5601034c0 0x7fe560112c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe55400e9f0 tx=0x7fe55400edb0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 -- 172.21.15.37:0/204183295 shutdown_connections 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe5480b2a40 0x7fe5480b4f50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe560113710 0x7fe560073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5601034c0 0x7fe560112c90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 --2- 172.21.15.37:0/204183295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe560108740 0x7fe5601131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 -- 172.21.15.37:0/204183295 >> 172.21.15.37:0/204183295 conn(0x7fe5600fedc0 msgr2=0x7fe5601011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 -- 172.21.15.37:0/204183295 shutdown_connections 2024-05-09T01:06:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:07.430+0000 7fe54d7fa700 1 -- 172.21.15.37:0/204183295 wait complete. 2024-05-09T01:06:08.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:06:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:08 smithi037 ceph-mon[30122]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 795 op/s 2024-05-09T01:06:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:08 smithi136 ceph-mon[34110]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 795 op/s 2024-05-09T01:06:08.642 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:08 smithi151 ceph-mon[34780]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 795 op/s 2024-05-09T01:06:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 230.0 s, 4016.8 tps, lat 24.823 ms stddev 29.425 2024-05-09T01:06:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:10 smithi136 ceph-mon[34110]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 738 op/s 2024-05-09T01:06:10.632 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:10 smithi037 ceph-mon[30122]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 738 op/s 2024-05-09T01:06:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:10 smithi151 ceph-mon[34780]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 738 op/s 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 -- 172.21.15.37:0/1465894653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c109860 msgr2=0x7fd55c1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 --2- 172.21.15.37:0/1465894653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c109860 0x7fd55c1111c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd55400b0d0 tx=0x7fd55400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 -- 172.21.15.37:0/1465894653 shutdown_connections 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 --2- 172.21.15.37:0/1465894653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c109860 0x7fd55c1111c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 --2- 172.21.15.37:0/1465894653 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55c1045e0 0x7fd55c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 --2- 172.21.15.37:0/1465894653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd55c108f10 0x7fd55c109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 -- 172.21.15.37:0/1465894653 >> 172.21.15.37:0/1465894653 conn(0x7fd55c0ffe70 msgr2=0x7fd55c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 -- 172.21.15.37:0/1465894653 shutdown_connections 2024-05-09T01:06:10.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.936+0000 7fd56187d700 1 -- 172.21.15.37:0/1465894653 wait complete. 2024-05-09T01:06:10.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.940+0000 7fd56187d700 1 Processor -- start 2024-05-09T01:06:10.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.940+0000 7fd56187d700 1 -- start start 2024-05-09T01:06:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd56187d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55c1045e0 0x7fd55c19ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd56187d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c108f10 0x7fd55c19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd56187d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd55c109860 0x7fd55c19f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd56187d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c114490 con 0x7fd55c108f10 2024-05-09T01:06:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd56187d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c114310 con 0x7fd55c1045e0 2024-05-09T01:06:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd56187d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c114610 con 0x7fd55c109860 2024-05-09T01:06:10.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd55a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c108f10 0x7fd55c19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd55affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55c1045e0 0x7fd55c19ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd55a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c108f10 0x7fd55c19b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36330/0 (socket says 172.21.15.37:36330) 2024-05-09T01:06:10.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.941+0000 7fd55a7fc700 1 -- 172.21.15.37:0/3782088597 learned_addr learned my addr 172.21.15.37:0/3782088597 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd55b7fe700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd55c109860 0x7fd55c19f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd55affd700 1 -- 172.21.15.37:0/3782088597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd55c109860 msgr2=0x7fd55c19f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd55affd700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd55c109860 0x7fd55c19f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd55affd700 1 -- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c108f10 msgr2=0x7fd55c19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd55affd700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c108f10 0x7fd55c19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd55affd700 1 -- 172.21.15.37:0/3782088597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55c19fc80 con 0x7fd55c1045e0 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd55affd700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55c1045e0 0x7fd55c19ae00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009ef0 tx=0x7fd54c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:10.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd56087b700 1 -- 172.21.15.37:0/3782088597 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c020070 con 0x7fd55c1045e0 2024-05-09T01:06:10.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd56087b700 1 -- 172.21.15.37:0/3782088597 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd54c00cc70 con 0x7fd55c1045e0 2024-05-09T01:06:10.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55c19ff70 con 0x7fd55c1045e0 2024-05-09T01:06:10.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.942+0000 7fd56087b700 1 -- 172.21.15.37:0/3782088597 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c01b810 con 0x7fd55c1045e0 2024-05-09T01:06:10.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.943+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55c0759f0 con 0x7fd55c1045e0 2024-05-09T01:06:10.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.945+0000 7fd56087b700 1 -- 172.21.15.37:0/3782088597 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd54c023070 con 0x7fd55c1045e0 2024-05-09T01:06:10.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.948+0000 7fd570293b80 1 Processor -- start 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.949+0000 7fd56087b700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5440b2900 0x7fd5440b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.949+0000 7fd570293b80 1 -- start start 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.949+0000 7fd56087b700 1 -- 172.21.15.37:0/3782088597 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd54c0e6120 con 0x7fd55c1045e0 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.949+0000 7fd570293b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad36240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.949+0000 7fd55b7fe700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5440b2900 0x7fd5440b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.949+0000 7fd570293b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad36780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd570293b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ad30400 0x56544ad30810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd570293b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56544ac530a0 con 0x56544ad30400 2024-05-09T01:06:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd570293b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56544abf89a0 con 0x56544abb34a0 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd570293b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56544ac4f060 con 0x56544ac2dd00 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad36240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad36240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:50068/0 (socket says 172.21.15.37:50068) 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 -- 172.21.15.37:0/1645037706 learned_addr learned my addr 172.21.15.37:0/1645037706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad36780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 -- 172.21.15.37:0/1645037706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 msgr2=0x56544ad36780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad36780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 -- 172.21.15.37:0/1645037706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ad30400 msgr2=0x56544ad30810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55b7fe700 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ad30400 0x56544ad30810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ad30400 0x56544ad30810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 -- 172.21.15.37:0/1645037706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56544abe9500 con 0x56544ac2dd00 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55b7fe700 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ad30400 0x56544ad30810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55b7fe700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5440b2900 0x7fd5440b4e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd554009900 tx=0x7fd554009c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:10.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd55affd700 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad36240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c5b0 tx=0x7fd54c0ad1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2b8c5fab6bc36 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:10.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd541ffb700 1 -- 172.21.15.37:0/1645037706 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0a7e60 con 0x56544ac2dd00 2024-05-09T01:06:10.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.950+0000 7fd541ffb700 1 -- 172.21.15.37:0/1645037706 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd54c013be0 con 0x56544ac2dd00 2024-05-09T01:06:10.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.951+0000 7fd541ffb700 1 -- 172.21.15.37:0/1645037706 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0b65a0 con 0x56544ac2dd00 2024-05-09T01:06:10.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 -- 172.21.15.37:0/1645037706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 msgr2=0x56544ad36240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:10.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad36240 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c5b0 tx=0x7fd54c0ad1c0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 -- 172.21.15.37:0/1645037706 shutdown_connections 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ad30400 0x56544ad30810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad36240 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 --2- 172.21.15.37:0/1645037706 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad36780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 -- 172.21.15.37:0/1645037706 >> 172.21.15.37:0/1645037706 conn(0x56544abb6f70 msgr2=0x56544ad2b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 -- 172.21.15.37:0/1645037706 shutdown_connections 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.952+0000 7fd570293b80 1 -- 172.21.15.37:0/1645037706 wait complete. 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 -- start start 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 Processor -- start 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad3a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad3a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56544ad31160 con 0x56544ac2dd00 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56544abedb20 con 0x56544abb34a0 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56544ad3d020 con 0x56544ad30400 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd570293b80 10 client.0 _ll_register_callbacks cb 0x56544aac46c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.953+0000 7fd55affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad3a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad3a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60190/0 (socket says 172.21.15.37:60190) 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 -- 172.21.15.37:0/2811174484 learned_addr learned my addr 172.21.15.37:0/2811174484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55b7fe700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 -- 172.21.15.37:0/2811174484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 msgr2=0x56544ad3aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 -- 172.21.15.37:0/2811174484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 msgr2=0x56544ad3a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad3a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 -- 172.21.15.37:0/2811174484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56544aace490 con 0x56544abb34a0 2024-05-09T01:06:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55b7fe700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd55affd700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad3a040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0acff0 tx=0x7fd54c0b6340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c71510e453beea9a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd53affd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd53affd700 1 -- 172.21.15.37:0/2811174484 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0c6020 con 0x56544abb34a0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd53affd700 1 -- 172.21.15.37:0/2811174484 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd54c0c2da0 con 0x56544abb34a0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.954+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56544ac60a80 con 0x56544abb34a0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.955+0000 7fd53affd700 1 -- 172.21.15.37:0/2811174484 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd54c0a7e60 con 0x56544abb34a0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.955+0000 7fd570293b80 10 client.25694 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.955+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56544ad47980 con 0x56544abb34a0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.956+0000 7fd53affd700 1 -- 172.21.15.37:0/2811174484 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56544ac60a80 con 0x56544abb34a0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.956+0000 7fd53affd700 1 -- 172.21.15.37:0/2811174484 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fd54c00c900 con 0x56544abb34a0 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.956+0000 7fd570293b80 10 client.25694 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.956+0000 7fd570293b80 10 client.25694 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.956+0000 7fd570293b80 20 client.25694 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:10.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.956+0000 7fd570293b80 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544ad4c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.957+0000 7fd570293b80 4 client.25694 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.957+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544ad4c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.957+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56544ac5ab20 con 0x56544ad49e50 2024-05-09T01:06:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.957+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544ad4c270 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ecc9e553c2b9c9a8 server_cookie=8dfbf25677d8adb0 in_seq=0 out_seq=0 2024-05-09T01:06:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.957+0000 7fd53affd700 10 client.25694 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:06:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.958+0000 7fd53affd700 1 -- 172.21.15.37:0/2811174484 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56544ac5ab20 con 0x56544ad49e50 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.958+0000 7fd53affd700 10 client.25694 handle_command_reply: tid=0 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.958+0000 7fd570293b80 1 client.25694 shutdown 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.958+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 msgr2=0x56544ad3a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad3a040 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd54c0acff0 tx=0x7fd54c0b6340 comp rx=0 tx=0).stop 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 shutdown_connections 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad3a040 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544ad4c270 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd53affd700 0 client.25694 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 --2- 172.21.15.37:0/2811174484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad3a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 >> 172.21.15.37:0/2811174484 conn(0x56544abb6f70 msgr2=0x56544ad24ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 shutdown_connections 2024-05-09T01:06:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 1 -- 172.21.15.37:0/2811174484 wait complete. 2024-05-09T01:06:10.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.959+0000 7fd570293b80 20 client.25694 trim_cache size 0 max 16384 2024-05-09T01:06:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.986+0000 7fd570293b80 1 Processor -- start 2024-05-09T01:06:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.987+0000 7fd570293b80 1 -- start start 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.987+0000 7fd570293b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad25a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.987+0000 7fd570293b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad46020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.988+0000 7fd570293b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.988+0000 7fd570293b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ac960 con 0x56544ac2dd00 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.988+0000 7fd55a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad46020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.988+0000 7fd570293b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ae4d0 con 0x56544abb34a0 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.988+0000 7fd570293b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ad030 con 0x56544ad30400 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.988+0000 7fd55a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad46020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36354/0 (socket says 172.21.15.37:36354) 2024-05-09T01:06:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.988+0000 7fd55a7fc700 1 -- 172.21.15.37:0/3721056039 learned_addr learned my addr 172.21.15.37:0/3721056039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.989+0000 7fd55affd700 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad25a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.992+0000 7fd55a7fc700 1 -- 172.21.15.37:0/3721056039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 msgr2=0x56544ad3a000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:06:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.992+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.992+0000 7fd55a7fc700 1 -- 172.21.15.37:0/3721056039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 msgr2=0x56544ad25a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.992+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad25a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.992+0000 7fd55a7fc700 1 -- 172.21.15.37:0/3721056039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56544ad279d0 con 0x56544ac2dd00 2024-05-09T01:06:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:10.993+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad46020 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd550009690 tx=0x7fd550009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf7cfdedb04006f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.000+0000 7fd5417fa700 1 -- 172.21.15.37:0/3721056039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd550003cc0 con 0x56544ac2dd00 2024-05-09T01:06:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.000+0000 7fd5417fa700 1 -- 172.21.15.37:0/3721056039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd550004ce0 con 0x56544ac2dd00 2024-05-09T01:06:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.000+0000 7fd5417fa700 1 -- 172.21.15.37:0/3721056039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd550010430 con 0x56544ac2dd00 2024-05-09T01:06:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.001+0000 7fd570293b80 1 -- 172.21.15.37:0/3721056039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 msgr2=0x56544ad46020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.001+0000 7fd570293b80 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad46020 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd550009690 tx=0x7fd550009260 comp rx=0 tx=0).stop 2024-05-09T01:06:11.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.003+0000 7fd570293b80 1 -- 172.21.15.37:0/3721056039 shutdown_connections 2024-05-09T01:06:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.003+0000 7fd570293b80 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ad30400 0x56544ad3a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.003+0000 7fd570293b80 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544abb34a0 0x56544ad25a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.003+0000 7fd570293b80 1 --2- 172.21.15.37:0/3721056039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544ac2dd00 0x56544ad46020 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.003+0000 7fd570293b80 1 -- 172.21.15.37:0/3721056039 >> 172.21.15.37:0/3721056039 conn(0x56544abb6f70 msgr2=0x56544ad351a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.006+0000 7fd570293b80 1 -- 172.21.15.37:0/3721056039 shutdown_connections 2024-05-09T01:06:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.006+0000 7fd570293b80 1 -- 172.21.15.37:0/3721056039 wait complete. 2024-05-09T01:06:11.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.007+0000 7fd570293b80 1 -- start start 2024-05-09T01:06:11.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.007+0000 7fd570293b80 1 Processor -- start 2024-05-09T01:06:11.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.008+0000 7fd570293b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544abb34a0 0x56544ad4e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:11.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.008+0000 7fd570293b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad4eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:11.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd570293b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544ad30400 0x56544adb23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:11.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd570293b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ade00 con 0x56544abb34a0 2024-05-09T01:06:11.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd570293b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ad700 con 0x56544ad30400 2024-05-09T01:06:11.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd55b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544ad30400 0x56544adb23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:11.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd55b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544ad30400 0x56544adb23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60198/0 (socket says 172.21.15.37:60198) 2024-05-09T01:06:11.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd55b7fe700 1 -- 172.21.15.37:0/911667692 learned_addr learned my addr 172.21.15.37:0/911667692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:11.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1aa920 con 0x56544ac2dd00 2024-05-09T01:06:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.009+0000 7fd55affd700 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544abb34a0 0x56544ad4e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.011+0000 7fd570293b80 10 client.0 _ll_register_callbacks cb 0x56544aac46c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.011+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad4eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.012+0000 7fd55a7fc700 1 -- 172.21.15.37:0/911667692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544ad30400 msgr2=0x56544adb23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.012+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544ad30400 0x56544adb23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.012+0000 7fd55a7fc700 1 -- 172.21.15.37:0/911667692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544abb34a0 msgr2=0x56544ad4e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.012+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544abb34a0 0x56544ad4e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.012+0000 7fd55a7fc700 1 -- 172.21.15.37:0/911667692 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56544adb28e0 con 0x56544ac2dd00 2024-05-09T01:06:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.012+0000 7fd55a7fc700 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad4eaa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x56544ad3cf50 tx=0x7fd5500057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2b4bd44a5469cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.012+0000 7fd53affd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:06:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.013+0000 7fd53affd700 1 -- 172.21.15.37:0/911667692 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5500049c0 con 0x56544ac2dd00 2024-05-09T01:06:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.013+0000 7fd53affd700 1 -- 172.21.15.37:0/911667692 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd550003ac0 con 0x56544ac2dd00 2024-05-09T01:06:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.014+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd550004ce0 con 0x56544ac2dd00 2024-05-09T01:06:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.015+0000 7fd53affd700 1 -- 172.21.15.37:0/911667692 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fd550003cc0 con 0x56544ac2dd00 2024-05-09T01:06:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.015+0000 7fd570293b80 10 client.25699 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.015+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56544adb3a10 con 0x56544ac2dd00 2024-05-09T01:06:11.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.017+0000 7fd53affd700 1 -- 172.21.15.37:0/911667692 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5500205d0 con 0x56544ac2dd00 2024-05-09T01:06:11.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.019+0000 7fd53affd700 1 -- 172.21.15.37:0/911667692 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fd55002b430 con 0x56544ac2dd00 2024-05-09T01:06:11.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.019+0000 7fd570293b80 10 client.25699 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:11.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.019+0000 7fd570293b80 10 client.25699 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:06:11.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.019+0000 7fd570293b80 20 client.25699 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:11.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.019+0000 7fd570293b80 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544adb6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:11.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.019+0000 7fd570293b80 4 client.25699 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:06:11.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.019+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd550004ce0 con 0x56544ad49e50 2024-05-09T01:06:11.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.020+0000 7fd55affd700 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544adb6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:11.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.021+0000 7fd55affd700 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544adb6010 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3272a9c7c20722dc server_cookie=b0399fd86d788ba in_seq=0 out_seq=0 2024-05-09T01:06:11.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.021+0000 7fd53affd700 10 client.25699 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:06:11.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.021+0000 7fd53affd700 1 -- 172.21.15.37:0/911667692 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd550004ce0 con 0x56544ad49e50 2024-05-09T01:06:11.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.021+0000 7fd53affd700 10 client.25699 handle_command_reply: tid=0 2024-05-09T01:06:11.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.021+0000 7fd570293b80 1 client.25699 shutdown 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.021+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 msgr2=0x56544ad4eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.021+0000 7fd570293b80 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad4eaa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x56544ad3cf50 tx=0x7fd5500057a0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 shutdown_connections 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56544ad30400 0x56544adb23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56544ad49e50 0x56544adb6010 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56544abb34a0 0x56544ad4e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 --2- 172.21.15.37:0/911667692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56544ac2dd00 0x56544ad4eaa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 >> 172.21.15.37:0/911667692 conn(0x56544abb6f70 msgr2=0x56544ad3a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd53affd700 0 client.25699 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 shutdown_connections 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 1 -- 172.21.15.37:0/911667692 wait complete. 2024-05-09T01:06:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.022+0000 7fd570293b80 20 client.25699 trim_cache size 0 max 16384 2024-05-09T01:06:11.025 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:06:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5440b2900 msgr2=0x7fd5440b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5440b2900 0x7fd5440b4e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd554009900 tx=0x7fd554009c80 comp rx=0 tx=0).stop 2024-05-09T01:06:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55c1045e0 msgr2=0x7fd55c19ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55c1045e0 0x7fd55c19ae00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009ef0 tx=0x7fd54c00ecd0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 shutdown_connections 2024-05-09T01:06:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5440b2900 0x7fd5440b4e10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd55c109860 0x7fd55c19f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55c1045e0 0x7fd55c19ae00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 --2- 172.21.15.37:0/3782088597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55c108f10 0x7fd55c19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.023+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 >> 172.21.15.37:0/3782088597 conn(0x7fd55c0ffe70 msgr2=0x7fd55c107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.024+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 shutdown_connections 2024-05-09T01:06:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:11.024+0000 7fd56187d700 1 -- 172.21.15.37:0/3782088597 wait complete. 2024-05-09T01:06:11.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:06:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:12 smithi136 ceph-mon[34110]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 799 op/s 2024-05-09T01:06:12.639 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:12 smithi037 ceph-mon[30122]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 799 op/s 2024-05-09T01:06:12.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:12 smithi151 ceph-mon[34780]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 799 op/s 2024-05-09T01:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 -- 172.21.15.37:0/1590162502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 msgr2=0x7fb160108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 --2- 172.21.15.37:0/1590162502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb160108220 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb1540098f0 tx=0x7fb154009c00 comp rx=0 tx=0).stop 2024-05-09T01:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 -- 172.21.15.37:0/1590162502 shutdown_connections 2024-05-09T01:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 --2- 172.21.15.37:0/1590162502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb160108760 0x7fb1601100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 --2- 172.21.15.37:0/1590162502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1601034e0 0x7fb1601038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 --2- 172.21.15.37:0/1590162502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb160108220 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 -- 172.21.15.37:0/1590162502 >> 172.21.15.37:0/1590162502 conn(0x7fb1600fef30 msgr2=0x7fb160101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 -- 172.21.15.37:0/1590162502 shutdown_connections 2024-05-09T01:06:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.264+0000 7fb164a5e700 1 -- 172.21.15.37:0/1590162502 wait complete. 2024-05-09T01:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 Processor -- start 2024-05-09T01:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 -- start start 2024-05-09T01:06:14.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1601034e0 0x7fb16019d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb16019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb160108760 0x7fb1601a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb160114500 con 0x7fb160108760 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb160114380 con 0x7fb160107e10 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.266+0000 7fb164a5e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb160114680 con 0x7fb1601034e0 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1601034e0 0x7fb16019d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb16019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb160108760 0x7fb1601a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1601034e0 0x7fb16019d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48326/0 (socket says 172.21.15.37:48326) 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb16019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52000/0 (socket says 172.21.15.37:52000) 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15e59c700 1 -- 172.21.15.37:0/2956940925 learned_addr learned my addr 172.21.15.37:0/2956940925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 -- 172.21.15.37:0/2956940925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1601034e0 msgr2=0x7fb16019d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1601034e0 0x7fb16019d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 -- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb160108760 msgr2=0x7fb1601a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb160108760 0x7fb1601a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 -- 172.21.15.37:0/2956940925 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1601a2000 con 0x7fb160107e10 2024-05-09T01:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15ed9d700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb160108760 0x7fb1601a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb16019d6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb154000c00 tx=0x7fb15400fa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.267+0000 7fb14f7fe700 1 -- 172.21.15.37:0/2956940925 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540050c0 con 0x7fb160107e10 2024-05-09T01:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.268+0000 7fb14f7fe700 1 -- 172.21.15.37:0/2956940925 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb15400b560 con 0x7fb160107e10 2024-05-09T01:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.268+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1601a2290 con 0x7fb160107e10 2024-05-09T01:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.268+0000 7fb14f7fe700 1 -- 172.21.15.37:0/2956940925 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540039b0 con 0x7fb160107e10 2024-05-09T01:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.268+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1601a2740 con 0x7fb160107e10 2024-05-09T01:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.271+0000 7fb14f7fe700 1 -- 172.21.15.37:0/2956940925 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb154003b50 con 0x7fb160107e10 2024-05-09T01:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.272+0000 7fb14f7fe700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1480b2880 0x7fb1480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.272+0000 7fb14f7fe700 1 -- 172.21.15.37:0/2956940925 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb1540e2ff0 con 0x7fb160107e10 2024-05-09T01:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.272+0000 7fb15e59c700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1480b2880 0x7fb1480b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.273+0000 7fb173474b80 1 Processor -- start 2024-05-09T01:06:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.273+0000 7fb15e59c700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1480b2880 0x7fb1480b4d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb150005d10 tx=0x7fb150009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.273+0000 7fb173474b80 1 -- start start 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.273+0000 7fb173474b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366ba79160 0x56366bb124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.273+0000 7fb173474b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb12a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.273+0000 7fb173474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366bb0c6a0 0x56366bb0cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.273+0000 7fb173474b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56366ba2eff0 con 0x56366ba79160 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.274+0000 7fb173474b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56366b9cd7f0 con 0x56366b98f4a0 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.274+0000 7fb173474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56366ba2afb0 con 0x56366bb0c6a0 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.274+0000 7fb15dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb12a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.274+0000 7fb15dd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb12a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52006/0 (socket says 172.21.15.37:52006) 2024-05-09T01:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.274+0000 7fb15dd9b700 1 -- 172.21.15.37:0/2409174797 learned_addr learned my addr 172.21.15.37:0/2409174797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.274+0000 7fb15ed9d700 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366bb0c6a0 0x56366bb0cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.274+0000 7fb15dd9b700 1 -- 172.21.15.37:0/2409174797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366bb0c6a0 msgr2=0x56366bb0cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366bb0c6a0 0x56366bb0cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb15dd9b700 1 -- 172.21.15.37:0/2409174797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366ba79160 msgr2=0x56366bb124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366ba79160 0x56366bb124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb15dd9b700 1 -- 172.21.15.37:0/2409174797 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366b9c5370 con 0x56366b98f4a0 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb15ed9d700 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366bb0c6a0 0x56366bb0cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb12a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb154005f40 tx=0x7fb1540b1120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=867f9c302dd20b61 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb14cff9700 1 -- 172.21.15.37:0/2409174797 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540a4e60 con 0x56366b98f4a0 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb14cff9700 1 -- 172.21.15.37:0/2409174797 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1540094d0 con 0x56366b98f4a0 2024-05-09T01:06:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.275+0000 7fb14cff9700 1 -- 172.21.15.37:0/2409174797 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540a6a10 con 0x56366b98f4a0 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 -- 172.21.15.37:0/2409174797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 msgr2=0x56366bb12a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb12a30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb154005f40 tx=0x7fb1540b1120 comp rx=0 tx=0).stop 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 -- 172.21.15.37:0/2409174797 shutdown_connections 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366bb0c6a0 0x56366bb0cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366ba79160 0x56366bb124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 --2- 172.21.15.37:0/2409174797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb12a30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 -- 172.21.15.37:0/2409174797 >> 172.21.15.37:0/2409174797 conn(0x56366b9ef6a0 msgr2=0x56366bb07400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.276+0000 7fb173474b80 1 -- 172.21.15.37:0/2409174797 shutdown_connections 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 -- 172.21.15.37:0/2409174797 wait complete. 2024-05-09T01:06:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 -- start start 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 Processor -- start 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb1bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb16030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56366b8aaba0 con 0x56366bb0c6a0 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56366b9e9150 con 0x56366b98f4a0 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56366bb0d360 con 0x56366ba79160 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb1bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.277+0000 7fb173474b80 10 client.0 _ll_register_callbacks cb 0x56366b8a06c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb1bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52008/0 (socket says 172.21.15.37:52008) 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15e59c700 1 -- 172.21.15.37:0/3482474625 learned_addr learned my addr 172.21.15.37:0/3482474625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15ed9d700 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb16030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15dd9b700 1 -- 172.21.15.37:0/3482474625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 msgr2=0x56366bb1bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb1bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15dd9b700 1 -- 172.21.15.37:0/3482474625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 msgr2=0x56366bb16030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb16030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15dd9b700 1 -- 172.21.15.37:0/3482474625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366b8aa490 con 0x56366ba79160 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.278+0000 7fb15ed9d700 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb16030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.279+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1c170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x56366bb0d1f0 tx=0x7fb1540a4ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a75e0140fbd358a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.279+0000 7fb145ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.279+0000 7fb145ffb700 1 -- 172.21.15.37:0/3482474625 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154071060 con 0x56366ba79160 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.279+0000 7fb145ffb700 1 -- 172.21.15.37:0/3482474625 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb15400b9e0 con 0x56366ba79160 2024-05-09T01:06:14.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.279+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1540094d0 con 0x56366ba79160 2024-05-09T01:06:14.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.280+0000 7fb145ffb700 1 -- 172.21.15.37:0/3482474625 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb1540c9050 con 0x56366ba79160 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.280+0000 7fb173474b80 10 client.25711 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.280+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56366bb23850 con 0x56366ba79160 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.280+0000 7fb145ffb700 1 -- 172.21.15.37:0/3482474625 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1540094d0 con 0x56366ba79160 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb145ffb700 1 -- 172.21.15.37:0/3482474625 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fb154021410 con 0x56366ba79160 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb173474b80 10 client.25711 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb173474b80 10 client.25711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb173474b80 20 client.25711 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb173474b80 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb28140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb173474b80 4 client.25711 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56366ba3c9d0 con 0x56366bb25d20 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb15e59c700 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb28140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb145ffb700 10 client.25711 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:14.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.281+0000 7fb15e59c700 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb28140 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17915a3e31326b65 server_cookie=ae031c08644133a4 in_seq=0 out_seq=0 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb145ffb700 1 -- 172.21.15.37:0/3482474625 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56366ba3c9d0 con 0x56366bb25d20 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb145ffb700 10 client.25711 handle_command_reply: tid=0 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb173474b80 1 client.25711 shutdown 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 msgr2=0x56366bb1c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb173474b80 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1c170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x56366bb0d1f0 tx=0x7fb1540a4ed0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 shutdown_connections 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb173474b80 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb28140 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb173474b80 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb16030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.283+0000 7fb173474b80 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb1bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.284+0000 7fb145ffb700 0 client.25711 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.284+0000 7fb173474b80 1 --2- 172.21.15.37:0/3482474625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1c170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.284+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 >> 172.21.15.37:0/3482474625 conn(0x56366b9ef6a0 msgr2=0x56366bb071c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:14.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.284+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 shutdown_connections 2024-05-09T01:06:14.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.284+0000 7fb173474b80 1 -- 172.21.15.37:0/3482474625 wait complete. 2024-05-09T01:06:14.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.284+0000 7fb173474b80 20 client.25711 trim_cache size 0 max 16384 2024-05-09T01:06:14.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.304+0000 7fb173474b80 1 Processor -- start 2024-05-09T01:06:14.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.304+0000 7fb173474b80 1 -- start start 2024-05-09T01:06:14.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.305+0000 7fb173474b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb15ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.305+0000 7fb173474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb2d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.305+0000 7fb173474b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb2dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.305+0000 7fb173474b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601b0bf0 con 0x56366bb0c6a0 2024-05-09T01:06:14.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.305+0000 7fb173474b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601b2760 con 0x56366b98f4a0 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.305+0000 7fb173474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601b12c0 con 0x56366ba79160 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb2d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb2dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb2dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33420/0 (socket says 172.21.15.37:33420) 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15ed9d700 1 -- 172.21.15.37:0/1653380434 learned_addr learned my addr 172.21.15.37:0/1653380434 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb2d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48348/0 (socket says 172.21.15.37:48348) 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15e59c700 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb15ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 -- 172.21.15.37:0/1653380434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 msgr2=0x56366bb15ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb15ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 -- 172.21.15.37:0/1653380434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 msgr2=0x56366bb2dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb2dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 -- 172.21.15.37:0/1653380434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366bb0d7e0 con 0x56366ba79160 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15e59c700 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb15ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb2d820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1540aa440 tx=0x7fb154009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c946a47556eeda server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:14.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.306+0000 7fb147fff700 1 -- 172.21.15.37:0/1653380434 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540c3070 con 0x56366ba79160 2024-05-09T01:06:14.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.307+0000 7fb147fff700 1 -- 172.21.15.37:0/1653380434 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1540094d0 con 0x56366ba79160 2024-05-09T01:06:14.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.307+0000 7fb147fff700 1 -- 172.21.15.37:0/1653380434 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1540aeaf0 con 0x56366ba79160 2024-05-09T01:06:14.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.307+0000 7fb173474b80 1 -- 172.21.15.37:0/1653380434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 msgr2=0x56366bb2d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.307+0000 7fb173474b80 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb2d820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb1540aa440 tx=0x7fb154009c00 comp rx=0 tx=0).stop 2024-05-09T01:06:14.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 -- 172.21.15.37:0/1653380434 shutdown_connections 2024-05-09T01:06:14.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366bb0c6a0 0x56366bb2dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366b98f4a0 0x56366bb15ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 --2- 172.21.15.37:0/1653380434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb2d820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 -- 172.21.15.37:0/1653380434 >> 172.21.15.37:0/1653380434 conn(0x56366b9ef6a0 msgr2=0x56366bb158e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:14.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 -- 172.21.15.37:0/1653380434 shutdown_connections 2024-05-09T01:06:14.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 -- 172.21.15.37:0/1653380434 wait complete. 2024-05-09T01:06:14.310 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:14 smithi037 ceph-mon[30122]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.0 MiB/s wr, 773 op/s 2024-05-09T01:06:14.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 -- start start 2024-05-09T01:06:14.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.308+0000 7fb173474b80 1 Processor -- start 2024-05-09T01:06:14.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb173474b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366b98f4a0 0x56366bb1efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb173474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb173474b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366bb0c6a0 0x56366bb8e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb173474b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601b2090 con 0x56366b98f4a0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb173474b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601b1990 con 0x56366bb0c6a0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb173474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb1601aebf0 con 0x56366ba79160 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb173474b80 10 client.0 _ll_register_callbacks cb 0x56366b8a06c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb15ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366bb0c6a0 0x56366bb8e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb15ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366bb0c6a0 0x56366bb8e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52030/0 (socket says 172.21.15.37:52030) 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb15ed9d700 1 -- 172.21.15.37:0/3791397979 learned_addr learned my addr 172.21.15.37:0/3791397979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb15e59c700 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366b98f4a0 0x56366bb1efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.309+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.310+0000 7fb15e59c700 1 -- 172.21.15.37:0/3791397979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 msgr2=0x56366bb1f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.310+0000 7fb15e59c700 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.310+0000 7fb15e59c700 1 -- 172.21.15.37:0/3791397979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366bb0c6a0 msgr2=0x56366bb8e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.310+0000 7fb15e59c700 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366bb0c6a0 0x56366bb8e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.310+0000 7fb15e59c700 1 -- 172.21.15.37:0/3791397979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366bb1fda0 con 0x56366b98f4a0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.310+0000 7fb15e59c700 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366b98f4a0 0x56366bb1efd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x56366bb28790 tx=0x7fb1500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70b3606a5e70291 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.310+0000 7fb145ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:14.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.311+0000 7fb145ffb700 1 -- 172.21.15.37:0/3791397979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150030070 con 0x56366b98f4a0 2024-05-09T01:06:14.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.311+0000 7fb145ffb700 1 -- 172.21.15.37:0/3791397979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb150029950 con 0x56366b98f4a0 2024-05-09T01:06:14.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.311+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1540094d0 con 0x56366b98f4a0 2024-05-09T01:06:14.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.311+0000 7fb145ffb700 1 -- 172.21.15.37:0/3791397979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb15003c050 con 0x56366b98f4a0 2024-05-09T01:06:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 10 client.15927 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56366bb8f980 con 0x56366b98f4a0 2024-05-09T01:06:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb145ffb700 1 -- 172.21.15.37:0/3791397979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb15001d940 con 0x56366b98f4a0 2024-05-09T01:06:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb145ffb700 1 -- 172.21.15.37:0/3791397979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fb150026050 con 0x56366b98f4a0 2024-05-09T01:06:14.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 20 client.15927 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb91fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 4 client.15927 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.312+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb1540094d0 con 0x56366bb25d20 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.313+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb91fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.313+0000 7fb145ffb700 10 client.15927 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.313+0000 7fb15dd9b700 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb91fd0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18dd828509d2249a server_cookie=57e6b50d77579f2a in_seq=0 out_seq=0 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.314+0000 7fb145ffb700 1 -- 172.21.15.37:0/3791397979 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb1540094d0 con 0x56366bb25d20 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.314+0000 7fb145ffb700 10 client.15927 handle_command_reply: tid=0 2024-05-09T01:06:14.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.314+0000 7fb173474b80 1 client.15927 shutdown 2024-05-09T01:06:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366b98f4a0 msgr2=0x56366bb1efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366b98f4a0 0x56366bb1efd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x56366bb28790 tx=0x7fb1500047c0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 shutdown_connections 2024-05-09T01:06:14.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56366bb25d20 0x56366bb91fd0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56366bb0c6a0 0x56366bb8e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56366b98f4a0 0x56366bb1efd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 --2- 172.21.15.37:0/3791397979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56366ba79160 0x56366bb1f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 >> 172.21.15.37:0/3791397979 conn(0x56366b9ef6a0 msgr2=0x56366bb0fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb145ffb700 0 client.15927 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 shutdown_connections 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 1 -- 172.21.15.37:0/3791397979 wait complete. 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.315+0000 7fb173474b80 20 client.15927 trim_cache size 0 max 16384 2024-05-09T01:06:14.318 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:06:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1480b2880 msgr2=0x7fb1480b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1480b2880 0x7fb1480b4d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb150005d10 tx=0x7fb150009310 comp rx=0 tx=0).stop 2024-05-09T01:06:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 msgr2=0x7fb16019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb16019d6d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb154000c00 tx=0x7fb15400fa20 comp rx=0 tx=0).stop 2024-05-09T01:06:14.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 shutdown_connections 2024-05-09T01:06:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb1480b2880 0x7fb1480b4d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb160108760 0x7fb1601a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1601034e0 0x7fb16019d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 --2- 172.21.15.37:0/2956940925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb160107e10 0x7fb16019d6d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 >> 172.21.15.37:0/2956940925 conn(0x7fb1600fef30 msgr2=0x7fb1601075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 shutdown_connections 2024-05-09T01:06:14.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:14.316+0000 7fb164a5e700 1 -- 172.21.15.37:0/2956940925 wait complete. 2024-05-09T01:06:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:14 smithi136 ceph-mon[34110]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.0 MiB/s wr, 773 op/s 2024-05-09T01:06:14.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:14 smithi151 ceph-mon[34780]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.0 MiB/s wr, 773 op/s 2024-05-09T01:06:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 235.0 s, 2792.0 tps, lat 35.782 ms stddev 40.016 2024-05-09T01:06:16.327 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:06:16.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:06:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:16 smithi136 ceph-mon[34110]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 740 op/s 2024-05-09T01:06:16.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:16 smithi037 ceph-mon[30122]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 740 op/s 2024-05-09T01:06:16.724 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:16.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:16 smithi151 ceph-mon[34780]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 740 op/s 2024-05-09T01:06:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.610+0000 7f188cca8640 1 -- 172.21.15.37:0/476837849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 msgr2=0x7f188810a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.610+0000 7f188cca8640 1 --2- 172.21.15.37:0/476837849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 0x7f188810a660 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1870009900 tx=0x7f187002a400 comp rx=0 tx=0).stop 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.610+0000 7f188cca8640 1 -- 172.21.15.37:0/476837849 shutdown_connections 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.610+0000 7f188cca8640 1 --2- 172.21.15.37:0/476837849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f188810bcc0 0x7f188810c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.610+0000 7f188cca8640 1 --2- 172.21.15.37:0/476837849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f188810b370 0x7f188810b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.610+0000 7f188cca8640 1 --2- 172.21.15.37:0/476837849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 0x7f188810a660 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.610+0000 7f188cca8640 1 -- 172.21.15.37:0/476837849 >> 172.21.15.37:0/476837849 conn(0x7f1888070a90 msgr2=0x7f1888072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.611+0000 7f188cca8640 1 -- 172.21.15.37:0/476837849 shutdown_connections 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.611+0000 7f188cca8640 1 -- 172.21.15.37:0/476837849 wait complete. 2024-05-09T01:06:17.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.612+0000 7f188cca8640 1 Processor -- start 2024-05-09T01:06:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.612+0000 7f188cca8640 1 -- start start 2024-05-09T01:06:17.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188cca8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 0x7f18881a9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188cca8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f188810b370 0x7f18881a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188cca8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f188810bcc0 0x7f18881b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188cca8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1888115da0 con 0x7f188810a250 2024-05-09T01:06:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188cca8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1888115c20 con 0x7f188810b370 2024-05-09T01:06:17.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188cca8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1888115f20 con 0x7f188810bcc0 2024-05-09T01:06:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 0x7f18881a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f1886d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f188810bcc0 0x7f18881b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 0x7f18881a9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33438/0 (socket says 172.21.15.37:33438) 2024-05-09T01:06:17.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f188659c640 1 -- 172.21.15.37:0/4187500970 learned_addr learned my addr 172.21.15.37:0/4187500970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.613+0000 7f1885d9b640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f188810b370 0x7f18881a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.614+0000 7f1886d9d640 1 -- 172.21.15.37:0/4187500970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f188810b370 msgr2=0x7f18881a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.614+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f188810b370 0x7f18881a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.614+0000 7f1886d9d640 1 -- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 msgr2=0x7f18881a9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.614+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 0x7f18881a9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.614+0000 7f1886d9d640 1 -- 172.21.15.37:0/4187500970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18881b0c90 con 0x7f188810bcc0 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.614+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f188810bcc0 0x7f18881b0620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f188000e940 tx=0x7f188000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.614+0000 7f187f7fe640 1 -- 172.21.15.37:0/4187500970 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880004d20 con 0x7f188810bcc0 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.615+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18881b0f80 con 0x7f188810bcc0 2024-05-09T01:06:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.615+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18881b13e0 con 0x7f188810bcc0 2024-05-09T01:06:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.615+0000 7f187f7fe640 1 -- 172.21.15.37:0/4187500970 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1880005020 con 0x7f188810bcc0 2024-05-09T01:06:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.615+0000 7f187f7fe640 1 -- 172.21.15.37:0/4187500970 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18800116d0 con 0x7f188810bcc0 2024-05-09T01:06:17.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.618+0000 7f18937fd740 1 Processor -- start 2024-05-09T01:06:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.619+0000 7f18937fd740 1 -- start start 2024-05-09T01:06:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.619+0000 7f18937fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c471b0 0x556f77feb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.619+0000 7f18937fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77feba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.619+0000 7f18937fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f18937fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f77f4f7c0 con 0x556f77c264d0 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f18937fd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556f77eeb0e0 con 0x556f77c471b0 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f18937fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556f77f4b780 con 0x556f77c1e2f0 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f1885d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c471b0 0x556f77feb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77feba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77feba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48384/0 (socket says 172.21.15.37:48384) 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 -- 172.21.15.37:0/3233262397 learned_addr learned my addr 172.21.15.37:0/3233262397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f1885d9b640 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 -- 172.21.15.37:0/3233262397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c471b0 msgr2=0x556f77feb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c471b0 0x556f77feb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 -- 172.21.15.37:0/3233262397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 msgr2=0x556f77ff2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f188659c640 1 -- 172.21.15.37:0/3233262397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f77f147c0 con 0x556f77c1e2f0 2024-05-09T01:06:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.620+0000 7f1885d9b640 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:06:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.621+0000 7f188659c640 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77feba80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f187002a920 tx=0x7f18700040f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace207de235f9eb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.622+0000 7f187cff9640 1 -- 172.21.15.37:0/3233262397 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870035030 con 0x556f77c1e2f0 2024-05-09T01:06:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.622+0000 7f187cff9640 1 -- 172.21.15.37:0/3233262397 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1870040070 con 0x556f77c1e2f0 2024-05-09T01:06:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.622+0000 7f187f7fe640 1 -- 172.21.15.37:0/4187500970 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f188000cb20 con 0x7f188810bcc0 2024-05-09T01:06:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.623+0000 7f18937fd740 1 -- 172.21.15.37:0/3233262397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 msgr2=0x556f77feba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.623+0000 7f18937fd740 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77feba80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f187002a920 tx=0x7f18700040f0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.623+0000 7f18937fd740 1 -- 172.21.15.37:0/3233262397 shutdown_connections 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.623+0000 7f18937fd740 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.623+0000 7f18937fd740 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77feba80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.623+0000 7f18937fd740 1 --2- 172.21.15.37:0/3233262397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c471b0 0x556f77feb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.623+0000 7f18937fd740 1 -- 172.21.15.37:0/3233262397 >> 172.21.15.37:0/3233262397 conn(0x556f77c3b300 msgr2=0x556f77fe6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.624+0000 7f187f7fe640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18740b2870 0x7f18740b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.624+0000 7f187f7fe640 1 -- 172.21.15.37:0/4187500970 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f18800e2480 con 0x7f188810bcc0 2024-05-09T01:06:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.624+0000 7f188659c640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18740b2870 0x7f18740b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.625+0000 7f18937fd740 1 -- 172.21.15.37:0/3233262397 shutdown_connections 2024-05-09T01:06:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.625+0000 7f18937fd740 1 -- 172.21.15.37:0/3233262397 wait complete. 2024-05-09T01:06:17.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.625+0000 7f188659c640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18740b2870 0x7f18740b4d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18700096c0 tx=0x7f187003e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 -- start start 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 Processor -- start 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77ff5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c264d0 0x556f77ff5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f77ffc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556f77ff33c0 con 0x556f77c471b0 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556f77ed69c0 con 0x556f77c264d0 2024-05-09T01:06:17.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.626+0000 7f18937fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556f77ff3540 con 0x556f77c1e2f0 2024-05-09T01:06:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.627+0000 7f18937fd740 10 client.0 _ll_register_callbacks cb 0x556f77f03020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.627+0000 7f1885d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c264d0 0x556f77ff5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.627+0000 7f1885d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c264d0 0x556f77ff5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52048/0 (socket says 172.21.15.37:52048) 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.627+0000 7f1886d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f77ffc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.627+0000 7f1886d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f77ffc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33450/0 (socket says 172.21.15.37:33450) 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.627+0000 7f1886d9d640 1 -- 172.21.15.37:0/4040994948 learned_addr learned my addr 172.21.15.37:0/4040994948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.627+0000 7f188659c640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77ff5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f1886d9d640 1 -- 172.21.15.37:0/4040994948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 msgr2=0x556f77ff5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77ff5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f1886d9d640 1 -- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c264d0 msgr2=0x556f77ff5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c264d0 0x556f77ff5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f1886d9d640 1 -- 172.21.15.37:0/4040994948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f77efd1f0 con 0x556f77c471b0 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f1885d9b640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c264d0 0x556f77ff5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:17.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f188659c640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77ff5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f77ffc8a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18800a9ab0 tx=0x7f18800a53a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fbf27f1debbef2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.628+0000 7f186dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.629+0000 7f186dffb640 1 -- 172.21.15.37:0/4040994948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18800c2070 con 0x556f77c471b0 2024-05-09T01:06:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.629+0000 7f186dffb640 1 -- 172.21.15.37:0/4040994948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f18800a8f90 con 0x556f77c471b0 2024-05-09T01:06:17.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.629+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f77f5d3d0 con 0x556f77c471b0 2024-05-09T01:06:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.630+0000 7f186dffb640 1 -- 172.21.15.37:0/4040994948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f18800a9b20 con 0x556f77c471b0 2024-05-09T01:06:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.630+0000 7f18937fd740 10 client.15939 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.630+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556f77cb2790 con 0x556f77c471b0 2024-05-09T01:06:17.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.630+0000 7f186dffb640 1 -- 172.21.15.37:0/4040994948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556f77f5d3d0 con 0x556f77c471b0 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f186dffb640 1 -- 172.21.15.37:0/4040994948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f188000f040 con 0x556f77c471b0 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f18937fd740 10 client.15939 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f18937fd740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f18937fd740 20 client.15939 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f18937fd740 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77c05d80 0x556f78002d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f18937fd740 4 client.15939 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f77f57240 con 0x556f77c05d80 2024-05-09T01:06:17.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.631+0000 7f188659c640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77c05d80 0x556f78002d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.632+0000 7f188659c640 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77c05d80 0x556f78002d80 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=187350609376f820 server_cookie=84b58e754463607d in_seq=0 out_seq=0 2024-05-09T01:06:17.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.632+0000 7f186dffb640 10 client.15939 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:17.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.633+0000 7f186dffb640 1 -- 172.21.15.37:0/4040994948 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556f77f57240 con 0x556f77c05d80 2024-05-09T01:06:17.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.633+0000 7f186dffb640 10 client.15939 handle_command_reply: tid=0 2024-05-09T01:06:17.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.633+0000 7f18937fd740 1 client.15939 shutdown 2024-05-09T01:06:17.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 msgr2=0x556f77ffc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f77ffc8a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18800a9ab0 tx=0x7f18800a53a0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 shutdown_connections 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77c05d80 0x556f78002d80 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f77ffc8a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c264d0 0x556f77ff5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 --2- 172.21.15.37:0/4040994948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c1e2f0 0x556f77ff5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 >> 172.21.15.37:0/4040994948 conn(0x556f77c3b300 msgr2=0x556f77fe9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.634+0000 7f186dffb640 0 client.15939 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.635+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 shutdown_connections 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.635+0000 7f18937fd740 1 -- 172.21.15.37:0/4040994948 wait complete. 2024-05-09T01:06:17.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.635+0000 7f18937fd740 20 client.15939 trim_cache size 0 max 16384 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.664+0000 7f18937fd740 1 Processor -- start 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.664+0000 7f18937fd740 1 -- start start 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.664+0000 7f18937fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ff40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.664+0000 7f18937fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c264d0 0x556f77ffc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.664+0000 7f18937fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f78008540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f1885d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c264d0 0x556f77ffc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f1885d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c264d0 0x556f77ffc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48402/0 (socket says 172.21.15.37:48402) 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f1886d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f78008540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f18937fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f186800e3f0 con 0x556f77c471b0 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f1885d9b640 1 -- 172.21.15.37:0/2312797777 learned_addr learned my addr 172.21.15.37:0/2312797777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f18937fd740 1 -- 172.21.15.37:0/2312797777 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f186800ff60 con 0x556f77c1e2f0 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f18937fd740 1 -- 172.21.15.37:0/2312797777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f186800eac0 con 0x556f77c264d0 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f188659c640 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ff40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f188659c640 1 -- 172.21.15.37:0/2312797777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c264d0 msgr2=0x556f77ffc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f188659c640 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c264d0 0x556f77ffc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f188659c640 1 -- 172.21.15.37:0/2312797777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 msgr2=0x556f78008540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f188659c640 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f78008540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.665+0000 7f188659c640 1 -- 172.21.15.37:0/2312797777 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f77d295f0 con 0x556f77c1e2f0 2024-05-09T01:06:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.667+0000 7f188659c640 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ff40d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x556f77fe7c20 tx=0x7f1870048040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1029ee8f21327491 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.667+0000 7f186ffff640 1 -- 172.21.15.37:0/2312797777 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870035030 con 0x556f77c1e2f0 2024-05-09T01:06:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.667+0000 7f186ffff640 1 -- 172.21.15.37:0/2312797777 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f187005d900 con 0x556f77c1e2f0 2024-05-09T01:06:17.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.667+0000 7f186ffff640 1 -- 172.21.15.37:0/2312797777 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18700466e0 con 0x556f77c1e2f0 2024-05-09T01:06:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.668+0000 7f18937fd740 1 -- 172.21.15.37:0/2312797777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 msgr2=0x556f77ff40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.668+0000 7f18937fd740 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ff40d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x556f77fe7c20 tx=0x7f1870048040 comp rx=0 tx=0).stop 2024-05-09T01:06:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.669+0000 7f18937fd740 1 -- 172.21.15.37:0/2312797777 shutdown_connections 2024-05-09T01:06:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.669+0000 7f18937fd740 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c471b0 0x556f78008540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.669+0000 7f18937fd740 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c264d0 0x556f77ffc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.669+0000 7f18937fd740 1 --2- 172.21.15.37:0/2312797777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ff40d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.669+0000 7f18937fd740 1 -- 172.21.15.37:0/2312797777 >> 172.21.15.37:0/2312797777 conn(0x556f77c3b300 msgr2=0x556f77ff39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.669+0000 7f18937fd740 1 -- 172.21.15.37:0/2312797777 shutdown_connections 2024-05-09T01:06:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.669+0000 7f18937fd740 1 -- 172.21.15.37:0/2312797777 wait complete. 2024-05-09T01:06:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.670+0000 7f18937fd740 1 -- start start 2024-05-09T01:06:17.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.670+0000 7f18937fd740 1 Processor -- start 2024-05-09T01:06:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f18937fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ffc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f18937fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f18937fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c471b0 0x556f77ff9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f18937fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f186800f890 con 0x556f77c264d0 2024-05-09T01:06:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f18937fd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f186800f190 con 0x556f77c1e2f0 2024-05-09T01:06:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f18937fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f186800c3d0 con 0x556f77c471b0 2024-05-09T01:06:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f18937fd740 10 client.0 _ll_register_callbacks cb 0x7f1880005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f188659c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ffc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f188659c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ffc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52066/0 (socket says 172.21.15.37:52066) 2024-05-09T01:06:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f188659c640 1 -- 172.21.15.37:0/4189377596 learned_addr learned my addr 172.21.15.37:0/4189377596 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:17.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.673+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c471b0 0x556f77ff9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f1885d9b640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f188659c640 1 -- 172.21.15.37:0/4189377596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c471b0 msgr2=0x556f77ff9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f188659c640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c471b0 0x556f77ff9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f188659c640 1 -- 172.21.15.37:0/4189377596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 msgr2=0x556f77ff91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f188659c640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f188659c640 1 -- 172.21.15.37:0/4189377596 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f77f13ed0 con 0x556f77c1e2f0 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f1886d9d640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c471b0 0x556f77ff9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f188659c640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ffc660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f187002a9c0 tx=0x7f1870003880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e954566a1a9cfa1d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.674+0000 7f186dffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.675+0000 7f186dffb640 1 -- 172.21.15.37:0/4189377596 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187006b070 con 0x556f77c1e2f0 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.675+0000 7f186dffb640 1 -- 172.21.15.37:0/4189377596 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1870046480 con 0x556f77c1e2f0 2024-05-09T01:06:17.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.675+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f187005d900 con 0x556f77c1e2f0 2024-05-09T01:06:17.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.676+0000 7f186dffb640 1 -- 172.21.15.37:0/4189377596 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1870075050 con 0x556f77c1e2f0 2024-05-09T01:06:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.677+0000 7f18937fd740 10 client.25733 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:17.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.677+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556f78069fe0 con 0x556f77c1e2f0 2024-05-09T01:06:17.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f186dffb640 1 -- 172.21.15.37:0/4189377596 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f187005dab0 con 0x556f77c1e2f0 2024-05-09T01:06:17.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f186dffb640 1 -- 172.21.15.37:0/4189377596 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f18700704e0 con 0x556f77c1e2f0 2024-05-09T01:06:17.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f18937fd740 10 client.25733 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f18937fd740 10 client.25733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f18937fd740 20 client.25733 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f18937fd740 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77bdb1c0 0x556f7806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f18937fd740 4 client.25733 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.678+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f187005d900 con 0x556f77bdb1c0 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.679+0000 7f1885d9b640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77bdb1c0 0x556f7806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.679+0000 7f1885d9b640 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77bdb1c0 0x556f7806c540 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2412f526211a962 server_cookie=2608d3c502ebb042 in_seq=0 out_seq=0 2024-05-09T01:06:17.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.679+0000 7f186dffb640 10 client.25733 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.689+0000 7f186dffb640 1 -- 172.21.15.37:0/4189377596 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f187005d900 con 0x556f77bdb1c0 2024-05-09T01:06:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.689+0000 7f186dffb640 10 client.25733 handle_command_reply: tid=0 2024-05-09T01:06:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.689+0000 7f18937fd740 1 client.25733 shutdown 2024-05-09T01:06:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 msgr2=0x556f77ffc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ffc660 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f187002a9c0 tx=0x7f1870003880 comp rx=0 tx=0).stop 2024-05-09T01:06:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 shutdown_connections 2024-05-09T01:06:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556f77bdb1c0 0x556f7806c540 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f77c471b0 0x556f77ff9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556f77c264d0 0x556f77ff91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 --2- 172.21.15.37:0/4189377596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556f77c1e2f0 0x556f77ffc660 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 >> 172.21.15.37:0/4189377596 conn(0x556f77c3b300 msgr2=0x556f77fe9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f186dffb640 0 client.25733 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 shutdown_connections 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.690+0000 7f18937fd740 1 -- 172.21.15.37:0/4189377596 wait complete. 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.691+0000 7f18937fd740 20 client.25733 trim_cache size 0 max 16384 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:06:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:06:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.692+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18740b2870 msgr2=0x7f18740b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.692+0000 7f188cca8640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18740b2870 0x7f18740b4d80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18700096c0 tx=0x7f187003e040 comp rx=0 tx=0).stop 2024-05-09T01:06:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.692+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f188810bcc0 msgr2=0x7f18881b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.692+0000 7f188cca8640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f188810bcc0 0x7f18881b0620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f188000e940 tx=0x7f188000ee00 comp rx=0 tx=0).stop 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.693+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 shutdown_connections 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.693+0000 7f188cca8640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f188810bcc0 0x7f18881b0620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.694+0000 7f188cca8640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18740b2870 0x7f18740b4d80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.694+0000 7f188cca8640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f188810b370 0x7f18881a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.694+0000 7f188cca8640 1 --2- 172.21.15.37:0/4187500970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188810a250 0x7f18881a9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.694+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 >> 172.21.15.37:0/4187500970 conn(0x7f1888070a90 msgr2=0x7f1888116730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.694+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 shutdown_connections 2024-05-09T01:06:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:17.694+0000 7f188cca8640 1 -- 172.21.15.37:0/4187500970 wait complete. 2024-05-09T01:06:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:18 smithi037 ceph-mon[30122]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 777 op/s 2024-05-09T01:06:18.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 -- 172.21.15.37:0/1625678322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18c107df0 msgr2=0x7fa18c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 --2- 172.21.15.37:0/1625678322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18c107df0 0x7fa18c108200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1880099c0 tx=0x7fa188009cd0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 -- 172.21.15.37:0/1625678322 shutdown_connections 2024-05-09T01:06:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 --2- 172.21.15.37:0/1625678322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa18c108740 0x7fa18c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 --2- 172.21.15.37:0/1625678322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18c1034c0 0x7fa18c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 --2- 172.21.15.37:0/1625678322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18c107df0 0x7fa18c108200 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 -- 172.21.15.37:0/1625678322 >> 172.21.15.37:0/1625678322 conn(0x7fa18c0fedc0 msgr2=0x7fa18c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 -- 172.21.15.37:0/1625678322 shutdown_connections 2024-05-09T01:06:18.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.600+0000 7fa193dca700 1 -- 172.21.15.37:0/1625678322 wait complete. 2024-05-09T01:06:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 Processor -- start 2024-05-09T01:06:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 -- start start 2024-05-09T01:06:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18c1034c0 0x7fa18c110d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18c107df0 0x7fa18c111250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa18c108740 0x7fa18c111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c116730 con 0x7fa18c108740 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1165b0 con 0x7fa18c1034c0 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.602+0000 7fa193dca700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1168b0 con 0x7fa18c107df0 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.603+0000 7fa191b66700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18c1034c0 0x7fa18c110d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.603+0000 7fa192367700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa18c108740 0x7fa18c111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.603+0000 7fa191b66700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18c1034c0 0x7fa18c110d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52096/0 (socket says 172.21.15.37:52096) 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.603+0000 7fa191b66700 1 -- 172.21.15.37:0/2031972953 learned_addr learned my addr 172.21.15.37:0/2031972953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:18.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.604+0000 7fa192367700 1 -- 172.21.15.37:0/2031972953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18c107df0 msgr2=0x7fa18c111250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.604+0000 7fa192367700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18c107df0 0x7fa18c111250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.604+0000 7fa192367700 1 -- 172.21.15.37:0/2031972953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18c1034c0 msgr2=0x7fa18c110d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.604+0000 7fa192367700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18c1034c0 0x7fa18c110d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.604+0000 7fa192367700 1 -- 172.21.15.37:0/2031972953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c1ad600 con 0x7fa18c108740 2024-05-09T01:06:18.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.604+0000 7fa192367700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa18c108740 0x7fa18c111790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa18400e320 tx=0x7fa184007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.605+0000 7fa182ffd700 1 -- 172.21.15.37:0/2031972953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184004db0 con 0x7fa18c108740 2024-05-09T01:06:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.605+0000 7fa182ffd700 1 -- 172.21.15.37:0/2031972953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa18400b110 con 0x7fa18c108740 2024-05-09T01:06:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.605+0000 7fa182ffd700 1 -- 172.21.15.37:0/2031972953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184009c50 con 0x7fa18c108740 2024-05-09T01:06:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.605+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c1ad890 con 0x7fa18c108740 2024-05-09T01:06:18.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.605+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c1adcc0 con 0x7fa18c108740 2024-05-09T01:06:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.612+0000 7fa182ffd700 1 -- 172.21.15.37:0/2031972953 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa18401c020 con 0x7fa18c108740 2024-05-09T01:06:18.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 Processor -- start 2024-05-09T01:06:18.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 -- start start 2024-05-09T01:06:18.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195edf1520 0x56195ef74800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ef6e480 0x56195ef6e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56195ee91120 con 0x56195ee6bd80 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56195ee36a20 con 0x56195edf1520 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56195ee8d0e0 con 0x56195ef6e480 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.613+0000 7fa191365700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.614+0000 7fa191365700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33512/0 (socket says 172.21.15.37:33512) 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.614+0000 7fa191365700 1 -- 172.21.15.37:0/2139468198 learned_addr learned my addr 172.21.15.37:0/2139468198 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.614+0000 7fa191365700 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ef6e480 0x56195ef6e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.614+0000 7fa191b66700 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195edf1520 0x56195ef74800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.616+0000 7fa182ffd700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b2900 0x7fa1780b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.617+0000 7fa182ffd700 1 -- 172.21.15.37:0/2031972953 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa1840e1cb0 con 0x7fa18c108740 2024-05-09T01:06:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa191365700 1 -- 172.21.15.37:0/2139468198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ef6e480 msgr2=0x56195ef6e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa191365700 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ef6e480 0x56195ef6e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa191365700 1 -- 172.21.15.37:0/2139468198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195edf1520 msgr2=0x56195ef74800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa191365700 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195edf1520 0x56195ef74800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa191365700 1 -- 172.21.15.37:0/2139468198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56195ee27580 con 0x56195ee6bd80 2024-05-09T01:06:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa191b66700 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195edf1520 0x56195ef74800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa191365700 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef742c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa188005f50 tx=0x7fa188005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4358104a87cc20b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa192367700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b2900 0x7fa1780b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.618+0000 7fa177fff700 1 -- 172.21.15.37:0/2139468198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18801b070 con 0x56195ee6bd80 2024-05-09T01:06:18.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.620+0000 7fa192367700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b2900 0x7fa1780b4e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa1840a9300 tx=0x7fa184009710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.620+0000 7fa177fff700 1 -- 172.21.15.37:0/2139468198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa188004d30 con 0x56195ee6bd80 2024-05-09T01:06:18.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.620+0000 7fa177fff700 1 -- 172.21.15.37:0/2139468198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800b9f0 con 0x56195ee6bd80 2024-05-09T01:06:18.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.621+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2139468198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 msgr2=0x56195ef742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.621+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef742c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa188005f50 tx=0x7fa188005e80 comp rx=0 tx=0).stop 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.622+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2139468198 shutdown_connections 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.622+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ef6e480 0x56195ef6e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.622+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef742c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.622+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2139468198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195edf1520 0x56195ef74800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.622+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2139468198 >> 172.21.15.37:0/2139468198 conn(0x56195edf4ff0 msgr2=0x56195ef692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.622+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2139468198 shutdown_connections 2024-05-09T01:06:18.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.622+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2139468198 wait complete. 2024-05-09T01:06:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.623+0000 7fa1a27e0b80 1 -- start start 2024-05-09T01:06:18.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.623+0000 7fa1a27e0b80 1 Processor -- start 2024-05-09T01:06:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.625+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195edf1520 0x56195ef780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.625+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ee6bd80 0x56195ef785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.625+0000 7fa191365700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195edf1520 0x56195ef780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.625+0000 7fa191365700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195edf1520 0x56195ef780a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33528/0 (socket says 172.21.15.37:33528) 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.625+0000 7fa191365700 1 -- 172.21.15.37:0/3836651100 learned_addr learned my addr 172.21.15.37:0/3836651100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.625+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 0x56195ef78b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56195ef6f180 con 0x56195edf1520 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56195ee2bba0 con 0x56195ef6e480 2024-05-09T01:06:18.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56195ef84280 con 0x56195ee6bd80 2024-05-09T01:06:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:18 smithi136 ceph-mon[34110]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 777 op/s 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa1a27e0b80 10 client.0 _ll_register_callbacks cb 0x56195ed02740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa191365700 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 0x56195ef78b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa191365700 1 -- 172.21.15.37:0/3836651100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ee6bd80 msgr2=0x56195ef785e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa191365700 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ee6bd80 0x56195ef785e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa191365700 1 -- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 msgr2=0x56195ef78b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa191365700 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 0x56195ef78b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.626+0000 7fa191365700 1 -- 172.21.15.37:0/3836651100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56195ed0c510 con 0x56195edf1520 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.627+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa188004d30 con 0x56195edf1520 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.627+0000 7fa191365700 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195edf1520 0x56195ef780a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa188005b40 tx=0x7fa188005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f190828cc69b867 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.627+0000 7fa1757fa700 10 client.15957 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.628+0000 7fa1757fa700 1 -- 172.21.15.37:0/3836651100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18802e070 con 0x56195edf1520 2024-05-09T01:06:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.628+0000 7fa1757fa700 1 -- 172.21.15.37:0/3836651100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa188005350 con 0x56195edf1520 2024-05-09T01:06:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.628+0000 7fa1757fa700 1 -- 172.21.15.37:0/3836651100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa18801b040 con 0x56195edf1520 2024-05-09T01:06:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.629+0000 7fa1a27e0b80 10 client.15957 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.629+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=38}) -- 0x56195ef859c0 con 0x56195edf1520 2024-05-09T01:06:18.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.629+0000 7fa1757fa700 1 -- 172.21.15.37:0/3836651100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fa18800b730 con 0x56195edf1520 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.629+0000 7fa1a27e0b80 10 client.15957 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.629+0000 7fa1a27e0b80 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.629+0000 7fa1a27e0b80 20 client.15957 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.630+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195ef87e90 0x56195ef8a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.630+0000 7fa1a27e0b80 4 client.15957 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.630+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56195ee9eb00 con 0x56195ef87e90 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.630+0000 7fa191b66700 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195ef87e90 0x56195ef8a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.631+0000 7fa1757fa700 10 client.15957 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.631+0000 7fa191b66700 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195ef87e90 0x56195ef8a2b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f0226ab10a2c2d server_cookie=55078af2f049e10f in_seq=0 out_seq=0 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1757fa700 1 -- 172.21.15.37:0/3836651100 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56195ee9eb00 con 0x56195ef87e90 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1757fa700 10 client.15957 handle_command_reply: tid=0 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1a27e0b80 1 client.15957 shutdown 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195edf1520 msgr2=0x56195ef780a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195edf1520 0x56195ef780a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa188005b40 tx=0x7fa188005ad0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 shutdown_connections 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195ef87e90 0x56195ef8a2b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.632+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 0x56195ef78b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.633+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195edf1520 0x56195ef780a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.633+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/3836651100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195ee6bd80 0x56195ef785e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.633+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 >> 172.21.15.37:0/3836651100 conn(0x56195edf4ff0 msgr2=0x56195ef63070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:18.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.633+0000 7fa1757fa700 0 client.15957 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:18.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.633+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 shutdown_connections 2024-05-09T01:06:18.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.633+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/3836651100 wait complete. 2024-05-09T01:06:18.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.633+0000 7fa1a27e0b80 20 client.15957 trim_cache size 0 max 16384 2024-05-09T01:06:18.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.671+0000 7fa1a27e0b80 1 Processor -- start 2024-05-09T01:06:18.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.671+0000 7fa1a27e0b80 1 -- start start 2024-05-09T01:06:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef7a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ee6bd80 0x56195ef6dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ef6e480 0x56195ef71d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1b4fd0 con 0x56195ef6e480 2024-05-09T01:06:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1b6b40 con 0x56195ee6bd80 2024-05-09T01:06:18.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1b56a0 con 0x56195edf1520 2024-05-09T01:06:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa191365700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef7a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa191365700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef7a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48444/0 (socket says 172.21.15.37:48444) 2024-05-09T01:06:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.672+0000 7fa191365700 1 -- 172.21.15.37:0/2740600147 learned_addr learned my addr 172.21.15.37:0/2740600147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191365700 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ef6e480 0x56195ef71d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191b66700 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ee6bd80 0x56195ef6dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191365700 1 -- 172.21.15.37:0/2740600147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ee6bd80 msgr2=0x56195ef6dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:18.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191365700 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ee6bd80 0x56195ef6dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191365700 1 -- 172.21.15.37:0/2740600147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ef6e480 msgr2=0x56195ef71d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191365700 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ef6e480 0x56195ef71d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191365700 1 -- 172.21.15.37:0/2740600147 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56195ef77e70 con 0x56195edf1520 2024-05-09T01:06:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.673+0000 7fa191365700 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef7a540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa188004bd0 tx=0x7fa188021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e49db858cb06e0d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.674+0000 7fa1777fe700 1 -- 172.21.15.37:0/2740600147 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18802e070 con 0x56195edf1520 2024-05-09T01:06:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.674+0000 7fa1777fe700 1 -- 172.21.15.37:0/2740600147 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa188004d30 con 0x56195edf1520 2024-05-09T01:06:18.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.674+0000 7fa1777fe700 1 -- 172.21.15.37:0/2740600147 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188033c00 con 0x56195edf1520 2024-05-09T01:06:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.675+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2740600147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 msgr2=0x56195ef7a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.675+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef7a540 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa188004bd0 tx=0x7fa188021000 comp rx=0 tx=0).stop 2024-05-09T01:06:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.676+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2740600147 shutdown_connections 2024-05-09T01:06:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.676+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ef6e480 0x56195ef71d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.676+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef7a540 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.676+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/2740600147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ee6bd80 0x56195ef6dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.676+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2740600147 >> 172.21.15.37:0/2740600147 conn(0x56195edf4ff0 msgr2=0x56195ef636e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.676+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2740600147 shutdown_connections 2024-05-09T01:06:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.677+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/2740600147 wait complete. 2024-05-09T01:06:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.677+0000 7fa1a27e0b80 1 -- start start 2024-05-09T01:06:18.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.677+0000 7fa1a27e0b80 1 Processor -- start 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.678+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef8b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef8bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa1a27e0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 0x56195efeb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1b6470 con 0x56195ee6bd80 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1b5d70 con 0x56195ef6e480 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa1a27e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c1b2f90 con 0x56195edf1520 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa1a27e0b80 10 client.0 _ll_register_callbacks cb 0x56195ed02740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef8bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef8bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33542/0 (socket says 172.21.15.37:33542) 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 -- 172.21.15.37:0/1176946659 learned_addr learned my addr 172.21.15.37:0/1176946659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191365700 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef8b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 -- 172.21.15.37:0/1176946659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 msgr2=0x56195ef8b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:18.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef8b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 -- 172.21.15.37:0/1176946659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 msgr2=0x56195efeb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 0x56195efeb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.679+0000 7fa191b66700 1 -- 172.21.15.37:0/1176946659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56195efeb920 con 0x56195ee6bd80 2024-05-09T01:06:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.680+0000 7fa191b66700 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef8bc20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x56195ef6aa80 tx=0x7fa17c01b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e509bb7e2fc5697e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.680+0000 7fa1757fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.681+0000 7fa1757fa700 1 -- 172.21.15.37:0/1176946659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c004460 con 0x56195ee6bd80 2024-05-09T01:06:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.681+0000 7fa1757fa700 1 -- 172.21.15.37:0/1176946659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa17c003680 con 0x56195ee6bd80 2024-05-09T01:06:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.681+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa188004d30 con 0x56195ee6bd80 2024-05-09T01:06:18.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.681+0000 7fa1757fa700 1 -- 172.21.15.37:0/1176946659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa17c003880 con 0x56195ee6bd80 2024-05-09T01:06:18.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.681+0000 7fa1a27e0b80 10 client.15963 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:18.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.681+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56195eff2ca0 con 0x56195ee6bd80 2024-05-09T01:06:18.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.681+0000 7fa1757fa700 1 -- 172.21.15.37:0/1176946659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa17c01f030 con 0x56195ee6bd80 2024-05-09T01:06:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.683+0000 7fa1757fa700 1 -- 172.21.15.37:0/1176946659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fa17c0129f0 con 0x56195ee6bd80 2024-05-09T01:06:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.683+0000 7fa1a27e0b80 10 client.15963 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.683+0000 7fa1a27e0b80 10 client.15963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.683+0000 7fa1a27e0b80 20 client.15963 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.683+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195eff33e0 0x56195eff5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.683+0000 7fa1a27e0b80 4 client.15963 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:06:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.683+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fa188004d30 con 0x56195eff33e0 2024-05-09T01:06:18.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.685+0000 7fa191365700 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195eff33e0 0x56195eff5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:18.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.685+0000 7fa191365700 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195eff33e0 0x56195eff5800 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=287a86e3e67256ba server_cookie=1a24117f8361a9d2 in_seq=0 out_seq=0 2024-05-09T01:06:18.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.685+0000 7fa1757fa700 10 client.15963 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:18.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.686+0000 7fa1757fa700 1 -- 172.21.15.37:0/1176946659 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fa188004d30 con 0x56195eff33e0 2024-05-09T01:06:18.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.686+0000 7fa1757fa700 10 client.15963 handle_command_reply: tid=0 2024-05-09T01:06:18.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.686+0000 7fa1a27e0b80 1 client.15963 shutdown 2024-05-09T01:06:18.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 msgr2=0x56195ef8bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef8bc20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x56195ef6aa80 tx=0x7fa17c01b580 comp rx=0 tx=0).stop 2024-05-09T01:06:18.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 shutdown_connections 2024-05-09T01:06:18.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56195eff33e0 0x56195eff5800 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56195ef6e480 0x56195efeb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1757fa700 0 client.15963 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56195edf1520 0x56195ef8b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 --2- 172.21.15.37:0/1176946659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56195ee6bd80 0x56195ef8bc20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 >> 172.21.15.37:0/1176946659 conn(0x56195edf4ff0 msgr2=0x56195ef831e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.687+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 shutdown_connections 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.688+0000 7fa1a27e0b80 1 -- 172.21.15.37:0/1176946659 wait complete. 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.688+0000 7fa1a27e0b80 20 client.15963 trim_cache size 0 max 16384 2024-05-09T01:06:18.689 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:06:18.690 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:06:18.690 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "1f535251-5fb4-41b1-93c5-ea3089d93cc5", 2024-05-09T01:06:18.690 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:06:18.690 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:06:18.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b2900 msgr2=0x7fa1780b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b2900 0x7fa1780b4e10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa1840a9300 tx=0x7fa184009710 comp rx=0 tx=0).stop 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa18c108740 msgr2=0x7fa18c111790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa18c108740 0x7fa18c111790 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa18400e320 tx=0x7fa184007f90 comp rx=0 tx=0).stop 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 shutdown_connections 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b2900 0x7fa1780b4e10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa18c108740 0x7fa18c111790 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18c1034c0 0x7fa18c110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 --2- 172.21.15.37:0/2031972953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18c107df0 0x7fa18c111250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:18.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.689+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 >> 172.21.15.37:0/2031972953 conn(0x7fa18c0fedc0 msgr2=0x7fa18c1096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:18.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.691+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 shutdown_connections 2024-05-09T01:06:18.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:18.691+0000 7fa193dca700 1 -- 172.21.15.37:0/2031972953 wait complete. 2024-05-09T01:06:18.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:18 smithi151 ceph-mon[34780]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.9 MiB/s wr, 777 op/s 2024-05-09T01:06:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:19 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:06:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:19 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:06:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:19 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:06:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:19 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:06:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:19 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:19 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:19 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:19 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:06:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:19 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:06:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:19 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:06:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:19 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:06:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:19 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:19 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:19 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:19 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:06:19.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:19 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:06:19.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:19 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:06:19.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:19 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:06:19.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:19 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:19 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:19 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:19.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:06:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 240.0 s, 3784.2 tps, lat 26.597 ms stddev 31.610 2024-05-09T01:06:20.291 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:20 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:06:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:20 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:20 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:06:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:20 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:20 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:20 smithi037 ceph-mon[30122]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 MiB/s wr, 745 op/s 2024-05-09T01:06:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:20 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:06:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:20 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:20 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:06:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:20 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:20 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:20 smithi136 ceph-mon[34110]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 MiB/s wr, 745 op/s 2024-05-09T01:06:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:20 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:06:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:20 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:20 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:06:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:20 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:20 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:06:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:20 smithi151 ceph-mon[34780]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.1 MiB/s wr, 745 op/s 2024-05-09T01:06:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.296+0000 7f3386dd9700 1 -- 172.21.15.37:0/904578528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3380105540 msgr2=0x7f3380105950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.296+0000 7f3386dd9700 1 --2- 172.21.15.37:0/904578528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3380105540 0x7f3380105950 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3370009990 tx=0x7f3370009ca0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.298+0000 7f3386dd9700 1 -- 172.21.15.37:0/904578528 shutdown_connections 2024-05-09T01:06:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.298+0000 7f3386dd9700 1 --2- 172.21.15.37:0/904578528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f338010e920 0x7f3380110de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.298+0000 7f3386dd9700 1 --2- 172.21.15.37:0/904578528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3380105540 0x7f3380105950 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.298+0000 7f3386dd9700 1 --2- 172.21.15.37:0/904578528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105e90 0x7f338010e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.298+0000 7f3386dd9700 1 -- 172.21.15.37:0/904578528 >> 172.21.15.37:0/904578528 conn(0x7f33800fef30 msgr2=0x7f3380101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.298+0000 7f3386dd9700 1 -- 172.21.15.37:0/904578528 shutdown_connections 2024-05-09T01:06:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.298+0000 7f3386dd9700 1 -- 172.21.15.37:0/904578528 wait complete. 2024-05-09T01:06:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 Processor -- start 2024-05-09T01:06:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 -- start start 2024-05-09T01:06:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105540 0x7f338010ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3380105e90 0x7f338010bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338010e920 0x7f338011dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3380104c50 con 0x7f338010e920 2024-05-09T01:06:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3380104ad0 con 0x7f3380105540 2024-05-09T01:06:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.299+0000 7f3386dd9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3380104dd0 con 0x7f3380105e90 2024-05-09T01:06:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105540 0x7f338010ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105540 0x7f338010ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:54918/0 (socket says 172.21.15.37:54918) 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 -- 172.21.15.37:0/3267770843 learned_addr learned my addr 172.21.15.37:0/3267770843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f337ffff700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3380105e90 0x7f338010bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3385376700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338010e920 0x7f338011dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 -- 172.21.15.37:0/3267770843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3380105e90 msgr2=0x7f338010bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3380105e90 0x7f338010bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 -- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338010e920 msgr2=0x7f338011dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338010e920 0x7f338011dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.300+0000 7f3384b75700 1 -- 172.21.15.37:0/3267770843 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338010c850 con 0x7f3380105540 2024-05-09T01:06:22.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.302+0000 7f3384b75700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105540 0x7f338010ba20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3370005eb0 tx=0x7f3370005ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:22.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.302+0000 7f337dffb700 1 -- 172.21.15.37:0/3267770843 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370027070 con 0x7f3380105540 2024-05-09T01:06:22.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.302+0000 7f337dffb700 1 -- 172.21.15.37:0/3267770843 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3370003fb0 con 0x7f3380105540 2024-05-09T01:06:22.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.302+0000 7f337dffb700 1 -- 172.21.15.37:0/3267770843 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370022bd0 con 0x7f3380105540 2024-05-09T01:06:22.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.302+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338011e320 con 0x7f3380105540 2024-05-09T01:06:22.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.302+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338011e7b0 con 0x7f3380105540 2024-05-09T01:06:22.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.308+0000 7f33957efb80 1 Processor -- start 2024-05-09T01:06:22.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.309+0000 7f337dffb700 1 -- 172.21.15.37:0/3267770843 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f337002a070 con 0x7f3380105540 2024-05-09T01:06:22.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.310+0000 7f33957efb80 1 -- start start 2024-05-09T01:06:22.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.310+0000 7f33957efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e15120240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.310+0000 7f33957efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15120780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.310+0000 7f33957efb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e1511a400 0x558e1511a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.310+0000 7f3385376700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e15120240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.310+0000 7f3385376700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e15120240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49076/0 (socket says 172.21.15.37:49076) 2024-05-09T01:06:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.310+0000 7f3385376700 1 -- 172.21.15.37:0/3719936813 learned_addr learned my addr 172.21.15.37:0/3719936813 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e1503d0a0 con 0x558e14f9d4a0 2024-05-09T01:06:22.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558e14fe29a0 con 0x558e1511a400 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558e15039060 con 0x558e15017d00 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f337ffff700 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e1511a400 0x558e1511a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f3385376700 1 -- 172.21.15.37:0/3719936813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e1511a400 msgr2=0x558e1511a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f3385376700 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e1511a400 0x558e1511a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f3385376700 1 -- 172.21.15.37:0/3719936813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 msgr2=0x558e15120780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f3384b75700 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15120780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f3385376700 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15120780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.311+0000 7f3385376700 1 -- 172.21.15.37:0/3719936813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e14fd3500 con 0x558e15017d00 2024-05-09T01:06:22.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.312+0000 7f337dffb700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33680b2a50 0x7f33680b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.312+0000 7f337dffb700 1 -- 172.21.15.37:0/3267770843 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f33700e3060 con 0x7f3380105540 2024-05-09T01:06:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.312+0000 7f3385376700 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e15120240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f337400b810 tx=0x7f337400bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65369366af35bf31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.313+0000 7f3366ffd700 1 -- 172.21.15.37:0/3719936813 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374014620 con 0x558e15017d00 2024-05-09T01:06:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.313+0000 7f3366ffd700 1 -- 172.21.15.37:0/3719936813 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3374014c70 con 0x558e15017d00 2024-05-09T01:06:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.313+0000 7f3384b75700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33680b2a50 0x7f33680b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.313+0000 7f3366ffd700 1 -- 172.21.15.37:0/3719936813 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374012cf0 con 0x558e15017d00 2024-05-09T01:06:22.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.314+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 msgr2=0x558e15120240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.314+0000 7f33957efb80 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e15120240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f337400b810 tx=0x7f337400bb20 comp rx=0 tx=0).stop 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.314+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 shutdown_connections 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.314+0000 7f33957efb80 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e1511a400 0x558e1511a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.314+0000 7f33957efb80 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e15120240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.314+0000 7f33957efb80 1 --2- 172.21.15.37:0/3719936813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15120780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.314+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 >> 172.21.15.37:0/3719936813 conn(0x558e14fa0f70 msgr2=0x558e15115220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.315+0000 7f3384b75700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33680b2a50 0x7f33680b4f60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33700a7980 tx=0x7f3370009ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.315+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 shutdown_connections 2024-05-09T01:06:22.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.315+0000 7f33957efb80 1 -- 172.21.15.37:0/3719936813 wait complete. 2024-05-09T01:06:22.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.316+0000 7f33957efb80 1 -- start start 2024-05-09T01:06:22.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.316+0000 7f33957efb80 1 Processor -- start 2024-05-09T01:06:22.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f33957efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15123f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f33957efb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e151244a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f33957efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e1511a400 0x558e151249e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f3385376700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15123f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f337ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e151244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f337ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e151244a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:54942/0 (socket says 172.21.15.37:54942) 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f3385376700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15123f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46850/0 (socket says 172.21.15.37:46850) 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f337ffff700 1 -- 172.21.15.37:0/3619719714 learned_addr learned my addr 172.21.15.37:0/3619719714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e1511b160 con 0x558e14f9d4a0 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558e14fd7b20 con 0x558e15017d00 2024-05-09T01:06:22.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558e15127020 con 0x558e1511a400 2024-05-09T01:06:22.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f33957efb80 10 client.0 _ll_register_callbacks cb 0x558e14eae6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:22.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.317+0000 7f3385376700 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e1511a400 0x558e151249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.318+0000 7f337ffff700 1 -- 172.21.15.37:0/3619719714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e1511a400 msgr2=0x558e151249e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:22.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.318+0000 7f337ffff700 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e1511a400 0x558e151249e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.318+0000 7f337ffff700 1 -- 172.21.15.37:0/3619719714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 msgr2=0x558e15123f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:22.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.318+0000 7f337ffff700 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15123f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.318+0000 7f337ffff700 1 -- 172.21.15.37:0/3619719714 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e14eb8490 con 0x558e15017d00 2024-05-09T01:06:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.318+0000 7f337ffff700 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e151244a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f33780042a0 tx=0x7f33780042d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd20162096ae4cd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.318+0000 7f335ffff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.319+0000 7f335ffff700 1 -- 172.21.15.37:0/3619719714 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337801a070 con 0x558e15017d00 2024-05-09T01:06:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.319+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3374014c70 con 0x558e15017d00 2024-05-09T01:06:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.319+0000 7f335ffff700 1 -- 172.21.15.37:0/3619719714 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3378007700 con 0x558e15017d00 2024-05-09T01:06:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.319+0000 7f335ffff700 1 -- 172.21.15.37:0/3619719714 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3378026050 con 0x558e15017d00 2024-05-09T01:06:22.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.320+0000 7f33957efb80 10 client.25757 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:22.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.320+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558e151319d0 con 0x558e15017d00 2024-05-09T01:06:22.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.320+0000 7f335ffff700 1 -- 172.21.15.37:0/3619719714 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3374014c70 con 0x558e15017d00 2024-05-09T01:06:22.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.321+0000 7f335ffff700 1 -- 172.21.15.37:0/3619719714 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f3378016a20 con 0x558e15017d00 2024-05-09T01:06:22.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.321+0000 7f33957efb80 10 client.25757 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.321+0000 7f33957efb80 10 client.25757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.321+0000 7f33957efb80 20 client.25757 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.321+0000 7f33957efb80 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e15136380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.321+0000 7f33957efb80 4 client.25757 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.321+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e1504aa80 con 0x558e15133f60 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.322+0000 7f3385376700 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e15136380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.322+0000 7f3385376700 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e15136380 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac4a0c97b2159b2 server_cookie=fa956576621ecaed in_seq=0 out_seq=0 2024-05-09T01:06:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.322+0000 7f335ffff700 10 client.25757 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.323+0000 7f335ffff700 1 -- 172.21.15.37:0/3619719714 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558e1504aa80 con 0x558e15133f60 2024-05-09T01:06:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.323+0000 7f335ffff700 10 client.25757 handle_command_reply: tid=0 2024-05-09T01:06:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.323+0000 7f33957efb80 1 client.25757 shutdown 2024-05-09T01:06:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 msgr2=0x558e151244a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e151244a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f33780042a0 tx=0x7f33780042d0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 shutdown_connections 2024-05-09T01:06:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e15136380 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e1511a400 0x558e151249e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f335ffff700 0 client.25757 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e14f9d4a0 0x558e15123f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 --2- 172.21.15.37:0/3619719714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e151244a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 >> 172.21.15.37:0/3619719714 conn(0x558e14fa0f70 msgr2=0x558e1510eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.324+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 shutdown_connections 2024-05-09T01:06:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.326+0000 7f33957efb80 1 -- 172.21.15.37:0/3619719714 wait complete. 2024-05-09T01:06:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.326+0000 7f33957efb80 20 client.25757 trim_cache size 0 max 16384 2024-05-09T01:06:22.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.362+0000 7f33957efb80 1 Processor -- start 2024-05-09T01:06:22.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.362+0000 7f33957efb80 1 -- start start 2024-05-09T01:06:22.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:22 smithi037 ceph-mon[30122]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.5 MiB/s wr, 831 op/s 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f33957efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e14f9d4a0 0x558e1510f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f33957efb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e1512fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f33957efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 0x558e1513bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f33957efb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33801bd980 con 0x558e1511a400 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f3385376700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e14f9d4a0 0x558e1510f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f3385376700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e14f9d4a0 0x558e1510f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49092/0 (socket says 172.21.15.37:49092) 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f3385376700 1 -- 172.21.15.37:0/3142726940 learned_addr learned my addr 172.21.15.37:0/3142726940 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f33957efb80 1 -- 172.21.15.37:0/3142726940 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33801bf4f0 con 0x558e15017d00 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f33957efb80 1 -- 172.21.15.37:0/3142726940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f33801be050 con 0x558e14f9d4a0 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.363+0000 7f337ffff700 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e1512fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.364+0000 7f3385376700 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 0x558e1513bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.364+0000 7f3385376700 1 -- 172.21.15.37:0/3142726940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 msgr2=0x558e1512fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.364+0000 7f3385376700 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e1512fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.364+0000 7f3385376700 1 -- 172.21.15.37:0/3142726940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 msgr2=0x558e1513bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.364+0000 7f3385376700 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 0x558e1513bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.364+0000 7f3385376700 1 -- 172.21.15.37:0/3142726940 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e151119d0 con 0x558e14f9d4a0 2024-05-09T01:06:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.364+0000 7f3385376700 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e14f9d4a0 0x558e1510f700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33740128c0 tx=0x7f3374008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36cf7d618523de34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.365+0000 7f33667fc700 1 -- 172.21.15.37:0/3142726940 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374032070 con 0x558e14f9d4a0 2024-05-09T01:06:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.365+0000 7f33667fc700 1 -- 172.21.15.37:0/3142726940 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f337402ce50 con 0x558e14f9d4a0 2024-05-09T01:06:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.365+0000 7f33667fc700 1 -- 172.21.15.37:0/3142726940 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374014620 con 0x558e14f9d4a0 2024-05-09T01:06:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 -- 172.21.15.37:0/3142726940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e14f9d4a0 msgr2=0x558e1510f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e14f9d4a0 0x558e1510f700 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33740128c0 tx=0x7f3374008040 comp rx=0 tx=0).stop 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 -- 172.21.15.37:0/3142726940 shutdown_connections 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 0x558e1513bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e14f9d4a0 0x558e1510f700 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 --2- 172.21.15.37:0/3142726940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e15017d00 0x558e1512fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 -- 172.21.15.37:0/3142726940 >> 172.21.15.37:0/3142726940 conn(0x558e14fa0f70 msgr2=0x558e1510eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 -- 172.21.15.37:0/3142726940 shutdown_connections 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.366+0000 7f33957efb80 1 -- 172.21.15.37:0/3142726940 wait complete. 2024-05-09T01:06:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.367+0000 7f33957efb80 1 -- start start 2024-05-09T01:06:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.367+0000 7f33957efb80 1 Processor -- start 2024-05-09T01:06:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.368+0000 7f33957efb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e14f9d4a0 0x558e151210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.368+0000 7f33957efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e151215e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.368+0000 7f3385376700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e14f9d4a0 0x558e151210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.368+0000 7f3385376700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e14f9d4a0 0x558e151210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:54950/0 (socket says 172.21.15.37:54950) 2024-05-09T01:06:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f337ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e151215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f33957efb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 0x558e15121b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f337ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e151215e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49094/0 (socket says 172.21.15.37:49094) 2024-05-09T01:06:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f3385376700 1 -- 172.21.15.37:0/3823537948 learned_addr learned my addr 172.21.15.37:0/3823537948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33801bee20 con 0x558e1511a400 2024-05-09T01:06:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33801be720 con 0x558e14f9d4a0 2024-05-09T01:06:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f33801bb940 con 0x558e15017d00 2024-05-09T01:06:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f33957efb80 10 client.0 _ll_register_callbacks cb 0x558e151233d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f3385376700 1 -- 172.21.15.37:0/3823537948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 msgr2=0x558e151215e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f3385376700 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e151215e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f3385376700 1 -- 172.21.15.37:0/3823537948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 msgr2=0x558e15121b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f3385376700 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 0x558e15121b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.369+0000 7f3385376700 1 -- 172.21.15.37:0/3823537948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e1519d990 con 0x558e14f9d4a0 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.370+0000 7f3385376700 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e14f9d4a0 0x558e151210a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f337400b760 tx=0x7f3374012ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52f28c421816f68 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.370+0000 7f335ffff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.370+0000 7f335ffff700 1 -- 172.21.15.37:0/3823537948 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337403b060 con 0x558e14f9d4a0 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.371+0000 7f335ffff700 1 -- 172.21.15.37:0/3823537948 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f337402c600 con 0x558e14f9d4a0 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.371+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f337402ce50 con 0x558e14f9d4a0 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.371+0000 7f335ffff700 1 -- 172.21.15.37:0/3823537948 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3374032070 con 0x558e14f9d4a0 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.371+0000 7f33957efb80 10 client.25763 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.371+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x558e1519eba0 con 0x558e14f9d4a0 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.372+0000 7f335ffff700 1 -- 172.21.15.37:0/3823537948 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3374022040 con 0x558e14f9d4a0 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.372+0000 7f335ffff700 1 -- 172.21.15.37:0/3823537948 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f3374013050 con 0x558e14f9d4a0 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.372+0000 7f33957efb80 10 client.25763 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.372+0000 7f33957efb80 10 client.25763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.372+0000 7f33957efb80 20 client.25763 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.372+0000 7f33957efb80 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e151a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.373+0000 7f33957efb80 4 client.25763 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.373+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f337402ce50 con 0x558e15133f60 2024-05-09T01:06:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.373+0000 7f337ffff700 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e151a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.374+0000 7f337ffff700 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e151a0ec0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb1274af050e14aa server_cookie=eda5df4c933a7784 in_seq=0 out_seq=0 2024-05-09T01:06:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.374+0000 7f335ffff700 10 client.25763 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.374+0000 7f335ffff700 1 -- 172.21.15.37:0/3823537948 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f337402ce50 con 0x558e15133f60 2024-05-09T01:06:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.374+0000 7f335ffff700 10 client.25763 handle_command_reply: tid=0 2024-05-09T01:06:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.374+0000 7f33957efb80 1 client.25763 shutdown 2024-05-09T01:06:22.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e14f9d4a0 msgr2=0x558e151210a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e14f9d4a0 0x558e151210a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f337400b760 tx=0x7f3374012ba0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 shutdown_connections 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e15133f60 0x558e151a0ec0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1511a400 0x558e15121b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e14f9d4a0 0x558e151210a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 --2- 172.21.15.37:0/3823537948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e15017d00 0x558e151215e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f335ffff700 0 client.25763 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.377+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 >> 172.21.15.37:0/3823537948 conn(0x558e14fa0f70 msgr2=0x558e1511e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.378+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 shutdown_connections 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.378+0000 7f33957efb80 1 -- 172.21.15.37:0/3823537948 wait complete. 2024-05-09T01:06:22.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.378+0000 7f33957efb80 20 client.25763 trim_cache size 0 max 16384 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: "1f535251-5fb4-41b1-93c5-ea3089d93cc5": { 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "1f535251-5fb4-41b1-93c5-ea3089d93cc5", 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:06:22.379 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33680b2a50 msgr2=0x7f33680b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33680b2a50 0x7f33680b4f60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f33700a7980 tx=0x7f3370009ca0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105540 msgr2=0x7f338010ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105540 0x7f338010ba20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3370005eb0 tx=0x7f3370005ee0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 shutdown_connections 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f33680b2a50 0x7f33680b4f60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338010e920 0x7f338011dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3380105540 0x7f338010ba20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 --2- 172.21.15.37:0/3267770843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3380105e90 0x7f338010bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 >> 172.21.15.37:0/3267770843 conn(0x7f33800fef30 msgr2=0x7f33800ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 shutdown_connections 2024-05-09T01:06:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:22.379+0000 7f3386dd9700 1 -- 172.21.15.37:0/3267770843 wait complete. 2024-05-09T01:06:22.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:22 smithi136 ceph-mon[34110]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.5 MiB/s wr, 831 op/s 2024-05-09T01:06:22.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:22 smithi151 ceph-mon[34780]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.5 MiB/s wr, 831 op/s 2024-05-09T01:06:23.130 INFO:tasks.cephfs.filesystem:scrub status for tag:1f535251-5fb4-41b1-93c5-ea3089d93cc5 - {'path': '/', 'tag': '1f535251-5fb4-41b1-93c5-ea3089d93cc5', 'options': 'recursive,force'} 2024-05-09T01:06:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:24 smithi136 ceph-mon[34110]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 8.5 MiB/s wr, 821 op/s 2024-05-09T01:06:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:24 smithi037 ceph-mon[30122]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 8.5 MiB/s wr, 821 op/s 2024-05-09T01:06:24.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:24 smithi151 ceph-mon[34780]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 8.5 MiB/s wr, 821 op/s 2024-05-09T01:06:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 245.0 s, 2610.6 tps, lat 37.910 ms stddev 47.517 2024-05-09T01:06:26.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:26 smithi136 ceph-mon[34110]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 9.1 MiB/s wr, 832 op/s 2024-05-09T01:06:26.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:26 smithi037 ceph-mon[30122]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 9.1 MiB/s wr, 832 op/s 2024-05-09T01:06:26.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:26 smithi151 ceph-mon[34780]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 9.1 MiB/s wr, 832 op/s 2024-05-09T01:06:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:28 smithi136 ceph-mon[34110]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.0 MiB/s wr, 803 op/s 2024-05-09T01:06:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:28 smithi037 ceph-mon[30122]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.0 MiB/s wr, 803 op/s 2024-05-09T01:06:28.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:28 smithi151 ceph-mon[34780]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.0 MiB/s wr, 803 op/s 2024-05-09T01:06:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 250.0 s, 2896.2 tps, lat 34.948 ms stddev 40.146 2024-05-09T01:06:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:30 smithi136 ceph-mon[34110]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.5 MiB/s wr, 813 op/s 2024-05-09T01:06:30.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:30 smithi037 ceph-mon[30122]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.5 MiB/s wr, 813 op/s 2024-05-09T01:06:30.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:30 smithi151 ceph-mon[34780]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 9.5 MiB/s wr, 813 op/s 2024-05-09T01:06:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/3132013383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 msgr2=0x7ffa34103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/3132013383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 0x7ffa34103f50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009860 tx=0x7ffa2402a340 comp rx=0 tx=0).stop 2024-05-09T01:06:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/3132013383 shutdown_connections 2024-05-09T01:06:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/3132013383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa341045e0 0x7ffa3410ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/3132013383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 0x7ffa34103f50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/3132013383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa34103120 0x7ffa34103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/3132013383 >> 172.21.15.37:0/3132013383 conn(0x7ffa340fd4c0 msgr2=0x7ffa340ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/3132013383 shutdown_connections 2024-05-09T01:06:30.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.841+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/3132013383 wait complete. 2024-05-09T01:06:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.842+0000 7ffa3bf7d640 1 Processor -- start 2024-05-09T01:06:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.842+0000 7ffa3bf7d640 1 -- start start 2024-05-09T01:06:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa3bf7d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa34103120 0x7ffa341981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa3bf7d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 0x7ffa34198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa3bf7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa341045e0 0x7ffa3419f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa3bf7d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3410d590 con 0x7ffa34103b00 2024-05-09T01:06:30.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa3bf7d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3410d410 con 0x7ffa34103120 2024-05-09T01:06:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa3bf7d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3410d710 con 0x7ffa341045e0 2024-05-09T01:06:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa34103120 0x7ffa341981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa34103120 0x7ffa341981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:54968/0 (socket says 172.21.15.37:54968) 2024-05-09T01:06:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa39d19640 1 -- 172.21.15.37:0/2296116275 learned_addr learned my addr 172.21.15.37:0/2296116275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:30.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.843+0000 7ffa39518640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 0x7ffa34198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa39d19640 1 -- 172.21.15.37:0/2296116275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa341045e0 msgr2=0x7ffa3419f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa39d19640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa341045e0 0x7ffa3419f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa39d19640 1 -- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 msgr2=0x7ffa34198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa39d19640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 0x7ffa34198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa39d19640 1 -- 172.21.15.37:0/2296116275 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3419fd00 con 0x7ffa34103120 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa39d19640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa34103120 0x7ffa341981c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000e9c0 tx=0x7ffa3000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa2affd640 1 -- 172.21.15.37:0/2296116275 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000ccc0 con 0x7ffa34103120 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa2affd640 1 -- 172.21.15.37:0/2296116275 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa300035f0 con 0x7ffa34103120 2024-05-09T01:06:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa2affd640 1 -- 172.21.15.37:0/2296116275 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000ce60 con 0x7ffa34103120 2024-05-09T01:06:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3419fff0 con 0x7ffa34103120 2024-05-09T01:06:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.844+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa341a0450 con 0x7ffa34103120 2024-05-09T01:06:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.847+0000 7ffa2affd640 1 -- 172.21.15.37:0/2296116275 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ffa30004000 con 0x7ffa34103120 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.848+0000 7ffa42e35740 1 Processor -- start 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.849+0000 7ffa2affd640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffa200b4af0 0x7ffa200b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.849+0000 7ffa2affd640 1 -- 172.21.15.37:0/2296116275 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ffa300e24b0 con 0x7ffa34103120 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.849+0000 7ffa42e35740 1 -- start start 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40aaf5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40aaf5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7304d0 0x55d40aafc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa42e35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d40aa597c0 con 0x55d40a7282f0 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa42e35740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d40a9f50e0 con 0x55d40a7511b0 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa42e35740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d40aa55780 con 0x55d40a7304d0 2024-05-09T01:06:30.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40aaf5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40aaf5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:54970/0 (socket says 172.21.15.37:54970) 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa39d19640 1 -- 172.21.15.37:0/3957169455 learned_addr learned my addr 172.21.15.37:0/3957169455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffa200b4af0 0x7ffa200b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7304d0 0x55d40aafc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa39d19640 1 -- 172.21.15.37:0/3957169455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7304d0 msgr2=0x55d40aafc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.850+0000 7ffa39d19640 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7304d0 0x55d40aafc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa39518640 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40aaf5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa39d19640 1 -- 172.21.15.37:0/3957169455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 msgr2=0x55d40aaf5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa39d19640 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40aaf5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa39d19640 1 -- 172.21.15.37:0/3957169455 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d40aa1e7c0 con 0x55d40a7511b0 2024-05-09T01:06:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa39518640 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40aaf5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa39d19640 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40aaf5500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa300a9a60 tx=0x7ffa300a9370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf48e83239e81990 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffa200b4af0 0x7ffa200b7000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009810 tx=0x7ffa2c009780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa1ffff640 1 -- 172.21.15.37:0/3957169455 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa300c3070 con 0x55d40a7511b0 2024-05-09T01:06:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa1ffff640 1 -- 172.21.15.37:0/3957169455 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa300a9ad0 con 0x55d40a7511b0 2024-05-09T01:06:30.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.851+0000 7ffa1ffff640 1 -- 172.21.15.37:0/3957169455 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa300a5d60 con 0x55d40a7511b0 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.852+0000 7ffa42e35740 1 -- 172.21.15.37:0/3957169455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 msgr2=0x55d40aaf5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.852+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40aaf5500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa300a9a60 tx=0x7ffa300a9370 comp rx=0 tx=0).stop 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.853+0000 7ffa42e35740 1 -- 172.21.15.37:0/3957169455 shutdown_connections 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.853+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7304d0 0x55d40aafc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.853+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40aaf5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.853+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3957169455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40aaf5500 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.853+0000 7ffa42e35740 1 -- 172.21.15.37:0/3957169455 >> 172.21.15.37:0/3957169455 conn(0x55d40a745300 msgr2=0x55d40aaf0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.853+0000 7ffa42e35740 1 -- 172.21.15.37:0/3957169455 shutdown_connections 2024-05-09T01:06:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.853+0000 7ffa42e35740 1 -- 172.21.15.37:0/3957169455 wait complete. 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.854+0000 7ffa42e35740 1 -- start start 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.854+0000 7ffa42e35740 1 Processor -- start 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7282f0 0x55d40ab03670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab03bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40ab0ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa42e35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d40ab017e0 con 0x55d40a7304d0 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7282f0 0x55d40ab03670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa42e35740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d40a9e09c0 con 0x55d40a7511b0 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa42e35740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d40ab01960 con 0x55d40a7282f0 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39518640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab03bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7282f0 0x55d40ab03670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49134/0 (socket says 172.21.15.37:49134) 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39d19640 1 -- 172.21.15.37:0/1581367841 learned_addr learned my addr 172.21.15.37:0/1581367841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40ab0ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa42e35740 10 client.0 _ll_register_callbacks cb 0x55d40aa0d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39518640 1 -- 172.21.15.37:0/1581367841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7282f0 msgr2=0x55d40ab03670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39518640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7282f0 0x55d40ab03670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39518640 1 -- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 msgr2=0x55d40ab0ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39518640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40ab0ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39518640 1 -- 172.21.15.37:0/1581367841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d40aa071f0 con 0x55d40a7304d0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39d19640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7282f0 0x55d40ab03670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40ab0ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa39518640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab03bb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffa24035040 tx=0x7ffa240095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a945d30a292fd9b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.855+0000 7ffa1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.856+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/1581367841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24037040 con 0x55d40a7304d0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.856+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/1581367841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ffa24030760 con 0x55d40a7304d0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.856+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa300a9ad0 con 0x55d40a7304d0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.856+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/1581367841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ffa24041a70 con 0x55d40a7304d0 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.856+0000 7ffa42e35740 10 client.15984 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.856+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d40a7bc790 con 0x55d40a7304d0 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/1581367841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa300a9ad0 con 0x55d40a7304d0 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/1581367841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7ffa24003800 con 0x55d40a7304d0 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa42e35740 10 client.15984 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa42e35740 10 client.15984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa42e35740 20 client.15984 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa42e35740 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a70fd80 0x55d40ab00260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa42e35740 4 client.15984 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d40aa673d0 con 0x55d40a70fd80 2024-05-09T01:06:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.858+0000 7ffa39d19640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a70fd80 0x55d40ab00260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.859+0000 7ffa1d7fa640 10 client.15984 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.859+0000 7ffa39d19640 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a70fd80 0x55d40ab00260 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9614d7640c6810a server_cookie=c62d72760ab8d3e1 in_seq=0 out_seq=0 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/1581367841 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d40aa673d0 con 0x55d40a70fd80 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa1d7fa640 10 client.15984 handle_command_reply: tid=0 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 client.15984 shutdown 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 msgr2=0x55d40ab03bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab03bb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffa24035040 tx=0x7ffa240095a0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 shutdown_connections 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a70fd80 0x55d40ab00260 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7511b0 0x55d40ab0ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab03bb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 --2- 172.21.15.37:0/1581367841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7282f0 0x55d40ab03670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 >> 172.21.15.37:0/1581367841 conn(0x55d40a745300 msgr2=0x55d40aaf3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa1d7fa640 0 client.15984 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.860+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 shutdown_connections 2024-05-09T01:06:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.861+0000 7ffa42e35740 1 -- 172.21.15.37:0/1581367841 wait complete. 2024-05-09T01:06:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.861+0000 7ffa42e35740 20 client.15984 trim_cache size 0 max 16384 2024-05-09T01:06:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.888+0000 7ffa42e35740 1 Processor -- start 2024-05-09T01:06:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.888+0000 7ffa42e35740 1 -- start start 2024-05-09T01:06:30.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.888+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40ab01d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.888+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7304d0 0x55d40ab02240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40aaf96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa42e35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341a91a0 con 0x55d40a7282f0 2024-05-09T01:06:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa42e35740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341aad10 con 0x55d40a7304d0 2024-05-09T01:06:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa42e35740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341a9870 con 0x55d40a7511b0 2024-05-09T01:06:30.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40ab01d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40ab01d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46906/0 (socket says 172.21.15.37:46906) 2024-05-09T01:06:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa39d19640 1 -- 172.21.15.37:0/3213620013 learned_addr learned my addr 172.21.15.37:0/3213620013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40aaf96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.889+0000 7ffa39518640 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7304d0 0x55d40ab02240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.890+0000 7ffa3a51a640 1 -- 172.21.15.37:0/3213620013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7304d0 msgr2=0x55d40ab02240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.890+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7304d0 0x55d40ab02240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.890+0000 7ffa3a51a640 1 -- 172.21.15.37:0/3213620013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 msgr2=0x55d40ab01d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.890+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40ab01d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.890+0000 7ffa3a51a640 1 -- 172.21.15.37:0/3213620013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d40a8335f0 con 0x55d40a7511b0 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.890+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40aaf96e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c005c40 tx=0x7ffa2c005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1faaa39f7aa587 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.891+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/3213620013 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00ecb0 con 0x55d40a7511b0 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.891+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/3213620013 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa2c00ee50 con 0x55d40a7511b0 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.891+0000 7ffa1f7fe640 1 -- 172.21.15.37:0/3213620013 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c005020 con 0x55d40a7511b0 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 -- 172.21.15.37:0/3213620013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 msgr2=0x55d40aaf96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40aaf96e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c005c40 tx=0x7ffa2c005bd0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 -- 172.21.15.37:0/3213620013 shutdown_connections 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40aaf96e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7304d0 0x55d40ab02240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 --2- 172.21.15.37:0/3213620013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7282f0 0x55d40ab01d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 -- 172.21.15.37:0/3213620013 >> 172.21.15.37:0/3213620013 conn(0x55d40a745300 msgr2=0x55d40aaf8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 -- 172.21.15.37:0/3213620013 shutdown_connections 2024-05-09T01:06:30.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 -- 172.21.15.37:0/3213620013 wait complete. 2024-05-09T01:06:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 -- start start 2024-05-09T01:06:30.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.892+0000 7ffa42e35740 1 Processor -- start 2024-05-09T01:06:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7282f0 0x55d40ab07880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab07dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa42e35740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40ab08cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa42e35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341aa640 con 0x55d40a7304d0 2024-05-09T01:06:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa42e35740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341a9f40 con 0x55d40a7282f0 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa42e35740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa341a7180 con 0x55d40a7511b0 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa42e35740 10 client.0 _ll_register_callbacks cb 0x7ffa2c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa39518640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab07dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa39d19640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7282f0 0x55d40ab07880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa39518640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab07dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46918/0 (socket says 172.21.15.37:46918) 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa39518640 1 -- 172.21.15.37:0/2819325160 learned_addr learned my addr 172.21.15.37:0/2819325160 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa3a51a640 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40ab08cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa39d19640 1 -- 172.21.15.37:0/2819325160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 msgr2=0x55d40ab08cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.893+0000 7ffa39d19640 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40ab08cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa39d19640 1 -- 172.21.15.37:0/2819325160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 msgr2=0x55d40ab07dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa39d19640 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab07dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa39d19640 1 -- 172.21.15.37:0/2819325160 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d40aa1ded0 con 0x55d40a7282f0 2024-05-09T01:06:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa39518640 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab07dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa39d19640 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7282f0 0x55d40ab07880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000c6a0 tx=0x7ffa3000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db3796b850356c2f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/2819325160 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa300c3040 con 0x55d40a7282f0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/2819325160 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ffa300a60c0 con 0x55d40a7282f0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa2c00ee50 con 0x55d40a7282f0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/2819325160 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ffa300a9ad0 con 0x55d40a7282f0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa42e35740 10 client.25781 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.894+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d40ab0a370 con 0x55d40a7282f0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/2819325160 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa2c00ee50 con 0x55d40a7282f0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/2819325160 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7ffa300042f0 con 0x55d40a7282f0 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa42e35740 10 client.25781 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa42e35740 10 client.25781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa42e35740 20 client.25781 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa42e35740 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a6e51c0 0x55d40ab75d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa42e35740 4 client.25781 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:06:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d40aa61240 con 0x55d40a6e51c0 2024-05-09T01:06:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.895+0000 7ffa39518640 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a6e51c0 0x55d40ab75d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.896+0000 7ffa1d7fa640 10 client.25781 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:30.896+0000 7ffa39518640 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a6e51c0 0x55d40ab75d10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c4c51823bc7c317 server_cookie=911c24b258ec537d in_seq=0 out_seq=0 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.014+0000 7ffa1d7fa640 1 -- 172.21.15.37:0/2819325160 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d40aa61240 con 0x55d40a6e51c0 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.014+0000 7ffa1d7fa640 10 client.25781 handle_command_reply: tid=0 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.014+0000 7ffa42e35740 1 client.25781 shutdown 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.014+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7282f0 msgr2=0x55d40ab07880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.014+0000 7ffa42e35740 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7282f0 0x55d40ab07880 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000c6a0 tx=0x7ffa3000c7d0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 shutdown_connections 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d40a6e51c0 0x55d40ab75d10 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d40a7511b0 0x55d40ab08cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d40a7304d0 0x55d40ab07dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 --2- 172.21.15.37:0/2819325160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d40a7282f0 0x55d40ab07880 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa1d7fa640 0 client.25781 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 >> 172.21.15.37:0/2819325160 conn(0x55d40a745300 msgr2=0x55d40aaf8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 shutdown_connections 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 1 -- 172.21.15.37:0/2819325160 wait complete. 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa42e35740 20 client.25781 trim_cache size 0 max 16384 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:06:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:06:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffa200b4af0 msgr2=0x7ffa200b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffa200b4af0 0x7ffa200b7000 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009810 tx=0x7ffa2c009780 comp rx=0 tx=0).stop 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa34103120 msgr2=0x7ffa341981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa34103120 0x7ffa341981c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000e9c0 tx=0x7ffa3000ee80 comp rx=0 tx=0).stop 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 shutdown_connections 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa341045e0 0x7ffa3419f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa34103b00 0x7ffa34198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffa200b4af0 0x7ffa200b7000 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.015+0000 7ffa3bf7d640 1 --2- 172.21.15.37:0/2296116275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa34103120 0x7ffa341981c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.016+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 >> 172.21.15.37:0/2296116275 conn(0x7ffa340fd4c0 msgr2=0x7ffa34104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.016+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 shutdown_connections 2024-05-09T01:06:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:31.016+0000 7ffa3bf7d640 1 -- 172.21.15.37:0/2296116275 wait complete. 2024-05-09T01:06:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:32 smithi136 ceph-mon[34110]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.2 MiB/s wr, 844 op/s 2024-05-09T01:06:32.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:32 smithi037 ceph-mon[30122]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.2 MiB/s wr, 844 op/s 2024-05-09T01:06:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:32 smithi151 ceph-mon[34780]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 9.2 MiB/s wr, 844 op/s 2024-05-09T01:06:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:06:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:06:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:06:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:06:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:06:33.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:06:33.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:06:33.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:06:33.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:06:33.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:06:33.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:06:33.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:06:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:06:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:06:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:06:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:34 smithi136 ceph-mon[34110]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.0 MiB/s wr, 764 op/s 2024-05-09T01:06:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:34 smithi037 ceph-mon[30122]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.0 MiB/s wr, 764 op/s 2024-05-09T01:06:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:34 smithi151 ceph-mon[34780]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 9.0 MiB/s wr, 764 op/s 2024-05-09T01:06:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 255.0 s, 2924.6 tps, lat 34.065 ms stddev 37.925 2024-05-09T01:06:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:36 smithi136 ceph-mon[34110]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 807 op/s 2024-05-09T01:06:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:36 smithi037 ceph-mon[30122]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 807 op/s 2024-05-09T01:06:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:36 smithi151 ceph-mon[34780]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 MiB/s wr, 807 op/s 2024-05-09T01:06:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:38 smithi136 ceph-mon[34110]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.8 MiB/s wr, 744 op/s 2024-05-09T01:06:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:38 smithi037 ceph-mon[30122]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.8 MiB/s wr, 744 op/s 2024-05-09T01:06:38.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:38 smithi151 ceph-mon[34780]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.8 MiB/s wr, 744 op/s 2024-05-09T01:06:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 260.0 s, 2566.4 tps, lat 39.016 ms stddev 43.913 2024-05-09T01:06:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:40 smithi136 ceph-mon[34110]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 696 op/s 2024-05-09T01:06:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:40 smithi151 ceph-mon[34780]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 696 op/s 2024-05-09T01:06:40.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:40 smithi037 ceph-mon[30122]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 696 op/s 2024-05-09T01:06:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:42 smithi037 ceph-mon[30122]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 756 op/s 2024-05-09T01:06:42.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:42 smithi151 ceph-mon[34780]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 756 op/s 2024-05-09T01:06:42.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:42 smithi136 ceph-mon[34110]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 756 op/s 2024-05-09T01:06:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.180+0000 7fb3d9727640 1 -- 172.21.15.37:0/1044322822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 msgr2=0x7fb3d410b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.180+0000 7fb3d9727640 1 --2- 172.21.15.37:0/1044322822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d410b890 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009900 tx=0x7fb3c402a420 comp rx=0 tx=0).stop 2024-05-09T01:06:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.181+0000 7fb3d9727640 1 -- 172.21.15.37:0/1044322822 shutdown_connections 2024-05-09T01:06:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.181+0000 7fb3d9727640 1 --2- 172.21.15.37:0/1044322822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3d41101a0 0x7fb3d41105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.181+0000 7fb3d9727640 1 --2- 172.21.15.37:0/1044322822 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d410b890 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.181+0000 7fb3d9727640 1 --2- 172.21.15.37:0/1044322822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3d410a550 0x7fb3d410af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.181+0000 7fb3d9727640 1 -- 172.21.15.37:0/1044322822 >> 172.21.15.37:0/1044322822 conn(0x7fb3d4070670 msgr2=0x7fb3d4072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.182+0000 7fb3d9727640 1 -- 172.21.15.37:0/1044322822 shutdown_connections 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.186+0000 7fb3d9727640 1 -- 172.21.15.37:0/1044322822 wait complete. 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 Processor -- start 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 -- start start 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3d410a550 0x7fb3d41a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d41a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3d41101a0 0x7fb3d407af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d411e6b0 con 0x7fb3d41101a0 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d411e530 con 0x7fb3d410b480 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.187+0000 7fb3d9727640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d411e830 con 0x7fb3d410a550 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d41a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d41a97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60818/0 (socket says 172.21.15.37:60818) 2024-05-09T01:06:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 -- 172.21.15.37:0/3255044397 learned_addr learned my addr 172.21.15.37:0/3255044397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3d410a550 0x7fb3d41a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 -- 172.21.15.37:0/3255044397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3d410a550 msgr2=0x7fb3d41a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3d410a550 0x7fb3d41a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 -- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3d41101a0 msgr2=0x7fb3d407af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3d41101a0 0x7fb3d407af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.188+0000 7fb3d27fc640 1 -- 172.21.15.37:0/3255044397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d407b5a0 con 0x7fb3d410b480 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.189+0000 7fb3d27fc640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d41a97c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4005ab0 tx=0x7fb3c4003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.189+0000 7fb3bbfff640 1 -- 172.21.15.37:0/3255044397 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c403f070 con 0x7fb3d410b480 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.189+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d407b830 con 0x7fb3d410b480 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.189+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d407bdf0 con 0x7fb3d410b480 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.189+0000 7fb3bbfff640 1 -- 172.21.15.37:0/3255044397 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3c4031c50 con 0x7fb3d410b480 2024-05-09T01:06:44.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.189+0000 7fb3bbfff640 1 -- 172.21.15.37:0/3255044397 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4035030 con 0x7fb3d410b480 2024-05-09T01:06:44.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 Processor -- start 2024-05-09T01:06:44.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 -- start start 2024-05-09T01:06:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be7211b0 0x55d6beac5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be6f82f0 0x55d6beac5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6beacc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d6bea297c0 con 0x55d6be6f82f0 2024-05-09T01:06:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d6be9c50e0 con 0x55d6be7211b0 2024-05-09T01:06:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3e05d9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d6bea25780 con 0x55d6be7004d0 2024-05-09T01:06:44.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3d37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be7211b0 0x55d6beac5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3d37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be7211b0 0x55d6beac5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60830/0 (socket says 172.21.15.37:60830) 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.193+0000 7fb3d37fe640 1 -- 172.21.15.37:0/1087187320 learned_addr learned my addr 172.21.15.37:0/1087187320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3d27fc640 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6beacc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3bbfff640 1 -- 172.21.15.37:0/3255044397 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb3c4042070 con 0x7fb3d410b480 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3d37fe640 1 -- 172.21.15.37:0/1087187320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 msgr2=0x55d6beacc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6beacc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3d37fe640 1 -- 172.21.15.37:0/1087187320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be6f82f0 msgr2=0x55d6beac5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be6f82f0 0x55d6beac5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3d37fe640 1 -- 172.21.15.37:0/1087187320 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6be9ee7c0 con 0x55d6be7211b0 2024-05-09T01:06:44.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.194+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be7211b0 0x55d6beac5500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009790 tx=0x7fb3c8009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d928dc742ea2c66b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.195+0000 7fb3b97fa640 1 -- 172.21.15.37:0/1087187320 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8015020 con 0x55d6be7211b0 2024-05-09T01:06:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.195+0000 7fb3b97fa640 1 -- 172.21.15.37:0/1087187320 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3c8011420 con 0x55d6be7211b0 2024-05-09T01:06:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.195+0000 7fb3b97fa640 1 -- 172.21.15.37:0/1087187320 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80105c0 con 0x55d6be7211b0 2024-05-09T01:06:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.195+0000 7fb3bbfff640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb3bc0b2930 0x7fb3bc0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3bbfff640 1 -- 172.21.15.37:0/3255044397 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb3c4102a70 con 0x7fb3d410b480 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 -- 172.21.15.37:0/1087187320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be7211b0 msgr2=0x55d6beac5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be7211b0 0x55d6beac5500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8009790 tx=0x7fb3c8009c50 comp rx=0 tx=0).stop 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb3bc0b2930 0x7fb3bc0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 -- 172.21.15.37:0/1087187320 shutdown_connections 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6beacc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be6f82f0 0x55d6beac5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/1087187320 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be7211b0 0x55d6beac5500 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 -- 172.21.15.37:0/1087187320 >> 172.21.15.37:0/1087187320 conn(0x55d6be715300 msgr2=0x55d6beac0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.196+0000 7fb3e05d9740 1 -- 172.21.15.37:0/1087187320 shutdown_connections 2024-05-09T01:06:44.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.197+0000 7fb3e05d9740 1 -- 172.21.15.37:0/1087187320 wait complete. 2024-05-09T01:06:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.197+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb3bc0b2930 0x7fb3bc0b4e40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55d6beac1c20 tx=0x7fb3cc0098e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.197+0000 7fb3e05d9740 1 -- start start 2024-05-09T01:06:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.198+0000 7fb3e05d9740 1 Processor -- start 2024-05-09T01:06:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.198+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beacf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.198+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6beacf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.198+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beacf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beacf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60838/0 (socket says 172.21.15.37:60838) 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d2ffd640 1 -- 172.21.15.37:0/2989480864 learned_addr learned my addr 172.21.15.37:0/2989480864 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d27fc640 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6beacf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6bead6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d6beacd3d0 con 0x55d6be7004d0 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d6be9b09c0 con 0x55d6be6f82f0 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d6beacd550 con 0x55d6be7211b0 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6bead6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d37fe640 1 -- 172.21.15.37:0/2989480864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 msgr2=0x55d6beacf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beacf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d37fe640 1 -- 172.21.15.37:0/2989480864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 msgr2=0x55d6beacf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6beacf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3d37fe640 1 -- 172.21.15.37:0/2989480864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6be9d71f0 con 0x55d6be7211b0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3e05d9740 10 client.0 _ll_register_callbacks cb 0x55d6be9dd020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.199+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3c8011420 con 0x55d6be7211b0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.200+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6bead6850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55d6beac66d0 tx=0x7fb3c80117e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43668e3b766edb6f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.200+0000 7fb3b6ff5640 10 client.25786 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.200+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2989480864 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8015030 con 0x55d6be7211b0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.200+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2989480864 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb3c800bae0 con 0x55d6be7211b0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.200+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2989480864 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb3c8009ea0 con 0x55d6be7211b0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.200+0000 7fb3e05d9740 10 client.25786 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.200+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=38}) -- 0x55d6be78c790 con 0x55d6be7211b0 2024-05-09T01:06:44.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2989480864 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fb3c801a420 con 0x55d6be7211b0 2024-05-09T01:06:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3e05d9740 10 client.25786 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3e05d9740 10 client.25786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3e05d9740 20 client.25786 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6dfd80 0x55d6beadc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3e05d9740 4 client.25786 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6bea373d0 con 0x55d6be6dfd80 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.201+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6dfd80 0x55d6beadc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.202+0000 7fb3b6ff5640 10 client.25786 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.202+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6dfd80 0x55d6beadc6e0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4631f851dc84caa8 server_cookie=9544bbfad2122c36 in_seq=0 out_seq=0 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.202+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2989480864 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d6bea373d0 con 0x55d6be6dfd80 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.202+0000 7fb3b6ff5640 10 client.25786 handle_command_reply: tid=0 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.202+0000 7fb3e05d9740 1 client.25786 shutdown 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.203+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 msgr2=0x55d6bead6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.203+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6bead6850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55d6beac66d0 tx=0x7fb3c80117e0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.203+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 shutdown_connections 2024-05-09T01:06:44.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.203+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6dfd80 0x55d6beadc6e0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6bead6850 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6beacf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2989480864 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beacf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 >> 172.21.15.37:0/2989480864 conn(0x55d6be715300 msgr2=0x55d6beac3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3b6ff5640 0 client.25786 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 shutdown_connections 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2989480864 wait complete. 2024-05-09T01:06:44.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.204+0000 7fb3e05d9740 20 client.25786 trim_cache size 0 max 16384 2024-05-09T01:06:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 Processor -- start 2024-05-09T01:06:44.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 -- start start 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beac0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6bead6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6beac9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c000e2f0 con 0x55d6be7004d0 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c000fe60 con 0x55d6be6f82f0 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3e05d9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c000e9c0 con 0x55d6be7211b0 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6bead6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6bead6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41996/0 (socket says 172.21.15.37:41996) 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3d27fc640 1 -- 172.21.15.37:0/272618254 learned_addr learned my addr 172.21.15.37:0/272618254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:44.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beac0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.230+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6beac9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3d2ffd640 1 -- 172.21.15.37:0/272618254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 msgr2=0x55d6beac9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6beac9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3d2ffd640 1 -- 172.21.15.37:0/272618254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 msgr2=0x55d6bead6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6bead6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3d2ffd640 1 -- 172.21.15.37:0/272618254 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6be8035f0 con 0x55d6be6f82f0 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beac0710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55d6beadcde0 tx=0x7fb3cc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38b2eb41f21b8489 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3b8ff9640 1 -- 172.21.15.37:0/272618254 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc0295f0 con 0x55d6be6f82f0 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3b8ff9640 1 -- 172.21.15.37:0/272618254 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3cc02f070 con 0x55d6be6f82f0 2024-05-09T01:06:44.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.231+0000 7fb3b8ff9640 1 -- 172.21.15.37:0/272618254 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc020dc0 con 0x55d6be6f82f0 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 -- 172.21.15.37:0/272618254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 msgr2=0x55d6beac0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beac0710 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55d6beadcde0 tx=0x7fb3cc016000 comp rx=0 tx=0).stop 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 -- 172.21.15.37:0/272618254 shutdown_connections 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7211b0 0x55d6beac9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7004d0 0x55d6bead6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/272618254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6beac0710 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 -- 172.21.15.37:0/272618254 >> 172.21.15.37:0/272618254 conn(0x55d6be715300 msgr2=0x55d6beac3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 -- 172.21.15.37:0/272618254 shutdown_connections 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 -- 172.21.15.37:0/272618254 wait complete. 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.232+0000 7fb3e05d9740 1 -- start start 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 1 Processor -- start 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6bead36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6bead3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7211b0 0x55d6beb42a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c000f790 con 0x55d6be7211b0 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6bead36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6bead3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3d2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6bead36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60858/0 (socket says 172.21.15.37:60858) 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3d2ffd640 1 -- 172.21.15.37:0/2397204801 learned_addr learned my addr 172.21.15.37:0/2397204801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3d27fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6bead3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:44890/0 (socket says 172.21.15.37:44890) 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c000f090 con 0x55d6be6f82f0 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c000c2d0 con 0x55d6be7004d0 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7211b0 0x55d6beb42a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.233+0000 7fb3e05d9740 10 client.0 _ll_register_callbacks cb 0x7fb3c80095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.234+0000 7fb3d37fe640 1 -- 172.21.15.37:0/2397204801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 msgr2=0x55d6bead3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.234+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6bead3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.234+0000 7fb3d37fe640 1 -- 172.21.15.37:0/2397204801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 msgr2=0x55d6bead36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.234+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6bead36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.234+0000 7fb3d37fe640 1 -- 172.21.15.37:0/2397204801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6be9eded0 con 0x55d6be7211b0 2024-05-09T01:06:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.234+0000 7fb3d37fe640 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7211b0 0x55d6beb42a40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb3c801a9c0 tx=0x7fb3c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6f8cb1b73f384e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.234+0000 7fb3b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.235+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2397204801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8015040 con 0x55d6be7211b0 2024-05-09T01:06:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.235+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2397204801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb3c8011a50 con 0x55d6be7211b0 2024-05-09T01:06:44.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.235+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3cc02f070 con 0x55d6be7211b0 2024-05-09T01:06:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.235+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2397204801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fb3c800bae0 con 0x55d6be7211b0 2024-05-09T01:06:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 10 client.15999 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:44.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d6beb43ef0 con 0x55d6be7211b0 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2397204801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3cc02f070 con 0x55d6be7211b0 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2397204801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fb3c8040050 con 0x55d6be7211b0 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 10 client.15999 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 20 client.15999 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6b51c0 0x55d6beb467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 4 client.15999 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.236+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6bea31240 con 0x55d6be6b51c0 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.237+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6b51c0 0x55d6beb467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.238+0000 7fb3d2ffd640 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6b51c0 0x55d6beb467f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d76fc98a7a81193 server_cookie=548762e9b6c1b2f2 in_seq=0 out_seq=0 2024-05-09T01:06:44.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.238+0000 7fb3b6ff5640 10 client.15999 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.247+0000 7fb3b6ff5640 1 -- 172.21.15.37:0/2397204801 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d6bea31240 con 0x55d6be6b51c0 2024-05-09T01:06:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3b6ff5640 10 client.15999 handle_command_reply: tid=0 2024-05-09T01:06:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 client.15999 shutdown 2024-05-09T01:06:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7211b0 msgr2=0x55d6beb42a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7211b0 0x55d6beb42a40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb3c801a9c0 tx=0x7fb3c8000bc0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 shutdown_connections 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d6be6b51c0 0x55d6beb467f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6be7211b0 0x55d6beb42a40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6be7004d0 0x55d6bead3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 --2- 172.21.15.37:0/2397204801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d6be6f82f0 0x55d6bead36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 >> 172.21.15.37:0/2397204801 conn(0x55d6be715300 msgr2=0x55d6beac9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3b6ff5640 0 client.15999 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.248+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 shutdown_connections 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.249+0000 7fb3e05d9740 1 -- 172.21.15.37:0/2397204801 wait complete. 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.249+0000 7fb3e05d9740 20 client.15999 trim_cache size 0 max 16384 2024-05-09T01:06:44.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:06:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:06:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:06:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.249+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb3bc0b2930 msgr2=0x7fb3bc0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.249+0000 7fb3d9727640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb3bc0b2930 0x7fb3bc0b4e40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55d6beac1c20 tx=0x7fb3cc0098e0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.249+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 msgr2=0x7fb3d41a97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.249+0000 7fb3d9727640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d41a97c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4005ab0 tx=0x7fb3c4003bb0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 shutdown_connections 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3d41101a0 0x7fb3d407af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb3bc0b2930 0x7fb3bc0b4e40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3d410b480 0x7fb3d41a97c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 --2- 172.21.15.37:0/3255044397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3d410a550 0x7fb3d41a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 >> 172.21.15.37:0/3255044397 conn(0x7fb3d4070670 msgr2=0x7fb3d410c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 shutdown_connections 2024-05-09T01:06:44.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:44.250+0000 7fb3d9727640 1 -- 172.21.15.37:0/3255044397 wait complete. 2024-05-09T01:06:44.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:44 smithi037 ceph-mon[30122]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.8 MiB/s wr, 704 op/s 2024-05-09T01:06:44.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:44 smithi151 ceph-mon[34780]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.8 MiB/s wr, 704 op/s 2024-05-09T01:06:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:44 smithi136 ceph-mon[34110]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.8 MiB/s wr, 704 op/s 2024-05-09T01:06:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 265.0 s, 3311.4 tps, lat 30.057 ms stddev 34.258 2024-05-09T01:06:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:46 smithi037 ceph-mon[30122]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.5 MiB/s wr, 778 op/s 2024-05-09T01:06:46.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:46 smithi151 ceph-mon[34780]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.5 MiB/s wr, 778 op/s 2024-05-09T01:06:46.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:46 smithi136 ceph-mon[34110]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.5 MiB/s wr, 778 op/s 2024-05-09T01:06:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:48 smithi037 ceph-mon[30122]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.1 MiB/s wr, 709 op/s 2024-05-09T01:06:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:48 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:06:48.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:48 smithi151 ceph-mon[34780]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.1 MiB/s wr, 709 op/s 2024-05-09T01:06:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:48 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:06:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:48 smithi136 ceph-mon[34110]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.1 MiB/s wr, 709 op/s 2024-05-09T01:06:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:48 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:06:49.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:06:49.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:06:49.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:06:49.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:06:49.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:06:49.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:06:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:06:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:06:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:06:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:06:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 270.0 s, 3525.2 tps, lat 28.590 ms stddev 33.550 2024-05-09T01:06:50.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:50 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi037 to 177.2M 2024-05-09T01:06:50.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:50 smithi037 ceph-mon[30122]: Unable to set osd_memory_target on smithi037 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-09T01:06:50.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:50 smithi037 ceph-mon[30122]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 655 op/s 2024-05-09T01:06:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:50 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi037 to 177.2M 2024-05-09T01:06:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:50 smithi151 ceph-mon[34780]: Unable to set osd_memory_target on smithi037 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-09T01:06:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:50 smithi151 ceph-mon[34780]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 655 op/s 2024-05-09T01:06:50.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:50 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi037 to 177.2M 2024-05-09T01:06:50.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:50 smithi136 ceph-mon[34110]: Unable to set osd_memory_target on smithi037 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-09T01:06:50.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:50 smithi136 ceph-mon[34110]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.3 MiB/s wr, 655 op/s 2024-05-09T01:06:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:52 smithi037 ceph-mon[30122]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 765 op/s 2024-05-09T01:06:52.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:52 smithi151 ceph-mon[34780]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 765 op/s 2024-05-09T01:06:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:52 smithi136 ceph-mon[34110]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 765 op/s 2024-05-09T01:06:53.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:06:53.533 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:54.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:54 smithi037 ceph-mon[30122]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.7 MiB/s wr, 699 op/s 2024-05-09T01:06:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:54 smithi151 ceph-mon[34780]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.7 MiB/s wr, 699 op/s 2024-05-09T01:06:54.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:54 smithi136 ceph-mon[34110]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.7 MiB/s wr, 699 op/s 2024-05-09T01:06:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 275.0 s, 2892.2 tps, lat 34.301 ms stddev 39.057 2024-05-09T01:06:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.474+0000 7f2db740a700 1 -- 172.21.15.37:0/3264237947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 msgr2=0x7f2db01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.474+0000 7f2db740a700 1 --2- 172.21.15.37:0/3264237947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db01038d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0098f0 tx=0x7f2dac009c00 comp rx=0 tx=0).stop 2024-05-09T01:06:55.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.474+0000 7f2db740a700 1 -- 172.21.15.37:0/3264237947 shutdown_connections 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.474+0000 7f2db740a700 1 --2- 172.21.15.37:0/3264237947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2db0108740 0x7f2db006b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.474+0000 7f2db740a700 1 --2- 172.21.15.37:0/3264237947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db01038d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.474+0000 7f2db740a700 1 --2- 172.21.15.37:0/3264237947 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0107df0 0x7f2db0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.474+0000 7f2db740a700 1 -- 172.21.15.37:0/3264237947 >> 172.21.15.37:0/3264237947 conn(0x7f2db00fedc0 msgr2=0x7f2db01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.475+0000 7f2db740a700 1 -- 172.21.15.37:0/3264237947 shutdown_connections 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.475+0000 7f2db740a700 1 -- 172.21.15.37:0/3264237947 wait complete. 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.475+0000 7f2db740a700 1 Processor -- start 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.475+0000 7f2db740a700 1 -- start start 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db740a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db740a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2db0107df0 0x7f2db019d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db740a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0108740 0x7f2db01a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db740a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01166c0 con 0x7f2db01034c0 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db740a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0116840 con 0x7f2db0108740 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db740a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01169c0 con 0x7f2db0107df0 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db019d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41462/0 (socket says 172.21.15.37:41462) 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db51a6700 1 -- 172.21.15.37:0/708903611 learned_addr learned my addr 172.21.15.37:0/708903611 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:55.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.476+0000 7f2db49a5700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2db0107df0 0x7f2db019d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.477+0000 7f2db51a6700 1 -- 172.21.15.37:0/708903611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2db0107df0 msgr2=0x7f2db019d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.477+0000 7f2db51a6700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2db0107df0 0x7f2db019d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.477+0000 7f2db51a6700 1 -- 172.21.15.37:0/708903611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0108740 msgr2=0x7f2db01a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.477+0000 7f2db51a6700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0108740 0x7f2db01a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.477+0000 7f2db51a6700 1 -- 172.21.15.37:0/708903611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db01a2120 con 0x7f2db01034c0 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.477+0000 7f2db51a6700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db019d250 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009810 tx=0x7f2dac00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.477+0000 7f2da67fc700 1 -- 172.21.15.37:0/708903611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00bde0 con 0x7f2db01034c0 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.478+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db01a23b0 con 0x7f2db01034c0 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.478+0000 7f2da67fc700 1 -- 172.21.15.37:0/708903611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dac0055c0 con 0x7f2db01034c0 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.478+0000 7f2da67fc700 1 -- 172.21.15.37:0/708903611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac017400 con 0x7f2db01034c0 2024-05-09T01:06:55.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.478+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db01a9d30 con 0x7f2db01034c0 2024-05-09T01:06:55.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.481+0000 7f2da67fc700 1 -- 172.21.15.37:0/708903611 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2dac003710 con 0x7f2db01034c0 2024-05-09T01:06:55.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.483+0000 7f2da67fc700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2d9c0b2880 0x7f2d9c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.484+0000 7f2da67fc700 1 -- 172.21.15.37:0/708903611 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2dac0e3430 con 0x7f2db01034c0 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2db49a5700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2d9c0b2880 0x7f2d9c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 Processor -- start 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 -- start start 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a452d00 0x55e24a563a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a3d84a0 0x55e24a563f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a55e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e24a4780a0 con 0x55e24a452d00 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a452d00 0x55e24a563a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a452d00 0x55e24a563a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41468/0 (socket says 172.21.15.37:41468) 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2db51a6700 1 -- 172.21.15.37:0/2196818000 learned_addr learned my addr 172.21.15.37:0/2196818000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2db59a7700 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a55e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2196818000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e24a41d9a0 con 0x55e24a3d84a0 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a3d84a0 0x55e24a563f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.485+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2196818000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e24a474060 con 0x55e24a55dc10 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.486+0000 7f2db49a5700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2d9c0b2880 0x7f2d9c0b4d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2da0005950 tx=0x7f2da000f640 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.486+0000 7f2db49a5700 1 -- 172.21.15.37:0/2196818000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 msgr2=0x55e24a55e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.486+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a55e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.486+0000 7f2db49a5700 1 -- 172.21.15.37:0/2196818000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a452d00 msgr2=0x55e24a563a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.486+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a452d00 0x55e24a563a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.486+0000 7f2db49a5700 1 -- 172.21.15.37:0/2196818000 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24a40e500 con 0x55e24a3d84a0 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.486+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a3d84a0 0x55e24a563f90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2db006b800 tx=0x7f2da001a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7392e79d94fe4ad2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:55.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.487+0000 7f2d9b7fe700 1 -- 172.21.15.37:0/2196818000 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0012d30 con 0x55e24a3d84a0 2024-05-09T01:06:55.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.487+0000 7f2d9b7fe700 1 -- 172.21.15.37:0/2196818000 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2da001d8d0 con 0x55e24a3d84a0 2024-05-09T01:06:55.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.487+0000 7f2d9b7fe700 1 -- 172.21.15.37:0/2196818000 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0010630 con 0x55e24a3d84a0 2024-05-09T01:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2196818000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a3d84a0 msgr2=0x55e24a563f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a3d84a0 0x55e24a563f90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2db006b800 tx=0x7f2da001a000 comp rx=0 tx=0).stop 2024-05-09T01:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2196818000 shutdown_connections 2024-05-09T01:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a55e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a452d00 0x55e24a563a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2196818000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a3d84a0 0x55e24a563f90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2196818000 >> 172.21.15.37:0/2196818000 conn(0x55e24a3dbf70 msgr2=0x55e24a550220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2196818000 shutdown_connections 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.488+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2196818000 wait complete. 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.489+0000 7f2dc5e20b80 1 -- start start 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.489+0000 7f2dc5e20b80 1 Processor -- start 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.489+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a3d84a0 0x55e24a567780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.489+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a567cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.489+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a3d84a0 0x55e24a567780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.489+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a568200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2dc5e20b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e24a55e970 con 0x55e24a3d84a0 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2dc5e20b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e24a412b20 con 0x55e24a452d00 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2dc5e20b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e24a56a830 con 0x55e24a55dc10 2024-05-09T01:06:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a3d84a0 0x55e24a567780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41474/0 (socket says 172.21.15.37:41474) 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 -- 172.21.15.37:0/2920080991 learned_addr learned my addr 172.21.15.37:0/2920080991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2dc5e20b80 10 client.0 _ll_register_callbacks cb 0x55e24a2e96c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a567cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db59a7700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a568200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 -- 172.21.15.37:0/2920080991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 msgr2=0x55e24a568200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a568200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 -- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 msgr2=0x55e24a567cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a567cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 -- 172.21.15.37:0/2920080991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e24a2f3490 con 0x55e24a3d84a0 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db59a7700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a568200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a567cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2db51a6700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a3d84a0 0x55e24a567780 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00bfe0 tx=0x7f2dac005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf39b3e26dbe4c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2d98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2920080991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0aa690 con 0x55e24a3d84a0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.490+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2da001d8d0 con 0x55e24a3d84a0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.491+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2920080991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2dac009490 con 0x55e24a3d84a0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.491+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2920080991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2dac0ab280 con 0x55e24a3d84a0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.491+0000 7f2dc5e20b80 10 client.16011 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.491+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e24a575170 con 0x55e24a3d84a0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2920080991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2da001d8d0 con 0x55e24a3d84a0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2920080991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f2dac0b34c0 con 0x55e24a3d84a0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2dc5e20b80 10 client.16011 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2dc5e20b80 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2dc5e20b80 20 client.16011 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a579c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2dc5e20b80 4 client.16011 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e24a485a80 con 0x55e24a577730 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.492+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a579c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.493+0000 7f2d98ff9700 10 client.16011 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:55.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.493+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a579c00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15d9dc704cc7a216 server_cookie=abb1688d6a040c in_seq=0 out_seq=0 2024-05-09T01:06:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2920080991 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e24a485a80 con 0x55e24a577730 2024-05-09T01:06:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2d98ff9700 10 client.16011 handle_command_reply: tid=0 2024-05-09T01:06:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 client.16011 shutdown 2024-05-09T01:06:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a3d84a0 msgr2=0x55e24a567780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a3d84a0 0x55e24a567780 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00bfe0 tx=0x7f2dac005960 comp rx=0 tx=0).stop 2024-05-09T01:06:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 shutdown_connections 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a579c00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a55dc10 0x55e24a568200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2d98ff9700 0 client.16011 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a3d84a0 0x55e24a567780 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2920080991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a567cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 >> 172.21.15.37:0/2920080991 conn(0x55e24a3dbf70 msgr2=0x55e24a549ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 shutdown_connections 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2920080991 wait complete. 2024-05-09T01:06:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.494+0000 7f2dc5e20b80 20 client.16011 trim_cache size 0 max 16384 2024-05-09T01:06:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 Processor -- start 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 -- start start 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a54aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a566a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a55d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01ac890 con 0x55e24a55dc10 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01ae400 con 0x55e24a452d00 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2dc5e20b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01acf60 con 0x55e24a3d84a0 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2db59a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a55d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2db49a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a566a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2db59a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a55d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41486/0 (socket says 172.21.15.37:41486) 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2db49a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a566a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59384/0 (socket says 172.21.15.37:59384) 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.527+0000 7f2db59a7700 1 -- 172.21.15.37:0/1087732655 learned_addr learned my addr 172.21.15.37:0/1087732655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:55.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.528+0000 7f2db59a7700 1 -- 172.21.15.37:0/1087732655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 msgr2=0x55e24a54aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.528+0000 7f2db59a7700 1 --2- 172.21.15.37:0/1087732655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a54aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.528+0000 7f2db59a7700 1 -- 172.21.15.37:0/1087732655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 msgr2=0x55e24a566a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.528+0000 7f2db59a7700 1 --2- 172.21.15.37:0/1087732655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a566a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.528+0000 7f2db59a7700 1 -- 172.21.15.37:0/1087732655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24a54c9d0 con 0x55e24a55dc10 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.528+0000 7f2db59a7700 1 --2- 172.21.15.37:0/1087732655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a55d310 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009bf0 tx=0x7f2da8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69335ceb3166d115 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.530+0000 7f2d9affd700 1 -- 172.21.15.37:0/1087732655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8033040 con 0x55e24a55dc10 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.530+0000 7f2d9affd700 1 -- 172.21.15.37:0/1087732655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2da803c070 con 0x55e24a55dc10 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.530+0000 7f2d9affd700 1 -- 172.21.15.37:0/1087732655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8036390 con 0x55e24a55dc10 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.534+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/1087732655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 msgr2=0x55e24a55d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.534+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/1087732655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a55d310 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009bf0 tx=0x7f2da8009040 comp rx=0 tx=0).stop 2024-05-09T01:06:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.540+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/1087732655 shutdown_connections 2024-05-09T01:06:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.540+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/1087732655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a55d310 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.541+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/1087732655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a54aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.541+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/1087732655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a566a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.541+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/1087732655 >> 172.21.15.37:0/1087732655 conn(0x55e24a3dbf70 msgr2=0x55e24a55cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.542+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/1087732655 shutdown_connections 2024-05-09T01:06:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.542+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/1087732655 wait complete. 2024-05-09T01:06:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.542+0000 7f2dc5e20b80 1 -- start start 2024-05-09T01:06:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.543+0000 7f2dc5e20b80 1 Processor -- start 2024-05-09T01:06:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a56f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a56ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2dc5e20b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a56c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a56f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2db51a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a56f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39374/0 (socket says 172.21.15.37:39374) 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2db49a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a56ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2db49a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a56ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59394/0 (socket says 172.21.15.37:59394) 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.544+0000 7f2db51a6700 1 -- 172.21.15.37:0/2687349075 learned_addr learned my addr 172.21.15.37:0/2687349075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.545+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01add30 con 0x55e24a55dc10 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.545+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2db01ad630 con 0x55e24a452d00 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.545+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0115df0 con 0x55e24a3d84a0 2024-05-09T01:06:55.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.545+0000 7f2dc5e20b80 10 client.0 _ll_register_callbacks cb 0x55e24a2e96c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.546+0000 7f2db59a7700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a56c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.547+0000 7f2db59a7700 1 -- 172.21.15.37:0/2687349075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 msgr2=0x55e24a56f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.547+0000 7f2db59a7700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a56f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.547+0000 7f2db59a7700 1 -- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 msgr2=0x55e24a56ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.547+0000 7f2db59a7700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a56ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.547+0000 7f2db59a7700 1 -- 172.21.15.37:0/2687349075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e24a56d0c0 con 0x55e24a55dc10 2024-05-09T01:06:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.548+0000 7f2db59a7700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a56c9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009bf0 tx=0x7f2da8037710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e018cda8f86c6435 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:55.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.548+0000 7f2d98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:55.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.549+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2687349075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8044070 con 0x55e24a55dc10 2024-05-09T01:06:55.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.549+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2687349075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2da8004cd0 con 0x55e24a55dc10 2024-05-09T01:06:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.552+0000 7f2db51a6700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a56f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.552+0000 7f2db49a5700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a56ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:06:55.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.552+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2da803c070 con 0x55e24a55dc10 2024-05-09T01:06:55.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.559+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2687349075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f2da8005020 con 0x55e24a55dc10 2024-05-09T01:06:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.560+0000 7f2dc5e20b80 10 client.16017 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:55.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.560+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55e24a5e28f0 con 0x55e24a55dc10 2024-05-09T01:06:55.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.563+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2687349075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2da8005670 con 0x55e24a55dc10 2024-05-09T01:06:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.563+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2687349075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f2da8036070 con 0x55e24a55dc10 2024-05-09T01:06:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.563+0000 7f2dc5e20b80 10 client.16017 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.563+0000 7f2dc5e20b80 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:55.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.563+0000 7f2dc5e20b80 20 client.16017 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.563+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a5e4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.564+0000 7f2dc5e20b80 4 client.16017 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:06:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.564+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f2da803c070 con 0x55e24a577730 2024-05-09T01:06:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.564+0000 7f2db51a6700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a5e4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.565+0000 7f2db51a6700 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a5e4ef0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3da2c7921d58ba6 server_cookie=9f4ca96a46dce73b in_seq=0 out_seq=0 2024-05-09T01:06:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.565+0000 7f2d98ff9700 10 client.16017 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.566+0000 7f2d98ff9700 1 -- 172.21.15.37:0/2687349075 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f2da803c070 con 0x55e24a577730 2024-05-09T01:06:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.566+0000 7f2d98ff9700 10 client.16017 handle_command_reply: tid=0 2024-05-09T01:06:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.566+0000 7f2dc5e20b80 1 client.16017 shutdown 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.566+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 msgr2=0x55e24a56c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.566+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a56c9c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009bf0 tx=0x7f2da8037710 comp rx=0 tx=0).stop 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 shutdown_connections 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e24a577730 0x55e24a5e4ef0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24a55dc10 0x55e24a56c9c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e24a3d84a0 0x55e24a56f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2d98ff9700 0 client.16017 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2dc5e20b80 1 --2- 172.21.15.37:0/2687349075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e24a452d00 0x55e24a56ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 >> 172.21.15.37:0/2687349075 conn(0x55e24a3dbf70 msgr2=0x55e24a54a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.567+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 shutdown_connections 2024-05-09T01:06:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.568+0000 7f2dc5e20b80 1 -- 172.21.15.37:0/2687349075 wait complete. 2024-05-09T01:06:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.568+0000 7f2dc5e20b80 20 client.16017 trim_cache size 0 max 16384 2024-05-09T01:06:55.571 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:06:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:06:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:06:55.571 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:06:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.571+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2d9c0b2880 msgr2=0x7f2d9c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.571+0000 7f2db740a700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2d9c0b2880 0x7f2d9c0b4d90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2da0005950 tx=0x7f2da000f640 comp rx=0 tx=0).stop 2024-05-09T01:06:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 msgr2=0x7f2db019d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db019d250 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009810 tx=0x7f2dac00b840 comp rx=0 tx=0).stop 2024-05-09T01:06:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 shutdown_connections 2024-05-09T01:06:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2d9c0b2880 0x7f2d9c0b4d90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2db0108740 0x7f2db01a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db01034c0 0x7f2db019d250 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 --2- 172.21.15.37:0/708903611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2db0107df0 0x7f2db019d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 >> 172.21.15.37:0/708903611 conn(0x7f2db00fedc0 msgr2=0x7f2db0111130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.572+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 shutdown_connections 2024-05-09T01:06:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:55.573+0000 7f2db740a700 1 -- 172.21.15.37:0/708903611 wait complete. 2024-05-09T01:06:56.381 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:06:56.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:06:56.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:56 smithi037 ceph-mon[30122]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 798 op/s 2024-05-09T01:06:56.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:56 smithi151 ceph-mon[34780]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 798 op/s 2024-05-09T01:06:56.744 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:06:56.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:56 smithi136 ceph-mon[34110]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 798 op/s 2024-05-09T01:06:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.387+0000 7f92ef205640 1 -- 172.21.15.37:0/2597451527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 msgr2=0x7f92e81049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.387+0000 7f92ef205640 1 --2- 172.21.15.37:0/2597451527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e81049e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009900 tx=0x7f92dc02a410 comp rx=0 tx=0).stop 2024-05-09T01:06:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.388+0000 7f92ef205640 1 -- 172.21.15.37:0/2597451527 shutdown_connections 2024-05-09T01:06:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.388+0000 7f92ef205640 1 --2- 172.21.15.37:0/2597451527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8109c20 0x7f92e810c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.388+0000 7f92ef205640 1 --2- 172.21.15.37:0/2597451527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8104f20 0x7f92e8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.388+0000 7f92ef205640 1 --2- 172.21.15.37:0/2597451527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e81049e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.388+0000 7f92ef205640 1 -- 172.21.15.37:0/2597451527 >> 172.21.15.37:0/2597451527 conn(0x7f92e80feed0 msgr2=0x7f92e8101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:57.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.388+0000 7f92ef205640 1 -- 172.21.15.37:0/2597451527 shutdown_connections 2024-05-09T01:06:57.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.389+0000 7f92ef205640 1 -- 172.21.15.37:0/2597451527 wait complete. 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.389+0000 7f92ef205640 1 Processor -- start 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.389+0000 7f92ef205640 1 -- start start 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ef205640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ef205640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8104f20 0x7f92e819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ef205640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8109c20 0x7f92e81a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ef205640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92e810f770 con 0x7f92e8103ce0 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ef205640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92e810f5f0 con 0x7f92e8109c20 2024-05-09T01:06:57.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ef205640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92e810f8f0 con 0x7f92e8104f20 2024-05-09T01:06:57.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ecfa1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ed7a2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8109c20 0x7f92e81a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ecfa1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e819a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41506/0 (socket says 172.21.15.37:41506) 2024-05-09T01:06:57.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ecfa1640 1 -- 172.21.15.37:0/3603477745 learned_addr learned my addr 172.21.15.37:0/3603477745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:57.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92e7fff640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8104f20 0x7f92e819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ecfa1640 1 -- 172.21.15.37:0/3603477745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8104f20 msgr2=0x7f92e819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8104f20 0x7f92e819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ecfa1640 1 -- 172.21.15.37:0/3603477745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8109c20 msgr2=0x7f92e81a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.390+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8109c20 0x7f92e81a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.391+0000 7f92ecfa1640 1 -- 172.21.15.37:0/3603477745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e81a1ee0 con 0x7f92e8103ce0 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.391+0000 7f92e7fff640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8104f20 0x7f92e819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.391+0000 7f92ed7a2640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8109c20 0x7f92e81a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.391+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e819a3a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f92dc006010 tx=0x7f92dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:57.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.391+0000 7f92e5ffb640 1 -- 172.21.15.37:0/3603477745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc03f030 con 0x7f92e8103ce0 2024-05-09T01:06:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.391+0000 7f92e5ffb640 1 -- 172.21.15.37:0/3603477745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92dc031910 con 0x7f92e8103ce0 2024-05-09T01:06:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.391+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e81a2170 con 0x7f92e8103ce0 2024-05-09T01:06:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.392+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e81a2660 con 0x7f92e8103ce0 2024-05-09T01:06:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.393+0000 7f92e5ffb640 1 -- 172.21.15.37:0/3603477745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc03f030 con 0x7f92e8103ce0 2024-05-09T01:06:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 Processor -- start 2024-05-09T01:06:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 -- start start 2024-05-09T01:06:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a2e1b0 0x562a09dd6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a052f0 0x562a09dd6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a0d4d0 0x562a09dddd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562a09d367c0 con 0x562a09a2e1b0 2024-05-09T01:06:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562a09cd20e0 con 0x562a09a0d4d0 2024-05-09T01:06:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92f6192740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562a09d32780 con 0x562a09a052f0 2024-05-09T01:06:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92ed7a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a2e1b0 0x562a09dd6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92ed7a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a2e1b0 0x562a09dd6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41522/0 (socket says 172.21.15.37:41522) 2024-05-09T01:06:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92ed7a2640 1 -- 172.21.15.37:0/2217898978 learned_addr learned my addr 172.21.15.37:0/2217898978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:57.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.395+0000 7f92e7fff640 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a0d4d0 0x562a09dddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92e7fff640 1 -- 172.21.15.37:0/2217898978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a052f0 msgr2=0x562a09dd6e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92e7fff640 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a052f0 0x562a09dd6e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92e7fff640 1 -- 172.21.15.37:0/2217898978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a2e1b0 msgr2=0x562a09dd6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92e7fff640 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a2e1b0 0x562a09dd6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92e7fff640 1 -- 172.21.15.37:0/2217898978 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a09cfb7c0 con 0x562a09a0d4d0 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92e7fff640 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a0d4d0 0x562a09dddd90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009fa0 tx=0x7f92d40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d4940b0b37c9a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92e5ffb640 1 -- 172.21.15.37:0/3603477745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f92dc042030 con 0x7f92e8103ce0 2024-05-09T01:06:57.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92d2ffd640 1 -- 172.21.15.37:0/2217898978 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d40040f0 con 0x562a09a0d4d0 2024-05-09T01:06:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92d2ffd640 1 -- 172.21.15.37:0/2217898978 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92d40054d0 con 0x562a09a0d4d0 2024-05-09T01:06:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.396+0000 7f92d2ffd640 1 -- 172.21.15.37:0/2217898978 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d4004d90 con 0x562a09a0d4d0 2024-05-09T01:06:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.397+0000 7f92e5ffb640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d80b29d0 0x7f92d80b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.398+0000 7f92f6192740 1 -- 172.21.15.37:0/2217898978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a0d4d0 msgr2=0x562a09dddd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.398+0000 7f92f6192740 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a0d4d0 0x562a09dddd90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009fa0 tx=0x7f92d40118d0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.398+0000 7f92e5ffb640 1 -- 172.21.15.37:0/3603477745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f92dc102060 con 0x7f92e8103ce0 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.398+0000 7f92ed7a2640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d80b29d0 0x7f92d80b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.399+0000 7f92f6192740 1 -- 172.21.15.37:0/2217898978 shutdown_connections 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.399+0000 7f92f6192740 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a0d4d0 0x562a09dddd90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.399+0000 7f92f6192740 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a052f0 0x562a09dd6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.399+0000 7f92f6192740 1 --2- 172.21.15.37:0/2217898978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a2e1b0 0x562a09dd6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.399+0000 7f92f6192740 1 -- 172.21.15.37:0/2217898978 >> 172.21.15.37:0/2217898978 conn(0x562a09a22300 msgr2=0x562a09dcde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.399+0000 7f92f6192740 1 -- 172.21.15.37:0/2217898978 shutdown_connections 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.399+0000 7f92f6192740 1 -- 172.21.15.37:0/2217898978 wait complete. 2024-05-09T01:06:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.400+0000 7f92f6192740 1 -- start start 2024-05-09T01:06:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.400+0000 7f92ed7a2640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d80b29d0 0x7f92d80b4ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x562a09dd7ae0 tx=0x7f92e0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.400+0000 7f92f6192740 1 Processor -- start 2024-05-09T01:06:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92f6192740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92f6192740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92f6192740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a2e1b0 0x562a09de7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92f6192740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562a09dde7e0 con 0x562a09a0d4d0 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92f6192740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562a09cbd9c0 con 0x562a09a052f0 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92f6192740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562a09dde960 con 0x562a09a2e1b0 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92f6192740 10 client.0 _ll_register_callbacks cb 0x562a09cea020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41526/0 (socket says 172.21.15.37:41526) 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 -- 172.21.15.37:0/669309861 learned_addr learned my addr 172.21.15.37:0/669309861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92ed7a2640 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a2e1b0 0x562a09de7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 -- 172.21.15.37:0/669309861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a2e1b0 msgr2=0x562a09de7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a2e1b0 0x562a09de7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 -- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 msgr2=0x562a09de06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.401+0000 7f92e7fff640 1 -- 172.21.15.37:0/669309861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a09ce41f0 con 0x562a09a0d4d0 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92e7fff640 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de0c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92d4004630 tx=0x7f92d4004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84a8062853ee1e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92c7fff640 1 -- 172.21.15.37:0/669309861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d4028020 con 0x562a09a0d4d0 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92c7fff640 1 -- 172.21.15.37:0/669309861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f92d4005140 con 0x562a09a0d4d0 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92d40054d0 con 0x562a09a0d4d0 2024-05-09T01:06:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92c7fff640 1 -- 172.21.15.37:0/669309861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f92d401d070 con 0x562a09a0d4d0 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92f6192740 10 client.16029 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.402+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562a09a99790 con 0x562a09a0d4d0 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92c7fff640 1 -- 172.21.15.37:0/669309861 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92d40054d0 con 0x562a09a0d4d0 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92c7fff640 1 -- 172.21.15.37:0/669309861 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f92d400f4e0 con 0x562a09a0d4d0 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92f6192740 10 client.16029 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92f6192740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92f6192740 20 client.16029 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92f6192740 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a099ecd80 0x562a09deddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92f6192740 4 client.16029 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.403+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a09d443d0 con 0x562a099ecd80 2024-05-09T01:06:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.404+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a099ecd80 0x562a09deddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.404+0000 7f92c7fff640 10 client.16029 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.404+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a099ecd80 0x562a09deddd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2412255d365e0c2e server_cookie=dfd19c01f56f94a6 in_seq=0 out_seq=0 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92c7fff640 1 -- 172.21.15.37:0/669309861 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562a09d443d0 con 0x562a099ecd80 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92c7fff640 10 client.16029 handle_command_reply: tid=0 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 client.16029 shutdown 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 msgr2=0x562a09de0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de0c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92d4004630 tx=0x7f92d4004d40 comp rx=0 tx=0).stop 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 shutdown_connections 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a099ecd80 0x562a09deddd0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a2e1b0 0x562a09de7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de0c20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92c7fff640 0 client.16029 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 --2- 172.21.15.37:0/669309861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 >> 172.21.15.37:0/669309861 conn(0x562a09a22300 msgr2=0x562a09dd0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.405+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 shutdown_connections 2024-05-09T01:06:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.406+0000 7f92f6192740 1 -- 172.21.15.37:0/669309861 wait complete. 2024-05-09T01:06:57.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.406+0000 7f92f6192740 20 client.16029 trim_cache size 0 max 16384 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92f6192740 1 Processor -- start 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92f6192740 1 -- start start 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92f6192740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09dd6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92f6192740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09dcc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92f6192740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09dccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92f6192740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81a90e0 con 0x562a09a0d4d0 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92f6192740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81aac50 con 0x562a09a052f0 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92ed7a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09dccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92e7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09dcc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.444+0000 7f92e7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09dcc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59456/0 (socket says 172.21.15.37:59456) 2024-05-09T01:06:57.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ed7a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09dccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41540/0 (socket says 172.21.15.37:41540) 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92e7fff640 1 -- 172.21.15.37:0/2048391872 learned_addr learned my addr 172.21.15.37:0/2048391872 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92f6192740 1 -- 172.21.15.37:0/2048391872 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81a97b0 con 0x562a09a22300 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09dd6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ecfa1640 1 -- 172.21.15.37:0/2048391872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 msgr2=0x562a09dcc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09dcc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ecfa1640 1 -- 172.21.15.37:0/2048391872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 msgr2=0x562a09dccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09dccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ecfa1640 1 -- 172.21.15.37:0/2048391872 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a09b105f0 con 0x562a09a22300 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ed7a2640 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09dccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09dd6030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0ffc50 tx=0x7f92dc03b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e41da0b91d0e65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92d27fc640 1 -- 172.21.15.37:0/2048391872 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc035040 con 0x562a09a22300 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92d27fc640 1 -- 172.21.15.37:0/2048391872 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92dc0d0e50 con 0x562a09a22300 2024-05-09T01:06:57.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.445+0000 7f92d27fc640 1 -- 172.21.15.37:0/2048391872 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc049040 con 0x562a09a22300 2024-05-09T01:06:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.447+0000 7f92f6192740 1 -- 172.21.15.37:0/2048391872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 msgr2=0x562a09dd6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.447+0000 7f92f6192740 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09dd6030 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0ffc50 tx=0x7f92dc03b460 comp rx=0 tx=0).stop 2024-05-09T01:06:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.448+0000 7f92f6192740 1 -- 172.21.15.37:0/2048391872 shutdown_connections 2024-05-09T01:06:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.448+0000 7f92f6192740 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09dccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.448+0000 7f92f6192740 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09dcc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.448+0000 7f92f6192740 1 --2- 172.21.15.37:0/2048391872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09dd6030 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.448+0000 7f92f6192740 1 -- 172.21.15.37:0/2048391872 >> 172.21.15.37:0/2048391872 conn(0x562a09ddb320 msgr2=0x562a09dcd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.449+0000 7f92f6192740 1 -- 172.21.15.37:0/2048391872 shutdown_connections 2024-05-09T01:06:57.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.449+0000 7f92f6192740 1 -- 172.21.15.37:0/2048391872 wait complete. 2024-05-09T01:06:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.450+0000 7f92f6192740 1 -- start start 2024-05-09T01:06:57.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.450+0000 7f92f6192740 1 Processor -- start 2024-05-09T01:06:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92f6192740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92f6192740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92f6192740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09e58940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41552/0 (socket says 172.21.15.37:41552) 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92ecfa1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92ecfa1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59470/0 (socket says 172.21.15.37:59470) 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92ecfa1640 1 -- 172.21.15.37:0/1912581863 learned_addr learned my addr 172.21.15.37:0/1912581863 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81aa580 con 0x562a09a0d4d0 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81a9e80 con 0x562a09a052f0 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92ed7a2640 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09e58940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92e81a70c0 con 0x562a09a22300 2024-05-09T01:06:57.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.451+0000 7f92f6192740 10 client.0 _ll_register_callbacks cb 0x7f92e0009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:06:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92e7fff640 1 -- 172.21.15.37:0/1912581863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 msgr2=0x562a09e58940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92e7fff640 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09e58940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92e7fff640 1 -- 172.21.15.37:0/1912581863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 msgr2=0x562a09de3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92e7fff640 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92e7fff640 1 -- 172.21.15.37:0/1912581863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a09cfaed0 con 0x562a09a0d4d0 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92e7fff640 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de61a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x562a09de0f10 tx=0x7f92d400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae92304945218f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.452+0000 7f92c7fff640 1 -- 172.21.15.37:0/1912581863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d403d060 con 0x562a09a0d4d0 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.453+0000 7f92c7fff640 1 -- 172.21.15.37:0/1912581863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f92d4004400 con 0x562a09a0d4d0 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.453+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92dc0d0e50 con 0x562a09a0d4d0 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.453+0000 7f92c7fff640 1 -- 172.21.15.37:0/1912581863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f92d4028040 con 0x562a09a0d4d0 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 10 client.16035 fetch_fsmap learned FSMap version 38 2024-05-09T01:06:57.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562a09e5a0d0 con 0x562a09a0d4d0 2024-05-09T01:06:57.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92c7fff640 1 -- 172.21.15.37:0/1912581863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92d401e040 con 0x562a09a0d4d0 2024-05-09T01:06:57.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92c7fff640 1 -- 172.21.15.37:0/1912581863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f92d4036030 con 0x562a09a0d4d0 2024-05-09T01:06:57.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 10 client.16035 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:06:57.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:06:57.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 20 client.16035 populate_metadata read hostname 'smithi037' 2024-05-09T01:06:57.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a09a2e1b0 0x562a09e5cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:57.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 4 client.16035 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:06:57.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f92dc0d0e50 con 0x562a09a2e1b0 2024-05-09T01:06:57.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.454+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a09a2e1b0 0x562a09e5cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:57.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.455+0000 7f92c7fff640 10 client.16035 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:57.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.455+0000 7f92ecfa1640 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a09a2e1b0 0x562a09e5cac0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae3a5684374b421 server_cookie=dfa156d8b4179b9b in_seq=0 out_seq=0 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92c7fff640 1 -- 172.21.15.37:0/1912581863 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f92dc0d0e50 con 0x562a09a2e1b0 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92c7fff640 10 client.16035 handle_command_reply: tid=0 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 client.16035 shutdown 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 msgr2=0x562a09de61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de61a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x562a09de0f10 tx=0x7f92d400f710 comp rx=0 tx=0).stop 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 shutdown_connections 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562a09a2e1b0 0x562a09e5cac0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a09a22300 0x562a09e58940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92c7fff640 0 client.16035 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:06:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562a09a0d4d0 0x562a09de61a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 --2- 172.21.15.37:0/1912581863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562a09a052f0 0x562a09de3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.464+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 >> 172.21.15.37:0/1912581863 conn(0x562a09ddb320 msgr2=0x562a09dd0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.465+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 shutdown_connections 2024-05-09T01:06:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.465+0000 7f92f6192740 1 -- 172.21.15.37:0/1912581863 wait complete. 2024-05-09T01:06:57.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.465+0000 7f92f6192740 20 client.16035 trim_cache size 0 max 16384 2024-05-09T01:06:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:06:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:06:57.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d80b29d0 msgr2=0x7f92d80b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d80b29d0 0x7f92d80b4ee0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x562a09dd7ae0 tx=0x7f92e0009500 comp rx=0 tx=0).stop 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 msgr2=0x7f92e819a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e819a3a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f92dc006010 tx=0x7f92dc004270 comp rx=0 tx=0).stop 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 shutdown_connections 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d80b29d0 0x7f92d80b4ee0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8109c20 0x7f92e81a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8104f20 0x7f92e819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 --2- 172.21.15.37:0/3603477745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e8103ce0 0x7f92e819a3a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 >> 172.21.15.37:0/3603477745 conn(0x7f92e80feed0 msgr2=0x7f92e8105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 shutdown_connections 2024-05-09T01:06:57.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:06:57.466+0000 7f92ef205640 1 -- 172.21.15.37:0/3603477745 wait complete. 2024-05-09T01:06:58.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:58 smithi037 ceph-mon[30122]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 731 op/s 2024-05-09T01:06:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 -- 172.21.15.37:0/3588628083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 msgr2=0x7fa3d8111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3588628083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d8111120 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009990 tx=0x7fa3d0009ca0 comp rx=0 tx=0).stop 2024-05-09T01:06:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 -- 172.21.15.37:0/3588628083 shutdown_connections 2024-05-09T01:06:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3588628083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d8111120 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3588628083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d810a3e0 0x7fa3d810a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3588628083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d81027e0 0x7fa3d8102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 -- 172.21.15.37:0/3588628083 >> 172.21.15.37:0/3588628083 conn(0x7fa3d80fe6f0 msgr2=0x7fa3d8100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 -- 172.21.15.37:0/3588628083 shutdown_connections 2024-05-09T01:06:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.636+0000 7fa3df79b700 1 -- 172.21.15.37:0/3588628083 wait complete. 2024-05-09T01:06:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 Processor -- start 2024-05-09T01:06:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 -- start start 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d81027e0 0x7fa3d819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d810a3e0 0x7fa3d8198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d81122e0 con 0x7fa3d8103130 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8112160 con 0x7fa3d81027e0 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3df79b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d8112460 con 0x7fa3d810a3e0 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3dcd36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3dd537700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d81027e0 0x7fa3d819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3dcd36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41566/0 (socket says 172.21.15.37:41566) 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.637+0000 7fa3ddd38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d810a3e0 0x7fa3d8198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dcd36700 1 -- 172.21.15.37:0/3396676820 learned_addr learned my addr 172.21.15.37:0/3396676820 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dcd36700 1 -- 172.21.15.37:0/3396676820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d810a3e0 msgr2=0x7fa3d8198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dcd36700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d810a3e0 0x7fa3d8198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dcd36700 1 -- 172.21.15.37:0/3396676820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d81027e0 msgr2=0x7fa3d819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dcd36700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d81027e0 0x7fa3d819e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dcd36700 1 -- 172.21.15.37:0/3396676820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d81990b0 con 0x7fa3d8103130 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dd537700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d81027e0 0x7fa3d819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3dcd36700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d819ecd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800d980 tx=0x7fa3c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3ce7fc700 1 -- 172.21.15.37:0/3396676820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8017070 con 0x7fa3d8103130 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3ce7fc700 1 -- 172.21.15.37:0/3396676820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3c8009de0 con 0x7fa3d8103130 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.638+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d81993a0 con 0x7fa3d8103130 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.639+0000 7fa3ce7fc700 1 -- 172.21.15.37:0/3396676820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800f3c0 con 0x7fa3d8103130 2024-05-09T01:06:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.639+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d81a5620 con 0x7fa3d8103130 2024-05-09T01:06:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.641+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d80512c0 con 0x7fa3d8103130 2024-05-09T01:06:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.644+0000 7fa3ce7fc700 1 -- 172.21.15.37:0/3396676820 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa3c8009930 con 0x7fa3d8103130 2024-05-09T01:06:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.645+0000 7fa3ce7fc700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa3c40b6d10 0x7fa3c40b9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:06:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.645+0000 7fa3dd537700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa3c40b6d10 0x7fa3c40b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:06:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.645+0000 7fa3ce7fc700 1 -- 172.21.15.37:0/3396676820 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa3c80e1c70 con 0x7fa3d8103130 2024-05-09T01:06:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.645+0000 7fa3dd537700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa3c40b6d10 0x7fa3c40b9220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8101db0 tx=0x7fa3d400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:06:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:58.650+0000 7fa3ce7fc700 1 -- 172.21.15.37:0/3396676820 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa3c80a9a10 con 0x7fa3d8103130 2024-05-09T01:06:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:58 smithi151 ceph-mon[34780]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 731 op/s 2024-05-09T01:06:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:58 smithi136 ceph-mon[34110]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 MiB/s wr, 731 op/s 2024-05-09T01:06:59.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.059+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3d8199ee0 con 0x7fa3d8103130 2024-05-09T01:06:59.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.060+0000 7fa3ce7fc700 1 -- 172.21.15.37:0/3396676820 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11937 (secure 0 0 0) 0x7fa3c80a9310 con 0x7fa3d8103130 2024-05-09T01:06:59.062 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:06:59.062 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:05:27.452852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24446,24467,24445,24491,24454]},"id":1}]} 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.064+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa3c40b6d10 msgr2=0x7fa3c40b9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa3c40b6d10 0x7fa3c40b9220 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8101db0 tx=0x7fa3d400b040 comp rx=0 tx=0).stop 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 msgr2=0x7fa3d819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d819ecd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800d980 tx=0x7fa3c800dc90 comp rx=0 tx=0).stop 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 shutdown_connections 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa3c40b6d10 0x7fa3c40b9220 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d810a3e0 0x7fa3d8198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3d81027e0 0x7fa3d819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 --2- 172.21.15.37:0/3396676820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d8103130 0x7fa3d819ecd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:06:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 >> 172.21.15.37:0/3396676820 conn(0x7fa3d80fe6f0 msgr2=0x7fa3d8100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:06:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 shutdown_connections 2024-05-09T01:06:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:06:59.065+0000 7fa3df79b700 1 -- 172.21.15.37:0/3396676820 wait complete. 2024-05-09T01:06:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2024-05-09T01:06:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:06:59 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3396676820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:06:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:06:59 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3396676820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:06:59.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:06:59 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3396676820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:06:59.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:07:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 280.0 s, 1761.0 tps, lat 57.183 ms stddev 68.756 2024-05-09T01:07:00.444 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:00 smithi151 ceph-mon[34780]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 644 op/s 2024-05-09T01:07:00.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:00 smithi037 ceph-mon[30122]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 644 op/s 2024-05-09T01:07:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:00 smithi136 ceph-mon[34110]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 644 op/s 2024-05-09T01:07:02.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:02 smithi037 ceph-mon[30122]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 790 op/s 2024-05-09T01:07:02.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:02 smithi151 ceph-mon[34780]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 790 op/s 2024-05-09T01:07:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.759+0000 7fe154c4b700 1 -- 172.21.15.37:0/1960409646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 msgr2=0x7fe150110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.759+0000 7fe154c4b700 1 --2- 172.21.15.37:0/1960409646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe150110d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe140009990 tx=0x7fe140009ca0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.760+0000 7fe154c4b700 1 -- 172.21.15.37:0/1960409646 shutdown_connections 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.760+0000 7fe154c4b700 1 --2- 172.21.15.37:0/1960409646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe15010b2e0 0x7fe150117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.760+0000 7fe154c4b700 1 --2- 172.21.15.37:0/1960409646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe150110d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.760+0000 7fe154c4b700 1 --2- 172.21.15.37:0/1960409646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15010a990 0x7fe15010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.760+0000 7fe154c4b700 1 -- 172.21.15.37:0/1960409646 >> 172.21.15.37:0/1960409646 conn(0x7fe150077c80 msgr2=0x7fe1500780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.760+0000 7fe154c4b700 1 -- 172.21.15.37:0/1960409646 shutdown_connections 2024-05-09T01:07:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.760+0000 7fe154c4b700 1 -- 172.21.15.37:0/1960409646 wait complete. 2024-05-09T01:07:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.761+0000 7fe154c4b700 1 Processor -- start 2024-05-09T01:07:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.761+0000 7fe154c4b700 1 -- start start 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.761+0000 7fe154c4b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15010a990 0x7fe1501a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.761+0000 7fe154c4b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe15010b2e0 0x7fe1501a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.761+0000 7fe154c4b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe1501a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.762+0000 7fe154c4b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe15011aac0 con 0x7fe15010b2e0 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.762+0000 7fe154c4b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe15011a940 con 0x7fe150110970 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.762+0000 7fe154c4b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe15011ac40 con 0x7fe15010a990 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.762+0000 7fe14ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe1501a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.762+0000 7fe14ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe1501a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33066/0 (socket says 172.21.15.37:33066) 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.762+0000 7fe14ed9d700 1 -- 172.21.15.37:0/3482373500 learned_addr learned my addr 172.21.15.37:0/3482373500 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.762+0000 7fe14e59c700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15010a990 0x7fe1501a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14e59c700 1 -- 172.21.15.37:0/3482373500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 msgr2=0x7fe1501a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14e59c700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe1501a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe15010b2e0 0x7fe1501a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14e59c700 1 -- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe15010b2e0 msgr2=0x7fe1501a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14e59c700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe15010b2e0 0x7fe1501a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14e59c700 1 -- 172.21.15.37:0/3482373500 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1501a6350 con 0x7fe15010a990 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe1501a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.763+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe15010b2e0 0x7fe1501a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.764+0000 7fe14e59c700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15010a990 0x7fe1501a14d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe140000c00 tx=0x7fe1400047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.764+0000 7fe13f7fe700 1 -- 172.21.15.37:0/3482373500 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140026070 con 0x7fe15010a990 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.764+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1501a65e0 con 0x7fe15010a990 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.764+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1501adf60 con 0x7fe15010a990 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.764+0000 7fe13f7fe700 1 -- 172.21.15.37:0/3482373500 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe140021410 con 0x7fe15010a990 2024-05-09T01:07:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.764+0000 7fe13f7fe700 1 -- 172.21.15.37:0/3482373500 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140017650 con 0x7fe15010a990 2024-05-09T01:07:02.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.768+0000 7fe13f7fe700 1 -- 172.21.15.37:0/3482373500 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe140009d10 con 0x7fe15010a990 2024-05-09T01:07:02.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.769+0000 7fe13f7fe700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe1380b2880 0x7fe1380b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.769+0000 7fe13f7fe700 1 -- 172.21.15.37:0/3482373500 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe1400e2d60 con 0x7fe15010a990 2024-05-09T01:07:02.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.769+0000 7fe163661b80 1 Processor -- start 2024-05-09T01:07:02.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.769+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe1380b2880 0x7fe1380b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.769+0000 7fe163661b80 1 -- start start 2024-05-09T01:07:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe163661b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b054f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe163661b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b054f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe163661b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0549810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe163661b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572b046c0a0 con 0x5572b03cc4a0 2024-05-09T01:07:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe163661b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5572b04119a0 con 0x5572b0549400 2024-05-09T01:07:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe163661b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5572b0468060 con 0x5572b0446d00 2024-05-09T01:07:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe14dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b054f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe14dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b054f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52348/0 (socket says 172.21.15.37:52348) 2024-05-09T01:07:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe14dd9b700 1 -- 172.21.15.37:0/2832865896 learned_addr learned my addr 172.21.15.37:0/2832865896 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.770+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe1380b2880 0x7fe1380b4d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe15007aff0 tx=0x7fe144009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14e59c700 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b054f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14dd9b700 1 -- 172.21.15.37:0/2832865896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 msgr2=0x5572b054f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b054f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14dd9b700 1 -- 172.21.15.37:0/2832865896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 msgr2=0x5572b0549810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0549810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0549810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14dd9b700 1 -- 172.21.15.37:0/2832865896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b0402500 con 0x5572b03cc4a0 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.771+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0549810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.772+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b054f780 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe144010c70 tx=0x7fe144013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb6353a09e86fde server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.772+0000 7fe13cff9700 1 -- 172.21.15.37:0/2832865896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144023020 con 0x5572b03cc4a0 2024-05-09T01:07:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.772+0000 7fe13cff9700 1 -- 172.21.15.37:0/2832865896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1440128e0 con 0x5572b03cc4a0 2024-05-09T01:07:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.773+0000 7fe13cff9700 1 -- 172.21.15.37:0/2832865896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144003c60 con 0x5572b03cc4a0 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 -- 172.21.15.37:0/2832865896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 msgr2=0x5572b054f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b054f780 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe144010c70 tx=0x7fe144013000 comp rx=0 tx=0).stop 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 -- 172.21.15.37:0/2832865896 shutdown_connections 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0549810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b054f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 --2- 172.21.15.37:0/2832865896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b054f780 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 -- 172.21.15.37:0/2832865896 >> 172.21.15.37:0/2832865896 conn(0x5572b03cff70 msgr2=0x5572b0544220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 -- 172.21.15.37:0/2832865896 shutdown_connections 2024-05-09T01:07:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.774+0000 7fe163661b80 1 -- 172.21.15.37:0/2832865896 wait complete. 2024-05-09T01:07:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 -- start start 2024-05-09T01:07:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 Processor -- start 2024-05-09T01:07:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b0552f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b0553470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b05539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572b054a1b0 con 0x5572b03cc4a0 2024-05-09T01:07:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5572b0406b20 con 0x5572b0549400 2024-05-09T01:07:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5572b0556020 con 0x5572b0446d00 2024-05-09T01:07:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.775+0000 7fe163661b80 10 client.0 _ll_register_callbacks cb 0x5572b02dd6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b0552f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b0552f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52364/0 (socket says 172.21.15.37:52364) 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 -- 172.21.15.37:0/3898940232 learned_addr learned my addr 172.21.15.37:0/3898940232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b05539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b0553470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 -- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 msgr2=0x5572b0553470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b0553470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 -- 172.21.15.37:0/3898940232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 msgr2=0x5572b05539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b05539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 -- 172.21.15.37:0/3898940232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b02e7490 con 0x5572b03cc4a0 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe14e59c700 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b0552f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe140021db0 tx=0x7fe1400a9cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6fa17e57e9cf7b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe135ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe135ffb700 1 -- 172.21.15.37:0/3898940232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1400c4060 con 0x5572b03cc4a0 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe135ffb700 1 -- 172.21.15.37:0/3898940232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe1400a4bd0 con 0x5572b03cc4a0 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.776+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1440128e0 con 0x5572b03cc4a0 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.777+0000 7fe135ffb700 1 -- 172.21.15.37:0/3898940232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe1400aa4b0 con 0x5572b03cc4a0 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.777+0000 7fe163661b80 10 client.16050 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.777+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5572b0560980 con 0x5572b03cc4a0 2024-05-09T01:07:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe135ffb700 1 -- 172.21.15.37:0/3898940232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1440128e0 con 0x5572b03cc4a0 2024-05-09T01:07:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe135ffb700 1 -- 172.21.15.37:0/3898940232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fe1400cb300 con 0x5572b03cc4a0 2024-05-09T01:07:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe163661b80 10 client.16050 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe163661b80 10 client.16050 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:07:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe163661b80 20 client.16050 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe163661b80 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b0562fe0 0x5572b0565450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe163661b80 4 client.16050 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.778+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b0479a80 con 0x5572b0562fe0 2024-05-09T01:07:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.779+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b0562fe0 0x5572b0565450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.780+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b0562fe0 0x5572b0565450 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=de124c5f0e626663 server_cookie=19ed3766e1ec1505 in_seq=0 out_seq=0 2024-05-09T01:07:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.780+0000 7fe135ffb700 10 client.16050 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:07:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.780+0000 7fe135ffb700 1 -- 172.21.15.37:0/3898940232 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5572b0479a80 con 0x5572b0562fe0 2024-05-09T01:07:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.780+0000 7fe135ffb700 10 client.16050 handle_command_reply: tid=0 2024-05-09T01:07:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 client.16050 shutdown 2024-05-09T01:07:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 msgr2=0x5572b0552f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b0552f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe140021db0 tx=0x7fe1400a9cf0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 shutdown_connections 2024-05-09T01:07:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b0562fe0 0x5572b0565450 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b05539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b0552f30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 --2- 172.21.15.37:0/3898940232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b0553470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 >> 172.21.15.37:0/3898940232 conn(0x5572b03cff70 msgr2=0x5572b053dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe135ffb700 0 client.16050 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:07:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 shutdown_connections 2024-05-09T01:07:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.781+0000 7fe163661b80 1 -- 172.21.15.37:0/3898940232 wait complete. 2024-05-09T01:07:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.783+0000 7fe163661b80 20 client.16050 trim_cache size 0 max 16384 2024-05-09T01:07:02.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.805+0000 7fe163661b80 1 Processor -- start 2024-05-09T01:07:02.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe163661b80 1 -- start start 2024-05-09T01:07:02.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe163661b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b03cc4a0 0x5572b0544330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe163661b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b0446d00 0x5572b0551f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe163661b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0549400 0x5572b055eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe163661b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe13000d230 con 0x5572b0446d00 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe163661b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe13000eda0 con 0x5572b03cc4a0 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe163661b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe13000d900 con 0x5572b0549400 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe14ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0549400 0x5572b055eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe14ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0549400 0x5572b055eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41654/0 (socket says 172.21.15.37:41654) 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.806+0000 7fe14ed9d700 1 -- 172.21.15.37:0/1949655428 learned_addr learned my addr 172.21.15.37:0/1949655428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b0446d00 0x5572b0551f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14e59c700 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b03cc4a0 0x5572b0544330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14ed9d700 1 -- 172.21.15.37:0/1949655428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b03cc4a0 msgr2=0x5572b0544330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b03cc4a0 0x5572b0544330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14ed9d700 1 -- 172.21.15.37:0/1949655428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b0446d00 msgr2=0x5572b0551f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b0446d00 0x5572b0551f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14ed9d700 1 -- 172.21.15.37:0/1949655428 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b05557d0 con 0x5572b0549400 2024-05-09T01:07:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b0446d00 0x5572b0551f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0549400 0x5572b055eef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe148009500 tx=0x7fe14800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d96a946962c45280 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe137fff700 1 -- 172.21.15.37:0/1949655428 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148017420 con 0x5572b0549400 2024-05-09T01:07:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe137fff700 1 -- 172.21.15.37:0/1949655428 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe14801c070 con 0x5572b0549400 2024-05-09T01:07:02.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.807+0000 7fe137fff700 1 -- 172.21.15.37:0/1949655428 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1480169f0 con 0x5572b0549400 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 -- 172.21.15.37:0/1949655428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0549400 msgr2=0x5572b055eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0549400 0x5572b055eef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe148009500 tx=0x7fe14800b040 comp rx=0 tx=0).stop 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 -- 172.21.15.37:0/1949655428 shutdown_connections 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0549400 0x5572b055eef0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b03cc4a0 0x5572b0544330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 --2- 172.21.15.37:0/1949655428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b0446d00 0x5572b0551f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 -- 172.21.15.37:0/1949655428 >> 172.21.15.37:0/1949655428 conn(0x5572b03cff70 msgr2=0x5572b0551820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.808+0000 7fe163661b80 1 -- 172.21.15.37:0/1949655428 shutdown_connections 2024-05-09T01:07:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.809+0000 7fe163661b80 1 -- 172.21.15.37:0/1949655428 wait complete. 2024-05-09T01:07:02.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.809+0000 7fe163661b80 1 -- start start 2024-05-09T01:07:02.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.809+0000 7fe163661b80 1 Processor -- start 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe163661b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b055b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe163661b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b055b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe163661b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0569f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe163661b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe13000e6d0 con 0x5572b03cc4a0 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe163661b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe13000dfd0 con 0x5572b0549400 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe163661b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe13000b1d0 con 0x5572b0446d00 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe163661b80 10 client.0 _ll_register_callbacks cb 0x5572b02dd6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe14e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b055b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe14e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b055b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52378/0 (socket says 172.21.15.37:52378) 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe14e59c700 1 -- 172.21.15.37:0/463139040 learned_addr learned my addr 172.21.15.37:0/463139040 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.810+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b055b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14ed9d700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0569f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14e59c700 1 -- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 msgr2=0x5572b055b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14e59c700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b055b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14e59c700 1 -- 172.21.15.37:0/463139040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 msgr2=0x5572b0569f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14e59c700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0569f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14e59c700 1 -- 172.21.15.37:0/463139040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b056a700 con 0x5572b03cc4a0 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b055b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.811+0000 7fe14e59c700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b055b450 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe1400a7720 tx=0x7fe1400aaab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4522a96db8b94faa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe135ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe135ffb700 1 -- 172.21.15.37:0/463139040 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1400b3280 con 0x5572b03cc4a0 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe135ffb700 1 -- 172.21.15.37:0/463139040 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe1400cb330 con 0x5572b03cc4a0 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14801c070 con 0x5572b03cc4a0 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe135ffb700 1 -- 172.21.15.37:0/463139040 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe1400ae860 con 0x5572b03cc4a0 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe163661b80 10 client.16053 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5572b05c57c0 con 0x5572b03cc4a0 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.812+0000 7fe135ffb700 1 -- 172.21.15.37:0/463139040 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1400a5e20 con 0x5572b03cc4a0 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe135ffb700 1 -- 172.21.15.37:0/463139040 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fe1400a91f0 con 0x5572b03cc4a0 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe163661b80 10 client.16053 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe163661b80 10 client.16053 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe163661b80 20 client.16053 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe163661b80 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b05c5cf0 0x5572b05c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe163661b80 4 client.16053 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe14801c070 con 0x5572b05c5cf0 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b05c5cf0 0x5572b05c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.813+0000 7fe135ffb700 10 client.16053 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.814+0000 7fe14dd9b700 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b05c5cf0 0x5572b05c8110 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4c261e27047400fb server_cookie=d9e11e6a2da6ba44 in_seq=0 out_seq=0 2024-05-09T01:07:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.814+0000 7fe135ffb700 1 -- 172.21.15.37:0/463139040 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe14801c070 con 0x5572b05c5cf0 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.814+0000 7fe135ffb700 10 client.16053 handle_command_reply: tid=0 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.814+0000 7fe163661b80 1 client.16053 shutdown 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.814+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 msgr2=0x5572b055b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.814+0000 7fe163661b80 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b055b450 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe1400a7720 tx=0x7fe1400aaab0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 shutdown_connections 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5572b05c5cf0 0x5572b05c8110 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5572b0549400 0x5572b0569f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe135ffb700 0 client.16053 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572b03cc4a0 0x5572b055b450 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 --2- 172.21.15.37:0/463139040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b0446d00 0x5572b055b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 >> 172.21.15.37:0/463139040 conn(0x5572b03cff70 msgr2=0x5572b054d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 shutdown_connections 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 1 -- 172.21.15.37:0/463139040 wait complete. 2024-05-09T01:07:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.815+0000 7fe163661b80 20 client.16053 trim_cache size 0 max 16384 2024-05-09T01:07:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:07:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe1380b2880 msgr2=0x7fe1380b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe1380b2880 0x7fe1380b4d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe15007aff0 tx=0x7fe144009260 comp rx=0 tx=0).stop 2024-05-09T01:07:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15010a990 msgr2=0x7fe1501a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15010a990 0x7fe1501a14d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe140000c00 tx=0x7fe1400047b0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 shutdown_connections 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe1380b2880 0x7fe1380b4d90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe150110970 0x7fe1501a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe15010a990 0x7fe1501a14d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 --2- 172.21.15.37:0/3482373500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe15010b2e0 0x7fe1501a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 >> 172.21.15.37:0/3482373500 conn(0x7fe150077c80 msgr2=0x7fe15007bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 shutdown_connections 2024-05-09T01:07:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:02.816+0000 7fe154c4b700 1 -- 172.21.15.37:0/3482373500 wait complete. 2024-05-09T01:07:02.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:02 smithi136 ceph-mon[34110]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 790 op/s 2024-05-09T01:07:03.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:07:04.390 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:04 smithi037 ceph-mon[30122]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 719 op/s 2024-05-09T01:07:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:04 smithi151 ceph-mon[34780]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 719 op/s 2024-05-09T01:07:04.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:04 smithi136 ceph-mon[34110]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.4 MiB/s wr, 719 op/s 2024-05-09T01:07:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 285.0 s, 3034.2 tps, lat 32.654 ms stddev 38.810 2024-05-09T01:07:06.630 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:06 smithi037 ceph-mon[30122]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 MiB/s wr, 763 op/s 2024-05-09T01:07:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:06 smithi151 ceph-mon[34780]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 MiB/s wr, 763 op/s 2024-05-09T01:07:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:06 smithi136 ceph-mon[34110]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 MiB/s wr, 763 op/s 2024-05-09T01:07:07.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.058+0000 7f7e22543700 1 -- 172.21.15.37:0/1928207756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103ba0 msgr2=0x7f7e1c1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.058+0000 7f7e22543700 1 --2- 172.21.15.37:0/1928207756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103ba0 0x7f7e1c1080d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009990 tx=0x7f7e10009ca0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.060+0000 7f7e22543700 1 -- 172.21.15.37:0/1928207756 shutdown_connections 2024-05-09T01:07:07.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.060+0000 7f7e22543700 1 --2- 172.21.15.37:0/1928207756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 0x7f7e1c108b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.060+0000 7f7e22543700 1 --2- 172.21.15.37:0/1928207756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c103250 0x7f7e1c103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.060+0000 7f7e22543700 1 --2- 172.21.15.37:0/1928207756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103ba0 0x7f7e1c1080d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.060+0000 7f7e22543700 1 -- 172.21.15.37:0/1928207756 >> 172.21.15.37:0/1928207756 conn(0x7f7e1c0fedc0 msgr2=0x7f7e1c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.060+0000 7f7e22543700 1 -- 172.21.15.37:0/1928207756 shutdown_connections 2024-05-09T01:07:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.060+0000 7f7e22543700 1 -- 172.21.15.37:0/1928207756 wait complete. 2024-05-09T01:07:07.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 Processor -- start 2024-05-09T01:07:07.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 -- start start 2024-05-09T01:07:07.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103250 0x7f7e1c1a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c103ba0 0x7f7e1c1a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 0x7f7e1c1a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c11aa20 con 0x7f7e1c1086a0 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c11a8a0 con 0x7f7e1c103250 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.061+0000 7f7e22543700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c11aba0 con 0x7f7e1c103ba0 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.062+0000 7f7e20ae0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 0x7f7e1c1a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.062+0000 7f7e20ae0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 0x7f7e1c1a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52394/0 (socket says 172.21.15.37:52394) 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.062+0000 7f7e20ae0700 1 -- 172.21.15.37:0/997562095 learned_addr learned my addr 172.21.15.37:0/997562095 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.062+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103250 0x7f7e1c1a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.062+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c103ba0 0x7f7e1c1a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.063+0000 7f7e20ae0700 1 -- 172.21.15.37:0/997562095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c103ba0 msgr2=0x7f7e1c1a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.063+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c103ba0 0x7f7e1c1a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.063+0000 7f7e20ae0700 1 -- 172.21.15.37:0/997562095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103250 msgr2=0x7f7e1c1a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.063+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103250 0x7f7e1c1a13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.063+0000 7f7e20ae0700 1 -- 172.21.15.37:0/997562095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c1a62a0 con 0x7f7e1c1086a0 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.063+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103250 0x7f7e1c1a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.063+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 0x7f7e1c1a5c00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00e940 tx=0x7f7e0c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.064+0000 7f7e197fa700 1 -- 172.21.15.37:0/997562095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00cbd0 con 0x7f7e1c1086a0 2024-05-09T01:07:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.064+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1c1a6590 con 0x7f7e1c1086a0 2024-05-09T01:07:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.064+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1c1adeb0 con 0x7f7e1c1086a0 2024-05-09T01:07:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.064+0000 7f7e197fa700 1 -- 172.21.15.37:0/997562095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c00ee90 con 0x7f7e1c1086a0 2024-05-09T01:07:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.064+0000 7f7e197fa700 1 -- 172.21.15.37:0/997562095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c005590 con 0x7f7e1c1086a0 2024-05-09T01:07:07.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.069+0000 7f7e197fa700 1 -- 172.21.15.37:0/997562095 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7e0c021440 con 0x7f7e1c1086a0 2024-05-09T01:07:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.069+0000 7f7e30f59b80 1 Processor -- start 2024-05-09T01:07:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e197fa700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e040b2980 0x7f7e040b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e30f59b80 1 -- start start 2024-05-09T01:07:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e197fa700 1 -- 172.21.15.37:0/997562095 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7e0c0e2320 con 0x7f7e1c1086a0 2024-05-09T01:07:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e040b2980 0x7f7e040b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b68f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b68ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2b680eff0 con 0x55c2b68ec6a0 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2b67ad7f0 con 0x55c2b6859160 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c2b680afb0 con 0x55c2b676f4a0 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e20ae0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b68ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e20ae0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b68ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52406/0 (socket says 172.21.15.37:52406) 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e20ae0700 1 -- 172.21.15.37:0/4011162021 learned_addr learned my addr 172.21.15.37:0/4011162021 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.070+0000 7f7e1bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b68f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e20ae0700 1 -- 172.21.15.37:0/4011162021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 msgr2=0x55c2b68f2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e040b2980 0x7f7e040b4e90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005b40 tx=0x7f7e10005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e20ae0700 1 -- 172.21.15.37:0/4011162021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 msgr2=0x55c2b68f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b68f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e20ae0700 1 -- 172.21.15.37:0/4011162021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b67a5370 con 0x55c2b68ec6a0 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.071+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b68ecad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0a9da0 tx=0x7f7e0c0a9870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835973653dea5c78 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.072+0000 7f7e027fc700 1 -- 172.21.15.37:0/4011162021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0ae1c0 con 0x55c2b68ec6a0 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.072+0000 7f7e027fc700 1 -- 172.21.15.37:0/4011162021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c0b2c70 con 0x55c2b68ec6a0 2024-05-09T01:07:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.072+0000 7f7e027fc700 1 -- 172.21.15.37:0/4011162021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0aa2d0 con 0x55c2b68ec6a0 2024-05-09T01:07:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4011162021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 msgr2=0x55c2b68ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b68ecad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0a9da0 tx=0x7f7e0c0a9870 comp rx=0 tx=0).stop 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4011162021 shutdown_connections 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b68ecad0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b68f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4011162021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4011162021 >> 172.21.15.37:0/4011162021 conn(0x55c2b67cf6a0 msgr2=0x55c2b68e7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.074+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4011162021 shutdown_connections 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.075+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4011162021 wait complete. 2024-05-09T01:07:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.075+0000 7f7e30f59b80 1 -- start start 2024-05-09T01:07:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.075+0000 7f7e30f59b80 1 Processor -- start 2024-05-09T01:07:07.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.076+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.076+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b6859160 0x55c2b68f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.076+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b68ec6a0 0x55c2b68f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.076+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2b668aba0 con 0x55c2b6859160 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.076+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c2b67c9150 con 0x55c2b68ec6a0 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.076+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c2b68f91d0 con 0x55c2b676f4a0 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.076+0000 7f7e30f59b80 10 client.0 _ll_register_callbacks cb 0x55c2b66806c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.077+0000 7f7e1b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b6859160 0x55c2b68f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.077+0000 7f7e1b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b6859160 0x55c2b68f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52422/0 (socket says 172.21.15.37:52422) 2024-05-09T01:07:07.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.077+0000 7f7e1b7fe700 1 -- 172.21.15.37:0/4267843877 learned_addr learned my addr 172.21.15.37:0/4267843877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.077+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b68ec6a0 0x55c2b68f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.077+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e1b7fe700 1 -- 172.21.15.37:0/4267843877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 msgr2=0x55c2b68f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e1b7fe700 1 -- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b68ec6a0 msgr2=0x55c2b68f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b68ec6a0 0x55c2b68f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e1b7fe700 1 -- 172.21.15.37:0/4267843877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b668a490 con 0x55c2b6859160 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b68ec6a0 0x55c2b68f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b6859160 0x55c2b68f6630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000b720 tx=0x7f7e10009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa90dd228f21f12 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.078+0000 7f7dfb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/4267843877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10033060 con 0x55c2b6859160 2024-05-09T01:07:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/4267843877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7e10003890 con 0x55c2b6859160 2024-05-09T01:07:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e0c0b2c70 con 0x55c2b6859160 2024-05-09T01:07:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/4267843877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7e10003a90 con 0x55c2b6859160 2024-05-09T01:07:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7e30f59b80 10 client.16065 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c2b6903bc0 con 0x55c2b6859160 2024-05-09T01:07:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/4267843877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c0b2c70 con 0x55c2b6859160 2024-05-09T01:07:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/4267843877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f7e10038070 con 0x55c2b6859160 2024-05-09T01:07:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.079+0000 7f7e30f59b80 10 client.16065 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.080+0000 7f7e30f59b80 10 client.16065 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:07:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.080+0000 7f7e30f59b80 20 client.16065 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.080+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6908660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.080+0000 7f7e30f59b80 4 client.16065 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.080+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2b681c9d0 con 0x55c2b6906200 2024-05-09T01:07:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.080+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6908660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.080+0000 7f7dfb7fe700 10 client.16065 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:07:07.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.081+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6908660 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36e08e89c5da8d7b server_cookie=1871fb2d647b3e61 in_seq=0 out_seq=0 2024-05-09T01:07:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.082+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/4267843877 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c2b681c9d0 con 0x55c2b6906200 2024-05-09T01:07:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.082+0000 7f7dfb7fe700 10 client.16065 handle_command_reply: tid=0 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.082+0000 7f7e30f59b80 1 client.16065 shutdown 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b6859160 msgr2=0x55c2b68f6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b6859160 0x55c2b68f6630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000b720 tx=0x7f7e10009ca0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 shutdown_connections 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6908660 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b68ec6a0 0x55c2b68f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7dfb7fe700 0 client.16065 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/4267843877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b6859160 0x55c2b68f6630 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 >> 172.21.15.37:0/4267843877 conn(0x55c2b67cf6a0 msgr2=0x55c2b68e71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 shutdown_connections 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 1 -- 172.21.15.37:0/4267843877 wait complete. 2024-05-09T01:07:07.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.083+0000 7f7e30f59b80 20 client.16065 trim_cache size 0 max 16384 2024-05-09T01:07:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 Processor -- start 2024-05-09T01:07:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 -- start start 2024-05-09T01:07:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b69020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0800d220 con 0x55c2b68ec6a0 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0800ed90 con 0x55c2b6859160 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.117+0000 7f7e30f59b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0800d8f0 con 0x55c2b676f4a0 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.118+0000 7f7e20ae0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.118+0000 7f7e20ae0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52430/0 (socket says 172.21.15.37:52430) 2024-05-09T01:07:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.118+0000 7f7e20ae0700 1 -- 172.21.15.37:0/1422761368 learned_addr learned my addr 172.21.15.37:0/1422761368 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.119+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.119+0000 7f7e20ae0700 1 -- 172.21.15.37:0/1422761368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 msgr2=0x55c2b69020a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:07:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.119+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b69020a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.119+0000 7f7e20ae0700 1 -- 172.21.15.37:0/1422761368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 msgr2=0x55c2b690de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.119+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.119+0000 7f7e20ae0700 1 -- 172.21.15.37:0/1422761368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b68f8990 con 0x55c2b68ec6a0 2024-05-09T01:07:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.120+0000 7f7e20ae0700 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690e360 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009fd0 tx=0x7f7e0c017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77d002b013ad6d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.121+0000 7f7e01ffb700 1 -- 172.21.15.37:0/1422761368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0ae1c0 con 0x55c2b68ec6a0 2024-05-09T01:07:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.121+0000 7f7e01ffb700 1 -- 172.21.15.37:0/1422761368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c00cd70 con 0x55c2b68ec6a0 2024-05-09T01:07:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.121+0000 7f7e01ffb700 1 -- 172.21.15.37:0/1422761368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0b29e0 con 0x55c2b68ec6a0 2024-05-09T01:07:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.125+0000 7f7e30f59b80 1 -- 172.21.15.37:0/1422761368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 msgr2=0x55c2b690e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.125+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690e360 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009fd0 tx=0x7f7e0c017fa0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.127+0000 7f7e30f59b80 1 -- 172.21.15.37:0/1422761368 shutdown_connections 2024-05-09T01:07:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.127+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690e360 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.128+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b69020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.128+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/1422761368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.128+0000 7f7e30f59b80 1 -- 172.21.15.37:0/1422761368 >> 172.21.15.37:0/1422761368 conn(0x55c2b67cf6a0 msgr2=0x55c2b68f4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:07.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.129+0000 7f7e30f59b80 1 -- 172.21.15.37:0/1422761368 shutdown_connections 2024-05-09T01:07:07.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.129+0000 7f7e30f59b80 1 -- 172.21.15.37:0/1422761368 wait complete. 2024-05-09T01:07:07.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.130+0000 7f7e30f59b80 1 -- start start 2024-05-09T01:07:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.130+0000 7f7e30f59b80 1 Processor -- start 2024-05-09T01:07:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.131+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68fe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.131+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.131+0000 7f7e30f59b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.132+0000 7f7e1b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.132+0000 7f7e1b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33164/0 (socket says 172.21.15.37:33164) 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.132+0000 7f7e1b7fe700 1 -- 172.21.15.37:0/2257900929 learned_addr learned my addr 172.21.15.37:0/2257900929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.132+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.132+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0800e6c0 con 0x55c2b68ec6a0 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.132+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0800dfc0 con 0x55c2b6859160 2024-05-09T01:07:07.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.132+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0800b1c0 con 0x55c2b676f4a0 2024-05-09T01:07:07.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.133+0000 7f7e30f59b80 10 client.0 _ll_register_callbacks cb 0x55c2b66806c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.133+0000 7f7e1bfff700 1 -- 172.21.15.37:0/2257900929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 msgr2=0x55c2b690d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.133+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.133+0000 7f7e1bfff700 1 -- 172.21.15.37:0/2257900929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 msgr2=0x55c2b690d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.133+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.133+0000 7f7e1bfff700 1 -- 172.21.15.37:0/2257900929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b690df70 con 0x55c2b676f4a0 2024-05-09T01:07:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.134+0000 7f7e1bfff700 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68fe910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55c2b68f3050 tx=0x7f7e14003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f16862b032b060a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:07.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.134+0000 7f7dfb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.134+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/2257900929 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e14026060 con 0x55c2b676f4a0 2024-05-09T01:07:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.134+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/2257900929 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7e14004250 con 0x55c2b676f4a0 2024-05-09T01:07:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.134+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e0c00cd70 con 0x55c2b676f4a0 2024-05-09T01:07:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.135+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/2257900929 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7e14004450 con 0x55c2b676f4a0 2024-05-09T01:07:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.135+0000 7f7e30f59b80 10 client.25855 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.135+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55c2b6970830 con 0x55c2b676f4a0 2024-05-09T01:07:07.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.135+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/2257900929 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e0c00cd70 con 0x55c2b676f4a0 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.135+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/2257900929 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f7e1400ece0 con 0x55c2b676f4a0 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.136+0000 7f7e30f59b80 10 client.25855 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.136+0000 7f7e30f59b80 10 client.25855 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.136+0000 7f7e30f59b80 20 client.25855 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.136+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6972fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.136+0000 7f7e30f59b80 4 client.25855 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.136+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2b6816a70 con 0x55c2b6906200 2024-05-09T01:07:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.136+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6972fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.138+0000 7f7e1b7fe700 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6972fa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=671c39943fa112ca server_cookie=edbb62511b7da467 in_seq=0 out_seq=0 2024-05-09T01:07:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.139+0000 7f7dfb7fe700 10 client.25855 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:07:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.140+0000 7f7dfb7fe700 1 -- 172.21.15.37:0/2257900929 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2b6816a70 con 0x55c2b6906200 2024-05-09T01:07:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.140+0000 7f7dfb7fe700 10 client.25855 handle_command_reply: tid=0 2024-05-09T01:07:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.140+0000 7f7e30f59b80 1 client.25855 shutdown 2024-05-09T01:07:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 msgr2=0x55c2b68fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68fe910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55c2b68f3050 tx=0x7f7e14003ed0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 shutdown_connections 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2b68ec6a0 0x55c2b690d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c2b676f4a0 0x55c2b68fe910 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55c2b68f3050 tx=0x7f7e14003ed0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55c2b6906200 0x55c2b6972fa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 --2- 172.21.15.37:0/2257900929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c2b6859160 0x55c2b690d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 >> 172.21.15.37:0/2257900929 conn(0x55c2b67cf6a0 msgr2=0x55c2b68f10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.144+0000 7f7dfb7fe700 0 client.25855 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.145+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 shutdown_connections 2024-05-09T01:07:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.145+0000 7f7e30f59b80 1 -- 172.21.15.37:0/2257900929 wait complete. 2024-05-09T01:07:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.145+0000 7f7e30f59b80 20 client.25855 trim_cache size 0 max 16384 2024-05-09T01:07:07.147 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:07:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.147+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e040b2980 msgr2=0x7f7e040b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.147+0000 7f7e22543700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e040b2980 0x7f7e040b4e90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7e10005b40 tx=0x7f7e10005a90 comp rx=0 tx=0).stop 2024-05-09T01:07:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.147+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 msgr2=0x7f7e1c1a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.147+0000 7f7e22543700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 0x7f7e1c1a5c00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00e940 tx=0x7f7e0c00ec50 comp rx=0 tx=0).stop 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 shutdown_connections 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7e040b2980 0x7f7e040b4e90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e1c1086a0 0x7f7e1c1a5c00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e1c103250 0x7f7e1c1a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 --2- 172.21.15.37:0/997562095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c103ba0 0x7f7e1c1a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 >> 172.21.15.37:0/997562095 conn(0x7f7e1c0fedc0 msgr2=0x7f7e1c106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 shutdown_connections 2024-05-09T01:07:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:07.148+0000 7f7e22543700 1 -- 172.21.15.37:0/997562095 wait complete. 2024-05-09T01:07:07.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:07:08.400 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:08.690 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:08 smithi037 ceph-mon[30122]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 687 op/s 2024-05-09T01:07:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:08 smithi151 ceph-mon[34780]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 687 op/s 2024-05-09T01:07:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:08 smithi136 ceph-mon[34110]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 687 op/s 2024-05-09T01:07:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 290.0 s, 2696.8 tps, lat 37.237 ms stddev 42.579 2024-05-09T01:07:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 -- 172.21.15.37:0/1195840845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d0103d90 msgr2=0x7fa6d01041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 --2- 172.21.15.37:0/1195840845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d0103d90 0x7fa6d01041a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009900 tx=0x7fa6c002a410 comp rx=0 tx=0).stop 2024-05-09T01:07:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 -- 172.21.15.37:0/1195840845 shutdown_connections 2024-05-09T01:07:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 --2- 172.21.15.37:0/1195840845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 0x7fa6d010aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 --2- 172.21.15.37:0/1195840845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d0103d90 0x7fa6d01041a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 --2- 172.21.15.37:0/1195840845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6d0102b50 0x7fa6d0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 -- 172.21.15.37:0/1195840845 >> 172.21.15.37:0/1195840845 conn(0x7fa6d00fdd40 msgr2=0x7fa6d01001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 -- 172.21.15.37:0/1195840845 shutdown_connections 2024-05-09T01:07:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.645+0000 7fa6d5643640 1 -- 172.21.15.37:0/1195840845 wait complete. 2024-05-09T01:07:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.646+0000 7fa6d5643640 1 Processor -- start 2024-05-09T01:07:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.646+0000 7fa6d5643640 1 -- start start 2024-05-09T01:07:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.646+0000 7fa6d5643640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d0102b50 0x7fa6d0199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6d5643640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6d0103d90 0x7fa6d0199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6d5643640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 0x7fa6d01a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6d5643640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d010e680 con 0x7fa6d0102b50 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6d5643640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d010e500 con 0x7fa6d0103d90 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6d5643640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d010e800 con 0x7fa6d0108a90 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6cf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 0x7fa6d01a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6cf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 0x7fa6d01a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41724/0 (socket says 172.21.15.37:41724) 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/862711352 learned_addr learned my addr 172.21.15.37:0/862711352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/862711352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6d0103d90 msgr2=0x7fa6d0199770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6cf7fe640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6d0103d90 0x7fa6d0199770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d0102b50 msgr2=0x7fa6d0199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.647+0000 7fa6cf7fe640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d0102b50 0x7fa6d0199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.648+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/862711352 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d01a0d70 con 0x7fa6d0108a90 2024-05-09T01:07:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.648+0000 7fa6cf7fe640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 0x7fa6d01a0700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800eb10 tx=0x7fa6c800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.648+0000 7fa6ccff9640 1 -- 172.21.15.37:0/862711352 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8004b20 con 0x7fa6d0108a90 2024-05-09T01:07:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.649+0000 7fa6ccff9640 1 -- 172.21.15.37:0/862711352 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6c8004cc0 con 0x7fa6d0108a90 2024-05-09T01:07:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.649+0000 7fa6ccff9640 1 -- 172.21.15.37:0/862711352 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8010690 con 0x7fa6d0108a90 2024-05-09T01:07:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.649+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d01a1060 con 0x7fa6d0108a90 2024-05-09T01:07:10.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.649+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01a15b0 con 0x7fa6d0108a90 2024-05-09T01:07:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.653+0000 7fa6ccff9640 1 -- 172.21.15.37:0/862711352 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa6c8010830 con 0x7fa6d0108a90 2024-05-09T01:07:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.653+0000 7fa6dc5da740 1 Processor -- start 2024-05-09T01:07:10.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.653+0000 7fa6dc5da740 1 -- start start 2024-05-09T01:07:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c5fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c5fd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c603da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56520c55c7c0 con 0x56520c2541b0 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56520c4f80e0 con 0x56520c2334d0 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56520c558780 con 0x56520c22b2f0 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6c67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c5fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6c67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c5fcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52476/0 (socket says 172.21.15.37:52476) 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6c67fc640 1 -- 172.21.15.37:0/3853935101 learned_addr learned my addr 172.21.15.37:0/3853935101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c5fd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.654+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c603da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ceffd640 1 -- 172.21.15.37:0/3853935101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 msgr2=0x56520c603da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c603da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ceffd640 1 -- 172.21.15.37:0/3853935101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 msgr2=0x56520c5fcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c5fcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ceffd640 1 -- 172.21.15.37:0/3853935101 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520c5217c0 con 0x56520c22b2f0 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c5fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ccff9640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6bc0b29b0 0x7fa6bc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6bc0b29b0 0x7fa6bc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c5fd550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0102420 tx=0x7fa6b800e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de2a02e1b7b7fd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6ccff9640 1 -- 172.21.15.37:0/862711352 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa6c80e2870 con 0x7fa6d0108a90 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6c57fa640 1 -- 172.21.15.37:0/3853935101 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b800ed80 con 0x56520c22b2f0 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6c57fa640 1 -- 172.21.15.37:0/3853935101 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b80054d0 con 0x56520c22b2f0 2024-05-09T01:07:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.655+0000 7fa6c57fa640 1 -- 172.21.15.37:0/3853935101 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8010690 con 0x56520c22b2f0 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3853935101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 msgr2=0x56520c5fd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c5fd550 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0102420 tx=0x7fa6b800e350 comp rx=0 tx=0).stop 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6bc0b29b0 0x7fa6bc0b4ec0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa6c002a930 tx=0x7fa6c0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3853935101 shutdown_connections 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c603da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c5fd550 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3853935101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c5fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3853935101 >> 172.21.15.37:0/3853935101 conn(0x56520c248300 msgr2=0x56520c5f3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.656+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3853935101 shutdown_connections 2024-05-09T01:07:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.657+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3853935101 wait complete. 2024-05-09T01:07:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.657+0000 7fa6dc5da740 1 -- start start 2024-05-09T01:07:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.657+0000 7fa6dc5da740 1 Processor -- start 2024-05-09T01:07:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.659+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c606680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.659+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c606bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.659+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2541b0 0x56520c60db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.659+0000 7fa6c67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c606bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.659+0000 7fa6c67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c606bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52482/0 (socket says 172.21.15.37:52482) 2024-05-09T01:07:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.660+0000 7fa6c67fc640 1 -- 172.21.15.37:0/3527433151 learned_addr learned my addr 172.21.15.37:0/3527433151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.660+0000 7fa6cf7fe640 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2541b0 0x56520c60db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.660+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56520c6047e0 con 0x56520c2334d0 2024-05-09T01:07:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.660+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56520c4e39c0 con 0x56520c2541b0 2024-05-09T01:07:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.660+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56520c604960 con 0x56520c22b2f0 2024-05-09T01:07:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.660+0000 7fa6dc5da740 10 client.0 _ll_register_callbacks cb 0x56520c510020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.660+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c606680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.661+0000 7fa6ceffd640 1 -- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2541b0 msgr2=0x56520c60db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.661+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2541b0 0x56520c60db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.661+0000 7fa6ceffd640 1 -- 172.21.15.37:0/3527433151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 msgr2=0x56520c606bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.661+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c606bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.661+0000 7fa6ceffd640 1 -- 172.21.15.37:0/3527433151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520c50a1f0 con 0x56520c22b2f0 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c606680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009250 tx=0x7fa6b8005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fdef08d4b8bddb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6b67fc640 1 -- 172.21.15.37:0/3527433151 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8026020 con 0x56520c22b2f0 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6b67fc640 1 -- 172.21.15.37:0/3527433151 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa6b800ed90 con 0x56520c22b2f0 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b80054d0 con 0x56520c22b2f0 2024-05-09T01:07:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6b67fc640 1 -- 172.21.15.37:0/3527433151 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa6b8004e20 con 0x56520c22b2f0 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6dc5da740 10 client.25867 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56520c2bf790 con 0x56520c22b2f0 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.662+0000 7fa6b67fc640 1 -- 172.21.15.37:0/3527433151 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6b80054d0 con 0x56520c22b2f0 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6b67fc640 1 -- 172.21.15.37:0/3527433151 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fa6b8018430 con 0x56520c22b2f0 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6dc5da740 10 client.25867 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6dc5da740 10 client.25867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6dc5da740 20 client.25867 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c212d80 0x56520c614150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6dc5da740 4 client.25867 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56520c56a3d0 con 0x56520c212d80 2024-05-09T01:07:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c212d80 0x56520c614150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.663+0000 7fa6b67fc640 10 client.25867 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.664+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c212d80 0x56520c614150 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd5ae55bdfa7c3ba server_cookie=f7cbb1f45cf55e7d in_seq=0 out_seq=0 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.664+0000 7fa6b67fc640 1 -- 172.21.15.37:0/3527433151 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56520c56a3d0 con 0x56520c212d80 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.664+0000 7fa6b67fc640 10 client.25867 handle_command_reply: tid=0 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 client.25867 shutdown 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 msgr2=0x56520c606680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c606680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009250 tx=0x7fa6b8005250 comp rx=0 tx=0).stop 2024-05-09T01:07:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 shutdown_connections 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c212d80 0x56520c614150 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2541b0 0x56520c60db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c606bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/3527433151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c606680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 >> 172.21.15.37:0/3527433151 conn(0x56520c248300 msgr2=0x56520c5fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6b67fc640 0 client.25867 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 shutdown_connections 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 1 -- 172.21.15.37:0/3527433151 wait complete. 2024-05-09T01:07:10.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.665+0000 7fa6dc5da740 20 client.25867 trim_cache size 0 max 16384 2024-05-09T01:07:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.692+0000 7fa6dc5da740 1 Processor -- start 2024-05-09T01:07:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.692+0000 7fa6dc5da740 1 -- start start 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.692+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c600ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.692+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c600ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.692+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c60da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b000e330 con 0x56520c2541b0 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c600ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b000fea0 con 0x56520c2334d0 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c600ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33210/0 (socket says 172.21.15.37:33210) 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 -- 172.21.15.37:0/534114536 learned_addr learned my addr 172.21.15.37:0/534114536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6dc5da740 1 -- 172.21.15.37:0/534114536 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b000ea00 con 0x56520c22b2f0 2024-05-09T01:07:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c600ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 -- 172.21.15.37:0/534114536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 msgr2=0x56520c600ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c600ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 -- 172.21.15.37:0/534114536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 msgr2=0x56520c60da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c60da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.693+0000 7fa6c67fc640 1 -- 172.21.15.37:0/534114536 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520c3365f0 con 0x56520c2334d0 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.694+0000 7fa6c67fc640 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c600ff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005710 tx=0x7fa6c002a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf94af3276a44dcd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.694+0000 7fa6c4ff9640 1 -- 172.21.15.37:0/534114536 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0057070 con 0x56520c2334d0 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.694+0000 7fa6c4ff9640 1 -- 172.21.15.37:0/534114536 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6c00042c0 con 0x56520c2334d0 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.694+0000 7fa6c4ff9640 1 -- 172.21.15.37:0/534114536 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0035040 con 0x56520c2334d0 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.695+0000 7fa6dc5da740 1 -- 172.21.15.37:0/534114536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 msgr2=0x56520c600ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.695+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c600ff0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005710 tx=0x7fa6c002a410 comp rx=0 tx=0).stop 2024-05-09T01:07:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.696+0000 7fa6dc5da740 1 -- 172.21.15.37:0/534114536 shutdown_connections 2024-05-09T01:07:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.696+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2541b0 0x56520c60da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.696+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c2334d0 0x56520c600ff0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.696+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/534114536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c22b2f0 0x56520c600ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.696+0000 7fa6dc5da740 1 -- 172.21.15.37:0/534114536 >> 172.21.15.37:0/534114536 conn(0x56520c248300 msgr2=0x56520c604d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.698+0000 7fa6dc5da740 1 -- 172.21.15.37:0/534114536 shutdown_connections 2024-05-09T01:07:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.698+0000 7fa6dc5da740 1 -- 172.21.15.37:0/534114536 wait complete. 2024-05-09T01:07:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.699+0000 7fa6dc5da740 1 -- start start 2024-05-09T01:07:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.699+0000 7fa6dc5da740 1 Processor -- start 2024-05-09T01:07:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.700+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c22b2f0 0x56520c60dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.700+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c60e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.700+0000 7fa6dc5da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c2541b0 0x56520c60a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.700+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b000f7d0 con 0x56520c2334d0 2024-05-09T01:07:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.700+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b000f0d0 con 0x56520c22b2f0 2024-05-09T01:07:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.700+0000 7fa6dc5da740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b000c310 con 0x56520c2541b0 2024-05-09T01:07:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.701+0000 7fa6cf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c2541b0 0x56520c60a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.701+0000 7fa6cf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c2541b0 0x56520c60a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41746/0 (socket says 172.21.15.37:41746) 2024-05-09T01:07:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.701+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/2760169463 learned_addr learned my addr 172.21.15.37:0/2760169463 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.701+0000 7fa6dc5da740 10 client.0 _ll_register_callbacks cb 0x7fa6b8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:10.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.702+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/2760169463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c22b2f0 msgr2=0x56520c60dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.702+0000 7fa6cf7fe640 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c22b2f0 0x56520c60dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.702+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/2760169463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 msgr2=0x56520c60e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.702+0000 7fa6cf7fe640 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c60e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.702+0000 7fa6cf7fe640 1 -- 172.21.15.37:0/2760169463 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520c520ed0 con 0x56520c2541b0 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.702+0000 7fa6cf7fe640 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c2541b0 0x56520c60a790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80a7fc0 tx=0x7fa6c80165b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0833172083c52ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.702+0000 7fa6b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.703+0000 7fa6b67fc640 1 -- 172.21.15.37:0/2760169463 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80aad50 con 0x56520c2541b0 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.703+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c00042c0 con 0x56520c2541b0 2024-05-09T01:07:10.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.703+0000 7fa6b67fc640 1 -- 172.21.15.37:0/2760169463 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa6c80a7340 con 0x56520c2541b0 2024-05-09T01:07:10.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.703+0000 7fa6b67fc640 1 -- 172.21.15.37:0/2760169463 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa6c80af100 con 0x56520c2541b0 2024-05-09T01:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.710+0000 7fa6dc5da740 10 client.25873 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:10.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.710+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x56520c67af30 con 0x56520c2541b0 2024-05-09T01:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.712+0000 7fa6b67fc640 1 -- 172.21.15.37:0/2760169463 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6c80c9070 con 0x56520c2541b0 2024-05-09T01:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.712+0000 7fa6b67fc640 1 -- 172.21.15.37:0/2760169463 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fa6c80a66c0 con 0x56520c2541b0 2024-05-09T01:07:10.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.712+0000 7fa6dc5da740 10 client.25873 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.712+0000 7fa6dc5da740 10 client.25873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.712+0000 7fa6dc5da740 20 client.25873 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.712+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c1e81c0 0x56520c67d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.712+0000 7fa6dc5da740 4 client.25873 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:07:10.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.713+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa6c00042c0 con 0x56520c1e81c0 2024-05-09T01:07:10.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.714+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c1e81c0 0x56520c67d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.718+0000 7fa6ceffd640 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c1e81c0 0x56520c67d970 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24567e4c43a20e8a server_cookie=ae888cb7537d53c3 in_seq=0 out_seq=0 2024-05-09T01:07:10.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.718+0000 7fa6b67fc640 10 client.25873 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:10 smithi037 ceph-mon[30122]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 652 op/s 2024-05-09T01:07:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:10 smithi151 ceph-mon[34780]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 652 op/s 2024-05-09T01:07:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.760+0000 7fa6b67fc640 1 -- 172.21.15.37:0/2760169463 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fa6c00042c0 con 0x56520c1e81c0 2024-05-09T01:07:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.760+0000 7fa6b67fc640 10 client.25873 handle_command_reply: tid=0 2024-05-09T01:07:10.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.760+0000 7fa6dc5da740 1 client.25873 shutdown 2024-05-09T01:07:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c2541b0 msgr2=0x56520c60a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c2541b0 0x56520c60a790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80a7fc0 tx=0x7fa6c80165b0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 shutdown_connections 2024-05-09T01:07:10.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56520c1e81c0 0x56520c67d970 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56520c2541b0 0x56520c60a790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56520c2334d0 0x56520c60e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 --2- 172.21.15.37:0/2760169463 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56520c22b2f0 0x56520c60dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 >> 172.21.15.37:0/2760169463 conn(0x56520c248300 msgr2=0x56520c5fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6b67fc640 0 client.25873 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 shutdown_connections 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 1 -- 172.21.15.37:0/2760169463 wait complete. 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.761+0000 7fa6dc5da740 20 client.25873 trim_cache size 0 max 16384 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:07:10.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.762+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6bc0b29b0 msgr2=0x7fa6bc0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.762+0000 7fa6d5643640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6bc0b29b0 0x7fa6bc0b4ec0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa6c002a930 tx=0x7fa6c0031400 comp rx=0 tx=0).stop 2024-05-09T01:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.762+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 msgr2=0x7fa6d01a0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.762+0000 7fa6d5643640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 0x7fa6d01a0700 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800eb10 tx=0x7fa6c800c2d0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 shutdown_connections 2024-05-09T01:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d0108a90 0x7fa6d01a0700 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6bc0b29b0 0x7fa6bc0b4ec0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa6d0103d90 0x7fa6d0199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 --2- 172.21.15.37:0/862711352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d0102b50 0x7fa6d0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 >> 172.21.15.37:0/862711352 conn(0x7fa6d00fdd40 msgr2=0x7fa6d0104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 shutdown_connections 2024-05-09T01:07:10.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:10.763+0000 7fa6d5643640 1 -- 172.21.15.37:0/862711352 wait complete. 2024-05-09T01:07:10.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.809+0000 7fe09859b700 1 -- 172.21.15.37:0/170869244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 msgr2=0x7fe090113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.809+0000 7fe09859b700 1 --2- 172.21.15.37:0/170869244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 0x7fe090113350 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe08800b0a0 tx=0x7fe08800b3b0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.811+0000 7fe09859b700 1 -- 172.21.15.37:0/170869244 shutdown_connections 2024-05-09T01:07:10.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.811+0000 7fe09859b700 1 --2- 172.21.15.37:0/170869244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 0x7fe090113350 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.811+0000 7fe09859b700 1 --2- 172.21.15.37:0/170869244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe09010c5b0 0x7fe09010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.811+0000 7fe09859b700 1 --2- 172.21.15.37:0/170869244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe090106570 0x7fe090106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.811+0000 7fe09859b700 1 -- 172.21.15.37:0/170869244 >> 172.21.15.37:0/170869244 conn(0x7fe090102090 msgr2=0x7fe0901044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.811+0000 7fe09859b700 1 -- 172.21.15.37:0/170869244 shutdown_connections 2024-05-09T01:07:10.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.811+0000 7fe09859b700 1 -- 172.21.15.37:0/170869244 wait complete. 2024-05-09T01:07:10.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.812+0000 7fe09859b700 1 Processor -- start 2024-05-09T01:07:10.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.812+0000 7fe09859b700 1 -- start start 2024-05-09T01:07:10.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe09859b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe090106570 0x7fe0901106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe09859b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 0x7fe090110be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe09859b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe09010c5b0 0x7fe090111120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe09859b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe090116750 con 0x7fe090106ec0 2024-05-09T01:07:10.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe09859b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901165d0 con 0x7fe09010c5b0 2024-05-09T01:07:10.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe09859b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901168d0 con 0x7fe090106570 2024-05-09T01:07:10.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe095b36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 0x7fe090110be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe095b36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 0x7fe090110be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52512/0 (socket says 172.21.15.37:52512) 2024-05-09T01:07:10.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe095b36700 1 -- 172.21.15.37:0/1309510898 learned_addr learned my addr 172.21.15.37:0/1309510898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe096337700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe090106570 0x7fe0901106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe096b38700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe09010c5b0 0x7fe090111120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe096337700 1 -- 172.21.15.37:0/1309510898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe09010c5b0 msgr2=0x7fe090111120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe096337700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe09010c5b0 0x7fe090111120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe096337700 1 -- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 msgr2=0x7fe090110be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe096337700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 0x7fe090110be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.813+0000 7fe096337700 1 -- 172.21.15.37:0/1309510898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0901a2d70 con 0x7fe090106570 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.814+0000 7fe096337700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe090106570 0x7fe0901106a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00e9c0 tx=0x7fe08c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.814+0000 7fe0877fe700 1 -- 172.21.15.37:0/1309510898 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c004220 con 0x7fe090106570 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.814+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0901a3060 con 0x7fe090106570 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.814+0000 7fe0877fe700 1 -- 172.21.15.37:0/1309510898 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe08c0043c0 con 0x7fe090106570 2024-05-09T01:07:10.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.814+0000 7fe0877fe700 1 -- 172.21.15.37:0/1309510898 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c005020 con 0x7fe090106570 2024-05-09T01:07:10.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.814+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0901a35a0 con 0x7fe090106570 2024-05-09T01:07:10.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.817+0000 7fe0877fe700 1 -- 172.21.15.37:0/1309510898 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe08c0051c0 con 0x7fe090106570 2024-05-09T01:07:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.819+0000 7fe0877fe700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe07c0b2900 0x7fe07c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.819+0000 7fe095b36700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe07c0b2900 0x7fe07c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.819+0000 7fe0877fe700 1 -- 172.21.15.37:0/1309510898 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe08c0e2050 con 0x7fe090106570 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 Processor -- start 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe095b36700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe07c0b2900 0x7fe07c0b4e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe090103d80 tx=0x7fe08000b460 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 -- start start 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b336384f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33638a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33632ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b33554ff0 con 0x556b3359f160 2024-05-09T01:07:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556b334f37f0 con 0x556b334b54a0 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556b33550fb0 con 0x556b336326a0 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe096b38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33632ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe096b38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33632ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41764/0 (socket says 172.21.15.37:41764) 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.820+0000 7fe096b38700 1 -- 172.21.15.37:0/548814018 learned_addr learned my addr 172.21.15.37:0/548814018 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe095b36700 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33638a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096b38700 1 -- 172.21.15.37:0/548814018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 msgr2=0x556b33638a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096b38700 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33638a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096b38700 1 -- 172.21.15.37:0/548814018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 msgr2=0x556b336384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096337700 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b336384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096b38700 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b336384f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096b38700 1 -- 172.21.15.37:0/548814018 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b334eb370 con 0x556b336326a0 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe095b36700 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33638a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096337700 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b336384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe096b38700 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33632ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe08800b0a0 tx=0x7fe0880092e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abfc1a25b8437cf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe084ff9700 1 -- 172.21.15.37:0/548814018 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08800bcb0 con 0x556b336326a0 2024-05-09T01:07:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe084ff9700 1 -- 172.21.15.37:0/548814018 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0880075c0 con 0x556b336326a0 2024-05-09T01:07:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.821+0000 7fe084ff9700 1 -- 172.21.15.37:0/548814018 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe088005280 con 0x556b336326a0 2024-05-09T01:07:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.823+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/548814018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 msgr2=0x556b33632ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.823+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33632ad0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe08800b0a0 tx=0x7fe0880092e0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.824+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/548814018 shutdown_connections 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.824+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33632ad0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.824+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b336384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.824+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/548814018 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33638a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.824+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/548814018 >> 172.21.15.37:0/548814018 conn(0x556b335156a0 msgr2=0x556b3362d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.824+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/548814018 shutdown_connections 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.825+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/548814018 wait complete. 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.825+0000 7fe0a6fb1b80 1 -- start start 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.825+0000 7fe0a6fb1b80 1 Processor -- start 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b334b54a0 0x556b3363c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b3363c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b3363ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b333d0ba0 con 0x556b334b54a0 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556b3350f150 con 0x556b3359f160 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556b3363f1d0 con 0x556b336326a0 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe096337700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b334b54a0 0x556b3363c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe0a6fb1b80 10 client.0 _ll_register_callbacks cb 0x556b333c66c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe095b36700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b3363c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe096b38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b3363ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe095b36700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b3363c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33260/0 (socket says 172.21.15.37:33260) 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.826+0000 7fe095b36700 1 -- 172.21.15.37:0/3402434926 learned_addr learned my addr 172.21.15.37:0/3402434926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe095b36700 1 -- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 msgr2=0x556b3363ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe095b36700 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b3363ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe095b36700 1 -- 172.21.15.37:0/3402434926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b334b54a0 msgr2=0x556b3363c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe095b36700 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b334b54a0 0x556b3363c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe095b36700 1 -- 172.21.15.37:0/3402434926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b333d0490 con 0x556b3359f160 2024-05-09T01:07:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe096b38700 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b3363ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe095b36700 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b3363c770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe080011770 tx=0x7fe0800047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6fdc6f16243c8f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe079ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe079ffb700 1 -- 172.21.15.37:0/3402434926 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08001f840 con 0x556b3359f160 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe079ffb700 1 -- 172.21.15.37:0/3402434926 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe08001f9e0 con 0x556b3359f160 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0880075c0 con 0x556b3359f160 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe079ffb700 1 -- 172.21.15.37:0/3402434926 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe080010e50 con 0x556b3359f160 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe0a6fb1b80 10 client.25886 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.827+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556b33649ba0 con 0x556b3359f160 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe079ffb700 1 -- 172.21.15.37:0/3402434926 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0880075c0 con 0x556b3359f160 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe079ffb700 1 -- 172.21.15.37:0/3402434926 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fe080028c80 con 0x556b3359f160 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe0a6fb1b80 10 client.25886 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe0a6fb1b80 10 client.25886 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe0a6fb1b80 20 client.25886 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b3364c1e0 0x556b3364e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe0a6fb1b80 4 client.25886 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b335629d0 con 0x556b3364c1e0 2024-05-09T01:07:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.828+0000 7fe096337700 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b3364c1e0 0x556b3364e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.829+0000 7fe079ffb700 10 client.25886 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.829+0000 7fe096337700 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b3364c1e0 0x556b3364e640 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f53420800db6b2a7 server_cookie=31316041fc884ed6 in_seq=0 out_seq=0 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe079ffb700 1 -- 172.21.15.37:0/3402434926 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556b335629d0 con 0x556b3364c1e0 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe079ffb700 10 client.25886 handle_command_reply: tid=0 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 client.25886 shutdown 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 msgr2=0x556b3363c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b3363c770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe080011770 tx=0x7fe0800047c0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 shutdown_connections 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b3364c1e0 0x556b3364e640 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe079ffb700 0 client.25886 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b3363ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b334b54a0 0x556b3363c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3402434926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b3363c770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.830+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 >> 172.21.15.37:0/3402434926 conn(0x556b335156a0 msgr2=0x556b3362d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.831+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 shutdown_connections 2024-05-09T01:07:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.831+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3402434926 wait complete. 2024-05-09T01:07:10.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.831+0000 7fe0a6fb1b80 20 client.25886 trim_cache size 0 max 16384 2024-05-09T01:07:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.857+0000 7fe0a6fb1b80 1 Processor -- start 2024-05-09T01:07:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe0a6fb1b80 1 -- start start 2024-05-09T01:07:10.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33648010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b33653e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33654380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bd840 con 0x556b3359f160 2024-05-09T01:07:10.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bf3b0 con 0x556b334b54a0 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bdf10 con 0x556b336326a0 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe096b38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33654380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe096b38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33654380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41796/0 (socket says 172.21.15.37:41796) 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe096b38700 1 -- 172.21.15.37:0/898032310 learned_addr learned my addr 172.21.15.37:0/898032310 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe096337700 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33648010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.858+0000 7fe095b36700 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b33653e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe096337700 1 -- 172.21.15.37:0/898032310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 msgr2=0x556b33654380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe096337700 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33654380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe096337700 1 -- 172.21.15.37:0/898032310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 msgr2=0x556b33653e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe096337700 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b33653e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe096337700 1 -- 172.21.15.37:0/898032310 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b3362e300 con 0x556b334b54a0 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe096b38700 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33654380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe095b36700 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b33653e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe096337700 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33648010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0dfc40 tx=0x7fe08c0a6570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5be3e30e2d3d4c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe07bfff700 1 -- 172.21.15.37:0/898032310 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c01c040 con 0x556b334b54a0 2024-05-09T01:07:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe07bfff700 1 -- 172.21.15.37:0/898032310 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe08c0ae930 con 0x556b334b54a0 2024-05-09T01:07:10.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.859+0000 7fe07bfff700 1 -- 172.21.15.37:0/898032310 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0054b0 con 0x556b334b54a0 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/898032310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 msgr2=0x556b33648010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33648010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0dfc40 tx=0x7fe08c0a6570 comp rx=0 tx=0).stop 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/898032310 shutdown_connections 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b336326a0 0x556b33654380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b334b54a0 0x556b33648010 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/898032310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b3359f160 0x556b33653e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/898032310 >> 172.21.15.37:0/898032310 conn(0x556b335156a0 msgr2=0x556b3363ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.860+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/898032310 shutdown_connections 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.861+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/898032310 wait complete. 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.861+0000 7fe0a6fb1b80 1 -- start start 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.861+0000 7fe0a6fb1b80 1 Processor -- start 2024-05-09T01:07:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b334b54a0 0x556b33644390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b336448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe0a6fb1b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b336326a0 0x556b33652e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bece0 con 0x556b336326a0 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901be5e0 con 0x556b3359f160 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe0a6fb1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bb840 con 0x556b334b54a0 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe0a6fb1b80 10 client.0 _ll_register_callbacks cb 0x556b333c66c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b336448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b336448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33282/0 (socket says 172.21.15.37:33282) 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 -- 172.21.15.37:0/3066368960 learned_addr learned my addr 172.21.15.37:0/3066368960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe096b38700 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b336326a0 0x556b33652e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe096337700 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b334b54a0 0x556b33644390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 -- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b334b54a0 msgr2=0x556b33644390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b334b54a0 0x556b33644390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 -- 172.21.15.37:0/3066368960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b336326a0 msgr2=0x556b33652e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b336326a0 0x556b33652e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.862+0000 7fe095b36700 1 -- 172.21.15.37:0/3066368960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b33654830 con 0x556b3359f160 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.863+0000 7fe095b36700 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b336448d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe080005e10 tx=0x7fe08001f8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65842677f7e43710 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.863+0000 7fe079ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.863+0000 7fe079ffb700 1 -- 172.21.15.37:0/3066368960 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080028670 con 0x556b3359f160 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.863+0000 7fe079ffb700 1 -- 172.21.15.37:0/3066368960 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe080028810 con 0x556b3359f160 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.863+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe08c0ae930 con 0x556b3359f160 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.863+0000 7fe079ffb700 1 -- 172.21.15.37:0/3066368960 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe080044050 con 0x556b3359f160 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.864+0000 7fe0a6fb1b80 10 client.25892 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.864+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x556b336b5f90 con 0x556b3359f160 2024-05-09T01:07:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.864+0000 7fe079ffb700 1 -- 172.21.15.37:0/3066368960 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe08c0ae930 con 0x556b3359f160 2024-05-09T01:07:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe079ffb700 1 -- 172.21.15.37:0/3066368960 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7fe080033560 con 0x556b3359f160 2024-05-09T01:07:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe0a6fb1b80 10 client.25892 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe0a6fb1b80 10 client.25892 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:07:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe0a6fb1b80 20 client.25892 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b336b6640 0x556b336b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe0a6fb1b80 4 client.25892 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b3355ca70 con 0x556b336b6640 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.865+0000 7fe096337700 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b336b6640 0x556b336b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.866+0000 7fe096337700 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b336b6640 0x556b336b8a60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a6a3148d9eab1185 server_cookie=f4983bfb9ab6d63a in_seq=0 out_seq=0 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.866+0000 7fe079ffb700 10 client.25892 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.866+0000 7fe079ffb700 1 -- 172.21.15.37:0/3066368960 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b3355ca70 con 0x556b336b6640 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.866+0000 7fe079ffb700 10 client.25892 handle_command_reply: tid=0 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.866+0000 7fe0a6fb1b80 1 client.25892 shutdown 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 msgr2=0x556b336448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b336448d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe080005e10 tx=0x7fe08001f8f0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 shutdown_connections 2024-05-09T01:07:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b336b6640 0x556b336b8a60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b336326a0 0x556b33652e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b334b54a0 0x556b33644390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 --2- 172.21.15.37:0/3066368960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b3359f160 0x556b336448d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 >> 172.21.15.37:0/3066368960 conn(0x556b335156a0 msgr2=0x556b3363c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe079ffb700 0 client.25892 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 shutdown_connections 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 1 -- 172.21.15.37:0/3066368960 wait complete. 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.867+0000 7fe0a6fb1b80 20 client.25892 trim_cache size 0 max 16384 2024-05-09T01:07:10.871 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:07:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe07c0b2900 msgr2=0x7fe07c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe07c0b2900 0x7fe07c0b4e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe090103d80 tx=0x7fe08000b460 comp rx=0 tx=0).stop 2024-05-09T01:07:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe090106570 msgr2=0x7fe0901106a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe090106570 0x7fe0901106a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00e9c0 tx=0x7fe08c00ecd0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 shutdown_connections 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe07c0b2900 0x7fe07c0b4e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe09010c5b0 0x7fe090111120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe090106570 0x7fe0901106a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 --2- 172.21.15.37:0/1309510898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe090106ec0 0x7fe090110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.869+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 >> 172.21.15.37:0/1309510898 conn(0x7fe090102090 msgr2=0x7fe090104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.870+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 shutdown_connections 2024-05-09T01:07:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:10.870+0000 7fe09859b700 1 -- 172.21.15.37:0/1309510898 wait complete. 2024-05-09T01:07:10.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:10 smithi136 ceph-mon[34110]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 652 op/s 2024-05-09T01:07:11.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:07:12.012 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:12 smithi037 ceph-mon[30122]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 763 op/s 2024-05-09T01:07:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:12 smithi151 ceph-mon[34780]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 763 op/s 2024-05-09T01:07:12.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:12 smithi136 ceph-mon[34110]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 763 op/s 2024-05-09T01:07:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.916+0000 7f5694c96700 1 -- 172.21.15.37:0/1791866376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 msgr2=0x7f569010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.916+0000 7f5694c96700 1 --2- 172.21.15.37:0/1791866376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 0x7f569010ad40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f568401a9a0 tx=0x7f568401acb0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.916+0000 7f5694c96700 1 -- 172.21.15.37:0/1791866376 shutdown_connections 2024-05-09T01:07:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.916+0000 7f5694c96700 1 --2- 172.21.15.37:0/1791866376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 0x7f569011fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.916+0000 7f5694c96700 1 --2- 172.21.15.37:0/1791866376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 0x7f569010ad40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.916+0000 7f5694c96700 1 --2- 172.21.15.37:0/1791866376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569010b280 0x7f569011d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.916+0000 7f5694c96700 1 -- 172.21.15.37:0/1791866376 >> 172.21.15.37:0/1791866376 conn(0x7f569006f4d0 msgr2=0x7f569006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:13.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.920+0000 7f5694c96700 1 -- 172.21.15.37:0/1791866376 shutdown_connections 2024-05-09T01:07:13.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.920+0000 7f5694c96700 1 -- 172.21.15.37:0/1791866376 wait complete. 2024-05-09T01:07:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.921+0000 7f5694c96700 1 Processor -- start 2024-05-09T01:07:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.923+0000 7f5694c96700 1 -- start start 2024-05-09T01:07:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.923+0000 7f5694c96700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 0x7f569011d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.923+0000 7f5694c96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569010b280 0x7f5690119240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f5694c96700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 0x7f5690119780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f5694c96700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5690115430 con 0x7f569010b280 2024-05-09T01:07:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f5694c96700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f56901152b0 con 0x7f569011d930 2024-05-09T01:07:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f5694c96700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56901155b0 con 0x7f569010a930 2024-05-09T01:07:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f568ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 0x7f5690119780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f568ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 0x7f5690119780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47118/0 (socket says 172.21.15.37:47118) 2024-05-09T01:07:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f568ed9d700 1 -- 172.21.15.37:0/2316467635 learned_addr learned my addr 172.21.15.37:0/2316467635 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.924+0000 7f568e59c700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 0x7f569011d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.925+0000 7f568ed9d700 1 -- 172.21.15.37:0/2316467635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 msgr2=0x7f569011d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.925+0000 7f568ed9d700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 0x7f569011d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.925+0000 7f568ed9d700 1 -- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569010b280 msgr2=0x7f5690119240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.925+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569010b280 0x7f5690119240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.925+0000 7f568ed9d700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569010b280 0x7f5690119240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.925+0000 7f568ed9d700 1 -- 172.21.15.37:0/2316467635 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5690119e80 con 0x7f569011d930 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.925+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569010b280 0x7f5690119240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.926+0000 7f568ed9d700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 0x7f5690119780 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f568000e970 tx=0x7f568000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.926+0000 7f567f7fe700 1 -- 172.21.15.37:0/2316467635 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568000cbd0 con 0x7f569011d930 2024-05-09T01:07:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.926+0000 7f567f7fe700 1 -- 172.21.15.37:0/2316467635 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f568000cd70 con 0x7f569011d930 2024-05-09T01:07:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.927+0000 7f567f7fe700 1 -- 172.21.15.37:0/2316467635 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680005620 con 0x7f569011d930 2024-05-09T01:07:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.927+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56901ad8c0 con 0x7f569011d930 2024-05-09T01:07:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.927+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56901adc60 con 0x7f569011d930 2024-05-09T01:07:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.932+0000 7f567f7fe700 1 -- 172.21.15.37:0/2316467635 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5680004750 con 0x7f569011d930 2024-05-09T01:07:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.932+0000 7f56a36acb80 1 Processor -- start 2024-05-09T01:07:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.933+0000 7f56a36acb80 1 -- start start 2024-05-09T01:07:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.933+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a09c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.933+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f194a0 0x55ec1a09c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.933+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.933+0000 7f56a36acb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec19fb90a0 con 0x55ec19f93d00 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.933+0000 7f56a36acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ec19f5e9a0 con 0x55ec19f194a0 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.933+0000 7f56a36acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ec19fb5060 con 0x55ec1a096400 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.934+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a09c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.934+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a09c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46384/0 (socket says 172.21.15.37:46384) 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.934+0000 7f568dd9b700 1 -- 172.21.15.37:0/1485107536 learned_addr learned my addr 172.21.15.37:0/1485107536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.934+0000 7f568dd9b700 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.934+0000 7f567f7fe700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f56780b2940 0x7f56780b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.934+0000 7f568ed9d700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f56780b2940 0x7f56780b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f568dd9b700 1 -- 172.21.15.37:0/1485107536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 msgr2=0x55ec1a096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:13.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f568dd9b700 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a096810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f568dd9b700 1 -- 172.21.15.37:0/1485107536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f194a0 msgr2=0x55ec1a09c780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:07:13.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f568dd9b700 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f194a0 0x55ec1a09c780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f568dd9b700 1 -- 172.21.15.37:0/1485107536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec19f4f500 con 0x55ec19f93d00 2024-05-09T01:07:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f567f7fe700 1 -- 172.21.15.37:0/2316467635 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f56800e2460 con 0x7f569011d930 2024-05-09T01:07:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f568ed9d700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f56780b2940 0x7f56780b4e50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f56800a9820 tx=0x7f56800a5b10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.935+0000 7f568dd9b700 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a09c240 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5688011cd0 tx=0x7f56880097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f5a6f0af71b54e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.936+0000 7f567cff9700 1 -- 172.21.15.37:0/1485107536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688003ac0 con 0x55ec19f93d00 2024-05-09T01:07:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.936+0000 7f567cff9700 1 -- 172.21.15.37:0/1485107536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f568800cd20 con 0x55ec19f93d00 2024-05-09T01:07:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.936+0000 7f567cff9700 1 -- 172.21.15.37:0/1485107536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688004440 con 0x55ec19f93d00 2024-05-09T01:07:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 -- 172.21.15.37:0/1485107536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 msgr2=0x55ec1a09c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a09c240 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5688011cd0 tx=0x7f56880097e0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 -- 172.21.15.37:0/1485107536 shutdown_connections 2024-05-09T01:07:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a096810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a09c240 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 --2- 172.21.15.37:0/1485107536 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f194a0 0x55ec1a09c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 -- 172.21.15.37:0/1485107536 >> 172.21.15.37:0/1485107536 conn(0x55ec19f1cf70 msgr2=0x55ec1a091220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 -- 172.21.15.37:0/1485107536 shutdown_connections 2024-05-09T01:07:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.937+0000 7f56a36acb80 1 -- 172.21.15.37:0/1485107536 wait complete. 2024-05-09T01:07:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.938+0000 7f56a36acb80 1 -- start start 2024-05-09T01:07:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.938+0000 7f56a36acb80 1 Processor -- start 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f93d00 0x55ec1a0a0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f56a36acb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec1a097100 con 0x55ec19f194a0 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46392/0 (socket says 172.21.15.37:46392) 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f568dd9b700 1 -- 172.21.15.37:0/2908281361 learned_addr learned my addr 172.21.15.37:0/2908281361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.939+0000 7f56a36acb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ec19f53b20 con 0x55ec1a096400 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ec1a0ac200 con 0x55ec19f93d00 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f568e59c700 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f93d00 0x55ec1a0a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f56a36acb80 10 client.0 _ll_register_callbacks cb 0x55ec19e2a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f568dd9b700 1 -- 172.21.15.37:0/2908281361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f93d00 msgr2=0x55ec1a0a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f93d00 0x55ec1a0a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f568dd9b700 1 -- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 msgr2=0x55ec1a0a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.940+0000 7f568dd9b700 1 -- 172.21.15.37:0/2908281361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec19e34490 con 0x55ec19f194a0 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.941+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a0000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5688007030 tx=0x7f56880092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e561be9fd2d07607 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.941+0000 7f5675ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.941+0000 7f5675ffb700 1 -- 172.21.15.37:0/2908281361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880040c0 con 0x55ec19f194a0 2024-05-09T01:07:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.941+0000 7f5675ffb700 1 -- 172.21.15.37:0/2908281361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5688026070 con 0x55ec19f194a0 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.941+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f568800cd20 con 0x55ec19f194a0 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.941+0000 7f5675ffb700 1 -- 172.21.15.37:0/2908281361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f56880040c0 con 0x55ec19f194a0 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.941+0000 7f56a36acb80 10 client.16098 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.942+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ec1a0adae0 con 0x55ec19f194a0 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.942+0000 7f5675ffb700 1 -- 172.21.15.37:0/2908281361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f568800cd20 con 0x55ec19f194a0 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.942+0000 7f5675ffb700 1 -- 172.21.15.37:0/2908281361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f568800f4d0 con 0x55ec19f194a0 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.942+0000 7f56a36acb80 10 client.16098 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.942+0000 7f56a36acb80 10 client.16098 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.943+0000 7f56a36acb80 20 client.16098 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.943+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.943+0000 7f56a36acb80 4 client.16098 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.943+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec19fc6a80 con 0x55ec1a0affb0 2024-05-09T01:07:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.943+0000 7f568e59c700 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.944+0000 7f568e59c700 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a0b23d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99f660ca14c1c1dc server_cookie=1e68b1d15d41fbe7 in_seq=0 out_seq=0 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.944+0000 7f5675ffb700 10 client.16098 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f5675ffb700 1 -- 172.21.15.37:0/2908281361 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ec19fc6a80 con 0x55ec1a0affb0 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f5675ffb700 10 client.16098 handle_command_reply: tid=0 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 client.16098 shutdown 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 msgr2=0x55ec1a0a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a0000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5688007030 tx=0x7f56880092d0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 shutdown_connections 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a0b23d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a0000 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2908281361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f93d00 0x55ec1a0a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f5675ffb700 0 client.16098 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:07:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.945+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 >> 172.21.15.37:0/2908281361 conn(0x55ec19f1cf70 msgr2=0x55ec1a08aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.946+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 shutdown_connections 2024-05-09T01:07:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.946+0000 7f56a36acb80 1 -- 172.21.15.37:0/2908281361 wait complete. 2024-05-09T01:07:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.946+0000 7f56a36acb80 20 client.16098 trim_cache size 0 max 16384 2024-05-09T01:07:13.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.962+0000 7f56a36acb80 1 Processor -- start 2024-05-09T01:07:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.962+0000 7f56a36acb80 1 -- start start 2024-05-09T01:07:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.962+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f194a0 0x55ec1a08ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a0a24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0b7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f194a0 0x55ec1a08ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f194a0 0x55ec1a08ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41942/0 (socket says 172.21.15.37:41942) 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a0a24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a0a24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46402/0 (socket says 172.21.15.37:46402) 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 -- 172.21.15.37:0/3174270547 learned_addr learned my addr 172.21.15.37:0/3174270547 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56901b5270 con 0x55ec19f93d00 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f56901b6de0 con 0x55ec1a096400 2024-05-09T01:07:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56901b5940 con 0x55ec19f194a0 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568dd9b700 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 -- 172.21.15.37:0/3174270547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f194a0 msgr2=0x55ec1a08ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f194a0 0x55ec1a08ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 -- 172.21.15.37:0/3174270547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 msgr2=0x55ec1a0b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.963+0000 7f568e59c700 1 -- 172.21.15.37:0/3174270547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec1a09bc80 con 0x55ec19f93d00 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.964+0000 7f568e59c700 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a0a24a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f568401a8f0 tx=0x7f568401c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7533cd3a630002e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.964+0000 7f5677fff700 1 -- 172.21.15.37:0/3174270547 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568401cb50 con 0x55ec19f93d00 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.964+0000 7f5677fff700 1 -- 172.21.15.37:0/3174270547 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f568401ccf0 con 0x55ec19f93d00 2024-05-09T01:07:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.964+0000 7f5677fff700 1 -- 172.21.15.37:0/3174270547 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684003cc0 con 0x55ec19f93d00 2024-05-09T01:07:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 msgr2=0x55ec1a0a24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a0a24a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f568401a8f0 tx=0x7f568401c270 comp rx=0 tx=0).stop 2024-05-09T01:07:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 shutdown_connections 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec1a096400 0x55ec1a0b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec19f194a0 0x55ec1a08ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 --2- 172.21.15.37:0/3174270547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f93d00 0x55ec1a0a24a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 >> 172.21.15.37:0/3174270547 conn(0x55ec19f1cf70 msgr2=0x55ec1a09a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 shutdown_connections 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 -- 172.21.15.37:0/3174270547 wait complete. 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 -- start start 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.965+0000 7f56a36acb80 1 Processor -- start 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46414/0 (socket says 172.21.15.37:46414) 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f56a36acb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f93d00 0x55ec1a0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 -- 172.21.15.37:0/2433793475 learned_addr learned my addr 172.21.15.37:0/2433793475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a0a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56901b6710 con 0x55ec19f194a0 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f56901b6010 con 0x55ec19f93d00 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56901b31d0 con 0x55ec1a096400 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f56a36acb80 10 client.0 _ll_register_callbacks cb 0x55ec19e2a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568e59c700 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f93d00 0x55ec1a0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a0a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 -- 172.21.15.37:0/2433793475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 msgr2=0x55ec1a0a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a0a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 -- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f93d00 msgr2=0x55ec1a0a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f93d00 0x55ec1a0a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.966+0000 7f568dd9b700 1 -- 172.21.15.37:0/2433793475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec1a0a65a0 con 0x55ec19f194a0 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f568dd9b700 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a85d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f568800c630 tx=0x7f56880092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb05a88374e0cd8a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f5675ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f5675ffb700 1 -- 172.21.15.37:0/2433793475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56880040c0 con 0x55ec19f194a0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f5675ffb700 1 -- 172.21.15.37:0/2433793475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f568801ae20 con 0x55ec19f194a0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f568401ccf0 con 0x55ec19f194a0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f5675ffb700 1 -- 172.21.15.37:0/2433793475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f568801a9a0 con 0x55ec19f194a0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 10 client.16104 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ec1a11a310 con 0x55ec19f194a0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f5675ffb700 1 -- 172.21.15.37:0/2433793475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f568401ccf0 con 0x55ec19f194a0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f5675ffb700 1 -- 172.21.15.37:0/2433793475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f568800f4d0 con 0x55ec19f194a0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 10 client.16104 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 10 client.16104 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 20 client.16104 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a11c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 4 client.16104 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.967+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec19fc0b20 con 0x55ec1a0affb0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f568e59c700 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a11c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f5675ffb700 10 client.16104 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f568e59c700 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a11c780 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=255e54e212b7698 server_cookie=924ffb19389f037f in_seq=0 out_seq=0 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f5675ffb700 1 -- 172.21.15.37:0/2433793475 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec19fc0b20 con 0x55ec1a0affb0 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f5675ffb700 10 client.16104 handle_command_reply: tid=0 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f56a36acb80 1 client.16104 shutdown 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 msgr2=0x55ec1a0a85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a85d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f568800c630 tx=0x7f56880092d0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 shutdown_connections 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.968+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec1a096400 0x55ec1a0a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55ec1a0affb0 0x55ec1a11c780 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec19f194a0 0x55ec1a0a85d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f56a36acb80 1 --2- 172.21.15.37:0/2433793475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ec19f93d00 0x55ec1a0a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 >> 172.21.15.37:0/2433793475 conn(0x55ec19f1cf70 msgr2=0x55ec1a0953f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5675ffb700 0 client.16104 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:07:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 shutdown_connections 2024-05-09T01:07:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f56a36acb80 1 -- 172.21.15.37:0/2433793475 wait complete. 2024-05-09T01:07:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f56a36acb80 20 client.16104 trim_cache size 0 max 16384 2024-05-09T01:07:13.975 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f56780b2940 msgr2=0x7f56780b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f56780b2940 0x7f56780b4e50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f56800a9820 tx=0x7f56800a5b10 comp rx=0 tx=0).stop 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 msgr2=0x7f5690119780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 0x7f5690119780 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f568000e970 tx=0x7f568000ed30 comp rx=0 tx=0).stop 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 shutdown_connections 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f56780b2940 0x7f56780b4e50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f569011d930 0x7f5690119780 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f569010a930 0x7f569011d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 --2- 172.21.15.37:0/2316467635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f569010b280 0x7f5690119240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.969+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 >> 172.21.15.37:0/2316467635 conn(0x7f569006f4d0 msgr2=0x7f569011dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.970+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 shutdown_connections 2024-05-09T01:07:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:13.970+0000 7f5694c96700 1 -- 172.21.15.37:0/2316467635 wait complete. 2024-05-09T01:07:14.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:14 smithi037 ceph-mon[30122]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 MiB/s wr, 687 op/s 2024-05-09T01:07:14.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:14 smithi151 ceph-mon[34780]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 MiB/s wr, 687 op/s 2024-05-09T01:07:14.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:07:14.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:14 smithi136 ceph-mon[34110]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.8 MiB/s wr, 687 op/s 2024-05-09T01:07:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 295.0 s, 2083.4 tps, lat 48.104 ms stddev 56.353 2024-05-09T01:07:16.630 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:16 smithi037 ceph-mon[30122]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.7 MiB/s wr, 737 op/s 2024-05-09T01:07:16.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:16 smithi151 ceph-mon[34780]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.7 MiB/s wr, 737 op/s 2024-05-09T01:07:16.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:16 smithi136 ceph-mon[34110]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.7 MiB/s wr, 737 op/s 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 -- 172.21.15.37:0/1811080038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc41030e0 msgr2=0x7f0dc4111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/1811080038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc41030e0 0x7f0dc4111170 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009f90 tx=0x7f0dc000b330 comp rx=0 tx=0).stop 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 -- 172.21.15.37:0/1811080038 shutdown_connections 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/1811080038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc41030e0 0x7f0dc4111170 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/1811080038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc4109300 0x7f0dc4109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/1811080038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc4102790 0x7f0dc4102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 -- 172.21.15.37:0/1811080038 >> 172.21.15.37:0/1811080038 conn(0x7f0dc40fe4e0 msgr2=0x7f0dc4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.034+0000 7f0dcbed0700 1 -- 172.21.15.37:0/1811080038 shutdown_connections 2024-05-09T01:07:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.039+0000 7f0dcbed0700 1 -- 172.21.15.37:0/1811080038 wait complete. 2024-05-09T01:07:17.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 Processor -- start 2024-05-09T01:07:17.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 -- start start 2024-05-09T01:07:17.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4102790 0x7f0dc4105510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc41030e0 0x7f0dc4103970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc4109300 0x7f0dc4103f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41145f0 con 0x7f0dc4109300 2024-05-09T01:07:17.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4114470 con 0x7f0dc41030e0 2024-05-09T01:07:17.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.040+0000 7f0dcbed0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4114770 con 0x7f0dc4102790 2024-05-09T01:07:17.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.042+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc41030e0 0x7f0dc4103970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.042+0000 7f0dc9c6c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4102790 0x7f0dc4105510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.042+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc41030e0 0x7f0dc4103970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47140/0 (socket says 172.21.15.37:47140) 2024-05-09T01:07:17.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.042+0000 7f0dc946b700 1 -- 172.21.15.37:0/2266687275 learned_addr learned my addr 172.21.15.37:0/2266687275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:17.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.042+0000 7f0dc9c6c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4102790 0x7f0dc4105510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41966/0 (socket says 172.21.15.37:41966) 2024-05-09T01:07:17.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.043+0000 7f0dc946b700 1 -- 172.21.15.37:0/2266687275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4102790 msgr2=0x7f0dc4105510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.043+0000 7f0dc946b700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4102790 0x7f0dc4105510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.043+0000 7f0dc946b700 1 -- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc4109300 msgr2=0x7f0dc4103f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.043+0000 7f0dc946b700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc4109300 0x7f0dc4103f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.043+0000 7f0dc946b700 1 -- 172.21.15.37:0/2266687275 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc4104780 con 0x7f0dc41030e0 2024-05-09T01:07:17.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.043+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4102790 0x7f0dc4105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:17.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.044+0000 7f0dc946b700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc41030e0 0x7f0dc4103970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0db400e9f0 tx=0x7f0db400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:17.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.045+0000 7f0dbaffd700 1 -- 172.21.15.37:0/2266687275 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db400c9c0 con 0x7f0dc41030e0 2024-05-09T01:07:17.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.045+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc419f150 con 0x7f0dc41030e0 2024-05-09T01:07:17.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.046+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc419f660 con 0x7f0dc41030e0 2024-05-09T01:07:17.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.046+0000 7f0dbaffd700 1 -- 172.21.15.37:0/2266687275 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db400cb60 con 0x7f0dc41030e0 2024-05-09T01:07:17.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.046+0000 7f0dbaffd700 1 -- 172.21.15.37:0/2266687275 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db4018680 con 0x7f0dc41030e0 2024-05-09T01:07:17.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.053+0000 7f0dbaffd700 1 -- 172.21.15.37:0/2266687275 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0db400cd10 con 0x7f0dc41030e0 2024-05-09T01:07:17.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.054+0000 7f0dda8e6b80 1 Processor -- start 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.054+0000 7f0dda8e6b80 1 -- start start 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46ed5160 0x55de46f6e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f6ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46f686a0 0x55de46f68ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dda8e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55de46e8aff0 con 0x55de46ed5160 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dda8e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55de46e297f0 con 0x55de46deb4a0 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dda8e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55de46e86fb0 con 0x55de46f686a0 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dc9c6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f6ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dc9c6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f6ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47154/0 (socket says 172.21.15.37:47154) 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/929014442 learned_addr learned my addr 172.21.15.37:0/929014442 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:17.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.055+0000 7f0dc946b700 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46f686a0 0x55de46f68ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.056+0000 7f0dca46d700 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46ed5160 0x55de46f6e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.056+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/929014442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46f686a0 msgr2=0x55de46f68ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.056+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46f686a0 0x55de46f68ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.056+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/929014442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46ed5160 msgr2=0x55de46f6e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.056+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46ed5160 0x55de46f6e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.056+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/929014442 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de46e21370 con 0x55de46deb4a0 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.056+0000 7f0dca46d700 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46ed5160 0x55de46f6e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:17.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.057+0000 7f0dbaffd700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0db00b29d0 0x7f0db00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.057+0000 7f0dbaffd700 1 -- 172.21.15.37:0/2266687275 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0db40e2260 con 0x7f0dc41030e0 2024-05-09T01:07:17.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.057+0000 7f0dca46d700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0db00b29d0 0x7f0db00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.058+0000 7f0dca46d700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0db00b29d0 0x7f0db00b4ee0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009f90 tx=0x7f0dc00096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:17.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.059+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f6ea30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0114f0 tx=0x7f0dbc011800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3df8c90738c9b589 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:17.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.060+0000 7f0daffff700 1 -- 172.21.15.37:0/929014442 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc004a30 con 0x55de46deb4a0 2024-05-09T01:07:17.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.060+0000 7f0daffff700 1 -- 172.21.15.37:0/929014442 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dbc0054d0 con 0x55de46deb4a0 2024-05-09T01:07:17.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.060+0000 7f0daffff700 1 -- 172.21.15.37:0/929014442 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00ea50 con 0x55de46deb4a0 2024-05-09T01:07:17.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.061+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/929014442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 msgr2=0x55de46f6ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.061+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f6ea30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0114f0 tx=0x7f0dbc011800 comp rx=0 tx=0).stop 2024-05-09T01:07:17.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.062+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/929014442 shutdown_connections 2024-05-09T01:07:17.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.062+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46f686a0 0x55de46f68ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.062+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46ed5160 0x55de46f6e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.062+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/929014442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f6ea30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.062+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/929014442 >> 172.21.15.37:0/929014442 conn(0x55de46e4b6a0 msgr2=0x55de46f63400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:17.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.062+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/929014442 shutdown_connections 2024-05-09T01:07:17.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.062+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/929014442 wait complete. 2024-05-09T01:07:17.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.063+0000 7f0dda8e6b80 1 -- start start 2024-05-09T01:07:17.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.063+0000 7f0dda8e6b80 1 Processor -- start 2024-05-09T01:07:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46deb4a0 0x55de46f721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46ed5160 0x55de46f726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f72c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dda8e6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55de46d06ba0 con 0x55de46f686a0 2024-05-09T01:07:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dda8e6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55de46e45150 con 0x55de46ed5160 2024-05-09T01:07:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dda8e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55de46f751d0 con 0x55de46deb4a0 2024-05-09T01:07:17.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dda8e6b80 10 client.0 _ll_register_callbacks cb 0x55de46cfc6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dc9c6c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46deb4a0 0x55de46f721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.064+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46ed5160 0x55de46f726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.065+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46ed5160 0x55de46f726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47160/0 (socket says 172.21.15.37:47160) 2024-05-09T01:07:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.065+0000 7f0dc946b700 1 -- 172.21.15.37:0/462129443 learned_addr learned my addr 172.21.15.37:0/462129443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.065+0000 7f0dc946b700 1 -- 172.21.15.37:0/462129443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46deb4a0 msgr2=0x55de46f721b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.065+0000 7f0dc946b700 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46deb4a0 0x55de46f721b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.065+0000 7f0dc946b700 1 -- 172.21.15.37:0/462129443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 msgr2=0x55de46f72c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.065+0000 7f0dc946b700 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f72c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.065+0000 7f0dc946b700 1 -- 172.21.15.37:0/462129443 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de46d06490 con 0x55de46ed5160 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.066+0000 7f0dc946b700 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46ed5160 0x55de46f726f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0db40a98b0 tx=0x7f0db40a9e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1cef98daf8e9aa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.066+0000 7f0dad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.066+0000 7f0dad7fa700 1 -- 172.21.15.37:0/462129443 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db40a9090 con 0x55de46ed5160 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.066+0000 7f0dad7fa700 1 -- 172.21.15.37:0/462129443 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0db40b22f0 con 0x55de46ed5160 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.066+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dbc0054d0 con 0x55de46ed5160 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.067+0000 7f0dad7fa700 1 -- 172.21.15.37:0/462129443 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0db40a50b0 con 0x55de46ed5160 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.067+0000 7f0dda8e6b80 10 client.25919 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.067+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55de46f90c00 con 0x55de46ed5160 2024-05-09T01:07:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.067+0000 7f0dad7fa700 1 -- 172.21.15.37:0/462129443 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dbc0054d0 con 0x55de46ed5160 2024-05-09T01:07:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.067+0000 7f0dad7fa700 1 -- 172.21.15.37:0/462129443 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f0db40a5290 con 0x55de46ed5160 2024-05-09T01:07:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.069+0000 7f0dda8e6b80 10 client.25919 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.069+0000 7f0dda8e6b80 10 client.25919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.069+0000 7f0dda8e6b80 20 client.25919 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.069+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46f95660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.069+0000 7f0dda8e6b80 4 client.25919 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.069+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de46e989d0 con 0x55de46f93240 2024-05-09T01:07:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.070+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46f95660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.071+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46f95660 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f753092c7bb63c31 server_cookie=de36a15eb061b6e3 in_seq=0 out_seq=0 2024-05-09T01:07:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.071+0000 7f0dad7fa700 10 client.25919 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.072+0000 7f0dad7fa700 1 -- 172.21.15.37:0/462129443 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55de46e989d0 con 0x55de46f93240 2024-05-09T01:07:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.072+0000 7f0dad7fa700 10 client.25919 handle_command_reply: tid=0 2024-05-09T01:07:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.072+0000 7f0dda8e6b80 1 client.25919 shutdown 2024-05-09T01:07:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.072+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46ed5160 msgr2=0x55de46f726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.072+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46ed5160 0x55de46f726f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0db40a98b0 tx=0x7f0db40a9e00 comp rx=0 tx=0).stop 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.074+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 shutdown_connections 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.074+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46f95660 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.074+0000 7f0dad7fa700 0 client.25919 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.074+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f72c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.074+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46deb4a0 0x55de46f721b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.074+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/462129443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46ed5160 0x55de46f726f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.074+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 >> 172.21.15.37:0/462129443 conn(0x55de46e4b6a0 msgr2=0x55de46f631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.075+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 shutdown_connections 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.075+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/462129443 wait complete. 2024-05-09T01:07:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.075+0000 7f0dda8e6b80 20 client.25919 trim_cache size 0 max 16384 2024-05-09T01:07:17.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.100+0000 7f0dda8e6b80 1 Processor -- start 2024-05-09T01:07:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.100+0000 7f0dda8e6b80 1 -- start start 2024-05-09T01:07:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.100+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.100+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f9b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f6be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dc9c6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dc9c6c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f9ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47162/0 (socket says 172.21.15.37:47162) 2024-05-09T01:07:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f9b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f9b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41994/0 (socket says 172.21.15.37:41994) 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/252915638 learned_addr learned my addr 172.21.15.37:0/252915638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0da800d300 con 0x55de46f686a0 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0da800ee70 con 0x55de46deb4a0 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0da800d9d0 con 0x55de46ed5160 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.101+0000 7f0dca46d700 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f6be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.102+0000 7f0dca46d700 1 -- 172.21.15.37:0/252915638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 msgr2=0x55de46f9b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.102+0000 7f0dca46d700 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f9b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.102+0000 7f0dca46d700 1 -- 172.21.15.37:0/252915638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 msgr2=0x55de46f9ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.102+0000 7f0dca46d700 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f9ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.102+0000 7f0dca46d700 1 -- 172.21.15.37:0/252915638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de46f6e050 con 0x55de46f686a0 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.102+0000 7f0dc946b700 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f9b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.102+0000 7f0dca46d700 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f6be00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0004cc0 tx=0x7f0dc0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8386409237dbb2a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.103+0000 7f0daf7fe700 1 -- 172.21.15.37:0/252915638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc002c020 con 0x55de46f686a0 2024-05-09T01:07:17.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.103+0000 7f0daf7fe700 1 -- 172.21.15.37:0/252915638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dc000bbf0 con 0x55de46f686a0 2024-05-09T01:07:17.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.103+0000 7f0daf7fe700 1 -- 172.21.15.37:0/252915638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00052a0 con 0x55de46f686a0 2024-05-09T01:07:17.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 msgr2=0x55de46f6be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f6be00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0004cc0 tx=0x7f0dc0009920 comp rx=0 tx=0).stop 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 shutdown_connections 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46f686a0 0x55de46f6be00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46deb4a0 0x55de46f9ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/252915638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f9b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 >> 172.21.15.37:0/252915638 conn(0x55de46e4b6a0 msgr2=0x55de46f6e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 shutdown_connections 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.104+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/252915638 wait complete. 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.105+0000 7f0dda8e6b80 1 -- start start 2024-05-09T01:07:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.105+0000 7f0dda8e6b80 1 Processor -- start 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.106+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46deb4a0 0x55de46f7a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.106+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f7a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.106+0000 7f0dda8e6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46f686a0 0x55de46f73500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f7a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dc946b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f7a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41998/0 (socket says 172.21.15.37:41998) 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dca46d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46f686a0 0x55de46f73500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dca46d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46f686a0 0x55de46f73500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47164/0 (socket says 172.21.15.37:47164) 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dc946b700 1 -- 172.21.15.37:0/3495978291 learned_addr learned my addr 172.21.15.37:0/3495978291 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46deb4a0 0x55de46f7a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0da800e7a0 con 0x55de46deb4a0 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0da800e0a0 con 0x55de46f686a0 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0da800b2a0 con 0x55de46ed5160 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dda8e6b80 10 client.0 _ll_register_callbacks cb 0x55de46cfc6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/3495978291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 msgr2=0x55de46f7a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.107+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f7a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46f686a0 msgr2=0x55de46f73500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46f686a0 0x55de46f73500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dc9c6c700 1 -- 172.21.15.37:0/3495978291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de46f73a40 con 0x55de46deb4a0 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dc946b700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f7a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dca46d700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46f686a0 0x55de46f73500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dc9c6c700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46deb4a0 0x55de46f7a420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e580 tx=0x7f0dbc005140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bd251a60ad123c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.108+0000 7f0dad7fa700 1 -- 172.21.15.37:0/3495978291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc003680 con 0x55de46deb4a0 2024-05-09T01:07:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.109+0000 7f0dad7fa700 1 -- 172.21.15.37:0/3495978291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0dbc003820 con 0x55de46deb4a0 2024-05-09T01:07:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.109+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dc000bbf0 con 0x55de46deb4a0 2024-05-09T01:07:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.109+0000 7f0dad7fa700 1 -- 172.21.15.37:0/3495978291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0dbc003a20 con 0x55de46deb4a0 2024-05-09T01:07:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.110+0000 7f0dda8e6b80 10 client.16113 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.110+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55de46ffd0b0 con 0x55de46deb4a0 2024-05-09T01:07:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.110+0000 7f0dad7fa700 1 -- 172.21.15.37:0/3495978291 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dbc003bc0 con 0x55de46deb4a0 2024-05-09T01:07:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.110+0000 7f0dad7fa700 1 -- 172.21.15.37:0/3495978291 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f0dbc02a130 con 0x55de46deb4a0 2024-05-09T01:07:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.111+0000 7f0dda8e6b80 10 client.16113 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.111+0000 7f0dda8e6b80 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.111+0000 7f0dda8e6b80 20 client.16113 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.111+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46fff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.111+0000 7f0dda8e6b80 4 client.16113 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.111+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0dc000bbf0 con 0x55de46f93240 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.111+0000 7f0dc946b700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46fff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.112+0000 7f0dad7fa700 10 client.16113 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.112+0000 7f0dc946b700 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46fff5f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7017135a35be2df server_cookie=5721d4fa7fc51fe2 in_seq=0 out_seq=0 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.112+0000 7f0dad7fa700 1 -- 172.21.15.37:0/3495978291 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0dc000bbf0 con 0x55de46f93240 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.112+0000 7f0dad7fa700 10 client.16113 handle_command_reply: tid=0 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.112+0000 7f0dda8e6b80 1 client.16113 shutdown 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46deb4a0 msgr2=0x55de46f7a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46deb4a0 0x55de46f7a420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00e580 tx=0x7f0dbc005140 comp rx=0 tx=0).stop 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 shutdown_connections 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55de46f93240 0x55de46fff5f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55de46f686a0 0x55de46f73500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de46deb4a0 0x55de46f7a420 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 --2- 172.21.15.37:0/3495978291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55de46ed5160 0x55de46f7a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dad7fa700 0 client.16113 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 >> 172.21.15.37:0/3495978291 conn(0x55de46e4b6a0 msgr2=0x55de46f6be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 shutdown_connections 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 1 -- 172.21.15.37:0/3495978291 wait complete. 2024-05-09T01:07:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.113+0000 7f0dda8e6b80 20 client.16113 trim_cache size 0 max 16384 2024-05-09T01:07:17.119 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.114+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0db00b29d0 msgr2=0x7f0db00b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.114+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0db00b29d0 0x7f0db00b4ee0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009f90 tx=0x7f0dc00096c0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.114+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc41030e0 msgr2=0x7f0dc4103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.114+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc41030e0 0x7f0dc4103970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0db400e9f0 tx=0x7f0db400ed00 comp rx=0 tx=0).stop 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.114+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 shutdown_connections 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.115+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0db00b29d0 0x7f0db00b4ee0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.115+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc4109300 0x7f0dc4103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.115+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dc4102790 0x7f0dc4105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.115+0000 7f0dcbed0700 1 --2- 172.21.15.37:0/2266687275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0dc41030e0 0x7f0dc4103970 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.115+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 >> 172.21.15.37:0/2266687275 conn(0x7f0dc40fe4e0 msgr2=0x7f0dc4107000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:17.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.115+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 shutdown_connections 2024-05-09T01:07:17.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:17.115+0000 7f0dcbed0700 1 -- 172.21.15.37:0/2266687275 wait complete. 2024-05-09T01:07:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:18 smithi037 ceph-mon[30122]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 MiB/s wr, 731 op/s 2024-05-09T01:07:18.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:18 smithi151 ceph-mon[34780]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 MiB/s wr, 731 op/s 2024-05-09T01:07:18.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:18 smithi136 ceph-mon[34110]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.5 MiB/s wr, 731 op/s 2024-05-09T01:07:18.900 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:07:18.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:07:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 300.0 s, 2366.2 tps, lat 42.074 ms stddev 51.144 2024-05-09T01:07:20.692 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:20 smithi037 ceph-mon[30122]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 693 op/s 2024-05-09T01:07:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:20 smithi151 ceph-mon[34780]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 693 op/s 2024-05-09T01:07:20.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:20 smithi136 ceph-mon[34110]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 693 op/s 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 -- 172.21.15.37:0/2692856691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 msgr2=0x7f11601038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 --2- 172.21.15.37:0/2692856691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 0x7f11601038d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f115000bab0 tx=0x7f115000bdc0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 -- 172.21.15.37:0/2692856691 shutdown_connections 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 --2- 172.21.15.37:0/2692856691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160108740 0x7f11601100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 --2- 172.21.15.37:0/2692856691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 0x7f11601038d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 --2- 172.21.15.37:0/2692856691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1160107df0 0x7f1160108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 -- 172.21.15.37:0/2692856691 >> 172.21.15.37:0/2692856691 conn(0x7f11600fedc0 msgr2=0x7f11601011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 -- 172.21.15.37:0/2692856691 shutdown_connections 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.212+0000 7f1166571700 1 -- 172.21.15.37:0/2692856691 wait complete. 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.213+0000 7f1166571700 1 Processor -- start 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.213+0000 7f1166571700 1 -- start start 2024-05-09T01:07:21.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1166571700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 0x7f116019f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1166571700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160107df0 0x7f1160198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1166571700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1160108740 0x7f1160199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1166571700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1160112320 con 0x7f1160107df0 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1166571700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11601121a0 con 0x7f1160108740 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1166571700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f11601124a0 con 0x7f11601034c0 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160107df0 0x7f1160198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160107df0 0x7f1160198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46468/0 (socket says 172.21.15.37:46468) 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 -- 172.21.15.37:0/202881598 learned_addr learned my addr 172.21.15.37:0/202881598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1164b0e700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1160108740 0x7f1160199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115ffff700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 0x7f116019f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 -- 172.21.15.37:0/202881598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 msgr2=0x7f116019f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 0x7f116019f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 -- 172.21.15.37:0/202881598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1160108740 msgr2=0x7f1160199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1160108740 0x7f1160199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 -- 172.21.15.37:0/202881598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1160199870 con 0x7f1160107df0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115ffff700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 0x7f116019f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f1164b0e700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1160108740 0x7f1160199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.214+0000 7f115f7fe700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160107df0 0x7f1160198a40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f114800e970 tx=0x7f114800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.215+0000 7f115d7fa700 1 -- 172.21.15.37:0/202881598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114800cbd0 con 0x7f1160107df0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.215+0000 7f115d7fa700 1 -- 172.21.15.37:0/202881598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f114800cd70 con 0x7f1160107df0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.215+0000 7f115d7fa700 1 -- 172.21.15.37:0/202881598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1148005680 con 0x7f1160107df0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.215+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f116019d560 con 0x7f1160107df0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.215+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f116019da50 con 0x7f1160107df0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.222+0000 7f115d7fa700 1 -- 172.21.15.37:0/202881598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1148004750 con 0x7f1160107df0 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.222+0000 7f1174f87b80 1 Processor -- start 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.223+0000 7f1174f87b80 1 -- start start 2024-05-09T01:07:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.223+0000 7f115d7fa700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f114c0b2a50 0x7f114c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.223+0000 7f115d7fa700 1 -- 172.21.15.37:0/202881598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f11480e23e0 con 0x7f1160107df0 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba594570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba411520 0x55f3ba594ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 0x55f3ba58eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f1174f87b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f3ba4b1070 con 0x55f3ba411520 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f1174f87b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f3ba44f870 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f1174f87b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f3ba4ad030 con 0x55f3ba58e720 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f115ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba594570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba411520 0x55f3ba594ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f115ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba594570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47192/0 (socket says 172.21.15.37:47192) 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f115ffff700 1 -- 172.21.15.37:0/736686880 learned_addr learned my addr 172.21.15.37:0/736686880 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.224+0000 7f1164b0e700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f114c0b2a50 0x7f114c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f115f7fe700 1 -- 172.21.15.37:0/736686880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 msgr2=0x55f3ba58eb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:07:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f115f7fe700 1 --2- 172.21.15.37:0/736686880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 0x55f3ba58eb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f115f7fe700 1 -- 172.21.15.37:0/736686880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 msgr2=0x55f3ba594570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f115f7fe700 1 --2- 172.21.15.37:0/736686880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba594570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f115f7fe700 1 -- 172.21.15.37:0/736686880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ba4473f0 con 0x55f3ba411520 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f115f7fe700 1 --2- 172.21.15.37:0/736686880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba411520 0x55f3ba594ab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f11480a9700 tx=0x7f11480a98e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2b451a52e051cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f11567fc700 1 -- 172.21.15.37:0/736686880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11480c2020 con 0x55f3ba411520 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f11567fc700 1 -- 172.21.15.37:0/736686880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11480bee50 con 0x55f3ba411520 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.225+0000 7f11567fc700 1 -- 172.21.15.37:0/736686880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11480cc340 con 0x55f3ba411520 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.226+0000 7f1174f87b80 1 -- 172.21.15.37:0/736686880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba411520 msgr2=0x55f3ba594ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.226+0000 7f1174f87b80 1 --2- 172.21.15.37:0/736686880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba411520 0x55f3ba594ab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f11480a9700 tx=0x7f11480a98e0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.226+0000 7f1164b0e700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f114c0b2a50 0x7f114c0b4f60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55f3ba595140 tx=0x7f115800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 -- 172.21.15.37:0/736686880 shutdown_connections 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 --2- 172.21.15.37:0/736686880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 0x55f3ba58eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 --2- 172.21.15.37:0/736686880 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba594570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 --2- 172.21.15.37:0/736686880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba411520 0x55f3ba594ab0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 -- 172.21.15.37:0/736686880 >> 172.21.15.37:0/736686880 conn(0x55f3ba471720 msgr2=0x55f3ba589480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 -- 172.21.15.37:0/736686880 shutdown_connections 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 -- 172.21.15.37:0/736686880 wait complete. 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 -- start start 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.227+0000 7f1174f87b80 1 Processor -- start 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba411520 0x55f3ba598320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba598860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1174f87b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f3ba32cc20 con 0x55f3ba58e720 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1174f87b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f3ba46b1d0 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1174f87b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f3ba59b250 con 0x55f3ba411520 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1174f87b80 10 client.0 _ll_register_callbacks cb 0x55f3ba322740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba411520 0x55f3ba598320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba411520 0x55f3ba598320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42038/0 (socket says 172.21.15.37:42038) 2024-05-09T01:07:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115ffff700 1 -- 172.21.15.37:0/1638960720 learned_addr learned my addr 172.21.15.37:0/1638960720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f1164b0e700 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115f7fe700 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba598860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115ffff700 1 -- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 msgr2=0x55f3ba598860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115ffff700 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba598860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115ffff700 1 -- 172.21.15.37:0/1638960720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 msgr2=0x55f3ba598da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.228+0000 7f115ffff700 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.229+0000 7f115ffff700 1 -- 172.21.15.37:0/1638960720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ba32c510 con 0x55f3ba411520 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.229+0000 7f115ffff700 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba411520 0x55f3ba598320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1150014870 tx=0x7f11500148a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa781c29dd51d26 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.229+0000 7f113f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.230+0000 7f113f7fe700 1 -- 172.21.15.37:0/1638960720 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150005040 con 0x55f3ba411520 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.230+0000 7f113f7fe700 1 -- 172.21.15.37:0/1638960720 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f11500051e0 con 0x55f3ba411520 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.230+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11480bee50 con 0x55f3ba411520 2024-05-09T01:07:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f113f7fe700 1 -- 172.21.15.37:0/1638960720 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f11500053e0 con 0x55f3ba411520 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 10 client.25933 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f3ba5a5cf0 con 0x55f3ba411520 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f113f7fe700 1 -- 172.21.15.37:0/1638960720 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11480bee50 con 0x55f3ba411520 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f113f7fe700 1 -- 172.21.15.37:0/1638960720 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f1150013070 con 0x55f3ba411520 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 10 client.25933 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 10 client.25933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 20 client.25933 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba5a8330 0x55f3ba5aa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 4 client.25933 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.231+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3ba4bea50 con 0x55f3ba5a8330 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.232+0000 7f115f7fe700 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba5a8330 0x55f3ba5aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.232+0000 7f113f7fe700 10 client.25933 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.233+0000 7f115f7fe700 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba5a8330 0x55f3ba5aa750 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8bedbb8b19e4b3c server_cookie=491d17cb859754eb in_seq=0 out_seq=0 2024-05-09T01:07:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f113f7fe700 1 -- 172.21.15.37:0/1638960720 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f3ba4bea50 con 0x55f3ba5a8330 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f113f7fe700 10 client.25933 handle_command_reply: tid=0 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 client.25933 shutdown 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba411520 msgr2=0x55f3ba598320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba411520 0x55f3ba598320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1150014870 tx=0x7f11500148a0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 shutdown_connections 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba5a8330 0x55f3ba5aa750 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba411520 0x55f3ba598320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 --2- 172.21.15.37:0/1638960720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba598860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 >> 172.21.15.37:0/1638960720 conn(0x55f3ba471720 msgr2=0x55f3ba589240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.234+0000 7f113f7fe700 0 client.25933 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.235+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 shutdown_connections 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.235+0000 7f1174f87b80 1 -- 172.21.15.37:0/1638960720 wait complete. 2024-05-09T01:07:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.235+0000 7f1174f87b80 20 client.25933 trim_cache size 0 max 16384 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.274+0000 7f1174f87b80 1 Processor -- start 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.274+0000 7f1174f87b80 1 -- start start 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.275+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba597660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.275+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba5928a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.275+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46484/0 (socket says 172.21.15.37:46484) 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 -- 172.21.15.37:0/3508532319 learned_addr learned my addr 172.21.15.37:0/3508532319 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.275+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11601bda60 con 0x55f3ba58e720 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11601bf5d0 con 0x55f3ba411520 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f11601be130 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 -- 172.21.15.37:0/3508532319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba4fb1e0 msgr2=0x55f3ba5928a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 --2- 172.21.15.37:0/3508532319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba5928a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 -- 172.21.15.37:0/3508532319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 msgr2=0x55f3ba597660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 --2- 172.21.15.37:0/3508532319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba597660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.276+0000 7f1164b0e700 1 -- 172.21.15.37:0/3508532319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ba5939f0 con 0x55f3ba58e720 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.277+0000 7f1164b0e700 1 --2- 172.21.15.37:0/3508532319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598be0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f115800e840 tx=0x7f1158014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9598b26a61a9db6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.278+0000 7f1155ffb700 1 -- 172.21.15.37:0/3508532319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158027030 con 0x55f3ba58e720 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.278+0000 7f1155ffb700 1 -- 172.21.15.37:0/3508532319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f115801b070 con 0x55f3ba58e720 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.278+0000 7f1155ffb700 1 -- 172.21.15.37:0/3508532319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1158023a20 con 0x55f3ba58e720 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.279+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 msgr2=0x55f3ba598be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.280+0000 7f1174f87b80 1 --2- 172.21.15.37:0/3508532319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598be0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f115800e840 tx=0x7f1158014000 comp rx=0 tx=0).stop 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.280+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 shutdown_connections 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.280+0000 7f1174f87b80 1 --2- 172.21.15.37:0/3508532319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba58e720 0x55f3ba598be0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.280+0000 7f1174f87b80 1 --2- 172.21.15.37:0/3508532319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba597660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.280+0000 7f1174f87b80 1 --2- 172.21.15.37:0/3508532319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba5928a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.280+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 >> 172.21.15.37:0/3508532319 conn(0x55f3ba471720 msgr2=0x55f3ba5999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.280+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 shutdown_connections 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.282+0000 7f1174f87b80 1 -- 172.21.15.37:0/3508532319 wait complete. 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.282+0000 7f1174f87b80 1 -- start start 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 1 Processor -- start 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba59b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba59b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 0x55f3ba59bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11601bef00 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11601be800 con 0x55f3ba411520 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f11601bba20 con 0x55f3ba58e720 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.283+0000 7f1174f87b80 10 client.0 _ll_register_callbacks cb 0x55f3ba322740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.284+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba59b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.284+0000 7f115f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba59b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46488/0 (socket says 172.21.15.37:46488) 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.284+0000 7f115f7fe700 1 -- 172.21.15.37:0/2186188939 learned_addr learned my addr 172.21.15.37:0/2186188939 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:21.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.284+0000 7f115ffff700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba59b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.284+0000 7f1164b0e700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 0x55f3ba59bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.285+0000 7f115f7fe700 1 -- 172.21.15.37:0/2186188939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 msgr2=0x55f3ba59bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.285+0000 7f115f7fe700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 0x55f3ba59bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.285+0000 7f115f7fe700 1 -- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 msgr2=0x55f3ba59b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "f3903426-f285-4768-a2a6-f0f3e264c701", 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:07:21.436 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.285+0000 7f115f7fe700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba59b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.285+0000 7f115f7fe700 1 -- 172.21.15.37:0/2186188939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ba623a50 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.285+0000 7f115ffff700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba59b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.285+0000 7f115f7fe700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba59b830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f114800c5b0 tx=0x7f114800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a08b2765a130ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.286+0000 7f113f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.286+0000 7f113f7fe700 1 -- 172.21.15.37:0/2186188939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11480c2040 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.286+0000 7f113f7fe700 1 -- 172.21.15.37:0/2186188939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f11480a5ff0 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.287+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f115801b070 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.287+0000 7f113f7fe700 1 -- 172.21.15.37:0/2186188939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f11480aa100 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.290+0000 7f1174f87b80 10 client.16131 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.290+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55f3ba624c10 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f113f7fe700 1 -- 172.21.15.37:0/2186188939 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f115801b070 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f113f7fe700 1 -- 172.21.15.37:0/2186188939 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f11480c5070 con 0x55f3ba4fb1e0 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f1174f87b80 10 client.16131 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f1174f87b80 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f1174f87b80 20 client.16131 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f1174f87b80 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba625270 0x55f3ba627690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f1174f87b80 4 client.16131 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.292+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f3ba4b8af0 con 0x55f3ba625270 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.293+0000 7f115ffff700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba625270 0x55f3ba627690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.295+0000 7f115ffff700 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba625270 0x55f3ba627690 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d801c143d66b17b7 server_cookie=d0cc7b587e3d57bf in_seq=0 out_seq=0 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.295+0000 7f113f7fe700 10 client.16131 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.297+0000 7f113f7fe700 1 -- 172.21.15.37:0/2186188939 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f3ba4b8af0 con 0x55f3ba625270 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.297+0000 7f113f7fe700 10 client.16131 handle_command_reply: tid=0 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.297+0000 7f1174f87b80 1 client.16131 shutdown 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.304+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba4fb1e0 msgr2=0x55f3ba59b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.304+0000 7f1174f87b80 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba59b830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f114800c5b0 tx=0x7f114800c6e0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 shutdown_connections 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f3ba625270 0x55f3ba627690 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3ba58e720 0x55f3ba59bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f3ba411520 0x55f3ba59b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 --2- 172.21.15.37:0/2186188939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3ba4fb1e0 0x55f3ba59b830 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 >> 172.21.15.37:0/2186188939 conn(0x55f3ba471720 msgr2=0x55f3ba5973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f113f7fe700 0 client.16131 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 shutdown_connections 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 1 -- 172.21.15.37:0/2186188939 wait complete. 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.305+0000 7f1174f87b80 20 client.16131 trim_cache size 0 max 16384 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.309+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f114c0b2a50 msgr2=0x7f114c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.309+0000 7f1166571700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f114c0b2a50 0x7f114c0b4f60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55f3ba595140 tx=0x7f115800b040 comp rx=0 tx=0).stop 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.309+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160107df0 msgr2=0x7f1160198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.309+0000 7f1166571700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160107df0 0x7f1160198a40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f114800e970 tx=0x7f114800ec80 comp rx=0 tx=0).stop 2024-05-09T01:07:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 shutdown_connections 2024-05-09T01:07:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f114c0b2a50 0x7f114c0b4f60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1160108740 0x7f1160199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11601034c0 0x7f116019f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 --2- 172.21.15.37:0/202881598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1160107df0 0x7f1160198a40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 >> 172.21.15.37:0/202881598 conn(0x7f11600fedc0 msgr2=0x7f116010fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 shutdown_connections 2024-05-09T01:07:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:21.310+0000 7f1166571700 1 -- 172.21.15.37:0/202881598 wait complete. 2024-05-09T01:07:22.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:07:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:22.720 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 801 op/s 2024-05-09T01:07:22.720 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:07:22.720 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.720 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:07:22.720 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:22 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 801 op/s 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:22 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 801 op/s 2024-05-09T01:07:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:07:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:07:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:07:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:07:22.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:07:22.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:07:22.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:22.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:22 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:07:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.940+0000 7f5796b76640 1 -- 172.21.15.37:0/3366712958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 msgr2=0x7f57901094e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.940+0000 7f5796b76640 1 --2- 172.21.15.37:0/3366712958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 0x7f57901094e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5778009900 tx=0x7f577802a3f0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.940+0000 7f5796b76640 1 -- 172.21.15.37:0/3366712958 shutdown_connections 2024-05-09T01:07:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.940+0000 7f5796b76640 1 --2- 172.21.15.37:0/3366712958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 0x7f579010be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.940+0000 7f5796b76640 1 --2- 172.21.15.37:0/3366712958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 0x7f57901094e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.941+0000 7f5796b76640 1 --2- 172.21.15.37:0/3366712958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5790104760 0x7f5790106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.941+0000 7f5796b76640 1 -- 172.21.15.37:0/3366712958 >> 172.21.15.37:0/3366712958 conn(0x7f57900fdd60 msgr2=0x7f5790100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.941+0000 7f5796b76640 1 -- 172.21.15.37:0/3366712958 shutdown_connections 2024-05-09T01:07:23.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.941+0000 7f5796b76640 1 -- 172.21.15.37:0/3366712958 wait complete. 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 Processor -- start 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 -- start start 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5790104760 0x7f57901981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 0x7f5790198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 0x7f57901a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f579010f7d0 con 0x7f5790109a20 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f579010f650 con 0x7f5790104760 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5796b76640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f579010f950 con 0x7f57901070c0 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5795113640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 0x7f57901a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5795113640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 0x7f57901a7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43026/0 (socket says 172.21.15.37:43026) 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5795113640 1 -- 172.21.15.37:0/2219861454 learned_addr learned my addr 172.21.15.37:0/2219861454 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f5794912640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5790104760 0x7f57901981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.942+0000 7f578ffff640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 0x7f5790198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5795113640 1 -- 172.21.15.37:0/2219861454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 msgr2=0x7f5790198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5795113640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 0x7f5790198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5795113640 1 -- 172.21.15.37:0/2219861454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5790104760 msgr2=0x7f57901981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5795113640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5790104760 0x7f57901981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5795113640 1 -- 172.21.15.37:0/2219861454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5790199370 con 0x7f5790109a20 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5794912640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5790104760 0x7f57901981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f578ffff640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 0x7f5790198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5795113640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 0x7f57901a7e80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f578800ccb0 tx=0x7f578800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f578dffb640 1 -- 172.21.15.37:0/2219861454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788003970 con 0x7f5790109a20 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f578dffb640 1 -- 172.21.15.37:0/2219861454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5788004030 con 0x7f5790109a20 2024-05-09T01:07:23.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.943+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5790199660 con 0x7f5790109a20 2024-05-09T01:07:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.944+0000 7f578dffb640 1 -- 172.21.15.37:0/2219861454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578800f6b0 con 0x7f5790109a20 2024-05-09T01:07:23.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.944+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5790199b80 con 0x7f5790109a20 2024-05-09T01:07:23.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.947+0000 7f579da2d740 1 Processor -- start 2024-05-09T01:07:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.948+0000 7f578dffb640 1 -- 172.21.15.37:0/2219861454 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5788003b10 con 0x7f5790109a20 2024-05-09T01:07:23.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.949+0000 7f578dffb640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f577c0b28b0 0x7f577c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f578ffff640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f577c0b28b0 0x7f577c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f578dffb640 1 -- 172.21.15.37:0/2219861454 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f57880a5e10 con 0x7f5790109a20 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f579da2d740 1 -- start start 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f578ffff640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f577c0b28b0 0x7f577c0b4dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5778031500 tx=0x7f5778000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f579da2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e01659500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f579da2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0128c2f0 0x557e01659a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f579da2d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012944d0 0x557e01660980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f579da2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e015bd7c0 con 0x557e0128c2f0 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f579da2d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557e015590e0 con 0x557e012944d0 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.950+0000 7f579da2d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e015b9780 con 0x557e012b51b0 2024-05-09T01:07:23.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e01659500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e01659500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51688/0 (socket says 172.21.15.37:51688) 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 -- 172.21.15.37:0/2578402773 learned_addr learned my addr 172.21.15.37:0/2578402773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5795113640 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012944d0 0x557e01660980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f578ffff640 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0128c2f0 0x557e01659a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 -- 172.21.15.37:0/2578402773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012944d0 msgr2=0x557e01660980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012944d0 0x557e01660980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 -- 172.21.15.37:0/2578402773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0128c2f0 msgr2=0x557e01659a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0128c2f0 0x557e01659a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 -- 172.21.15.37:0/2578402773 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e015827c0 con 0x557e012b51b0 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5795113640 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012944d0 0x557e01660980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f578ffff640 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0128c2f0 0x557e01659a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5794912640 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e01659500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f57800114f0 tx=0x7f57800119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b7537cfebaeb6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:23.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5786ffd640 1 -- 172.21.15.37:0/2578402773 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780005020 con 0x557e012b51b0 2024-05-09T01:07:23.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5786ffd640 1 -- 172.21.15.37:0/2578402773 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57800047a0 con 0x557e012b51b0 2024-05-09T01:07:23.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.951+0000 7f5786ffd640 1 -- 172.21.15.37:0/2578402773 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578000f930 con 0x557e012b51b0 2024-05-09T01:07:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.952+0000 7f579da2d740 1 -- 172.21.15.37:0/2578402773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 msgr2=0x557e01659500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.952+0000 7f579da2d740 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e01659500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f57800114f0 tx=0x7f57800119b0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.952+0000 7f579da2d740 1 -- 172.21.15.37:0/2578402773 shutdown_connections 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.952+0000 7f579da2d740 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012944d0 0x557e01660980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.952+0000 7f579da2d740 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0128c2f0 0x557e01659a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.952+0000 7f579da2d740 1 --2- 172.21.15.37:0/2578402773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e01659500 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.952+0000 7f579da2d740 1 -- 172.21.15.37:0/2578402773 >> 172.21.15.37:0/2578402773 conn(0x557e012a9300 msgr2=0x557e01654e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.953+0000 7f579da2d740 1 -- 172.21.15.37:0/2578402773 shutdown_connections 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.953+0000 7f579da2d740 1 -- 172.21.15.37:0/2578402773 wait complete. 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.953+0000 7f579da2d740 1 -- start start 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.953+0000 7f579da2d740 1 Processor -- start 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f579da2d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01663200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f579da2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01663740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f579da2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e0166a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f579da2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e016613d0 con 0x557e012944d0 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f578ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01663740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f578ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01663740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43050/0 (socket says 172.21.15.37:43050) 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f578ffff640 1 -- 172.21.15.37:0/3969290975 learned_addr learned my addr 172.21.15.37:0/3969290975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f5795113640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e0166a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.954+0000 7f5794912640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01663200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557e015449c0 con 0x557e0128c2f0 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e01661550 con 0x557e012b51b0 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f579da2d740 10 client.0 _ll_register_callbacks cb 0x557e01571020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f5795113640 1 -- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 msgr2=0x557e01663200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f5795113640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01663200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f5795113640 1 -- 172.21.15.37:0/3969290975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 msgr2=0x557e01663740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f5795113640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01663740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f5795113640 1 -- 172.21.15.37:0/3969290975 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e0156b1f0 con 0x557e012b51b0 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f578ffff640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01663740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f5795113640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e0166a6a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f57880a3ea0 tx=0x7f57880b20d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba639868d7ca95bb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:23.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f576ffff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f576ffff640 1 -- 172.21.15.37:0/3969290975 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57880a6010 con 0x557e012b51b0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.955+0000 7f576ffff640 1 -- 172.21.15.37:0/3969290975 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f57880b2510 con 0x557e012b51b0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57800047a0 con 0x557e012b51b0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f576ffff640 1 -- 172.21.15.37:0/3969290975 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f57880a61b0 con 0x557e012b51b0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 10 client.25948 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557e01320790 con 0x557e012b51b0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f576ffff640 1 -- 172.21.15.37:0/3969290975 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57800047a0 con 0x557e012b51b0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f576ffff640 1 -- 172.21.15.37:0/3969290975 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f57880a5ab0 con 0x557e012b51b0 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 10 client.25948 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 10 client.25948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 20 client.25948 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e01273d80 0x557e01670b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 4 client.25948 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:23.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.956+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e015cb3d0 con 0x557e01273d80 2024-05-09T01:07:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.957+0000 7f5794912640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e01273d80 0x557e01670b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.957+0000 7f576ffff640 10 client.25948 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:23.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.957+0000 7f5794912640 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e01273d80 0x557e01670b50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa16f38c694607c6 server_cookie=9629b72040c6f678 in_seq=0 out_seq=0 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.960+0000 7f576ffff640 1 -- 172.21.15.37:0/3969290975 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e015cb3d0 con 0x557e01273d80 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.960+0000 7f576ffff640 10 client.25948 handle_command_reply: tid=0 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.960+0000 7f579da2d740 1 client.25948 shutdown 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 msgr2=0x557e0166a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e0166a6a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f57880a3ea0 tx=0x7f57880b20d0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 shutdown_connections 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e01273d80 0x557e01670b50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012b51b0 0x557e0166a6a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01663740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 --2- 172.21.15.37:0/3969290975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01663200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 >> 172.21.15.37:0/3969290975 conn(0x557e012a9300 msgr2=0x557e01657da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f576ffff640 0 client.25948 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 shutdown_connections 2024-05-09T01:07:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 1 -- 172.21.15.37:0/3969290975 wait complete. 2024-05-09T01:07:23.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.961+0000 7f579da2d740 20 client.25948 trim_cache size 0 max 16384 2024-05-09T01:07:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 Processor -- start 2024-05-09T01:07:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 -- start start 2024-05-09T01:07:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0128c2f0 0x557e01654850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01654d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012b51b0 0x557e016618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57901b9fa0 con 0x557e012944d0 2024-05-09T01:07:23.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57901bbb10 con 0x557e012b51b0 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f579da2d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57901ba670 con 0x557e0128c2f0 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f578ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01654d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f578ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01654d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43066/0 (socket says 172.21.15.37:43066) 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f578ffff640 1 -- 172.21.15.37:0/2063790678 learned_addr learned my addr 172.21.15.37:0/2063790678 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.986+0000 7f5794912640 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0128c2f0 0x557e01654850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f5795113640 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012b51b0 0x557e016618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f5794912640 1 -- 172.21.15.37:0/2063790678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012b51b0 msgr2=0x557e016618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f5794912640 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012b51b0 0x557e016618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f5794912640 1 -- 172.21.15.37:0/2063790678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 msgr2=0x557e01654d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f5794912640 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01654d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f5794912640 1 -- 172.21.15.37:0/2063790678 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e013975f0 con 0x557e0128c2f0 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f578ffff640 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01654d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f5794912640 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0128c2f0 0x557e01654850 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57800114c0 tx=0x7f5780009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f876f37eb36243 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:23.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f57867fc640 1 -- 172.21.15.37:0/2063790678 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780004de0 con 0x557e0128c2f0 2024-05-09T01:07:23.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f57867fc640 1 -- 172.21.15.37:0/2063790678 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5780005430 con 0x557e0128c2f0 2024-05-09T01:07:23.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.987+0000 7f57867fc640 1 -- 172.21.15.37:0/2063790678 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780003d00 con 0x557e0128c2f0 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 -- 172.21.15.37:0/2063790678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0128c2f0 msgr2=0x557e01654850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0128c2f0 0x557e01654850 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57800114c0 tx=0x7f5780009290 comp rx=0 tx=0).stop 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 -- 172.21.15.37:0/2063790678 shutdown_connections 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e012b51b0 0x557e016618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012944d0 0x557e01654d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 --2- 172.21.15.37:0/2063790678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0128c2f0 0x557e01654850 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 -- 172.21.15.37:0/2063790678 >> 172.21.15.37:0/2063790678 conn(0x557e012a9300 msgr2=0x557e0165d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.988+0000 7f579da2d740 1 -- 172.21.15.37:0/2063790678 shutdown_connections 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.989+0000 7f579da2d740 1 -- 172.21.15.37:0/2063790678 wait complete. 2024-05-09T01:07:23.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.989+0000 7f579da2d740 1 -- start start 2024-05-09T01:07:23.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.989+0000 7f579da2d740 1 Processor -- start 2024-05-09T01:07:23.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f579da2d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01666b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f579da2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012944d0 0x557e016670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f579da2d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012b51b0 0x557e016d6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f579da2d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57901bb440 con 0x557e012b51b0 2024-05-09T01:07:23.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f579da2d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57901bad40 con 0x557e0128c2f0 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f579da2d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57901a0770 con 0x557e012944d0 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f579da2d740 10 client.0 _ll_register_callbacks cb 0x7f578801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f5794912640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01666b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f5794912640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01666b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51988/0 (socket says 172.21.15.37:51988) 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f5794912640 1 -- 172.21.15.37:0/1464767303 learned_addr learned my addr 172.21.15.37:0/1464767303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.990+0000 7f5795113640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012b51b0 0x557e016d6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f578ffff640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012944d0 0x557e016670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f5794912640 1 -- 172.21.15.37:0/1464767303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012944d0 msgr2=0x557e016670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f5794912640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012944d0 0x557e016670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f5794912640 1 -- 172.21.15.37:0/1464767303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012b51b0 msgr2=0x557e016d6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f5794912640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012b51b0 0x557e016d6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f5794912640 1 -- 172.21.15.37:0/1464767303 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e01581ed0 con 0x557e0128c2f0 2024-05-09T01:07:23.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f5794912640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01666b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5780009700 tx=0x7f5780005690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d100ce4153ca8a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:23.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.991+0000 7f578ffff640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012944d0 0x557e016670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:23.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.992+0000 7f576ffff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.992+0000 7f576ffff640 1 -- 172.21.15.37:0/1464767303 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780011250 con 0x557e0128c2f0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.992+0000 7f576ffff640 1 -- 172.21.15.37:0/1464767303 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5780031070 con 0x557e0128c2f0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.992+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5780005430 con 0x557e0128c2f0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.993+0000 7f576ffff640 1 -- 172.21.15.37:0/1464767303 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5780004de0 con 0x557e0128c2f0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.993+0000 7f579da2d740 10 client.25958 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.993+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x557e016d8320 con 0x557e0128c2f0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.993+0000 7f576ffff640 1 -- 172.21.15.37:0/1464767303 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5780005430 con 0x557e0128c2f0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f576ffff640 1 -- 172.21.15.37:0/1464767303 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f578002a070 con 0x557e0128c2f0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f579da2d740 10 client.25958 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f579da2d740 10 client.25958 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f579da2d740 20 client.25958 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f579da2d740 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e012491c0 0x557e016daa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f579da2d740 4 client.25958 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e015c5240 con 0x557e012491c0 2024-05-09T01:07:23.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.994+0000 7f578ffff640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e012491c0 0x557e016daa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:23.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.995+0000 7f576ffff640 10 client.25958 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:23.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:23.995+0000 7f578ffff640 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e012491c0 0x557e016daa20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f49c8c70d3896c server_cookie=fe38d3e090ea4e in_seq=0 out_seq=0 2024-05-09T01:07:24.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f576ffff640 1 -- 172.21.15.37:0/1464767303 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557e015c5240 con 0x557e012491c0 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f576ffff640 10 client.25958 handle_command_reply: tid=0 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 client.25958 shutdown 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 msgr2=0x557e01666b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01666b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5780009700 tx=0x7f5780005690 comp rx=0 tx=0).stop 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 shutdown_connections 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e012491c0 0x557e016daa20 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e012b51b0 0x557e016d6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e012944d0 0x557e016670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 --2- 172.21.15.37:0/1464767303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e0128c2f0 0x557e01666b90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 >> 172.21.15.37:0/1464767303 conn(0x557e012a9300 msgr2=0x557e016618f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f576ffff640 0 client.25958 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 shutdown_connections 2024-05-09T01:07:24.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.005+0000 7f579da2d740 1 -- 172.21.15.37:0/1464767303 wait complete. 2024-05-09T01:07:24.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f579da2d740 20 client.25958 trim_cache size 0 max 16384 2024-05-09T01:07:24.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:07:24.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:07:24.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f577c0b28b0 msgr2=0x7f577c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f577c0b28b0 0x7f577c0b4dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5778031500 tx=0x7f5778000bc0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 msgr2=0x7f57901a7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 0x7f57901a7e80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f578800ccb0 tx=0x7f578800a620 comp rx=0 tx=0).stop 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 shutdown_connections 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5790109a20 0x7f57901a7e80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57901070c0 0x7f5790198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f577c0b28b0 0x7f577c0b4dc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 --2- 172.21.15.37:0/2219861454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5790104760 0x7f57901981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 >> 172.21.15.37:0/2219861454 conn(0x7f57900fdd60 msgr2=0x7f5790102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 shutdown_connections 2024-05-09T01:07:24.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:24.006+0000 7f5796b76640 1 -- 172.21.15.37:0/2219861454 wait complete. 2024-05-09T01:07:24.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.499+0000 7f5962435700 1 -- 172.21.15.37:0/2076105516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c10b2e0 msgr2=0x7f595c117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.499+0000 7f5962435700 1 --2- 172.21.15.37:0/2076105516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c10b2e0 0x7f595c117810 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f595400b0a0 tx=0x7f595400b3b0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.500+0000 7f5962435700 1 -- 172.21.15.37:0/2076105516 shutdown_connections 2024-05-09T01:07:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.500+0000 7f5962435700 1 --2- 172.21.15.37:0/2076105516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c10b2e0 0x7f595c117810 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.500+0000 7f5962435700 1 --2- 172.21.15.37:0/2076105516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f595c110970 0x7f595c110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.500+0000 7f5962435700 1 --2- 172.21.15.37:0/2076105516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 0x7f595c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.500+0000 7f5962435700 1 -- 172.21.15.37:0/2076105516 >> 172.21.15.37:0/2076105516 conn(0x7f595c077c80 msgr2=0x7f595c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.501+0000 7f5962435700 1 -- 172.21.15.37:0/2076105516 shutdown_connections 2024-05-09T01:07:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.501+0000 7f5962435700 1 -- 172.21.15.37:0/2076105516 wait complete. 2024-05-09T01:07:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 Processor -- start 2024-05-09T01:07:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 -- start start 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 0x7f595c1a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f595c10b2e0 0x7f595c1a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c110970 0x7f595c1a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f595c11aa90 con 0x7f595c110970 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f595c11a910 con 0x7f595c10b2e0 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5962435700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f595c11ac10 con 0x7f595c10a990 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f595bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 0x7f595c1a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f59609d2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c110970 0x7f595c1a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f5953fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f595c10b2e0 0x7f595c1a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f595bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 0x7f595c1a13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51748/0 (socket says 172.21.15.37:51748) 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.502+0000 7f595bfff700 1 -- 172.21.15.37:0/4282052076 learned_addr learned my addr 172.21.15.37:0/4282052076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5953fff700 1 -- 172.21.15.37:0/4282052076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 msgr2=0x7f595c1a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5953fff700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 0x7f595c1a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5953fff700 1 -- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c110970 msgr2=0x7f595c1a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5953fff700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c110970 0x7f595c1a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5953fff700 1 -- 172.21.15.37:0/4282052076 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595c1a6290 con 0x7f595c10b2e0 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f595bfff700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 0x7f595c1a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5953fff700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f595c10b2e0 0x7f595c1a1960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f594400e9c0 tx=0x7f594400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5959ffb700 1 -- 172.21.15.37:0/4282052076 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594400cb70 con 0x7f595c10b2e0 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5959ffb700 1 -- 172.21.15.37:0/4282052076 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f594400ee60 con 0x7f595c10b2e0 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5959ffb700 1 -- 172.21.15.37:0/4282052076 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944003d60 con 0x7f595c10b2e0 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595c1a6580 con 0x7f595c10b2e0 2024-05-09T01:07:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.503+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f595c1adea0 con 0x7f595c10b2e0 2024-05-09T01:07:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.507+0000 7f5959ffb700 1 -- 172.21.15.37:0/4282052076 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5944004830 con 0x7f595c10b2e0 2024-05-09T01:07:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.509+0000 7f5959ffb700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59480b2900 0x7f59480b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.509+0000 7f5959ffb700 1 -- 172.21.15.37:0/4282052076 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f59440e21e0 con 0x7f595c10b2e0 2024-05-09T01:07:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.510+0000 7f5970e4bb80 1 Processor -- start 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.510+0000 7f595bfff700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59480b2900 0x7f59480b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.510+0000 7f5970e4bb80 1 -- start start 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.510+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db05fd00 0x5631db168240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db168780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db162400 0x5631db162810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5631db0850a0 con 0x5631dafe54a0 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5631db02a9a0 con 0x5631db162400 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5631db081060 con 0x5631db05fd00 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db168780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db168780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43102/0 (socket says 172.21.15.37:43102) 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 -- 172.21.15.37:0/427973054 learned_addr learned my addr 172.21.15.37:0/427973054 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 -- 172.21.15.37:0/427973054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db05fd00 msgr2=0x5631db168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 --2- 172.21.15.37:0/427973054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db05fd00 0x5631db168240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 -- 172.21.15.37:0/427973054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db162400 msgr2=0x5631db162810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:07:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 --2- 172.21.15.37:0/427973054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db162400 0x5631db162810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.511+0000 7f5953fff700 1 -- 172.21.15.37:0/427973054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631db01b500 con 0x5631dafe54a0 2024-05-09T01:07:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.512+0000 7f595bfff700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59480b2900 0x7f59480b4e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f594c005950 tx=0x7f594c0118e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:24.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.519+0000 7f5953fff700 1 --2- 172.21.15.37:0/427973054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db168780 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59440a5900 tx=0x7f59440a9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7aab2b370e2182 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.523+0000 7f59527fc700 1 -- 172.21.15.37:0/427973054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440a9880 con 0x5631dafe54a0 2024-05-09T01:07:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.523+0000 7f59527fc700 1 -- 172.21.15.37:0/427973054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59440e1070 con 0x5631dafe54a0 2024-05-09T01:07:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.523+0000 7f59527fc700 1 -- 172.21.15.37:0/427973054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440a9ae0 con 0x5631dafe54a0 2024-05-09T01:07:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.528+0000 7f5970e4bb80 1 -- 172.21.15.37:0/427973054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 msgr2=0x5631db168780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.528+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/427973054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db168780 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59440a5900 tx=0x7f59440a9070 comp rx=0 tx=0).stop 2024-05-09T01:07:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.530+0000 7f5970e4bb80 1 -- 172.21.15.37:0/427973054 shutdown_connections 2024-05-09T01:07:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.530+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/427973054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db162400 0x5631db162810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.530+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/427973054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db05fd00 0x5631db168240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.530+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/427973054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db168780 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.530+0000 7f5970e4bb80 1 -- 172.21.15.37:0/427973054 >> 172.21.15.37:0/427973054 conn(0x5631dafe8f70 msgr2=0x5631db15d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.533+0000 7f5970e4bb80 1 -- 172.21.15.37:0/427973054 shutdown_connections 2024-05-09T01:07:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.537+0000 7f5970e4bb80 1 -- 172.21.15.37:0/427973054 wait complete. 2024-05-09T01:07:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.538+0000 7f5970e4bb80 1 -- start start 2024-05-09T01:07:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.538+0000 7f5970e4bb80 1 Processor -- start 2024-05-09T01:07:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.538+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db16c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.538+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db16c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 0x5631db16cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5631db163100 con 0x5631db162400 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5631db01fb20 con 0x5631db05fd00 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5631db178280 con 0x5631dafe54a0 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f5970e4bb80 10 client.0 _ll_register_callbacks cb 0x5631daef66c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f595bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db16c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f595bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db16c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51770/0 (socket says 172.21.15.37:51770) 2024-05-09T01:07:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.539+0000 7f595bfff700 1 -- 172.21.15.37:0/3966942849 learned_addr learned my addr 172.21.15.37:0/3966942849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.540+0000 7f5953fff700 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db16c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.540+0000 7f595bfff700 1 -- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 msgr2=0x5631db16c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.540+0000 7f595bfff700 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db16c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.540+0000 7f595bfff700 1 -- 172.21.15.37:0/3966942849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 msgr2=0x5631db16cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:24.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.540+0000 7f595bfff700 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 0x5631db16cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.540+0000 7f595bfff700 1 -- 172.21.15.37:0/3966942849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631daf00490 con 0x5631dafe54a0 2024-05-09T01:07:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.544+0000 7f595bfff700 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db16c140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f594c0092a0 tx=0x7f594c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d1837242d39fa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.544+0000 7f593b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.544+0000 7f593b7fe700 1 -- 172.21.15.37:0/3966942849 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c017070 con 0x5631dafe54a0 2024-05-09T01:07:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.544+0000 7f593b7fe700 1 -- 172.21.15.37:0/3966942849 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f594c004a30 con 0x5631dafe54a0 2024-05-09T01:07:24.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.547+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59440e1070 con 0x5631dafe54a0 2024-05-09T01:07:24.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.548+0000 7f593b7fe700 1 -- 172.21.15.37:0/3966942849 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f594c004c70 con 0x5631dafe54a0 2024-05-09T01:07:24.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.548+0000 7f5970e4bb80 10 client.25960 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:24.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.548+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5631db179cd0 con 0x5631dafe54a0 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f593b7fe700 1 -- 172.21.15.37:0/3966942849 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f594c004e10 con 0x5631dafe54a0 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f593b7fe700 1 -- 172.21.15.37:0/3966942849 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f594c00ec70 con 0x5631dafe54a0 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f5970e4bb80 10 client.25960 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f5970e4bb80 10 client.25960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f5970e4bb80 20 client.25960 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db17c360 0x5631db17e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f5970e4bb80 4 client.25960 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:24.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.549+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f59440e1070 con 0x5631db17c360 2024-05-09T01:07:24.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.552+0000 7f5953fff700 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db17c360 0x5631db17e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.558+0000 7f593b7fe700 10 client.25960 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:24.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.558+0000 7f5953fff700 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db17c360 0x5631db17e800 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8a370d761ff9ef7 server_cookie=5f8b31efd8cebbd in_seq=0 out_seq=0 2024-05-09T01:07:24.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.559+0000 7f593b7fe700 1 -- 172.21.15.37:0/3966942849 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f59440e1070 con 0x5631db17c360 2024-05-09T01:07:24.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.559+0000 7f593b7fe700 10 client.25960 handle_command_reply: tid=0 2024-05-09T01:07:24.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.559+0000 7f5970e4bb80 1 client.25960 shutdown 2024-05-09T01:07:24.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.559+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 msgr2=0x5631db16c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db16c140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f594c0092a0 tx=0x7f594c004750 comp rx=0 tx=0).stop 2024-05-09T01:07:24.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 shutdown_connections 2024-05-09T01:07:24.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db17c360 0x5631db17e800 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 0x5631db16cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db16c140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/3966942849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db16c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f593b7fe700 0 client.25960 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 >> 172.21.15.37:0/3966942849 conn(0x5631dafe8f70 msgr2=0x5631db156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 shutdown_connections 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 1 -- 172.21.15.37:0/3966942849 wait complete. 2024-05-09T01:07:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.560+0000 7f5970e4bb80 20 client.25960 trim_cache size 0 max 16384 2024-05-09T01:07:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 Processor -- start 2024-05-09T01:07:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 -- start start 2024-05-09T01:07:24.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:24 smithi037 ceph-mon[30122]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 829 op/s 2024-05-09T01:07:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db184000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db184540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db162400 0x5631db156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f595c1b5250 con 0x5631dafe54a0 2024-05-09T01:07:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f595c1b6dc0 con 0x5631db05fd00 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.594+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f595c1b5920 con 0x5631db162400 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f595bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db184000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f595bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db184000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43122/0 (socket says 172.21.15.37:43122) 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f595bfff700 1 -- 172.21.15.37:0/507384892 learned_addr learned my addr 172.21.15.37:0/507384892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f5953fff700 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db184540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f59609d2700 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db162400 0x5631db156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f5953fff700 1 -- 172.21.15.37:0/507384892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db162400 msgr2=0x5631db156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f5953fff700 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db162400 0x5631db156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f5953fff700 1 -- 172.21.15.37:0/507384892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 msgr2=0x5631db184000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f5953fff700 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db184000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f5953fff700 1 -- 172.21.15.37:0/507384892 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631db16bf10 con 0x5631db05fd00 2024-05-09T01:07:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.595+0000 7f5953fff700 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db184540 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5631db15ea00 tx=0x7f59440a9070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f6c2ac14f409f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:24.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.596+0000 7f5951ffb700 1 -- 172.21.15.37:0/507384892 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440c5070 con 0x5631db05fd00 2024-05-09T01:07:24.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.596+0000 7f5951ffb700 1 -- 172.21.15.37:0/507384892 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59440e1070 con 0x5631db05fd00 2024-05-09T01:07:24.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.596+0000 7f5951ffb700 1 -- 172.21.15.37:0/507384892 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440cc1d0 con 0x5631db05fd00 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.598+0000 7f5970e4bb80 1 -- 172.21.15.37:0/507384892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 msgr2=0x5631db184540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.598+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db184540 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5631db15ea00 tx=0x7f59440a9070 comp rx=0 tx=0).stop 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.598+0000 7f5970e4bb80 1 -- 172.21.15.37:0/507384892 shutdown_connections 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631db162400 0x5631db156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631dafe54a0 0x5631db184000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/507384892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db184540 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 -- 172.21.15.37:0/507384892 >> 172.21.15.37:0/507384892 conn(0x5631dafe8f70 msgr2=0x5631db16aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 -- 172.21.15.37:0/507384892 shutdown_connections 2024-05-09T01:07:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 -- 172.21.15.37:0/507384892 wait complete. 2024-05-09T01:07:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 -- start start 2024-05-09T01:07:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.599+0000 7f5970e4bb80 1 Processor -- start 2024-05-09T01:07:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db174430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db168a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f5970e4bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 0x5631db168fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f595c1b66f0 con 0x5631db162400 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f595c1b5ff0 con 0x5631db05fd00 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f5970e4bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f595c1b3210 con 0x5631dafe54a0 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f5970e4bb80 10 client.0 _ll_register_callbacks cb 0x5631db15d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.600+0000 7f595bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db174430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f595bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db174430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51792/0 (socket says 172.21.15.37:51792) 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f595bfff700 1 -- 172.21.15.37:0/39783266 learned_addr learned my addr 172.21.15.37:0/39783266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f5953fff700 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db168a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f5953fff700 1 -- 172.21.15.37:0/39783266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 msgr2=0x5631db174430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f5953fff700 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db174430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f5953fff700 1 -- 172.21.15.37:0/39783266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 msgr2=0x5631db168fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f5953fff700 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 0x5631db168fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.601+0000 7f5953fff700 1 -- 172.21.15.37:0/39783266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631db1694f0 con 0x5631db05fd00 2024-05-09T01:07:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.602+0000 7f5953fff700 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db168a70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59440b21b0 tx=0x7f59440b2050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8be0918e596859b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.602+0000 7f593b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:07:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.602+0000 7f593b7fe700 1 -- 172.21.15.37:0/39783266 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440c5070 con 0x5631db05fd00 2024-05-09T01:07:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.602+0000 7f593b7fe700 1 -- 172.21.15.37:0/39783266 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f59440cc0b0 con 0x5631db05fd00 2024-05-09T01:07:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.602+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59440e1070 con 0x5631db05fd00 2024-05-09T01:07:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f593b7fe700 1 -- 172.21.15.37:0/39783266 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f59440a9880 con 0x5631db05fd00 2024-05-09T01:07:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 10 client.25970 fetch_fsmap learned FSMap version 38 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5631db1e6870 con 0x5631db05fd00 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f593b7fe700 1 -- 172.21.15.37:0/39783266 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59440dfdb0 con 0x5631db05fd00 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f593b7fe700 1 -- 172.21.15.37:0/39783266 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 38) ==== 8358+0+0 (secure 0 0 0) 0x7f59440a8ae0 con 0x5631db05fd00 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 10 client.25970 fetch_fsmap finished waiting for FSMap version 38 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 10 client.25970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 20 client.25970 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db1e6a40 0x5631db1e8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 4 client.25970 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.603+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f59440e1070 con 0x5631db1e6a40 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.604+0000 7f595bfff700 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db1e6a40 0x5631db1e8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.604+0000 7f593b7fe700 10 client.25970 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f595bfff700 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db1e6a40 0x5631db1e8e60 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8a471c325c309aa server_cookie=c83097a53ba8a287 in_seq=0 out_seq=0 2024-05-09T01:07:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f593b7fe700 1 -- 172.21.15.37:0/39783266 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f59440e1070 con 0x5631db1e6a40 2024-05-09T01:07:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f593b7fe700 10 client.25970 handle_command_reply: tid=0 2024-05-09T01:07:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 client.25970 shutdown 2024-05-09T01:07:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 msgr2=0x5631db168a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db168a70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59440b21b0 tx=0x7f59440b2050 comp rx=0 tx=0).stop 2024-05-09T01:07:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 shutdown_connections 2024-05-09T01:07:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5631db1e6a40 0x5631db1e8e60 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f593b7fe700 0 client.25970 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631db162400 0x5631db168fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631dafe54a0 0x5631db174430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 --2- 172.21.15.37:0/39783266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631db05fd00 0x5631db168a70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 >> 172.21.15.37:0/39783266 conn(0x5631dafe8f70 msgr2=0x5631db156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 shutdown_connections 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.605+0000 7f5970e4bb80 1 -- 172.21.15.37:0/39783266 wait complete. 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.606+0000 7f5970e4bb80 20 client.25970 trim_cache size 0 max 16384 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:07:24.609 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:07:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: "f3903426-f285-4768-a2a6-f0f3e264c701": { 2024-05-09T01:07:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:07:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "f3903426-f285-4768-a2a6-f0f3e264c701", 2024-05-09T01:07:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:07:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:07:24.610 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:07:24.610 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.606+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59480b2900 msgr2=0x7f59480b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.606+0000 7f5962435700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59480b2900 0x7f59480b4e10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f594c005950 tx=0x7f594c0118e0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.606+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f595c10b2e0 msgr2=0x7f595c1a1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.606+0000 7f5962435700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f595c10b2e0 0x7f595c1a1960 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f594400e9c0 tx=0x7f594400ecd0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 shutdown_connections 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f59480b2900 0x7f59480b4e10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c110970 0x7f595c1a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f595c10a990 0x7f595c1a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 --2- 172.21.15.37:0/4282052076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f595c10b2e0 0x7f595c1a1960 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 >> 172.21.15.37:0/4282052076 conn(0x7f595c077c80 msgr2=0x7f595c07b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 shutdown_connections 2024-05-09T01:07:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:24.607+0000 7f5962435700 1 -- 172.21.15.37:0/4282052076 wait complete. 2024-05-09T01:07:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:24 smithi151 ceph-mon[34780]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 829 op/s 2024-05-09T01:07:24.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:24 smithi136 ceph-mon[34110]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 19 MiB/s wr, 829 op/s 2024-05-09T01:07:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 305.0 s, 2259.8 tps, lat 44.426 ms stddev 56.472 2024-05-09T01:07:25.639 INFO:tasks.cephfs.filesystem:scrub status for tag:f3903426-f285-4768-a2a6-f0f3e264c701 - {'path': '/', 'tag': 'f3903426-f285-4768-a2a6-f0f3e264c701', 'options': 'recursive,force'} 2024-05-09T01:07:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:26 smithi151 ceph-mon[34780]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 21 MiB/s wr, 866 op/s 2024-05-09T01:07:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:26 smithi136 ceph-mon[34110]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 21 MiB/s wr, 866 op/s 2024-05-09T01:07:26.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:26 smithi037 ceph-mon[30122]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 21 MiB/s wr, 866 op/s 2024-05-09T01:07:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:28 smithi136 ceph-mon[34110]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 21 MiB/s wr, 877 op/s 2024-05-09T01:07:28.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:28 smithi151 ceph-mon[34780]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 21 MiB/s wr, 877 op/s 2024-05-09T01:07:28.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:28 smithi037 ceph-mon[30122]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 21 MiB/s wr, 877 op/s 2024-05-09T01:07:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 310.0 s, 2383.0 tps, lat 42.019 ms stddev 51.446 2024-05-09T01:07:30.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:30 smithi037 ceph-mon[30122]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 19 MiB/s wr, 761 op/s 2024-05-09T01:07:30.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:30 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:07:30.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:30 smithi136 ceph-mon[34110]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 19 MiB/s wr, 761 op/s 2024-05-09T01:07:30.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:30 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:07:30.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:30 smithi151 ceph-mon[34780]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 19 MiB/s wr, 761 op/s 2024-05-09T01:07:30.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:30 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:07:32.777 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:32 smithi151 ceph-mon[34780]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 863 op/s 2024-05-09T01:07:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:32 smithi136 ceph-mon[34110]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 863 op/s 2024-05-09T01:07:32.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:32 smithi037 ceph-mon[30122]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 21 MiB/s wr, 863 op/s 2024-05-09T01:07:33.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:07:33.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:07:33.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:07:33.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:07:33.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:33 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:07:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:07:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:07:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:07:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:07:33.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:33 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:07:33.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:07:33.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:07:33.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:07:33.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:07:33.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:33 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:07:34.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:34 smithi136 ceph-mon[34110]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 20 MiB/s wr, 828 op/s 2024-05-09T01:07:34.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:34 smithi037 ceph-mon[30122]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 20 MiB/s wr, 828 op/s 2024-05-09T01:07:34.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:34 smithi151 ceph-mon[34780]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 20 MiB/s wr, 828 op/s 2024-05-09T01:07:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 315.0 s, 2553.6 tps, lat 38.455 ms stddev 44.787 2024-05-09T01:07:35.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:35 smithi136 ceph-mon[34110]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 760 op/s 2024-05-09T01:07:35.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:35 smithi037 ceph-mon[30122]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 760 op/s 2024-05-09T01:07:35.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:35 smithi151 ceph-mon[34780]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 760 op/s 2024-05-09T01:07:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.151+0000 7f0db7c4c640 1 -- 172.21.15.37:0/1434195913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0102b70 msgr2=0x7f0db0103870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.151+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/1434195913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0102b70 0x7f0db0103870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00fb10 tx=0x7f0dac02e570 comp rx=0 tx=0).stop 2024-05-09T01:07:37.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.151+0000 7f0db7c4c640 1 -- 172.21.15.37:0/1434195913 shutdown_connections 2024-05-09T01:07:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.151+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/1434195913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db0108ab0 0x7f0db010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.151+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/1434195913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0103db0 0x7f0db01041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.151+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/1434195913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0102b70 0x7f0db0103870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.151+0000 7f0db7c4c640 1 -- 172.21.15.37:0/1434195913 >> 172.21.15.37:0/1434195913 conn(0x7f0db00fdd60 msgr2=0x7f0db0100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.152+0000 7f0db7c4c640 1 -- 172.21.15.37:0/1434195913 shutdown_connections 2024-05-09T01:07:37.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.152+0000 7f0db7c4c640 1 -- 172.21.15.37:0/1434195913 wait complete. 2024-05-09T01:07:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.153+0000 7f0db7c4c640 1 Processor -- start 2024-05-09T01:07:37.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.153+0000 7f0db7c4c640 1 -- start start 2024-05-09T01:07:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.154+0000 7f0db7c4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0102b70 0x7f0db01a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db7c4c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0103db0 0x7f0db01a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db7c4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db0108ab0 0x7f0db01a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db7c4c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010d590 con 0x7f0db0108ab0 2024-05-09T01:07:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db7c4c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010d410 con 0x7f0db0103db0 2024-05-09T01:07:37.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db7c4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0db010d710 con 0x7f0db0102b70 2024-05-09T01:07:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db51e7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0103db0 0x7f0db01a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db51e7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0103db0 0x7f0db01a0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55518/0 (socket says 172.21.15.37:55518) 2024-05-09T01:07:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db51e7640 1 -- 172.21.15.37:0/2909175343 learned_addr learned my addr 172.21.15.37:0/2909175343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db0108ab0 0x7f0db01a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.155+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0102b70 0x7f0db01a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db51e7640 1 -- 172.21.15.37:0/2909175343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0102b70 msgr2=0x7f0db01a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db51e7640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0102b70 0x7f0db01a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db51e7640 1 -- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db0108ab0 msgr2=0x7f0db01a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db51e7640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db0108ab0 0x7f0db01a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db51e7640 1 -- 172.21.15.37:0/2909175343 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db01a84c0 con 0x7f0db0103db0 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0102b70 0x7f0db01a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db51e7640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0103db0 0x7f0db01a0ec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0da000e9f0 tx=0x7f0da000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0da6ffd640 1 -- 172.21.15.37:0/2909175343 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da000cd80 con 0x7f0db0103db0 2024-05-09T01:07:37.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0da6ffd640 1 -- 172.21.15.37:0/2909175343 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0da00054d0 con 0x7f0db0103db0 2024-05-09T01:07:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0da6ffd640 1 -- 172.21.15.37:0/2909175343 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0010430 con 0x7f0db0103db0 2024-05-09T01:07:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db01a87b0 con 0x7f0db0103db0 2024-05-09T01:07:37.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.156+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db01a8cb0 con 0x7f0db0103db0 2024-05-09T01:07:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.161+0000 7f0dbebdd740 1 Processor -- start 2024-05-09T01:07:37.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0dbebdd740 1 -- start start 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100f61b0 0x558e1049a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100cd2f0 0x558e1049aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100d54d0 0x558e104a1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0db61e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100f61b0 0x558e1049a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0db61e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100f61b0 0x558e1049a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33204/0 (socket says 172.21.15.37:33204) 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0db59e8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100cd2f0 0x558e1049aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0db59e8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100cd2f0 0x558e1049aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59370/0 (socket says 172.21.15.37:59370) 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0da6ffd640 1 -- 172.21.15.37:0/2909175343 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0da00105f0 con 0x7f0db0103db0 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0db61e9640 1 -- 172.21.15.37:0/3307169918 learned_addr learned my addr 172.21.15.37:0/3307169918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e103fe7c0 con 0x558e100f61b0 2024-05-09T01:07:37.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558e1039a0e0 con 0x558e100d54d0 2024-05-09T01:07:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.162+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558e103fa780 con 0x558e100cd2f0 2024-05-09T01:07:37.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.163+0000 7f0db51e7640 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100d54d0 0x558e104a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.163+0000 7f0db59e8640 1 -- 172.21.15.37:0/3307169918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100d54d0 msgr2=0x558e104a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.163+0000 7f0db59e8640 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100d54d0 0x558e104a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.163+0000 7f0db59e8640 1 -- 172.21.15.37:0/3307169918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100f61b0 msgr2=0x558e1049a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.163+0000 7f0db59e8640 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100f61b0 0x558e1049a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.163+0000 7f0db59e8640 1 -- 172.21.15.37:0/3307169918 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e103c37c0 con 0x558e100cd2f0 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.164+0000 7f0db59e8640 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100cd2f0 0x558e1049aa80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0dac02ea90 tx=0x7f0dac004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4104fef859ebe4fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.164+0000 7f0d9bfff640 1 -- 172.21.15.37:0/3307169918 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac043070 con 0x558e100cd2f0 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.164+0000 7f0d9bfff640 1 -- 172.21.15.37:0/3307169918 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dac00e5c0 con 0x558e100cd2f0 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.164+0000 7f0d9bfff640 1 -- 172.21.15.37:0/3307169918 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00f370 con 0x558e100cd2f0 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.164+0000 7f0da6ffd640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0d9c0b2860 0x7f0d9c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.165+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0d9c0b2860 0x7f0d9c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.165+0000 7f0da6ffd640 1 -- 172.21.15.37:0/2909175343 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0da00e25e0 con 0x7f0db0103db0 2024-05-09T01:07:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100cd2f0 msgr2=0x558e1049aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100cd2f0 0x558e1049aa80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0dac02ea90 tx=0x7f0dac004af0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0d9c0b2860 0x7f0d9c0b4d70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x558e1049b6d0 tx=0x7f0da800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 shutdown_connections 2024-05-09T01:07:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100d54d0 0x558e104a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100cd2f0 0x558e1049aa80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/3307169918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100f61b0 0x558e1049a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 >> 172.21.15.37:0/3307169918 conn(0x558e100ea300 msgr2=0x558e10495e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.166+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 shutdown_connections 2024-05-09T01:07:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.167+0000 7f0dbebdd740 1 -- 172.21.15.37:0/3307169918 wait complete. 2024-05-09T01:07:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.167+0000 7f0dbebdd740 1 -- start start 2024-05-09T01:07:37.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.168+0000 7f0dbebdd740 1 Processor -- start 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e104a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100d54d0 0x558e104a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100f61b0 0x558e104ab670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e104a2370 con 0x558e100d54d0 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558e103859c0 con 0x558e100cd2f0 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558e104a24f0 con 0x558e100f61b0 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0db59e8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e104a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0dbebdd740 10 client.0 _ll_register_callbacks cb 0x558e103b2020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0db59e8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e104a41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55550/0 (socket says 172.21.15.37:55550) 2024-05-09T01:07:37.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0db59e8640 1 -- 172.21.15.37:0/2908608682 learned_addr learned my addr 172.21.15.37:0/2908608682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:37.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.169+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100f61b0 0x558e104ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0db61e9640 1 -- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 msgr2=0x558e104a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e104a41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0db61e9640 1 -- 172.21.15.37:0/2908608682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100d54d0 msgr2=0x558e104a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100d54d0 0x558e104a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0db61e9640 1 -- 172.21.15.37:0/2908608682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e103ac1f0 con 0x558e100f61b0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e104a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100f61b0 0x558e104ab670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0da8015d60 tx=0x7f0da8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6c5b64c817de8d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0d997fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0d997fa640 1 -- 172.21.15.37:0/2908608682 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8028070 con 0x558e100f61b0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0d997fa640 1 -- 172.21.15.37:0/2908608682 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0da8017980 con 0x558e100f61b0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.170+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dac00e5c0 con 0x558e100f61b0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0d997fa640 1 -- 172.21.15.37:0/2908608682 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0da8034050 con 0x558e100f61b0 2024-05-09T01:07:37.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0dbebdd740 10 client.25978 fetch_fsmap learned FSMap version 39 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x558e10161790 con 0x558e100f61b0 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0d997fa640 1 -- 172.21.15.37:0/2908608682 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dac00e5c0 con 0x558e100f61b0 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0d997fa640 1 -- 172.21.15.37:0/2908608682 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f0da80233c0 con 0x558e100f61b0 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0dbebdd740 10 client.25978 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0dbebdd740 10 client.25978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0dbebdd740 20 client.25978 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.171+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100b4d80 0x558e104b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.172+0000 7f0dbebdd740 4 client.25978 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.172+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e1040c3d0 con 0x558e100b4d80 2024-05-09T01:07:37.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.172+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100b4d80 0x558e104b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.172+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100b4d80 0x558e104b1c70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed20aa6dc2ab1185 server_cookie=58dd3bd6e593b2e6 in_seq=0 out_seq=0 2024-05-09T01:07:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.173+0000 7f0d997fa640 10 client.25978 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.173+0000 7f0d997fa640 1 -- 172.21.15.37:0/2908608682 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558e1040c3d0 con 0x558e100b4d80 2024-05-09T01:07:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.173+0000 7f0d997fa640 10 client.25978 handle_command_reply: tid=0 2024-05-09T01:07:37.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 client.25978 shutdown 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100f61b0 msgr2=0x558e104ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100f61b0 0x558e104ab670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0da8015d60 tx=0x7f0da8004ab0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 shutdown_connections 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100b4d80 0x558e104b1c70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100f61b0 0x558e104ab670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100d54d0 0x558e104a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2908608682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e104a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0d997fa640 0 client.25978 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:37.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.174+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 >> 172.21.15.37:0/2908608682 conn(0x558e100ea300 msgr2=0x558e10498da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.175+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 shutdown_connections 2024-05-09T01:07:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.175+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2908608682 wait complete. 2024-05-09T01:07:37.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.176+0000 7f0dbebdd740 20 client.25978 trim_cache size 0 max 16384 2024-05-09T01:07:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.200+0000 7f0dbebdd740 1 Processor -- start 2024-05-09T01:07:37.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.200+0000 7f0dbebdd740 1 -- start start 2024-05-09T01:07:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100b4d80 0x558e1049d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e1049dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e104ab590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01a8ff0 con 0x558e100b4d80 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01aab30 con 0x558e100cd2f0 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01a96c0 con 0x558e100d54d0 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0db59e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100b4d80 0x558e1049d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0db59e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100b4d80 0x558e1049d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33222/0 (socket says 172.21.15.37:33222) 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0db59e8640 1 -- 172.21.15.37:0/2483900137 learned_addr learned my addr 172.21.15.37:0/2483900137 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0db51e7640 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e1049dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.201+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e104ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0db59e8640 1 -- 172.21.15.37:0/2483900137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 msgr2=0x558e104ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e104ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0db59e8640 1 -- 172.21.15.37:0/2483900137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 msgr2=0x558e1049dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e1049dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0db59e8640 1 -- 172.21.15.37:0/2483900137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e101d85f0 con 0x558e100b4d80 2024-05-09T01:07:37.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100b4d80 0x558e1049d710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0dac005940 tx=0x7f0dac005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d948eff0a1e11e09 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0d9b7fe640 1 -- 172.21.15.37:0/2483900137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac043040 con 0x558e100b4d80 2024-05-09T01:07:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0d9b7fe640 1 -- 172.21.15.37:0/2483900137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dac05a020 con 0x558e100b4d80 2024-05-09T01:07:37.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.202+0000 7f0d9b7fe640 1 -- 172.21.15.37:0/2483900137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac004ef0 con 0x558e100b4d80 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.203+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2483900137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100b4d80 msgr2=0x558e1049d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.203+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100b4d80 0x558e1049d710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f0dac005940 tx=0x7f0dac005fd0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.203+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2483900137 shutdown_connections 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.203+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e104ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.203+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100cd2f0 0x558e1049dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.203+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2483900137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100b4d80 0x558e1049d710 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.203+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2483900137 >> 172.21.15.37:0/2483900137 conn(0x558e100ea300 msgr2=0x558e1049e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.204+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2483900137 shutdown_connections 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.205+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2483900137 wait complete. 2024-05-09T01:07:37.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.205+0000 7f0dbebdd740 1 -- start start 2024-05-09T01:07:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.205+0000 7f0dbebdd740 1 Processor -- start 2024-05-09T01:07:37.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100b4d80 0x558e104a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100cd2f0 0x558e104a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0dbebdd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e10518010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01aa460 con 0x558e100cd2f0 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01a9d90 con 0x558e100b4d80 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0dbebdd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0db01994c0 con 0x558e100d54d0 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0dbebdd740 10 client.0 _ll_register_callbacks cb 0x7f0da801b050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0db59e8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100b4d80 0x558e104a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0db61e9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e10518010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0db61e9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e10518010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59396/0 (socket says 172.21.15.37:59396) 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0db61e9640 1 -- 172.21.15.37:0/2209620921 learned_addr learned my addr 172.21.15.37:0/2209620921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.206+0000 7f0db51e7640 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100cd2f0 0x558e104a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0db61e9640 1 -- 172.21.15.37:0/2209620921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100b4d80 msgr2=0x558e104a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100b4d80 0x558e104a8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0db61e9640 1 -- 172.21.15.37:0/2209620921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100cd2f0 msgr2=0x558e104a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100cd2f0 0x558e104a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0db61e9640 1 -- 172.21.15.37:0/2209620921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e103c2ed0 con 0x558e100d54d0 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0db61e9640 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e10518010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0da80237b0 tx=0x7f0da80235f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef0af234331e665d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0d997fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.207+0000 7f0d997fa640 1 -- 172.21.15.37:0/2209620921 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da803c020 con 0x558e100d54d0 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.208+0000 7f0d997fa640 1 -- 172.21.15.37:0/2209620921 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0da8017780 con 0x558e100d54d0 2024-05-09T01:07:37.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.208+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dac05a020 con 0x558e100d54d0 2024-05-09T01:07:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.208+0000 7f0d997fa640 1 -- 172.21.15.37:0/2209620921 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0da8028040 con 0x558e100d54d0 2024-05-09T01:07:37.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.208+0000 7f0dbebdd740 10 client.25984 fetch_fsmap learned FSMap version 39 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.208+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x558e10519230 con 0x558e100d54d0 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.208+0000 7f0d997fa640 1 -- 172.21.15.37:0/2209620921 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dac05a020 con 0x558e100d54d0 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0d997fa640 1 -- 172.21.15.37:0/2209620921 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f0da80248e0 con 0x558e100d54d0 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0dbebdd740 10 client.25984 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0dbebdd740 10 client.25984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0dbebdd740 20 client.25984 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100f61b0 0x558e1051bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0dbebdd740 4 client.25984 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558e10406240 con 0x558e100f61b0 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100f61b0 0x558e1051bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0d997fa640 10 client.25984 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:37.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.209+0000 7f0db59e8640 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100f61b0 0x558e1051bbc0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d8ac16b0b6797 server_cookie=e301f818a089fb92 in_seq=0 out_seq=0 2024-05-09T01:07:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.249+0000 7f0d997fa640 1 -- 172.21.15.37:0/2209620921 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x558e10406240 con 0x558e100f61b0 2024-05-09T01:07:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.249+0000 7f0d997fa640 10 client.25984 handle_command_reply: tid=0 2024-05-09T01:07:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.249+0000 7f0dbebdd740 1 client.25984 shutdown 2024-05-09T01:07:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.249+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 msgr2=0x558e10518010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.249+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e10518010 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0da80237b0 tx=0x7f0da80235f0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.249+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 shutdown_connections 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558e100f61b0 0x558e1051bbc0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e100d54d0 0x558e10518010 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0d997fa640 0 client.25984 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e100cd2f0 0x558e104a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 1 --2- 172.21.15.37:0/2209620921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558e100b4d80 0x558e104a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 >> 172.21.15.37:0/2209620921 conn(0x558e100ea300 msgr2=0x558e1049e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 shutdown_connections 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 1 -- 172.21.15.37:0/2209620921 wait complete. 2024-05-09T01:07:37.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.250+0000 7f0dbebdd740 20 client.25984 trim_cache size 0 max 16384 2024-05-09T01:07:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:07:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:07:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:07:37.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0d9c0b2860 msgr2=0x7f0d9c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0d9c0b2860 0x7f0d9c0b4d70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x558e1049b6d0 tx=0x7f0da800d040 comp rx=0 tx=0).stop 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0103db0 msgr2=0x7f0db01a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0103db0 0x7f0db01a0ec0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0da000e9f0 tx=0x7f0da000edf0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 shutdown_connections 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0db0108ab0 0x7f0db01a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0d9c0b2860 0x7f0d9c0b4d70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0db0103db0 0x7f0db01a0ec0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 --2- 172.21.15.37:0/2909175343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db0102b70 0x7f0db01a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.251+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 >> 172.21.15.37:0/2909175343 conn(0x7f0db00fdd60 msgr2=0x7f0db0104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.252+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 shutdown_connections 2024-05-09T01:07:37.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:37.252+0000 7f0db7c4c640 1 -- 172.21.15.37:0/2909175343 wait complete. 2024-05-09T01:07:38.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:38 smithi037 ceph-mon[30122]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 777 op/s 2024-05-09T01:07:38.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:38 smithi151 ceph-mon[34780]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 777 op/s 2024-05-09T01:07:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:38 smithi136 ceph-mon[34110]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 777 op/s 2024-05-09T01:07:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 320.0 s, 2838.0 tps, lat 35.757 ms stddev 47.660 2024-05-09T01:07:40.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:40 smithi037 ceph-mon[30122]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 674 op/s 2024-05-09T01:07:40.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:40 smithi151 ceph-mon[34780]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 674 op/s 2024-05-09T01:07:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:40 smithi136 ceph-mon[34110]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 16 MiB/s wr, 674 op/s 2024-05-09T01:07:42.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:42 smithi037 ceph-mon[30122]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 18 MiB/s wr, 780 op/s 2024-05-09T01:07:42.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:42 smithi151 ceph-mon[34780]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 18 MiB/s wr, 780 op/s 2024-05-09T01:07:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:42 smithi136 ceph-mon[34110]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 18 MiB/s wr, 780 op/s 2024-05-09T01:07:44.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:44 smithi037 ceph-mon[30122]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 MiB/s wr, 937 op/s 2024-05-09T01:07:44.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:44 smithi151 ceph-mon[34780]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 MiB/s wr, 937 op/s 2024-05-09T01:07:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:44 smithi136 ceph-mon[34110]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 22 MiB/s wr, 937 op/s 2024-05-09T01:07:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 325.0 s, 441.8 tps, lat 60.706 ms stddev 151.023 2024-05-09T01:07:46.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:46 smithi037 ceph-mon[30122]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 1.19k op/s 2024-05-09T01:07:46.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:46 smithi151 ceph-mon[34780]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 1.19k op/s 2024-05-09T01:07:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:46 smithi136 ceph-mon[34110]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 30 MiB/s wr, 1.19k op/s 2024-05-09T01:07:48.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:48 smithi037 ceph-mon[30122]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 36 MiB/s wr, 1.34k op/s 2024-05-09T01:07:48.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:48 smithi151 ceph-mon[34780]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 36 MiB/s wr, 1.34k op/s 2024-05-09T01:07:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:48 smithi136 ceph-mon[34110]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 36 MiB/s wr, 1.34k op/s 2024-05-09T01:07:49.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:49 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:07:49.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:49 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:07:49.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:49 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:07:50.236 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 330.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-05-09T01:07:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 -- 172.21.15.37:0/3473564962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 msgr2=0x7f97381041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 --2- 172.21.15.37:0/3473564962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f97381041a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f972c009900 tx=0x7f972c02a410 comp rx=0 tx=0).stop 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 -- 172.21.15.37:0/3473564962 shutdown_connections 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 --2- 172.21.15.37:0/3473564962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9738108a90 0x7f973810aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 --2- 172.21.15.37:0/3473564962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f97381041a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 --2- 172.21.15.37:0/3473564962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9738102b50 0x7f9738103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 -- 172.21.15.37:0/3473564962 >> 172.21.15.37:0/3473564962 conn(0x7f97380fdd40 msgr2=0x7f97381001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 -- 172.21.15.37:0/3473564962 shutdown_connections 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.363+0000 7f973d97d640 1 -- 172.21.15.37:0/3473564962 wait complete. 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 Processor -- start 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 -- start start 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9738102b50 0x7f973819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f973819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9738108a90 0x7f97381a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f973810f7e0 con 0x7f9738103d90 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f973810f660 con 0x7f9738108a90 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f973d97d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f973810f960 con 0x7f9738102b50 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f97367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f973819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f97367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f973819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33612/0 (socket says 172.21.15.37:33612) 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f97367fc640 1 -- 172.21.15.37:0/2122038328 learned_addr learned my addr 172.21.15.37:0/2122038328 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f97377fe640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9738108a90 0x7f97381a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.364+0000 7f9736ffd640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9738102b50 0x7f973819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f97367fc640 1 -- 172.21.15.37:0/2122038328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9738102b50 msgr2=0x7f973819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f97367fc640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9738102b50 0x7f973819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f97367fc640 1 -- 172.21.15.37:0/2122038328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9738108a90 msgr2=0x7f97381a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f97367fc640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9738108a90 0x7f97381a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f97367fc640 1 -- 172.21.15.37:0/2122038328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97381a1f10 con 0x7f9738103d90 2024-05-09T01:07:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f97367fc640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f973819a980 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f972c006010 tx=0x7f972c004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f973c97b640 1 -- 172.21.15.37:0/2122038328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c03f030 con 0x7f9738103d90 2024-05-09T01:07:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f973c97b640 1 -- 172.21.15.37:0/2122038328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f972c003cb0 con 0x7f9738103d90 2024-05-09T01:07:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97381a21a0 con 0x7f9738103d90 2024-05-09T01:07:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f973c97b640 1 -- 172.21.15.37:0/2122038328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c035070 con 0x7f9738103d90 2024-05-09T01:07:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.365+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97381a2760 con 0x7f9738103d90 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f973c97b640 1 -- 172.21.15.37:0/2122038328 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f972c042030 con 0x7f9738103d90 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 Processor -- start 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 -- start start 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a7f9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4344d0 0x55aa8a800980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aa8a75d7c0 con 0x55aa8a42c2f0 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55aa8a6f90e0 con 0x55aa8a4344d0 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9744833740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55aa8a759780 con 0x55aa8a4551b0 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9736ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9736ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7f9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33628/0 (socket says 172.21.15.37:33628) 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f9736ffd640 1 -- 172.21.15.37:0/334150617 learned_addr learned my addr 172.21.15.37:0/334150617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f97367fc640 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4344d0 0x55aa8a800980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.368+0000 7f97377fe640 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a7f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f9736ffd640 1 -- 172.21.15.37:0/334150617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 msgr2=0x55aa8a7f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f9736ffd640 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a7f9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f9736ffd640 1 -- 172.21.15.37:0/334150617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4344d0 msgr2=0x55aa8a800980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f9736ffd640 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4344d0 0x55aa8a800980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f9736ffd640 1 -- 172.21.15.37:0/334150617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa8a7227c0 con 0x55aa8a42c2f0 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f973c97b640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97200b2860 0x7f97200b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f9736ffd640 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7f9a80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f972800b7c0 tx=0x7f972800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689a208e1b37c696 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f97377fe640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97200b2860 0x7f97200b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f973c97b640 1 -- 172.21.15.37:0/2122038328 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f972c102780 con 0x7f9738103d90 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f971dffb640 1 -- 172.21.15.37:0/334150617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972800d950 con 0x55aa8a42c2f0 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f971dffb640 1 -- 172.21.15.37:0/334150617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9728018070 con 0x55aa8a42c2f0 2024-05-09T01:07:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.369+0000 7f971dffb640 1 -- 172.21.15.37:0/334150617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97280123e0 con 0x55aa8a42c2f0 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 -- 172.21.15.37:0/334150617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 msgr2=0x55aa8a7f9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f97377fe640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97200b2860 0x7f97200b4d70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55aa8a7fa6d0 tx=0x7f9730009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7f9a80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f972800b7c0 tx=0x7f972800bc80 comp rx=0 tx=0).stop 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 -- 172.21.15.37:0/334150617 shutdown_connections 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4344d0 0x55aa8a800980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7f9a80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 --2- 172.21.15.37:0/334150617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a7f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 -- 172.21.15.37:0/334150617 >> 172.21.15.37:0/334150617 conn(0x55aa8a449300 msgr2=0x55aa8a7f4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 -- 172.21.15.37:0/334150617 shutdown_connections 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 -- 172.21.15.37:0/334150617 wait complete. 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.370+0000 7f9744833740 1 -- start start 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 1 Processor -- start 2024-05-09T01:07:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a42c2f0 0x55aa8a8031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a803710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a80a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aa8a8013d0 con 0x55aa8a4344d0 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55aa8a6e49c0 con 0x55aa8a4551b0 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55aa8a801550 con 0x55aa8a42c2f0 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9744833740 10 client.0 _ll_register_callbacks cb 0x55aa8a711020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a803710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a803710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33642/0 (socket says 172.21.15.37:33642) 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97367fc640 1 -- 172.21.15.37:0/137226197 learned_addr learned my addr 172.21.15.37:0/137226197 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97377fe640 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a80a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f9736ffd640 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a42c2f0 0x55aa8a8031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97367fc640 1 -- 172.21.15.37:0/137226197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a42c2f0 msgr2=0x55aa8a8031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97367fc640 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a42c2f0 0x55aa8a8031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97367fc640 1 -- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 msgr2=0x55aa8a80a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.371+0000 7f97367fc640 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a80a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f97367fc640 1 -- 172.21.15.37:0/137226197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa8a70b1f0 con 0x55aa8a4344d0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f97367fc640 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a803710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f972c0c9dd0 tx=0x7f972c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66ba5fe71129316 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9716ffd640 1 -- 172.21.15.37:0/137226197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0cc020 con 0x55aa8a4344d0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9716ffd640 1 -- 172.21.15.37:0/137226197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f972c0c60d0 con 0x55aa8a4344d0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9728018070 con 0x55aa8a4344d0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9716ffd640 1 -- 172.21.15.37:0/137226197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f972c049070 con 0x55aa8a4344d0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 10 client.16185 fetch_fsmap learned FSMap version 39 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55aa8a4c0790 con 0x55aa8a4344d0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9716ffd640 1 -- 172.21.15.37:0/137226197 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9728018070 con 0x55aa8a4344d0 2024-05-09T01:07:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9716ffd640 1 -- 172.21.15.37:0/137226197 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f972c0ca0a0 con 0x55aa8a4344d0 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 10 client.16185 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 10 client.16185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 20 client.16185 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a413d80 0x55aa8a810ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 4 client.16185 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.372+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa8a76b3d0 con 0x55aa8a413d80 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.373+0000 7f9736ffd640 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a413d80 0x55aa8a810ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.373+0000 7f9716ffd640 10 client.16185 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.373+0000 7f9736ffd640 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a413d80 0x55aa8a810ba0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a06ecf0213f88e55 server_cookie=4858b2dfcd2d63e9 in_seq=0 out_seq=0 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9716ffd640 1 -- 172.21.15.37:0/137226197 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa8a76b3d0 con 0x55aa8a413d80 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9716ffd640 10 client.16185 handle_command_reply: tid=0 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 client.16185 shutdown 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 msgr2=0x55aa8a803710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a803710 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f972c0c9dd0 tx=0x7f972c004530 comp rx=0 tx=0).stop 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 shutdown_connections 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a413d80 0x55aa8a810ba0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a80a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a803710 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 --2- 172.21.15.37:0/137226197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a42c2f0 0x55aa8a8031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9716ffd640 0 client.16185 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 >> 172.21.15.37:0/137226197 conn(0x55aa8a449300 msgr2=0x55aa8a7f3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 shutdown_connections 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 1 -- 172.21.15.37:0/137226197 wait complete. 2024-05-09T01:07:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.374+0000 7f9744833740 20 client.16185 trim_cache size 0 max 16384 2024-05-09T01:07:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.389+0000 7f9744833740 1 Processor -- start 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.389+0000 7f9744833740 1 -- start start 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9744833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9744833740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4344d0 0x55aa8a7fd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9744833740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a7fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9744833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ab260 con 0x55aa8a42c2f0 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9744833740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97381acda0 con 0x55aa8a4551b0 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9744833740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ab930 con 0x55aa8a4344d0 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7fcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33652/0 (socket says 172.21.15.37:33652) 2024-05-09T01:07:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 -- 172.21.15.37:0/42428902 learned_addr learned my addr 172.21.15.37:0/42428902 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f97377fe640 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a7fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 -- 172.21.15.37:0/42428902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4344d0 msgr2=0x55aa8a7fd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f97367fc640 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4344d0 0x55aa8a7fd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4344d0 0x55aa8a7fd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 -- 172.21.15.37:0/42428902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 msgr2=0x55aa8a7fdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a7fdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 -- 172.21.15.37:0/42428902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa8a5375f0 con 0x55aa8a42c2f0 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f97377fe640 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a7fdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f9736ffd640 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7fcd80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9728008010 tx=0x7f9728006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348023cfbf5e8347 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f971d7fa640 1 -- 172.21.15.37:0/42428902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972802d070 con 0x55aa8a42c2f0 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f971d7fa640 1 -- 172.21.15.37:0/42428902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9728022070 con 0x55aa8a42c2f0 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.390+0000 7f971d7fa640 1 -- 172.21.15.37:0/42428902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728027aa0 con 0x55aa8a42c2f0 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 -- 172.21.15.37:0/42428902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 msgr2=0x55aa8a7fcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7fcd80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9728008010 tx=0x7f9728006a30 comp rx=0 tx=0).stop 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 -- 172.21.15.37:0/42428902 shutdown_connections 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a4551b0 0x55aa8a7fdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4344d0 0x55aa8a7fd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 --2- 172.21.15.37:0/42428902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a42c2f0 0x55aa8a7fcd80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 -- 172.21.15.37:0/42428902 >> 172.21.15.37:0/42428902 conn(0x55aa8a449300 msgr2=0x55aa8a8018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 -- 172.21.15.37:0/42428902 shutdown_connections 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.391+0000 7f9744833740 1 -- 172.21.15.37:0/42428902 wait complete. 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 -- start start 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 Processor -- start 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a42c2f0 0x55aa8a807230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a807770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a8086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ac6d0 con 0x55aa8a4344d0 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97381ac000 con 0x55aa8a42c2f0 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97381a9240 con 0x55aa8a4551b0 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9744833740 10 client.0 _ll_register_callbacks cb 0x7f972c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a807770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97367fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a807770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33668/0 (socket says 172.21.15.37:33668) 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97367fc640 1 -- 172.21.15.37:0/737064280 learned_addr learned my addr 172.21.15.37:0/737064280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97377fe640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a8086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f9736ffd640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a42c2f0 0x55aa8a807230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97367fc640 1 -- 172.21.15.37:0/737064280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 msgr2=0x55aa8a8086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97367fc640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a8086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97367fc640 1 -- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a42c2f0 msgr2=0x55aa8a807230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.392+0000 7f97367fc640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a42c2f0 0x55aa8a807230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f97367fc640 1 -- 172.21.15.37:0/737064280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa8a721ed0 con 0x55aa8a4344d0 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9736ffd640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a42c2f0 0x55aa8a807230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f97367fc640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a807770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f972c102c00 tx=0x7f972c0e4660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ffda3b76a2f1cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9716ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:07:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9716ffd640 1 -- 172.21.15.37:0/737064280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972c0a8070 con 0x55aa8a4344d0 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9716ffd640 1 -- 172.21.15.37:0/737064280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f972c0c6430 con 0x55aa8a4344d0 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9728022070 con 0x55aa8a4344d0 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9716ffd640 1 -- 172.21.15.37:0/737064280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f972c0d7050 con 0x55aa8a4344d0 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 10 client.16191 fetch_fsmap learned FSMap version 39 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55aa8a809dc0 con 0x55aa8a4344d0 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9716ffd640 1 -- 172.21.15.37:0/737064280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9728022070 con 0x55aa8a4344d0 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9716ffd640 1 -- 172.21.15.37:0/737064280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f972c0ca0a0 con 0x55aa8a4344d0 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 10 client.16191 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 20 client.16191 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a3e91c0 0x55aa8a87b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 4 client.16191 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:07:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.393+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa8a765240 con 0x55aa8a3e91c0 2024-05-09T01:07:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.394+0000 7f9736ffd640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a3e91c0 0x55aa8a87b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.394+0000 7f9716ffd640 10 client.16191 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:50.394+0000 7f9736ffd640 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a3e91c0 0x55aa8a87b3c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bda60e75cb695fd5 server_cookie=913bf9cc2c2bf97c in_seq=0 out_seq=0 2024-05-09T01:07:50.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 34 MiB/s wr, 1.21k op/s 2024-05-09T01:07:50.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi136 to 176.2M 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: Unable to set osd_memory_target on smithi136 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:07:50.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 34 MiB/s wr, 1.21k op/s 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi136 to 176.2M 2024-05-09T01:07:50.476 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-09T01:07:50.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: Unable to set osd_memory_target on smithi136 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-09T01:07:50.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-09T01:07:50.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:07:50.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:07:50.477 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:07:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 34 MiB/s wr, 1.21k op/s 2024-05-09T01:07:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi136 to 176.2M 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: Unable to set osd_memory_target on smithi136 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:07:50.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:07:52.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:52 smithi037 ceph-mon[30122]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 35 MiB/s wr, 1.21k op/s 2024-05-09T01:07:52.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:52 smithi151 ceph-mon[34780]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 35 MiB/s wr, 1.21k op/s 2024-05-09T01:07:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:52 smithi136 ceph-mon[34110]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 35 MiB/s wr, 1.21k op/s 2024-05-09T01:07:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9716ffd640 1 -- 172.21.15.37:0/737064280 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55aa8a765240 con 0x55aa8a3e91c0 2024-05-09T01:07:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9716ffd640 10 client.16191 handle_command_reply: tid=0 2024-05-09T01:07:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 client.16191 shutdown 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 msgr2=0x55aa8a807770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a807770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f972c102c00 tx=0x7f972c0e4660 comp rx=0 tx=0).stop 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 shutdown_connections 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa8a3e91c0 0x55aa8a87b3c0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa8a4551b0 0x55aa8a8086a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa8a4344d0 0x55aa8a807770 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 --2- 172.21.15.37:0/737064280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa8a42c2f0 0x55aa8a807230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 >> 172.21.15.37:0/737064280 conn(0x55aa8a449300 msgr2=0x55aa8a8018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.207+0000 7f9716ffd640 0 client.16191 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.208+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 shutdown_connections 2024-05-09T01:07:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.208+0000 7f9744833740 1 -- 172.21.15.37:0/737064280 wait complete. 2024-05-09T01:07:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.208+0000 7f9744833740 20 client.16191 trim_cache size 0 max 16384 2024-05-09T01:07:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:07:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:07:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97200b2860 msgr2=0x7f97200b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97200b2860 0x7f97200b4d70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55aa8a7fa6d0 tx=0x7f9730009600 comp rx=0 tx=0).stop 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 msgr2=0x7f973819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f973819a980 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f972c006010 tx=0x7f972c004340 comp rx=0 tx=0).stop 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 shutdown_connections 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97200b2860 0x7f97200b4d70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9738108a90 0x7f97381a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9738103d90 0x7f973819a980 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 --2- 172.21.15.37:0/2122038328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9738102b50 0x7f973819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:54.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 >> 172.21.15.37:0/2122038328 conn(0x7f97380fdd40 msgr2=0x7f9738104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:54.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 shutdown_connections 2024-05-09T01:07:54.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:07:54.209+0000 7f973d97d640 1 -- 172.21.15.37:0/2122038328 wait complete. 2024-05-09T01:07:54.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:54 smithi037 ceph-mon[30122]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 32 MiB/s wr, 1.06k op/s 2024-05-09T01:07:54.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:54 smithi151 ceph-mon[34780]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 32 MiB/s wr, 1.06k op/s 2024-05-09T01:07:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:54 smithi136 ceph-mon[34110]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 32 MiB/s wr, 1.06k op/s 2024-05-09T01:07:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 335.0 s, 520.0 tps, lat 524.177 ms stddev 2344.021 2024-05-09T01:07:55.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:07:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:07:56.442 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:56 smithi037 ceph-mon[30122]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 24 MiB/s wr, 762 op/s 2024-05-09T01:07:56.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:56 smithi151 ceph-mon[34780]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 24 MiB/s wr, 762 op/s 2024-05-09T01:07:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:56 smithi136 ceph-mon[34110]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 24 MiB/s wr, 762 op/s 2024-05-09T01:07:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 -- 172.21.15.37:0/1244741780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 msgr2=0x7f2914109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 --2- 172.21.15.37:0/1244741780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 0x7f2914109310 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f29000099c0 tx=0x7f2900009cd0 comp rx=0 tx=0).stop 2024-05-09T01:07:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 -- 172.21.15.37:0/1244741780 shutdown_connections 2024-05-09T01:07:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 --2- 172.21.15.37:0/1244741780 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2914109850 0x7f29141111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 --2- 172.21.15.37:0/1244741780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29141045d0 0x7f29141049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 --2- 172.21.15.37:0/1244741780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 0x7f2914109310 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 -- 172.21.15.37:0/1244741780 >> 172.21.15.37:0/1244741780 conn(0x7f29140ffea0 msgr2=0x7f29141022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:58.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 -- 172.21.15.37:0/1244741780 shutdown_connections 2024-05-09T01:07:58.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.998+0000 7f291af40700 1 -- 172.21.15.37:0/1244741780 wait complete. 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 Processor -- start 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 -- start start 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29141045d0 0x7f291419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 0x7f291419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2914109850 0x7f2914198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29141123a0 con 0x7f2914108f00 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2914112220 con 0x7f29141045d0 2024-05-09T01:07:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f291af40700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2914112520 con 0x7f2914109850 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f2918cdc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29141045d0 0x7f291419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f2913fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 0x7f291419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f2918cdc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29141045d0 0x7f291419e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43074/0 (socket says 172.21.15.37:43074) 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f2918cdc700 1 -- 172.21.15.37:0/2465407128 learned_addr learned my addr 172.21.15.37:0/2465407128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:57.999+0000 7f29194dd700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2914109850 0x7f2914198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2918cdc700 1 -- 172.21.15.37:0/2465407128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2914109850 msgr2=0x7f2914198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2918cdc700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2914109850 0x7f2914198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2918cdc700 1 -- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 msgr2=0x7f291419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2918cdc700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 0x7f291419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2918cdc700 1 -- 172.21.15.37:0/2465407128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2914199170 con 0x7f29141045d0 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2918cdc700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29141045d0 0x7f291419e8a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f290800d980 tx=0x7f290800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2911ffb700 1 -- 172.21.15.37:0/2465407128 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908016070 con 0x7f29141045d0 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2914199460 con 0x7f29141045d0 2024-05-09T01:07:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2911ffb700 1 -- 172.21.15.37:0/2465407128 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2908004830 con 0x7f29141045d0 2024-05-09T01:07:58.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.000+0000 7f2911ffb700 1 -- 172.21.15.37:0/2465407128 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908005560 con 0x7f29141045d0 2024-05-09T01:07:58.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.001+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29141a5730 con 0x7f29141045d0 2024-05-09T01:07:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.004+0000 7f2911ffb700 1 -- 172.21.15.37:0/2465407128 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2908004220 con 0x7f29141045d0 2024-05-09T01:07:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.005+0000 7f2911ffb700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b6d50 0x7f29040b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.006+0000 7f2911ffb700 1 -- 172.21.15.37:0/2465407128 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f29080e1f30 con 0x7f29141045d0 2024-05-09T01:07:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.006+0000 7f2913fff700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b6d50 0x7f29040b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 Processor -- start 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 -- start start 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a79950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a79ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a7e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a76798aff0 con 0x55a767a7e000 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a7679297f0 con 0x55a7678eb4a0 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.007+0000 7f2929956b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a767986fb0 con 0x55a7679d5160 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a7e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a7e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42770/0 (socket says 172.21.15.37:42770) 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 -- 172.21.15.37:0/192529490 learned_addr learned my addr 172.21.15.37:0/192529490 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 -- 172.21.15.37:0/192529490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 msgr2=0x55a767a79950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 --2- 172.21.15.37:0/192529490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a79950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 -- 172.21.15.37:0/192529490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 msgr2=0x55a767a79ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:07:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 --2- 172.21.15.37:0/192529490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a79ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.008+0000 7f29194dd700 1 -- 172.21.15.37:0/192529490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a767921370 con 0x55a767a7e000 2024-05-09T01:07:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.009+0000 7f2913fff700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b6d50 0x7f29040b9260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2900009990 tx=0x7f290001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.009+0000 7f29194dd700 1 --2- 172.21.15.37:0/192529490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a7e410 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f290c033690 tx=0x7f290c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f1e25100bea9c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.009+0000 7f28feffd700 1 -- 172.21.15.37:0/192529490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c03b030 con 0x55a767a7e000 2024-05-09T01:07:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.009+0000 7f28feffd700 1 -- 172.21.15.37:0/192529490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f290c0093a0 con 0x55a767a7e000 2024-05-09T01:07:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.010+0000 7f28feffd700 1 -- 172.21.15.37:0/192529490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c007500 con 0x55a767a7e000 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 -- 172.21.15.37:0/192529490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 msgr2=0x55a767a7e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 --2- 172.21.15.37:0/192529490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a7e410 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f290c033690 tx=0x7f290c009920 comp rx=0 tx=0).stop 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 -- 172.21.15.37:0/192529490 shutdown_connections 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 --2- 172.21.15.37:0/192529490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a7e410 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 --2- 172.21.15.37:0/192529490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a79950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 --2- 172.21.15.37:0/192529490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a79ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 -- 172.21.15.37:0/192529490 >> 172.21.15.37:0/192529490 conn(0x55a76794b6a0 msgr2=0x55a767a63400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 -- 172.21.15.37:0/192529490 shutdown_connections 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 -- 172.21.15.37:0/192529490 wait complete. 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.011+0000 7f2929956b80 1 -- start start 2024-05-09T01:07:58.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 1 Processor -- start 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7678eb4a0 0x55a767a704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a70a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a6b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a767806ba0 con 0x55a7678eb4a0 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a767945150 con 0x55a767a7e000 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a767a7ee50 con 0x55a7679d5160 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2929956b80 10 client.0 _ll_register_callbacks cb 0x55a7677fc6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2913fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a70a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2913fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a70a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48378/0 (socket says 172.21.15.37:48378) 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2913fff700 1 -- 172.21.15.37:0/3222570317 learned_addr learned my addr 172.21.15.37:0/3222570317 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f29194dd700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a6b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.012+0000 7f2918cdc700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7678eb4a0 0x55a767a704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2913fff700 1 -- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 msgr2=0x55a767a6b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2913fff700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a6b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2913fff700 1 -- 172.21.15.37:0/3222570317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7678eb4a0 msgr2=0x55a767a704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2913fff700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7678eb4a0 0x55a767a704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2913fff700 1 -- 172.21.15.37:0/3222570317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a767806490 con 0x55a7679d5160 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2918cdc700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7678eb4a0 0x55a767a704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f29194dd700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a6b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2913fff700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a70a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f291406c110 tx=0x7f2900009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cbe278c9d35fb7d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f28f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f28f3fff700 1 -- 172.21.15.37:0/3222570317 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900034060 con 0x55a7679d5160 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a7679989d0 con 0x55a7679d5160 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f28f3fff700 1 -- 172.21.15.37:0/3222570317 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f290000b790 con 0x55a7679d5160 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.013+0000 7f28f3fff700 1 -- 172.21.15.37:0/3222570317 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2900003e20 con 0x55a7679d5160 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 10 client.26005 fetch_fsmap learned FSMap version 39 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a767a78f60 con 0x55a7679d5160 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f28f3fff700 1 -- 172.21.15.37:0/3222570317 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a7679989d0 con 0x55a7679d5160 2024-05-09T01:07:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f28f3fff700 1 -- 172.21.15.37:0/3222570317 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f2900039070 con 0x55a7679d5160 2024-05-09T01:07:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 10 client.26005 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:07:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 10 client.26005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 20 client.26005 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767a791f0 0x55a767a84570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 4 client.26005 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:07:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.014+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a767992a70 con 0x55a767a791f0 2024-05-09T01:07:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.015+0000 7f2918cdc700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767a791f0 0x55a767a84570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.016+0000 7f28f3fff700 10 client.26005 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.016+0000 7f2918cdc700 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767a791f0 0x55a767a84570 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95a5ef652bb68aa server_cookie=f8c00e162ebd674c in_seq=0 out_seq=0 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.016+0000 7f28f3fff700 1 -- 172.21.15.37:0/3222570317 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a767992a70 con 0x55a767a791f0 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.016+0000 7f28f3fff700 10 client.26005 handle_command_reply: tid=0 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.016+0000 7f2929956b80 1 client.26005 shutdown 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 msgr2=0x55a767a70a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a70a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f291406c110 tx=0x7f2900009310 comp rx=0 tx=0).stop 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 shutdown_connections 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767a791f0 0x55a767a84570 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a6b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7678eb4a0 0x55a767a704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 --2- 172.21.15.37:0/3222570317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a70a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 >> 172.21.15.37:0/3222570317 conn(0x55a76794b6a0 msgr2=0x55a767a631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f28f3fff700 0 client.26005 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 shutdown_connections 2024-05-09T01:07:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 1 -- 172.21.15.37:0/3222570317 wait complete. 2024-05-09T01:07:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.017+0000 7f2929956b80 20 client.26005 trim_cache size 0 max 16384 2024-05-09T01:07:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.045+0000 7f2929956b80 1 Processor -- start 2024-05-09T01:07:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.045+0000 7f2929956b80 1 -- start start 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f2929956b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7678eb4a0 0x55a767a6fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f2929956b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7679d5160 0x55a767a7f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f2929956b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a89ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f2929956b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2914074250 con 0x55a7679d5160 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f2929956b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f29141a5ca0 con 0x55a767a7e000 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f2929956b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2914074920 con 0x55a7678eb4a0 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f29194dd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a89ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f2918cdc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7678eb4a0 0x55a767a6fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f29194dd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a89ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43092/0 (socket says 172.21.15.37:43092) 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.046+0000 7f29194dd700 1 -- 172.21.15.37:0/4063920673 learned_addr learned my addr 172.21.15.37:0/4063920673 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2913fff700 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7679d5160 0x55a767a7f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2918cdc700 1 -- 172.21.15.37:0/4063920673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 msgr2=0x55a767a89ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2918cdc700 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a89ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2918cdc700 1 -- 172.21.15.37:0/4063920673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7679d5160 msgr2=0x55a767a7f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2918cdc700 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7679d5160 0x55a767a7f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2918cdc700 1 -- 172.21.15.37:0/4063920673 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a767a69e30 con 0x55a7678eb4a0 2024-05-09T01:07:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2913fff700 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7679d5160 0x55a767a7f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:07:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f2918cdc700 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7678eb4a0 0x55a767a6fd50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2908000c00 tx=0x7f2908091040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db400fcb28b26d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f28fe7fc700 1 -- 172.21.15.37:0/4063920673 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080b23b0 con 0x55a7678eb4a0 2024-05-09T01:07:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f28fe7fc700 1 -- 172.21.15.37:0/4063920673 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29080dfe50 con 0x55a7678eb4a0 2024-05-09T01:07:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.047+0000 7f28fe7fc700 1 -- 172.21.15.37:0/4063920673 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080a9a10 con 0x55a7678eb4a0 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 -- 172.21.15.37:0/4063920673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7678eb4a0 msgr2=0x55a767a6fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7678eb4a0 0x55a767a6fd50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2908000c00 tx=0x7f2908091040 comp rx=0 tx=0).stop 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 -- 172.21.15.37:0/4063920673 shutdown_connections 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a767a7e000 0x55a767a89ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7678eb4a0 0x55a767a6fd50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 --2- 172.21.15.37:0/4063920673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a7679d5160 0x55a767a7f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 -- 172.21.15.37:0/4063920673 >> 172.21.15.37:0/4063920673 conn(0x55a76794b6a0 msgr2=0x55a767a7efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 -- 172.21.15.37:0/4063920673 shutdown_connections 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.048+0000 7f2929956b80 1 -- 172.21.15.37:0/4063920673 wait complete. 2024-05-09T01:07:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.049+0000 7f2929956b80 1 -- start start 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.049+0000 7f2929956b80 1 Processor -- start 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.049+0000 7f2929956b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a77ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.049+0000 7f2929956b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a71390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.049+0000 7f2929956b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a719e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2929956b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29140756c0 con 0x55a767a7e000 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2929956b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2914074ff0 con 0x55a7678eb4a0 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2929956b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2914072210 con 0x55a7679d5160 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2929956b80 10 client.0 _ll_register_callbacks cb 0x55a7677fc6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a71390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2918cdc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a77ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a71390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48396/0 (socket says 172.21.15.37:48396) 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2918cdc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a77ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43094/0 (socket says 172.21.15.37:43094) 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 -- 172.21.15.37:0/4091522401 learned_addr learned my addr 172.21.15.37:0/4091522401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:07:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f29194dd700 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 -- 172.21.15.37:0/4091522401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 msgr2=0x55a767a77ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a77ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 -- 172.21.15.37:0/4091522401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 msgr2=0x55a767a719e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a719e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.050+0000 7f2913fff700 1 -- 172.21.15.37:0/4091522401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a767a72180 con 0x55a7679d5160 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f2913fff700 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a71390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29000099c0 tx=0x7f2900024410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e73dcd9d784fa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f28f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f28f3fff700 1 -- 172.21.15.37:0/4091522401 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290003f020 con 0x55a7679d5160 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29080dfe50 con 0x55a7679d5160 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f28f3fff700 1 -- 172.21.15.37:0/4091522401 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f290000b9a0 con 0x55a7679d5160 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f28f3fff700 1 -- 172.21.15.37:0/4091522401 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f290000bba0 con 0x55a7679d5160 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f2929956b80 10 client.26011 fetch_fsmap learned FSMap version 39 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a767aec850 con 0x55a7679d5160 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f28f3fff700 1 -- 172.21.15.37:0/4091522401 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29080dfe50 con 0x55a7679d5160 2024-05-09T01:07:58.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.051+0000 7f28f3fff700 1 -- 172.21.15.37:0/4091522401 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f2900039040 con 0x55a7679d5160 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2929956b80 10 client.26011 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2929956b80 10 client.26011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2929956b80 20 client.26011 populate_metadata read hostname 'smithi037' 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2929956b80 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767aece20 0x55a767aef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2929956b80 4 client.26011 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a767806970 con 0x55a767aece20 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2918cdc700 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767aece20 0x55a767aef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f28f3fff700 10 client.26011 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f2918cdc700 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767aece20 0x55a767aef240 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbf8520367c24d83 server_cookie=b63fc2c8cf1df13c in_seq=0 out_seq=0 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f28f3fff700 1 -- 172.21.15.37:0/4091522401 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a767806970 con 0x55a767aece20 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.052+0000 7f28f3fff700 10 client.26011 handle_command_reply: tid=0 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 client.26011 shutdown 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 msgr2=0x55a767a71390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a71390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29000099c0 tx=0x7f2900024410 comp rx=0 tx=0).stop 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 shutdown_connections 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a767aece20 0x55a767aef240 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a767a7e000 0x55a767a719e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a7678eb4a0 0x55a767a77ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 --2- 172.21.15.37:0/4091522401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7679d5160 0x55a767a71390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f28f3fff700 0 client.26011 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 >> 172.21.15.37:0/4091522401 conn(0x55a76794b6a0 msgr2=0x55a767a6a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 shutdown_connections 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 1 -- 172.21.15.37:0/4091522401 wait complete. 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.053+0000 7f2929956b80 20 client.26011 trim_cache size 0 max 16384 2024-05-09T01:07:58.059 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:07:58.060 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:07:58.060 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:07:58.060 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b6d50 msgr2=0x7f29040b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b6d50 0x7f29040b9260 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2900009990 tx=0x7f290001a040 comp rx=0 tx=0).stop 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29141045d0 msgr2=0x7f291419e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29141045d0 0x7f291419e8a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f290800d980 tx=0x7f290800dc90 comp rx=0 tx=0).stop 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 shutdown_connections 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29040b6d50 0x7f29040b9260 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2914109850 0x7f2914198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29141045d0 0x7f291419e8a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 --2- 172.21.15.37:0/2465407128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2914108f00 0x7f291419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:07:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 >> 172.21.15.37:0/2465407128 conn(0x7f29140ffea0 msgr2=0x7f2914102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:07:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 shutdown_connections 2024-05-09T01:07:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:07:58.054+0000 7f291af40700 1 -- 172.21.15.37:0/2465407128 wait complete. 2024-05-09T01:07:58.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:07:58 smithi037 ceph-mon[30122]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 MiB/s wr, 429 op/s 2024-05-09T01:07:58.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:07:58 smithi151 ceph-mon[34780]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 MiB/s wr, 429 op/s 2024-05-09T01:07:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:07:58 smithi136 ceph-mon[34110]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 13 MiB/s wr, 429 op/s 2024-05-09T01:07:58.891 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:07:58.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:07:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 340.0 s, 2169.2 tps, lat 46.327 ms stddev 51.940 2024-05-09T01:08:00.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:00 smithi037 ceph-mon[30122]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.3 MiB/s wr, 239 op/s 2024-05-09T01:08:00.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:00 smithi151 ceph-mon[34780]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.3 MiB/s wr, 239 op/s 2024-05-09T01:08:00.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:00 smithi136 ceph-mon[34110]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.3 MiB/s wr, 239 op/s 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.377+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/1449506181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e18105db0 msgr2=0x7f4e1810e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.377+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/1449506181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e18105db0 0x7f4e1810e300 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4e08009990 tx=0x7f4e08009ca0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.377+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/1449506181 shutdown_connections 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.377+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/1449506181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e1810e8d0 0x7f4e18110de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.377+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/1449506181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18105460 0x7f4e18105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.377+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/1449506181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e18105db0 0x7f4e1810e300 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.377+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/1449506181 >> 172.21.15.37:0/1449506181 conn(0x7f4e180fedf0 msgr2=0x7f4e18101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.378+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/1449506181 shutdown_connections 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.378+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/1449506181 wait complete. 2024-05-09T01:08:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 Processor -- start 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 -- start start 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18105460 0x7f4e1810e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e18105db0 0x7f4e18108410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e1810e8d0 0x7f4e18108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1806dae0 con 0x7f4e1810e8d0 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1806d960 con 0x7f4e18105db0 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1fe9c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1806dc60 con 0x7f4e18105460 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1d437700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e18105db0 0x7f4e18108410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1dc38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18105460 0x7f4e1810e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1d437700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e18105db0 0x7f4e18108410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43116/0 (socket says 172.21.15.37:43116) 2024-05-09T01:08:01.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1d437700 1 -- 172.21.15.37:0/3021480529 learned_addr learned my addr 172.21.15.37:0/3021480529 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.379+0000 7f4e1e439700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e1810e8d0 0x7f4e18108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.380+0000 7f4e1dc38700 1 -- 172.21.15.37:0/3021480529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e18105db0 msgr2=0x7f4e18108410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.380+0000 7f4e1dc38700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e18105db0 0x7f4e18108410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.380+0000 7f4e1dc38700 1 -- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e1810e8d0 msgr2=0x7f4e18108ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.380+0000 7f4e1dc38700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e1810e8d0 0x7f4e18108ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.380+0000 7f4e1dc38700 1 -- 172.21.15.37:0/3021480529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e181af8b0 con 0x7f4e18105460 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.380+0000 7f4e1dc38700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18105460 0x7f4e1810e2d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009ef0 tx=0x7f4e1400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.380+0000 7f4e0effd700 1 -- 172.21.15.37:0/3021480529 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14013d00 con 0x7f4e18105460 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.381+0000 7f4e0effd700 1 -- 172.21.15.37:0/3021480529 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e140044d0 con 0x7f4e18105460 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.381+0000 7f4e0effd700 1 -- 172.21.15.37:0/3021480529 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1401b6a0 con 0x7f4e18105460 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.381+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e181030e0 con 0x7f4e18105460 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.381+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e181035d0 con 0x7f4e18105460 2024-05-09T01:08:01.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.383+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e180762d0 con 0x7f4e18105460 2024-05-09T01:08:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.384+0000 7f4e0effd700 1 -- 172.21.15.37:0/3021480529 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4e140037a0 con 0x7f4e18105460 2024-05-09T01:08:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.386+0000 7f4e0effd700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4e040b2900 0x7f4e040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.386+0000 7f4e0effd700 1 -- 172.21.15.37:0/3021480529 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4e140e6450 con 0x7f4e18105460 2024-05-09T01:08:01.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.386+0000 7f4e1d437700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4e040b2900 0x7f4e040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:01.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.387+0000 7f4e1d437700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4e040b2900 0x7f4e040b4e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4e18102540 tx=0x7f4e0801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:01.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.391+0000 7f4e0effd700 1 -- 172.21.15.37:0/3021480529 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4e14057df0 con 0x7f4e18105460 2024-05-09T01:08:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.846+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e18109920 con 0x7f4e18105460 2024-05-09T01:08:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.847+0000 7f4e0effd700 1 -- 172.21.15.37:0/3021480529 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11936 (secure 0 0 0) 0x7f4e140ae210 con 0x7f4e18105460 2024-05-09T01:08:01.848 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:08:01.848 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:07:28.918612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24454,24491,24445,24446,24467]},"id":1}]} 2024-05-09T01:08:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4e040b2900 msgr2=0x7f4e040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4e040b2900 0x7f4e040b4e10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4e18102540 tx=0x7f4e0801a040 comp rx=0 tx=0).stop 2024-05-09T01:08:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18105460 msgr2=0x7f4e1810e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18105460 0x7f4e1810e2d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009ef0 tx=0x7f4e1400eca0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 shutdown_connections 2024-05-09T01:08:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4e040b2900 0x7f4e040b4e10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e1810e8d0 0x7f4e18108ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18105460 0x7f4e1810e2d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 --2- 172.21.15.37:0/3021480529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4e18105db0 0x7f4e18108410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 >> 172.21.15.37:0/3021480529 conn(0x7f4e180fedf0 msgr2=0x7f4e180ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 shutdown_connections 2024-05-09T01:08:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:01.851+0000 7f4e1fe9c700 1 -- 172.21.15.37:0/3021480529 wait complete. 2024-05-09T01:08:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2024-05-09T01:08:02.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:02 smithi037 ceph-mon[30122]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 356 op/s 2024-05-09T01:08:02.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:02 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3021480529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:08:02.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:02 smithi151 ceph-mon[34780]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 356 op/s 2024-05-09T01:08:02.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:02 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3021480529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:08:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:02 smithi136 ceph-mon[34110]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 356 op/s 2024-05-09T01:08:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:02 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3021480529' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:08:02.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:08:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:04.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:04 smithi037 ceph-mon[30122]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.9 MiB/s wr, 422 op/s 2024-05-09T01:08:04.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:04 smithi151 ceph-mon[34780]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.9 MiB/s wr, 422 op/s 2024-05-09T01:08:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:04 smithi136 ceph-mon[34110]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.9 MiB/s wr, 422 op/s 2024-05-09T01:08:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 345.0 s, 2522.4 tps, lat 39.477 ms stddev 48.219 2024-05-09T01:08:05.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.493+0000 7f61ee147700 1 -- 172.21.15.37:0/1412205299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e8109870 msgr2=0x7f61e81111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.493+0000 7f61ee147700 1 --2- 172.21.15.37:0/1412205299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e8109870 0x7f61e81111d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b0a0 tx=0x7f61e000b3b0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.494+0000 7f61ee147700 1 -- 172.21.15.37:0/1412205299 shutdown_connections 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.494+0000 7f61ee147700 1 --2- 172.21.15.37:0/1412205299 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e8109870 0x7f61e81111d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.494+0000 7f61ee147700 1 --2- 172.21.15.37:0/1412205299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e81045f0 0x7f61e8104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.494+0000 7f61ee147700 1 --2- 172.21.15.37:0/1412205299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e8108f20 0x7f61e8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.494+0000 7f61ee147700 1 -- 172.21.15.37:0/1412205299 >> 172.21.15.37:0/1412205299 conn(0x7f61e8100040 msgr2=0x7f61e8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.494+0000 7f61ee147700 1 -- 172.21.15.37:0/1412205299 shutdown_connections 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.494+0000 7f61ee147700 1 -- 172.21.15.37:0/1412205299 wait complete. 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.496+0000 7f61ee147700 1 Processor -- start 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.496+0000 7f61ee147700 1 -- start start 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61ee147700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e81045f0 0x7f61e8119a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61ee147700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8108f20 0x7f61e8119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61ee147700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e8109870 0x7f61e8113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61ee147700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8112310 con 0x7f61e8108f20 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61ee147700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8112190 con 0x7f61e81045f0 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61ee147700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8112490 con 0x7f61e8109870 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8108f20 0x7f61e8119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61e6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8108f20 0x7f61e8119f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57180/0 (socket says 172.21.15.37:57180) 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.497+0000 7f61e6ffd700 1 -- 172.21.15.37:0/1480931083 learned_addr learned my addr 172.21.15.37:0/1480931083 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.498+0000 7f61e6ffd700 1 -- 172.21.15.37:0/1480931083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e8109870 msgr2=0x7f61e8113c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.498+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e8109870 0x7f61e8113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.498+0000 7f61e6ffd700 1 -- 172.21.15.37:0/1480931083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e81045f0 msgr2=0x7f61e8119a20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.498+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e81045f0 0x7f61e8119a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.498+0000 7f61e6ffd700 1 -- 172.21.15.37:0/1480931083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e8114460 con 0x7f61e8108f20 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.499+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8108f20 0x7f61e8119f80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e970 tx=0x7f61dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.499+0000 7f61e4ff9700 1 -- 172.21.15.37:0/1480931083 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00cb50 con 0x7f61e8108f20 2024-05-09T01:08:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.499+0000 7f61e4ff9700 1 -- 172.21.15.37:0/1480931083 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61dc00ccf0 con 0x7f61e8108f20 2024-05-09T01:08:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.499+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e8114750 con 0x7f61e8108f20 2024-05-09T01:08:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.499+0000 7f61e4ff9700 1 -- 172.21.15.37:0/1480931083 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0056c0 con 0x7f61e8108f20 2024-05-09T01:08:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.499+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e81b64a0 con 0x7f61e8108f20 2024-05-09T01:08:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.503+0000 7f61e4ff9700 1 -- 172.21.15.37:0/1480931083 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f61dc004750 con 0x7f61e8108f20 2024-05-09T01:08:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.504+0000 7f61e4ff9700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b2940 0x7f61d00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.504+0000 7f61e4ff9700 1 -- 172.21.15.37:0/1480931083 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f61dc0e2410 con 0x7f61e8108f20 2024-05-09T01:08:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.505+0000 7f61e77fe700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b2940 0x7f61d00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.505+0000 7f61fcb5db80 1 Processor -- start 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.505+0000 7f61fcb5db80 1 -- start start 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561219854d00 0x56121995d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612197da4a0 0x56121995d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219957810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56121987a0a0 con 0x561219854d00 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56121981f9a0 con 0x5612197da4a0 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561219876060 con 0x561219957400 2024-05-09T01:08:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612197da4a0 0x56121995d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219957810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219957810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45220/0 (socket says 172.21.15.37:45220) 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 -- 172.21.15.37:0/1410505048 learned_addr learned my addr 172.21.15.37:0/1410505048 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e77fe700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b2940 0x7f61d00b4e50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009af0 tx=0x7f61d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612197da4a0 0x56121995d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47596/0 (socket says 172.21.15.37:47596) 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 -- 172.21.15.37:0/1410505048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612197da4a0 msgr2=0x56121995d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612197da4a0 0x56121995d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 -- 172.21.15.37:0/1410505048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561219854d00 msgr2=0x56121995d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561219854d00 0x56121995d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.506+0000 7f61e7fff700 1 -- 172.21.15.37:0/1410505048 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561219810500 con 0x561219957400 2024-05-09T01:08:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.507+0000 7f61e7fff700 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219957810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b070 tx=0x7f61e0009dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=764b8c22da8e2cb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.507+0000 7f61cdffb700 1 -- 172.21.15.37:0/1410505048 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0021020 con 0x561219957400 2024-05-09T01:08:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.508+0000 7f61cdffb700 1 -- 172.21.15.37:0/1410505048 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e000bcb0 con 0x561219957400 2024-05-09T01:08:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.508+0000 7f61cdffb700 1 -- 172.21.15.37:0/1410505048 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e001d470 con 0x561219957400 2024-05-09T01:08:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 -- 172.21.15.37:0/1410505048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 msgr2=0x561219957810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219957810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b070 tx=0x7f61e0009dd0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 -- 172.21.15.37:0/1410505048 shutdown_connections 2024-05-09T01:08:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219957810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561219854d00 0x56121995d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/1410505048 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5612197da4a0 0x56121995d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 -- 172.21.15.37:0/1410505048 >> 172.21.15.37:0/1410505048 conn(0x5612197ddf70 msgr2=0x561219952220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 -- 172.21.15.37:0/1410505048 shutdown_connections 2024-05-09T01:08:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.509+0000 7f61fcb5db80 1 -- 172.21.15.37:0/1410505048 wait complete. 2024-05-09T01:08:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.510+0000 7f61fcb5db80 1 -- start start 2024-05-09T01:08:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.510+0000 7f61fcb5db80 1 Processor -- start 2024-05-09T01:08:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x5612199610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x5612199615f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219961b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561219958100 con 0x5612197da4a0 2024-05-09T01:08:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561219814b20 con 0x561219854d00 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56121996d200 con 0x561219957400 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x5612199610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x5612199615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219961b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x5612199615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47600/0 (socket says 172.21.15.37:47600) 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 -- 172.21.15.37:0/3641504317 learned_addr learned my addr 172.21.15.37:0/3641504317 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61fcb5db80 10 client.0 _ll_register_callbacks cb 0x5612196eb6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 -- 172.21.15.37:0/3641504317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 msgr2=0x561219961b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219961b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 -- 172.21.15.37:0/3641504317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 msgr2=0x5612199610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x5612199610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.511+0000 7f61e6ffd700 1 -- 172.21.15.37:0/3641504317 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612196f5490 con 0x561219854d00 2024-05-09T01:08:05.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.512+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x5612199615f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c5b0 tx=0x7f61dc0a9f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=346689af9e195447 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.512+0000 7f61c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.512+0000 7f61c6ffd700 1 -- 172.21.15.37:0/3641504317 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0a9540 con 0x561219854d00 2024-05-09T01:08:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.512+0000 7f61c6ffd700 1 -- 172.21.15.37:0/3641504317 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f61dc0cc2d0 con 0x561219854d00 2024-05-09T01:08:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.512+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61e000bcb0 con 0x561219854d00 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.513+0000 7f61c6ffd700 1 -- 172.21.15.37:0/3641504317 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f61dc0aa130 con 0x561219854d00 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 10 client.26036 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56121996eb40 con 0x561219854d00 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61c6ffd700 1 -- 172.21.15.37:0/3641504317 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e000bcb0 con 0x561219854d00 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61c6ffd700 1 -- 172.21.15.37:0/3641504317 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f61dc0cace0 con 0x561219854d00 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 10 client.26036 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 10 client.26036 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 20 client.26036 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:05.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561219971150 0x5612199735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 4 client.26036 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561219887a80 con 0x561219971150 2024-05-09T01:08:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.514+0000 7f61e77fe700 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561219971150 0x5612199735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.515+0000 7f61e77fe700 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561219971150 0x5612199735a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8039186447fe87f9 server_cookie=a69bb364d5d100a3 in_seq=0 out_seq=0 2024-05-09T01:08:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61c6ffd700 10 client.26036 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:08:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61c6ffd700 1 -- 172.21.15.37:0/3641504317 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561219887a80 con 0x561219971150 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61c6ffd700 10 client.26036 handle_command_reply: tid=0 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61fcb5db80 1 client.26036 shutdown 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 msgr2=0x5612199615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x5612199615f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c5b0 tx=0x7f61dc0a9f90 comp rx=0 tx=0).stop 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 shutdown_connections 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.516+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x561219971150 0x5612199735a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x561219961b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x5612199610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/3641504317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x5612199615f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61c6ffd700 0 client.26036 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 >> 172.21.15.37:0/3641504317 conn(0x5612197ddf70 msgr2=0x56121994bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 shutdown_connections 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61fcb5db80 1 -- 172.21.15.37:0/3641504317 wait complete. 2024-05-09T01:08:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.517+0000 7f61fcb5db80 20 client.26036 trim_cache size 0 max 16384 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.539+0000 7f61fcb5db80 1 Processor -- start 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.539+0000 7f61fcb5db80 1 -- start start 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.539+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219961620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x56121994bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x56121994c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219961620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219961620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57214/0 (socket says 172.21.15.37:57214) 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e77fe700 1 -- 172.21.15.37:0/2712717385 learned_addr learned my addr 172.21.15.37:0/2712717385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81bd7a0 con 0x5612197da4a0 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81bf2e0 con 0x561219854d00 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81bde70 con 0x561219957400 2024-05-09T01:08:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x56121994bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e7fff700 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x56121994c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e6ffd700 1 -- 172.21.15.37:0/2712717385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 msgr2=0x56121994c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x56121994c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e6ffd700 1 -- 172.21.15.37:0/2712717385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 msgr2=0x561219961620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219961620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e6ffd700 1 -- 172.21.15.37:0/2712717385 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121995f620 con 0x561219854d00 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e77fe700 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219961620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61e6ffd700 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x56121994bff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0a5fd0 tx=0x7f61dc00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f208f9a40e5adfcf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.540+0000 7f61cd7fa700 1 -- 172.21.15.37:0/2712717385 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc004dc0 con 0x561219854d00 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.541+0000 7f61cd7fa700 1 -- 172.21.15.37:0/2712717385 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61dc0c3070 con 0x561219854d00 2024-05-09T01:08:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.541+0000 7f61cd7fa700 1 -- 172.21.15.37:0/2712717385 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc0cc2d0 con 0x561219854d00 2024-05-09T01:08:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 msgr2=0x56121994bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x56121994bff0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0a5fd0 tx=0x7f61dc00cea0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 shutdown_connections 2024-05-09T01:08:05.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219957400 0x56121994c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219961620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2712717385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219854d00 0x56121994bff0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 >> 172.21.15.37:0/2712717385 conn(0x5612197ddf70 msgr2=0x56121995f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.542+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 shutdown_connections 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.543+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2712717385 wait complete. 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.543+0000 7f61fcb5db80 1 -- start start 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.543+0000 7f61fcb5db80 1 Processor -- start 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219969130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219854d00 0x561219969670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61fcb5db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219957400 0x561219977d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81bec10 con 0x5612197da4a0 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81be540 con 0x561219957400 2024-05-09T01:08:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61fcb5db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81bb760 con 0x561219854d00 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219969130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61fcb5db80 10 client.0 _ll_register_callbacks cb 0x5612196eb6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219854d00 0x561219969670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219969130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57218/0 (socket says 172.21.15.37:57218) 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e77fe700 1 -- 172.21.15.37:0/2969783410 learned_addr learned my addr 172.21.15.37:0/2969783410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e7fff700 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219957400 0x561219977d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e7fff700 1 -- 172.21.15.37:0/2969783410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219854d00 msgr2=0x561219969670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e7fff700 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219854d00 0x561219969670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e7fff700 1 -- 172.21.15.37:0/2969783410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 msgr2=0x561219969130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e7fff700 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219969130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.544+0000 7f61e7fff700 1 -- 172.21.15.37:0/2969783410 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561219978290 con 0x561219957400 2024-05-09T01:08:05.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61e7fff700 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219957400 0x561219977d50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b0a0 tx=0x7f61e000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=497ec4ee1d6c08c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:05.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:05.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61c6ffd700 1 -- 172.21.15.37:0/2969783410 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e002a030 con 0x561219957400 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61c6ffd700 1 -- 172.21.15.37:0/2969783410 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f61e000f040 con 0x561219957400 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61dc0c3070 con 0x561219957400 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61e77fe700 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219969130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61c6ffd700 1 -- 172.21.15.37:0/2969783410 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f61e0021030 con 0x561219957400 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61fcb5db80 10 client.26042 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.545+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5612199dafd0 con 0x561219957400 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.546+0000 7f61c6ffd700 1 -- 172.21.15.37:0/2969783410 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e0007cf0 con 0x561219957400 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61c6ffd700 1 -- 172.21.15.37:0/2969783410 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f61e0011070 con 0x561219957400 2024-05-09T01:08:05.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61fcb5db80 10 client.26042 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61fcb5db80 10 client.26042 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61fcb5db80 20 client.26042 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5612199db250 0x5612199dd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61fcb5db80 4 client.26042 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f61dc0c3070 con 0x5612199db250 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.547+0000 7f61e77fe700 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5612199db250 0x5612199dd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.548+0000 7f61e77fe700 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5612199db250 0x5612199dd670 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8be38f04e1f9417b server_cookie=2cc45f966dae5639 in_seq=0 out_seq=0 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.548+0000 7f61c6ffd700 10 client.26042 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.548+0000 7f61c6ffd700 1 -- 172.21.15.37:0/2969783410 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f61dc0c3070 con 0x5612199db250 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.548+0000 7f61c6ffd700 10 client.26042 handle_command_reply: tid=0 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.548+0000 7f61fcb5db80 1 client.26042 shutdown 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219957400 msgr2=0x561219977d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219957400 0x561219977d50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f61e000b0a0 tx=0x7f61e000be20 comp rx=0 tx=0).stop 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 shutdown_connections 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5612199db250 0x5612199dd670 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561219957400 0x561219977d50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612197da4a0 0x561219969130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 --2- 172.21.15.37:0/2969783410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561219854d00 0x561219969670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 >> 172.21.15.37:0/2969783410 conn(0x5612197ddf70 msgr2=0x56121994bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61c6ffd700 0 client.26042 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 shutdown_connections 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 1 -- 172.21.15.37:0/2969783410 wait complete. 2024-05-09T01:08:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.549+0000 7f61fcb5db80 20 client.26042 trim_cache size 0 max 16384 2024-05-09T01:08:05.554 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:08:05.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b2940 msgr2=0x7f61d00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b2940 0x7f61d00b4e50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009af0 tx=0x7f61d8009260 comp rx=0 tx=0).stop 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8108f20 msgr2=0x7f61e8119f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8108f20 0x7f61e8119f80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e970 tx=0x7f61dc00ed30 comp rx=0 tx=0).stop 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 shutdown_connections 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b2940 0x7f61d00b4e50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e8109870 0x7f61e8113c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e81045f0 0x7f61e8119a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 --2- 172.21.15.37:0/1480931083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e8108f20 0x7f61e8119f80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.550+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 >> 172.21.15.37:0/1480931083 conn(0x7f61e8100040 msgr2=0x7f61e8108500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.551+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 shutdown_connections 2024-05-09T01:08:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:05.551+0000 7f61ee147700 1 -- 172.21.15.37:0/1480931083 wait complete. 2024-05-09T01:08:06.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:08:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:06 smithi037 ceph-mon[30122]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.0 MiB/s wr, 550 op/s 2024-05-09T01:08:06.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:06 smithi151 ceph-mon[34780]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.0 MiB/s wr, 550 op/s 2024-05-09T01:08:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:06 smithi136 ceph-mon[34110]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.0 MiB/s wr, 550 op/s 2024-05-09T01:08:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.376+0000 7fa993fff640 1 -- 172.21.15.37:0/2272488517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9940750c0 msgr2=0x7fa9940754d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.376+0000 7fa993fff640 1 --2- 172.21.15.37:0/2272488517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9940750c0 0x7fa9940754d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa988009900 tx=0x7fa98802a440 comp rx=0 tx=0).stop 2024-05-09T01:08:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.376+0000 7fa993fff640 1 -- 172.21.15.37:0/2272488517 shutdown_connections 2024-05-09T01:08:07.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.376+0000 7fa993fff640 1 --2- 172.21.15.37:0/2272488517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9941101f0 0x7fa994112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.376+0000 7fa993fff640 1 --2- 172.21.15.37:0/2272488517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa994075a10 0x7fa99410fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.376+0000 7fa993fff640 1 --2- 172.21.15.37:0/2272488517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9940750c0 0x7fa9940754d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.376+0000 7fa993fff640 1 -- 172.21.15.37:0/2272488517 >> 172.21.15.37:0/2272488517 conn(0x7fa9940fec80 msgr2=0x7fa994101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.377+0000 7fa993fff640 1 -- 172.21.15.37:0/2272488517 shutdown_connections 2024-05-09T01:08:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.377+0000 7fa993fff640 1 -- 172.21.15.37:0/2272488517 wait complete. 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.378+0000 7fa993fff640 1 Processor -- start 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.378+0000 7fa993fff640 1 -- start start 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.378+0000 7fa993fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9940750c0 0x7fa994071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.378+0000 7fa993fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9941101f0 0x7fa9940721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.378+0000 7fa993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa994073160 0x7fa994073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa993fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa994115d00 con 0x7fa994073160 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa993fff640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa994115b80 con 0x7fa9941101f0 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa993fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa994115e80 con 0x7fa9940750c0 2024-05-09T01:08:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa992ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9940750c0 0x7fa994071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa992ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9940750c0 0x7fa994071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45262/0 (socket says 172.21.15.37:45262) 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa992ffd640 1 -- 172.21.15.37:0/2268524258 learned_addr learned my addr 172.21.15.37:0/2268524258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa9927fc640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9941101f0 0x7fa9940721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.379+0000 7fa992ffd640 1 -- 172.21.15.37:0/2268524258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9941101f0 msgr2=0x7fa9940721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.380+0000 7fa992ffd640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9941101f0 0x7fa9940721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.380+0000 7fa992ffd640 1 -- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa994073160 msgr2=0x7fa994073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.380+0000 7fa992ffd640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa994073160 0x7fa994073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.380+0000 7fa992ffd640 1 -- 172.21.15.37:0/2268524258 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa994073ca0 con 0x7fa9940750c0 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.380+0000 7fa992ffd640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9940750c0 0x7fa994071c40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa988006010 tx=0x7fa9880035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.380+0000 7fa9927fc640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9941101f0 0x7fa9940721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.381+0000 7fa97bfff640 1 -- 172.21.15.37:0/2268524258 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988040070 con 0x7fa9940750c0 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.381+0000 7fa97bfff640 1 -- 172.21.15.37:0/2268524258 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa988003c20 con 0x7fa9940750c0 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.381+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa994073f30 con 0x7fa9940750c0 2024-05-09T01:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.381+0000 7fa97bfff640 1 -- 172.21.15.37:0/2268524258 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa988035040 con 0x7fa9940750c0 2024-05-09T01:08:07.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.381+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9940744a0 con 0x7fa9940750c0 2024-05-09T01:08:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.386+0000 7fa9a03a9740 1 Processor -- start 2024-05-09T01:08:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.387+0000 7fa9a03a9740 1 -- start start 2024-05-09T01:08:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.387+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772624c1b0 0x5577265f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.387+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577262232f0 0x5577265f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.387+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x5577265f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.387+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5577265547c0 con 0x55772622b4d0 2024-05-09T01:08:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.387+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5577264f00e0 con 0x55772624c1b0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.387+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557726550780 con 0x5577262232f0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772624c1b0 0x5577265f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772624c1b0 0x5577265f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47652/0 (socket says 172.21.15.37:47652) 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 -- 172.21.15.37:0/1049751886 learned_addr learned my addr 172.21.15.37:0/1049751886 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa992ffd640 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577262232f0 0x5577265f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa97bfff640 1 -- 172.21.15.37:0/2268524258 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa988043070 con 0x7fa9940750c0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 -- 172.21.15.37:0/1049751886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577262232f0 msgr2=0x5577265f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577262232f0 0x5577265f0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 -- 172.21.15.37:0/1049751886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 msgr2=0x5577265f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x5577265f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.388+0000 7fa9937fe640 1 -- 172.21.15.37:0/1049751886 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577265197c0 con 0x55772624c1b0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.389+0000 7fa9937fe640 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772624c1b0 0x5577265f06c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009cf0 tx=0x7fa98c00b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d09ffa462bc4ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.389+0000 7fa9797fa640 1 -- 172.21.15.37:0/1049751886 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c00bd40 con 0x55772624c1b0 2024-05-09T01:08:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.389+0000 7fa9797fa640 1 -- 172.21.15.37:0/1049751886 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c017070 con 0x55772624c1b0 2024-05-09T01:08:07.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.389+0000 7fa9797fa640 1 -- 172.21.15.37:0/1049751886 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0115d0 con 0x55772624c1b0 2024-05-09T01:08:07.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa97bfff640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa97c0b28a0 0x7fa97c0b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa9a03a9740 1 -- 172.21.15.37:0/1049751886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772624c1b0 msgr2=0x5577265f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772624c1b0 0x5577265f06c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009cf0 tx=0x7fa98c00b420 comp rx=0 tx=0).stop 2024-05-09T01:08:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa9a03a9740 1 -- 172.21.15.37:0/1049751886 shutdown_connections 2024-05-09T01:08:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x5577265f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577262232f0 0x5577265f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/1049751886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772624c1b0 0x5577265f06c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.390+0000 7fa9a03a9740 1 -- 172.21.15.37:0/1049751886 >> 172.21.15.37:0/1049751886 conn(0x557726240300 msgr2=0x5577265ec050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.391+0000 7fa97bfff640 1 -- 172.21.15.37:0/2268524258 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa9881028d0 con 0x7fa9940750c0 2024-05-09T01:08:07.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.391+0000 7fa9a03a9740 1 -- 172.21.15.37:0/1049751886 shutdown_connections 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.391+0000 7fa992ffd640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa97c0b28a0 0x7fa97c0b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.391+0000 7fa9a03a9740 1 -- 172.21.15.37:0/1049751886 wait complete. 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 -- start start 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 Processor -- start 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265fa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265fa990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577266018f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5577265f8590 con 0x5577262232f0 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5577264db9c0 con 0x55772622b4d0 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.392+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5577265f8710 con 0x55772624c1b0 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9a03a9740 10 client.0 _ll_register_callbacks cb 0x557726508020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577266018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577266018f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45268/0 (socket says 172.21.15.37:45268) 2024-05-09T01:08:07.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 -- 172.21.15.37:0/3247514662 learned_addr learned my addr 172.21.15.37:0/3247514662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9927fc640 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265fa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 -- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 msgr2=0x5577265fa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265fa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 -- 172.21.15.37:0/3247514662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 msgr2=0x5577265fa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa9937fe640 1 -- 172.21.15.37:0/3247514662 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577265021f0 con 0x55772624c1b0 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.393+0000 7fa992ffd640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa97c0b28a0 0x7fa97c0b4db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa98803ac80 tx=0x7fa9881084b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.394+0000 7fa9937fe640 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577266018f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa98c016000 tx=0x7fa98c012660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23a97a7108a5df8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:07.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.394+0000 7fa976ff5640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.394+0000 7fa976ff5640 1 -- 172.21.15.37:0/3247514662 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c0255f0 con 0x55772624c1b0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.394+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa98c017070 con 0x55772624c1b0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.394+0000 7fa976ff5640 1 -- 172.21.15.37:0/3247514662 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa98c01b3f0 con 0x55772624c1b0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa976ff5640 1 -- 172.21.15.37:0/3247514662 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa98c025790 con 0x55772624c1b0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa9a03a9740 10 client.26041 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5577262b7790 con 0x55772624c1b0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa976ff5640 1 -- 172.21.15.37:0/3247514662 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c017070 con 0x55772624c1b0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa976ff5640 1 -- 172.21.15.37:0/3247514662 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fa98c011070 con 0x55772624c1b0 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa9a03a9740 10 client.26041 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa9a03a9740 10 client.26041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.395+0000 7fa9a03a9740 20 client.26041 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.396+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55772620ad80 0x557726607d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.396+0000 7fa9a03a9740 4 client.26041 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.396+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577265623d0 con 0x55772620ad80 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.396+0000 7fa9927fc640 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55772620ad80 0x557726607d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.396+0000 7fa976ff5640 10 client.26041 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.396+0000 7fa9927fc640 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55772620ad80 0x557726607d00 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e117a8902c2dd47 server_cookie=3d2e33215385ae3d in_seq=0 out_seq=0 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.397+0000 7fa976ff5640 1 -- 172.21.15.37:0/3247514662 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5577265623d0 con 0x55772620ad80 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.397+0000 7fa976ff5640 10 client.26041 handle_command_reply: tid=0 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 client.26041 shutdown 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 msgr2=0x5577266018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577266018f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa98c016000 tx=0x7fa98c012660 comp rx=0 tx=0).stop 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 shutdown_connections 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55772620ad80 0x557726607d00 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577266018f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265fa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3247514662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 >> 172.21.15.37:0/3247514662 conn(0x557726240300 msgr2=0x5577265eb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa976ff5640 0 client.26041 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:07.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 shutdown_connections 2024-05-09T01:08:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.398+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3247514662 wait complete. 2024-05-09T01:08:07.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.399+0000 7fa9a03a9740 20 client.26041 trim_cache size 0 max 16384 2024-05-09T01:08:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.424+0000 7fa9a03a9740 1 Processor -- start 2024-05-09T01:08:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.424+0000 7fa9a03a9740 1 -- start start 2024-05-09T01:08:07.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.424+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265ebf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x557726601810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941a9690 con 0x5577262232f0 2024-05-09T01:08:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941ab1d0 con 0x55772622b4d0 2024-05-09T01:08:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9a03a9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941a9d60 con 0x55772624c1b0 2024-05-09T01:08:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265eba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57260/0 (socket says 172.21.15.37:57260) 2024-05-09T01:08:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9937fe640 1 -- 172.21.15.37:0/3202291415 learned_addr learned my addr 172.21.15.37:0/3202291415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9937fe640 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x557726601810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.425+0000 7fa9927fc640 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265ebf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa9937fe640 1 -- 172.21.15.37:0/3202291415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 msgr2=0x5577265ebf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa9937fe640 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265ebf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa9937fe640 1 -- 172.21.15.37:0/3202291415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 msgr2=0x5577265eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa9937fe640 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa9937fe640 1 -- 172.21.15.37:0/3202291415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772632e5f0 con 0x55772624c1b0 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa9937fe640 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x557726601810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa98c02f7c0 tx=0x7fa98c012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2cd902ce0367f33 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa978ff9640 1 -- 172.21.15.37:0/3202291415 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c035070 con 0x55772624c1b0 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa978ff9640 1 -- 172.21.15.37:0/3202291415 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c017070 con 0x55772624c1b0 2024-05-09T01:08:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.426+0000 7fa978ff9640 1 -- 172.21.15.37:0/3202291415 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c02fc90 con 0x55772624c1b0 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.428+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3202291415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 msgr2=0x557726601810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.428+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x557726601810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa98c02f7c0 tx=0x7fa98c012f90 comp rx=0 tx=0).stop 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.428+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3202291415 shutdown_connections 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.428+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x557726601810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.428+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55772622b4d0 0x5577265ebf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.428+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/3202291415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577262232f0 0x5577265eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.429+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3202291415 >> 172.21.15.37:0/3202291415 conn(0x557726240300 msgr2=0x5577265f4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.429+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3202291415 shutdown_connections 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.429+0000 7fa9a03a9740 1 -- 172.21.15.37:0/3202291415 wait complete. 2024-05-09T01:08:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.429+0000 7fa9a03a9740 1 -- start start 2024-05-09T01:08:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.429+0000 7fa9a03a9740 1 Processor -- start 2024-05-09T01:08:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577262232f0 0x5577265fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9a03a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x557726601e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577262232f0 0x5577265fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9937fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577262232f0 0x5577265fc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47670/0 (socket says 172.21.15.37:47670) 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9927fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x557726601e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9927fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x557726601e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57262/0 (socket says 172.21.15.37:57262) 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9937fe640 1 -- 172.21.15.37:0/2371308588 learned_addr learned my addr 172.21.15.37:0/2371308588 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577265fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941aab00 con 0x55772622b4d0 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941aa430 con 0x5577262232f0 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa994074ce0 con 0x55772624c1b0 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.430+0000 7fa9a03a9740 10 client.0 _ll_register_callbacks cb 0x7fa988108400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9937fe640 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577265fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9937fe640 1 -- 172.21.15.37:0/2371308588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 msgr2=0x5577265fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9937fe640 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577265fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9937fe640 1 -- 172.21.15.37:0/2371308588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 msgr2=0x557726601e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9937fe640 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x557726601e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9937fe640 1 -- 172.21.15.37:0/2371308588 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557726518ed0 con 0x5577262232f0 2024-05-09T01:08:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9937fe640 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577262232f0 0x5577265fc9b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa98c02f9b0 tx=0x7fa98c02f8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb07ec2e9e2a2638 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa976ff5640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa976ff5640 1 -- 172.21.15.37:0/2371308588 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c035040 con 0x5577262232f0 2024-05-09T01:08:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa98c017070 con 0x5577262232f0 2024-05-09T01:08:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.431+0000 7fa976ff5640 1 -- 172.21.15.37:0/2371308588 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa98c02fc30 con 0x5577262232f0 2024-05-09T01:08:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.432+0000 7fa976ff5640 1 -- 172.21.15.37:0/2371308588 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa98c003a10 con 0x5577262232f0 2024-05-09T01:08:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.432+0000 7fa9a03a9740 10 client.26057 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.432+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55772666eee0 con 0x5577262232f0 2024-05-09T01:08:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa976ff5640 1 -- 172.21.15.37:0/2371308588 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c017070 con 0x5577262232f0 2024-05-09T01:08:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa976ff5640 1 -- 172.21.15.37:0/2371308588 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fa98c011070 con 0x5577262232f0 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa9a03a9740 10 client.26057 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa9a03a9740 10 client.26057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa9a03a9740 20 client.26057 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5577261e01c0 0x557726671760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa9a03a9740 4 client.26057 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55772655c240 con 0x5577261e01c0 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.433+0000 7fa9927fc640 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5577261e01c0 0x557726671760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.434+0000 7fa976ff5640 10 client.26057 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.434+0000 7fa9927fc640 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5577261e01c0 0x557726671760 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d0ba7b5dc3202a6 server_cookie=2c366f9422d5ad6e in_seq=0 out_seq=0 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.447+0000 7fa976ff5640 1 -- 172.21.15.37:0/2371308588 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55772655c240 con 0x5577261e01c0 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.447+0000 7fa976ff5640 10 client.26057 handle_command_reply: tid=0 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.447+0000 7fa9a03a9740 1 client.26057 shutdown 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.447+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577262232f0 msgr2=0x5577265fc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.447+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577262232f0 0x5577265fc9b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa98c02f9b0 tx=0x7fa98c02f8e0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 shutdown_connections 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5577261e01c0 0x557726671760 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55772624c1b0 0x5577265fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa976ff5640 0 client.26057 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55772622b4d0 0x557726601e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 --2- 172.21.15.37:0/2371308588 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577262232f0 0x5577265fc9b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 >> 172.21.15.37:0/2371308588 conn(0x557726240300 msgr2=0x5577265eee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 shutdown_connections 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 1 -- 172.21.15.37:0/2371308588 wait complete. 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.448+0000 7fa9a03a9740 20 client.26057 trim_cache size 0 max 16384 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:08:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:08:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa97c0b28a0 msgr2=0x7fa97c0b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa97c0b28a0 0x7fa97c0b4db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa98803ac80 tx=0x7fa9881084b0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9940750c0 msgr2=0x7fa994071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9940750c0 0x7fa994071c40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa988006010 tx=0x7fa9880035f0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 shutdown_connections 2024-05-09T01:08:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa994073160 0x7fa994073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa97c0b28a0 0x7fa97c0b4db0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9941101f0 0x7fa9940721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 --2- 172.21.15.37:0/2268524258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9940750c0 0x7fa994071c40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.449+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 >> 172.21.15.37:0/2268524258 conn(0x7fa9940fec80 msgr2=0x7fa994103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.450+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 shutdown_connections 2024-05-09T01:08:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:07.450+0000 7fa993fff640 1 -- 172.21.15.37:0/2268524258 wait complete. 2024-05-09T01:08:08.470 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:08 smithi037 ceph-mon[30122]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.5 MiB/s wr, 637 op/s 2024-05-09T01:08:08.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:08 smithi151 ceph-mon[34780]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.5 MiB/s wr, 637 op/s 2024-05-09T01:08:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:08 smithi136 ceph-mon[34110]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.5 MiB/s wr, 637 op/s 2024-05-09T01:08:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 -- 172.21.15.37:0/95823372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 msgr2=0x7fe72c1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 --2- 172.21.15.37:0/95823372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 0x7fe72c1080d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe714009990 tx=0x7fe714009ca0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 -- 172.21.15.37:0/95823372 shutdown_connections 2024-05-09T01:08:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 --2- 172.21.15.37:0/95823372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe72c1086a0 0x7fe72c108b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 --2- 172.21.15.37:0/95823372 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 0x7fe72c103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 --2- 172.21.15.37:0/95823372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 0x7fe72c1080d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 -- 172.21.15.37:0/95823372 >> 172.21.15.37:0/95823372 conn(0x7fe72c0fedc0 msgr2=0x7fe72c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 -- 172.21.15.37:0/95823372 shutdown_connections 2024-05-09T01:08:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.907+0000 7fe732d1f700 1 -- 172.21.15.37:0/95823372 wait complete. 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.908+0000 7fe732d1f700 1 Processor -- start 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.909+0000 7fe732d1f700 1 -- start start 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.909+0000 7fe732d1f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 0x7fe72c075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.909+0000 7fe732d1f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 0x7fe72c06f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.909+0000 7fe732d1f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe72c1086a0 0x7fe72c06fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.909+0000 7fe732d1f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c06dae0 con 0x7fe72c1086a0 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.909+0000 7fe732d1f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c06d960 con 0x7fe72c103250 2024-05-09T01:08:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.909+0000 7fe732d1f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c06dc60 con 0x7fe72c103ba0 2024-05-09T01:08:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 0x7fe72c075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 0x7fe72c075450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47700/0 (socket says 172.21.15.37:47700) 2024-05-09T01:08:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 -- 172.21.15.37:0/2401464837 learned_addr learned my addr 172.21.15.37:0/2401464837 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe7312bc700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe72c1086a0 0x7fe72c06fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe72bfff700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 0x7fe72c06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 -- 172.21.15.37:0/2401464837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 msgr2=0x7fe72c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 0x7fe72c06f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 -- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe72c1086a0 msgr2=0x7fe72c06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe72c1086a0 0x7fe72c06fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe730abb700 1 -- 172.21.15.37:0/2401464837 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c1b5ec0 con 0x7fe72c103250 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe7312bc700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe72c1086a0 0x7fe72c06fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.910+0000 7fe72bfff700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 0x7fe72c06f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:08:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.911+0000 7fe730abb700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 0x7fe72c075450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00e9a0 tx=0x7fe71c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.911+0000 7fe729ffb700 1 -- 172.21.15.37:0/2401464837 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00cbd0 con 0x7fe72c103250 2024-05-09T01:08:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.911+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72c1b6090 con 0x7fe72c103250 2024-05-09T01:08:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.911+0000 7fe729ffb700 1 -- 172.21.15.37:0/2401464837 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe71c00cd70 con 0x7fe72c103250 2024-05-09T01:08:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.912+0000 7fe729ffb700 1 -- 172.21.15.37:0/2401464837 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c018680 con 0x7fe72c103250 2024-05-09T01:08:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.912+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72c1b65d0 con 0x7fe72c103250 2024-05-09T01:08:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.916+0000 7fe729ffb700 1 -- 172.21.15.37:0/2401464837 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe71c018820 con 0x7fe72c103250 2024-05-09T01:08:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.917+0000 7fe729ffb700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7200b29d0 0x7fe7200b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.917+0000 7fe729ffb700 1 -- 172.21.15.37:0/2401464837 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe71c0e2420 con 0x7fe72c103250 2024-05-09T01:08:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.917+0000 7fe72bfff700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7200b29d0 0x7fe7200b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe72bfff700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7200b29d0 0x7fe7200b4ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b2e0 tx=0x7fe714005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 Processor -- start 2024-05-09T01:08:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 -- start start 2024-05-09T01:08:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc61d8d00 0x559bc62e1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62db810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559bc61fe0a0 con 0x559bc615e4a0 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559bc61a39a0 con 0x559bc61d8d00 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.918+0000 7fe741735b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559bc61fa060 con 0x559bc62db400 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.919+0000 7fe730abb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc61d8d00 0x559bc62e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.919+0000 7fe7312bc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62db810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.919+0000 7fe7312bc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62db810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45302/0 (socket says 172.21.15.37:45302) 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.919+0000 7fe7312bc700 1 -- 172.21.15.37:0/1701349538 learned_addr learned my addr 172.21.15.37:0/1701349538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:08.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.920+0000 7fe72bfff700 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.920+0000 7fe730abb700 1 -- 172.21.15.37:0/1701349538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 msgr2=0x559bc62db810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.920+0000 7fe730abb700 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62db810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.920+0000 7fe730abb700 1 -- 172.21.15.37:0/1701349538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 msgr2=0x559bc62e1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.920+0000 7fe730abb700 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.920+0000 7fe730abb700 1 -- 172.21.15.37:0/1701349538 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc6194500 con 0x559bc61d8d00 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.920+0000 7fe7312bc700 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62db810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.921+0000 7fe730abb700 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc61d8d00 0x559bc62e1240 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0e0010 tx=0x7fe71c0b3260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e419d79f28d26d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.921+0000 7fe71affd700 1 -- 172.21.15.37:0/1701349538 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0aa9f0 con 0x559bc61d8d00 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.921+0000 7fe71affd700 1 -- 172.21.15.37:0/1701349538 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe71c0aeda0 con 0x559bc61d8d00 2024-05-09T01:08:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.921+0000 7fe71affd700 1 -- 172.21.15.37:0/1701349538 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0b3620 con 0x559bc61d8d00 2024-05-09T01:08:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 -- 172.21.15.37:0/1701349538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc61d8d00 msgr2=0x559bc62e1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc61d8d00 0x559bc62e1240 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0e0010 tx=0x7fe71c0b3260 comp rx=0 tx=0).stop 2024-05-09T01:08:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 -- 172.21.15.37:0/1701349538 shutdown_connections 2024-05-09T01:08:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62db810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc61d8d00 0x559bc62e1240 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 --2- 172.21.15.37:0/1701349538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 -- 172.21.15.37:0/1701349538 >> 172.21.15.37:0/1701349538 conn(0x559bc6161f70 msgr2=0x559bc62d6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 -- 172.21.15.37:0/1701349538 shutdown_connections 2024-05-09T01:08:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 -- 172.21.15.37:0/1701349538 wait complete. 2024-05-09T01:08:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.922+0000 7fe741735b80 1 -- start start 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.923+0000 7fe741735b80 1 Processor -- start 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.923+0000 7fe741735b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.923+0000 7fe741735b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62e5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.923+0000 7fe741735b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe741735b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559bc62dc160 con 0x559bc615e4a0 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe741735b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559bc6198b20 con 0x559bc62e5d10 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe741735b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559bc62e8020 con 0x559bc62db400 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe730abb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe730abb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57280/0 (socket says 172.21.15.37:57280) 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe730abb700 1 -- 172.21.15.37:0/2680889420 learned_addr learned my addr 172.21.15.37:0/2680889420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe7312bc700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe741735b80 10 client.0 _ll_register_callbacks cb 0x559bc606f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe72bfff700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe7312bc700 1 -- 172.21.15.37:0/2680889420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 msgr2=0x559bc62e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe7312bc700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe7312bc700 1 -- 172.21.15.37:0/2680889420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 msgr2=0x559bc62e5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe7312bc700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe7312bc700 1 -- 172.21.15.37:0/2680889420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc6079490 con 0x559bc62e5d10 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe72bfff700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe71c0aeda0 con 0x559bc62e5d10 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe7312bc700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62f1240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe724007f00 tx=0x7fe724007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ebf059d23242a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.924+0000 7fe70bfff700 10 client.26069 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe70bfff700 1 -- 172.21.15.37:0/2680889420 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72401a030 con 0x559bc62e5d10 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe70bfff700 1 -- 172.21.15.37:0/2680889420 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe724004bb0 con 0x559bc62e5d10 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe70bfff700 1 -- 172.21.15.37:0/2680889420 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe724004db0 con 0x559bc62e5d10 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 10 client.26069 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:08.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=39}) -- 0x559bc62f3030 con 0x559bc62e5d10 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe70bfff700 1 -- 172.21.15.37:0/2680889420 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fe724026020 con 0x559bc62e5d10 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 10 client.26069 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 10 client.26069 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 20 client.26069 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc62f7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 4 client.26069 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.925+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bc620ba80 con 0x559bc62f5500 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.926+0000 7fe730abb700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc62f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.926+0000 7fe730abb700 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc62f7960 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=339f6bc5803befd7 server_cookie=77aa283729c5c989 in_seq=0 out_seq=0 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.927+0000 7fe70bfff700 10 client.26069 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.927+0000 7fe70bfff700 1 -- 172.21.15.37:0/2680889420 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559bc620ba80 con 0x559bc62f5500 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.927+0000 7fe70bfff700 10 client.26069 handle_command_reply: tid=0 2024-05-09T01:08:08.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.927+0000 7fe741735b80 1 client.26069 shutdown 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 msgr2=0x559bc62f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62f1240 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe724007f00 tx=0x7fe724007f30 comp rx=0 tx=0).stop 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 shutdown_connections 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc62f7960 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62f1240 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe70bfff700 0 client.26069 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 --2- 172.21.15.37:0/2680889420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 >> 172.21.15.37:0/2680889420 conn(0x559bc6161f70 msgr2=0x559bc62cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.928+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 shutdown_connections 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.929+0000 7fe741735b80 1 -- 172.21.15.37:0/2680889420 wait complete. 2024-05-09T01:08:08.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.929+0000 7fe741735b80 20 client.26069 trim_cache size 0 max 16384 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 Processor -- start 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 -- start start 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc615e4a0 0x559bc62d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc62db400 0x559bc62e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62e7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1bd950 con 0x559bc62db400 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1bf490 con 0x559bc62e5d10 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.952+0000 7fe741735b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1be020 con 0x559bc615e4a0 2024-05-09T01:08:08.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc615e4a0 0x559bc62d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe7312bc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe7312bc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62e7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47738/0 (socket says 172.21.15.37:47738) 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc615e4a0 0x559bc62d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45326/0 (socket says 172.21.15.37:45326) 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 -- 172.21.15.37:0/933562305 learned_addr learned my addr 172.21.15.37:0/933562305 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe72bfff700 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc62db400 0x559bc62e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 -- 172.21.15.37:0/933562305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 msgr2=0x559bc62e7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62e7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 -- 172.21.15.37:0/933562305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc62db400 msgr2=0x559bc62e2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc62db400 0x559bc62e2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 -- 172.21.15.37:0/933562305 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bc62d29d0 con 0x559bc615e4a0 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.953+0000 7fe730abb700 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc615e4a0 0x559bc62d0a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0dffc0 tx=0x7fe71c00efa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58ce0df31ce7896 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.954+0000 7fe71a7fc700 1 -- 172.21.15.37:0/933562305 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0aa9f0 con 0x559bc615e4a0 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.954+0000 7fe71a7fc700 1 -- 172.21.15.37:0/933562305 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe71c0c3040 con 0x559bc615e4a0 2024-05-09T01:08:08.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.954+0000 7fe71a7fc700 1 -- 172.21.15.37:0/933562305 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c018d70 con 0x559bc615e4a0 2024-05-09T01:08:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.955+0000 7fe741735b80 1 -- 172.21.15.37:0/933562305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc615e4a0 msgr2=0x559bc62d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.955+0000 7fe741735b80 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc615e4a0 0x559bc62d0a20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0dffc0 tx=0x7fe71c00efa0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.955+0000 7fe741735b80 1 -- 172.21.15.37:0/933562305 shutdown_connections 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.955+0000 7fe741735b80 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62e7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.955+0000 7fe741735b80 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc615e4a0 0x559bc62d0a20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.956+0000 7fe741735b80 1 --2- 172.21.15.37:0/933562305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc62db400 0x559bc62e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.956+0000 7fe741735b80 1 -- 172.21.15.37:0/933562305 >> 172.21.15.37:0/933562305 conn(0x559bc6161f70 msgr2=0x559bc62e0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.956+0000 7fe741735b80 1 -- 172.21.15.37:0/933562305 shutdown_connections 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.956+0000 7fe741735b80 1 -- 172.21.15.37:0/933562305 wait complete. 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.957+0000 7fe741735b80 1 -- start start 2024-05-09T01:08:08.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.957+0000 7fe741735b80 1 Processor -- start 2024-05-09T01:08:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.958+0000 7fe741735b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe741735b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe730abb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe730abb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57294/0 (socket says 172.21.15.37:57294) 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe730abb700 1 -- 172.21.15.37:0/4274316050 learned_addr learned my addr 172.21.15.37:0/4274316050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe741735b80 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62fcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1bedc0 con 0x559bc615e4a0 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1be6f0 con 0x559bc62e5d10 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1bb930 con 0x559bc62db400 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe72bfff700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.959+0000 7fe741735b80 10 client.0 _ll_register_callbacks cb 0x559bc606f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe7312bc700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62fcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe730abb700 1 -- 172.21.15.37:0/4274316050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 msgr2=0x559bc62fc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe730abb700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62fc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe730abb700 1 -- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 msgr2=0x559bc62fcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe730abb700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62fcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe730abb700 1 -- 172.21.15.37:0/4274316050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bc62fd380 con 0x559bc615e4a0 2024-05-09T01:08:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe72bfff700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe7312bc700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe730abb700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62ed740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0a6a20 tx=0x7fe71c0aa660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbf4ac4d090373a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe70bfff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe70bfff700 1 -- 172.21.15.37:0/4274316050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0aac50 con 0x559bc615e4a0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe71c0c3040 con 0x559bc615e4a0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe70bfff700 1 -- 172.21.15.37:0/4274316050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe71c0aadf0 con 0x559bc615e4a0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe70bfff700 1 -- 172.21.15.37:0/4274316050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe71c0a9c50 con 0x559bc615e4a0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe741735b80 10 client.16248 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.960+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559bc635fb90 con 0x559bc615e4a0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe70bfff700 1 -- 172.21.15.37:0/4274316050 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe71c0c3040 con 0x559bc615e4a0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe70bfff700 1 -- 172.21.15.37:0/4274316050 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fe71c0a6360 con 0x559bc615e4a0 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe741735b80 10 client.16248 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe741735b80 10 client.16248 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:08:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe741735b80 20 client.16248 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe741735b80 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc6361ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe741735b80 4 client.16248 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:08:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559bc6205b20 con 0x559bc62f5500 2024-05-09T01:08:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.961+0000 7fe72bfff700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc6361ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.962+0000 7fe70bfff700 10 client.16248 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:08:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.962+0000 7fe72bfff700 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc6361ba0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d5d093b389e2f832 server_cookie=1e24663256d1c2ab in_seq=0 out_seq=0 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.963+0000 7fe70bfff700 1 -- 172.21.15.37:0/4274316050 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559bc6205b20 con 0x559bc62f5500 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.963+0000 7fe70bfff700 10 client.16248 handle_command_reply: tid=0 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.963+0000 7fe741735b80 1 client.16248 shutdown 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.963+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 msgr2=0x559bc62ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.963+0000 7fe741735b80 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62ed740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0a6a20 tx=0x7fe71c0aa660 comp rx=0 tx=0).stop 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 shutdown_connections 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559bc62f5500 0x559bc6361ba0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559bc62e5d10 0x559bc62fcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bc615e4a0 0x559bc62ed740 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 --2- 172.21.15.37:0/4274316050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bc62db400 0x559bc62fc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 >> 172.21.15.37:0/4274316050 conn(0x559bc6161f70 msgr2=0x559bc62e0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe70bfff700 0 client.16248 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 shutdown_connections 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.964+0000 7fe741735b80 1 -- 172.21.15.37:0/4274316050 wait complete. 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.965+0000 7fe741735b80 20 client.16248 trim_cache size 0 max 16384 2024-05-09T01:08:08.969 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:08:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7200b29d0 msgr2=0x7fe7200b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7200b29d0 0x7fe7200b4ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe71400b2e0 tx=0x7fe714005fb0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 msgr2=0x7fe72c075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:08.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 0x7fe72c075450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00e9a0 tx=0x7fe71c00ed60 comp rx=0 tx=0).stop 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 shutdown_connections 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7200b29d0 0x7fe7200b4ee0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe72c1086a0 0x7fe72c06fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe72c103250 0x7fe72c075450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 --2- 172.21.15.37:0/2401464837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe72c103ba0 0x7fe72c06f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 >> 172.21.15.37:0/2401464837 conn(0x7fe72c0fedc0 msgr2=0x7fe72c106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 shutdown_connections 2024-05-09T01:08:08.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:08.966+0000 7fe732d1f700 1 -- 172.21.15.37:0/2401464837 wait complete. 2024-05-09T01:08:09.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:08:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 350.0 s, 3297.0 tps, lat 30.596 ms stddev 39.043 2024-05-09T01:08:10.424 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:10.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:10 smithi037 ceph-mon[30122]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.4 MiB/s wr, 627 op/s 2024-05-09T01:08:10.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:10 smithi151 ceph-mon[34780]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.4 MiB/s wr, 627 op/s 2024-05-09T01:08:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:10 smithi136 ceph-mon[34110]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 9.4 MiB/s wr, 627 op/s 2024-05-09T01:08:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 -- 172.21.15.37:0/563647643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410e8e0 msgr2=0x7f34b4110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/563647643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410e8e0 0x7f34b4110dc0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00b0a0 tx=0x7f34ac00b3b0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 -- 172.21.15.37:0/563647643 shutdown_connections 2024-05-09T01:08:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/563647643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b410e8e0 0x7f34b4110dc0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/563647643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34b4105500 0x7f34b4105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/563647643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34b4105e50 0x7f34b410e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 -- 172.21.15.37:0/563647643 >> 172.21.15.37:0/563647643 conn(0x7f34b40fedc0 msgr2=0x7f34b41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:12.521 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:12 smithi037 ceph-mon[30122]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-05-09T01:08:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.519+0000 7f34bbf9a700 1 -- 172.21.15.37:0/563647643 shutdown_connections 2024-05-09T01:08:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.520+0000 7f34bbf9a700 1 -- 172.21.15.37:0/563647643 wait complete. 2024-05-09T01:08:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.520+0000 7f34bbf9a700 1 Processor -- start 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.520+0000 7f34bbf9a700 1 -- start start 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34bbf9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34b4105500 0x7f34b4104d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34bbf9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b4105e50 0x7f34b41031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34bbf9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34b410e8e0 0x7f34b41037d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34bbf9a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4114490 con 0x7f34b4105e50 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34bbf9a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4114310 con 0x7f34b4105500 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34bbf9a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f34b4114610 con 0x7f34b410e8e0 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34ba537700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34b410e8e0 0x7f34b41037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34b9535700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b4105e50 0x7f34b41031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34b9535700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b4105e50 0x7f34b41031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55202/0 (socket says 172.21.15.37:55202) 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.521+0000 7f34b9535700 1 -- 172.21.15.37:0/772780868 learned_addr learned my addr 172.21.15.37:0/772780868 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.522+0000 7f34b9535700 1 -- 172.21.15.37:0/772780868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34b410e8e0 msgr2=0x7f34b41037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.522+0000 7f34b9535700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34b410e8e0 0x7f34b41037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.522+0000 7f34b9535700 1 -- 172.21.15.37:0/772780868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34b4105500 msgr2=0x7f34b4104d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.522+0000 7f34b9535700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34b4105500 0x7f34b4104d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.522+0000 7f34b9535700 1 -- 172.21.15.37:0/772780868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b4104000 con 0x7f34b4105e50 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.523+0000 7f34b9535700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b4105e50 0x7f34b41031f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9a0 tx=0x7f34b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.523+0000 7f34aaffd700 1 -- 172.21.15.37:0/772780868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b000cbd0 con 0x7f34b4105e50 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.523+0000 7f34aaffd700 1 -- 172.21.15.37:0/772780868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34b000cd70 con 0x7f34b4105e50 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.523+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34b419efb0 con 0x7f34b4105e50 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.524+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34b419f4c0 con 0x7f34b4105e50 2024-05-09T01:08:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.524+0000 7f34aaffd700 1 -- 172.21.15.37:0/772780868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b003a680 con 0x7f34b4105e50 2024-05-09T01:08:12.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.528+0000 7f34aaffd700 1 -- 172.21.15.37:0/772780868 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f34b003a820 con 0x7f34b4105e50 2024-05-09T01:08:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.529+0000 7f34aaffd700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34a00b2a10 0x7f34a00b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.529+0000 7f34aaffd700 1 -- 172.21.15.37:0/772780868 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f34b0104420 con 0x7f34b4105e50 2024-05-09T01:08:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.529+0000 7f34b9d36700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34a00b2a10 0x7f34a00b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.530+0000 7f34ca9b0b80 1 Processor -- start 2024-05-09T01:08:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.533+0000 7f34ca9b0b80 1 -- start start 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.533+0000 7f34b9d36700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34a00b2a10 0x7f34a00b4f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009b20 tx=0x7f34a4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.533+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2ccd00 0x55c26e3d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.533+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.533+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e3cf400 0x55c26e3cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c26e2f20a0 con 0x55c26e3cf400 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c26e2979a0 con 0x55c26e2ccd00 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c26e2ee060 con 0x55c26e2524a0 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34ba537700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e3cf400 0x55c26e3cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9d36700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2ccd00 0x55c26e3d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34ba537700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e3cf400 0x55c26e3cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55210/0 (socket says 172.21.15.37:55210) 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34ba537700 1 -- 172.21.15.37:0/1915300683 learned_addr learned my addr 172.21.15.37:0/1915300683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9535700 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9d36700 1 -- 172.21.15.37:0/1915300683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 msgr2=0x55c26e3d5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9d36700 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9d36700 1 -- 172.21.15.37:0/1915300683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e3cf400 msgr2=0x55c26e3cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9d36700 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e3cf400 0x55c26e3cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9d36700 1 -- 172.21.15.37:0/1915300683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26e288500 con 0x55c26e2ccd00 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34ba537700 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e3cf400 0x55c26e3cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.534+0000 7f34b9d36700 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2ccd00 0x55c26e3d5240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34a400eae0 tx=0x7f34a4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff4866e7579a0d69 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.535+0000 7f349ffff700 1 -- 172.21.15.37:0/1915300683 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4020070 con 0x55c26e2ccd00 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.535+0000 7f349ffff700 1 -- 172.21.15.37:0/1915300683 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34a4010d70 con 0x55c26e2ccd00 2024-05-09T01:08:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.535+0000 7f349ffff700 1 -- 172.21.15.37:0/1915300683 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34a4005280 con 0x55c26e2ccd00 2024-05-09T01:08:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1915300683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2ccd00 msgr2=0x55c26e3d5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2ccd00 0x55c26e3d5240 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34a400eae0 tx=0x7f34a4011000 comp rx=0 tx=0).stop 2024-05-09T01:08:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1915300683 shutdown_connections 2024-05-09T01:08:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e3cf400 0x55c26e3cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2ccd00 0x55c26e3d5240 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1915300683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1915300683 >> 172.21.15.37:0/1915300683 conn(0x55c26e255f70 msgr2=0x55c26e3ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1915300683 shutdown_connections 2024-05-09T01:08:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.536+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1915300683 wait complete. 2024-05-09T01:08:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.537+0000 7f34ca9b0b80 1 -- start start 2024-05-09T01:08:12.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.537+0000 7f34ca9b0b80 1 Processor -- start 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.538+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.538+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e3cf400 0x55c26e3d9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c26e3d0160 con 0x55c26e2ccd00 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c26e28cb20 con 0x55c26e3cf400 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c26e3dc020 con 0x55c26e2524a0 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55220/0 (socket says 172.21.15.37:55220) 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 -- 172.21.15.37:0/739813205 learned_addr learned my addr 172.21.15.37:0/739813205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34ca9b0b80 10 client.0 _ll_register_callbacks cb 0x55c26e1636c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34ba537700 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e3cf400 0x55c26e3d9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 -- 172.21.15.37:0/739813205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 msgr2=0x55c26e3d90b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:08:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d90b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 -- 172.21.15.37:0/739813205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e3cf400 msgr2=0x55c26e3d9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e3cf400 0x55c26e3d9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.539+0000 7f34b9535700 1 -- 172.21.15.37:0/739813205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26e16d490 con 0x55c26e2ccd00 2024-05-09T01:08:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.540+0000 7f34b9535700 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d95f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f34b00cb7e0 tx=0x7f34b00cc020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40554d703f49faf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.540+0000 7f349d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.540+0000 7f349d7fa700 1 -- 172.21.15.37:0/739813205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b00e5060 con 0x55c26e2ccd00 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.540+0000 7f349d7fa700 1 -- 172.21.15.37:0/739813205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f34b00caf50 con 0x55c26e2ccd00 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.540+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34a4010d70 con 0x55c26e2ccd00 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.541+0000 7f349d7fa700 1 -- 172.21.15.37:0/739813205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f34b00d4280 con 0x55c26e2ccd00 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.541+0000 7f34ca9b0b80 10 client.16260 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.541+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c26e3e6ae0 con 0x55c26e2ccd00 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f349d7fa700 1 -- 172.21.15.37:0/739813205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34b00cb5f0 con 0x55c26e2ccd00 2024-05-09T01:08:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f349d7fa700 1 -- 172.21.15.37:0/739813205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f34b00d4b90 con 0x55c26e2ccd00 2024-05-09T01:08:12.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f34ca9b0b80 10 client.16260 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:12.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f34ca9b0b80 10 client.16260 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:08:12.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f34ca9b0b80 20 client.16260 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:12.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3e8fb0 0x55c26e3eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f34ca9b0b80 4 client.16260 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:12.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.542+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f34a4010d70 con 0x55c26e3e8fb0 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.543+0000 7f34b9d36700 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3e8fb0 0x55c26e3eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.543+0000 7f34b9d36700 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3e8fb0 0x55c26e3eb3d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aad1c87d3a3ea78a server_cookie=9ae3b1c749cce497 in_seq=0 out_seq=0 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.543+0000 7f349d7fa700 10 client.16260 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f349d7fa700 1 -- 172.21.15.37:0/739813205 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f34a4010d70 con 0x55c26e3e8fb0 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f349d7fa700 10 client.16260 handle_command_reply: tid=0 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f34ca9b0b80 1 client.16260 shutdown 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 msgr2=0x55c26e3d95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d95f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f34b00cb7e0 tx=0x7f34b00cc020 comp rx=0 tx=0).stop 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 shutdown_connections 2024-05-09T01:08:12.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3e8fb0 0x55c26e3eb3d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e3cf400 0x55c26e3d9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.544+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.545+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/739813205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d95f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.545+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 >> 172.21.15.37:0/739813205 conn(0x55c26e255f70 msgr2=0x55c26e3c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.545+0000 7f349d7fa700 0 client.16260 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.545+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 shutdown_connections 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.545+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/739813205 wait complete. 2024-05-09T01:08:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.545+0000 7f34ca9b0b80 20 client.16260 trim_cache size 0 max 16384 2024-05-09T01:08:12.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.569+0000 7f34ca9b0b80 1 Processor -- start 2024-05-09T01:08:12.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.569+0000 7f34ca9b0b80 1 -- start start 2024-05-09T01:08:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e255f70 0x55c26e3db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34b41a6990 con 0x55c26e2ccd00 2024-05-09T01:08:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f34b41ae500 con 0x55c26e255f70 2024-05-09T01:08:12.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f34b41a7060 con 0x55c26e2524a0 2024-05-09T01:08:12.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ba537700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ba537700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55236/0 (socket says 172.21.15.37:55236) 2024-05-09T01:08:12.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34ba537700 1 -- 172.21.15.37:0/1801583981 learned_addr learned my addr 172.21.15.37:0/1801583981 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:12.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.570+0000 7f34b9535700 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.571+0000 7f34ba537700 1 -- 172.21.15.37:0/1801583981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 msgr2=0x55c26e3d9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:12.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.571+0000 7f34ba537700 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.571+0000 7f34ba537700 1 -- 172.21.15.37:0/1801583981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e255f70 msgr2=0x55c26e3db550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:08:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.571+0000 7f34ba537700 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e255f70 0x55c26e3db550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.571+0000 7f34ba537700 1 -- 172.21.15.37:0/1801583981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26e3d7620 con 0x55c26e2ccd00 2024-05-09T01:08:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.571+0000 7f34ba537700 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d80b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009550 tx=0x7f34ac009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46ff9c9f5345f42 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.572+0000 7f349f7fe700 1 -- 172.21.15.37:0/1801583981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00bc90 con 0x55c26e2ccd00 2024-05-09T01:08:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.572+0000 7f349f7fe700 1 -- 172.21.15.37:0/1801583981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34ac0075c0 con 0x55c26e2ccd00 2024-05-09T01:08:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.572+0000 7f349f7fe700 1 -- 172.21.15.37:0/1801583981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00be30 con 0x55c26e2ccd00 2024-05-09T01:08:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1801583981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 msgr2=0x55c26e3d80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d80b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009550 tx=0x7f34ac009580 comp rx=0 tx=0).stop 2024-05-09T01:08:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1801583981 shutdown_connections 2024-05-09T01:08:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e2ccd00 0x55c26e3d80b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e255f70 0x55c26e3db550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/1801583981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2524a0 0x55c26e3d9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1801583981 >> 172.21.15.37:0/1801583981 conn(0x55c26e3cfae0 msgr2=0x55c26e3d79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.573+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1801583981 shutdown_connections 2024-05-09T01:08:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.574+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/1801583981 wait complete. 2024-05-09T01:08:12.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.574+0000 7f34ca9b0b80 1 -- start start 2024-05-09T01:08:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.574+0000 7f34ca9b0b80 1 Processor -- start 2024-05-09T01:08:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.575+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2524a0 0x55c26e3e1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.575+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e255f70 0x55c26e3e1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ca9b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2ccd00 0x55c26e3efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34b41ade30 con 0x55c26e255f70 2024-05-09T01:08:12.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ca9b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f34b41ad780 con 0x55c26e2524a0 2024-05-09T01:08:12.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34b9d36700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2524a0 0x55c26e3e1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34b9535700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e255f70 0x55c26e3e1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34b9d36700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2524a0 0x55c26e3e1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36278/0 (socket says 172.21.15.37:36278) 2024-05-09T01:08:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34b9d36700 1 -- 172.21.15.37:0/4013351453 learned_addr learned my addr 172.21.15.37:0/4013351453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ba537700 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2ccd00 0x55c26e3efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f34b41a49b0 con 0x55c26e2ccd00 2024-05-09T01:08:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ca9b0b80 10 client.0 _ll_register_callbacks cb 0x55c26e1636c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ba537700 1 -- 172.21.15.37:0/4013351453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2524a0 msgr2=0x55c26e3e1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ba537700 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2524a0 0x55c26e3e1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ba537700 1 -- 172.21.15.37:0/4013351453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e255f70 msgr2=0x55c26e3e1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.576+0000 7f34ba537700 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e255f70 0x55c26e3e1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.577+0000 7f34ba537700 1 -- 172.21.15.37:0/4013351453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26e3f0460 con 0x55c26e2ccd00 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.577+0000 7f34ba537700 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2ccd00 0x55c26e3efcc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009900 tx=0x7f34ac0079a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=949872c976d0aeb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.577+0000 7f349d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.577+0000 7f349d7fa700 1 -- 172.21.15.37:0/4013351453 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac003c10 con 0x55c26e2ccd00 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.578+0000 7f349d7fa700 1 -- 172.21.15.37:0/4013351453 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f34ac003db0 con 0x55c26e2ccd00 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.578+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34ac0075c0 con 0x55c26e2ccd00 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.579+0000 7f349d7fa700 1 -- 172.21.15.37:0/4013351453 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f34ac0050b0 con 0x55c26e2ccd00 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.579+0000 7f34ca9b0b80 10 client.26074 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.579+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c26e453140 con 0x55c26e2ccd00 2024-05-09T01:08:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f349d7fa700 1 -- 172.21.15.37:0/4013351453 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34ac005700 con 0x55c26e2ccd00 2024-05-09T01:08:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f349d7fa700 1 -- 172.21.15.37:0/4013351453 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f34ac011070 con 0x55c26e2ccd00 2024-05-09T01:08:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f34ca9b0b80 10 client.26074 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f34ca9b0b80 10 client.26074 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:08:12.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f34ca9b0b80 20 client.26074 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:12.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3cf400 0x55c26e455750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f34ca9b0b80 4 client.26074 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:08:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.580+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f34ac0075c0 con 0x55c26e3cf400 2024-05-09T01:08:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.581+0000 7f34b9d36700 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3cf400 0x55c26e455750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.581+0000 7f349d7fa700 10 client.26074 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:08:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.581+0000 7f34b9d36700 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3cf400 0x55c26e455750 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71893db90c433f2e server_cookie=339c211b50135cb0 in_seq=0 out_seq=0 2024-05-09T01:08:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f349d7fa700 1 -- 172.21.15.37:0/4013351453 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f34ac0075c0 con 0x55c26e3cf400 2024-05-09T01:08:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f349d7fa700 10 client.26074 handle_command_reply: tid=0 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 client.26074 shutdown 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2ccd00 msgr2=0x55c26e3efcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2ccd00 0x55c26e3efcc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009900 tx=0x7f34ac0079a0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 shutdown_connections 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55c26e3cf400 0x55c26e455750 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c26e2ccd00 0x55c26e3efcc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f349d7fa700 0 client.26074 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c26e2524a0 0x55c26e3e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 --2- 172.21.15.37:0/4013351453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c26e255f70 0x55c26e3e1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 >> 172.21.15.37:0/4013351453 conn(0x55c26e3cfae0 msgr2=0x55c26e3c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 shutdown_connections 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 1 -- 172.21.15.37:0/4013351453 wait complete. 2024-05-09T01:08:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.582+0000 7f34ca9b0b80 20 client.26074 trim_cache size 0 max 16384 2024-05-09T01:08:12.586 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:08:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.583+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34a00b2a10 msgr2=0x7f34a00b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.583+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34a00b2a10 0x7f34a00b4f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f34a4009b20 tx=0x7f34a4009260 comp rx=0 tx=0).stop 2024-05-09T01:08:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.583+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b4105e50 msgr2=0x7f34b41031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b4105e50 0x7f34b41031f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e9a0 tx=0x7f34b000ecb0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 shutdown_connections 2024-05-09T01:08:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34a00b2a10 0x7f34a00b4f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34b410e8e0 0x7f34b41037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34b4105500 0x7f34b4104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 --2- 172.21.15.37:0/772780868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34b4105e50 0x7f34b41031f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 >> 172.21.15.37:0/772780868 conn(0x7f34b40fedc0 msgr2=0x7f34b40ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 shutdown_connections 2024-05-09T01:08:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:12.584+0000 7f34bbf9a700 1 -- 172.21.15.37:0/772780868 wait complete. 2024-05-09T01:08:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:12 smithi136 ceph-mon[34110]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-05-09T01:08:12.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:12 smithi151 ceph-mon[34780]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 738 op/s 2024-05-09T01:08:13.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:08:14.007 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:14.407 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:14 smithi037 ceph-mon[30122]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 724 op/s 2024-05-09T01:08:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:14 smithi136 ceph-mon[34110]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 724 op/s 2024-05-09T01:08:14.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:14 smithi151 ceph-mon[34780]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 724 op/s 2024-05-09T01:08:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 355.0 s, 2898.8 tps, lat 34.454 ms stddev 41.300 2024-05-09T01:08:15.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.996+0000 7f4fb647c700 1 -- 172.21.15.37:0/3085924442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb01034c0 msgr2=0x7f4fb01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:15.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.996+0000 7f4fb647c700 1 --2- 172.21.15.37:0/3085924442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb01034c0 0x7f4fb01038d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00099c0 tx=0x7f4fa0009cd0 comp rx=0 tx=0).stop 2024-05-09T01:08:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.996+0000 7f4fb647c700 1 -- 172.21.15.37:0/3085924442 shutdown_connections 2024-05-09T01:08:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.996+0000 7f4fb647c700 1 --2- 172.21.15.37:0/3085924442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fb0108740 0x7f4fb01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.996+0000 7f4fb647c700 1 --2- 172.21.15.37:0/3085924442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb01034c0 0x7f4fb01038d0 secure :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00099c0 tx=0x7f4fa0009cd0 comp rx=0 tx=0).stop 2024-05-09T01:08:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.996+0000 7f4fb647c700 1 --2- 172.21.15.37:0/3085924442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0107df0 0x7f4fb0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.996+0000 7f4fb647c700 1 -- 172.21.15.37:0/3085924442 >> 172.21.15.37:0/3085924442 conn(0x7f4fb00fedf0 msgr2=0x7f4fb0101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.997+0000 7f4fb647c700 1 -- 172.21.15.37:0/3085924442 shutdown_connections 2024-05-09T01:08:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.997+0000 7f4fb647c700 1 -- 172.21.15.37:0/3085924442 wait complete. 2024-05-09T01:08:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.998+0000 7f4fb647c700 1 Processor -- start 2024-05-09T01:08:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.998+0000 7f4fb647c700 1 -- start start 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4fb647c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb0107df0 0x7f4fb019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4fb647c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0108740 0x7f4fb019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4fb647c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fb019c840 0x7f4fb01a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4fb647c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb01133c0 con 0x7f4fb0107df0 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4fb647c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0113240 con 0x7f4fb019c840 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4fb647c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0113540 con 0x7f4fb0108740 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb0107df0 0x7f4fb019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb0107df0 0x7f4fb019bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55256/0 (socket says 172.21.15.37:55256) 2024-05-09T01:08:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 -- 172.21.15.37:0/2147745999 learned_addr learned my addr 172.21.15.37:0/2147745999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0108740 0x7f4fb019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fb019c840 0x7f4fb01a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 -- 172.21.15.37:0/2147745999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0108740 msgr2=0x7f4fb019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0108740 0x7f4fb019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 -- 172.21.15.37:0/2147745999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fb019c840 msgr2=0x7f4fb01a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fb019c840 0x7f4fb01a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:15.999+0000 7f4faffff700 1 -- 172.21.15.37:0/2147745999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb01a75e0 con 0x7f4fb0107df0 2024-05-09T01:08:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.000+0000 7f4faffff700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb0107df0 0x7f4fb019bdc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00098e0 tx=0x7f4fa00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:16.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.000+0000 7f4fad7fa700 1 -- 172.21.15.37:0/2147745999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0009e60 con 0x7f4fb0107df0 2024-05-09T01:08:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.000+0000 7f4fad7fa700 1 -- 172.21.15.37:0/2147745999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa0005030 con 0x7f4fb0107df0 2024-05-09T01:08:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.000+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb0199bb0 con 0x7f4fb0107df0 2024-05-09T01:08:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.000+0000 7f4fad7fa700 1 -- 172.21.15.37:0/2147745999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00049f0 con 0x7f4fb0107df0 2024-05-09T01:08:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.000+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb019a040 con 0x7f4fb0107df0 2024-05-09T01:08:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.005+0000 7f4fad7fa700 1 -- 172.21.15.37:0/2147745999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4fa0004b90 con 0x7f4fb0107df0 2024-05-09T01:08:16.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.007+0000 7f4fc4e92b80 1 Processor -- start 2024-05-09T01:08:16.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.007+0000 7f4fad7fa700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f980b2900 0x7f4f980b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.007+0000 7f4fad7fa700 1 -- 172.21.15.37:0/2147745999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4fa00e2c00 con 0x7f4fb0107df0 2024-05-09T01:08:16.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.007+0000 7f4fc4e92b80 1 -- start start 2024-05-09T01:08:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b35232c160 0x55b3523cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3522424a0 0x55b3523ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3523c7eb0 0x55b3523c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3522e1ff0 con 0x55b3522424a0 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b3522807f0 con 0x55b3523c7eb0 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b3522ddfb0 con 0x55b35232c160 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b35232c160 0x55b3523cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b35232c160 0x55b3523cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42916/0 (socket says 172.21.15.37:42916) 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 -- 172.21.15.37:0/1431276941 learned_addr learned my addr 172.21.15.37:0/1431276941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 -- 172.21.15.37:0/1431276941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3523c7eb0 msgr2=0x55b3523c82e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 --2- 172.21.15.37:0/1431276941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3523c7eb0 0x55b3523c82e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 -- 172.21.15.37:0/1431276941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3522424a0 msgr2=0x55b3523ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 --2- 172.21.15.37:0/1431276941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3522424a0 0x55b3523ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.008+0000 7f4faffff700 1 -- 172.21.15.37:0/1431276941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b352278370 con 0x55b35232c160 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.009+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f980b2900 0x7f4f980b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.010+0000 7f4faffff700 1 --2- 172.21.15.37:0/1431276941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b35232c160 0x55b3523cdd00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a75c0 tx=0x7f4fa00096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b785f54b994153c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.010+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f980b2900 0x7f4f980b4e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55b3523ce8d0 tx=0x7f4fa8009100 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.010+0000 7f4f967fc700 1 -- 172.21.15.37:0/1431276941 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00aa350 con 0x55b35232c160 2024-05-09T01:08:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.010+0000 7f4f967fc700 1 -- 172.21.15.37:0/1431276941 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa00ae700 con 0x55b35232c160 2024-05-09T01:08:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.010+0000 7f4f967fc700 1 -- 172.21.15.37:0/1431276941 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00b2c90 con 0x55b35232c160 2024-05-09T01:08:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.011+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1431276941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b35232c160 msgr2=0x55b3523cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.011+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1431276941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b35232c160 0x55b3523cdd00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a75c0 tx=0x7f4fa00096a0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.012+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1431276941 shutdown_connections 2024-05-09T01:08:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.012+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1431276941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3523c7eb0 0x55b3523c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.012+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1431276941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b35232c160 0x55b3523cdd00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.012+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1431276941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3522424a0 0x55b3523ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.012+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1431276941 >> 172.21.15.37:0/1431276941 conn(0x55b3522a26a0 msgr2=0x55b3523ba400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.012+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1431276941 shutdown_connections 2024-05-09T01:08:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.013+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1431276941 wait complete. 2024-05-09T01:08:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.013+0000 7f4fc4e92b80 1 -- start start 2024-05-09T01:08:16.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.013+0000 7f4fc4e92b80 1 Processor -- start 2024-05-09T01:08:16.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3522424a0 0x55b3523d7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523d7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523d1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b35215dba0 con 0x55b35232c160 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b35229c150 con 0x55b3522424a0 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b3523c8b70 con 0x55b3523c7eb0 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4faf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523d7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4fc4e92b80 10 client.0 _ll_register_callbacks cb 0x55b3521536c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4faf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523d7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55272/0 (socket says 172.21.15.37:55272) 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4faf7fe700 1 -- 172.21.15.37:0/1762110691 learned_addr learned my addr 172.21.15.37:0/1762110691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.014+0000 7f4faffff700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3522424a0 0x55b3523d7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523d1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4faffff700 1 -- 172.21.15.37:0/1762110691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 msgr2=0x55b3523d1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4faffff700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523d1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4faffff700 1 -- 172.21.15.37:0/1762110691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 msgr2=0x55b3523d7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4faffff700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523d7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4faffff700 1 -- 172.21.15.37:0/1762110691 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b35215d490 con 0x55b3522424a0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4faffff700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3522424a0 0x55b3523d7550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a63d0 tx=0x7f4fa00aab10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e3d152c9f7f9daf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4f8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1762110691 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00c3030 con 0x55b3522424a0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1762110691 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4fa00a6940 con 0x55b3522424a0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa00ae700 con 0x55b3522424a0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1762110691 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4fa00aa350 con 0x55b3522424a0 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4fc4e92b80 10 client.26093 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b3523df150 con 0x55b3522424a0 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.015+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1762110691 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa00aa7c0 con 0x55b3522424a0 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1762110691 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f4fa002a030 con 0x55b3522424a0 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4fc4e92b80 10 client.26093 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4fc4e92b80 10 client.26093 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4fc4e92b80 20 client.26093 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b3523e1620 0x55b3523e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4fc4e92b80 4 client.26093 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4fa00ae700 con 0x55b3523e1620 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4faf7fe700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b3523e1620 0x55b3523e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4f8f7fe700 10 client.26093 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:08:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.016+0000 7f4faf7fe700 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b3523e1620 0x55b3523e3a40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae51aa4cadc31f9c server_cookie=d2cc47d177d05fc6 in_seq=0 out_seq=0 2024-05-09T01:08:16.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.017+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1762110691 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f4fa00ae700 con 0x55b3523e1620 2024-05-09T01:08:16.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.017+0000 7f4f8f7fe700 10 client.26093 handle_command_reply: tid=0 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.017+0000 7f4fc4e92b80 1 client.26093 shutdown 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.017+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3522424a0 msgr2=0x55b3523d7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.017+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3522424a0 0x55b3523d7550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00a63d0 tx=0x7f4fa00aab10 comp rx=0 tx=0).stop 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 shutdown_connections 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523d1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b3522424a0 0x55b3523d7550 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b3523e1620 0x55b3523e3a40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1762110691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523d7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 >> 172.21.15.37:0/1762110691 conn(0x55b3522a26a0 msgr2=0x55b3523ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4f8f7fe700 0 client.26093 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:08:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 shutdown_connections 2024-05-09T01:08:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1762110691 wait complete. 2024-05-09T01:08:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.018+0000 7f4fc4e92b80 20 client.26093 trim_cache size 0 max 16384 2024-05-09T01:08:16.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.040+0000 7f4fc4e92b80 1 Processor -- start 2024-05-09T01:08:16.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fc4e92b80 1 -- start start 2024-05-09T01:08:16.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3522424a0 0x55b3523d7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b35232c160 0x55b3523d7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3523c7eb0 0x55b3523d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb00727f0 con 0x55b3523c7eb0 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0074330 con 0x55b35232c160 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fc4e92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0072ec0 con 0x55b3522424a0 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4faffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3522424a0 0x55b3523d7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4faffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3522424a0 0x55b3523d7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42928/0 (socket says 172.21.15.37:42928) 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4faffff700 1 -- 172.21.15.37:0/2420494064 learned_addr learned my addr 172.21.15.37:0/2420494064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3523c7eb0 0x55b3523d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.041+0000 7f4faf7fe700 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b35232c160 0x55b3523d7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4faffff700 1 -- 172.21.15.37:0/2420494064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b35232c160 msgr2=0x55b3523d7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4faffff700 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b35232c160 0x55b3523d7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4faffff700 1 -- 172.21.15.37:0/2420494064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3523c7eb0 msgr2=0x55b3523d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4faffff700 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3523c7eb0 0x55b3523d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4faffff700 1 -- 172.21.15.37:0/2420494064 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3523cfec0 con 0x55b3522424a0 2024-05-09T01:08:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3523c7eb0 0x55b3523d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4faffff700 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3522424a0 0x55b3523d7530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009990 tx=0x7f4fa0009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deffd69ce0c9d59d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4f95ffb700 1 -- 172.21.15.37:0/2420494064 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00c3070 con 0x55b3522424a0 2024-05-09T01:08:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4f95ffb700 1 -- 172.21.15.37:0/2420494064 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa00b3120 con 0x55b3522424a0 2024-05-09T01:08:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.042+0000 7f4f95ffb700 1 -- 172.21.15.37:0/2420494064 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00b2c90 con 0x55b3522424a0 2024-05-09T01:08:16.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.043+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/2420494064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3522424a0 msgr2=0x55b3523d7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.043+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3522424a0 0x55b3523d7530 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009990 tx=0x7f4fa0009310 comp rx=0 tx=0).stop 2024-05-09T01:08:16.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.043+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/2420494064 shutdown_connections 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.043+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3523c7eb0 0x55b3523d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.043+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3522424a0 0x55b3523d7530 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009990 tx=0x7f4fa0009310 comp rx=0 tx=0).stop 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.043+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/2420494064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b35232c160 0x55b3523d7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.043+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/2420494064 >> 172.21.15.37:0/2420494064 conn(0x55b3522a26a0 msgr2=0x55b3523ba170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.044+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/2420494064 shutdown_connections 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.044+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/2420494064 wait complete. 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.045+0000 7f4fc4e92b80 1 -- start start 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.045+0000 7f4fc4e92b80 1 Processor -- start 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.045+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523dad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.045+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.045+0000 7f4fc4e92b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b352447be0 0x55b35244a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523dad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523dad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55282/0 (socket says 172.21.15.37:55282) 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 -- 172.21.15.37:0/1264169368 learned_addr learned my addr 172.21.15.37:0/1264169368 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0073c60 con 0x55b35232c160 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb0073590 con 0x55b352447be0 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb00707b0 con 0x55b3523c7eb0 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4fc4e92b80 10 client.0 _ll_register_callbacks cb 0x55b3521536c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faf7fe700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4fb4a19700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b352447be0 0x55b35244a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 -- 172.21.15.37:0/1264169368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 msgr2=0x55b3523db2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523db2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 -- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b352447be0 msgr2=0x55b35244a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b352447be0 0x55b35244a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 -- 172.21.15.37:0/1264169368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b35244a570 con 0x55b35232c160 2024-05-09T01:08:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faf7fe700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523db2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4faffff700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523dad60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00aa2e0 tx=0x7f4fa00a5d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42af920e1e7ead0c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.046+0000 7f4f8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:08:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.047+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1264169368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa00c3070 con 0x55b35232c160 2024-05-09T01:08:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.047+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1264169368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4fa00b2c90 con 0x55b35232c160 2024-05-09T01:08:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.047+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa00b3120 con 0x55b35232c160 2024-05-09T01:08:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.056+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1264169368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4fa00095d0 con 0x55b35232c160 2024-05-09T01:08:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.056+0000 7f4fc4e92b80 10 client.16281 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.056+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b35244a570 con 0x55b35232c160 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1264169368 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa00b3120 con 0x55b35232c160 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1264169368 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f4fa002a040 con 0x55b35232c160 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4fc4e92b80 10 client.16281 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4fc4e92b80 10 client.16281 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4fc4e92b80 20 client.16281 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b35244ba40 0x55b35244de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4fc4e92b80 4 client.16281 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:08:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.063+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3522ef9d0 con 0x55b35244ba40 2024-05-09T01:08:16.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.066+0000 7f4faf7fe700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b35244ba40 0x55b35244de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:16.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.078+0000 7f4faf7fe700 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b35244ba40 0x55b35244de60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8be1f4d40f9b9c4f server_cookie=190a356a76494b9f in_seq=0 out_seq=0 2024-05-09T01:08:16.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.078+0000 7f4f8f7fe700 10 client.16281 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:08:16.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.078+0000 7f4f8f7fe700 1 -- 172.21.15.37:0/1264169368 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3522ef9d0 con 0x55b35244ba40 2024-05-09T01:08:16.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.078+0000 7f4f8f7fe700 10 client.16281 handle_command_reply: tid=0 2024-05-09T01:08:16.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.078+0000 7f4fc4e92b80 1 client.16281 shutdown 2024-05-09T01:08:16.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.083+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 msgr2=0x55b3523dad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.083+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523dad60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00aa2e0 tx=0x7f4fa00a5d30 comp rx=0 tx=0).stop 2024-05-09T01:08:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.086+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 shutdown_connections 2024-05-09T01:08:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.086+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b352447be0 0x55b35244a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.086+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55b35244ba40 0x55b35244de60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.086+0000 7f4f8f7fe700 0 client.16281 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:08:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.086+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b35232c160 0x55b3523dad60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.086+0000 7f4fc4e92b80 1 --2- 172.21.15.37:0/1264169368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3523c7eb0 0x55b3523db2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.086+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 >> 172.21.15.37:0/1264169368 conn(0x55b3522a26a0 msgr2=0x55b3523d7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.089+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 shutdown_connections 2024-05-09T01:08:16.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.089+0000 7f4fc4e92b80 1 -- 172.21.15.37:0/1264169368 wait complete. 2024-05-09T01:08:16.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.089+0000 7f4fc4e92b80 20 client.16281 trim_cache size 0 max 16384 2024-05-09T01:08:16.091 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.093+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f980b2900 msgr2=0x7f4f980b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.093+0000 7f4fb647c700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f980b2900 0x7f4f980b4e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55b3523ce8d0 tx=0x7f4fa8009100 comp rx=0 tx=0).stop 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.093+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb0107df0 msgr2=0x7f4fb019bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.093+0000 7f4fb647c700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb0107df0 0x7f4fb019bdc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00098e0 tx=0x7f4fa00045e0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.094+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 shutdown_connections 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.094+0000 7f4fb647c700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f980b2900 0x7f4f980b4e10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.094+0000 7f4fb647c700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fb019c840 0x7f4fb01a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.094+0000 7f4fb647c700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fb0107df0 0x7f4fb019bdc0 secure :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00098e0 tx=0x7f4fa00045e0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.094+0000 7f4fb647c700 1 --2- 172.21.15.37:0/2147745999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fb0108740 0x7f4fb019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.094+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 >> 172.21.15.37:0/2147745999 conn(0x7f4fb00fedf0 msgr2=0x7f4fb0101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.095+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 shutdown_connections 2024-05-09T01:08:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:16.095+0000 7f4fb647c700 1 -- 172.21.15.37:0/2147745999 wait complete. 2024-05-09T01:08:16.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:16 smithi037 ceph-mon[30122]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 736 op/s 2024-05-09T01:08:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:16 smithi136 ceph-mon[34110]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 736 op/s 2024-05-09T01:08:16.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:16 smithi151 ceph-mon[34780]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 736 op/s 2024-05-09T01:08:16.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:08:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:18.532 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:18 smithi037 ceph-mon[30122]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 705 op/s 2024-05-09T01:08:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:18 smithi136 ceph-mon[34110]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 705 op/s 2024-05-09T01:08:18.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:18 smithi151 ceph-mon[34780]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 705 op/s 2024-05-09T01:08:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.972+0000 7fbbd876c700 1 -- 172.21.15.37:0/3061710283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 msgr2=0x7fbbd010cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.972+0000 7fbbd876c700 1 --2- 172.21.15.37:0/3061710283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 0x7fbbd010cc50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009990 tx=0x7fbbcc009ca0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.973+0000 7fbbd876c700 1 -- 172.21.15.37:0/3061710283 shutdown_connections 2024-05-09T01:08:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.973+0000 7fbbd876c700 1 --2- 172.21.15.37:0/3061710283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbd0110fb0 0x7fbbd01188f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.973+0000 7fbbd876c700 1 --2- 172.21.15.37:0/3061710283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 0x7fbbd010cc50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.973+0000 7fbbd876c700 1 --2- 172.21.15.37:0/3061710283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0110660 0x7fbbd0110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.973+0000 7fbbd876c700 1 -- 172.21.15.37:0/3061710283 >> 172.21.15.37:0/3061710283 conn(0x7fbbd006f4d0 msgr2=0x7fbbd006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.973+0000 7fbbd876c700 1 -- 172.21.15.37:0/3061710283 shutdown_connections 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.973+0000 7fbbd876c700 1 -- 172.21.15.37:0/3061710283 wait complete. 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.974+0000 7fbbd876c700 1 Processor -- start 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.974+0000 7fbbd876c700 1 -- start start 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.975+0000 7fbbd876c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 0x7fbbd01a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd876c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0110660 0x7fbbd01a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd876c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbd0110fb0 0x7fbbd01a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd876c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd011bbe0 con 0x7fbbd010c840 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd876c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd011ba60 con 0x7fbbd0110fb0 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd876c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd011bd60 con 0x7fbbd0110660 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd6d09700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbd0110fb0 0x7fbbd01a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd6508700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 0x7fbbd01a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd6d09700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbd0110fb0 0x7fbbd01a6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36324/0 (socket says 172.21.15.37:36324) 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd6d09700 1 -- 172.21.15.37:0/1212950545 learned_addr learned my addr 172.21.15.37:0/1212950545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.976+0000 7fbbd5d07700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0110660 0x7fbbd01a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd5d07700 1 -- 172.21.15.37:0/1212950545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbd0110fb0 msgr2=0x7fbbd01a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd5d07700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbd0110fb0 0x7fbbd01a6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd5d07700 1 -- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 msgr2=0x7fbbd01a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:18.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd5d07700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 0x7fbbd01a2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd5d07700 1 -- 172.21.15.37:0/1212950545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd01a7400 con 0x7fbbd0110660 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd6508700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 0x7fbbd01a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd5d07700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0110660 0x7fbbd01a2ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006d130 tx=0x7fbbc000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbc77fe700 1 -- 172.21.15.37:0/1212950545 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0016070 con 0x7fbbd0110660 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd01a76f0 con 0x7fbbd0110660 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbc77fe700 1 -- 172.21.15.37:0/1212950545 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbc000fd40 con 0x7fbbd0110660 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbc77fe700 1 -- 172.21.15.37:0/1212950545 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0016070 con 0x7fbbd0110660 2024-05-09T01:08:18.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.977+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd010b4a0 con 0x7fbbd0110660 2024-05-09T01:08:18.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.982+0000 7fbbc77fe700 1 -- 172.21.15.37:0/1212950545 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbbc0019070 con 0x7fbbd0110660 2024-05-09T01:08:18.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.982+0000 7fbbe7182b80 1 Processor -- start 2024-05-09T01:08:18.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.983+0000 7fbbe7182b80 1 -- start start 2024-05-09T01:08:18.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.984+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f64240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.984+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238de14a0 0x561238f64780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.984+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f5e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbe7182b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561238e810a0 con 0x561238e5bd00 2024-05-09T01:08:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbe7182b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561238e269a0 con 0x561238f5e400 2024-05-09T01:08:18.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbe7182b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561238e7d060 con 0x561238de14a0 2024-05-09T01:08:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f64240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f64240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55308/0 (socket says 172.21.15.37:55308) 2024-05-09T01:08:18.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 -- 172.21.15.37:0/3325839560 learned_addr learned my addr 172.21.15.37:0/3325839560 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6508700 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238de14a0 0x561238f64780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 -- 172.21.15.37:0/3325839560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238de14a0 msgr2=0x561238f64780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238de14a0 0x561238f64780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 -- 172.21.15.37:0/3325839560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 msgr2=0x561238f5e810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f5e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.985+0000 7fbbd6d09700 1 -- 172.21.15.37:0/3325839560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561238e17500 con 0x561238e5bd00 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.986+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f64240 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fa0 tx=0x7fbbc80091b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1206c42aad4545 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:18.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.987+0000 7fbbc4ff9700 1 -- 172.21.15.37:0/3325839560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8004db0 con 0x561238e5bd00 2024-05-09T01:08:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.987+0000 7fbbc4ff9700 1 -- 172.21.15.37:0/3325839560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbc8019070 con 0x561238e5bd00 2024-05-09T01:08:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.988+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3325839560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 msgr2=0x561238f64240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:18.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.988+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f64240 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fa0 tx=0x7fbbc80091b0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.993+0000 7fbbc77fe700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbbbc0b2c70 0x7fbbbc0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:18.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.993+0000 7fbbc77fe700 1 -- 172.21.15.37:0/1212950545 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbbc000f690 con 0x7fbbd0110660 2024-05-09T01:08:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.994+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3325839560 shutdown_connections 2024-05-09T01:08:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.994+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f5e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.994+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f64240 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.994+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3325839560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238de14a0 0x561238f64780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.994+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3325839560 >> 172.21.15.37:0/3325839560 conn(0x561238de4f70 msgr2=0x561238f59220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.996+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbbbc0b2c70 0x7fbbbc0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:18.997+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3325839560 shutdown_connections 2024-05-09T01:08:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.003+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3325839560 wait complete. 2024-05-09T01:08:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.003+0000 7fbbe7182b80 1 -- start start 2024-05-09T01:08:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.003+0000 7fbbe7182b80 1 Processor -- start 2024-05-09T01:08:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.008+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238de14a0 0x561238f67fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.009+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238e5bd00 0x561238f68510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.009+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f68a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.009+0000 7fbbe7182b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561238f5f1b0 con 0x561238de14a0 2024-05-09T01:08:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.009+0000 7fbbe7182b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561238e1bb20 con 0x561238f5e400 2024-05-09T01:08:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.009+0000 7fbbe7182b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561238f6b020 con 0x561238e5bd00 2024-05-09T01:08:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.009+0000 7fbbe7182b80 10 client.0 _ll_register_callbacks cb 0x561238cf26c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.010+0000 7fbbd5d07700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238e5bd00 0x561238f68510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.011+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbbbc0b2c70 0x7fbbbc0b5180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc8004f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.013+0000 7fbbd6508700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238de14a0 0x561238f67fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.013+0000 7fbbd6508700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238de14a0 0x561238f67fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55322/0 (socket says 172.21.15.37:55322) 2024-05-09T01:08:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.013+0000 7fbbd6508700 1 -- 172.21.15.37:0/77248380 learned_addr learned my addr 172.21.15.37:0/77248380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.013+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f68a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.014+0000 7fbbd6d09700 1 -- 172.21.15.37:0/77248380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238e5bd00 msgr2=0x561238f68510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.014+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238e5bd00 0x561238f68510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.014+0000 7fbbd6d09700 1 -- 172.21.15.37:0/77248380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238de14a0 msgr2=0x561238f67fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.014+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238de14a0 0x561238f67fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.014+0000 7fbbd6d09700 1 -- 172.21.15.37:0/77248380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561238cfc490 con 0x561238f5e400 2024-05-09T01:08:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.015+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f68a50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8005340 tx=0x7fbbc800d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2811bdb62935a502 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.016+0000 7fbbb9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.016+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/77248380 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc802e020 con 0x561238f5e400 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.016+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc8019070 con 0x561238f5e400 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.016+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/77248380 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbbc801dc90 con 0x561238f5e400 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.017+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/77248380 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbbc8023070 con 0x561238f5e400 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.017+0000 7fbbe7182b80 10 client.26108 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.017+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561238f7e040 con 0x561238f5e400 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.018+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/77248380 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbc8019070 con 0x561238f5e400 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.018+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/77248380 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fbbc80293e0 con 0x561238f5e400 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.018+0000 7fbbe7182b80 10 client.26108 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.018+0000 7fbbe7182b80 10 client.26108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.018+0000 7fbbe7182b80 20 client.26108 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.018+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238f80510 0x561238f82930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.019+0000 7fbbe7182b80 4 client.26108 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.019+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561238e8ea80 con 0x561238f80510 2024-05-09T01:08:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.021+0000 7fbbd6508700 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238f80510 0x561238f82930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.024+0000 7fbbd6508700 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238f80510 0x561238f82930 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6910c3d0f30e416e server_cookie=5207f681c9732252 in_seq=0 out_seq=0 2024-05-09T01:08:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.025+0000 7fbbb9ffb700 10 client.26108 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.026+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/77248380 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561238e8ea80 con 0x561238f80510 2024-05-09T01:08:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.026+0000 7fbbb9ffb700 10 client.26108 handle_command_reply: tid=0 2024-05-09T01:08:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.026+0000 7fbbe7182b80 1 client.26108 shutdown 2024-05-09T01:08:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 msgr2=0x561238f68a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f68a50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8005340 tx=0x7fbbc800d000 comp rx=0 tx=0).stop 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 shutdown_connections 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238f80510 0x561238f82930 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238f5e400 0x561238f68a50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238de14a0 0x561238f67fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/77248380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238e5bd00 0x561238f68510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 >> 172.21.15.37:0/77248380 conn(0x561238de4f70 msgr2=0x561238f52ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.028+0000 7fbbb9ffb700 0 client.26108 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.029+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 shutdown_connections 2024-05-09T01:08:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.030+0000 7fbbe7182b80 1 -- 172.21.15.37:0/77248380 wait complete. 2024-05-09T01:08:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.030+0000 7fbbe7182b80 20 client.26108 trim_cache size 0 max 16384 2024-05-09T01:08:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.062+0000 7fbbe7182b80 1 Processor -- start 2024-05-09T01:08:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.062+0000 7fbbe7182b80 1 -- start start 2024-05-09T01:08:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.062+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f7cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.062+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f53a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.062+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238f688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.063+0000 7fbbd6508700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f7cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.063+0000 7fbbd6508700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f7cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36338/0 (socket says 172.21.15.37:36338) 2024-05-09T01:08:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.063+0000 7fbbd6508700 1 -- 172.21.15.37:0/2702600574 learned_addr learned my addr 172.21.15.37:0/2702600574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.063+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01b5250 con 0x561238e5bd00 2024-05-09T01:08:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.063+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01b6d90 con 0x561238de14a0 2024-05-09T01:08:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.063+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01b5920 con 0x561238f5e400 2024-05-09T01:08:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.064+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238f688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.065+0000 7fbbd6d09700 1 -- 172.21.15.37:0/2702600574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 msgr2=0x561238f7cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.065+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f7cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.065+0000 7fbbd6d09700 1 -- 172.21.15.37:0/2702600574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 msgr2=0x561238f53a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.065+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f53a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.065+0000 7fbbd6d09700 1 -- 172.21.15.37:0/2702600574 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561238f5aee0 con 0x561238f5e400 2024-05-09T01:08:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.068+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238f688b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009ec0 tx=0x7fbbc8029c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=287a13c8ab69fe46 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.068+0000 7fbbbbfff700 1 -- 172.21.15.37:0/2702600574 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8042070 con 0x561238f5e400 2024-05-09T01:08:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.068+0000 7fbbbbfff700 1 -- 172.21.15.37:0/2702600574 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbc8019040 con 0x561238f5e400 2024-05-09T01:08:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.068+0000 7fbbbbfff700 1 -- 172.21.15.37:0/2702600574 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc802e070 con 0x561238f5e400 2024-05-09T01:08:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 msgr2=0x561238f688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238f688b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009ec0 tx=0x7fbbc8029c20 comp rx=0 tx=0).stop 2024-05-09T01:08:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 shutdown_connections 2024-05-09T01:08:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238f688b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f7cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/2702600574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f53a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 >> 172.21.15.37:0/2702600574 conn(0x561238de4f70 msgr2=0x561238f667b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 shutdown_connections 2024-05-09T01:08:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.070+0000 7fbbe7182b80 1 -- 172.21.15.37:0/2702600574 wait complete. 2024-05-09T01:08:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.071+0000 7fbbe7182b80 1 -- start start 2024-05-09T01:08:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.071+0000 7fbbe7182b80 1 Processor -- start 2024-05-09T01:08:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.071+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f82820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f82d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbe7182b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238fe8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f82820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f82820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36350/0 (socket says 172.21.15.37:36350) 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 -- 172.21.15.37:0/3133888295 learned_addr learned my addr 172.21.15.37:0/3133888295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01b66c0 con 0x561238e5bd00 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01b5ff0 con 0x561238de14a0 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd01b3210 con 0x561238f5e400 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd5d07700 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f82d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6d09700 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238fe8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 -- 172.21.15.37:0/3133888295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 msgr2=0x561238fe8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238fe8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 -- 172.21.15.37:0/3133888295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 msgr2=0x561238f82d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f82d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.072+0000 7fbbd6508700 1 -- 172.21.15.37:0/3133888295 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561238f559d0 con 0x561238de14a0 2024-05-09T01:08:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.073+0000 7fbbd6508700 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f82820 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc000c00 tx=0x7fbbcc00bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c6baf0f31f29f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.073+0000 7fbbb9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.073+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/3133888295 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc02d020 con 0x561238de14a0 2024-05-09T01:08:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.073+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/3133888295 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbbcc003a60 con 0x561238de14a0 2024-05-09T01:08:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.073+0000 7fbbb9ffb700 10 client.0 inactive, discarding osd_map(81..81 src has 1..81) 2024-05-09T01:08:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.073+0000 7fbbe7182b80 10 client.0 _ll_register_callbacks cb 0x561238cf26c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.073+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbc8019040 con 0x561238de14a0 2024-05-09T01:08:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.076+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/3133888295 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbbcc003c60 con 0x561238de14a0 2024-05-09T01:08:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.076+0000 7fbbe7182b80 10 client.26114 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.076+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=39}) -- 0x561238fe9bb0 con 0x561238de14a0 2024-05-09T01:08:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/3133888295 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fbbcc005070 con 0x561238de14a0 2024-05-09T01:08:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbe7182b80 10 client.26114 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbe7182b80 10 client.26114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:19.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbe7182b80 20 client.26114 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:19.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238fea160 0x561238fec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:19.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbe7182b80 4 client.26114 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:08:19.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbbc8019040 con 0x561238fea160 2024-05-09T01:08:19.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.077+0000 7fbbd5d07700 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238fea160 0x561238fec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.078+0000 7fbbb9ffb700 10 client.26114 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.078+0000 7fbbd5d07700 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238fea160 0x561238fec5a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bbe5f5bafd56bc5 server_cookie=98b854eaf8bf3520 in_seq=0 out_seq=0 2024-05-09T01:08:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.078+0000 7fbbb9ffb700 1 -- 172.21.15.37:0/3133888295 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbbc8019040 con 0x561238fea160 2024-05-09T01:08:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbb9ffb700 10 client.26114 handle_command_reply: tid=0 2024-05-09T01:08:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 client.26114 shutdown 2024-05-09T01:08:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 msgr2=0x561238f82820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f82820 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc000c00 tx=0x7fbbcc00bb80 comp rx=0 tx=0).stop 2024-05-09T01:08:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 shutdown_connections 2024-05-09T01:08:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561238fea160 0x561238fec5a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbb9ffb700 0 client.26114 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561238f5e400 0x561238fe8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561238de14a0 0x561238f82820 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 --2- 172.21.15.37:0/3133888295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561238e5bd00 0x561238f82d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 >> 172.21.15.37:0/3133888295 conn(0x561238de4f70 msgr2=0x561238f53780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 shutdown_connections 2024-05-09T01:08:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 1 -- 172.21.15.37:0/3133888295 wait complete. 2024-05-09T01:08:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.079+0000 7fbbe7182b80 20 client.26114 trim_cache size 0 max 16384 2024-05-09T01:08:19.083 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:08:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbbbc0b2c70 msgr2=0x7fbbbc0b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbbbc0b2c70 0x7fbbbc0b5180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009fd0 tx=0x7fbbc8004f50 comp rx=0 tx=0).stop 2024-05-09T01:08:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0110660 msgr2=0x7fbbd01a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0110660 0x7fbbd01a2ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbbd006d130 tx=0x7fbbc000dc30 comp rx=0 tx=0).stop 2024-05-09T01:08:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 shutdown_connections 2024-05-09T01:08:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbbbc0b2c70 0x7fbbbc0b5180 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbd0110fb0 0x7fbbd01a6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd010c840 0x7fbbd01a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 --2- 172.21.15.37:0/1212950545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0110660 0x7fbbd01a2ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 >> 172.21.15.37:0/1212950545 conn(0x7fbbd006f4d0 msgr2=0x7fbbd010f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.080+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 shutdown_connections 2024-05-09T01:08:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:19.083+0000 7fbbd876c700 1 -- 172.21.15.37:0/1212950545 wait complete. 2024-05-09T01:08:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 360.0 s, 2439.6 tps, lat 40.876 ms stddev 45.904 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.608+0000 7f1258365640 1 -- 172.21.15.37:0/283276421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 msgr2=0x7f125010bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.608+0000 7f1258365640 1 --2- 172.21.15.37:0/283276421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 0x7f125010bde0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1248009900 tx=0x7f124802a420 comp rx=0 tx=0).stop 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.609+0000 7f1258365640 1 -- 172.21.15.37:0/283276421 shutdown_connections 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.609+0000 7f1258365640 1 --2- 172.21.15.37:0/283276421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 0x7f125010bde0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.609+0000 7f1258365640 1 --2- 172.21.15.37:0/283276421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1250106d90 0x7f1250109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.609+0000 7f1258365640 1 --2- 172.21.15.37:0/283276421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12501043a0 0x7f12501067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.609+0000 7f1258365640 1 -- 172.21.15.37:0/283276421 >> 172.21.15.37:0/283276421 conn(0x7f12500fdd40 msgr2=0x7f12501001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:20.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.610+0000 7f1258365640 1 -- 172.21.15.37:0/283276421 shutdown_connections 2024-05-09T01:08:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.610+0000 7f1258365640 1 -- 172.21.15.37:0/283276421 wait complete. 2024-05-09T01:08:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.610+0000 7f1258365640 1 Processor -- start 2024-05-09T01:08:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1258365640 1 -- start start 2024-05-09T01:08:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1258365640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501043a0 0x7f1250198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1258365640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1250106d90 0x7f12501986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1258365640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 0x7f12501a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1258365640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f125010f810 con 0x7f1250109900 2024-05-09T01:08:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1258365640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f125010f690 con 0x7f1250106d90 2024-05-09T01:08:20.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1258365640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f125010f990 con 0x7f12501043a0 2024-05-09T01:08:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1255900640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1250106d90 0x7f12501986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1255900640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1250106d90 0x7f12501986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36374/0 (socket says 172.21.15.37:36374) 2024-05-09T01:08:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1255900640 1 -- 172.21.15.37:0/3970160898 learned_addr learned my addr 172.21.15.37:0/3970160898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1256902640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 0x7f12501a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.611+0000 7f1256101640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501043a0 0x7f1250198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.612+0000 7f1255900640 1 -- 172.21.15.37:0/3970160898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501043a0 msgr2=0x7f1250198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.612+0000 7f1255900640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501043a0 0x7f1250198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.612+0000 7f1255900640 1 -- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 msgr2=0x7f12501a7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.612+0000 7f1255900640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 0x7f12501a7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.612+0000 7f1255900640 1 -- 172.21.15.37:0/3970160898 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12501a84c0 con 0x7f1250106d90 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.612+0000 7f1255900640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1250106d90 0x7f12501986b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f124000b450 tx=0x7f124000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.612+0000 7f12477fe640 1 -- 172.21.15.37:0/3970160898 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240015020 con 0x7f1250106d90 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.613+0000 7f12477fe640 1 -- 172.21.15.37:0/3970160898 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1240011d40 con 0x7f1250106d90 2024-05-09T01:08:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.613+0000 7f12477fe640 1 -- 172.21.15.37:0/3970160898 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124000f340 con 0x7f1250106d90 2024-05-09T01:08:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.613+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12501a87b0 con 0x7f1250106d90 2024-05-09T01:08:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.613+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12501a8d30 con 0x7f1250106d90 2024-05-09T01:08:20.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.616+0000 7f12477fe640 1 -- 172.21.15.37:0/3970160898 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1240018020 con 0x7f1250106d90 2024-05-09T01:08:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.617+0000 7f125f218740 1 Processor -- start 2024-05-09T01:08:20.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.617+0000 7f125f218740 1 -- start start 2024-05-09T01:08:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.617+0000 7f125f218740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1c7e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.617+0000 7f125f218740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c7ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f125f218740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c85980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f125f218740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bac1be27c0 con 0x55bac18b12f0 2024-05-09T01:08:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f125f218740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55bac1b7e0e0 con 0x55bac18b94d0 2024-05-09T01:08:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f125f218740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bac1bde780 con 0x55bac18da1b0 2024-05-09T01:08:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f1256101640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c7ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f1256101640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c7ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55376/0 (socket says 172.21.15.37:55376) 2024-05-09T01:08:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f1256101640 1 -- 172.21.15.37:0/2077775893 learned_addr learned my addr 172.21.15.37:0/2077775893 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f1256902640 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1c7e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.618+0000 7f12477fe640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f123c0b2860 0x7f123c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.619+0000 7f12477fe640 1 -- 172.21.15.37:0/3970160898 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f12400e1b90 con 0x7f1250106d90 2024-05-09T01:08:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.619+0000 7f1256902640 1 -- 172.21.15.37:0/2077775893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 msgr2=0x55bac1c85980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:08:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.619+0000 7f1256902640 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c85980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.619+0000 7f1256902640 1 -- 172.21.15.37:0/2077775893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 msgr2=0x55bac1c7ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.619+0000 7f1256902640 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c7ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.619+0000 7f1256902640 1 -- 172.21.15.37:0/2077775893 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac1ba77c0 con 0x55bac18da1b0 2024-05-09T01:08:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.620+0000 7f1256902640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f123c0b2860 0x7f123c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.620+0000 7f1256902640 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1c7e500 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f124802a940 tx=0x7f12480041e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf9061bb81f9caf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.620+0000 7f1244bfe640 1 -- 172.21.15.37:0/2077775893 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124804f070 con 0x55bac18da1b0 2024-05-09T01:08:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.620+0000 7f1244bfe640 1 -- 172.21.15.37:0/2077775893 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1248031a50 con 0x55bac18da1b0 2024-05-09T01:08:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.620+0000 7f1244bfe640 1 -- 172.21.15.37:0/2077775893 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248035040 con 0x55bac18da1b0 2024-05-09T01:08:20.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.620+0000 7f1256902640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f123c0b2860 0x7f123c0b4d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1248048000 tx=0x7f1248049000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.622+0000 7f125f218740 1 -- 172.21.15.37:0/2077775893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 msgr2=0x55bac1c7e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.622+0000 7f125f218740 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1c7e500 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f124802a940 tx=0x7f12480041e0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.622+0000 7f125f218740 1 -- 172.21.15.37:0/2077775893 shutdown_connections 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.622+0000 7f125f218740 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c85980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.622+0000 7f125f218740 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c7ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.622+0000 7f125f218740 1 --2- 172.21.15.37:0/2077775893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1c7e500 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.622+0000 7f125f218740 1 -- 172.21.15.37:0/2077775893 >> 172.21.15.37:0/2077775893 conn(0x55bac18ce300 msgr2=0x55bac1c79e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.623+0000 7f125f218740 1 -- 172.21.15.37:0/2077775893 shutdown_connections 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.623+0000 7f125f218740 1 -- 172.21.15.37:0/2077775893 wait complete. 2024-05-09T01:08:20.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.624+0000 7f125f218740 1 -- start start 2024-05-09T01:08:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.624+0000 7f125f218740 1 Processor -- start 2024-05-09T01:08:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f125f218740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b12f0 0x55bac1c882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f125f218740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c88830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f125f218740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 0x55bac1c8f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f125f218740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bac1c863d0 con 0x55bac18da1b0 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f125f218740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55bac1b699c0 con 0x55bac18b94d0 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f125f218740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bac1c86550 con 0x55bac18b12f0 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f125f218740 10 client.0 _ll_register_callbacks cb 0x55bac1b96020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c88830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c88830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36396/0 (socket says 172.21.15.37:36396) 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 -- 172.21.15.37:0/1601684036 learned_addr learned my addr 172.21.15.37:0/1601684036 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1256101640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b12f0 0x55bac1c882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1256902640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 0x55bac1c8f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 -- 172.21.15.37:0/1601684036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b12f0 msgr2=0x55bac1c882f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b12f0 0x55bac1c882f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 -- 172.21.15.37:0/1601684036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 msgr2=0x55bac1c8f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 0x55bac1c8f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1255900640 1 -- 172.21.15.37:0/1601684036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac1b901f0 con 0x55bac18b94d0 2024-05-09T01:08:20.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.625+0000 7f1256101640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b12f0 0x55bac1c882f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:20.631 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:20 smithi136 ceph-mon[34110]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.2 MiB/s wr, 649 op/s 2024-05-09T01:08:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.626+0000 7f1255900640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c88830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12400a8f50 tx=0x7f12400a89c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a62db73d6e07a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.626+0000 7f1239ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.626+0000 7f1239ffb640 1 -- 172.21.15.37:0/1601684036 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12400a9250 con 0x55bac18b94d0 2024-05-09T01:08:20.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.626+0000 7f1239ffb640 1 -- 172.21.15.37:0/1601684036 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f12400ad170 con 0x55bac18b94d0 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.626+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1248031a50 con 0x55bac18b94d0 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.627+0000 7f1239ffb640 1 -- 172.21.15.37:0/1601684036 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f12400ad600 con 0x55bac18b94d0 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.627+0000 7f125f218740 10 client.26123 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.627+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bac1945790 con 0x55bac18b94d0 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.627+0000 7f1239ffb640 1 -- 172.21.15.37:0/1601684036 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1248031a50 con 0x55bac18b94d0 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.627+0000 7f1239ffb640 1 -- 172.21.15.37:0/1601684036 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f12400c3b40 con 0x55bac18b94d0 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.628+0000 7f125f218740 10 client.26123 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.628+0000 7f125f218740 10 client.26123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.628+0000 7f125f218740 20 client.26123 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.628+0000 7f125f218740 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac1898d80 0x55bac1c95ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.628+0000 7f125f218740 4 client.26123 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:20.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.628+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bac1bf03d0 con 0x55bac1898d80 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.628+0000 7f1256101640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac1898d80 0x55bac1c95ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.629+0000 7f1256101640 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac1898d80 0x55bac1c95ca0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea7268c550b2da90 server_cookie=273321a0fefdc70c in_seq=0 out_seq=0 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.629+0000 7f1239ffb640 10 client.26123 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.630+0000 7f1239ffb640 1 -- 172.21.15.37:0/1601684036 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bac1bf03d0 con 0x55bac1898d80 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.630+0000 7f1239ffb640 10 client.26123 handle_command_reply: tid=0 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.630+0000 7f125f218740 1 client.26123 shutdown 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.631+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 msgr2=0x55bac1c88830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.631+0000 7f125f218740 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c88830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12400a8f50 tx=0x7f12400a89c0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 shutdown_connections 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac1898d80 0x55bac1c95ca0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 0x55bac1c8f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c88830 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 --2- 172.21.15.37:0/1601684036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b12f0 0x55bac1c882f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 >> 172.21.15.37:0/1601684036 conn(0x55bac18ce300 msgr2=0x55bac1c7cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f1239ffb640 0 client.26123 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 shutdown_connections 2024-05-09T01:08:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 1 -- 172.21.15.37:0/1601684036 wait complete. 2024-05-09T01:08:20.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.632+0000 7f125f218740 20 client.26123 trim_cache size 0 max 16384 2024-05-09T01:08:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 Processor -- start 2024-05-09T01:08:20.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 -- start start 2024-05-09T01:08:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b12f0 0x55bac1c7e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b94d0 0x55bac1c8f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 0x55bac1c7e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f1255900640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b94d0 0x55bac1c8f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f1255900640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b94d0 0x55bac1c8f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43068/0 (socket says 172.21.15.37:43068) 2024-05-09T01:08:20.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f1255900640 1 -- 172.21.15.37:0/1213780423 learned_addr learned my addr 172.21.15.37:0/1213780423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12501b18f0 con 0x55bac18da1b0 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 -- 172.21.15.37:0/1213780423 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f12501b3430 con 0x55bac18b12f0 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.663+0000 7f125f218740 1 -- 172.21.15.37:0/1213780423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12501b1fc0 con 0x55bac18b94d0 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.664+0000 7f1255900640 1 -- 172.21.15.37:0/1213780423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b12f0 msgr2=0x55bac1c7e480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.664+0000 7f1255900640 1 --2- 172.21.15.37:0/1213780423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b12f0 0x55bac1c7e480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.664+0000 7f1255900640 1 -- 172.21.15.37:0/1213780423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 msgr2=0x55bac1c7e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.664+0000 7f1255900640 1 --2- 172.21.15.37:0/1213780423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 0x55bac1c7e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.664+0000 7f1255900640 1 -- 172.21.15.37:0/1213780423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac19bc5f0 con 0x55bac18b94d0 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.664+0000 7f1255900640 1 --2- 172.21.15.37:0/1213780423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b94d0 0x55bac1c8f6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1240009fd0 tx=0x7f12400a8af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8622fa7a2c4b2a66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.665+0000 7f123bfff640 1 -- 172.21.15.37:0/1213780423 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12400ca2d0 con 0x55bac18b94d0 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.665+0000 7f123bfff640 1 -- 172.21.15.37:0/1213780423 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12400a9250 con 0x55bac18b94d0 2024-05-09T01:08:20.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.665+0000 7f123bfff640 1 -- 172.21.15.37:0/1213780423 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240011890 con 0x55bac18b94d0 2024-05-09T01:08:20.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 -- 172.21.15.37:0/1213780423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b94d0 msgr2=0x55bac1c8f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 --2- 172.21.15.37:0/1213780423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b94d0 0x55bac1c8f6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1240009fd0 tx=0x7f12400a8af0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 -- 172.21.15.37:0/1213780423 shutdown_connections 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 --2- 172.21.15.37:0/1213780423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18da1b0 0x55bac1c7e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 --2- 172.21.15.37:0/1213780423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18b94d0 0x55bac1c8f6b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 --2- 172.21.15.37:0/1213780423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b12f0 0x55bac1c7e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 -- 172.21.15.37:0/1213780423 >> 172.21.15.37:0/1213780423 conn(0x55bac18ce300 msgr2=0x55bac1c882f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 -- 172.21.15.37:0/1213780423 shutdown_connections 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.666+0000 7f125f218740 1 -- 172.21.15.37:0/1213780423 wait complete. 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.667+0000 7f125f218740 1 -- start start 2024-05-09T01:08:20.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.667+0000 7f125f218740 1 Processor -- start 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.668+0000 7f125f218740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c8c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.668+0000 7f125f218740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c8cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.668+0000 7f125f218740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1cfc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.668+0000 7f125f218740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12501b2d60 con 0x55bac18b12f0 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.668+0000 7f125f218740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f12501b2690 con 0x55bac18b94d0 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.668+0000 7f125f218740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12501af8d0 con 0x55bac18da1b0 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.668+0000 7f125f218740 10 client.0 _ll_register_callbacks cb 0x7f12400046e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1256902640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1cfc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c8cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c8cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:36406/0 (socket says 172.21.15.37:36406) 2024-05-09T01:08:20.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 -- 172.21.15.37:0/3949938403 learned_addr learned my addr 172.21.15.37:0/3949938403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1256101640 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c8c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 -- 172.21.15.37:0/3949938403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 msgr2=0x55bac1cfc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1cfc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 -- 172.21.15.37:0/3949938403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 msgr2=0x55bac1c8c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c8c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 -- 172.21.15.37:0/3949938403 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac1ba6ed0 con 0x55bac18b94d0 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1256101640 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1255900640 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c8cc20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12400e1eb0 tx=0x7f12400a84b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caf266ba34a6406d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.669+0000 7f1239ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f1239ffb640 1 -- 172.21.15.37:0/3949938403 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12400ad400 con 0x55bac18b94d0 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f1239ffb640 1 -- 172.21.15.37:0/3949938403 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f12400a5840 con 0x55bac18b94d0 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12400a9250 con 0x55bac18b94d0 2024-05-09T01:08:20.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f1239ffb640 1 -- 172.21.15.37:0/3949938403 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f12400ca2d0 con 0x55bac18b94d0 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 10 client.26126 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bac1cfd540 con 0x55bac18b94d0 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f1239ffb640 1 -- 172.21.15.37:0/3949938403 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12400a9250 con 0x55bac18b94d0 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f1239ffb640 1 -- 172.21.15.37:0/3949938403 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f12400be220 con 0x55bac18b94d0 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 10 client.26126 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 10 client.26126 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 20 client.26126 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac186e1c0 0x55bac1cffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 4 client.26126 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.670+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bac1bea240 con 0x55bac186e1c0 2024-05-09T01:08:20.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.671+0000 7f1256101640 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac186e1c0 0x55bac1cffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.673+0000 7f1256101640 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac186e1c0 0x55bac1cffce0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=234a9c67e19ad3ea server_cookie=81e645e3e255ef0c in_seq=0 out_seq=0 2024-05-09T01:08:20.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.673+0000 7f1239ffb640 10 client.26126 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:20.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.684+0000 7f1239ffb640 1 -- 172.21.15.37:0/3949938403 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55bac1bea240 con 0x55bac186e1c0 2024-05-09T01:08:20.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.684+0000 7f1239ffb640 10 client.26126 handle_command_reply: tid=0 2024-05-09T01:08:20.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.684+0000 7f125f218740 1 client.26126 shutdown 2024-05-09T01:08:20.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 msgr2=0x55bac1c8cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c8cc20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f12400e1eb0 tx=0x7f12400a84b0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 shutdown_connections 2024-05-09T01:08:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bac186e1c0 0x55bac1cffce0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bac18da1b0 0x55bac1cfc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bac18b94d0 0x55bac1c8cc20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 --2- 172.21.15.37:0/3949938403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bac18b12f0 0x55bac1c8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 >> 172.21.15.37:0/3949938403 conn(0x55bac18ce300 msgr2=0x55bac1c82780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:20.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f1239ffb640 0 client.26126 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:20.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 shutdown_connections 2024-05-09T01:08:20.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 1 -- 172.21.15.37:0/3949938403 wait complete. 2024-05-09T01:08:20.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:08:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:08:20.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:08:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.685+0000 7f125f218740 20 client.26126 trim_cache size 0 max 16384 2024-05-09T01:08:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f123c0b2860 msgr2=0x7f123c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f123c0b2860 0x7f123c0b4d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1248048000 tx=0x7f1248049000 comp rx=0 tx=0).stop 2024-05-09T01:08:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1250106d90 msgr2=0x7f12501986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1250106d90 0x7f12501986b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f124000b450 tx=0x7f124000b910 comp rx=0 tx=0).stop 2024-05-09T01:08:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 shutdown_connections 2024-05-09T01:08:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1250109900 0x7f12501a7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f123c0b2860 0x7f123c0b4d70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1250106d90 0x7f12501986b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 --2- 172.21.15.37:0/3970160898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501043a0 0x7f1250198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 >> 172.21.15.37:0/3970160898 conn(0x7f12500fdd40 msgr2=0x7f1250102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 shutdown_connections 2024-05-09T01:08:20.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:20.687+0000 7f1258365640 1 -- 172.21.15.37:0/3970160898 wait complete. 2024-05-09T01:08:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:20 smithi037 ceph-mon[30122]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.2 MiB/s wr, 649 op/s 2024-05-09T01:08:20.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:20 smithi151 ceph-mon[34780]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.2 MiB/s wr, 649 op/s 2024-05-09T01:08:20.834 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:08:20.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:08:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:22.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:22 smithi136 ceph-mon[34110]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-05-09T01:08:22.634 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:22 smithi037 ceph-mon[30122]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-05-09T01:08:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:22 smithi151 ceph-mon[34780]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-05-09T01:08:23.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.083+0000 7f1bab59e700 1 -- 172.21.15.37:0/347866310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac1032b0 msgr2=0x7f1bac1036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.083+0000 7f1bab59e700 1 --2- 172.21.15.37:0/347866310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac1032b0 0x7f1bac1036c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0099c0 tx=0x7f1b9c009cd0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.083+0000 7f1bab59e700 1 -- 172.21.15.37:0/347866310 shutdown_connections 2024-05-09T01:08:23.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.084+0000 7f1bab59e700 1 --2- 172.21.15.37:0/347866310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bac108530 0x7f1bac10fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.084+0000 7f1bab59e700 1 --2- 172.21.15.37:0/347866310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac1032b0 0x7f1bac1036c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.084+0000 7f1bab59e700 1 --2- 172.21.15.37:0/347866310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac107be0 0x7f1bac107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.084+0000 7f1bab59e700 1 -- 172.21.15.37:0/347866310 >> 172.21.15.37:0/347866310 conn(0x7f1bac078ab0 msgr2=0x7f1bac078f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:23.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.084+0000 7f1bab59e700 1 -- 172.21.15.37:0/347866310 shutdown_connections 2024-05-09T01:08:23.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.084+0000 7f1bab59e700 1 -- 172.21.15.37:0/347866310 wait complete. 2024-05-09T01:08:23.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.085+0000 7f1bab59e700 1 Processor -- start 2024-05-09T01:08:23.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.085+0000 7f1bab59e700 1 -- start start 2024-05-09T01:08:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.085+0000 7f1bab59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac1032b0 0x7f1bac109f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.085+0000 7f1bab59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bac107be0 0x7f1bac10a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.085+0000 7f1bab59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac108530 0x7f1bac10a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac1032b0 0x7f1bac109f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1ba9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bac107be0 0x7f1bac10a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac1032b0 0x7f1bac109f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:36146/0 (socket says 172.21.15.37:36146) 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 -- 172.21.15.37:0/2236585269 learned_addr learned my addr 172.21.15.37:0/2236585269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1bab59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac113160 con 0x7f1bac108530 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac112fe0 con 0x7f1bac107be0 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baad9d700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac108530 0x7f1bac10a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1132e0 con 0x7f1bac1032b0 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 -- 172.21.15.37:0/2236585269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bac107be0 msgr2=0x7f1bac10a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bac107be0 0x7f1bac10a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 -- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac108530 msgr2=0x7f1bac10a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac108530 0x7f1bac10a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baa59c700 1 -- 172.21.15.37:0/2236585269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac1a9080 con 0x7f1bac1032b0 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.086+0000 7f1baad9d700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac108530 0x7f1bac10a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.087+0000 7f1baa59c700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac1032b0 0x7f1bac109f30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c006010 tx=0x7f1b9c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.087+0000 7f1b9b7fe700 1 -- 172.21.15.37:0/2236585269 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c026070 con 0x7f1bac1032b0 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.087+0000 7f1b9b7fe700 1 -- 172.21.15.37:0/2236585269 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b9c003c70 con 0x7f1bac1032b0 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.087+0000 7f1b9b7fe700 1 -- 172.21.15.37:0/2236585269 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c00fb70 con 0x7f1bac1032b0 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.087+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac1a9310 con 0x7f1bac1032b0 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.088+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac1a97c0 con 0x7f1bac1032b0 2024-05-09T01:08:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.092+0000 7f1b9b7fe700 1 -- 172.21.15.37:0/2236585269 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1b9c029070 con 0x7f1bac1032b0 2024-05-09T01:08:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.094+0000 7f1b9b7fe700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1b940b2900 0x7f1b940b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.094+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1b940b2900 0x7f1b940b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.094+0000 7f1b9b7fe700 1 -- 172.21.15.37:0/2236585269 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1b9c0e28e0 con 0x7f1bac1032b0 2024-05-09T01:08:23.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.095+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1b940b2900 0x7f1b940b4e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1bac109850 tx=0x7f1ba0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:23.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.095+0000 7f1bbf33db80 1 Processor -- start 2024-05-09T01:08:23.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.096+0000 7f1bbf33db80 1 -- start start 2024-05-09T01:08:23.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.096+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561bed899c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.096+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed89f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.096+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561bed9e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.096+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5561becac120 con 0x5561bec86d80 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.096+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5561bec51a20 con 0x5561bec0c520 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.096+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5561beca80e0 con 0x5561bed9bdd0 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed89f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed89f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50262/0 (socket says 172.21.15.37:50262) 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 -- 172.21.15.37:0/3883904903 learned_addr learned my addr 172.21.15.37:0/3883904903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1baa59c700 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561bed899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 -- 172.21.15.37:0/3883904903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 msgr2=0x5561bed9e1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561bed9e1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 -- 172.21.15.37:0/3883904903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 msgr2=0x5561bed899c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561bed899c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.097+0000 7f1ba9d9b700 1 -- 172.21.15.37:0/3883904903 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561bec42580 con 0x5561bec0c520 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.098+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed89f00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0011d20 tx=0x7f1ba0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=400dc792911cf026 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.098+0000 7f1b98ff9700 1 -- 172.21.15.37:0/3883904903 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000edd0 con 0x5561bec0c520 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.098+0000 7f1b98ff9700 1 -- 172.21.15.37:0/3883904903 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0011e10 con 0x5561bec0c520 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.098+0000 7f1b98ff9700 1 -- 172.21.15.37:0/3883904903 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba001d700 con 0x5561bec0c520 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.099+0000 7f1bbf33db80 1 -- 172.21.15.37:0/3883904903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 msgr2=0x5561bed89f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.099+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed89f00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0011d20 tx=0x7f1ba0014000 comp rx=0 tx=0).stop 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.099+0000 7f1bbf33db80 1 -- 172.21.15.37:0/3883904903 shutdown_connections 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.099+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561bed9e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.099+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561bed899c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.099+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/3883904903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed89f00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.100+0000 7f1bbf33db80 1 -- 172.21.15.37:0/3883904903 >> 172.21.15.37:0/3883904903 conn(0x5561bec0fff0 msgr2=0x5561bed847e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.100+0000 7f1bbf33db80 1 -- 172.21.15.37:0/3883904903 shutdown_connections 2024-05-09T01:08:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.100+0000 7f1bbf33db80 1 -- 172.21.15.37:0/3883904903 wait complete. 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.100+0000 7f1bbf33db80 1 -- start start 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.100+0000 7f1bbf33db80 1 Processor -- start 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec0c520 0x5561bed98d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bec86d80 0x5561bed992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bed9bdd0 0x5561bed99810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5561bed9e7f0 con 0x5561bec0c520 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5561bec46ba0 con 0x5561bed9bdd0 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5561bed9e970 con 0x5561bec86d80 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1bbf33db80 10 client.0 _ll_register_callbacks cb 0x5561beb1d740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec0c520 0x5561bed98d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec0c520 0x5561bed98d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37146/0 (socket says 172.21.15.37:37146) 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baa59c700 1 -- 172.21.15.37:0/2303288622 learned_addr learned my addr 172.21.15.37:0/2303288622 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baad9d700 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bed9bdd0 0x5561bed99810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baad9d700 1 -- 172.21.15.37:0/2303288622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bec86d80 msgr2=0x5561bed992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baad9d700 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bec86d80 0x5561bed992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baad9d700 1 -- 172.21.15.37:0/2303288622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec0c520 msgr2=0x5561bed98d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baad9d700 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec0c520 0x5561bed98d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.101+0000 7f1baad9d700 1 -- 172.21.15.37:0/2303288622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561beb27510 con 0x5561bed9bdd0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.102+0000 7f1baad9d700 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bed9bdd0 0x5561bed99810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4007af0 tx=0x7f1ba4007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7539c41ef2104e73 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.102+0000 7f1b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.103+0000 7f1b91ffb700 1 -- 172.21.15.37:0/2303288622 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400edd0 con 0x5561bed9bdd0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.103+0000 7f1b91ffb700 1 -- 172.21.15.37:0/2303288622 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1ba4003a00 con 0x5561bed9bdd0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.103+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ba0011e10 con 0x5561bed9bdd0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.103+0000 7f1b91ffb700 1 -- 172.21.15.37:0/2303288622 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1ba4003c00 con 0x5561bed9bdd0 2024-05-09T01:08:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.103+0000 7f1bbf33db80 10 client.26138 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.103+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5561beda92c0 con 0x5561bed9bdd0 2024-05-09T01:08:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.103+0000 7f1b91ffb700 1 -- 172.21.15.37:0/2303288622 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ba0011e10 con 0x5561bed9bdd0 2024-05-09T01:08:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1b91ffb700 1 -- 172.21.15.37:0/2303288622 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f1ba4026020 con 0x5561bed9bdd0 2024-05-09T01:08:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1bbf33db80 10 client.26138 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1bbf33db80 10 client.26138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1bbf33db80 20 client.26138 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:23.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bedadcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1bbf33db80 4 client.26138 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:23.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561becb9b00 con 0x5561bedab850 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.104+0000 7f1baa59c700 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bedadcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.105+0000 7f1b91ffb700 10 client.26138 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.105+0000 7f1baa59c700 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bedadcf0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b625f8b41556529 server_cookie=8d708fd9fc287fa4 in_seq=0 out_seq=0 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1b91ffb700 1 -- 172.21.15.37:0/2303288622 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5561becb9b00 con 0x5561bedab850 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1b91ffb700 10 client.26138 handle_command_reply: tid=0 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1bbf33db80 1 client.26138 shutdown 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bed9bdd0 msgr2=0x5561bed99810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bed9bdd0 0x5561bed99810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4007af0 tx=0x7f1ba4007e00 comp rx=0 tx=0).stop 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 shutdown_connections 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bedadcf0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1b91ffb700 0 client.26138 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.107+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bed9bdd0 0x5561bed99810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.108+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec0c520 0x5561bed98d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.108+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/2303288622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bec86d80 0x5561bed992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.108+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 >> 172.21.15.37:0/2303288622 conn(0x5561bec0fff0 msgr2=0x5561bed842d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.108+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 shutdown_connections 2024-05-09T01:08:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.108+0000 7f1bbf33db80 1 -- 172.21.15.37:0/2303288622 wait complete. 2024-05-09T01:08:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.108+0000 7f1bbf33db80 20 client.26138 trim_cache size 0 max 16384 2024-05-09T01:08:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 Processor -- start 2024-05-09T01:08:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 -- start start 2024-05-09T01:08:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed84630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561bedb34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1ac690 con 0x5561bec86d80 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1ae1d0 con 0x5561bec0c520 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1bbf33db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1acd60 con 0x5561bed9bdd0 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed84630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed84630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50282/0 (socket says 172.21.15.37:50282) 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1baa59c700 1 -- 172.21.15.37:0/48974554 learned_addr learned my addr 172.21.15.37:0/48974554 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1baad9d700 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561bedb34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.141+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1baa59c700 1 -- 172.21.15.37:0/48974554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 msgr2=0x5561bedb34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1baa59c700 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561bedb34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1baa59c700 1 -- 172.21.15.37:0/48974554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 msgr2=0x5561beda78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1baa59c700 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1baa59c700 1 -- 172.21.15.37:0/48974554 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561bed4ed20 con 0x5561bec0c520 2024-05-09T01:08:23.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1baa59c700 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed84630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0059d0 tx=0x7f1b9c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=358c8f4067f0245f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:23.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1b93fff700 1 -- 172.21.15.37:0/48974554 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0a9f90 con 0x5561bec0c520 2024-05-09T01:08:23.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1b93fff700 1 -- 172.21.15.37:0/48974554 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b9c0ae340 con 0x5561bec0c520 2024-05-09T01:08:23.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.142+0000 7f1b93fff700 1 -- 172.21.15.37:0/48974554 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0b2b30 con 0x5561bec0c520 2024-05-09T01:08:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.143+0000 7f1bbf33db80 1 -- 172.21.15.37:0/48974554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 msgr2=0x5561bed84630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed84630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0059d0 tx=0x7f1b9c004770 comp rx=0 tx=0).stop 2024-05-09T01:08:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 -- 172.21.15.37:0/48974554 shutdown_connections 2024-05-09T01:08:23.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561bedb34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561bed84630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/48974554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 -- 172.21.15.37:0/48974554 >> 172.21.15.37:0/48974554 conn(0x5561bec0fff0 msgr2=0x5561bed943e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 -- 172.21.15.37:0/48974554 shutdown_connections 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.144+0000 7f1bbf33db80 1 -- 172.21.15.37:0/48974554 wait complete. 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.145+0000 7f1bbf33db80 1 -- start start 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.145+0000 7f1bbf33db80 1 Processor -- start 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.145+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561beda42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1bbf33db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561beda42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561beda42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50294/0 (socket says 172.21.15.37:50294) 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 -- 172.21.15.37:0/307771801 learned_addr learned my addr 172.21.15.37:0/307771801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561beda0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1adb00 con 0x5561bec86d80 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac1ad430 con 0x5561bec0c520 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac19e880 con 0x5561bed9bdd0 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1bbf33db80 10 client.0 _ll_register_callbacks cb 0x5561bed8a420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baad9d700 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561beda0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 -- 172.21.15.37:0/307771801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 msgr2=0x5561beda0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561beda0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 -- 172.21.15.37:0/307771801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 msgr2=0x5561beda0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.146+0000 7f1baa59c700 1 -- 172.21.15.37:0/307771801 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561bedae280 con 0x5561bec0c520 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.147+0000 7f1baa59c700 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561beda42e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0a9c90 tx=0x7f1b9c0046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99104f9b9775fdff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.147+0000 7f1b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.148+0000 7f1b91ffb700 1 -- 172.21.15.37:0/307771801 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0c9060 con 0x5561bec0c520 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.148+0000 7f1b91ffb700 1 -- 172.21.15.37:0/307771801 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1b9c0b28d0 con 0x5561bec0c520 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.148+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b9c0ae340 con 0x5561bec0c520 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.148+0000 7f1b91ffb700 1 -- 172.21.15.37:0/307771801 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1b9c0e04f0 con 0x5561bec0c520 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.148+0000 7f1bbf33db80 10 client.26144 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.148+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5561bee16ee0 con 0x5561bec0c520 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.148+0000 7f1b91ffb700 1 -- 172.21.15.37:0/307771801 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b9c0ae340 con 0x5561bec0c520 2024-05-09T01:08:23.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1b91ffb700 1 -- 172.21.15.37:0/307771801 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f1b9c0a5900 con 0x5561bec0c520 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1bbf33db80 10 client.26144 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1bbf33db80 10 client.26144 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1bbf33db80 20 client.26144 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bee19480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1bbf33db80 4 client.26144 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5561becb3ba0 con 0x5561bedab850 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.149+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bee19480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.150+0000 7f1b91ffb700 10 client.26144 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:23.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.150+0000 7f1ba9d9b700 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bee19480 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb7f34084a8ad01 server_cookie=5748a692683e7dfa in_seq=0 out_seq=0 2024-05-09T01:08:23.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1b91ffb700 1 -- 172.21.15.37:0/307771801 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5561becb3ba0 con 0x5561bedab850 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1b91ffb700 10 client.26144 handle_command_reply: tid=0 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 client.26144 shutdown 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 msgr2=0x5561beda42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561beda42e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0a9c90 tx=0x7f1b9c0046e0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 shutdown_connections 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5561bedab850 0x5561bee19480 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561bed9bdd0 0x5561beda0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5561bec0c520 0x5561beda42e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1b91ffb700 0 client.26144 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 --2- 172.21.15.37:0/307771801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561bec86d80 0x5561beda0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.152+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 >> 172.21.15.37:0/307771801 conn(0x5561bec0fff0 msgr2=0x5561bed943e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.153+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 shutdown_connections 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.153+0000 7f1bbf33db80 1 -- 172.21.15.37:0/307771801 wait complete. 2024-05-09T01:08:23.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.153+0000 7f1bbf33db80 20 client.26144 trim_cache size 0 max 16384 2024-05-09T01:08:23.156 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:08:23.156 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:08:23.156 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "a0fd252e-0a87-4fc2-a06e-43c84cc24a31", 2024-05-09T01:08:23.156 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:08:23.156 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:08:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.154+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1b940b2900 msgr2=0x7f1b940b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.154+0000 7f1bab59e700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1b940b2900 0x7f1b940b4e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1bac109850 tx=0x7f1ba0009260 comp rx=0 tx=0).stop 2024-05-09T01:08:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.154+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac1032b0 msgr2=0x7f1bac109f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.154+0000 7f1bab59e700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac1032b0 0x7f1bac109f30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c006010 tx=0x7f1b9c004270 comp rx=0 tx=0).stop 2024-05-09T01:08:23.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.155+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 shutdown_connections 2024-05-09T01:08:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.155+0000 7f1bab59e700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1b940b2900 0x7f1b940b4e10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.155+0000 7f1bab59e700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bac108530 0x7f1bac10a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.155+0000 7f1bab59e700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bac1032b0 0x7f1bac109f30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.155+0000 7f1bab59e700 1 --2- 172.21.15.37:0/2236585269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bac107be0 0x7f1bac10a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.155+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 >> 172.21.15.37:0/2236585269 conn(0x7f1bac078ab0 msgr2=0x7f1bac0ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.156+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 shutdown_connections 2024-05-09T01:08:23.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:23.156+0000 7f1bab59e700 1 -- 172.21.15.37:0/2236585269 wait complete. 2024-05-09T01:08:23.628 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:08:23 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:08:23.179+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001a [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact/ auth{1=1,2=1,3=1,4=1} v804 ap=2 f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0) n(v4 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@11} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8323600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001a:[<0x10000000006/pg_xact v414>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000001a:[<0x10000000006/pg_xact v804>,<0x10000000005/data v512>,<0x100000001fb/postgres v266>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v286>,<0x10000000001/sv_1 v306>,<0x10000000000/qa v296>,<0x1/volumes v279>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:02:06.872458+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1)","memory_value.dirstat":"f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0)","memory_value.rstat":"n(v4 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:08:23.628 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:08:23 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:08:23.184+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans/ auth{1=1,2=1,3=1,4=1} v842 ap=2 f(v18 m2024-05-09T01:07:55.055882+0000 1=1+0) n(v20 rc2024-05-09T01:07:55.055882+0000 2=1+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@40} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8371600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v316>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v842>,<0x10000000005/data v512>,<0x100000001fb/postgres v266>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v286>,<0x10000000001/sv_1 v306>,<0x10000000000/qa v296>,<0x1/volumes v279>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:07:55.032882+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:07:55.055882+0000 2=1+1)","memory_value.dirstat":"f(v18 m2024-05-09T01:07:55.055882+0000 1=1+0)","memory_value.rstat":"n(v20 rc2024-05-09T01:07:55.055882+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:08:24.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:08:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 705 op/s 2024-05-09T01:08:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:08:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:24 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 705 op/s 2024-05-09T01:08:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:08:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:08:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:24 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.0 MiB/s wr, 705 op/s 2024-05-09T01:08:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:08:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:08:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:24 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:08:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 365.0 s, 2383.2 tps, lat 42.252 ms stddev 54.494 2024-05-09T01:08:26.452 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:26 smithi037 ceph-mon[30122]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.5 MiB/s wr, 736 op/s 2024-05-09T01:08:26.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:26 smithi136 ceph-mon[34110]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.5 MiB/s wr, 736 op/s 2024-05-09T01:08:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.629+0000 7faa74520700 1 -- 172.21.15.37:0/2985350278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 msgr2=0x7faa6c10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.629+0000 7faa74520700 1 --2- 172.21.15.37:0/2985350278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10ad40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faa58009990 tx=0x7faa58009ca0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.630+0000 7faa74520700 1 -- 172.21.15.37:0/2985350278 shutdown_connections 2024-05-09T01:08:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.630+0000 7faa74520700 1 --2- 172.21.15.37:0/2985350278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa6c10b280 0x7faa6c1198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.630+0000 7faa74520700 1 --2- 172.21.15.37:0/2985350278 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c111bd0 0x7faa6c111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.630+0000 7faa74520700 1 --2- 172.21.15.37:0/2985350278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10ad40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.630+0000 7faa74520700 1 -- 172.21.15.37:0/2985350278 >> 172.21.15.37:0/2985350278 conn(0x7faa6c06f4d0 msgr2=0x7faa6c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.630+0000 7faa74520700 1 -- 172.21.15.37:0/2985350278 shutdown_connections 2024-05-09T01:08:26.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.630+0000 7faa74520700 1 -- 172.21.15.37:0/2985350278 wait complete. 2024-05-09T01:08:26.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 Processor -- start 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 -- start start 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c10b280 0x7faa6c10c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa6c111bd0 0x7faa6c10cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c11ccf0 con 0x7faa6c10a930 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c11cb70 con 0x7faa6c10b280 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa74520700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c11ce70 con 0x7faa6c111bd0 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37176/0 (socket says 172.21.15.37:37176) 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.631+0000 7faa722bc700 1 -- 172.21.15.37:0/3400619522 learned_addr learned my addr 172.21.15.37:0/3400619522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:26.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa71abb700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c10b280 0x7faa6c10c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa72abd700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa6c111bd0 0x7faa6c10cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa722bc700 1 -- 172.21.15.37:0/3400619522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa6c111bd0 msgr2=0x7faa6c10cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa722bc700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa6c111bd0 0x7faa6c10cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa722bc700 1 -- 172.21.15.37:0/3400619522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c10b280 msgr2=0x7faa6c10c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa722bc700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c10b280 0x7faa6c10c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa722bc700 1 -- 172.21.15.37:0/3400619522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c10d490 con 0x7faa6c10a930 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa722bc700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10e220 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faa6000efc0 tx=0x7faa6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa6b7fe700 1 -- 172.21.15.37:0/3400619522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600092e0 con 0x7faa6c10a930 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c1b6050 con 0x7faa6c10a930 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa6b7fe700 1 -- 172.21.15.37:0/3400619522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa6000c9c0 con 0x7faa6c10a930 2024-05-09T01:08:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.632+0000 7faa6b7fe700 1 -- 172.21.15.37:0/3400619522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60004580 con 0x7faa6c10a930 2024-05-09T01:08:26.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.633+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c1b65b0 con 0x7faa6c10a930 2024-05-09T01:08:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.641+0000 7faa82f36b80 1 Processor -- start 2024-05-09T01:08:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.641+0000 7faa6b7fe700 1 -- 172.21.15.37:0/3400619522 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7faa6001b030 con 0x7faa6c10a930 2024-05-09T01:08:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.642+0000 7faa82f36b80 1 -- start start 2024-05-09T01:08:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.643+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd942784f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.643+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd94278a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.643+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd94272ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.643+0000 7faa82f36b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fd94194ff0 con 0x55fd940f54a0 2024-05-09T01:08:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.643+0000 7faa82f36b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fd941337f0 con 0x55fd941df160 2024-05-09T01:08:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.643+0000 7faa82f36b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd94190fb0 con 0x55fd942726a0 2024-05-09T01:08:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd94278a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd94278a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37190/0 (socket says 172.21.15.37:37190) 2024-05-09T01:08:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 -- 172.21.15.37:0/2441815294 learned_addr learned my addr 172.21.15.37:0/2441815294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 -- 172.21.15.37:0/2441815294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 msgr2=0x55fd94272ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:08:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 --2- 172.21.15.37:0/2441815294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd94272ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 -- 172.21.15.37:0/2441815294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 msgr2=0x55fd942784f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:08:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 --2- 172.21.15.37:0/2441815294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd942784f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.644+0000 7faa722bc700 1 -- 172.21.15.37:0/2441815294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9412b370 con 0x55fd940f54a0 2024-05-09T01:08:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.645+0000 7faa722bc700 1 --2- 172.21.15.37:0/2441815294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd94278a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faa600e5fb0 tx=0x7faa600ea3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e491ebb4bf625c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.647+0000 7faa6b7fe700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7faa5c0b29c0 0x7faa5c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.647+0000 7faa6b7fe700 1 -- 172.21.15.37:0/3400619522 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7faa600e1f90 con 0x7faa6c10a930 2024-05-09T01:08:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.652+0000 7faa68ff9700 1 -- 172.21.15.37:0/2441815294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600f5070 con 0x55fd940f54a0 2024-05-09T01:08:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.652+0000 7faa68ff9700 1 -- 172.21.15.37:0/2441815294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa600a9150 con 0x55fd940f54a0 2024-05-09T01:08:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.653+0000 7faa72abd700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7faa5c0b29c0 0x7faa5c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.653+0000 7faa82f36b80 1 -- 172.21.15.37:0/2441815294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 msgr2=0x55fd94278a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.653+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2441815294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd94278a30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faa600e5fb0 tx=0x7faa600ea3c0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.658+0000 7faa82f36b80 1 -- 172.21.15.37:0/2441815294 shutdown_connections 2024-05-09T01:08:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.658+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2441815294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd94272ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.658+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2441815294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd942784f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.658+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2441815294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd94278a30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.658+0000 7faa82f36b80 1 -- 172.21.15.37:0/2441815294 >> 172.21.15.37:0/2441815294 conn(0x55fd941556a0 msgr2=0x55fd9426d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.661+0000 7faa72abd700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7faa5c0b29c0 0x7faa5c0b4ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faa64005950 tx=0x7faa6400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.663+0000 7faa82f36b80 1 -- 172.21.15.37:0/2441815294 shutdown_connections 2024-05-09T01:08:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.666+0000 7faa82f36b80 1 -- 172.21.15.37:0/2441815294 wait complete. 2024-05-09T01:08:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.666+0000 7faa82f36b80 1 -- start start 2024-05-09T01:08:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.666+0000 7faa82f36b80 1 Processor -- start 2024-05-09T01:08:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.670+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd9427c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.670+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd9427c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.670+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9427cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.670+0000 7faa82f36b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fd94010ba0 con 0x55fd940f54a0 2024-05-09T01:08:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.670+0000 7faa82f36b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fd9414f150 con 0x55fd941df160 2024-05-09T01:08:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.670+0000 7faa82f36b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd9427f1d0 con 0x55fd942726a0 2024-05-09T01:08:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa82f36b80 10 client.0 _ll_register_callbacks cb 0x55fd940066c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd9427c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd9427c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37192/0 (socket says 172.21.15.37:37192) 2024-05-09T01:08:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa722bc700 1 -- 172.21.15.37:0/1924931166 learned_addr learned my addr 172.21.15.37:0/1924931166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa71abb700 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd9427c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa72abd700 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9427cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa722bc700 1 -- 172.21.15.37:0/1924931166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 msgr2=0x55fd9427cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.671+0000 7faa722bc700 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9427cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.672+0000 7faa722bc700 1 -- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 msgr2=0x55fd9427c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.672+0000 7faa722bc700 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd9427c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.672+0000 7faa722bc700 1 -- 172.21.15.37:0/1924931166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd94010490 con 0x55fd940f54a0 2024-05-09T01:08:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.672+0000 7faa722bc700 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd9427c170 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faa600090a0 tx=0x7faa600e54c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f2307054cbe50e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.672+0000 7faa55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:08:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.673+0000 7faa55ffb700 1 -- 172.21.15.37:0/1924931166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600a8db0 con 0x55fd940f54a0 2024-05-09T01:08:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.673+0000 7faa55ffb700 1 -- 172.21.15.37:0/1924931166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7faa60091110 con 0x55fd940f54a0 2024-05-09T01:08:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.673+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa600a9150 con 0x55fd940f54a0 2024-05-09T01:08:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.673+0000 7faa55ffb700 1 -- 172.21.15.37:0/1924931166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7faa600a9410 con 0x55fd940f54a0 2024-05-09T01:08:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.674+0000 7faa82f36b80 10 client.16338 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.674+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55fd94289a00 con 0x55fd940f54a0 2024-05-09T01:08:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa55ffb700 1 -- 172.21.15.37:0/1924931166 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa600a9150 con 0x55fd940f54a0 2024-05-09T01:08:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa55ffb700 1 -- 172.21.15.37:0/1924931166 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7faa600b0ce0 con 0x55fd940f54a0 2024-05-09T01:08:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa82f36b80 10 client.16338 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa82f36b80 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa82f36b80 20 client.16338 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa82f36b80 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9428bed0 0x55fd9428e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa82f36b80 4 client.16338 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd941a29d0 con 0x55fd9428bed0 2024-05-09T01:08:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.678+0000 7faa71abb700 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9428bed0 0x55fd9428e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.679+0000 7faa55ffb700 10 client.16338 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.681+0000 7faa71abb700 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9428bed0 0x55fd9428e2f0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20836f6127fd79b0 server_cookie=44e5be57fad15ab5 in_seq=0 out_seq=0 2024-05-09T01:08:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.685+0000 7faa55ffb700 1 -- 172.21.15.37:0/1924931166 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd941a29d0 con 0x55fd9428bed0 2024-05-09T01:08:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.685+0000 7faa55ffb700 10 client.16338 handle_command_reply: tid=0 2024-05-09T01:08:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.685+0000 7faa82f36b80 1 client.16338 shutdown 2024-05-09T01:08:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.687+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 msgr2=0x55fd9427c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.687+0000 7faa82f36b80 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd9427c170 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faa600090a0 tx=0x7faa600e54c0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.689+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 shutdown_connections 2024-05-09T01:08:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.689+0000 7faa82f36b80 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd9428bed0 0x55fd9428e2f0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.689+0000 7faa82f36b80 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9427cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.689+0000 7faa82f36b80 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd940f54a0 0x55fd9427c170 secure :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faa600090a0 tx=0x7faa600e54c0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.689+0000 7faa82f36b80 1 --2- 172.21.15.37:0/1924931166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd9427c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.689+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 >> 172.21.15.37:0/1924931166 conn(0x55fd941556a0 msgr2=0x55fd9426d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.690+0000 7faa55ffb700 0 client.16338 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:26.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.691+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 shutdown_connections 2024-05-09T01:08:26.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.691+0000 7faa82f36b80 1 -- 172.21.15.37:0/1924931166 wait complete. 2024-05-09T01:08:26.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.691+0000 7faa82f36b80 20 client.16338 trim_cache size 0 max 16384 2024-05-09T01:08:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:26 smithi151 ceph-mon[34780]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.5 MiB/s wr, 736 op/s 2024-05-09T01:08:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.729+0000 7faa82f36b80 1 Processor -- start 2024-05-09T01:08:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.729+0000 7faa82f36b80 1 -- start start 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.729+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd941df160 0x55fd94288430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd942726a0 0x55fd94276510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd94272ab0 0x55fd94290f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa82f36b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1bda30 con 0x55fd941df160 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa82f36b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1bf570 con 0x55fd942726a0 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd941df160 0x55fd94288430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa722bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd941df160 0x55fd94288430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37194/0 (socket says 172.21.15.37:37194) 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa722bc700 1 -- 172.21.15.37:0/2759835730 learned_addr learned my addr 172.21.15.37:0/2759835730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa71abb700 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd942726a0 0x55fd94276510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa82f36b80 1 -- 172.21.15.37:0/2759835730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1be100 con 0x55fd94272ab0 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa72abd700 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd94272ab0 0x55fd94290f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa71abb700 1 -- 172.21.15.37:0/2759835730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd94272ab0 msgr2=0x55fd94290f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa71abb700 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd94272ab0 0x55fd94290f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa71abb700 1 -- 172.21.15.37:0/2759835730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd941df160 msgr2=0x55fd94288430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa71abb700 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd941df160 0x55fd94288430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa71abb700 1 -- 172.21.15.37:0/2759835730 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9426ece0 con 0x55fd942726a0 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.730+0000 7faa722bc700 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd941df160 0x55fd94288430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.731+0000 7faa71abb700 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd942726a0 0x55fd94276510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa5800b2e0 tx=0x7faa58005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef2f6a3e673f80d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.731+0000 7faa57fff700 1 -- 172.21.15.37:0/2759835730 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5802c070 con 0x55fd942726a0 2024-05-09T01:08:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.731+0000 7faa57fff700 1 -- 172.21.15.37:0/2759835730 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa5800bdd0 con 0x55fd942726a0 2024-05-09T01:08:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.731+0000 7faa57fff700 1 -- 172.21.15.37:0/2759835730 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa580270e0 con 0x55fd942726a0 2024-05-09T01:08:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.733+0000 7faa82f36b80 1 -- 172.21.15.37:0/2759835730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd942726a0 msgr2=0x55fd94276510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.733+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd942726a0 0x55fd94276510 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faa5800b2e0 tx=0x7faa58005040 comp rx=0 tx=0).stop 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.733+0000 7faa82f36b80 1 -- 172.21.15.37:0/2759835730 shutdown_connections 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.734+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd94272ab0 0x55fd94290f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.734+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd941df160 0x55fd94288430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.734+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2759835730 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd942726a0 0x55fd94276510 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.734+0000 7faa82f36b80 1 -- 172.21.15.37:0/2759835730 >> 172.21.15.37:0/2759835730 conn(0x55fd941556a0 msgr2=0x55fd94275e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.735+0000 7faa82f36b80 1 -- 172.21.15.37:0/2759835730 shutdown_connections 2024-05-09T01:08:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.735+0000 7faa82f36b80 1 -- 172.21.15.37:0/2759835730 wait complete. 2024-05-09T01:08:26.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.735+0000 7faa82f36b80 1 -- start start 2024-05-09T01:08:26.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.736+0000 7faa82f36b80 1 Processor -- start 2024-05-09T01:08:26.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.737+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd94291540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.737+0000 7faa82f36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9428e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.737+0000 7faa722bc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd94291540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.737+0000 7faa722bc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd94291540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50340/0 (socket says 172.21.15.37:50340) 2024-05-09T01:08:26.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.738+0000 7faa722bc700 1 -- 172.21.15.37:0/2039236398 learned_addr learned my addr 172.21.15.37:0/2039236398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.738+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd94272ab0 0x55fd9428eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.738+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1beea0 con 0x55fd94272ab0 2024-05-09T01:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.738+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1be7d0 con 0x55fd941df160 2024-05-09T01:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.738+0000 7faa72abd700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd94272ab0 0x55fd9428eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c1bb9f0 con 0x55fd942726a0 2024-05-09T01:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa71abb700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9428e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa82f36b80 10 client.0 _ll_register_callbacks cb 0x55fd940066c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa72abd700 1 -- 172.21.15.37:0/2039236398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 msgr2=0x55fd9428e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa72abd700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9428e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa72abd700 1 -- 172.21.15.37:0/2039236398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 msgr2=0x55fd94291540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa72abd700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd94291540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa72abd700 1 -- 172.21.15.37:0/2039236398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9428f630 con 0x55fd94272ab0 2024-05-09T01:08:26.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.739+0000 7faa71abb700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9428e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:26.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.741+0000 7faa72abd700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd94272ab0 0x55fd9428eec0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faa64004410 tx=0x7faa640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6dc64b80341fd89 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:26.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.741+0000 7faa55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:08:26.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.742+0000 7faa55ffb700 1 -- 172.21.15.37:0/2039236398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64020d80 con 0x55fd94272ab0 2024-05-09T01:08:26.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.742+0000 7faa55ffb700 1 -- 172.21.15.37:0/2039236398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7faa64004830 con 0x55fd94272ab0 2024-05-09T01:08:26.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.742+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa5800bdd0 con 0x55fd94272ab0 2024-05-09T01:08:26.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.742+0000 7faa55ffb700 1 -- 172.21.15.37:0/2039236398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7faa64004a30 con 0x55fd94272ab0 2024-05-09T01:08:26.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.743+0000 7faa82f36b80 10 client.16344 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:26.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.743+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55fd942f6420 con 0x55fd94272ab0 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.743+0000 7faa55ffb700 1 -- 172.21.15.37:0/2039236398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa640054d0 con 0x55fd94272ab0 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.743+0000 7faa55ffb700 1 -- 172.21.15.37:0/2039236398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7faa64027070 con 0x55fd94272ab0 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.743+0000 7faa82f36b80 10 client.16344 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.743+0000 7faa82f36b80 10 client.16344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.743+0000 7faa82f36b80 20 client.16344 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.744+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd942f6b60 0x55fd942f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.744+0000 7faa82f36b80 4 client.16344 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.744+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7faa5800bdd0 con 0x55fd942f6b60 2024-05-09T01:08:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.744+0000 7faa722bc700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd942f6b60 0x55fd942f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.744+0000 7faa55ffb700 10 client.16344 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:26.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.744+0000 7faa722bc700 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd942f6b60 0x55fd942f8f80 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e30d572175750f38 server_cookie=c907fe87339206b8 in_seq=0 out_seq=0 2024-05-09T01:08:26.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.745+0000 7faa55ffb700 1 -- 172.21.15.37:0/2039236398 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7faa5800bdd0 con 0x55fd942f6b60 2024-05-09T01:08:26.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.745+0000 7faa55ffb700 10 client.16344 handle_command_reply: tid=0 2024-05-09T01:08:26.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.745+0000 7faa82f36b80 1 client.16344 shutdown 2024-05-09T01:08:26.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.745+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd94272ab0 msgr2=0x55fd9428eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.745+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd94272ab0 0x55fd9428eec0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faa64004410 tx=0x7faa640047c0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 shutdown_connections 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fd942f6b60 0x55fd942f8f80 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa55ffb700 0 client.16344 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fd94272ab0 0x55fd9428eec0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fd941df160 0x55fd94291540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa82f36b80 1 --2- 172.21.15.37:0/2039236398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd942726a0 0x55fd9428e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 >> 172.21.15.37:0/2039236398 conn(0x55fd941556a0 msgr2=0x55fd94271690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:26.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.746+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 shutdown_connections 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa82f36b80 1 -- 172.21.15.37:0/2039236398 wait complete. 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa82f36b80 20 client.16344 trim_cache size 0 max 16384 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stdout: "a0fd252e-0a87-4fc2-a06e-43c84cc24a31": { 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "a0fd252e-0a87-4fc2-a06e-43c84cc24a31", 2024-05-09T01:08:26.753 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:08:26.754 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:08:26.754 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:08:26.754 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:08:26.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7faa5c0b29c0 msgr2=0x7faa5c0b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa74520700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7faa5c0b29c0 0x7faa5c0b4ed0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faa64005950 tx=0x7faa6400b390 comp rx=0 tx=0).stop 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 msgr2=0x7faa6c10e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa74520700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10e220 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faa6000efc0 tx=0x7faa6000c3a0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 shutdown_connections 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.747+0000 7faa74520700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7faa5c0b29c0 0x7faa5c0b4ed0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.748+0000 7faa74520700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa6c111bd0 0x7faa6c10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.748+0000 7faa74520700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10a930 0x7faa6c10e220 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.748+0000 7faa74520700 1 --2- 172.21.15.37:0/3400619522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c10b280 0x7faa6c10c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.748+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 >> 172.21.15.37:0/3400619522 conn(0x7faa6c06f4d0 msgr2=0x7faa6c1104b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.748+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 shutdown_connections 2024-05-09T01:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:26.748+0000 7faa74520700 1 -- 172.21.15.37:0/3400619522 wait complete. 2024-05-09T01:08:27.458 INFO:tasks.cephfs.filesystem:scrub status for tag:a0fd252e-0a87-4fc2-a06e-43c84cc24a31 - {'path': '/', 'tag': 'a0fd252e-0a87-4fc2-a06e-43c84cc24a31', 'options': 'recursive,force'} 2024-05-09T01:08:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:28 smithi136 ceph-mon[34110]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.4 MiB/s wr, 838 op/s 2024-05-09T01:08:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:28 smithi037 ceph-mon[30122]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.4 MiB/s wr, 838 op/s 2024-05-09T01:08:28.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:28 smithi151 ceph-mon[34780]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.4 MiB/s wr, 838 op/s 2024-05-09T01:08:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 370.0 s, 3651.2 tps, lat 27.247 ms stddev 36.290 2024-05-09T01:08:30.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:30 smithi037 ceph-mon[30122]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.4 MiB/s wr, 762 op/s 2024-05-09T01:08:30.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:30 smithi136 ceph-mon[34110]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.4 MiB/s wr, 762 op/s 2024-05-09T01:08:30.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:30 smithi151 ceph-mon[34780]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.4 MiB/s wr, 762 op/s 2024-05-09T01:08:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:32 smithi136 ceph-mon[34110]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 10 MiB/s wr, 912 op/s 2024-05-09T01:08:32.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:32 smithi037 ceph-mon[30122]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 10 MiB/s wr, 912 op/s 2024-05-09T01:08:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:32 smithi151 ceph-mon[34780]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 10 MiB/s wr, 912 op/s 2024-05-09T01:08:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/484332002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c481105b0 msgr2=0x7f8c481129d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/484332002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c481105b0 0x7f8c481129d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000c840 tx=0x7f8c3002ae10 comp rx=0 tx=0).stop 2024-05-09T01:08:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/484332002 shutdown_connections 2024-05-09T01:08:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/484332002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c481105b0 0x7f8c481129d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/484332002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c4810b8b0 0x7f8c4810bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/484332002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c4810a670 0x7f8c4810b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/484332002 >> 172.21.15.37:0/484332002 conn(0x7f8c48070a90 msgr2=0x7f8c48072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/484332002 shutdown_connections 2024-05-09T01:08:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.838+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/484332002 wait complete. 2024-05-09T01:08:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 Processor -- start 2024-05-09T01:08:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 -- start start 2024-05-09T01:08:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c4810a670 0x7f8c48112560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c4810b8b0 0x7f8c481a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c481105b0 0x7f8c481a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48115d50 con 0x7f8c4810b8b0 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48115bd0 con 0x7f8c481105b0 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.839+0000 7f8c4d9a8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48115ed0 con 0x7f8c4810a670 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c4810b8b0 0x7f8c481a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c4810a670 0x7f8c48112560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c4810b8b0 0x7f8c481a78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55434/0 (socket says 172.21.15.37:55434) 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c477fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c481105b0 0x7f8c481a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c467fc640 1 -- 172.21.15.37:0/509176744 learned_addr learned my addr 172.21.15.37:0/509176744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c477fe640 1 -- 172.21.15.37:0/509176744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c4810a670 msgr2=0x7f8c48112560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c477fe640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c4810a670 0x7f8c48112560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c477fe640 1 -- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c4810b8b0 msgr2=0x7f8c481a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c477fe640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c4810b8b0 0x7f8c481a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c477fe640 1 -- 172.21.15.37:0/509176744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c481aa640 con 0x7f8c481105b0 2024-05-09T01:08:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c4810a670 0x7f8c48112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.840+0000 7f8c477fe640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c481105b0 0x7f8c481a9e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000c790 tx=0x7f8c30003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.841+0000 7f8c4c9a6640 1 -- 172.21.15.37:0/509176744 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30038040 con 0x7f8c481105b0 2024-05-09T01:08:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.841+0000 7f8c4c9a6640 1 -- 172.21.15.37:0/509176744 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c30043070 con 0x7f8c481105b0 2024-05-09T01:08:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.841+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c481a16a0 con 0x7f8c481105b0 2024-05-09T01:08:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.841+0000 7f8c4c9a6640 1 -- 172.21.15.37:0/509176744 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30009360 con 0x7f8c481105b0 2024-05-09T01:08:33.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.841+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481a1bb0 con 0x7f8c481105b0 2024-05-09T01:08:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.844+0000 7f8c5485c740 1 Processor -- start 2024-05-09T01:08:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.845+0000 7f8c4c9a6640 1 -- 172.21.15.37:0/509176744 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8c3002bd10 con 0x7f8c481105b0 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.845+0000 7f8c5485c740 1 -- start start 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788871b0 0x561978c2b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c2ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788664d0 0x561978c32980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c5485c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561978b8f7c0 con 0x56197885e2f0 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c5485c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561978b2b0e0 con 0x5619788664d0 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c5485c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561978b8b780 con 0x5619788871b0 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c467fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788871b0 0x561978c2b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c467fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788871b0 0x561978c2b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59046/0 (socket says 172.21.15.37:59046) 2024-05-09T01:08:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c467fc640 1 -- 172.21.15.37:0/4215344618 learned_addr learned my addr 172.21.15.37:0/4215344618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c467fc640 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788664d0 0x561978c32980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.846+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c2ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c467fc640 1 -- 172.21.15.37:0/4215344618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788664d0 msgr2=0x561978c32980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c467fc640 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788664d0 0x561978c32980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c467fc640 1 -- 172.21.15.37:0/4215344618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 msgr2=0x561978c2ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c467fc640 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c2ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c467fc640 1 -- 172.21.15.37:0/4215344618 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561978b547c0 con 0x5619788871b0 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c2ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c4c9a6640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c280b2860 0x7f8c280b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c280b2860 0x7f8c280b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c4c9a6640 1 -- 172.21.15.37:0/509176744 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8c301027c0 con 0x7f8c481105b0 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.847+0000 7f8c467fc640 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788871b0 0x561978c2b500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800b970 tx=0x7f8c38011040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8b45fbe51254548 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.848+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c280b2860 0x7f8c280b4d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x561978c2c8e0 tx=0x7f8c40016040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:33.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.848+0000 7f8c3dffb640 1 -- 172.21.15.37:0/4215344618 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004030 con 0x5619788871b0 2024-05-09T01:08:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.848+0000 7f8c3dffb640 1 -- 172.21.15.37:0/4215344618 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c38005020 con 0x5619788871b0 2024-05-09T01:08:33.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.848+0000 7f8c3dffb640 1 -- 172.21.15.37:0/4215344618 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004920 con 0x5619788871b0 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 -- 172.21.15.37:0/4215344618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788871b0 msgr2=0x561978c2b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788871b0 0x561978c2b500 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800b970 tx=0x7f8c38011040 comp rx=0 tx=0).stop 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 -- 172.21.15.37:0/4215344618 shutdown_connections 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788664d0 0x561978c32980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c2ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 --2- 172.21.15.37:0/4215344618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788871b0 0x561978c2b500 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 -- 172.21.15.37:0/4215344618 >> 172.21.15.37:0/4215344618 conn(0x56197887b300 msgr2=0x561978c26e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 -- 172.21.15.37:0/4215344618 shutdown_connections 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 -- 172.21.15.37:0/4215344618 wait complete. 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.849+0000 7f8c5485c740 1 -- start start 2024-05-09T01:08:33.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 1 Processor -- start 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56197885e2f0 0x561978c35350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619788664d0 0x561978c35890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788871b0 0x561978c3c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561978c333d0 con 0x5619788664d0 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561978b169c0 con 0x5619788871b0 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561978c33550 con 0x56197885e2f0 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c5485c740 10 client.0 _ll_register_callbacks cb 0x561978b43020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.850+0000 7f8c467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619788664d0 0x561978c35890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c467fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619788664d0 0x561978c35890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55448/0 (socket says 172.21.15.37:55448) 2024-05-09T01:08:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56197885e2f0 0x561978c35350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c467fc640 1 -- 172.21.15.37:0/1309917512 learned_addr learned my addr 172.21.15.37:0/1309917512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c477fe640 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788871b0 0x561978c3c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c46ffd640 1 -- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788871b0 msgr2=0x561978c3c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788871b0 0x561978c3c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c46ffd640 1 -- 172.21.15.37:0/1309917512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619788664d0 msgr2=0x561978c35890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619788664d0 0x561978c35890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c46ffd640 1 -- 172.21.15.37:0/1309917512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561978b3d1f0 con 0x56197885e2f0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c477fe640 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788871b0 0x561978c3c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56197885e2f0 0x561978c35350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x561978c27c20 tx=0x7f8c40004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab08e118fbf765e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c36ffd640 1 -- 172.21.15.37:0/1309917512 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40009c90 con 0x56197885e2f0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c38005020 con 0x56197885e2f0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.851+0000 7f8c36ffd640 1 -- 172.21.15.37:0/1309917512 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8c40014e00 con 0x56197885e2f0 2024-05-09T01:08:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c36ffd640 1 -- 172.21.15.37:0/1309917512 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8c4001f8d0 con 0x56197885e2f0 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 10 client.26158 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5619788f2790 con 0x56197885e2f0 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c36ffd640 1 -- 172.21.15.37:0/1309917512 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c38005020 con 0x56197885e2f0 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c36ffd640 1 -- 172.21.15.37:0/1309917512 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f8c4002c070 con 0x56197885e2f0 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 10 client.26158 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 10 client.26158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 20 client.26158 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561978845d80 0x561978c432a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 4 client.26158 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561978b9d3d0 con 0x561978845d80 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.852+0000 7f8c467fc640 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561978845d80 0x561978c432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.853+0000 7f8c36ffd640 10 client.26158 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.853+0000 7f8c467fc640 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561978845d80 0x561978c432a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4fb12c52b31f8f5 server_cookie=e0ebab911cee83c3 in_seq=0 out_seq=0 2024-05-09T01:08:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c36ffd640 1 -- 172.21.15.37:0/1309917512 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561978b9d3d0 con 0x561978845d80 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c36ffd640 10 client.26158 handle_command_reply: tid=0 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 client.26158 shutdown 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56197885e2f0 msgr2=0x561978c35350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56197885e2f0 0x561978c35350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x561978c27c20 tx=0x7f8c40004730 comp rx=0 tx=0).stop 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 shutdown_connections 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561978845d80 0x561978c432a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5619788871b0 0x561978c3c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619788664d0 0x561978c35890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c36ffd640 0 client.26158 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 --2- 172.21.15.37:0/1309917512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56197885e2f0 0x561978c35350 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.854+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 >> 172.21.15.37:0/1309917512 conn(0x56197887b300 msgr2=0x561978c25700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.855+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 shutdown_connections 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.855+0000 7f8c5485c740 1 -- 172.21.15.37:0/1309917512 wait complete. 2024-05-09T01:08:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.855+0000 7f8c5485c740 20 client.26158 trim_cache size 0 max 16384 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 Processor -- start 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 -- start start 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561978845d80 0x561978c25e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56197885e2f0 0x561978c3c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c00e330 con 0x561978845d80 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c00fe70 con 0x56197885e2f0 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c5485c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c00ea00 con 0x5619788664d0 2024-05-09T01:08:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561978845d80 0x561978c25e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c477fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c477fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59054/0 (socket says 172.21.15.37:59054) 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561978845d80 0x561978c25e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55460/0 (socket says 172.21.15.37:55460) 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c477fe640 1 -- 172.21.15.37:0/2512651159 learned_addr learned my addr 172.21.15.37:0/2512651159 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.879+0000 7f8c467fc640 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56197885e2f0 0x561978c3c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c477fe640 1 -- 172.21.15.37:0/2512651159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56197885e2f0 msgr2=0x561978c3c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c477fe640 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56197885e2f0 0x561978c3c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c477fe640 1 -- 172.21.15.37:0/2512651159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561978845d80 msgr2=0x561978c25e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c477fe640 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561978845d80 0x561978c25e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c477fe640 1 -- 172.21.15.37:0/2512651159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619789695f0 con 0x5619788664d0 2024-05-09T01:08:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561978845d80 0x561978c25e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c477fe640 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3ccc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c300c70e0 tx=0x7f8c300c98d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca674cac5e1bcf78 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c3d7fa640 1 -- 172.21.15.37:0/2512651159 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c300c9e70 con 0x5619788664d0 2024-05-09T01:08:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c3d7fa640 1 -- 172.21.15.37:0/2512651159 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c300ce220 con 0x5619788664d0 2024-05-09T01:08:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.880+0000 7f8c3d7fa640 1 -- 172.21.15.37:0/2512651159 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c300ca0d0 con 0x5619788664d0 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 -- 172.21.15.37:0/2512651159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 msgr2=0x561978c3ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3ccc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c300c70e0 tx=0x7f8c300c98d0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 -- 172.21.15.37:0/2512651159 shutdown_connections 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3ccc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56197885e2f0 0x561978c3c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2512651159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561978845d80 0x561978c25e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 -- 172.21.15.37:0/2512651159 >> 172.21.15.37:0/2512651159 conn(0x56197887b300 msgr2=0x561978c25700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.881+0000 7f8c5485c740 1 -- 172.21.15.37:0/2512651159 shutdown_connections 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.882+0000 7f8c5485c740 1 -- 172.21.15.37:0/2512651159 wait complete. 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.882+0000 7f8c5485c740 1 -- start start 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.882+0000 7f8c5485c740 1 Processor -- start 2024-05-09T01:08:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561978845d80 0x561978c39e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c3a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c5485c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c5485c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c00f7a0 con 0x56197885e2f0 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561978845d80 0x561978c39e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c5485c740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c00f0d0 con 0x561978845d80 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c5485c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c00c310 con 0x5619788664d0 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561978845d80 0x561978c39e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39180/0 (socket says 172.21.15.37:39180) 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 -- 172.21.15.37:0/2728767556 learned_addr learned my addr 172.21.15.37:0/2728767556 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c5485c740 10 client.0 _ll_register_callbacks cb 0x7f8c4000bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c467fc640 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c3a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c477fe640 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 -- 172.21.15.37:0/2728767556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 msgr2=0x561978c3b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 -- 172.21.15.37:0/2728767556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 msgr2=0x561978c3a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c3a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.883+0000 7f8c46ffd640 1 -- 172.21.15.37:0/2728767556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561978b53ed0 con 0x561978845d80 2024-05-09T01:08:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.884+0000 7f8c46ffd640 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561978845d80 0x561978c39e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c4002ddd0 tx=0x7f8c4001fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e934ecc17e7735c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.892+0000 7f8c36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.896+0000 7f8c36ffd640 1 -- 172.21.15.37:0/2728767556 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4002d840 con 0x561978845d80 2024-05-09T01:08:33.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.896+0000 7f8c36ffd640 1 -- 172.21.15.37:0/2728767556 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8c400383f0 con 0x561978845d80 2024-05-09T01:08:33.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.898+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c300ce220 con 0x561978845d80 2024-05-09T01:08:33.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.903+0000 7f8c36ffd640 1 -- 172.21.15.37:0/2728767556 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8c4002d9e0 con 0x561978845d80 2024-05-09T01:08:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.904+0000 7f8c5485c740 10 client.26177 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:33.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.905+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561978c3c960 con 0x561978845d80 2024-05-09T01:08:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c36ffd640 1 -- 172.21.15.37:0/2728767556 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c4002de50 con 0x561978845d80 2024-05-09T01:08:33.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c36ffd640 1 -- 172.21.15.37:0/2728767556 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f8c4004b470 con 0x561978845d80 2024-05-09T01:08:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c5485c740 10 client.26177 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c5485c740 10 client.26177 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c5485c740 20 client.26177 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:33.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5619788871b0 0x561978cad790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c5485c740 4 client.26177 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:08:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.908+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8c300ce220 con 0x5619788871b0 2024-05-09T01:08:33.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.909+0000 7f8c467fc640 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5619788871b0 0x561978cad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:33.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.912+0000 7f8c467fc640 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5619788871b0 0x561978cad790 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff2ed8bcbc919f5 server_cookie=419691eb8232fa73 in_seq=0 out_seq=0 2024-05-09T01:08:33.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.912+0000 7f8c36ffd640 10 client.26177 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:33.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.925+0000 7f8c36ffd640 1 -- 172.21.15.37:0/2728767556 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f8c300ce220 con 0x5619788871b0 2024-05-09T01:08:33.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.925+0000 7f8c36ffd640 10 client.26177 handle_command_reply: tid=0 2024-05-09T01:08:33.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.925+0000 7f8c5485c740 1 client.26177 shutdown 2024-05-09T01:08:33.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561978845d80 msgr2=0x561978c39e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561978845d80 0x561978c39e90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c4002ddd0 tx=0x7f8c4001fd20 comp rx=0 tx=0).stop 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 shutdown_connections 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5619788871b0 0x561978cad790 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5619788664d0 0x561978c3b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c36ffd640 0 client.26177 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56197885e2f0 0x561978c3a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 --2- 172.21.15.37:0/2728767556 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561978845d80 0x561978c39e90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 >> 172.21.15.37:0/2728767556 conn(0x56197887b300 msgr2=0x561978c25e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 shutdown_connections 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 1 -- 172.21.15.37:0/2728767556 wait complete. 2024-05-09T01:08:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.926+0000 7f8c5485c740 20 client.26177 trim_cache size 0 max 16384 2024-05-09T01:08:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:08:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:08:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:08:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.927+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c280b2860 msgr2=0x7f8c280b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.927+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c280b2860 0x7f8c280b4d70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x561978c2c8e0 tx=0x7f8c40016040 comp rx=0 tx=0).stop 2024-05-09T01:08:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.927+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c481105b0 msgr2=0x7f8c481a9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.927+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c481105b0 0x7f8c481a9e20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000c790 tx=0x7f8c30003f30 comp rx=0 tx=0).stop 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 shutdown_connections 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c280b2860 0x7f8c280b4d70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c481105b0 0x7f8c481a9e20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c4810b8b0 0x7f8c481a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 --2- 172.21.15.37:0/509176744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c4810a670 0x7f8c48112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 >> 172.21.15.37:0/509176744 conn(0x7f8c48070a90 msgr2=0x7f8c48072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 shutdown_connections 2024-05-09T01:08:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:33.928+0000 7f8c4d9a8640 1 -- 172.21.15.37:0/509176744 wait complete. 2024-05-09T01:08:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:34 smithi136 ceph-mon[34110]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.1 MiB/s wr, 879 op/s 2024-05-09T01:08:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:34 smithi037 ceph-mon[30122]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.1 MiB/s wr, 879 op/s 2024-05-09T01:08:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:34 smithi151 ceph-mon[34780]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.1 MiB/s wr, 879 op/s 2024-05-09T01:08:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 375.0 s, 2383.6 tps, lat 41.612 ms stddev 47.978 2024-05-09T01:08:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:36 smithi136 ceph-mon[34110]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 10 MiB/s wr, 932 op/s 2024-05-09T01:08:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:36 smithi037 ceph-mon[30122]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 10 MiB/s wr, 932 op/s 2024-05-09T01:08:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:36 smithi151 ceph-mon[34780]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 10 MiB/s wr, 932 op/s 2024-05-09T01:08:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:38 smithi136 ceph-mon[34110]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.2 MiB/s wr, 865 op/s 2024-05-09T01:08:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:08:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:08:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:08:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:08:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:08:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:38 smithi037 ceph-mon[30122]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.2 MiB/s wr, 865 op/s 2024-05-09T01:08:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:08:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:08:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:08:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:08:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:08:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:38 smithi151 ceph-mon[34780]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.2 MiB/s wr, 865 op/s 2024-05-09T01:08:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:08:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:08:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:08:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:08:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:08:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 380.0 s, 1695.0 tps, lat 59.198 ms stddev 68.244 2024-05-09T01:08:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:40 smithi136 ceph-mon[34110]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 672 op/s 2024-05-09T01:08:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:40 smithi037 ceph-mon[30122]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 672 op/s 2024-05-09T01:08:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:40 smithi151 ceph-mon[34780]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 672 op/s 2024-05-09T01:08:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:42 smithi136 ceph-mon[34110]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.1 MiB/s wr, 798 op/s 2024-05-09T01:08:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:42 smithi037 ceph-mon[30122]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.1 MiB/s wr, 798 op/s 2024-05-09T01:08:42.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:42 smithi151 ceph-mon[34780]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.1 MiB/s wr, 798 op/s 2024-05-09T01:08:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:44 smithi136 ceph-mon[34110]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.6 MiB/s wr, 713 op/s 2024-05-09T01:08:44.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:44 smithi037 ceph-mon[30122]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.6 MiB/s wr, 713 op/s 2024-05-09T01:08:44.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:44 smithi151 ceph-mon[34780]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 8.6 MiB/s wr, 713 op/s 2024-05-09T01:08:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 385.0 s, 2454.6 tps, lat 40.959 ms stddev 44.042 2024-05-09T01:08:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:46 smithi136 ceph-mon[34110]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.5 MiB/s wr, 638 op/s 2024-05-09T01:08:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:46 smithi037 ceph-mon[30122]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.5 MiB/s wr, 638 op/s 2024-05-09T01:08:46.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:46 smithi151 ceph-mon[34780]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.5 MiB/s wr, 638 op/s 2024-05-09T01:08:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 -- 172.21.15.37:0/3136021733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6409b820 msgr2=0x7f5c6409dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 --2- 172.21.15.37:0/3136021733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6409b820 0x7f5c6409dc40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0687c0 tx=0x7f5c6c097980 comp rx=0 tx=0).stop 2024-05-09T01:08:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 -- 172.21.15.37:0/3136021733 shutdown_connections 2024-05-09T01:08:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 --2- 172.21.15.37:0/3136021733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6409b820 0x7f5c6409dc40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 --2- 172.21.15.37:0/3136021733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c64096b20 0x7f5c64096f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 --2- 172.21.15.37:0/3136021733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 0x7f5c640965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 -- 172.21.15.37:0/3136021733 >> 172.21.15.37:0/3136021733 conn(0x7f5c64090ab0 msgr2=0x7f5c64092f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 -- 172.21.15.37:0/3136021733 shutdown_connections 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.081+0000 7f5c72829640 1 -- 172.21.15.37:0/3136021733 wait complete. 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 Processor -- start 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 -- start start 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 0x7f5c640a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64096b20 0x7f5c640a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c6409b820 0x7f5c640a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c640a47a0 con 0x7f5c64096b20 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5c640a00b0 con 0x7f5c6409b820 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c72829640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c640a4920 con 0x7f5c640958e0 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.082+0000 7f5c71827640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 0x7f5c640a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71827640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 0x7f5c640a3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42412/0 (socket says 172.21.15.37:42412) 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71827640 1 -- 172.21.15.37:0/4094881098 learned_addr learned my addr 172.21.15.37:0/4094881098 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71026640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64096b20 0x7f5c640a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c72028640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c6409b820 0x7f5c640a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71026640 1 -- 172.21.15.37:0/4094881098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 msgr2=0x7f5c640a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71026640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 0x7f5c640a3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71026640 1 -- 172.21.15.37:0/4094881098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c6409b820 msgr2=0x7f5c640a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71026640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c6409b820 0x7f5c640a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71026640 1 -- 172.21.15.37:0/4094881098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c640a0f30 con 0x7f5c64096b20 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71827640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 0x7f5c640a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.083+0000 7f5c71026640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64096b20 0x7f5c640a4100 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00e9f0 tx=0x7f5c5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.084+0000 7f5c62ffd640 1 -- 172.21.15.37:0/4094881098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c00cd80 con 0x7f5c64096b20 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.084+0000 7f5c62ffd640 1 -- 172.21.15.37:0/4094881098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c5c0035f0 con 0x7f5c64096b20 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.084+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c640a1220 con 0x7f5c64096b20 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.084+0000 7f5c62ffd640 1 -- 172.21.15.37:0/4094881098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c010670 con 0x7f5c64096b20 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.084+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6413b9b0 con 0x7f5c64096b20 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 Processor -- start 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c62ffd640 1 -- 172.21.15.37:0/4094881098 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5c5c0108d0 con 0x7f5c64096b20 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 -- start start 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddde6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dddec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56182dd427c0 con 0x56182da112f0 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56182dcde0e0 con 0x56182da3a1b0 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56182dd3e780 con 0x56182da194d0 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.087+0000 7f5c72028640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddde6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c71026640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddde6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50218/0 (socket says 172.21.15.37:50218) 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 -- 172.21.15.37:0/2496374406 learned_addr learned my addr 172.21.15.37:0/2496374406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c71827640 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dddec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 -- 172.21.15.37:0/2496374406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 msgr2=0x56182dde5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 -- 172.21.15.37:0/2496374406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 msgr2=0x56182dddec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c62ffd640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5c580b2870 0x7f5c580b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dddec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 -- 172.21.15.37:0/2496374406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182dd077c0 con 0x56182da3a1b0 2024-05-09T01:08:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c71026640 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c62ffd640 1 -- 172.21.15.37:0/4094881098 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5c5c0e23b0 con 0x7f5c64096b20 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5c580b2870 0x7f5c580b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.088+0000 7f5c72028640 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddde6c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c02e1f0 tx=0x7f5c6c068f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25bcc0387f28e3f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.089+0000 7f5c57fff640 1 -- 172.21.15.37:0/2496374406 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0a2040 con 0x56182da3a1b0 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.089+0000 7f5c57fff640 1 -- 172.21.15.37:0/2496374406 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c6c0a9460 con 0x56182da3a1b0 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.089+0000 7f5c57fff640 1 -- 172.21.15.37:0/2496374406 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0ba070 con 0x56182da3a1b0 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2496374406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 msgr2=0x56182ddde6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddde6c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c02e1f0 tx=0x7f5c6c068f90 comp rx=0 tx=0).stop 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c72028640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5c580b2870 0x7f5c580b4d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x56182dde61e0 tx=0x7f5c6c0b4000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2496374406 shutdown_connections 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dddec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2496374406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddde6c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2496374406 >> 172.21.15.37:0/2496374406 conn(0x56182da2e300 msgr2=0x56182ddda050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2496374406 shutdown_connections 2024-05-09T01:08:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.090+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2496374406 wait complete. 2024-05-09T01:08:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.091+0000 7f5c7aa11740 1 -- start start 2024-05-09T01:08:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.091+0000 7f5c7aa11740 1 Processor -- start 2024-05-09T01:08:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.092+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dde8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.092+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.092+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.092+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56182dde6590 con 0x56182da112f0 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.092+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56182dcc99c0 con 0x56182da3a1b0 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.092+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56182dde6710 con 0x56182da194d0 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.092+0000 7f5c7aa11740 10 client.0 _ll_register_callbacks cb 0x56182dcf6020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddef910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50230/0 (socket says 172.21.15.37:50230) 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 -- 172.21.15.37:0/3981121260 learned_addr learned my addr 172.21.15.37:0/3981121260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c71026640 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c71827640 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dde8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 -- 172.21.15.37:0/3981121260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 msgr2=0x56182dde89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 -- 172.21.15.37:0/3981121260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 msgr2=0x56182dde8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dde8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 -- 172.21.15.37:0/3981121260 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182dcf01f0 con 0x56182da3a1b0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c72028640 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddef910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c000b60 tx=0x7f5c6c069110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd51a26bffdf3c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c557fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.093+0000 7f5c557fa640 1 -- 172.21.15.37:0/3981121260 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0a9e60 con 0x56182da3a1b0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c557fa640 1 -- 172.21.15.37:0/3981121260 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5c6c069a10 con 0x56182da3a1b0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c6c0a9460 con 0x56182da3a1b0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c557fa640 1 -- 172.21.15.37:0/3981121260 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5c6c0cf050 con 0x56182da3a1b0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 10 client.26189 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56182daa5790 con 0x56182da3a1b0 2024-05-09T01:08:47.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c557fa640 1 -- 172.21.15.37:0/3981121260 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c6c0a9460 con 0x56182da3a1b0 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c557fa640 1 -- 172.21.15.37:0/3981121260 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f5c6c0b4490 con 0x56182da3a1b0 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 10 client.26189 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 10 client.26189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 20 client.26189 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182d9f8d80 0x56182ddf59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 4 client.26189 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.094+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56182dd503d0 con 0x56182d9f8d80 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.095+0000 7f5c71827640 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182d9f8d80 0x56182ddf59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.095+0000 7f5c71827640 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182d9f8d80 0x56182ddf59f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42d24c41edd0da92 server_cookie=d82dd84672f0061d in_seq=0 out_seq=0 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.095+0000 7f5c557fa640 10 client.26189 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.097+0000 7f5c557fa640 1 -- 172.21.15.37:0/3981121260 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56182dd503d0 con 0x56182d9f8d80 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.097+0000 7f5c557fa640 10 client.26189 handle_command_reply: tid=0 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.097+0000 7f5c7aa11740 1 client.26189 shutdown 2024-05-09T01:08:47.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 msgr2=0x56182ddef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddef910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c000b60 tx=0x7f5c6c069110 comp rx=0 tx=0).stop 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 shutdown_connections 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182d9f8d80 0x56182ddf59f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c557fa640 0 client.26189 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da3a1b0 0x56182ddef910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182dde89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/3981121260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182dde8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.098+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 >> 172.21.15.37:0/3981121260 conn(0x56182da2e300 msgr2=0x56182ddd9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.099+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 shutdown_connections 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.099+0000 7f5c7aa11740 1 -- 172.21.15.37:0/3981121260 wait complete. 2024-05-09T01:08:47.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.099+0000 7f5c7aa11740 20 client.26189 trim_cache size 0 max 16384 2024-05-09T01:08:47.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.123+0000 7f5c7aa11740 1 Processor -- start 2024-05-09T01:08:47.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c7aa11740 1 -- start start 2024-05-09T01:08:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182d9f8d80 0x56182dde2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da112f0 0x56182dddd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182ddfb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c641445a0 con 0x56182d9f8d80 2024-05-09T01:08:47.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5c641460e0 con 0x56182da112f0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64144c70 con 0x56182da194d0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c71827640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182d9f8d80 0x56182dde2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c71827640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182d9f8d80 0x56182dde2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50796/0 (socket says 172.21.15.37:50796) 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c71827640 1 -- 172.21.15.37:0/580060023 learned_addr learned my addr 172.21.15.37:0/580060023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c72028640 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182ddfb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.124+0000 7f5c71026640 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da112f0 0x56182dddd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c72028640 1 -- 172.21.15.37:0/580060023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da112f0 msgr2=0x56182dddd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c72028640 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da112f0 0x56182dddd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c72028640 1 -- 172.21.15.37:0/580060023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182d9f8d80 msgr2=0x56182dde2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c72028640 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182d9f8d80 0x56182dde2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c72028640 1 -- 172.21.15.37:0/580060023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182db1c5f0 con 0x56182da194d0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c71827640 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182d9f8d80 0x56182dde2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c72028640 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182ddfb1f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c050b40 tx=0x7f5c6c068f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc2cf15c04aed2c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c577fe640 1 -- 172.21.15.37:0/580060023 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0a2070 con 0x56182da194d0 2024-05-09T01:08:47.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c577fe640 1 -- 172.21.15.37:0/580060023 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c6c0b4c50 con 0x56182da194d0 2024-05-09T01:08:47.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.125+0000 7f5c577fe640 1 -- 172.21.15.37:0/580060023 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0a9940 con 0x56182da194d0 2024-05-09T01:08:47.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.126+0000 7f5c7aa11740 1 -- 172.21.15.37:0/580060023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 msgr2=0x56182ddfb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.126+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182ddfb1f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c050b40 tx=0x7f5c6c068f90 comp rx=0 tx=0).stop 2024-05-09T01:08:47.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.126+0000 7f5c7aa11740 1 -- 172.21.15.37:0/580060023 shutdown_connections 2024-05-09T01:08:47.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.126+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182ddfb1f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.126+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182da112f0 0x56182dddd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.126+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/580060023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182d9f8d80 0x56182dde2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.126+0000 7f5c7aa11740 1 -- 172.21.15.37:0/580060023 >> 172.21.15.37:0/580060023 conn(0x56182da2e300 msgr2=0x56182dddced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.127+0000 7f5c7aa11740 1 -- 172.21.15.37:0/580060023 shutdown_connections 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.127+0000 7f5c7aa11740 1 -- 172.21.15.37:0/580060023 wait complete. 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.127+0000 7f5c7aa11740 1 -- start start 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.127+0000 7f5c7aa11740 1 Processor -- start 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182d9f8d80 0x56182ddeb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182ddeb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c7aa11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182de5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64145a10 con 0x56182da112f0 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64145340 con 0x56182d9f8d80 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c7aa11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c64142580 con 0x56182da194d0 2024-05-09T01:08:47.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182ddeb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182ddeb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50810/0 (socket says 172.21.15.37:50810) 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 -- 172.21.15.37:0/2419161227 learned_addr learned my addr 172.21.15.37:0/2419161227 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71827640 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182d9f8d80 0x56182ddeb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c7aa11740 10 client.0 _ll_register_callbacks cb 0x7f5c68009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c72028640 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182de5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 -- 172.21.15.37:0/2419161227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 msgr2=0x56182de5bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182de5bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 -- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182d9f8d80 msgr2=0x56182ddeb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182d9f8d80 0x56182ddeb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 -- 172.21.15.37:0/2419161227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182dd06ed0 con 0x56182da112f0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c71026640 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182ddeb6b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0e5c70 tx=0x7f5c5c0a9900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840ce278439f31ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c557fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.128+0000 7f5c557fa640 1 -- 172.21.15.37:0/2419161227 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0b2210 con 0x56182da112f0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c557fa640 1 -- 172.21.15.37:0/2419161227 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5c5c0a5d00 con 0x56182da112f0 2024-05-09T01:08:47.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c6c0b4c50 con 0x56182da112f0 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c557fa640 1 -- 172.21.15.37:0/2419161227 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5c5c003ac0 con 0x56182da112f0 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 10 client.16380 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56182de5d440 con 0x56182da112f0 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c557fa640 1 -- 172.21.15.37:0/2419161227 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c6c0b4c50 con 0x56182da112f0 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c557fa640 1 -- 172.21.15.37:0/2419161227 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f5c5c0b2440 con 0x56182da112f0 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 10 client.16380 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 10 client.16380 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 20 client.16380 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182da3a1b0 0x56182de5fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 4 client.16380 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56182dd4a240 con 0x56182da3a1b0 2024-05-09T01:08:47.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.129+0000 7f5c71827640 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182da3a1b0 0x56182de5fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.130+0000 7f5c71827640 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182da3a1b0 0x56182de5fd90 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=178119505b45dc88 server_cookie=1d8029af9c617cca in_seq=0 out_seq=0 2024-05-09T01:08:47.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.131+0000 7f5c557fa640 10 client.16380 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.140+0000 7f5c557fa640 1 -- 172.21.15.37:0/2419161227 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56182dd4a240 con 0x56182da3a1b0 2024-05-09T01:08:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.140+0000 7f5c557fa640 10 client.16380 handle_command_reply: tid=0 2024-05-09T01:08:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 client.16380 shutdown 2024-05-09T01:08:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 msgr2=0x56182ddeb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182ddeb6b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0e5c70 tx=0x7f5c5c0a9900 comp rx=0 tx=0).stop 2024-05-09T01:08:47.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 shutdown_connections 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56182da3a1b0 0x56182de5fd90 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56182da194d0 0x56182de5bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56182da112f0 0x56182ddeb6b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 --2- 172.21.15.37:0/2419161227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56182d9f8d80 0x56182ddeb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c557fa640 0 client.16380 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 >> 172.21.15.37:0/2419161227 conn(0x56182da2e300 msgr2=0x56182dde72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 shutdown_connections 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 1 -- 172.21.15.37:0/2419161227 wait complete. 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.141+0000 7f5c7aa11740 20 client.16380 trim_cache size 0 max 16384 2024-05-09T01:08:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:08:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:08:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:08:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5c580b2870 msgr2=0x7f5c580b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5c580b2870 0x7f5c580b4d80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x56182dde61e0 tx=0x7f5c6c0b4000 comp rx=0 tx=0).stop 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64096b20 msgr2=0x7f5c640a4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64096b20 0x7f5c640a4100 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00e9f0 tx=0x7f5c5c00eeb0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 shutdown_connections 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5c580b2870 0x7f5c580b4d80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c6409b820 0x7f5c640a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c64096b20 0x7f5c640a4100 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 --2- 172.21.15.37:0/4094881098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c640958e0 0x7f5c640a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 >> 172.21.15.37:0/4094881098 conn(0x7f5c64090ab0 msgr2=0x7f5c64097800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.143+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 shutdown_connections 2024-05-09T01:08:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:08:47.144+0000 7f5c72829640 1 -- 172.21.15.37:0/4094881098 wait complete. 2024-05-09T01:08:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:48 smithi136 ceph-mon[34110]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 646 op/s 2024-05-09T01:08:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:48 smithi037 ceph-mon[30122]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 646 op/s 2024-05-09T01:08:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:48 smithi151 ceph-mon[34780]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 646 op/s 2024-05-09T01:08:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 390.0 s, 3161.2 tps, lat 31.645 ms stddev 39.487 2024-05-09T01:08:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:50 smithi136 ceph-mon[34110]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.1 MiB/s wr, 583 op/s 2024-05-09T01:08:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:50 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:08:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:50 smithi037 ceph-mon[30122]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.1 MiB/s wr, 583 op/s 2024-05-09T01:08:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:50 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:08:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:50 smithi151 ceph-mon[34780]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.1 MiB/s wr, 583 op/s 2024-05-09T01:08:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:50 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:08:51.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:51 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:08:51.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:51 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:08:51.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:51 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:08:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:08:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:08:51.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:08:51.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:51 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:08:51.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:51 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:08:51.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:51 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:08:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:52 smithi136 ceph-mon[34110]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 730 op/s 2024-05-09T01:08:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:52 smithi037 ceph-mon[30122]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 730 op/s 2024-05-09T01:08:52.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:52 smithi151 ceph-mon[34780]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 730 op/s 2024-05-09T01:08:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:54 smithi136 ceph-mon[34110]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2024-05-09T01:08:54.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:54 smithi037 ceph-mon[30122]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2024-05-09T01:08:54.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:54 smithi151 ceph-mon[34780]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 7.2 MiB/s wr, 661 op/s 2024-05-09T01:08:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 395.0 s, 3478.8 tps, lat 28.603 ms stddev 38.992 2024-05-09T01:08:56.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:56 smithi136 ceph-mon[34110]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 721 op/s 2024-05-09T01:08:56.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:56 smithi037 ceph-mon[30122]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 721 op/s 2024-05-09T01:08:56.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:56 smithi151 ceph-mon[34780]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 721 op/s 2024-05-09T01:08:57.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:08:57.835 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:08:58.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:08:58 smithi136 ceph-mon[34110]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 762 op/s 2024-05-09T01:08:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:08:58 smithi037 ceph-mon[30122]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 762 op/s 2024-05-09T01:08:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:08:58 smithi151 ceph-mon[34780]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 762 op/s 2024-05-09T01:08:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.820+0000 7f22ec8fb700 1 -- 172.21.15.37:0/3696272345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 msgr2=0x7f22e811fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.820+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/3696272345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 0x7f22e811fd50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009990 tx=0x7f22d0009ca0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.821+0000 7f22ec8fb700 1 -- 172.21.15.37:0/3696272345 shutdown_connections 2024-05-09T01:08:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.821+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/3696272345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 0x7f22e811fd50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.821+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/3696272345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e810a930 0x7f22e810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.821+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/3696272345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810b280 0x7f22e811d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.821+0000 7f22ec8fb700 1 -- 172.21.15.37:0/3696272345 >> 172.21.15.37:0/3696272345 conn(0x7f22e806f4d0 msgr2=0x7f22e806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.822+0000 7f22ec8fb700 1 -- 172.21.15.37:0/3696272345 shutdown_connections 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.824+0000 7f22ec8fb700 1 -- 172.21.15.37:0/3696272345 wait complete. 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 Processor -- start 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 -- start start 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810a930 0x7f22e81a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e810b280 0x7f22e81aa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 0x7f22e81ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81233d0 con 0x7f22e810a930 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8123250 con 0x7f22e811d930 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.825+0000 7f22ec8fb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8123550 con 0x7f22e810b280 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.827+0000 7f22e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810a930 0x7f22e81a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.828+0000 7f22e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810a930 0x7f22e81a9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42202/0 (socket says 172.21.15.37:42202) 2024-05-09T01:08:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.828+0000 7f22e659c700 1 -- 172.21.15.37:0/1831067983 learned_addr learned my addr 172.21.15.37:0/1831067983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.828+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 0x7f22e81ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.828+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e810b280 0x7f22e81aa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.830+0000 7f22e659c700 1 -- 172.21.15.37:0/1831067983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e810b280 msgr2=0x7f22e81aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.830+0000 7f22e659c700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e810b280 0x7f22e81aa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.830+0000 7f22e659c700 1 -- 172.21.15.37:0/1831067983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 msgr2=0x7f22e81ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.830+0000 7f22e659c700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 0x7f22e81ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.830+0000 7f22e659c700 1 -- 172.21.15.37:0/1831067983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e81aec70 con 0x7f22e810a930 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.831+0000 7f22e659c700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810a930 0x7f22e81a9da0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f22e000b550 tx=0x7f22e000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.831+0000 7f22df7fe700 1 -- 172.21.15.37:0/1831067983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0015020 con 0x7f22e810a930 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.831+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e81aef60 con 0x7f22e810a930 2024-05-09T01:08:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.831+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e807ba20 con 0x7f22e810a930 2024-05-09T01:08:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.831+0000 7f22df7fe700 1 -- 172.21.15.37:0/1831067983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22e0011ce0 con 0x7f22e810a930 2024-05-09T01:08:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.832+0000 7f22df7fe700 1 -- 172.21.15.37:0/1831067983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0010d30 con 0x7f22e810a930 2024-05-09T01:08:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.839+0000 7f22df7fe700 1 -- 172.21.15.37:0/1831067983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f22e0018020 con 0x7f22e810a930 2024-05-09T01:08:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.840+0000 7f22df7fe700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f22d40b28c0 0x7f22d40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.840+0000 7f22df7fe700 1 -- 172.21.15.37:0/1831067983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f22e00e27f0 con 0x7f22e810a930 2024-05-09T01:08:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.841+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f22d40b28c0 0x7f22d40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.842+0000 7f22fb311b80 1 Processor -- start 2024-05-09T01:08:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.844+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f22d40b28c0 0x7f22d40b4dd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f22e8120230 tx=0x7f22d80094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.844+0000 7f22fb311b80 1 -- start start 2024-05-09T01:08:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.845+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.845+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a22a4a0 0x55574a3ada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.845+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a3a76a0 0x55574a3a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.845+0000 7f22e659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.845+0000 7f22e5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a22a4a0 0x55574a3ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.845+0000 7f22e659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ad4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55492/0 (socket says 172.21.15.37:55492) 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.846+0000 7f22e5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a22a4a0 0x55574a3ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42742/0 (socket says 172.21.15.37:42742) 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.846+0000 7f22e659c700 1 -- 172.21.15.37:0/3515094639 learned_addr learned my addr 172.21.15.37:0/3515094639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.846+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a3a76a0 0x55574a3a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.846+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55574a2c9ff0 con 0x55574a3a76a0 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.846+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55574a2687f0 con 0x55574a314160 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.846+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55574a2c5fb0 con 0x55574a22a4a0 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.847+0000 7f22e6d9d700 1 -- 172.21.15.37:0/3515094639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a22a4a0 msgr2=0x55574a3ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.847+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a22a4a0 0x55574a3ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.847+0000 7f22e6d9d700 1 -- 172.21.15.37:0/3515094639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 msgr2=0x55574a3ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.847+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.847+0000 7f22e6d9d700 1 -- 172.21.15.37:0/3515094639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55574a260370 con 0x55574a3a76a0 2024-05-09T01:08:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.849+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a3a76a0 0x55574a3a7ad0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd650cd814ef052 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.852+0000 7f22dcff9700 1 -- 172.21.15.37:0/3515094639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0003bb0 con 0x55574a3a76a0 2024-05-09T01:08:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.852+0000 7f22dcff9700 1 -- 172.21.15.37:0/3515094639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d0003d50 con 0x55574a3a76a0 2024-05-09T01:08:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.852+0000 7f22dcff9700 1 -- 172.21.15.37:0/3515094639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d000f460 con 0x55574a3a76a0 2024-05-09T01:08:59.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.853+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a3a76a0 msgr2=0x55574a3a7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.853+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a3a76a0 0x55574a3a7ad0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d000b560 comp rx=0 tx=0).stop 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.853+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 shutdown_connections 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.853+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a3a76a0 0x55574a3a7ad0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.853+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.853+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3515094639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a22a4a0 0x55574a3ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.854+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 >> 172.21.15.37:0/3515094639 conn(0x55574a28a6a0 msgr2=0x55574a3a2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.854+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 shutdown_connections 2024-05-09T01:08:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.854+0000 7f22fb311b80 1 -- 172.21.15.37:0/3515094639 wait complete. 2024-05-09T01:08:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.855+0000 7f22fb311b80 1 -- start start 2024-05-09T01:08:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.856+0000 7f22fb311b80 1 Processor -- start 2024-05-09T01:08:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.856+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22fb311b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55574a145ba0 con 0x55574a22a4a0 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22fb311b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55574a284150 con 0x55574a314160 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22fb311b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55574a3b41d0 con 0x55574a3a76a0 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22fb311b80 10 client.0 _ll_register_callbacks cb 0x55574a13b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e5d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55508/0 (socket says 172.21.15.37:55508) 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e5d9b700 1 -- 172.21.15.37:0/4253763629 learned_addr learned my addr 172.21.15.37:0/4253763629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e6d9d700 1 -- 172.21.15.37:0/4253763629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 msgr2=0x55574a3b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e6d9d700 1 -- 172.21.15.37:0/4253763629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 msgr2=0x55574a3b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.857+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.858+0000 7f22e6d9d700 1 -- 172.21.15.37:0/4253763629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55574a145490 con 0x55574a3a76a0 2024-05-09T01:08:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.858+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3b1b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d000bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb7e650cc0425ece server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.858+0000 7f22cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:08:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.859+0000 7f22cdffb700 1 -- 172.21.15.37:0/4253763629 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0030060 con 0x55574a3a76a0 2024-05-09T01:08:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.859+0000 7f22cdffb700 1 -- 172.21.15.37:0/4253763629 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f22d0005110 con 0x55574a3a76a0 2024-05-09T01:08:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.859+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d0003d50 con 0x55574a3a76a0 2024-05-09T01:08:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.859+0000 7f22cdffb700 1 -- 172.21.15.37:0/4253763629 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f22d0005310 con 0x55574a3a76a0 2024-05-09T01:08:59.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.859+0000 7f22fb311b80 10 client.26191 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.859+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55574a3be940 con 0x55574a3a76a0 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.859+0000 7f22cdffb700 1 -- 172.21.15.37:0/4253763629 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d0003d50 con 0x55574a3a76a0 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.860+0000 7f22cdffb700 1 -- 172.21.15.37:0/4253763629 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f22d0021020 con 0x55574a3a76a0 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.860+0000 7f22fb311b80 10 client.26191 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.860+0000 7f22fb311b80 10 client.26191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.860+0000 7f22fb311b80 20 client.26191 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.860+0000 7f22fb311b80 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a3c0e10 0x55574a3c3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.860+0000 7f22fb311b80 4 client.26191 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:08:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.860+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55574a2d79d0 con 0x55574a3c0e10 2024-05-09T01:08:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.861+0000 7f22e659c700 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a3c0e10 0x55574a3c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.861+0000 7f22cdffb700 10 client.26191 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.861+0000 7f22e659c700 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a3c0e10 0x55574a3c3230 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e1b2cd79c31a1 server_cookie=8562629de6e96e63 in_seq=0 out_seq=0 2024-05-09T01:08:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.862+0000 7f22cdffb700 1 -- 172.21.15.37:0/4253763629 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55574a2d79d0 con 0x55574a3c0e10 2024-05-09T01:08:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.862+0000 7f22cdffb700 10 client.26191 handle_command_reply: tid=0 2024-05-09T01:08:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.862+0000 7f22fb311b80 1 client.26191 shutdown 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 msgr2=0x55574a3b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3b1b30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d000bd20 comp rx=0 tx=0).stop 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 shutdown_connections 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a3c0e10 0x55574a3c3230 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3b1b30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 --2- 172.21.15.37:0/4253763629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 >> 172.21.15.37:0/4253763629 conn(0x55574a28a6a0 msgr2=0x55574a3a21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22cdffb700 0 client.26191 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.863+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 shutdown_connections 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.864+0000 7f22fb311b80 1 -- 172.21.15.37:0/4253763629 wait complete. 2024-05-09T01:08:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.864+0000 7f22fb311b80 20 client.26191 trim_cache size 0 max 16384 2024-05-09T01:08:59.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.893+0000 7f22fb311b80 1 Processor -- start 2024-05-09T01:08:59.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.893+0000 7f22fb311b80 1 -- start start 2024-05-09T01:08:59.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.893+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3bd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.893+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.893+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3a6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22fb311b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22c800d260 con 0x55574a22a4a0 2024-05-09T01:08:59.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22fb311b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f22c800eda0 con 0x55574a314160 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22fb311b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22c800d930 con 0x55574a3a76a0 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3bd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42230/0 (socket says 172.21.15.37:42230) 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 -- 172.21.15.37:0/3937382638 learned_addr learned my addr 172.21.15.37:0/3937382638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 -- 172.21.15.37:0/3937382638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 msgr2=0x55574a3a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 -- 172.21.15.37:0/3937382638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 msgr2=0x55574a3ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 -- 172.21.15.37:0/3937382638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55574a3a7e20 con 0x55574a22a4a0 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22e659c700 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3bd430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f22e00a9df0 tx=0x7f22e00e0260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c5a8d31c877e65 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:59.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.894+0000 7f22cffff700 1 -- 172.21.15.37:0/3937382638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e00a9eb0 con 0x55574a22a4a0 2024-05-09T01:08:59.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.895+0000 7f22cffff700 1 -- 172.21.15.37:0/3937382638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55574a2d79d0 con 0x55574a22a4a0 2024-05-09T01:08:59.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.895+0000 7f22cffff700 1 -- 172.21.15.37:0/3937382638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e0010380 con 0x55574a22a4a0 2024-05-09T01:08:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.895+0000 7f22fb311b80 1 -- 172.21.15.37:0/3937382638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 msgr2=0x55574a3bd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.895+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3bd430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f22e00a9df0 tx=0x7f22e00e0260 comp rx=0 tx=0).stop 2024-05-09T01:08:59.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 -- 172.21.15.37:0/3937382638 shutdown_connections 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a3a76a0 0x55574a3a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3bd430 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3937382638 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a314160 0x55574a3ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 -- 172.21.15.37:0/3937382638 >> 172.21.15.37:0/3937382638 conn(0x55574a28a6a0 msgr2=0x55574a3aae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 -- 172.21.15.37:0/3937382638 shutdown_connections 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 -- 172.21.15.37:0/3937382638 wait complete. 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 -- start start 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.896+0000 7f22fb311b80 1 Processor -- start 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a314160 0x55574a3c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22fb311b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a3a76a0 0x55574a3c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22fb311b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22c800e6d0 con 0x55574a22a4a0 2024-05-09T01:08:59.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22fb311b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f22c800e000 con 0x55574a3a76a0 2024-05-09T01:08:59.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42244/0 (socket says 172.21.15.37:42244) 2024-05-09T01:08:59.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22fb311b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22c800b200 con 0x55574a314160 2024-05-09T01:08:59.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e659c700 1 -- 172.21.15.37:0/3177119029 learned_addr learned my addr 172.21.15.37:0/3177119029 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:08:59.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a314160 0x55574a3c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e6d9d700 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a3a76a0 0x55574a3c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22fb311b80 10 client.0 _ll_register_callbacks cb 0x55574a13b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:08:59.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e5d9b700 1 -- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a3a76a0 msgr2=0x55574a3c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a3a76a0 0x55574a3c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e5d9b700 1 -- 172.21.15.37:0/3177119029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 msgr2=0x55574a3c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:08:59.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.897+0000 7f22e5d9b700 1 -- 172.21.15.37:0/3177119029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55574a3c45f0 con 0x55574a314160 2024-05-09T01:08:59.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.898+0000 7f22e5d9b700 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a314160 0x55574a3c3a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009d00 tx=0x7f22d8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf0463ff96740b31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:08:59.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.898+0000 7f22cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.898+0000 7f22cdffb700 1 -- 172.21.15.37:0/3177119029 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d802b020 con 0x55574a314160 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.898+0000 7f22cdffb700 1 -- 172.21.15.37:0/3177119029 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f22d8016990 con 0x55574a314160 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.898+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55574a2d79d0 con 0x55574a314160 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.899+0000 7f22cdffb700 1 -- 172.21.15.37:0/3177119029 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f22d800ce60 con 0x55574a314160 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.899+0000 7f22fb311b80 10 client.26197 fetch_fsmap learned FSMap version 39 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.899+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55574a42b130 con 0x55574a314160 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22cdffb700 1 -- 172.21.15.37:0/3177119029 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22d8016b90 con 0x55574a314160 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22cdffb700 1 -- 172.21.15.37:0/3177119029 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f22d8025410 con 0x55574a314160 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22fb311b80 10 client.26197 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22fb311b80 10 client.26197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22fb311b80 20 client.26197 populate_metadata read hostname 'smithi037' 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a42b840 0x55574a42dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:08:59.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22fb311b80 4 client.26197 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55574a2d79d0 con 0x55574a42b840 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.900+0000 7f22e659c700 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a42b840 0x55574a42dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.901+0000 7f22cdffb700 10 client.26197 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.902+0000 7f22e659c700 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a42b840 0x55574a42dc60 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=747e704c60055b5a server_cookie=f089f732a16414f7 in_seq=0 out_seq=0 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.902+0000 7f22cdffb700 1 -- 172.21.15.37:0/3177119029 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55574a2d79d0 con 0x55574a42b840 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.902+0000 7f22cdffb700 10 client.26197 handle_command_reply: tid=0 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.902+0000 7f22fb311b80 1 client.26197 shutdown 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a314160 msgr2=0x55574a3c3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a314160 0x55574a3c3a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009d00 tx=0x7f22d8004ad0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 shutdown_connections 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55574a42b840 0x55574a42dc60 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55574a3a76a0 0x55574a3c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55574a22a4a0 0x55574a3c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22cdffb700 0 client.26197 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 --2- 172.21.15.37:0/3177119029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55574a314160 0x55574a3c3a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 >> 172.21.15.37:0/3177119029 conn(0x55574a28a6a0 msgr2=0x55574a3ab590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 shutdown_connections 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 1 -- 172.21.15.37:0/3177119029 wait complete. 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.903+0000 7f22fb311b80 20 client.26197 trim_cache size 0 max 16384 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:08:59.908 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:08:59.909 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:08:59.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f22d40b28c0 msgr2=0x7f22d40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f22d40b28c0 0x7f22d40b4dd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f22e8120230 tx=0x7f22d80094f0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810a930 msgr2=0x7f22e81a9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:08:59.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810a930 0x7f22e81a9da0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f22e000b550 tx=0x7f22e000b860 comp rx=0 tx=0).stop 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 shutdown_connections 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f22d40b28c0 0x7f22d40b4dd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e811d930 0x7f22e81ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e810a930 0x7f22e81a9da0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 --2- 172.21.15.37:0/1831067983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e810b280 0x7f22e81aa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.904+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 >> 172.21.15.37:0/1831067983 conn(0x7f22e806f4d0 msgr2=0x7f22e811b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.905+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 shutdown_connections 2024-05-09T01:08:59.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:08:59.905+0000 7f22ec8fb700 1 -- 172.21.15.37:0/1831067983 wait complete. 2024-05-09T01:09:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 400.0 s, 1689.8 tps, lat 59.204 ms stddev 64.114 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 -- 172.21.15.37:0/4226286126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 msgr2=0x7f3ae410bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 --2- 172.21.15.37:0/4226286126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 0x7f3ae410bfe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009be0 tx=0x7f3adc02a6c0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 -- 172.21.15.37:0/4226286126 shutdown_connections 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 --2- 172.21.15.37:0/4226286126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 0x7f3ae410bfe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 --2- 172.21.15.37:0/4226286126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae4104ec0 0x7f3ae41052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 --2- 172.21.15.37:0/4226286126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 0x7f3ae4104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 -- 172.21.15.37:0/4226286126 >> 172.21.15.37:0/4226286126 conn(0x7f3ae40fee50 msgr2=0x7f3ae4101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 -- 172.21.15.37:0/4226286126 shutdown_connections 2024-05-09T01:09:00.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.293+0000 7f3aec62b640 1 -- 172.21.15.37:0/4226286126 wait complete. 2024-05-09T01:09:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.294+0000 7f3aec62b640 1 Processor -- start 2024-05-09T01:09:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.294+0000 7f3aec62b640 1 -- start start 2024-05-09T01:09:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aec62b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 0x7f3ae419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aec62b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae4104ec0 0x7f3ae419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aec62b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 0x7f3ae41a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aec62b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae410f790 con 0x7f3ae4103c80 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aec62b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae410f610 con 0x7f3ae4109bc0 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aec62b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae410f910 con 0x7f3ae4104ec0 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 0x7f3ae419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 0x7f3ae419a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42260/0 (socket says 172.21.15.37:42260) 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1007582311 learned_addr learned my addr 172.21.15.37:0/1007582311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.295+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae4104ec0 0x7f3ae419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 0x7f3ae41a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1007582311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae4104ec0 msgr2=0x7f3ae419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae4104ec0 0x7f3ae419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1007582311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 msgr2=0x7f3ae41a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 0x7f3ae41a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1007582311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae4074f00 con 0x7f3ae4103c80 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 0x7f3ae41a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:09:00.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 0x7f3ae419a360 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000e9f0 tx=0x7f3ae000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3adb7fe640 1 -- 172.21.15.37:0/1007582311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000ccc0 con 0x7f3ae4103c80 2024-05-09T01:09:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3adb7fe640 1 -- 172.21.15.37:0/1007582311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae00035f0 con 0x7f3ae4103c80 2024-05-09T01:09:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.296+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae40751f0 con 0x7f3ae4103c80 2024-05-09T01:09:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.297+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae4075730 con 0x7f3ae4103c80 2024-05-09T01:09:00.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.297+0000 7f3adb7fe640 1 -- 172.21.15.37:0/1007582311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000ce60 con 0x7f3ae4103c80 2024-05-09T01:09:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.300+0000 7f3af35be740 1 Processor -- start 2024-05-09T01:09:00.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.300+0000 7f3af35be740 1 -- start start 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3af35be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c70415500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3af35be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700482f0 0x556c70415a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3af35be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700504d0 0x556c7041c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3af35be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c703797c0 con 0x556c700711b0 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3af35be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556c703150e0 con 0x556c700482f0 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3af35be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556c70375780 con 0x556c700504d0 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3ae9bc6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700504d0 0x556c7041c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3aeabc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c70415500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3ae9bc6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700504d0 0x556c7041c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42810/0 (socket says 172.21.15.37:42810) 2024-05-09T01:09:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3ae9bc6640 1 -- 172.21.15.37:0/3535087003 learned_addr learned my addr 172.21.15.37:0/3535087003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:00.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.301+0000 7f3adb7fe640 1 -- 172.21.15.37:0/1007582311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3ae0003aa0 con 0x7f3ae4103c80 2024-05-09T01:09:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700482f0 0x556c70415a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3ae9bc6640 1 -- 172.21.15.37:0/3535087003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700482f0 msgr2=0x556c70415a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700482f0 0x556c70415a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3ae9bc6640 1 -- 172.21.15.37:0/3535087003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 msgr2=0x556c70415500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c70415500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3ae9bc6640 1 -- 172.21.15.37:0/3535087003 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c7033e7c0 con 0x556c700504d0 2024-05-09T01:09:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700482f0 0x556c70415a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:09:00.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700504d0 0x556c7041c980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009c80 tx=0x7f3ad4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f79b751023274c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.303+0000 7f3ad8bfe640 1 -- 172.21.15.37:0/3535087003 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4004220 con 0x556c700504d0 2024-05-09T01:09:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.304+0000 7f3ad8bfe640 1 -- 172.21.15.37:0/3535087003 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ad40043c0 con 0x556c700504d0 2024-05-09T01:09:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.304+0000 7f3ad8bfe640 1 -- 172.21.15.37:0/3535087003 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40197b0 con 0x556c700504d0 2024-05-09T01:09:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.304+0000 7f3adb7fe640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ad00b2860 0x7f3ad00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.304+0000 7f3adb7fe640 1 -- 172.21.15.37:0/1007582311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3ae00e2550 con 0x7f3ae4103c80 2024-05-09T01:09:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.304+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ad00b2860 0x7f3ad00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 -- 172.21.15.37:0/3535087003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700504d0 msgr2=0x556c7041c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700504d0 0x556c7041c980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009c80 tx=0x7f3ad4011810 comp rx=0 tx=0).stop 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ad00b2860 0x7f3ad00b4d70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3adc004af0 tx=0x7f3adc0308a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 -- 172.21.15.37:0/3535087003 shutdown_connections 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700504d0 0x556c7041c980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700482f0 0x556c70415a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 --2- 172.21.15.37:0/3535087003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c70415500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 -- 172.21.15.37:0/3535087003 >> 172.21.15.37:0/3535087003 conn(0x556c70065300 msgr2=0x556c70410e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 -- 172.21.15.37:0/3535087003 shutdown_connections 2024-05-09T01:09:00.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.305+0000 7f3af35be740 1 -- 172.21.15.37:0/3535087003 wait complete. 2024-05-09T01:09:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.306+0000 7f3af35be740 1 -- start start 2024-05-09T01:09:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.306+0000 7f3af35be740 1 Processor -- start 2024-05-09T01:09:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.306+0000 7f3af35be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.306+0000 7f3af35be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c7041f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.306+0000 7f3af35be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c704266b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.306+0000 7f3af35be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c7041d3d0 con 0x556c700711b0 2024-05-09T01:09:00.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3af35be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556c703009c0 con 0x556c700504d0 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.306+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3af35be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556c7041d550 con 0x556c700482f0 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42822/0 (socket says 172.21.15.37:42822) 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1869608090 learned_addr learned my addr 172.21.15.37:0/1869608090 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c7041f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3af35be740 10 client.0 _ll_register_callbacks cb 0x556c7032d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c704266b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 msgr2=0x556c7041f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c7041f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1869608090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 msgr2=0x556c704266b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c704266b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1869608090 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c703271f0 con 0x556c700482f0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00a5bf0 tx=0x7f3ae00a97c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78a73c3a742b1c6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3acdffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3acdffb640 1 -- 172.21.15.37:0/1869608090 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00adf20 con 0x556c700482f0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3acdffb640 1 -- 172.21.15.37:0/1869608090 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3ae00e20d0 con 0x556c700482f0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.307+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ad40043c0 con 0x556c700482f0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3acdffb640 1 -- 172.21.15.37:0/1869608090 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3ae00b29d0 con 0x556c700482f0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3af35be740 10 client.26209 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556c700dc790 con 0x556c700482f0 2024-05-09T01:09:00.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3acdffb640 1 -- 172.21.15.37:0/1869608090 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ad40043c0 con 0x556c700482f0 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3acdffb640 1 -- 172.21.15.37:0/1869608090 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f3ae00a54e0 con 0x556c700482f0 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3af35be740 10 client.26209 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3af35be740 10 client.26209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3af35be740 20 client.26209 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.308+0000 7f3af35be740 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c7002fd80 0x556c7042cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.309+0000 7f3af35be740 4 client.26209 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.309+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c703873d0 con 0x556c7002fd80 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.309+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c7002fd80 0x556c7042cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.310+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c7002fd80 0x556c7042cb10 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5363f629c1de0247 server_cookie=77a74b6d31f69922 in_seq=0 out_seq=0 2024-05-09T01:09:00.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.310+0000 7f3acdffb640 10 client.26209 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:00.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3acdffb640 1 -- 172.21.15.37:0/1869608090 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556c703873d0 con 0x556c7002fd80 2024-05-09T01:09:00.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3acdffb640 10 client.26209 handle_command_reply: tid=0 2024-05-09T01:09:00.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 client.26209 shutdown 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 msgr2=0x556c7041f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00a5bf0 tx=0x7f3ae00a97c0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 shutdown_connections 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c7002fd80 0x556c7042cb10 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700711b0 0x556c704266b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c7041f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 --2- 172.21.15.37:0/1869608090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3acdffb640 0 client.26209 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 >> 172.21.15.37:0/1869608090 conn(0x556c70065300 msgr2=0x556c70413da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 shutdown_connections 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 1 -- 172.21.15.37:0/1869608090 wait complete. 2024-05-09T01:09:00.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.311+0000 7f3af35be740 20 client.26209 trim_cache size 0 max 16384 2024-05-09T01:09:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.333+0000 7f3af35be740 1 Processor -- start 2024-05-09T01:09:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.333+0000 7f3af35be740 1 -- start start 2024-05-09T01:09:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.333+0000 7f3af35be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.333+0000 7f3af35be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700504d0 0x556c70426640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3af35be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700711b0 0x556c70431300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3af35be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41ad420 con 0x556c700504d0 2024-05-09T01:09:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3af35be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41aef60 con 0x556c700711b0 2024-05-09T01:09:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3af35be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41adaf0 con 0x556c700482f0 2024-05-09T01:09:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3ae9bc6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700504d0 0x556c70426640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42838/0 (socket says 172.21.15.37:42838) 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1383873185 learned_addr learned my addr 172.21.15.37:0/1383873185 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700504d0 0x556c70426640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42292/0 (socket says 172.21.15.37:42292) 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700711b0 0x556c70431300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1383873185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700711b0 msgr2=0x556c70431300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700711b0 0x556c70431300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1383873185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700504d0 msgr2=0x556c70426640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700504d0 0x556c70426640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 -- 172.21.15.37:0/1383873185 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c701535f0 con 0x556c700482f0 2024-05-09T01:09:00.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700504d0 0x556c70426640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:09:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.334+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f4f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00e27f0 tx=0x7f3ae000c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9852a95e54c708f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.335+0000 7f3acffff640 1 -- 172.21.15.37:0/1383873185 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00a5a30 con 0x556c700482f0 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.335+0000 7f3acffff640 1 -- 172.21.15.37:0/1383873185 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae00c41a0 con 0x556c700482f0 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.335+0000 7f3acffff640 1 -- 172.21.15.37:0/1383873185 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae00b27a0 con 0x556c700482f0 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 -- 172.21.15.37:0/1383873185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 msgr2=0x556c7041f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f4f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00e27f0 tx=0x7f3ae000c840 comp rx=0 tx=0).stop 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 -- 172.21.15.37:0/1383873185 shutdown_connections 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700711b0 0x556c70431300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700504d0 0x556c70426640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 --2- 172.21.15.37:0/1383873185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700482f0 0x556c7041f4f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 -- 172.21.15.37:0/1383873185 >> 172.21.15.37:0/1383873185 conn(0x556c70065300 msgr2=0x556c7041ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 -- 172.21.15.37:0/1383873185 shutdown_connections 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 -- 172.21.15.37:0/1383873185 wait complete. 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 -- start start 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 Processor -- start 2024-05-09T01:09:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.336+0000 7f3af35be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700482f0 0x556c704238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3af35be740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c70423df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3af35be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700711b0 0x556c70424d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3af35be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41ae890 con 0x556c700482f0 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3af35be740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41ae1c0 con 0x556c700504d0 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3af35be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae41ab400 con 0x556c700711b0 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3af35be740 10 client.0 _ll_register_callbacks cb 0x7f3ae00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700482f0 0x556c704238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aea3c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700482f0 0x556c704238b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42300/0 (socket says 172.21.15.37:42300) 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aeabc8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700711b0 0x556c70424d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aea3c7640 1 -- 172.21.15.37:0/157596321 learned_addr learned my addr 172.21.15.37:0/157596321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3ae9bc6640 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c70423df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aeabc8640 1 -- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 msgr2=0x556c70423df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c70423df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aeabc8640 1 -- 172.21.15.37:0/157596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700482f0 msgr2=0x556c704238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700482f0 0x556c704238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aeabc8640 1 -- 172.21.15.37:0/157596321 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c7033ded0 con 0x556c700711b0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700482f0 0x556c704238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3aeabc8640 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700711b0 0x556c70424d20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3adc006010 tx=0x7f3adc02a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cfb70840b437821 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.337+0000 7f3acdffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3acdffb640 1 -- 172.21.15.37:0/157596321 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3adc036050 con 0x556c700711b0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3acdffb640 1 -- 172.21.15.37:0/157596321 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3adc004450 con 0x556c700711b0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ae00c41a0 con 0x556c700711b0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3acdffb640 1 -- 172.21.15.37:0/157596321 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3adc05a050 con 0x556c700711b0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 10 client.26215 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556c70426410 con 0x556c700711b0 2024-05-09T01:09:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3acdffb640 1 -- 172.21.15.37:0/157596321 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ae00c41a0 con 0x556c700711b0 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3acdffb640 1 -- 172.21.15.37:0/157596321 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f3adc03c040 con 0x556c700711b0 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 10 client.26215 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 10 client.26215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 20 client.26215 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c700051c0 0x556c704971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 4 client.26215 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.338+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c70381240 con 0x556c700051c0 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.339+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c700051c0 0x556c704971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.339+0000 7f3acdffb640 10 client.26215 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:00.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.339+0000 7f3aea3c7640 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c700051c0 0x556c704971a0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3613331874b30959 server_cookie=daf75d3f603be3f3 in_seq=0 out_seq=0 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.347+0000 7f3acdffb640 1 -- 172.21.15.37:0/157596321 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x556c70381240 con 0x556c700051c0 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.347+0000 7f3acdffb640 10 client.26215 handle_command_reply: tid=0 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.347+0000 7f3af35be740 1 client.26215 shutdown 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.347+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700711b0 msgr2=0x556c70424d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.347+0000 7f3af35be740 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700711b0 0x556c70424d20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3adc006010 tx=0x7f3adc02a6c0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 shutdown_connections 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x556c700051c0 0x556c704971a0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c700711b0 0x556c70424d20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3acdffb640 0 client.26215 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c700504d0 0x556c70423df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 --2- 172.21.15.37:0/157596321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c700482f0 0x556c704238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 >> 172.21.15.37:0/157596321 conn(0x556c70065300 msgr2=0x556c70413d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 shutdown_connections 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 1 -- 172.21.15.37:0/157596321 wait complete. 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3af35be740 20 client.26215 trim_cache size 0 max 16384 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:09:00.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:09:00.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ad00b2860 msgr2=0x7f3ad00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3aec62b640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ad00b2860 0x7f3ad00b4d70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3adc004af0 tx=0x7f3adc0308a0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 msgr2=0x7f3ae419a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3aec62b640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 0x7f3ae419a360 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000e9f0 tx=0x7f3ae000eeb0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 shutdown_connections 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.348+0000 7f3aec62b640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ad00b2860 0x7f3ad00b4d70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.349+0000 7f3aec62b640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ae4109bc0 0x7f3ae41a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.349+0000 7f3aec62b640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae4104ec0 0x7f3ae419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.349+0000 7f3aec62b640 1 --2- 172.21.15.37:0/1007582311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae4103c80 0x7f3ae419a360 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.349+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 >> 172.21.15.37:0/1007582311 conn(0x7f3ae40fee50 msgr2=0x7f3ae4105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.349+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 shutdown_connections 2024-05-09T01:09:00.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:00.349+0000 7f3aec62b640 1 -- 172.21.15.37:0/1007582311 wait complete. 2024-05-09T01:09:00.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:00 smithi136 ceph-mon[34110]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 648 op/s 2024-05-09T01:09:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:00 smithi037 ceph-mon[30122]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 648 op/s 2024-05-09T01:09:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:00 smithi151 ceph-mon[34780]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 648 op/s 2024-05-09T01:09:00.921 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:09:00.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:09:01.300 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:02 smithi136 ceph-mon[34110]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 802 op/s 2024-05-09T01:09:02.695 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:02 smithi037 ceph-mon[30122]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 802 op/s 2024-05-09T01:09:02.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:02 smithi151 ceph-mon[34780]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 MiB/s wr, 802 op/s 2024-05-09T01:09:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.400+0000 7f72d3a81700 1 -- 172.21.15.37:0/952532254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 msgr2=0x7f72cc10ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.400+0000 7f72d3a81700 1 --2- 172.21.15.37:0/952532254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 0x7f72cc10ad80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009990 tx=0x7f72bc009ca0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.406+0000 7f72d3a81700 1 -- 172.21.15.37:0/952532254 shutdown_connections 2024-05-09T01:09:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.406+0000 7f72d3a81700 1 --2- 172.21.15.37:0/952532254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc10b2c0 0x7f72cc117840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.406+0000 7f72d3a81700 1 --2- 172.21.15.37:0/952532254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72cc1109a0 0x7f72cc110db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.406+0000 7f72d3a81700 1 --2- 172.21.15.37:0/952532254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 0x7f72cc10ad80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.406+0000 7f72d3a81700 1 -- 172.21.15.37:0/952532254 >> 172.21.15.37:0/952532254 conn(0x7f72cc076cc0 msgr2=0x7f72cc0770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.411+0000 7f72d3a81700 1 -- 172.21.15.37:0/952532254 shutdown_connections 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.411+0000 7f72d3a81700 1 -- 172.21.15.37:0/952532254 wait complete. 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 Processor -- start 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 -- start start 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 0x7f72cc0841f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72cc10b2c0 0x7f72cc07d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc1109a0 0x7f72cc07d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc11aaa0 con 0x7f72cc10a970 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc11a920 con 0x7f72cc1109a0 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.412+0000 7f72d3a81700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc11ac20 con 0x7f72cc10b2c0 2024-05-09T01:09:03.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc1109a0 0x7f72cc07d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc1109a0 0x7f72cc07d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55368/0 (socket says 172.21.15.37:55368) 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 -- 172.21.15.37:0/276548663 learned_addr learned my addr 172.21.15.37:0/276548663 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d181d700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 0x7f72cc0841f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 -- 172.21.15.37:0/276548663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72cc10b2c0 msgr2=0x7f72cc07d320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72cc10b2c0 0x7f72cc07d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 -- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 msgr2=0x7f72cc0841f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 0x7f72cc0841f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.416+0000 7f72d201e700 1 -- 172.21.15.37:0/276548663 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc081d20 con 0x7f72cc1109a0 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.417+0000 7f72d201e700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc1109a0 0x7f72cc07d950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72c400ef30 tx=0x7f72c400c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.418+0000 7f72c2ffd700 1 -- 172.21.15.37:0/276548663 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40092e0 con 0x7f72cc1109a0 2024-05-09T01:09:03.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.418+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc081fb0 con 0x7f72cc1109a0 2024-05-09T01:09:03.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.418+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc0824f0 con 0x7f72cc1109a0 2024-05-09T01:09:03.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.419+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72cc10c0b0 con 0x7f72cc1109a0 2024-05-09T01:09:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.420+0000 7f72c2ffd700 1 -- 172.21.15.37:0/276548663 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72c4004bb0 con 0x7f72cc1109a0 2024-05-09T01:09:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.420+0000 7f72c2ffd700 1 -- 172.21.15.37:0/276548663 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4004280 con 0x7f72cc1109a0 2024-05-09T01:09:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.428+0000 7f72c2ffd700 1 -- 172.21.15.37:0/276548663 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f72c401b030 con 0x7f72cc1109a0 2024-05-09T01:09:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.429+0000 7f72c2ffd700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f72b80b2900 0x7f72b80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.430+0000 7f72c2ffd700 1 -- 172.21.15.37:0/276548663 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f72c40e2b60 con 0x7f72cc1109a0 2024-05-09T01:09:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.430+0000 7f72d181d700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f72b80b2900 0x7f72b80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:03.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.431+0000 7f72d181d700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f72b80b2900 0x7f72b80b4e10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f72cc07eb70 tx=0x7f72c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:03.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.433+0000 7f72c2ffd700 1 -- 172.21.15.37:0/276548663 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f72c4022020 con 0x7f72cc1109a0 2024-05-09T01:09:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.879+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72cc07e850 con 0x7f72cc1109a0 2024-05-09T01:09:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.880+0000 7f72c2ffd700 1 -- 172.21.15.37:0/276548663 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11936 (secure 0 0 0) 0x7f72c4010040 con 0x7f72cc1109a0 2024-05-09T01:09:03.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:09:03.881 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:07:28.918612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24454,24491,24445,24446,24467]},"id":1}]} 2024-05-09T01:09:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.883+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f72b80b2900 msgr2=0x7f72b80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.883+0000 7f72d3a81700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f72b80b2900 0x7f72b80b4e10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f72cc07eb70 tx=0x7f72c8009260 comp rx=0 tx=0).stop 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.883+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc1109a0 msgr2=0x7f72cc07d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.883+0000 7f72d3a81700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc1109a0 0x7f72cc07d950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f72c400ef30 tx=0x7f72c400c450 comp rx=0 tx=0).stop 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.883+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 shutdown_connections 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.884+0000 7f72d3a81700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f72b80b2900 0x7f72b80b4e10 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f72cc07eb70 tx=0x7f72c8009260 comp rx=0 tx=0).stop 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.884+0000 7f72d3a81700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72cc1109a0 0x7f72cc07d950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.884+0000 7f72d3a81700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72cc10a970 0x7f72cc0841f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.884+0000 7f72d3a81700 1 --2- 172.21.15.37:0/276548663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72cc10b2c0 0x7f72cc07d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.884+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 >> 172.21.15.37:0/276548663 conn(0x7f72cc076cc0 msgr2=0x7f72cc1088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:03.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.885+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 shutdown_connections 2024-05-09T01:09:03.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:03.885+0000 7f72d3a81700 1 -- 172.21.15.37:0/276548663 wait complete. 2024-05-09T01:09:03.888 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2024-05-09T01:09:04.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:04 smithi037 ceph-mon[30122]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-05-09T01:09:04.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:04 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/276548663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:09:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:04 smithi136 ceph-mon[34110]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-05-09T01:09:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:04 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/276548663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:09:04.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:09:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:04 smithi151 ceph-mon[34780]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.2 MiB/s wr, 701 op/s 2024-05-09T01:09:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:04 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/276548663' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:09:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 405.0 s, 1967.4 tps, lat 50.969 ms stddev 59.695 2024-05-09T01:09:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:06 smithi037 ceph-mon[30122]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 715 op/s 2024-05-09T01:09:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:06 smithi151 ceph-mon[34780]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 715 op/s 2024-05-09T01:09:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:06 smithi136 ceph-mon[34110]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 715 op/s 2024-05-09T01:09:07.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.045+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/2828224925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b441102a0 msgr2=0x7f3b44117c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.045+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/2828224925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b441102a0 0x7f3b44117c00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c340 tx=0x7f3b3c00c650 comp rx=0 tx=0).stop 2024-05-09T01:09:07.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.050+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/2828224925 shutdown_connections 2024-05-09T01:09:07.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.050+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/2828224925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b441102a0 0x7f3b44117c00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.050+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/2828224925 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b4410b020 0x7f3b4410b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.050+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/2828224925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4410f950 0x7f3b4410fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.050+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/2828224925 >> 172.21.15.37:0/2828224925 conn(0x7f3b4406f990 msgr2=0x7f3b4406fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.056+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/2828224925 shutdown_connections 2024-05-09T01:09:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.056+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/2828224925 wait complete. 2024-05-09T01:09:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.057+0000 7f3b4c2c7700 1 Processor -- start 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.061+0000 7f3b4c2c7700 1 -- start start 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.061+0000 7f3b4c2c7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b4410b020 0x7f3b44113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.061+0000 7f3b4c2c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4410f950 0x7f3b44111ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.061+0000 7f3b4c2c7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b441102a0 0x7f3b44112280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.061+0000 7f3b4c2c7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4411ab40 con 0x7f3b4410f950 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.061+0000 7f3b4c2c7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4411a9c0 con 0x7f3b441102a0 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.061+0000 7f3b4c2c7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4411acc0 con 0x7f3b4410b020 2024-05-09T01:09:07.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.064+0000 7f3b4a864700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b441102a0 0x7f3b44112280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.066+0000 7f3b4a063700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b4410b020 0x7f3b44113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.066+0000 7f3b4a063700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b4410b020 0x7f3b44113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48446/0 (socket says 172.21.15.37:48446) 2024-05-09T01:09:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.066+0000 7f3b4a063700 1 -- 172.21.15.37:0/393930204 learned_addr learned my addr 172.21.15.37:0/393930204 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:07.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.068+0000 7f3b49862700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4410f950 0x7f3b44111ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.069+0000 7f3b4a063700 1 -- 172.21.15.37:0/393930204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b441102a0 msgr2=0x7f3b44112280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.069+0000 7f3b4a063700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b441102a0 0x7f3b44112280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.069+0000 7f3b4a063700 1 -- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4410f950 msgr2=0x7f3b44111ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.069+0000 7f3b4a063700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4410f950 0x7f3b44111ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.069+0000 7f3b4a063700 1 -- 172.21.15.37:0/393930204 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b44112ab0 con 0x7f3b4410b020 2024-05-09T01:09:07.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.070+0000 7f3b4a063700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b4410b020 0x7f3b44113840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400d980 tx=0x7f3b3400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.072+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/393930204 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34016070 con 0x7f3b4410b020 2024-05-09T01:09:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.072+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/393930204 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b3400fd40 con 0x7f3b4410b020 2024-05-09T01:09:07.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.072+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/393930204 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340093a0 con 0x7f3b4410b020 2024-05-09T01:09:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.075+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b441a7920 con 0x7f3b4410b020 2024-05-09T01:09:07.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.075+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b441a7de0 con 0x7f3b4410b020 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.083+0000 7f3b5acddb80 1 Processor -- start 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.086+0000 7f3b5acddb80 1 -- start start 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.086+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158c2a160 0x563158cc34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.086+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158b404a0 0x563158cc3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.086+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cbdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.086+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563158bdfff0 con 0x563158c2a160 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.086+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563158b7e7f0 con 0x563158b404a0 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.086+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563158bdbfb0 con 0x563158cbd6a0 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/393930204 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3b34019070 con 0x7f3b4410b020 2024-05-09T01:09:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158b404a0 0x563158cc3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158b404a0 0x563158cc3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55388/0 (socket says 172.21.15.37:55388) 2024-05-09T01:09:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 -- 172.21.15.37:0/4032617798 learned_addr learned my addr 172.21.15.37:0/4032617798 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b49862700 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cbdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 -- 172.21.15.37:0/4032617798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 msgr2=0x563158cbdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cbdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 -- 172.21.15.37:0/4032617798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158c2a160 msgr2=0x563158cc34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158c2a160 0x563158cc34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.087+0000 7f3b4a063700 1 -- 172.21.15.37:0/4032617798 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563158b76370 con 0x563158b404a0 2024-05-09T01:09:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.088+0000 7f3b4a063700 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158b404a0 0x563158cc3a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b340e7650 tx=0x7f3b340e7960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa3334e966e383c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.088+0000 7f3b38d47700 1 -- 172.21.15.37:0/4032617798 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340f5070 con 0x563158b404a0 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.088+0000 7f3b38d47700 1 -- 172.21.15.37:0/4032617798 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b340e1e30 con 0x563158b404a0 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.088+0000 7f3b38d47700 1 -- 172.21.15.37:0/4032617798 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340ed930 con 0x563158b404a0 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.089+0000 7f3b5acddb80 1 -- 172.21.15.37:0/4032617798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158b404a0 msgr2=0x563158cc3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.089+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158b404a0 0x563158cc3a30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b340e7650 tx=0x7f3b340e7960 comp rx=0 tx=0).stop 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.090+0000 7f3b5acddb80 1 -- 172.21.15.37:0/4032617798 shutdown_connections 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.090+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cbdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.090+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158c2a160 0x563158cc34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.090+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/4032617798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158b404a0 0x563158cc3a30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.090+0000 7f3b5acddb80 1 -- 172.21.15.37:0/4032617798 >> 172.21.15.37:0/4032617798 conn(0x563158ba06a0 msgr2=0x563158cb8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.090+0000 7f3b5acddb80 1 -- 172.21.15.37:0/4032617798 shutdown_connections 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.090+0000 7f3b5acddb80 1 -- 172.21.15.37:0/4032617798 wait complete. 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.091+0000 7f3b5acddb80 1 -- start start 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.091+0000 7f3b5acddb80 1 Processor -- start 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.091+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158b404a0 0x563158cc7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.091+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cc7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.091+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158cbd6a0 0x563158cc7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563158a5bba0 con 0x563158cbd6a0 2024-05-09T01:09:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563158b9a150 con 0x563158c2a160 2024-05-09T01:09:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563158cca1d0 con 0x563158b404a0 2024-05-09T01:09:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b4a063700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cc7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b4a063700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cc7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55394/0 (socket says 172.21.15.37:55394) 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b4a063700 1 -- 172.21.15.37:0/505854544 learned_addr learned my addr 172.21.15.37:0/505854544 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b4a864700 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158b404a0 0x563158cc7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.092+0000 7f3b5acddb80 10 client.0 _ll_register_callbacks cb 0x563158a516c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.093+0000 7f3b4a864700 1 -- 172.21.15.37:0/505854544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 msgr2=0x563158cc7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.093+0000 7f3b4a864700 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cc7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.093+0000 7f3b4a864700 1 -- 172.21.15.37:0/505854544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158cbd6a0 msgr2=0x563158cc7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.093+0000 7f3b4a864700 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158cbd6a0 0x563158cc7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.093+0000 7f3b4a864700 1 -- 172.21.15.37:0/505854544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563158a5b490 con 0x563158b404a0 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.093+0000 7f3b4a864700 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158b404a0 0x563158cc7240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c310 tx=0x7f3b3c0125c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6649d41758e0c4d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.093+0000 7f3b2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:07.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.094+0000 7f3b2dffb700 1 -- 172.21.15.37:0/505854544 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c021070 con 0x563158b404a0 2024-05-09T01:09:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.095+0000 7f3b2dffb700 1 -- 172.21.15.37:0/505854544 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3b3c012b40 con 0x563158b404a0 2024-05-09T01:09:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.095+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b340e1e30 con 0x563158b404a0 2024-05-09T01:09:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.095+0000 7f3b2dffb700 1 -- 172.21.15.37:0/505854544 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c02d050 con 0x563158b404a0 2024-05-09T01:09:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.095+0000 7f3b3b7fe700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b29a0 0x7f3b300b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.096+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/393930204 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3b340e15f0 con 0x7f3b4410b020 2024-05-09T01:09:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.096+0000 7f3b5acddb80 10 client.26230 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.096+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563158cd4cb0 con 0x563158b404a0 2024-05-09T01:09:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.096+0000 7f3b4a063700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b29a0 0x7f3b300b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b4a063700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b29a0 0x7f3b300b4eb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400b2d0 tx=0x7f3b340e71d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b2dffb700 1 -- 172.21.15.37:0/505854544 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b340e1e30 con 0x563158b404a0 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b2dffb700 1 -- 172.21.15.37:0/505854544 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f3b3c012070 con 0x563158b404a0 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b5acddb80 10 client.26230 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b5acddb80 10 client.26230 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b5acddb80 20 client.26230 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158cd7340 0x563158cd97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b5acddb80 4 client.26230 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563158bed9d0 con 0x563158cd7340 2024-05-09T01:09:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.098+0000 7f3b49862700 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158cd7340 0x563158cd97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.099+0000 7f3b2dffb700 10 client.26230 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:09:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.099+0000 7f3b49862700 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158cd7340 0x563158cd97b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c0b11e57d5bce1ef server_cookie=29ced6506d75d2f4 in_seq=0 out_seq=0 2024-05-09T01:09:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b2dffb700 1 -- 172.21.15.37:0/505854544 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563158bed9d0 con 0x563158cd7340 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b2dffb700 10 client.26230 handle_command_reply: tid=0 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 client.26230 shutdown 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158b404a0 msgr2=0x563158cc7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158b404a0 0x563158cc7240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c310 tx=0x7f3b3c0125c0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 shutdown_connections 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158cd7340 0x563158cd97b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158cbd6a0 0x563158cc7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158b404a0 0x563158cc7240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/505854544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cc7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b2dffb700 0 client.26230 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 >> 172.21.15.37:0/505854544 conn(0x563158ba06a0 msgr2=0x563158cb81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.100+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 shutdown_connections 2024-05-09T01:09:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.101+0000 7f3b5acddb80 1 -- 172.21.15.37:0/505854544 wait complete. 2024-05-09T01:09:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.101+0000 7f3b5acddb80 20 client.26230 trim_cache size 0 max 16384 2024-05-09T01:09:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 Processor -- start 2024-05-09T01:09:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 -- start start 2024-05-09T01:09:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158cd30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cd35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cc2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b441af220 con 0x563158b404a0 2024-05-09T01:09:07.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44076710 con 0x563158c2a160 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3b441af8f0 con 0x563158cbd6a0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b4a864700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158cd30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b4a864700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158cd30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41062/0 (socket says 172.21.15.37:41062) 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b4a864700 1 -- 172.21.15.37:0/3035906990 learned_addr learned my addr 172.21.15.37:0/3035906990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b49862700 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cd35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.129+0000 7f3b4a864700 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cc2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b4a864700 1 -- 172.21.15.37:0/3035906990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 msgr2=0x563158cc2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b4a864700 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cc2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b4a864700 1 -- 172.21.15.37:0/3035906990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 msgr2=0x563158cd35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b4a864700 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cd35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b4a864700 1 -- 172.21.15.37:0/3035906990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563158cb9110 con 0x563158b404a0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b4a864700 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158cd30a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c012360 tx=0x7f3b3c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f5795f60115db8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b2ffff700 1 -- 172.21.15.37:0/3035906990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c035070 con 0x563158b404a0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b2ffff700 1 -- 172.21.15.37:0/3035906990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b3c005360 con 0x563158b404a0 2024-05-09T01:09:07.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.130+0000 7f3b2ffff700 1 -- 172.21.15.37:0/3035906990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c021040 con 0x563158b404a0 2024-05-09T01:09:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 -- 172.21.15.37:0/3035906990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 msgr2=0x563158cd30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158cd30a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c012360 tx=0x7f3b3c0021d0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 -- 172.21.15.37:0/3035906990 shutdown_connections 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cc2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158cd30a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/3035906990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cd35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 -- 172.21.15.37:0/3035906990 >> 172.21.15.37:0/3035906990 conn(0x563158ba06a0 msgr2=0x563158cc5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 -- 172.21.15.37:0/3035906990 shutdown_connections 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.131+0000 7f3b5acddb80 1 -- 172.21.15.37:0/3035906990 wait complete. 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 -- start start 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 Processor -- start 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158ccf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cde5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cdeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44076040 con 0x563158b404a0 2024-05-09T01:09:07.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b440759c0 con 0x563158c2a160 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3b441ad1e0 con 0x563158cbd6a0 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b5acddb80 10 client.0 _ll_register_callbacks cb 0x563158a516c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b4a864700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158ccf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b4a864700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158ccf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41064/0 (socket says 172.21.15.37:41064) 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b4a864700 1 -- 172.21.15.37:0/79584829 learned_addr learned my addr 172.21.15.37:0/79584829 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b49862700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cde5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.132+0000 7f3b4a864700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cdeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b4a864700 1 -- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 msgr2=0x563158cdeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b4a864700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cdeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b4a864700 1 -- 172.21.15.37:0/79584829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 msgr2=0x563158cde5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b4a864700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cde5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b4a864700 1 -- 172.21.15.37:0/79584829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563158cb9cc0 con 0x563158b404a0 2024-05-09T01:09:07.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b49862700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cde5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b4a864700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158ccf9b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x563158a52c20 tx=0x7f3b3c00c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ea5ba2eaa448f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b2dffb700 1 -- 172.21.15.37:0/79584829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c021070 con 0x563158b404a0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b2dffb700 1 -- 172.21.15.37:0/79584829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3b3c012cd0 con 0x563158b404a0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.133+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c005360 con 0x563158b404a0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b2dffb700 1 -- 172.21.15.37:0/79584829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c035040 con 0x563158b404a0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 10 client.16428 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563158d418a0 con 0x563158b404a0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b2dffb700 1 -- 172.21.15.37:0/79584829 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b3c005360 con 0x563158b404a0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b2dffb700 1 -- 172.21.15.37:0/79584829 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f3b3c012040 con 0x563158b404a0 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 10 client.16428 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 10 client.16428 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 20 client.16428 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:07.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158d41e20 0x563158d44240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 4 client.16428 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.134+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563158be7a70 con 0x563158d41e20 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b49862700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158d41e20 0x563158d44240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b2dffb700 10 client.16428 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b49862700 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158d41e20 0x563158d44240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a85bac9413d258aa server_cookie=981cb6d7a9dfca03 in_seq=0 out_seq=0 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b2dffb700 1 -- 172.21.15.37:0/79584829 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563158be7a70 con 0x563158d41e20 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b2dffb700 10 client.16428 handle_command_reply: tid=0 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b5acddb80 1 client.16428 shutdown 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 msgr2=0x563158ccf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158ccf9b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x563158a52c20 tx=0x7f3b3c00c650 comp rx=0 tx=0).stop 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.135+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 shutdown_connections 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563158d41e20 0x563158d44240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563158cbd6a0 0x563158cdeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563158b404a0 0x563158ccf9b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 1 --2- 172.21.15.37:0/79584829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563158c2a160 0x563158cde5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b2dffb700 0 client.16428 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:09:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 >> 172.21.15.37:0/79584829 conn(0x563158ba06a0 msgr2=0x563158cc2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 shutdown_connections 2024-05-09T01:09:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 1 -- 172.21.15.37:0/79584829 wait complete. 2024-05-09T01:09:07.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.136+0000 7f3b5acddb80 20 client.16428 trim_cache size 0 max 16384 2024-05-09T01:09:07.142 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b29a0 msgr2=0x7f3b300b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b29a0 0x7f3b300b4eb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400b2d0 tx=0x7f3b340e71d0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b4410b020 msgr2=0x7f3b44113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b4410b020 0x7f3b44113840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b3400d980 tx=0x7f3b3400dc90 comp rx=0 tx=0).stop 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 shutdown_connections 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b29a0 0x7f3b300b4eb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b441102a0 0x7f3b44112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b4410b020 0x7f3b44113840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 --2- 172.21.15.37:0/393930204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b4410f950 0x7f3b44111ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 >> 172.21.15.37:0/393930204 conn(0x7f3b4406f990 msgr2=0x7f3b4410d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 shutdown_connections 2024-05-09T01:09:07.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:07.137+0000 7f3b4c2c7700 1 -- 172.21.15.37:0/393930204 wait complete. 2024-05-09T01:09:07.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:09:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:08.677 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:08 smithi037 ceph-mon[30122]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 683 op/s 2024-05-09T01:09:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:08 smithi151 ceph-mon[34780]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 683 op/s 2024-05-09T01:09:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:08 smithi136 ceph-mon[34110]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 683 op/s 2024-05-09T01:09:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 410.0 s, 2723.4 tps, lat 36.777 ms stddev 48.235 2024-05-09T01:09:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.543+0000 7f2911e37700 1 -- 172.21.15.37:0/2339681417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1045f0 msgr2=0x7f290c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.543+0000 7f2911e37700 1 --2- 172.21.15.37:0/2339681417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1045f0 0x7f290c104a00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0099c0 tx=0x7f28fc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.544+0000 7f2911e37700 1 -- 172.21.15.37:0/2339681417 shutdown_connections 2024-05-09T01:09:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.544+0000 7f2911e37700 1 --2- 172.21.15.37:0/2339681417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c109870 0x7f290c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.544+0000 7f2911e37700 1 --2- 172.21.15.37:0/2339681417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1045f0 0x7f290c104a00 secure :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0099c0 tx=0x7f28fc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.544+0000 7f2911e37700 1 --2- 172.21.15.37:0/2339681417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f290c108f20 0x7f290c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.544+0000 7f2911e37700 1 -- 172.21.15.37:0/2339681417 >> 172.21.15.37:0/2339681417 conn(0x7f290c100040 msgr2=0x7f290c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.545+0000 7f2911e37700 1 -- 172.21.15.37:0/2339681417 shutdown_connections 2024-05-09T01:09:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.545+0000 7f2911e37700 1 -- 172.21.15.37:0/2339681417 wait complete. 2024-05-09T01:09:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.546+0000 7f2911e37700 1 Processor -- start 2024-05-09T01:09:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f2911e37700 1 -- start start 2024-05-09T01:09:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f2911e37700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c108f20 0x7f290c10ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f2911e37700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f290c109870 0x7f290c10ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f2911e37700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1ab2a0 0x7f290c1ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f2911e37700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f290c077570 con 0x7f290c1ab2a0 2024-05-09T01:09:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f2911e37700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f290c0773f0 con 0x7f290c108f20 2024-05-09T01:09:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f2911e37700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f290c0776f0 con 0x7f290c109870 2024-05-09T01:09:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c108f20 0x7f290c10ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f290bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1ab2a0 0x7f290c1ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c108f20 0x7f290c10ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55430/0 (socket says 172.21.15.37:55430) 2024-05-09T01:09:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f290b7fe700 1 -- 172.21.15.37:0/794490939 learned_addr learned my addr 172.21.15.37:0/794490939 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.547+0000 7f290affd700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f290c109870 0x7f290c10ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290bfff700 1 -- 172.21.15.37:0/794490939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f290c109870 msgr2=0x7f290c10ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290bfff700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f290c109870 0x7f290c10ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290bfff700 1 -- 172.21.15.37:0/794490939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c108f20 msgr2=0x7f290c10ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290bfff700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c108f20 0x7f290c10ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290bfff700 1 -- 172.21.15.37:0/794490939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290c1adc00 con 0x7f290c1ab2a0 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290b7fe700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c108f20 0x7f290c10ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290affd700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f290c109870 0x7f290c10ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f290bfff700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1ab2a0 0x7f290c1ad6c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f290400efc0 tx=0x7f290400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f2908ff9700 1 -- 172.21.15.37:0/794490939 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29040092e0 con 0x7f290c1ab2a0 2024-05-09T01:09:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f2908ff9700 1 -- 172.21.15.37:0/794490939 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2904004bb0 con 0x7f290c1ab2a0 2024-05-09T01:09:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f2908ff9700 1 -- 172.21.15.37:0/794490939 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2904004020 con 0x7f290c1ab2a0 2024-05-09T01:09:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290c1addd0 con 0x7f290c1ab2a0 2024-05-09T01:09:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.548+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f290c1ae230 con 0x7f290c1ab2a0 2024-05-09T01:09:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.554+0000 7f2908ff9700 1 -- 172.21.15.37:0/794490939 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f290401b030 con 0x7f290c1ab2a0 2024-05-09T01:09:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.555+0000 7f2908ff9700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f28f40b2900 0x7f28f40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.555+0000 7f2908ff9700 1 -- 172.21.15.37:0/794490939 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f29040e1b80 con 0x7f290c1ab2a0 2024-05-09T01:09:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f290b7fe700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f28f40b2900 0x7f28f40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 Processor -- start 2024-05-09T01:09:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 -- start start 2024-05-09T01:09:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f290b7fe700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f28f40b2900 0x7f28f40b4e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28fc000c00 tx=0x7f28fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db5c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db5ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db56ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a0da78ff0 con 0x559a0d9d94a0 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559a0da177f0 con 0x559a0dac3160 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.556+0000 7f292084db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559a0da74fb0 con 0x559a0db566a0 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db5c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db5ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db5ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41096/0 (socket says 172.21.15.37:41096) 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290affd700 1 -- 172.21.15.37:0/837824530 learned_addr learned my addr 172.21.15.37:0/837824530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290bfff700 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db56ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290b7fe700 1 -- 172.21.15.37:0/837824530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 msgr2=0x559a0db56ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290b7fe700 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db56ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290b7fe700 1 -- 172.21.15.37:0/837824530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 msgr2=0x559a0db5ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290b7fe700 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db5ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290b7fe700 1 -- 172.21.15.37:0/837824530 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0da0f370 con 0x559a0dac3160 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290affd700 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db5ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290bfff700 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db56ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.557+0000 7f290b7fe700 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db5c4f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003760 tx=0x7f28fc009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e09a4a40e09c30aa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.558+0000 7f28f1ffb700 1 -- 172.21.15.37:0/837824530 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0037c0 con 0x559a0dac3160 2024-05-09T01:09:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.558+0000 7f28f1ffb700 1 -- 172.21.15.37:0/837824530 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc003e10 con 0x559a0dac3160 2024-05-09T01:09:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.558+0000 7f28f1ffb700 1 -- 172.21.15.37:0/837824530 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc030c30 con 0x559a0dac3160 2024-05-09T01:09:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.559+0000 7f292084db80 1 -- 172.21.15.37:0/837824530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 msgr2=0x559a0db5c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.559+0000 7f292084db80 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db5c4f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003760 tx=0x7f28fc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.561+0000 7f292084db80 1 -- 172.21.15.37:0/837824530 shutdown_connections 2024-05-09T01:09:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.561+0000 7f292084db80 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db56ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.561+0000 7f292084db80 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db5c4f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.561+0000 7f292084db80 1 --2- 172.21.15.37:0/837824530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db5ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.561+0000 7f292084db80 1 -- 172.21.15.37:0/837824530 >> 172.21.15.37:0/837824530 conn(0x559a0da396a0 msgr2=0x559a0db51400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.561+0000 7f292084db80 1 -- 172.21.15.37:0/837824530 shutdown_connections 2024-05-09T01:09:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.561+0000 7f292084db80 1 -- 172.21.15.37:0/837824530 wait complete. 2024-05-09T01:09:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.562+0000 7f292084db80 1 -- start start 2024-05-09T01:09:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.562+0000 7f292084db80 1 Processor -- start 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f292084db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db60270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f292084db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f292084db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db60cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f292084db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a0d8f4ba0 con 0x559a0d9d94a0 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f292084db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559a0da33150 con 0x559a0dac3160 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f292084db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559a0db631d0 con 0x559a0db566a0 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f292084db80 10 client.0 _ll_register_callbacks cb 0x559a0d8ea6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55456/0 (socket says 172.21.15.37:55456) 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 -- 172.21.15.37:0/762523710 learned_addr learned my addr 172.21.15.37:0/762523710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db60270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290bfff700 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db60cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 -- 172.21.15.37:0/762523710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 msgr2=0x559a0db60cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db60cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 -- 172.21.15.37:0/762523710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 msgr2=0x559a0db60270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db60270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 -- 172.21.15.37:0/762523710 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0d8f4490 con 0x559a0dac3160 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.563+0000 7f290affd700 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db607b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2900010f10 tx=0x7f290000f700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aebb039434e68533 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f28eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f28eaffd700 1 -- 172.21.15.37:0/762523710 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900004830 con 0x559a0dac3160 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f28eaffd700 1 -- 172.21.15.37:0/762523710 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f29000049d0 con 0x559a0dac3160 2024-05-09T01:09:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28fc003e10 con 0x559a0dac3160 2024-05-09T01:09:10.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f28eaffd700 1 -- 172.21.15.37:0/762523710 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2900004bd0 con 0x559a0dac3160 2024-05-09T01:09:10.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f292084db80 10 client.26261 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:10.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559a0db6dbb0 con 0x559a0dac3160 2024-05-09T01:09:10.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f28eaffd700 1 -- 172.21.15.37:0/762523710 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2900004d70 con 0x559a0dac3160 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.564+0000 7f28eaffd700 1 -- 172.21.15.37:0/762523710 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f29000196e0 con 0x559a0dac3160 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.565+0000 7f292084db80 10 client.26261 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.565+0000 7f292084db80 10 client.26261 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.565+0000 7f292084db80 20 client.26261 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.565+0000 7f292084db80 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0db70240 0x559a0db72680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.565+0000 7f292084db80 4 client.26261 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.565+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f28fc003e10 con 0x559a0db70240 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.565+0000 7f290b7fe700 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0db70240 0x559a0db72680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.566+0000 7f28eaffd700 10 client.26261 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:09:10.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.568+0000 7f290b7fe700 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0db70240 0x559a0db72680 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77349edce282c567 server_cookie=6c0729eee48c78a in_seq=0 out_seq=0 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f28eaffd700 1 -- 172.21.15.37:0/762523710 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f28fc003e10 con 0x559a0db70240 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f28eaffd700 10 client.26261 handle_command_reply: tid=0 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 client.26261 shutdown 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 msgr2=0x559a0db607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db607b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2900010f10 tx=0x7f290000f700 comp rx=0 tx=0).stop 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 shutdown_connections 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db60cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db60270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0db70240 0x559a0db72680 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f28eaffd700 0 client.26261 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:09:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 --2- 172.21.15.37:0/762523710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db607b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.569+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 >> 172.21.15.37:0/762523710 conn(0x559a0da396a0 msgr2=0x559a0db511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.570+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 shutdown_connections 2024-05-09T01:09:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.570+0000 7f292084db80 1 -- 172.21.15.37:0/762523710 wait complete. 2024-05-09T01:09:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.570+0000 7f292084db80 20 client.26261 trim_cache size 0 max 16384 2024-05-09T01:09:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.591+0000 7f292084db80 1 Processor -- start 2024-05-09T01:09:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.592+0000 7f292084db80 1 -- start start 2024-05-09T01:09:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.592+0000 7f292084db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db6bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.592+0000 7f292084db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db6c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.592+0000 7f292084db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db5eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.592+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db6bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db6bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41110/0 (socket says 172.21.15.37:41110) 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290b7fe700 1 -- 172.21.15.37:0/322685778 learned_addr learned my addr 172.21.15.37:0/322685778 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f290c1b56a0 con 0x559a0d9d94a0 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f290c1b71e0 con 0x559a0dac3160 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290affd700 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db6c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f290c1b5d70 con 0x559a0db566a0 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290bfff700 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db5eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290b7fe700 1 -- 172.21.15.37:0/322685778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 msgr2=0x559a0db5eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290b7fe700 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db5eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290b7fe700 1 -- 172.21.15.37:0/322685778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 msgr2=0x559a0db6c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290b7fe700 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db6c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290b7fe700 1 -- 172.21.15.37:0/322685778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0db5e7e0 con 0x559a0d9d94a0 2024-05-09T01:09:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.593+0000 7f290affd700 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db6c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.594+0000 7f290b7fe700 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db6bfd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009990 tx=0x7f28fc005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae1f74526dcd77a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.594+0000 7f28f17fa700 1 -- 172.21.15.37:0/322685778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc003bd0 con 0x559a0d9d94a0 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.594+0000 7f28f17fa700 1 -- 172.21.15.37:0/322685778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc003e10 con 0x559a0d9d94a0 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.594+0000 7f28f17fa700 1 -- 172.21.15.37:0/322685778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc039460 con 0x559a0d9d94a0 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 msgr2=0x559a0db6bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db6bfd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009990 tx=0x7f28fc005fb0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 shutdown_connections 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0db566a0 0x559a0db5eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db6bfd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 --2- 172.21.15.37:0/322685778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0dac3160 0x559a0db6c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 >> 172.21.15.37:0/322685778 conn(0x559a0da396a0 msgr2=0x559a0db5b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 shutdown_connections 2024-05-09T01:09:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 -- 172.21.15.37:0/322685778 wait complete. 2024-05-09T01:09:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.595+0000 7f292084db80 1 -- start start 2024-05-09T01:09:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.596+0000 7f292084db80 1 Processor -- start 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.596+0000 7f292084db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db68600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.596+0000 7f292084db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0dac3160 0x559a0db77230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.596+0000 7f292084db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0db566a0 0x559a0db77770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.596+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db68600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.596+0000 7f290b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db68600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41120/0 (socket says 172.21.15.37:41120) 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0dac3160 0x559a0db77230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0dac3160 0x559a0db77230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48534/0 (socket says 172.21.15.37:48534) 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290b7fe700 1 -- 172.21.15.37:0/1974321601 learned_addr learned my addr 172.21.15.37:0/1974321601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f290c1b6b10 con 0x559a0d9d94a0 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f290c1b6440 con 0x559a0db566a0 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f290c1b3660 con 0x559a0dac3160 2024-05-09T01:09:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f292084db80 10 client.0 _ll_register_callbacks cb 0x559a0d8ea6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290bfff700 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0db566a0 0x559a0db77770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290affd700 1 -- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0db566a0 msgr2=0x559a0db77770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290affd700 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0db566a0 0x559a0db77770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290affd700 1 -- 172.21.15.37:0/1974321601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 msgr2=0x559a0db68600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290affd700 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db68600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.597+0000 7f290affd700 1 -- 172.21.15.37:0/1974321601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a0db77cb0 con 0x559a0dac3160 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.598+0000 7f290affd700 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0dac3160 0x559a0db77230 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2900019bd0 tx=0x7f2900004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1300378b9a7cc5f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.598+0000 7f28eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.598+0000 7f28eaffd700 1 -- 172.21.15.37:0/1974321601 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900032060 con 0x559a0dac3160 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.598+0000 7f28eaffd700 1 -- 172.21.15.37:0/1974321601 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f29000196b0 con 0x559a0dac3160 2024-05-09T01:09:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.598+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28fc003e10 con 0x559a0dac3160 2024-05-09T01:09:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.601+0000 7f28eaffd700 1 -- 172.21.15.37:0/1974321601 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2900028070 con 0x559a0dac3160 2024-05-09T01:09:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.601+0000 7f292084db80 10 client.26248 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.601+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559a0dbda620 con 0x559a0dac3160 2024-05-09T01:09:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.604+0000 7f28eaffd700 1 -- 172.21.15.37:0/1974321601 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2900029040 con 0x559a0dac3160 2024-05-09T01:09:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.605+0000 7f28eaffd700 1 -- 172.21.15.37:0/1974321601 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f2900035050 con 0x559a0dac3160 2024-05-09T01:09:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.605+0000 7f292084db80 10 client.26248 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.605+0000 7f292084db80 10 client.26248 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:09:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.605+0000 7f292084db80 20 client.26248 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.605+0000 7f292084db80 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0dbdad30 0x559a0dbdd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.605+0000 7f292084db80 4 client.26248 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:09:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.605+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f28fc003e10 con 0x559a0dbdad30 2024-05-09T01:09:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.606+0000 7f290b7fe700 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0dbdad30 0x559a0dbdd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.606+0000 7f290b7fe700 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0dbdad30 0x559a0dbdd150 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ebc2388189125de6 server_cookie=51ca95bacf2f538d in_seq=0 out_seq=0 2024-05-09T01:09:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.606+0000 7f28eaffd700 10 client.26248 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:09:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.607+0000 7f28eaffd700 1 -- 172.21.15.37:0/1974321601 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f28fc003e10 con 0x559a0dbdad30 2024-05-09T01:09:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.607+0000 7f28eaffd700 10 client.26248 handle_command_reply: tid=0 2024-05-09T01:09:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.607+0000 7f292084db80 1 client.26248 shutdown 2024-05-09T01:09:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.607+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0dac3160 msgr2=0x559a0db77230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.607+0000 7f292084db80 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0dac3160 0x559a0db77230 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2900019bd0 tx=0x7f2900004b40 comp rx=0 tx=0).stop 2024-05-09T01:09:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.607+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 shutdown_connections 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.607+0000 7f292084db80 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559a0dbdad30 0x559a0dbdd150 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f28eaffd700 0 client.26248 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f292084db80 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a0db566a0 0x559a0db77770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f292084db80 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a0d9d94a0 0x559a0db68600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f292084db80 1 --2- 172.21.15.37:0/1974321601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a0dac3160 0x559a0db77230 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 >> 172.21.15.37:0/1974321601 conn(0x559a0da396a0 msgr2=0x559a0db5e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 shutdown_connections 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f292084db80 1 -- 172.21.15.37:0/1974321601 wait complete. 2024-05-09T01:09:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.608+0000 7f292084db80 20 client.26248 trim_cache size 0 max 16384 2024-05-09T01:09:10.615 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:09:10.615 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:10 smithi037 ceph-mon[30122]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.614+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f28f40b2900 msgr2=0x7f28f40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.614+0000 7f2911e37700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f28f40b2900 0x7f28f40b4e10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28fc000c00 tx=0x7f28fc01a040 comp rx=0 tx=0).stop 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.614+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1ab2a0 msgr2=0x7f290c1ad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.614+0000 7f2911e37700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1ab2a0 0x7f290c1ad6c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f290400efc0 tx=0x7f290400c3a0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 shutdown_connections 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f28f40b2900 0x7f28f40b4e10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f290c1ab2a0 0x7f290c1ad6c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f290c108f20 0x7f290c10ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 --2- 172.21.15.37:0/794490939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f290c109870 0x7f290c10ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 >> 172.21.15.37:0/794490939 conn(0x7f290c100040 msgr2=0x7f290c102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 shutdown_connections 2024-05-09T01:09:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:10.615+0000 7f2911e37700 1 -- 172.21.15.37:0/794490939 wait complete. 2024-05-09T01:09:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:10 smithi151 ceph-mon[34780]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-05-09T01:09:10.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:10 smithi136 ceph-mon[34110]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-05-09T01:09:11.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:09:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:12.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:12 smithi037 ceph-mon[30122]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 740 op/s 2024-05-09T01:09:12.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:12 smithi151 ceph-mon[34780]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 740 op/s 2024-05-09T01:09:12.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:12 smithi136 ceph-mon[34110]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 MiB/s wr, 740 op/s 2024-05-09T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 -- 172.21.15.37:0/4008898518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718109a20 msgr2=0x7fe71810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 --2- 172.21.15.37:0/4008898518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718109a20 0x7fe71810be40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe710009ca0 tx=0x7fe71002a8b0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 -- 172.21.15.37:0/4008898518 shutdown_connections 2024-05-09T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 --2- 172.21.15.37:0/4008898518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718109a20 0x7fe71810be40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 --2- 172.21.15.37:0/4008898518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7181070c0 0x7fe7181094e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 --2- 172.21.15.37:0/4008898518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe718104760 0x7fe718106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 -- 172.21.15.37:0/4008898518 >> 172.21.15.37:0/4008898518 conn(0x7fe7180fdd60 msgr2=0x7fe718100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 -- 172.21.15.37:0/4008898518 shutdown_connections 2024-05-09T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.495+0000 7fe7202c6640 1 -- 172.21.15.37:0/4008898518 wait complete. 2024-05-09T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.496+0000 7fe7202c6640 1 Processor -- start 2024-05-09T01:09:13.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.496+0000 7fe7202c6640 1 -- start start 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.496+0000 7fe7202c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe718104760 0x7fe71819a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe7202c6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181070c0 0x7fe71819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe7202c6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe718109a20 0x7fe7181a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe7202c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810f7d0 con 0x7fe718104760 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe7202c6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810f650 con 0x7fe718109a20 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe7202c6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810f950 con 0x7fe7181070c0 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe71e863640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe718109a20 0x7fe7181a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe71e062640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe718104760 0x7fe71819a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe71e062640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe718104760 0x7fe71819a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60748/0 (socket says 172.21.15.37:60748) 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.497+0000 7fe71e062640 1 -- 172.21.15.37:0/2257743955 learned_addr learned my addr 172.21.15.37:0/2257743955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.498+0000 7fe71d861640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181070c0 0x7fe71819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.498+0000 7fe71d861640 1 -- 172.21.15.37:0/2257743955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe718109a20 msgr2=0x7fe7181a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.498+0000 7fe71d861640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe718109a20 0x7fe7181a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.498+0000 7fe71d861640 1 -- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe718104760 msgr2=0x7fe71819a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.498+0000 7fe71d861640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe718104760 0x7fe71819a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.498+0000 7fe71d861640 1 -- 172.21.15.37:0/2257743955 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7181a1c60 con 0x7fe7181070c0 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.498+0000 7fe71e062640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe718104760 0x7fe71819a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.499+0000 7fe71d861640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181070c0 0x7fe71819a660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe70800e9f0 tx=0x7fe70800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.499+0000 7fe70f7fe640 1 -- 172.21.15.37:0/2257743955 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70800ccc0 con 0x7fe7181070c0 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.499+0000 7fe70f7fe640 1 -- 172.21.15.37:0/2257743955 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7080108e0 con 0x7fe7181070c0 2024-05-09T01:09:13.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.499+0000 7fe70f7fe640 1 -- 172.21.15.37:0/2257743955 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708018880 con 0x7fe7181070c0 2024-05-09T01:09:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.499+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7181a1f50 con 0x7fe7181070c0 2024-05-09T01:09:13.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.499+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7181a2300 con 0x7fe7181070c0 2024-05-09T01:09:13.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.502+0000 7fe727176740 1 Processor -- start 2024-05-09T01:09:13.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.503+0000 7fe727176740 1 -- start start 2024-05-09T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.503+0000 7fe727176740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408df1b0 0x562340c81ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe727176740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408b62f0 0x562340c82440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe727176740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408be4d0 0x562340c7eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe727176740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562340be77c0 con 0x5623408b62f0 2024-05-09T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe727176740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562340b830e0 con 0x5623408be4d0 2024-05-09T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe727176740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562340be3780 con 0x5623408df1b0 2024-05-09T01:09:13.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.503+0000 7fe70f7fe640 1 -- 172.21.15.37:0/2257743955 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe708018a20 con 0x7fe7181070c0 2024-05-09T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe71e863640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408df1b0 0x562340c81ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe71e863640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408df1b0 0x562340c81ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49056/0 (socket says 172.21.15.37:49056) 2024-05-09T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.504+0000 7fe71e863640 1 -- 172.21.15.37:0/1153906078 learned_addr learned my addr 172.21.15.37:0/1153906078 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe71e863640 1 -- 172.21.15.37:0/1153906078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408be4d0 msgr2=0x562340c7eb70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:09:13.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe71e863640 1 --2- 172.21.15.37:0/1153906078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408be4d0 0x562340c7eb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe71e863640 1 -- 172.21.15.37:0/1153906078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408b62f0 msgr2=0x562340c82440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe71e863640 1 --2- 172.21.15.37:0/1153906078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408b62f0 0x562340c82440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe71e863640 1 -- 172.21.15.37:0/1153906078 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562340bac7c0 con 0x5623408df1b0 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe71e863640 1 --2- 172.21.15.37:0/1153906078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408df1b0 0x562340c81ec0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe710009ca0 tx=0x7fe710030ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a357394ed99049b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe70cbfe640 1 -- 172.21.15.37:0/1153906078 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710030a00 con 0x5623408df1b0 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe70f7fe640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7040b28e0 0x7fe7040b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe70cbfe640 1 -- 172.21.15.37:0/1153906078 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe710036030 con 0x5623408df1b0 2024-05-09T01:09:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.505+0000 7fe70cbfe640 1 -- 172.21.15.37:0/1153906078 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7100045e0 con 0x5623408df1b0 2024-05-09T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.506+0000 7fe71e062640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7040b28e0 0x7fe7040b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.506+0000 7fe70f7fe640 1 -- 172.21.15.37:0/2257743955 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe7080e2480 con 0x7fe7181070c0 2024-05-09T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.506+0000 7fe727176740 1 -- 172.21.15.37:0/1153906078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408df1b0 msgr2=0x562340c81ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.506+0000 7fe71e062640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7040b28e0 0x7fe7040b4df0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe714009fd0 tx=0x7fe714009780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.506+0000 7fe727176740 1 --2- 172.21.15.37:0/1153906078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408df1b0 0x562340c81ec0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe710009ca0 tx=0x7fe710030ff0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 -- 172.21.15.37:0/1153906078 shutdown_connections 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 --2- 172.21.15.37:0/1153906078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408be4d0 0x562340c7eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 --2- 172.21.15.37:0/1153906078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408b62f0 0x562340c82440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 --2- 172.21.15.37:0/1153906078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408df1b0 0x562340c81ec0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 -- 172.21.15.37:0/1153906078 >> 172.21.15.37:0/1153906078 conn(0x5623408d3300 msgr2=0x562340c83270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 -- 172.21.15.37:0/1153906078 shutdown_connections 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 -- 172.21.15.37:0/1153906078 wait complete. 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 -- start start 2024-05-09T01:09:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.507+0000 7fe727176740 1 Processor -- start 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe727176740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408b62f0 0x562340c95ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe727176740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408be4d0 0x562340c96010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe727176740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408df1b0 0x562340c9cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe727176740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562340c7f610 con 0x5623408be4d0 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe727176740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562340b6e9c0 con 0x5623408df1b0 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe727176740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562340c93d60 con 0x5623408b62f0 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe727176740 10 client.0 _ll_register_callbacks cb 0x562340b9b020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe71e863640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408df1b0 0x562340c9cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe71e863640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408df1b0 0x562340c9cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34732/0 (socket says 172.21.15.37:34732) 2024-05-09T01:09:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.508+0000 7fe71e863640 1 -- 172.21.15.37:0/2875022121 learned_addr learned my addr 172.21.15.37:0/2875022121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.509+0000 7fe71d861640 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408be4d0 0x562340c96010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.509+0000 7fe71e863640 1 -- 172.21.15.37:0/2875022121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408b62f0 msgr2=0x562340c95ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.509+0000 7fe71e863640 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408b62f0 0x562340c95ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.509+0000 7fe71e863640 1 -- 172.21.15.37:0/2875022121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408be4d0 msgr2=0x562340c96010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.509+0000 7fe71e863640 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408be4d0 0x562340c96010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.509+0000 7fe71e863640 1 -- 172.21.15.37:0/2875022121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562340b951f0 con 0x5623408df1b0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.510+0000 7fe71e863640 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408df1b0 0x562340c9cf70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe710004af0 tx=0x7fe71002a8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d36db45b41045e50 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.510+0000 7fe701ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.510+0000 7fe701ffb640 1 -- 172.21.15.37:0/2875022121 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710053020 con 0x5623408df1b0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.510+0000 7fe701ffb640 1 -- 172.21.15.37:0/2875022121 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe710004530 con 0x5623408df1b0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.510+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe710036030 con 0x5623408df1b0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.510+0000 7fe701ffb640 1 -- 172.21.15.37:0/2875022121 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe710004730 con 0x5623408df1b0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.510+0000 7fe727176740 10 client.26276 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56234094a790 con 0x5623408df1b0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe701ffb640 1 -- 172.21.15.37:0/2875022121 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe710003e20 con 0x5623408df1b0 2024-05-09T01:09:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe701ffb640 1 -- 172.21.15.37:0/2875022121 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fe710043070 con 0x5623408df1b0 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe727176740 10 client.26276 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe727176740 10 client.26276 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe727176740 20 client.26276 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe727176740 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56234089dd80 0x562340ca3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe727176740 4 client.26276 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.511+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe710036030 con 0x56234089dd80 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.512+0000 7fe71e062640 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56234089dd80 0x562340ca3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.512+0000 7fe71e062640 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56234089dd80 0x562340ca3080 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3402158b19a113d3 server_cookie=fc3505b80945ec5 in_seq=0 out_seq=0 2024-05-09T01:09:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.512+0000 7fe701ffb640 10 client.26276 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe701ffb640 1 -- 172.21.15.37:0/2875022121 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fe710036030 con 0x56234089dd80 2024-05-09T01:09:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe701ffb640 10 client.26276 handle_command_reply: tid=0 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 client.26276 shutdown 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408df1b0 msgr2=0x562340c9cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408df1b0 0x562340c9cf70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe710004af0 tx=0x7fe71002a8b0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 shutdown_connections 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56234089dd80 0x562340ca3080 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408df1b0 0x562340c9cf70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe701ffb640 0 client.26276 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5623408be4d0 0x562340c96010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 --2- 172.21.15.37:0/2875022121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408b62f0 0x562340c95ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 >> 172.21.15.37:0/2875022121 conn(0x5623408d3300 msgr2=0x562340c7de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 shutdown_connections 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.513+0000 7fe727176740 1 -- 172.21.15.37:0/2875022121 wait complete. 2024-05-09T01:09:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.514+0000 7fe727176740 20 client.26276 trim_cache size 0 max 16384 2024-05-09T01:09:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 Processor -- start 2024-05-09T01:09:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 -- start start 2024-05-09T01:09:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c94800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c86070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 0x562340c865b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181a8db0 con 0x56234089dd80 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181aa8f0 con 0x5623408b62f0 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe727176740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181a9480 con 0x5623408d3300 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe71d861640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c86070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe71d861640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c86070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60770/0 (socket says 172.21.15.37:60770) 2024-05-09T01:09:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.539+0000 7fe71d861640 1 -- 172.21.15.37:0/1237751456 learned_addr learned my addr 172.21.15.37:0/1237751456 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.540+0000 7fe71e062640 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c94800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.540+0000 7fe71d861640 1 -- 172.21.15.37:0/1237751456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 msgr2=0x562340c94800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.540+0000 7fe71d861640 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c94800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.540+0000 7fe71d861640 1 -- 172.21.15.37:0/1237751456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 msgr2=0x562340c865b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.540+0000 7fe71d861640 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 0x562340c865b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.540+0000 7fe71d861640 1 -- 172.21.15.37:0/1237751456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623409c15f0 con 0x56234089dd80 2024-05-09T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.540+0000 7fe71d861640 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c86070 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe7080a9850 tx=0x7fe70800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df85d4b818a63c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.541+0000 7fe703fff640 1 -- 172.21.15.37:0/1237751456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080b2250 con 0x56234089dd80 2024-05-09T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.541+0000 7fe703fff640 1 -- 172.21.15.37:0/1237751456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7080c3070 con 0x56234089dd80 2024-05-09T01:09:13.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.541+0000 7fe703fff640 1 -- 172.21.15.37:0/1237751456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7080a5de0 con 0x56234089dd80 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 -- 172.21.15.37:0/1237751456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 msgr2=0x562340c86070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c86070 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe7080a9850 tx=0x7fe70800ce60 comp rx=0 tx=0).stop 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 -- 172.21.15.37:0/1237751456 shutdown_connections 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 0x562340c865b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c86070 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 --2- 172.21.15.37:0/1237751456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c94800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 -- 172.21.15.37:0/1237751456 >> 172.21.15.37:0/1237751456 conn(0x562340c82650 msgr2=0x562340c940f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.542+0000 7fe727176740 1 -- 172.21.15.37:0/1237751456 shutdown_connections 2024-05-09T01:09:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.543+0000 7fe727176740 1 -- 172.21.15.37:0/1237751456 wait complete. 2024-05-09T01:09:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.543+0000 7fe727176740 1 -- start start 2024-05-09T01:09:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.543+0000 7fe727176740 1 Processor -- start 2024-05-09T01:09:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.544+0000 7fe727176740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c9b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.544+0000 7fe727176740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 0x562340c9b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.544+0000 7fe727176740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c9c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.544+0000 7fe727176740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181aa220 con 0x56234089dd80 2024-05-09T01:09:13.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.544+0000 7fe727176740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181a9b50 con 0x5623408b62f0 2024-05-09T01:09:13.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.544+0000 7fe727176740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe7181a6d90 con 0x5623408d3300 2024-05-09T01:09:13.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe727176740 10 client.0 _ll_register_callbacks cb 0x7fe710009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71d861640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 0x562340c9b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c9c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c9c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49080/0 (socket says 172.21.15.37:49080) 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 -- 172.21.15.37:0/2951011183 learned_addr learned my addr 172.21.15.37:0/2951011183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 -- 172.21.15.37:0/2951011183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 msgr2=0x562340c9b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 0x562340c9b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 -- 172.21.15.37:0/2951011183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 msgr2=0x562340c9b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c9b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 -- 172.21.15.37:0/2951011183 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562340babed0 con 0x5623408d3300 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.545+0000 7fe71e863640 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c9c4f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe71004fc80 tx=0x7fe71004f670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fdd6a5a636f6cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.546+0000 7fe701ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:13.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.546+0000 7fe701ffb640 1 -- 172.21.15.37:0/2951011183 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710009360 con 0x5623408d3300 2024-05-09T01:09:13.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.546+0000 7fe701ffb640 1 -- 172.21.15.37:0/2951011183 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe710004530 con 0x5623408d3300 2024-05-09T01:09:13.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.547+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7080c3070 con 0x5623408d3300 2024-05-09T01:09:13.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.547+0000 7fe701ffb640 1 -- 172.21.15.37:0/2951011183 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe710004b40 con 0x5623408d3300 2024-05-09T01:09:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.548+0000 7fe727176740 10 client.26263 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.548+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x562340c9db70 con 0x5623408d3300 2024-05-09T01:09:13.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.550+0000 7fe701ffb640 1 -- 172.21.15.37:0/2951011183 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7080c3070 con 0x5623408d3300 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.550+0000 7fe701ffb640 1 -- 172.21.15.37:0/2951011183 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fe710043070 con 0x5623408d3300 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.551+0000 7fe727176740 10 client.26263 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.551+0000 7fe727176740 10 client.26263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.551+0000 7fe727176740 20 client.26263 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.551+0000 7fe727176740 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5623408be4d0 0x562340d0d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.551+0000 7fe727176740 4 client.26263 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.551+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562340bf53d0 con 0x5623408be4d0 2024-05-09T01:09:13.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.551+0000 7fe71e062640 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5623408be4d0 0x562340d0d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:13.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.552+0000 7fe71e062640 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5623408be4d0 0x562340d0d760 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1f753dfc16d469d server_cookie=143a08c68b447347 in_seq=0 out_seq=0 2024-05-09T01:09:13.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.552+0000 7fe701ffb640 10 client.26263 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.589+0000 7fe701ffb640 1 -- 172.21.15.37:0/2951011183 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562340bf53d0 con 0x5623408be4d0 2024-05-09T01:09:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.589+0000 7fe701ffb640 10 client.26263 handle_command_reply: tid=0 2024-05-09T01:09:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.589+0000 7fe727176740 1 client.26263 shutdown 2024-05-09T01:09:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.589+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 msgr2=0x562340c9c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.589+0000 7fe727176740 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c9c4f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe71004fc80 tx=0x7fe71004f670 comp rx=0 tx=0).stop 2024-05-09T01:09:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 shutdown_connections 2024-05-09T01:09:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5623408be4d0 0x562340d0d760 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623408d3300 0x562340c9c4f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5623408b62f0 0x562340c9b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 --2- 172.21.15.37:0/2951011183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56234089dd80 0x562340c9b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 >> 172.21.15.37:0/2951011183 conn(0x562340c82650 msgr2=0x562340c86070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe701ffb640 0 client.26263 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 shutdown_connections 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 1 -- 172.21.15.37:0/2951011183 wait complete. 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.590+0000 7fe727176740 20 client.26263 trim_cache size 0 max 16384 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:09:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:09:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7040b28e0 msgr2=0x7fe7040b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7040b28e0 0x7fe7040b4df0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe714009fd0 tx=0x7fe714009780 comp rx=0 tx=0).stop 2024-05-09T01:09:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181070c0 msgr2=0x7fe71819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181070c0 0x7fe71819a660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe70800e9f0 tx=0x7fe70800eeb0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 shutdown_connections 2024-05-09T01:09:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7040b28e0 0x7fe7040b4df0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe718109a20 0x7fe7181a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181070c0 0x7fe71819a660 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 --2- 172.21.15.37:0/2257743955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe718104760 0x7fe71819a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 >> 172.21.15.37:0/2257743955 conn(0x7fe7180fdd60 msgr2=0x7fe718105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 shutdown_connections 2024-05-09T01:09:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:13.591+0000 7fe7202c6640 1 -- 172.21.15.37:0/2257743955 wait complete. 2024-05-09T01:09:14.552 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:14 smithi037 ceph-mon[30122]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 657 op/s 2024-05-09T01:09:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.631+0000 7fb69dfb3700 1 -- 172.21.15.37:0/1461955508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 msgr2=0x7fb698108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.631+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/1461955508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 0x7fb698108200 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0099c0 tx=0x7fb68c009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.636+0000 7fb69dfb3700 1 -- 172.21.15.37:0/1461955508 shutdown_connections 2024-05-09T01:09:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.636+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/1461955508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb698108740 0x7fb6981100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.636+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/1461955508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6981034c0 0x7fb6981038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.636+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/1461955508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 0x7fb698108200 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.636+0000 7fb69dfb3700 1 -- 172.21.15.37:0/1461955508 >> 172.21.15.37:0/1461955508 conn(0x7fb6980fedc0 msgr2=0x7fb6981011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.638+0000 7fb69dfb3700 1 -- 172.21.15.37:0/1461955508 shutdown_connections 2024-05-09T01:09:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.640+0000 7fb69dfb3700 1 -- 172.21.15.37:0/1461955508 wait complete. 2024-05-09T01:09:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.641+0000 7fb69dfb3700 1 Processor -- start 2024-05-09T01:09:14.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.644+0000 7fb69dfb3700 1 -- start start 2024-05-09T01:09:14.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb69dfb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6981034c0 0x7fb6981a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb69dfb3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 0x7fb6981a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6981034c0 0x7fb6981a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6981034c0 0x7fb6981a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49094/0 (socket says 172.21.15.37:49094) 2024-05-09T01:09:14.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb6977fe700 1 -- 172.21.15.37:0/764987046 learned_addr learned my addr 172.21.15.37:0/764987046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb698108740 0x7fb6981a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb698113460 con 0x7fb698107df0 2024-05-09T01:09:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.645+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981132e0 con 0x7fb698108740 2024-05-09T01:09:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.646+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb6981135e0 con 0x7fb6981034c0 2024-05-09T01:09:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.646+0000 7fb697fff700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb698108740 0x7fb6981a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.648+0000 7fb696ffd700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 0x7fb6981a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.649+0000 7fb696ffd700 1 -- 172.21.15.37:0/764987046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6981034c0 msgr2=0x7fb6981a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.649+0000 7fb696ffd700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6981034c0 0x7fb6981a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.649+0000 7fb696ffd700 1 -- 172.21.15.37:0/764987046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb698108740 msgr2=0x7fb6981a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.649+0000 7fb696ffd700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb698108740 0x7fb6981a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.650+0000 7fb696ffd700 1 -- 172.21.15.37:0/764987046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6981a63f0 con 0x7fb698107df0 2024-05-09T01:09:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.650+0000 7fb696ffd700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 0x7fb6981a1ac0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0098e0 tx=0x7fb68c004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.651+0000 7fb6977fe700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6981034c0 0x7fb6981a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:09:14.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.651+0000 7fb697fff700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb698108740 0x7fb6981a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:09:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.652+0000 7fb694ff9700 1 -- 172.21.15.37:0/764987046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c009e60 con 0x7fb698107df0 2024-05-09T01:09:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.652+0000 7fb694ff9700 1 -- 172.21.15.37:0/764987046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb68c0047f0 con 0x7fb698107df0 2024-05-09T01:09:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.652+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6981a6680 con 0x7fb698107df0 2024-05-09T01:09:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.652+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6981a6b60 con 0x7fb698107df0 2024-05-09T01:09:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.652+0000 7fb694ff9700 1 -- 172.21.15.37:0/764987046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c005280 con 0x7fb698107df0 2024-05-09T01:09:14.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.659+0000 7fb694ff9700 1 -- 172.21.15.37:0/764987046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb68c005420 con 0x7fb698107df0 2024-05-09T01:09:14.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.659+0000 7fb6ac9c9b80 1 Processor -- start 2024-05-09T01:09:14.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6ac9c9b80 1 -- start start 2024-05-09T01:09:14.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb694ff9700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb6800b2a10 0x7fb6800b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e9513160 0x5569e95ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95aca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e95a66a0 0x5569e95a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569e94c8ff0 con 0x5569e95a66a0 2024-05-09T01:09:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5569e94677f0 con 0x5569e9513160 2024-05-09T01:09:14.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5569e94c4fb0 con 0x5569e94294a0 2024-05-09T01:09:14.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb694ff9700 1 -- 172.21.15.37:0/764987046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb68c0e3880 con 0x7fb698107df0 2024-05-09T01:09:14.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e9513160 0x5569e95ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e9513160 0x5569e95ac4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34754/0 (socket says 172.21.15.37:34754) 2024-05-09T01:09:14.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.660+0000 7fb6977fe700 1 -- 172.21.15.37:0/2004401944 learned_addr learned my addr 172.21.15.37:0/2004401944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:14.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb697fff700 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e95a66a0 0x5569e95a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb697fff700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb6800b2a10 0x7fb6800b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb696ffd700 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb697fff700 1 -- 172.21.15.37:0/2004401944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 msgr2=0x5569e95aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb697fff700 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb697fff700 1 -- 172.21.15.37:0/2004401944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e9513160 msgr2=0x5569e95ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb697fff700 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e9513160 0x5569e95ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb697fff700 1 -- 172.21.15.37:0/2004401944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569e945f370 con 0x5569e95a66a0 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.661+0000 7fb6977fe700 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e9513160 0x5569e95ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.662+0000 7fb697fff700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb6800b2a10 0x7fb6800b4f20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c6c0 tx=0x7fb690019000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:14.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.663+0000 7fb697fff700 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e95a66a0 0x5569e95a6ad0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb69000ecb0 tx=0x7fb69000c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2781c038d10a7c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.664+0000 7fb67dffb700 1 -- 172.21.15.37:0/2004401944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6900185f0 con 0x5569e95a66a0 2024-05-09T01:09:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.664+0000 7fb67dffb700 1 -- 172.21.15.37:0/2004401944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb690018c40 con 0x5569e95a66a0 2024-05-09T01:09:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.664+0000 7fb67dffb700 1 -- 172.21.15.37:0/2004401944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690024820 con 0x5569e95a66a0 2024-05-09T01:09:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.665+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2004401944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e95a66a0 msgr2=0x5569e95a6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.665+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e95a66a0 0x5569e95a6ad0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb69000ecb0 tx=0x7fb69000c370 comp rx=0 tx=0).stop 2024-05-09T01:09:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.665+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2004401944 shutdown_connections 2024-05-09T01:09:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.666+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e95a66a0 0x5569e95a6ad0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.666+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e9513160 0x5569e95ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.666+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2004401944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.666+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2004401944 >> 172.21.15.37:0/2004401944 conn(0x5569e94896a0 msgr2=0x5569e95a1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.666+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2004401944 shutdown_connections 2024-05-09T01:09:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.666+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2004401944 wait complete. 2024-05-09T01:09:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.666+0000 7fb6ac9c9b80 1 -- start start 2024-05-09T01:09:14.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.667+0000 7fb6ac9c9b80 1 Processor -- start 2024-05-09T01:09:14.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.667+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.667+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.667+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.667+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569e9344ba0 con 0x5569e9513160 2024-05-09T01:09:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5569e9483150 con 0x5569e94294a0 2024-05-09T01:09:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60820/0 (socket says 172.21.15.37:60820) 2024-05-09T01:09:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb696ffd700 1 -- 172.21.15.37:0/2466208296 learned_addr learned my addr 172.21.15.37:0/2466208296 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb6977fe700 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb697fff700 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5569e95b31d0 con 0x5569e95a66a0 2024-05-09T01:09:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb6ac9c9b80 10 client.0 _ll_register_callbacks cb 0x5569e933a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb697fff700 1 -- 172.21.15.37:0/2466208296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 msgr2=0x5569e95b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb697fff700 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb697fff700 1 -- 172.21.15.37:0/2466208296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 msgr2=0x5569e95b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb697fff700 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.668+0000 7fb697fff700 1 -- 172.21.15.37:0/2466208296 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569e9344490 con 0x5569e95a66a0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.669+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb690018c40 con 0x5569e95a66a0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.669+0000 7fb697fff700 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95b0c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb690004c20 tx=0x7fb690018870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6aee62fae5b9065 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.669+0000 7fb676ffd700 10 client.26269 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.669+0000 7fb676ffd700 1 -- 172.21.15.37:0/2466208296 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69000e470 con 0x5569e95a66a0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.670+0000 7fb676ffd700 1 -- 172.21.15.37:0/2466208296 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb690024440 con 0x5569e95a66a0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.670+0000 7fb676ffd700 1 -- 172.21.15.37:0/2466208296 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb690024680 con 0x5569e95a66a0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.670+0000 7fb6ac9c9b80 10 client.26269 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.670+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5569e95bda60 con 0x5569e95a66a0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.671+0000 7fb676ffd700 1 -- 172.21.15.37:0/2466208296 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fb690022020 con 0x5569e95a66a0 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.671+0000 7fb6ac9c9b80 10 client.26269 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:14.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.671+0000 7fb6ac9c9b80 10 client.26269 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:09:14.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.671+0000 7fb6ac9c9b80 20 client.26269 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:14.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.671+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e95bff30 0x5569e95c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.671+0000 7fb6ac9c9b80 4 client.26269 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:14.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.671+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569e94d69d0 con 0x5569e95bff30 2024-05-09T01:09:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.672+0000 7fb6977fe700 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e95bff30 0x5569e95c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.672+0000 7fb676ffd700 10 client.26269 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:09:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.672+0000 7fb6977fe700 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e95bff30 0x5569e95c2350 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47e2bf8ecf929b06 server_cookie=e7f5dedfde228b2c in_seq=0 out_seq=0 2024-05-09T01:09:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.673+0000 7fb676ffd700 1 -- 172.21.15.37:0/2466208296 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5569e94d69d0 con 0x5569e95bff30 2024-05-09T01:09:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.673+0000 7fb676ffd700 10 client.26269 handle_command_reply: tid=0 2024-05-09T01:09:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.673+0000 7fb6ac9c9b80 1 client.26269 shutdown 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.675+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 msgr2=0x5569e95b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.675+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95b0c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb690004c20 tx=0x7fb690018870 comp rx=0 tx=0).stop 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.675+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 shutdown_connections 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.675+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e95bff30 0x5569e95c2350 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.675+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95b0c50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.675+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.675+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2466208296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.676+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 >> 172.21.15.37:0/2466208296 conn(0x5569e94896a0 msgr2=0x5569e95a11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.676+0000 7fb676ffd700 0 client.26269 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:09:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.676+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 shutdown_connections 2024-05-09T01:09:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.676+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2466208296 wait complete. 2024-05-09T01:09:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.676+0000 7fb6ac9c9b80 20 client.26269 trim_cache size 0 max 16384 2024-05-09T01:09:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.699+0000 7fb6ac9c9b80 1 Processor -- start 2024-05-09T01:09:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.699+0000 7fb6ac9c9b80 1 -- start start 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.700+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.700+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.700+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95a5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.700+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb68400d220 con 0x5569e9513160 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.700+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb68400ed60 con 0x5569e94294a0 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.700+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb697fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95bbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34776/0 (socket says 172.21.15.37:34776) 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 -- 172.21.15.37:0/2834368403 learned_addr learned my addr 172.21.15.37:0/2834368403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.700+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb68400d8f0 con 0x5569e95a66a0 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb696ffd700 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 -- 172.21.15.37:0/2834368403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 msgr2=0x5569e95a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 -- 172.21.15.37:0/2834368403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 msgr2=0x5569e95b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 -- 172.21.15.37:0/2834368403 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569e95b2f30 con 0x5569e94294a0 2024-05-09T01:09:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.701+0000 7fb6977fe700 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95bbe20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb688004140 tx=0x7fb688004450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b67294a35f36ccc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.702+0000 7fb67d7fa700 1 -- 172.21.15.37:0/2834368403 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688026070 con 0x5569e94294a0 2024-05-09T01:09:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.702+0000 7fb67d7fa700 1 -- 172.21.15.37:0/2834368403 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb688020e50 con 0x5569e94294a0 2024-05-09T01:09:14.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.702+0000 7fb67d7fa700 1 -- 172.21.15.37:0/2834368403 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688013880 con 0x5569e94294a0 2024-05-09T01:09:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2834368403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 msgr2=0x5569e95bbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95bbe20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb688004140 tx=0x7fb688004450 comp rx=0 tx=0).stop 2024-05-09T01:09:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2834368403 shutdown_connections 2024-05-09T01:09:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e95a66a0 0x5569e95a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e94294a0 0x5569e95bbe20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/2834368403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2834368403 >> 172.21.15.37:0/2834368403 conn(0x5569e94896a0 msgr2=0x5569e95b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:14.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2834368403 shutdown_connections 2024-05-09T01:09:14.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.703+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/2834368403 wait complete. 2024-05-09T01:09:14.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.704+0000 7fb6ac9c9b80 1 -- start start 2024-05-09T01:09:14.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.704+0000 7fb6ac9c9b80 1 Processor -- start 2024-05-09T01:09:14.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.704+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.704+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb6ac9c9b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e95a66a0 0x5569e95c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb68400e690 con 0x5569e9513160 2024-05-09T01:09:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb68400dfc0 con 0x5569e95a66a0 2024-05-09T01:09:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb6ac9c9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb68400b1c0 con 0x5569e94294a0 2024-05-09T01:09:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb6ac9c9b80 10 client.0 _ll_register_callbacks cb 0x5569e933a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb696ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60838/0 (socket says 172.21.15.37:60838) 2024-05-09T01:09:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb696ffd700 1 -- 172.21.15.37:0/1792300280 learned_addr learned my addr 172.21.15.37:0/1792300280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb6977fe700 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb697fff700 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e95a66a0 0x5569e95c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb697fff700 1 -- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 msgr2=0x5569e95b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb697fff700 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb697fff700 1 -- 172.21.15.37:0/1792300280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 msgr2=0x5569e95b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb697fff700 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.705+0000 7fb697fff700 1 -- 172.21.15.37:0/1792300280 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569e95c82d0 con 0x5569e95a66a0 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.706+0000 7fb697fff700 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e95a66a0 0x5569e95c6ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb69000eb80 tx=0x7fb6900099f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd266432d262e58c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.706+0000 7fb676ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.706+0000 7fb676ffd700 1 -- 172.21.15.37:0/1792300280 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69003c020 con 0x5569e95a66a0 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.706+0000 7fb676ffd700 1 -- 172.21.15.37:0/1792300280 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb69000e0b0 con 0x5569e95a66a0 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb688020e50 con 0x5569e95a66a0 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb676ffd700 1 -- 172.21.15.37:0/1792300280 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb690009c60 con 0x5569e95a66a0 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb6ac9c9b80 10 client.26294 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:14.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5569e96299f0 con 0x5569e95a66a0 2024-05-09T01:09:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb676ffd700 1 -- 172.21.15.37:0/1792300280 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb688020e50 con 0x5569e95a66a0 2024-05-09T01:09:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb676ffd700 1 -- 172.21.15.37:0/1792300280 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fb690022040 con 0x5569e95a66a0 2024-05-09T01:09:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb6ac9c9b80 10 client.26294 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb6ac9c9b80 10 client.26294 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:09:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.707+0000 7fb6ac9c9b80 20 client.26294 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:14.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.708+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e962a090 0x5569e962c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.708+0000 7fb6ac9c9b80 4 client.26294 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:09:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.708+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569e94d0a70 con 0x5569e962a090 2024-05-09T01:09:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.708+0000 7fb6977fe700 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e962a090 0x5569e962c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.708+0000 7fb676ffd700 10 client.26294 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:09:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6977fe700 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e962a090 0x5569e962c4b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3384294b85564a77 server_cookie=76240e07199b6473 in_seq=0 out_seq=0 2024-05-09T01:09:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb676ffd700 1 -- 172.21.15.37:0/1792300280 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569e94d0a70 con 0x5569e962a090 2024-05-09T01:09:14.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb676ffd700 10 client.26294 handle_command_reply: tid=0 2024-05-09T01:09:14.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 client.26294 shutdown 2024-05-09T01:09:14.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e95a66a0 msgr2=0x5569e95c6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e95a66a0 0x5569e95c6ab0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb69000eb80 tx=0x7fb6900099f0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 shutdown_connections 2024-05-09T01:09:14.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x5569e962a090 0x5569e962c4b0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb676ffd700 0 client.26294 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5569e95a66a0 0x5569e95c6ab0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569e94294a0 0x5569e95b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 --2- 172.21.15.37:0/1792300280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569e9513160 0x5569e95b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 >> 172.21.15.37:0/1792300280 conn(0x5569e94896a0 msgr2=0x5569e95a9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 shutdown_connections 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.709+0000 7fb6ac9c9b80 1 -- 172.21.15.37:0/1792300280 wait complete. 2024-05-09T01:09:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.710+0000 7fb6ac9c9b80 20 client.26294 trim_cache size 0 max 16384 2024-05-09T01:09:14.718 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:09:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb6800b2a10 msgr2=0x7fb6800b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb6800b2a10 0x7fb6800b4f20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb69000c6c0 tx=0x7fb690019000 comp rx=0 tx=0).stop 2024-05-09T01:09:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 msgr2=0x7fb6981a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 0x7fb6981a1ac0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0098e0 tx=0x7fb68c004690 comp rx=0 tx=0).stop 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 shutdown_connections 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb6800b2a10 0x7fb6800b4f20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb698108740 0x7fb6981a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6981034c0 0x7fb6981a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 --2- 172.21.15.37:0/764987046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb698107df0 0x7fb6981a1ac0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 >> 172.21.15.37:0/764987046 conn(0x7fb6980fedc0 msgr2=0x7fb6981011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 shutdown_connections 2024-05-09T01:09:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:14.711+0000 7fb69dfb3700 1 -- 172.21.15.37:0/764987046 wait complete. 2024-05-09T01:09:14.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:14 smithi151 ceph-mon[34780]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 657 op/s 2024-05-09T01:09:14.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:14 smithi136 ceph-mon[34110]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 657 op/s 2024-05-09T01:09:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 415.0 s, 1964.6 tps, lat 50.848 ms stddev 56.555 2024-05-09T01:09:15.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:09:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:16.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:16 smithi037 ceph-mon[30122]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 671 op/s 2024-05-09T01:09:16.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:16 smithi151 ceph-mon[34780]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 671 op/s 2024-05-09T01:09:16.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:16 smithi136 ceph-mon[34110]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.6 MiB/s wr, 671 op/s 2024-05-09T01:09:17.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.894+0000 7fcf81427700 1 -- 172.21.15.37:0/3208460830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 msgr2=0x7fcf7c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.894+0000 7fcf81427700 1 --2- 172.21.15.37:0/3208460830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 0x7fcf7c108200 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fcf700099c0 tx=0x7fcf70009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.894+0000 7fcf81427700 1 -- 172.21.15.37:0/3208460830 shutdown_connections 2024-05-09T01:09:17.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.894+0000 7fcf81427700 1 --2- 172.21.15.37:0/3208460830 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c108740 0x7fcf7c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.894+0000 7fcf81427700 1 --2- 172.21.15.37:0/3208460830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c1034c0 0x7fcf7c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.894+0000 7fcf81427700 1 --2- 172.21.15.37:0/3208460830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 0x7fcf7c108200 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.894+0000 7fcf81427700 1 -- 172.21.15.37:0/3208460830 >> 172.21.15.37:0/3208460830 conn(0x7fcf7c0fedc0 msgr2=0x7fcf7c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:17.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.895+0000 7fcf81427700 1 -- 172.21.15.37:0/3208460830 shutdown_connections 2024-05-09T01:09:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.895+0000 7fcf81427700 1 -- 172.21.15.37:0/3208460830 wait complete. 2024-05-09T01:09:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.897+0000 7fcf81427700 1 Processor -- start 2024-05-09T01:09:17.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.897+0000 7fcf81427700 1 -- start start 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf81427700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c1034c0 0x7fcf7c075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf81427700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 0x7fcf7c06f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf81427700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c108740 0x7fcf7c06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf81427700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c113430 con 0x7fcf7c107df0 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf81427700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1132b0 con 0x7fcf7c1034c0 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf81427700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1135b0 con 0x7fcf7c108740 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c1034c0 0x7fcf7c075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 0x7fcf7c06f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c1034c0 0x7fcf7c075480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34814/0 (socket says 172.21.15.37:34814) 2024-05-09T01:09:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 -- 172.21.15.37:0/386273135 learned_addr learned my addr 172.21.15.37:0/386273135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:17.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c108740 0x7fcf7c06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 -- 172.21.15.37:0/386273135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c108740 msgr2=0x7fcf7c06fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c108740 0x7fcf7c06fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 -- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 msgr2=0x7fcf7c06f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 0x7fcf7c06f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.898+0000 7fcf7affd700 1 -- 172.21.15.37:0/386273135 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf7c1af940 con 0x7fcf7c1034c0 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.899+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c108740 0x7fcf7c06fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.899+0000 7fcf7affd700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c1034c0 0x7fcf7c075480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00b550 tx=0x7fcf6c00b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.899+0000 7fcf63fff700 1 -- 172.21.15.37:0/386273135 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c015020 con 0x7fcf7c1034c0 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.899+0000 7fcf63fff700 1 -- 172.21.15.37:0/386273135 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf6c011ce0 con 0x7fcf7c1034c0 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.899+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf7c1afb10 con 0x7fcf7c1034c0 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.899+0000 7fcf63fff700 1 -- 172.21.15.37:0/386273135 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c010c80 con 0x7fcf7c1034c0 2024-05-09T01:09:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.899+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf7c1b0070 con 0x7fcf7c1034c0 2024-05-09T01:09:17.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.904+0000 7fcf63fff700 1 -- 172.21.15.37:0/386273135 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcf6c018020 con 0x7fcf7c1034c0 2024-05-09T01:09:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.905+0000 7fcf8fe3db80 1 Processor -- start 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.905+0000 7fcf8fe3db80 1 -- start start 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.906+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x56400030d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.906+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x56400030da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.906+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640003076a0 0x564000307ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.906+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564000229ff0 con 0x564000274160 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.906+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5640001c87f0 con 0x56400018a4a0 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.906+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564000225fb0 con 0x5640003076a0 2024-05-09T01:09:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.907+0000 7fcf63fff700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcf640b2900 0x7fcf640b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.907+0000 7fcf7affd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x56400030da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.907+0000 7fcf7b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x56400030d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.907+0000 7fcf7b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x56400030d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60870/0 (socket says 172.21.15.37:60870) 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.907+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/959061357 learned_addr learned my addr 172.21.15.37:0/959061357 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.907+0000 7fcf63fff700 1 -- 172.21.15.37:0/386273135 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcf6c0e17c0 con 0x7fcf7c1034c0 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.908+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcf640b2900 0x7fcf640b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.908+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640003076a0 0x564000307ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.908+0000 7fcf7affd700 1 -- 172.21.15.37:0/959061357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640003076a0 msgr2=0x564000307ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.908+0000 7fcf7affd700 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640003076a0 0x564000307ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.908+0000 7fcf7affd700 1 -- 172.21.15.37:0/959061357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 msgr2=0x56400030d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.908+0000 7fcf7affd700 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x56400030d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.908+0000 7fcf7affd700 1 -- 172.21.15.37:0/959061357 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640001c0370 con 0x56400018a4a0 2024-05-09T01:09:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.909+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640003076a0 0x564000307ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.909+0000 7fcf7affd700 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x56400030da30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0df3b0 tx=0x7fcf6c09d750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ba5d72f5b0ee6d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.909+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcf640b2900 0x7fcf640b4e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcf740060b0 tx=0x7fcf7400d3d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.909+0000 7fcf617fa700 1 -- 172.21.15.37:0/959061357 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c018310 con 0x56400018a4a0 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.909+0000 7fcf617fa700 1 -- 172.21.15.37:0/959061357 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf6c0a8990 con 0x56400018a4a0 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.909+0000 7fcf617fa700 1 -- 172.21.15.37:0/959061357 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00ded0 con 0x56400018a4a0 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.910+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/959061357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 msgr2=0x56400030da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.910+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x56400030da30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0df3b0 tx=0x7fcf6c09d750 comp rx=0 tx=0).stop 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/959061357 shutdown_connections 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640003076a0 0x564000307ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x56400030d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/959061357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x56400030da30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/959061357 >> 172.21.15.37:0/959061357 conn(0x5640001ea6a0 msgr2=0x564000302400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/959061357 shutdown_connections 2024-05-09T01:09:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/959061357 wait complete. 2024-05-09T01:09:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.911+0000 7fcf8fe3db80 1 -- start start 2024-05-09T01:09:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.912+0000 7fcf8fe3db80 1 Processor -- start 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x564000311230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564000274160 0x564000311770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5640000a5ba0 con 0x5640003076a0 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5640001e4150 con 0x56400018a4a0 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5640003141d0 con 0x564000274160 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60882/0 (socket says 172.21.15.37:60882) 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/2372405855 learned_addr learned my addr 172.21.15.37:0/2372405855 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf8fe3db80 10 client.0 _ll_register_callbacks cb 0x56400009b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564000274160 0x564000311770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/2372405855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564000274160 msgr2=0x564000311770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564000274160 0x564000311770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/2372405855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 msgr2=0x564000311230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x564000311230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/2372405855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640000a5490 con 0x5640003076a0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.913+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564000274160 0x564000311770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311cb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf74019d40 tx=0x7fcf7401b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a6321843aec47b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2372405855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7401f040 con 0x5640003076a0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2372405855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcf74011070 con 0x5640003076a0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf6c0a8990 con 0x5640003076a0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2372405855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fcf74019e20 con 0x5640003076a0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf8fe3db80 10 client.16488 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56400031ec10 con 0x5640003076a0 2024-05-09T01:09:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.914+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2372405855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf6c0a8990 con 0x5640003076a0 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2372405855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fcf7402c030 con 0x5640003076a0 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf8fe3db80 10 client.16488 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf8fe3db80 10 client.16488 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf8fe3db80 20 client.16488 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564000321250 0x564000323710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf8fe3db80 4 client.16488 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640002379d0 con 0x564000321250 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.915+0000 7fcf7affd700 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564000321250 0x564000323710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.916+0000 7fcf7affd700 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564000321250 0x564000323710 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85cb0f32957b90e1 server_cookie=b630c3801e25cb12 in_seq=0 out_seq=0 2024-05-09T01:09:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.916+0000 7fcf5eff5700 10 client.16488 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:09:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.918+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2372405855 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5640002379d0 con 0x564000321250 2024-05-09T01:09:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.918+0000 7fcf5eff5700 10 client.16488 handle_command_reply: tid=0 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 client.16488 shutdown 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 msgr2=0x564000311cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311cb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcf74019d40 tx=0x7fcf7401b070 comp rx=0 tx=0).stop 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 shutdown_connections 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564000321250 0x564000323710 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf5eff5700 0 client.16488 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311cb0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56400018a4a0 0x564000311230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2372405855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564000274160 0x564000311770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 >> 172.21.15.37:0/2372405855 conn(0x5640001ea6a0 msgr2=0x5640003021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 shutdown_connections 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2372405855 wait complete. 2024-05-09T01:09:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.919+0000 7fcf8fe3db80 20 client.16488 trim_cache size 0 max 16384 2024-05-09T01:09:17.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.944+0000 7fcf8fe3db80 1 Processor -- start 2024-05-09T01:09:17.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.944+0000 7fcf8fe3db80 1 -- start start 2024-05-09T01:09:17.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x56400030ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564000274160 0x5640003070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf7affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x56400030ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1b72b0 con 0x5640003076a0 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1b8df0 con 0x564000274160 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1b7980 con 0x56400018a4a0 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf7affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x56400030ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49170/0 (socket says 172.21.15.37:49170) 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf7affd700 1 -- 172.21.15.37:0/2529397122 learned_addr learned my addr 172.21.15.37:0/2529397122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.945+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564000274160 0x5640003070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.946+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/2529397122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 msgr2=0x56400030ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.946+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x56400030ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.946+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/2529397122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564000274160 msgr2=0x5640003070c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.946+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564000274160 0x5640003070c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.946+0000 7fcf7b7fe700 1 -- 172.21.15.37:0/2529397122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564000304150 con 0x5640003076a0 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.947+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311af0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcf74019d10 tx=0x7fcf74007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aebd38f15742b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.947+0000 7fcf60ff9700 1 -- 172.21.15.37:0/2529397122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf740353a0 con 0x5640003076a0 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.947+0000 7fcf60ff9700 1 -- 172.21.15.37:0/2529397122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf74016e70 con 0x5640003076a0 2024-05-09T01:09:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.947+0000 7fcf60ff9700 1 -- 172.21.15.37:0/2529397122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf740237f0 con 0x5640003076a0 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.948+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2529397122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 msgr2=0x564000311af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.948+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311af0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcf74019d10 tx=0x7fcf74007b40 comp rx=0 tx=0).stop 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.948+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2529397122 shutdown_connections 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.948+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640003076a0 0x564000311af0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.948+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x56400030ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.949+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2529397122 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564000274160 0x5640003070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.949+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2529397122 >> 172.21.15.37:0/2529397122 conn(0x5640001ea6a0 msgr2=0x56400030b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.949+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2529397122 shutdown_connections 2024-05-09T01:09:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.949+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2529397122 wait complete. 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.949+0000 7fcf8fe3db80 1 -- start start 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.949+0000 7fcf8fe3db80 1 Processor -- start 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x564000319a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x5640003286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf8fe3db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640003076a0 0x564000328d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1b8720 con 0x564000274160 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1b8050 con 0x5640003076a0 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf8fe3db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7c1b52f0 con 0x56400018a4a0 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf7a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x5640003286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf8fe3db80 10 client.0 _ll_register_callbacks cb 0x56400030cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf7a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x5640003286b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60902/0 (socket says 172.21.15.37:60902) 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf7a7fc700 1 -- 172.21.15.37:0/2134426812 learned_addr learned my addr 172.21.15.37:0/2134426812 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf7affd700 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x564000319a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.950+0000 7fcf7b7fe700 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640003076a0 0x564000328d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.951+0000 7fcf7a7fc700 1 -- 172.21.15.37:0/2134426812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 msgr2=0x564000319a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.951+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x564000319a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.951+0000 7fcf7a7fc700 1 -- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640003076a0 msgr2=0x564000328d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.951+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640003076a0 0x564000328d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.951+0000 7fcf7a7fc700 1 -- 172.21.15.37:0/2134426812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640003294a0 con 0x564000274160 2024-05-09T01:09:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.951+0000 7fcf7a7fc700 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x5640003286b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c076ab0 tx=0x7fcf70003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72af9036fdc952e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.952+0000 7fcf5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.952+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2134426812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70005580 con 0x564000274160 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.952+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf74016e70 con 0x564000274160 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.952+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2134426812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcf7000b790 con 0x564000274160 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.952+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2134426812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fcf7000b990 con 0x564000274160 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.952+0000 7fcf8fe3db80 10 client.16494 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.952+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56400038bbb0 con 0x564000274160 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2134426812 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf7000f460 con 0x564000274160 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2134426812 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fcf7002c030 con 0x564000274160 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf8fe3db80 10 client.16494 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf8fe3db80 10 client.16494 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf8fe3db80 20 client.16494 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56400038c340 0x56400038e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf8fe3db80 4 client.16494 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.953+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcf74016e70 con 0x56400038c340 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.954+0000 7fcf7affd700 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56400038c340 0x56400038e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.954+0000 7fcf7affd700 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56400038c340 0x56400038e760 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43e98f0b25b74670 server_cookie=7fb86d424b3a67fa in_seq=0 out_seq=0 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.954+0000 7fcf5eff5700 10 client.16494 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.954+0000 7fcf5eff5700 1 -- 172.21.15.37:0/2134426812 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcf74016e70 con 0x56400038c340 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.954+0000 7fcf5eff5700 10 client.16494 handle_command_reply: tid=0 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.954+0000 7fcf8fe3db80 1 client.16494 shutdown 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 msgr2=0x5640003286b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x5640003286b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c076ab0 tx=0x7fcf70003e30 comp rx=0 tx=0).stop 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 shutdown_connections 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640003076a0 0x564000328d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56400018a4a0 0x564000319a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x56400038c340 0x56400038e760 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 --2- 172.21.15.37:0/2134426812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564000274160 0x5640003286b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 >> 172.21.15.37:0/2134426812 conn(0x5640001ea6a0 msgr2=0x56400030f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf5eff5700 0 client.16494 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:09:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 shutdown_connections 2024-05-09T01:09:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.955+0000 7fcf8fe3db80 1 -- 172.21.15.37:0/2134426812 wait complete. 2024-05-09T01:09:17.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.956+0000 7fcf8fe3db80 20 client.16494 trim_cache size 0 max 16384 2024-05-09T01:09:17.961 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcf640b2900 msgr2=0x7fcf640b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcf640b2900 0x7fcf640b4e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcf740060b0 tx=0x7fcf7400d3d0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c1034c0 msgr2=0x7fcf7c075480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c1034c0 0x7fcf7c075480 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00b550 tx=0x7fcf6c00b860 comp rx=0 tx=0).stop 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 shutdown_connections 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcf640b2900 0x7fcf640b4e10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c108740 0x7fcf7c06fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.957+0000 7fcf81427700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf7c1034c0 0x7fcf7c075480 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.958+0000 7fcf81427700 1 --2- 172.21.15.37:0/386273135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf7c107df0 0x7fcf7c06f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.958+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 >> 172.21.15.37:0/386273135 conn(0x7fcf7c0fedc0 msgr2=0x7fcf7c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.958+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 shutdown_connections 2024-05-09T01:09:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:17.958+0000 7fcf81427700 1 -- 172.21.15.37:0/386273135 wait complete. 2024-05-09T01:09:18.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:18 smithi037 ceph-mon[30122]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 664 op/s 2024-05-09T01:09:18.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:18 smithi151 ceph-mon[34780]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 664 op/s 2024-05-09T01:09:18.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:18 smithi136 ceph-mon[34110]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 664 op/s 2024-05-09T01:09:18.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:09:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 420.0 s, 2137.4 tps, lat 46.082 ms stddev 53.163 2024-05-09T01:09:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:20 smithi037 ceph-mon[30122]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 616 op/s 2024-05-09T01:09:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:20 smithi151 ceph-mon[34780]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 616 op/s 2024-05-09T01:09:20.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:20 smithi136 ceph-mon[34110]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 616 op/s 2024-05-09T01:09:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.068+0000 7fd4d2e00700 1 -- 172.21.15.37:0/3338428133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4c4097470 msgr2=0x7fd4c4094a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.068+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/3338428133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4c4097470 0x7fd4c4094a80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00098f0 tx=0x7fd4c0009c00 comp rx=0 tx=0).stop 2024-05-09T01:09:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.068+0000 7fd4d2e00700 1 -- 172.21.15.37:0/3338428133 shutdown_connections 2024-05-09T01:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.068+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/3338428133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4c4095630 0x7fd4c40a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.068+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/3338428133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4c4097470 0x7fd4c4094a80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.068+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/3338428133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4097880 0x7fd4c4094fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.068+0000 7fd4d2e00700 1 -- 172.21.15.37:0/3338428133 >> 172.21.15.37:0/3338428133 conn(0x7fd4c400a790 msgr2=0x7fd4c400abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.069+0000 7fd4d2e00700 1 -- 172.21.15.37:0/3338428133 shutdown_connections 2024-05-09T01:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.069+0000 7fd4d2e00700 1 -- 172.21.15.37:0/3338428133 wait complete. 2024-05-09T01:09:21.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 Processor -- start 2024-05-09T01:09:21.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 -- start start 2024-05-09T01:09:21.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4095630 0x7fd4c40a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4c4097470 0x7fd4c40a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4c4097880 0x7fd4c40a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c40a8940 con 0x7fd4c4095630 2024-05-09T01:09:21.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c40a87c0 con 0x7fd4c4097880 2024-05-09T01:09:21.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.070+0000 7fd4d2e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c40a8ac0 con 0x7fd4c4097470 2024-05-09T01:09:21.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.071+0000 7fd4d0b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4095630 0x7fd4c40a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.071+0000 7fd4d0b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4095630 0x7fd4c40a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60924/0 (socket says 172.21.15.37:60924) 2024-05-09T01:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.071+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/1656120028 learned_addr learned my addr 172.21.15.37:0/1656120028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.072+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/1656120028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4c4097470 msgr2=0x7fd4c40a06d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.072+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4c4097470 0x7fd4c40a06d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.072+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/1656120028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4c4097880 msgr2=0x7fd4c40a0c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.072+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4c4097880 0x7fd4c40a0c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.072+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/1656120028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c41350b0 con 0x7fd4c4095630 2024-05-09T01:09:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.073+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4095630 0x7fd4c40a0190 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009230 tx=0x7fd4c000fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.073+0000 7fd4c9ffb700 1 -- 172.21.15.37:0/1656120028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0005220 con 0x7fd4c4095630 2024-05-09T01:09:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.073+0000 7fd4c9ffb700 1 -- 172.21.15.37:0/1656120028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c000b560 con 0x7fd4c4095630 2024-05-09T01:09:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.073+0000 7fd4c9ffb700 1 -- 172.21.15.37:0/1656120028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0003b40 con 0x7fd4c4095630 2024-05-09T01:09:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.073+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c4135340 con 0x7fd4c4095630 2024-05-09T01:09:21.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.074+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c4135840 con 0x7fd4c4095630 2024-05-09T01:09:21.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.080+0000 7fd4c9ffb700 1 -- 172.21.15.37:0/1656120028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd4c0003d00 con 0x7fd4c4095630 2024-05-09T01:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.082+0000 7fd4e1816b80 1 Processor -- start 2024-05-09T01:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.082+0000 7fd4e1816b80 1 -- start start 2024-05-09T01:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.083+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51abd00 0x55d1a52aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.083+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52aef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.083+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a52b8540 0x55d1a52ba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.083+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d1a51d10a0 con 0x55d1a51abd00 2024-05-09T01:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.083+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d1a51769a0 con 0x55d1a51314a0 2024-05-09T01:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.083+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d1a51cd060 con 0x55d1a52b8540 2024-05-09T01:09:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.084+0000 7fd4c9ffb700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4bc0b2900 0x7fd4bc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.084+0000 7fd4d139d700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4bc0b2900 0x7fd4bc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.084+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a52b8540 0x55d1a52ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.084+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a52b8540 0x55d1a52ba960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49212/0 (socket says 172.21.15.37:49212) 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.084+0000 7fd4d0b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.084+0000 7fd4d0b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34874/0 (socket says 172.21.15.37:34874) 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.084+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/517759743 learned_addr learned my addr 172.21.15.37:0/517759743 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/517759743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a52b8540 msgr2=0x55d1a52ba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/517759743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a52b8540 0x55d1a52ba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/517759743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51abd00 msgr2=0x55d1a52aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/517759743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51abd00 0x55d1a52aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/517759743 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a5167500 con 0x55d1a51314a0 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/517759743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52aef70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00a6950 tx=0x7fd4c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=654065cd38b7045c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4d139d700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4bc0b2900 0x7fd4bc0b4e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80094f0 tx=0x7fd4b8009460 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4c9ffb700 1 -- 172.21.15.37:0/1656120028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd4c00e3180 con 0x7fd4c4095630 2024-05-09T01:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.085+0000 7fd4b6ffd700 1 -- 172.21.15.37:0/517759743 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c00aa3e0 con 0x55d1a51314a0 2024-05-09T01:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.086+0000 7fd4b6ffd700 1 -- 172.21.15.37:0/517759743 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c00aafd0 con 0x55d1a51314a0 2024-05-09T01:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.086+0000 7fd4b6ffd700 1 -- 172.21.15.37:0/517759743 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0071180 con 0x55d1a51314a0 2024-05-09T01:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 -- 172.21.15.37:0/517759743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 msgr2=0x55d1a52aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/517759743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52aef70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd4c00a6950 tx=0x7fd4c0009c00 comp rx=0 tx=0).stop 2024-05-09T01:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 -- 172.21.15.37:0/517759743 shutdown_connections 2024-05-09T01:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/517759743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a52b8540 0x55d1a52ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/517759743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51abd00 0x55d1a52aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/517759743 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52aef70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 -- 172.21.15.37:0/517759743 >> 172.21.15.37:0/517759743 conn(0x55d1a5134f70 msgr2=0x55d1a52a9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.087+0000 7fd4e1816b80 1 -- 172.21.15.37:0/517759743 shutdown_connections 2024-05-09T01:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.088+0000 7fd4e1816b80 1 -- 172.21.15.37:0/517759743 wait complete. 2024-05-09T01:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.088+0000 7fd4e1816b80 1 -- start start 2024-05-09T01:09:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.089+0000 7fd4e1816b80 1 Processor -- start 2024-05-09T01:09:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.089+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.089+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.089+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a52b8540 0x55d1a52b6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4d0b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4d0b9c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52b5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34882/0 (socket says 172.21.15.37:34882) 2024-05-09T01:09:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4d139d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a52b8540 0x55d1a52b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4d139d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a52b8540 0x55d1a52b6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60934/0 (socket says 172.21.15.37:60934) 2024-05-09T01:09:21.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49214/0 (socket says 172.21.15.37:49214) 2024-05-09T01:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4d0b9c700 1 -- 172.21.15.37:0/4118706046 learned_addr learned my addr 172.21.15.37:0/4118706046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d1a51769a0 con 0x55d1a52b8540 2024-05-09T01:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d1a516bb20 con 0x55d1a51314a0 2024-05-09T01:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d1a52baea0 con 0x55d1a51abd00 2024-05-09T01:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.090+0000 7fd4e1816b80 10 client.0 _ll_register_callbacks cb 0x55d1a50426c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4d139d700 1 -- 172.21.15.37:0/4118706046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 msgr2=0x55d1a52b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4d139d700 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4d139d700 1 -- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 msgr2=0x55d1a52b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4d139d700 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4d139d700 1 -- 172.21.15.37:0/4118706046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a504c490 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4d139d700 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a52b8540 0x55d1a52b6090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x55d1a52aa110 tx=0x7fd4b8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebc122edfac123c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4abfff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4abfff700 1 -- 172.21.15.37:0/4118706046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8004bd0 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4abfff700 1 -- 172.21.15.37:0/4118706046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd4b8004d70 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.091+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4c00aafd0 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4abfff700 1 -- 172.21.15.37:0/4118706046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd4b8004030 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 10 client.16503 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d1a52c59d0 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4abfff700 1 -- 172.21.15.37:0/4118706046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b8003680 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4abfff700 1 -- 172.21.15.37:0/4118706046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fd4b8011440 con 0x55d1a52b8540 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 10 client.16503 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 20 client.16503 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a52c8010 0x55d1a52ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 4 client.16503 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.092+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd4c00aafd0 con 0x55d1a52c8010 2024-05-09T01:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.093+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a52c8010 0x55d1a52ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.097+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a52c8010 0x55d1a52ca4b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c0abf751b14d6e2 server_cookie=969c65ea115e99ac in_seq=0 out_seq=0 2024-05-09T01:09:21.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.097+0000 7fd4abfff700 10 client.16503 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4abfff700 1 -- 172.21.15.37:0/4118706046 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fd4c00aafd0 con 0x55d1a52c8010 2024-05-09T01:09:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4abfff700 10 client.16503 handle_command_reply: tid=0 2024-05-09T01:09:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 client.16503 shutdown 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a52b8540 msgr2=0x55d1a52b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a52b8540 0x55d1a52b6090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x55d1a52aa110 tx=0x7fd4b8009260 comp rx=0 tx=0).stop 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 shutdown_connections 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a52c8010 0x55d1a52ca4b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a52b8540 0x55d1a52b6090 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a51314a0 0x55d1a52b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/4118706046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.098+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 >> 172.21.15.37:0/4118706046 conn(0x55d1a5134f70 msgr2=0x55d1a52a9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.099+0000 7fd4abfff700 0 client.16503 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.099+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 shutdown_connections 2024-05-09T01:09:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.099+0000 7fd4e1816b80 1 -- 172.21.15.37:0/4118706046 wait complete. 2024-05-09T01:09:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.099+0000 7fd4e1816b80 20 client.16503 trim_cache size 0 max 16384 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 Processor -- start 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 -- start start 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a52adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c414fc10 con 0x55d1a51314a0 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4151750 con 0x55d1a52b8540 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.122+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41502e0 con 0x55d1a51abd00 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49216/0 (socket says 172.21.15.37:49216) 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 -- 172.21.15.37:0/3441992816 learned_addr learned my addr 172.21.15.37:0/3441992816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4d139d700 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a52adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 -- 172.21.15.37:0/3441992816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 msgr2=0x55d1a52adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a52adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 -- 172.21.15.37:0/3441992816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 msgr2=0x55d1a52ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 -- 172.21.15.37:0/3441992816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1a52ae5e0 con 0x55d1a51abd00 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4cbfff700 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b4f10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc052c60 tx=0x7fd4cc06a010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8763733706ead80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4b67fc700 1 -- 172.21.15.37:0/3441992816 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc081440 con 0x55d1a51abd00 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4b67fc700 1 -- 172.21.15.37:0/3441992816 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc081a90 con 0x55d1a51abd00 2024-05-09T01:09:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.123+0000 7fd4b67fc700 1 -- 172.21.15.37:0/3441992816 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc07f9a0 con 0x55d1a51abd00 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 -- 172.21.15.37:0/3441992816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 msgr2=0x55d1a52b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b4f10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc052c60 tx=0x7fd4cc06a010 comp rx=0 tx=0).stop 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 -- 172.21.15.37:0/3441992816 shutdown_connections 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a52adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/3441992816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52b4f10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 -- 172.21.15.37:0/3441992816 >> 172.21.15.37:0/3441992816 conn(0x55d1a5134f70 msgr2=0x55d1a52ad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 -- 172.21.15.37:0/3441992816 shutdown_connections 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.124+0000 7fd4e1816b80 1 -- 172.21.15.37:0/3441992816 wait complete. 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.125+0000 7fd4e1816b80 1 -- start start 2024-05-09T01:09:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.125+0000 7fd4e1816b80 1 Processor -- start 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52bb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4e1816b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a5330810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4d0b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4151080 con 0x55d1a51314a0 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41509b0 con 0x55d1a52b8540 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4e1816b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c414dbd0 con 0x55d1a51abd00 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4e1816b80 10 client.0 _ll_register_callbacks cb 0x55d1a52c4750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52bb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52bb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:49224/0 (socket says 172.21.15.37:49224) 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4cbfff700 1 -- 172.21.15.37:0/2822033106 learned_addr learned my addr 172.21.15.37:0/2822033106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.126+0000 7fd4d139d700 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a5330810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.127+0000 7fd4cbfff700 1 -- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 msgr2=0x55d1a5330810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.127+0000 7fd4cbfff700 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a5330810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.127+0000 7fd4cbfff700 1 -- 172.21.15.37:0/2822033106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 msgr2=0x55d1a52bb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.127+0000 7fd4cbfff700 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52bb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.127+0000 7fd4cbfff700 1 -- 172.21.15.37:0/2822033106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1a52bbe50 con 0x55d1a51abd00 2024-05-09T01:09:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.127+0000 7fd4cbfff700 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52bb5f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc067070 tx=0x7fd4cc081e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c98d9649b6df598 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.127+0000 7fd4abfff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.128+0000 7fd4abfff700 1 -- 172.21.15.37:0/2822033106 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc08d450 con 0x55d1a51abd00 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.128+0000 7fd4abfff700 1 -- 172.21.15.37:0/2822033106 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd4cc08d5f0 con 0x55d1a51abd00 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.128+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4cc081a90 con 0x55d1a51abd00 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.129+0000 7fd4abfff700 1 -- 172.21.15.37:0/2822033106 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd4cc08d7f0 con 0x55d1a51abd00 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.129+0000 7fd4e1816b80 10 client.26302 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.129+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d1a5331d60 con 0x55d1a51abd00 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.129+0000 7fd4abfff700 1 -- 172.21.15.37:0/2822033106 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc08de40 con 0x55d1a51abd00 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.129+0000 7fd4abfff700 1 -- 172.21.15.37:0/2822033106 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fd4cc095030 con 0x55d1a51abd00 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.129+0000 7fd4e1816b80 10 client.26302 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.129+0000 7fd4e1816b80 10 client.26302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.130+0000 7fd4e1816b80 20 client.26302 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.130+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a5332360 0x55d1a5334780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.130+0000 7fd4e1816b80 4 client.26302 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.130+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd4cc081a90 con 0x55d1a5332360 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.130+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a5332360 0x55d1a5334780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.130+0000 7fd4abfff700 10 client.26302 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.130+0000 7fd4d0b9c700 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a5332360 0x55d1a5334780 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aefc831ccc187e11 server_cookie=5da1e3bce856f246 in_seq=0 out_seq=0 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4abfff700 1 -- 172.21.15.37:0/2822033106 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd4cc081a90 con 0x55d1a5332360 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4abfff700 10 client.26302 handle_command_reply: tid=0 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 client.26302 shutdown 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 msgr2=0x55d1a52bb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52bb5f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc067070 tx=0x7fd4cc081e70 comp rx=0 tx=0).stop 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 shutdown_connections 2024-05-09T01:09:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d1a5332360 0x55d1a5334780 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4abfff700 0 client.26302 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d1a52b8540 0x55d1a5330810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1a51314a0 0x55d1a52bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 --2- 172.21.15.37:0/2822033106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1a51abd00 0x55d1a52bb5f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 >> 172.21.15.37:0/2822033106 conn(0x55d1a5134f70 msgr2=0x55d1a52b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 shutdown_connections 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.131+0000 7fd4e1816b80 1 -- 172.21.15.37:0/2822033106 wait complete. 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.132+0000 7fd4e1816b80 20 client.26302 trim_cache size 0 max 16384 2024-05-09T01:09:21.136 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:09:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.132+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4bc0b2900 msgr2=0x7fd4bc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.132+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4bc0b2900 0x7fd4bc0b4e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80094f0 tx=0x7fd4b8009460 comp rx=0 tx=0).stop 2024-05-09T01:09:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4095630 msgr2=0x7fd4c40a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4095630 0x7fd4c40a0190 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd4c0009230 tx=0x7fd4c000fb20 comp rx=0 tx=0).stop 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 shutdown_connections 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd4bc0b2900 0x7fd4bc0b4e10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4c4097880 0x7fd4c40a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c4095630 0x7fd4c40a0190 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 --2- 172.21.15.37:0/1656120028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4c4097470 0x7fd4c40a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 >> 172.21.15.37:0/1656120028 conn(0x7fd4c400a790 msgr2=0x7fd4c40938a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 shutdown_connections 2024-05-09T01:09:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:21.133+0000 7fd4d2e00700 1 -- 172.21.15.37:0/1656120028 wait complete. 2024-05-09T01:09:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:22 smithi037 ceph-mon[30122]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.8 MiB/s wr, 732 op/s 2024-05-09T01:09:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:22 smithi151 ceph-mon[34780]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.8 MiB/s wr, 732 op/s 2024-05-09T01:09:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:22 smithi136 ceph-mon[34110]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.8 MiB/s wr, 732 op/s 2024-05-09T01:09:22.880 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:09:22.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:09:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:24 smithi037 ceph-mon[30122]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 634 op/s 2024-05-09T01:09:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:24 smithi151 ceph-mon[34780]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 634 op/s 2024-05-09T01:09:24.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:24 smithi136 ceph-mon[34110]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 634 op/s 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.195+0000 7f93fe6c9700 1 -- 172.21.15.37:0/3904617160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f81034c0 msgr2=0x7f93f81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.195+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/3904617160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f81034c0 0x7f93f81038d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f93e80099c0 tx=0x7f93e8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.196+0000 7f93fe6c9700 1 -- 172.21.15.37:0/3904617160 shutdown_connections 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.196+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/3904617160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93f8108740 0x7f93f81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.196+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/3904617160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f81034c0 0x7f93f81038d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.196+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/3904617160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93f8107df0 0x7f93f8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.196+0000 7f93fe6c9700 1 -- 172.21.15.37:0/3904617160 >> 172.21.15.37:0/3904617160 conn(0x7f93f80fedc0 msgr2=0x7f93f81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.196+0000 7f93fe6c9700 1 -- 172.21.15.37:0/3904617160 shutdown_connections 2024-05-09T01:09:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.196+0000 7f93fe6c9700 1 -- 172.21.15.37:0/3904617160 wait complete. 2024-05-09T01:09:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.197+0000 7f93fe6c9700 1 Processor -- start 2024-05-09T01:09:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fe6c9700 1 -- start start 2024-05-09T01:09:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fe6c9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93f81034c0 0x7f93f819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fe6c9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93f8107df0 0x7f93f819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fe6c9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f8108740 0x7f93f81a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fe6c9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93f8113370 con 0x7f93f8108740 2024-05-09T01:09:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fe6c9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81131f0 con 0x7f93f8107df0 2024-05-09T01:09:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fe6c9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81134f0 con 0x7f93f81034c0 2024-05-09T01:09:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fcc66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f8108740 0x7f93f81a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93f81034c0 0x7f93f819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93f77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93f8107df0 0x7f93f819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fcc66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f8108740 0x7f93f81a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44638/0 (socket says 172.21.15.37:44638) 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93f81034c0 0x7f93f819d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48012/0 (socket says 172.21.15.37:48012) 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.198+0000 7f93fcc66700 1 -- 172.21.15.37:0/4071576979 learned_addr learned my addr 172.21.15.37:0/4071576979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.199+0000 7f93f77fe700 1 -- 172.21.15.37:0/4071576979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93f81034c0 msgr2=0x7f93f819d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.199+0000 7f93f77fe700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93f81034c0 0x7f93f819d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.199+0000 7f93f77fe700 1 -- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f8108740 msgr2=0x7f93f81a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.199+0000 7f93f77fe700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f8108740 0x7f93f81a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.199+0000 7f93f77fe700 1 -- 172.21.15.37:0/4071576979 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f81a1fe0 con 0x7f93f8107df0 2024-05-09T01:09:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.199+0000 7f93f77fe700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93f8107df0 0x7f93f819d6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00d720 tx=0x7f93ec00da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.200+0000 7f93f57fa700 1 -- 172.21.15.37:0/4071576979 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec014030 con 0x7f93f8107df0 2024-05-09T01:09:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.200+0000 7f93f57fa700 1 -- 172.21.15.37:0/4071576979 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93ec0044d0 con 0x7f93f8107df0 2024-05-09T01:09:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.200+0000 7f93f57fa700 1 -- 172.21.15.37:0/4071576979 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec005480 con 0x7f93f8107df0 2024-05-09T01:09:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.200+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f81a22d0 con 0x7f93f8107df0 2024-05-09T01:09:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.200+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f81a2760 con 0x7f93f8107df0 2024-05-09T01:09:25.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.204+0000 7f93f57fa700 1 -- 172.21.15.37:0/4071576979 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f93ec004020 con 0x7f93f8107df0 2024-05-09T01:09:25.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.212+0000 7f93f57fa700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93e00b29d0 0x7f93e00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.212+0000 7f93f57fa700 1 -- 172.21.15.37:0/4071576979 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93ec0e1950 con 0x7f93f8107df0 2024-05-09T01:09:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.213+0000 7f940d0dfb80 1 Processor -- start 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.217+0000 7f940d0dfb80 1 -- start start 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.218+0000 7f93f7fff700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93e00b29d0 0x7f93e00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.218+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.218+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a2834520 0x5584a29c0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.218+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a29b9f30 0x5584a29ba340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.218+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584a28d4070 con 0x5584a291e1e0 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.218+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5584a2872870 con 0x5584a2834520 2024-05-09T01:09:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.218+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5584a28d0030 con 0x5584a29b9f30 2024-05-09T01:09:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.219+0000 7f93fcc66700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a29b9f30 0x5584a29ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.219+0000 7f93fcc66700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a29b9f30 0x5584a29ba340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48020/0 (socket says 172.21.15.37:48020) 2024-05-09T01:09:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.219+0000 7f93fcc66700 1 -- 172.21.15.37:0/344721819 learned_addr learned my addr 172.21.15.37:0/344721819 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.220+0000 7f93fcc66700 1 -- 172.21.15.37:0/344721819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a2834520 msgr2=0x5584a29c0300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:09:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.220+0000 7f93fcc66700 1 --2- 172.21.15.37:0/344721819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a2834520 0x5584a29c0300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.220+0000 7f93fcc66700 1 -- 172.21.15.37:0/344721819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 msgr2=0x5584a29bfdc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:09:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.220+0000 7f93fcc66700 1 --2- 172.21.15.37:0/344721819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29bfdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.220+0000 7f93fcc66700 1 -- 172.21.15.37:0/344721819 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a286a3f0 con 0x5584a29b9f30 2024-05-09T01:09:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.225+0000 7f93fcc66700 1 --2- 172.21.15.37:0/344721819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a29b9f30 0x5584a29ba340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e690 tx=0x7f93f0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbaaa96d340b21e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:25.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.229+0000 7f93de7fc700 1 -- 172.21.15.37:0/344721819 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0019030 con 0x5584a29b9f30 2024-05-09T01:09:25.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.229+0000 7f93de7fc700 1 -- 172.21.15.37:0/344721819 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93f0004020 con 0x5584a29b9f30 2024-05-09T01:09:25.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.229+0000 7f93de7fc700 1 -- 172.21.15.37:0/344721819 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0007760 con 0x5584a29b9f30 2024-05-09T01:09:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 425.0 s, 2496.8 tps, lat 40.027 ms stddev 52.154 2024-05-09T01:09:25.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.232+0000 7f940d0dfb80 1 -- 172.21.15.37:0/344721819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a29b9f30 msgr2=0x5584a29ba340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.232+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/344721819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a29b9f30 0x5584a29ba340 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93f000e690 tx=0x7f93f0009920 comp rx=0 tx=0).stop 2024-05-09T01:09:25.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.233+0000 7f93f7fff700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93e00b29d0 0x7f93e00b4ee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f93e8003760 tx=0x7f93e801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:25.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.233+0000 7f940d0dfb80 1 -- 172.21.15.37:0/344721819 shutdown_connections 2024-05-09T01:09:25.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.233+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/344721819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a29b9f30 0x5584a29ba340 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.233+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/344721819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.233+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/344721819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a2834520 0x5584a29c0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.233+0000 7f940d0dfb80 1 -- 172.21.15.37:0/344721819 >> 172.21.15.37:0/344721819 conn(0x5584a2894720 msgr2=0x5584a29ac480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:25.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.234+0000 7f940d0dfb80 1 -- 172.21.15.37:0/344721819 shutdown_connections 2024-05-09T01:09:25.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.234+0000 7f940d0dfb80 1 -- 172.21.15.37:0/344721819 wait complete. 2024-05-09T01:09:25.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.235+0000 7f940d0dfb80 1 -- start start 2024-05-09T01:09:25.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.235+0000 7f940d0dfb80 1 Processor -- start 2024-05-09T01:09:25.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.236+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.236+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a291e1e0 0x5584a29c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.237+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a29b9f30 0x5584a29c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.237+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.237+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48030/0 (socket says 172.21.15.37:48030) 2024-05-09T01:09:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.237+0000 7f93f77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a291e1e0 0x5584a29c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.237+0000 7f93f77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a291e1e0 0x5584a29c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51594/0 (socket says 172.21.15.37:51594) 2024-05-09T01:09:25.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.237+0000 7f93f7fff700 1 -- 172.21.15.37:0/1244511860 learned_addr learned my addr 172.21.15.37:0/1244511860 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:25.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.237+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584a274fc20 con 0x5584a29b9f30 2024-05-09T01:09:25.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5584a288e1d0 con 0x5584a291e1e0 2024-05-09T01:09:25.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5584a29bad00 con 0x5584a2834520 2024-05-09T01:09:25.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f93fcc66700 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a29b9f30 0x5584a29c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f940d0dfb80 10 client.0 _ll_register_callbacks cb 0x5584a2745740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f93f7fff700 1 -- 172.21.15.37:0/1244511860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a291e1e0 msgr2=0x5584a29c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f93f7fff700 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a291e1e0 0x5584a29c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f93f7fff700 1 -- 172.21.15.37:0/1244511860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a29b9f30 msgr2=0x5584a29c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f93f7fff700 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a29b9f30 0x5584a29c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.238+0000 7f93f7fff700 1 -- 172.21.15.37:0/1244511860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a274f510 con 0x5584a2834520 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.239+0000 7f93fcc66700 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a29b9f30 0x5584a29c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.239+0000 7f93f7fff700 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29c3af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93e800a010 tx=0x7f93e8005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3300e9a435fbb18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.239+0000 7f93d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.239+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f0004020 con 0x5584a2834520 2024-05-09T01:09:25.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.239+0000 7f93d77fe700 1 -- 172.21.15.37:0/1244511860 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e800b990 con 0x5584a2834520 2024-05-09T01:09:25.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.239+0000 7f93d77fe700 1 -- 172.21.15.37:0/1244511860 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93e800bb30 con 0x5584a2834520 2024-05-09T01:09:25.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.239+0000 7f93d77fe700 1 -- 172.21.15.37:0/1244511860 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f93e800bd30 con 0x5584a2834520 2024-05-09T01:09:25.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.240+0000 7f940d0dfb80 10 client.26314 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:25.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.240+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5584a29d9b40 con 0x5584a2834520 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.243+0000 7f93d77fe700 1 -- 172.21.15.37:0/1244511860 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f93e802e070 con 0x5584a2834520 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.244+0000 7f940d0dfb80 10 client.26314 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.244+0000 7f940d0dfb80 10 client.26314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.244+0000 7f940d0dfb80 20 client.26314 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.244+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a29dc010 0x5584a29de4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.244+0000 7f940d0dfb80 4 client.26314 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.244+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f93f0004020 con 0x5584a29dc010 2024-05-09T01:09:25.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.244+0000 7f93f77fe700 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a29dc010 0x5584a29de4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.245+0000 7f93f77fe700 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a29dc010 0x5584a29de4c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56cb7bf9376e324 server_cookie=d7872793f6559a59 in_seq=0 out_seq=0 2024-05-09T01:09:25.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.245+0000 7f93d77fe700 10 client.26314 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:25.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.247+0000 7f93d77fe700 1 -- 172.21.15.37:0/1244511860 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f93f0004020 con 0x5584a29dc010 2024-05-09T01:09:25.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.247+0000 7f93d77fe700 10 client.26314 handle_command_reply: tid=0 2024-05-09T01:09:25.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.247+0000 7f940d0dfb80 1 client.26314 shutdown 2024-05-09T01:09:25.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 msgr2=0x5584a29c3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29c3af0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93e800a010 tx=0x7f93e8005040 comp rx=0 tx=0).stop 2024-05-09T01:09:25.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 shutdown_connections 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a29dc010 0x5584a29de4c0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a29b9f30 0x5584a29c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29c3af0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/1244511860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a291e1e0 0x5584a29c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 >> 172.21.15.37:0/1244511860 conn(0x5584a2894720 msgr2=0x5584a29ac240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f93d77fe700 0 client.26314 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 shutdown_connections 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 1 -- 172.21.15.37:0/1244511860 wait complete. 2024-05-09T01:09:25.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.248+0000 7f940d0dfb80 20 client.26314 trim_cache size 0 max 16384 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 Processor -- start 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 -- start start 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29be150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81ac7a0 con 0x5584a291e1e0 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81ae2e0 con 0x5584a29b9f30 2024-05-09T01:09:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.283+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81ace70 con 0x5584a2834520 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44660/0 (socket says 172.21.15.37:44660) 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 -- 172.21.15.37:0/3616414269 learned_addr learned my addr 172.21.15.37:0/3616414269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93fcc66700 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 -- 172.21.15.37:0/3616414269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 msgr2=0x5584a29be150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29be150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 -- 172.21.15.37:0/3616414269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 msgr2=0x5584a29c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 -- 172.21.15.37:0/3616414269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a29c6390 con 0x5584a291e1e0 2024-05-09T01:09:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93fcc66700 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.284+0000 7f93f77fe700 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29c43b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0df450 tx=0x7f93ec007460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ba8b1d051dc214 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.285+0000 7f93ddffb700 1 -- 172.21.15.37:0/3616414269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec01d040 con 0x5584a291e1e0 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.285+0000 7f93ddffb700 1 -- 172.21.15.37:0/3616414269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93ec0ad320 con 0x5584a291e1e0 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.285+0000 7f93ddffb700 1 -- 172.21.15.37:0/3616414269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0a91d0 con 0x5584a291e1e0 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.286+0000 7f940d0dfb80 1 -- 172.21.15.37:0/3616414269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 msgr2=0x5584a29c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.286+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29c43b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0df450 tx=0x7f93ec007460 comp rx=0 tx=0).stop 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.286+0000 7f940d0dfb80 1 -- 172.21.15.37:0/3616414269 shutdown_connections 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.286+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.286+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a2834520 0x5584a29be150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.286+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/3616414269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a291e1e0 0x5584a29c43b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.286+0000 7f940d0dfb80 1 -- 172.21.15.37:0/3616414269 >> 172.21.15.37:0/3616414269 conn(0x5584a2894720 msgr2=0x5584a29c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.287+0000 7f940d0dfb80 1 -- 172.21.15.37:0/3616414269 shutdown_connections 2024-05-09T01:09:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.287+0000 7f940d0dfb80 1 -- 172.21.15.37:0/3616414269 wait complete. 2024-05-09T01:09:25.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.287+0000 7f940d0dfb80 1 -- start start 2024-05-09T01:09:25.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.287+0000 7f940d0dfb80 1 Processor -- start 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a2834520 0x5584a2a3fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a291e1e0 0x5584a2a400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f940d0dfb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81adc10 con 0x5584a2834520 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93f81ad540 con 0x5584a29b9f30 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f940d0dfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93f810dd30 con 0x5584a291e1e0 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f940d0dfb80 10 client.0 _ll_register_callbacks cb 0x5584a2745740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a2834520 0x5584a2a3fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a291e1e0 0x5584a2a400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a291e1e0 0x5584a2a400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48042/0 (socket says 172.21.15.37:48042) 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a2834520 0x5584a2a3fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44676/0 (socket says 172.21.15.37:44676) 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 -- 172.21.15.37:0/948266165 learned_addr learned my addr 172.21.15.37:0/948266165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93fcc66700 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 -- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 msgr2=0x5584a29b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 -- 172.21.15.37:0/948266165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a2834520 msgr2=0x5584a2a3fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a2834520 0x5584a2a3fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 -- 172.21.15.37:0/948266165 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a29b4600 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93f77fe700 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a291e1e0 0x5584a2a400e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000c00 tx=0x7f93ec0a90a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18fb804feb74c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.288+0000 7f93d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f93d77fe700 1 -- 172.21.15.37:0/948266165 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0b6060 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f93d77fe700 1 -- 172.21.15.37:0/948266165 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93ec004ac0 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93ec0ad320 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f93d77fe700 1 -- 172.21.15.37:0/948266165 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f93ec01d040 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f940d0dfb80 10 client.26320 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5584a2a472b0 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f93d77fe700 1 -- 172.21.15.37:0/948266165 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93ec0a91d0 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f93d77fe700 1 -- 172.21.15.37:0/948266165 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f93ec0bb070 con 0x5584a291e1e0 2024-05-09T01:09:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f940d0dfb80 10 client.26320 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f940d0dfb80 10 client.26320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.289+0000 7f940d0dfb80 20 client.26320 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.290+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a2a478c0 0x5584a2a49ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.290+0000 7f940d0dfb80 4 client.26320 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:09:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.290+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f93ec0ad320 con 0x5584a2a478c0 2024-05-09T01:09:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.290+0000 7f93f7fff700 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a2a478c0 0x5584a2a49ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.290+0000 7f93d77fe700 10 client.26320 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.291+0000 7f93f7fff700 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a2a478c0 0x5584a2a49ce0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb1728a2ce80a9c0 server_cookie=116500aa368982a2 in_seq=0 out_seq=0 2024-05-09T01:09:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f93d77fe700 1 -- 172.21.15.37:0/948266165 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f93ec0ad320 con 0x5584a2a478c0 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f93d77fe700 10 client.26320 handle_command_reply: tid=0 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 client.26320 shutdown 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a291e1e0 msgr2=0x5584a2a400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a291e1e0 0x5584a2a400e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f93ec000c00 tx=0x7f93ec0a90a0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 shutdown_connections 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5584a2a478c0 0x5584a2a49ce0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f93d77fe700 0 client.26320 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5584a29b9f30 0x5584a29b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584a2834520 0x5584a2a3fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 --2- 172.21.15.37:0/948266165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584a291e1e0 0x5584a2a400e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.293+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 >> 172.21.15.37:0/948266165 conn(0x5584a2894720 msgr2=0x5584a29bdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:25.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.295+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 shutdown_connections 2024-05-09T01:09:25.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.296+0000 7f940d0dfb80 1 -- 172.21.15.37:0/948266165 wait complete. 2024-05-09T01:09:25.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.296+0000 7f940d0dfb80 20 client.26320 trim_cache size 0 max 16384 2024-05-09T01:09:25.297 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:09:25.298 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:09:25.298 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "2adbe8c6-41d8-4b41-912a-877f9d952df5", 2024-05-09T01:09:25.298 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:09:25.298 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93e00b29d0 msgr2=0x7f93e00b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93e00b29d0 0x7f93e00b4ee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f93e8003760 tx=0x7f93e801a040 comp rx=0 tx=0).stop 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93f8107df0 msgr2=0x7f93f819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93f8107df0 0x7f93f819d6b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00d720 tx=0x7f93ec00da30 comp rx=0 tx=0).stop 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 shutdown_connections 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93e00b29d0 0x7f93e00b4ee0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93f8108740 0x7f93f81a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93f81034c0 0x7f93f819d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 --2- 172.21.15.37:0/4071576979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93f8107df0 0x7f93f819d6b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 >> 172.21.15.37:0/4071576979 conn(0x7f93f80fedc0 msgr2=0x7f93f810eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 shutdown_connections 2024-05-09T01:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:25.297+0000 7f93fe6c9700 1 -- 172.21.15.37:0/4071576979 wait complete. 2024-05-09T01:09:25.629 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:09:25 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:09:25.318+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001a [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact/ auth{1=1,2=1,3=1,4=1} v804 ap=2 f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0) n(v4 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@11} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8323600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001a:[<0x10000000006/pg_xact v414>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000001a:[<0x10000000006/pg_xact v804>,<0x10000000005/data v545>,<0x100000001fb/postgres v294>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v314>,<0x10000000001/sv_1 v334>,<0x10000000000/qa v324>,<0x1/volumes v307>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:02:06.872458+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1)","memory_value.dirstat":"f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0)","memory_value.rstat":"n(v4 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:09:25.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:25 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:09:25.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:25 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:09:25.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:25 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:09:26.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:09:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:09:26.697 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 641 op/s 2024-05-09T01:09:26.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:09:26.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:09:26.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:09:26.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:09:26.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:09:26.698 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:09:26.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:26 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 641 op/s 2024-05-09T01:09:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:09:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:26 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 -- 172.21.15.37:0/736108400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998102b50 msgr2=0x7f2998103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 --2- 172.21.15.37:0/736108400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998102b50 0x7f2998103850 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2988009900 tx=0x7f298802a3f0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 -- 172.21.15.37:0/736108400 shutdown_connections 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 --2- 172.21.15.37:0/736108400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2998108a90 0x7f299810aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 --2- 172.21.15.37:0/736108400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 0x7f29981041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 --2- 172.21.15.37:0/736108400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998102b50 0x7f2998103850 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 -- 172.21.15.37:0/736108400 >> 172.21.15.37:0/736108400 conn(0x7f29980fdd40 msgr2=0x7f29981001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 -- 172.21.15.37:0/736108400 shutdown_connections 2024-05-09T01:09:26.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.743+0000 7f299fe69640 1 -- 172.21.15.37:0/736108400 wait complete. 2024-05-09T01:09:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.744+0000 7f299fe69640 1 Processor -- start 2024-05-09T01:09:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.744+0000 7f299fe69640 1 -- start start 2024-05-09T01:09:26.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299fe69640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2998102b50 0x7f299819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299fe69640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 0x7f299819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299fe69640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998108a90 0x7f29981a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299fe69640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f299810f770 con 0x7f2998102b50 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299fe69640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f299810f5f0 con 0x7f2998103d90 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299fe69640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f299810f8f0 con 0x7f2998108a90 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 0x7f299819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 0x7f299819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51626/0 (socket says 172.21.15.37:51626) 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 -- 172.21.15.37:0/1042934957 learned_addr learned my addr 172.21.15.37:0/1042934957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299e406640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998108a90 0x7f29981a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299dc05640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2998102b50 0x7f299819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 -- 172.21.15.37:0/1042934957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998108a90 msgr2=0x7f29981a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998108a90 0x7f29981a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 -- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2998102b50 msgr2=0x7f299819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2998102b50 0x7f299819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.745+0000 7f299d404640 1 -- 172.21.15.37:0/1042934957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29981a1ea0 con 0x7f2998103d90 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.746+0000 7f299dc05640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2998102b50 0x7f299819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.746+0000 7f299d404640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 0x7f299819a8a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f299000eab0 tx=0x7f299000ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.746+0000 7f298effd640 1 -- 172.21.15.37:0/1042934957 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299000ce40 con 0x7f2998103d90 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.746+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299810b600 con 0x7f2998103d90 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.746+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299810bba0 con 0x7f2998103d90 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.746+0000 7f298effd640 1 -- 172.21.15.37:0/1042934957 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2990011920 con 0x7f2998103d90 2024-05-09T01:09:26.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.746+0000 7f298effd640 1 -- 172.21.15.37:0/1042934957 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990010a30 con 0x7f2998103d90 2024-05-09T01:09:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.750+0000 7f29a6df1740 1 Processor -- start 2024-05-09T01:09:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.750+0000 7f29a6df1740 1 -- start start 2024-05-09T01:09:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f887198500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dcb2f0 0x55f887198a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dd34d0 0x55f88719f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f29a6df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f8870fc7c0 con 0x55f886dcb2f0 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f29a6df1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f8870980e0 con 0x55f886df41b0 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f29a6df1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f8870f8780 con 0x55f886dd34d0 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f298effd640 1 -- 172.21.15.37:0/1042934957 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2990010bd0 con 0x7f2998103d90 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f299e406640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f887198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f299e406640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f887198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51630/0 (socket says 172.21.15.37:51630) 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f299e406640 1 -- 172.21.15.37:0/3288986689 learned_addr learned my addr 172.21.15.37:0/3288986689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f299dc05640 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dcb2f0 0x55f887198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.751+0000 7f299d404640 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dd34d0 0x55f88719f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f299e406640 1 -- 172.21.15.37:0/3288986689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dd34d0 msgr2=0x55f88719f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f299e406640 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dd34d0 0x55f88719f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f299e406640 1 -- 172.21.15.37:0/3288986689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dcb2f0 msgr2=0x55f887198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f299e406640 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dcb2f0 0x55f887198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f299e406640 1 -- 172.21.15.37:0/3288986689 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8870c17c0 con 0x55f886df41b0 2024-05-09T01:09:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f299d404640 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dd34d0 0x55f88719f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:09:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f299e406640 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f887198500 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2994009ca0 tx=0x7f2994011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b95ce02e1d2749 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f2983fff640 1 -- 172.21.15.37:0/3288986689 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299401e070 con 0x55f886df41b0 2024-05-09T01:09:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f2983fff640 1 -- 172.21.15.37:0/3288986689 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2994009e50 con 0x55f886df41b0 2024-05-09T01:09:26.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f2983fff640 1 -- 172.21.15.37:0/3288986689 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299400e9a0 con 0x55f886df41b0 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.752+0000 7f298effd640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29840b28e0 0x7f29840b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f299dc05640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29840b28e0 0x7f29840b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f298effd640 1 -- 172.21.15.37:0/1042934957 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f29900e2600 con 0x7f2998103d90 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f29a6df1740 1 -- 172.21.15.37:0/3288986689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 msgr2=0x55f887198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f887198500 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2994009ca0 tx=0x7f2994011810 comp rx=0 tx=0).stop 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f29a6df1740 1 -- 172.21.15.37:0/3288986689 shutdown_connections 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dd34d0 0x55f88719f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dcb2f0 0x55f887198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3288986689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f887198500 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.753+0000 7f29a6df1740 1 -- 172.21.15.37:0/3288986689 >> 172.21.15.37:0/3288986689 conn(0x55f886de8300 msgr2=0x55f887193e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:26.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.754+0000 7f29a6df1740 1 -- 172.21.15.37:0/3288986689 shutdown_connections 2024-05-09T01:09:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.755+0000 7f29a6df1740 1 -- 172.21.15.37:0/3288986689 wait complete. 2024-05-09T01:09:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.755+0000 7f299dc05640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29840b28e0 0x7f29840b4df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2988009230 tx=0x7f298803c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.755+0000 7f29a6df1740 1 -- start start 2024-05-09T01:09:26.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.755+0000 7f29a6df1740 1 Processor -- start 2024-05-09T01:09:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f8871a9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f29a6df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f8871a03d0 con 0x55f886df41b0 2024-05-09T01:09:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f29a6df1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f8870839c0 con 0x55f886dd34d0 2024-05-09T01:09:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f29a6df1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f8871a0550 con 0x55f886dcb2f0 2024-05-09T01:09:26.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f29a6df1740 10 client.0 _ll_register_callbacks cb 0x55f8870b0020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299e406640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f8871a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299dc05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299d404640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299e406640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f8871a9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44704/0 (socket says 172.21.15.37:44704) 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299e406640 1 -- 172.21.15.37:0/3371988669 learned_addr learned my addr 172.21.15.37:0/3371988669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299d404640 1 -- 172.21.15.37:0/3371988669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 msgr2=0x55f8871a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299d404640 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299d404640 1 -- 172.21.15.37:0/3371988669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 msgr2=0x55f8871a9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299d404640 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f8871a9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299d404640 1 -- 172.21.15.37:0/3371988669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8870aa1f0 con 0x55f886dd34d0 2024-05-09T01:09:26.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.756+0000 7f299e406640 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f8871a9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.757+0000 7f299d404640 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a2830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29900a5ca0 tx=0x7f29900a9630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8375f7945dcc9f2b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.757+0000 7f29817fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.757+0000 7f29817fa640 1 -- 172.21.15.37:0/3371988669 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29900b23c0 con 0x55f886dd34d0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.757+0000 7f29817fa640 1 -- 172.21.15.37:0/3371988669 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f29900b2800 con 0x55f886dd34d0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.757+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2994009e50 con 0x55f886dd34d0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.758+0000 7f29817fa640 1 -- 172.21.15.37:0/3371988669 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f29900a9730 con 0x55f886dd34d0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.758+0000 7f29a6df1740 10 client.26348 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.758+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f886e5f790 con 0x55f886dd34d0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.758+0000 7f29817fa640 1 -- 172.21.15.37:0/3371988669 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2994009e50 con 0x55f886dd34d0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f29817fa640 1 -- 172.21.15.37:0/3371988669 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f299000f040 con 0x55f886dd34d0 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f29a6df1740 10 client.26348 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:26.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f29a6df1740 10 client.26348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f29a6df1740 20 client.26348 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886db2d80 0x55f8871afad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f29a6df1740 4 client.26348 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f88710a3d0 con 0x55f886db2d80 2024-05-09T01:09:26.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.759+0000 7f299dc05640 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886db2d80 0x55f8871afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.760+0000 7f29817fa640 10 client.26348 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.760+0000 7f299dc05640 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886db2d80 0x55f8871afad0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de584a00f3675bd9 server_cookie=36bd203e1a2bc75e in_seq=0 out_seq=0 2024-05-09T01:09:26.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.760+0000 7f29817fa640 1 -- 172.21.15.37:0/3371988669 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f88710a3d0 con 0x55f886db2d80 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.760+0000 7f29817fa640 10 client.26348 handle_command_reply: tid=0 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.760+0000 7f29a6df1740 1 client.26348 shutdown 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.761+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 msgr2=0x55f8871a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.761+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a2830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29900a5ca0 tx=0x7f29900a9630 comp rx=0 tx=0).stop 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.761+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 shutdown_connections 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886db2d80 0x55f8871afad0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f8871a9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a2830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3371988669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 >> 172.21.15.37:0/3371988669 conn(0x55f886de8300 msgr2=0x55f887192700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:26.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29817fa640 0 client.26348 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 shutdown_connections 2024-05-09T01:09:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 1 -- 172.21.15.37:0/3371988669 wait complete. 2024-05-09T01:09:26.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.762+0000 7f29a6df1740 20 client.26348 trim_cache size 0 max 16384 2024-05-09T01:09:26.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.783+0000 7f29a6df1740 1 Processor -- start 2024-05-09T01:09:26.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.784+0000 7f29a6df1740 1 -- start start 2024-05-09T01:09:26.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.784+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f88719c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f88719cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f29a6df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f297c00e290 con 0x55f886df41b0 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f29a6df1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f297c00fdd0 con 0x55f886dd34d0 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f29a6df1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f297c00e960 con 0x55f886dcb2f0 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f88719c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299d404640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f88719c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48098/0 (socket says 172.21.15.37:48098) 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 -- 172.21.15.37:0/3458484594 learned_addr learned my addr 172.21.15.37:0/3458484594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299e406640 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f88719cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 -- 172.21.15.37:0/3458484594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 msgr2=0x55f8871a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 -- 172.21.15.37:0/3458484594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 msgr2=0x55f88719cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f88719cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 -- 172.21.15.37:0/3458484594 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f886ed65f0 con 0x55f886dcb2f0 2024-05-09T01:09:26.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299d404640 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.785+0000 7f299dc05640 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f88719c6f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2988009900 tx=0x7f2988042000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7615937f2cbbb69 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.786+0000 7f29837fe640 1 -- 172.21.15.37:0/3458484594 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988035050 con 0x55f886dcb2f0 2024-05-09T01:09:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.786+0000 7f29837fe640 1 -- 172.21.15.37:0/3458484594 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2988003aa0 con 0x55f886dcb2f0 2024-05-09T01:09:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.786+0000 7f29837fe640 1 -- 172.21.15.37:0/3458484594 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988054750 con 0x55f886dcb2f0 2024-05-09T01:09:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 -- 172.21.15.37:0/3458484594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 msgr2=0x55f88719c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f88719c6f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2988009900 tx=0x7f2988042000 comp rx=0 tx=0).stop 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 -- 172.21.15.37:0/3458484594 shutdown_connections 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886df41b0 0x55f88719cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886dd34d0 0x55f8871a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 --2- 172.21.15.37:0/3458484594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f88719c6f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 -- 172.21.15.37:0/3458484594 >> 172.21.15.37:0/3458484594 conn(0x55f886de8300 msgr2=0x55f8871a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 -- 172.21.15.37:0/3458484594 shutdown_connections 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.787+0000 7f29a6df1740 1 -- 172.21.15.37:0/3458484594 wait complete. 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 -- start start 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 Processor -- start 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dd34d0 0x55f8871a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f8871a6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f297c00f700 con 0x55f886dd34d0 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f297c00f030 con 0x55f886df41b0 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f297c00c270 con 0x55f886dcb2f0 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f29a6df1740 10 client.0 _ll_register_callbacks cb 0x7f29900a99f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f299e406640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f8871a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f299dc05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f299d404640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dd34d0 0x55f8871a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f299dc05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48110/0 (socket says 172.21.15.37:48110) 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f299e406640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f8871a6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51656/0 (socket says 172.21.15.37:51656) 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f299dc05640 1 -- 172.21.15.37:0/1383559594 learned_addr learned my addr 172.21.15.37:0/1383559594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.788+0000 7f299d404640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dd34d0 0x55f8871a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44732/0 (socket says 172.21.15.37:44732) 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299d404640 1 -- 172.21.15.37:0/1383559594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 msgr2=0x55f8871a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299d404640 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299d404640 1 -- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 msgr2=0x55f8871a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:26.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299d404640 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f8871a6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299d404640 1 -- 172.21.15.37:0/1383559594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8870c0ed0 con 0x55f886dd34d0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299e406640 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f8871a6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299dc05640 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f299d404640 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dd34d0 0x55f8871a62b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f29900a6e90 tx=0x7f29900a9aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a32d5a3f606001d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f29817fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f29817fa640 1 -- 172.21.15.37:0/1383559594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29900c8070 con 0x55f886dd34d0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f29817fa640 1 -- 172.21.15.37:0/1383559594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2990011470 con 0x55f886dd34d0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2988003aa0 con 0x55f886dd34d0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f29817fa640 1 -- 172.21.15.37:0/1383559594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f29900b23c0 con 0x55f886dd34d0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f29a6df1740 10 client.16542 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.789+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f88721f810 con 0x55f886dd34d0 2024-05-09T01:09:26.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29817fa640 1 -- 172.21.15.37:0/1383559594 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2988003aa0 con 0x55f886dd34d0 2024-05-09T01:09:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29817fa640 1 -- 172.21.15.37:0/1383559594 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7f29900a5590 con 0x55f886dd34d0 2024-05-09T01:09:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29a6df1740 10 client.16542 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29a6df1740 10 client.16542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29a6df1740 20 client.16542 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29a6df1740 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886d881c0 0x55f887222070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29a6df1740 4 client.16542 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:09:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.791+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f887104240 con 0x55f886d881c0 2024-05-09T01:09:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.792+0000 7f299dc05640 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886d881c0 0x55f887222070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.792+0000 7f29817fa640 10 client.16542 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.792+0000 7f299dc05640 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886d881c0 0x55f887222070 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0f881ce5245fa81 server_cookie=4e600de2cee0839c in_seq=0 out_seq=0 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29817fa640 1 -- 172.21.15.37:0/1383559594 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55f887104240 con 0x55f886d881c0 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29817fa640 10 client.16542 handle_command_reply: tid=0 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29a6df1740 1 client.16542 shutdown 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dd34d0 msgr2=0x55f8871a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29a6df1740 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dd34d0 0x55f8871a62b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f29900a6e90 tx=0x7f29900a9aa0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 shutdown_connections 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29a6df1740 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f886d881c0 0x55f887222070 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.803+0000 7f29a6df1740 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f886df41b0 0x55f8871a6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.804+0000 7f29817fa640 0 client.16542 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.804+0000 7f29a6df1740 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f886dd34d0 0x55f8871a62b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.804+0000 7f29a6df1740 1 --2- 172.21.15.37:0/1383559594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f886dcb2f0 0x55f8871a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.804+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 >> 172.21.15.37:0/1383559594 conn(0x55f886de8300 msgr2=0x55f8871a0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.804+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 shutdown_connections 2024-05-09T01:09:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.804+0000 7f29a6df1740 1 -- 172.21.15.37:0/1383559594 wait complete. 2024-05-09T01:09:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.804+0000 7f29a6df1740 20 client.16542 trim_cache size 0 max 16384 2024-05-09T01:09:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:09:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:09:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29840b28e0 msgr2=0x7f29840b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29840b28e0 0x7f29840b4df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2988009230 tx=0x7f298803c040 comp rx=0 tx=0).stop 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 msgr2=0x7f299819a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 0x7f299819a8a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f299000eab0 tx=0x7f299000ef70 comp rx=0 tx=0).stop 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 shutdown_connections 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2998108a90 0x7f29981a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f29840b28e0 0x7f29840b4df0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2998103d90 0x7f299819a8a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 --2- 172.21.15.37:0/1042934957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2998102b50 0x7f299819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 >> 172.21.15.37:0/1042934957 conn(0x7f29980fdd40 msgr2=0x7f2998104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 shutdown_connections 2024-05-09T01:09:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:26.805+0000 7f299fe69640 1 -- 172.21.15.37:0/1042934957 wait complete. 2024-05-09T01:09:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 641 op/s 2024-05-09T01:09:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:09:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:09:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:09:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:09:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:09:26.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:09:26.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:26.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:26 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:09:28.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.346+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/187638797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c81045f0 msgr2=0x7fc1c8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.346+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/187638797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c81045f0 0x7fc1c8104a00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80099c0 tx=0x7fc1b8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.346+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/187638797 shutdown_connections 2024-05-09T01:09:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.346+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/187638797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c8109870 0x7fc1c81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.346+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/187638797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c81045f0 0x7fc1c8104a00 secure :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80099c0 tx=0x7fc1b8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.346+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/187638797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 0x7fc1c8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.346+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/187638797 >> 172.21.15.37:0/187638797 conn(0x7fc1c8100040 msgr2=0x7fc1c8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.347+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/187638797 shutdown_connections 2024-05-09T01:09:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.347+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/187638797 wait complete. 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.348+0000 7fc1ccd9f700 1 Processor -- start 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.348+0000 7fc1ccd9f700 1 -- start start 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1ccd9f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 0x7fc1c8075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1ccd9f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c8109870 0x7fc1c8076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1ccd9f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c8076540 0x7fc1c81a9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1ccd9f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c81144a0 con 0x7fc1c8109870 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1ccd9f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8114320 con 0x7fc1c8108f20 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1ccd9f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8114620 con 0x7fc1c8076540 2024-05-09T01:09:28.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 0x7fc1c8075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c6d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c8076540 0x7fc1c81a9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1bdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c8109870 0x7fc1c8076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 0x7fc1c8075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51680/0 (socket says 172.21.15.37:51680) 2024-05-09T01:09:28.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c659c700 1 -- 172.21.15.37:0/1949631926 learned_addr learned my addr 172.21.15.37:0/1949631926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c659c700 1 -- 172.21.15.37:0/1949631926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c8076540 msgr2=0x7fc1c81a9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c659c700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c8076540 0x7fc1c81a9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c659c700 1 -- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c8109870 msgr2=0x7fc1c8076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.349+0000 7fc1c659c700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c8109870 0x7fc1c8076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1c659c700 1 -- 172.21.15.37:0/1949631926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c81a9830 con 0x7fc1c8108f20 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c8109870 0x7fc1c8076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1c659c700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 0x7fc1c8075ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80098e0 tx=0x7fc1b8004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1bffff700 1 -- 172.21.15.37:0/1949631926 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8009e60 con 0x7fc1c8108f20 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c81a9ac0 con 0x7fc1c8108f20 2024-05-09T01:09:28.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1bffff700 1 -- 172.21.15.37:0/1949631926 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b8003c70 con 0x7fc1c8108f20 2024-05-09T01:09:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1bffff700 1 -- 172.21.15.37:0/1949631926 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800fad0 con 0x7fc1c8108f20 2024-05-09T01:09:28.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.350+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c81a9f10 con 0x7fc1c8108f20 2024-05-09T01:09:28.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.354+0000 7fc1bffff700 1 -- 172.21.15.37:0/1949631926 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc1b800fc70 con 0x7fc1c8108f20 2024-05-09T01:09:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.355+0000 7fc1bffff700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1b40b2880 0x7fc1b40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.355+0000 7fc1bffff700 1 -- 172.21.15.37:0/1949631926 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc1b80e2d50 con 0x7fc1c8108f20 2024-05-09T01:09:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.355+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1b40b2880 0x7fc1b40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 Processor -- start 2024-05-09T01:09:28.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 -- start start 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1b40b2880 0x7fc1b40b4d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8107c80 tx=0x7fc1b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f759d00 0x55f54f862240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f862780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f85c400 0x55f54f85c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f54f77f0a0 con 0x55f54f759d00 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f54f7249a0 con 0x55f54f6df4a0 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.356+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f54f77b060 con 0x55f54f85c400 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1c6d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f85c400 0x55f54f85c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1c659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f759d00 0x55f54f862240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1c6d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f85c400 0x55f54f85c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48136/0 (socket says 172.21.15.37:48136) 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1c6d9d700 1 -- 172.21.15.37:0/1982991419 learned_addr learned my addr 172.21.15.37:0/1982991419 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:28.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f862780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/1982991419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f85c400 msgr2=0x55f54f85c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f85c400 0x55f54f85c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/1982991419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f759d00 msgr2=0x55f54f862240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f759d00 0x55f54f862240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/1982991419 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f54f715500 con 0x55f54f6df4a0 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.357+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f862780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00042f0 tx=0x7fc1b0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e83a3278e8bb70d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.358+0000 7fc1bcd99700 1 -- 172.21.15.37:0/1982991419 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0003d10 con 0x55f54f6df4a0 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.358+0000 7fc1bcd99700 1 -- 172.21.15.37:0/1982991419 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b00268b0 con 0x55f54f6df4a0 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.358+0000 7fc1bcd99700 1 -- 172.21.15.37:0/1982991419 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b001e7d0 con 0x55f54f6df4a0 2024-05-09T01:09:28.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/1982991419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 msgr2=0x55f54f862780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f862780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00042f0 tx=0x7fc1b0014000 comp rx=0 tx=0).stop 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/1982991419 shutdown_connections 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f85c400 0x55f54f85c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f759d00 0x55f54f862240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/1982991419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f862780 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/1982991419 >> 172.21.15.37:0/1982991419 conn(0x55f54f6e2f70 msgr2=0x55f54f857220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/1982991419 shutdown_connections 2024-05-09T01:09:28.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/1982991419 wait complete. 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.359+0000 7fc1db7b5b80 1 -- start start 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 1 Processor -- start 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f6df4a0 0x55f54f865ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f759d00 0x55f54f866530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f866a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f54f85d160 con 0x55f54f85c400 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f54f719b20 con 0x55f54f759d00 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f54f869020 con 0x55f54f6df4a0 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1db7b5b80 10 client.0 _ll_register_callbacks cb 0x55f54f5f06c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:28.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1bdd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f759d00 0x55f54f866530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1bdd9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f759d00 0x55f54f866530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51704/0 (socket says 172.21.15.37:51704) 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2407670133 learned_addr learned my addr 172.21.15.37:0/2407670133 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.360+0000 7fc1c6d9d700 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f866a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.361+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2407670133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f6df4a0 msgr2=0x55f54f865ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.361+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f6df4a0 0x55f54f865ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.361+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2407670133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 msgr2=0x55f54f866a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.361+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f866a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.361+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2407670133 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f54f5fa490 con 0x55f54f759d00 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.361+0000 7fc1c6d9d700 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f866a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f759d00 0x55f54f866530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0003be0 tx=0x7fc1b0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df2cf76e85c4af5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1adffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1adffb700 1 -- 172.21.15.37:0/2407670133 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0005040 con 0x55f54f759d00 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1adffb700 1 -- 172.21.15.37:0/2407670133 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc1b00051e0 con 0x55f54f759d00 2024-05-09T01:09:28.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b00268b0 con 0x55f54f759d00 2024-05-09T01:09:28.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1adffb700 1 -- 172.21.15.37:0/2407670133 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc1b00053e0 con 0x55f54f759d00 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1db7b5b80 10 client.26366 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.362+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f54f88d220 con 0x55f54f759d00 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1adffb700 1 -- 172.21.15.37:0/2407670133 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b0005580 con 0x55f54f759d00 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1adffb700 1 -- 172.21.15.37:0/2407670133 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fc1b0030530 con 0x55f54f759d00 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1db7b5b80 10 client.26366 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1db7b5b80 10 client.26366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1db7b5b80 20 client.26366 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f88f800 0x55f54f891c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1db7b5b80 4 client.26366 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc1b00268b0 con 0x55f54f88f800 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.363+0000 7fc1c659c700 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f88f800 0x55f54f891c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.364+0000 7fc1adffb700 10 client.26366 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.364+0000 7fc1c659c700 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f88f800 0x55f54f891c20 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d0a2f529b2b939f server_cookie=2ad24b2dfd4377e in_seq=0 out_seq=0 2024-05-09T01:09:28.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1adffb700 1 -- 172.21.15.37:0/2407670133 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fc1b00268b0 con 0x55f54f88f800 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1adffb700 10 client.26366 handle_command_reply: tid=0 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 client.26366 shutdown 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f759d00 msgr2=0x55f54f866530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f759d00 0x55f54f866530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0003be0 tx=0x7fc1b0003c10 comp rx=0 tx=0).stop 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 shutdown_connections 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f88f800 0x55f54f891c20 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f866a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f6df4a0 0x55f54f865ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2407670133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f759d00 0x55f54f866530 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 >> 172.21.15.37:0/2407670133 conn(0x55f54f6e2f70 msgr2=0x55f54f850ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1adffb700 0 client.26366 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.365+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 shutdown_connections 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.366+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2407670133 wait complete. 2024-05-09T01:09:28.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.366+0000 7fc1db7b5b80 20 client.26366 trim_cache size 0 max 16384 2024-05-09T01:09:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.399+0000 7fc1db7b5b80 1 Processor -- start 2024-05-09T01:09:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.403+0000 7fc1db7b5b80 1 -- start start 2024-05-09T01:09:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.403+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f865310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.403+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f87aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.403+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f8668b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.403+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c806fe30 con 0x55f54f85c400 2024-05-09T01:09:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.403+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8071970 con 0x55f54f6df4a0 2024-05-09T01:09:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.403+0000 7fc1db7b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8070500 con 0x55f54f759d00 2024-05-09T01:09:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.407+0000 7fc1c659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f865310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.407+0000 7fc1bdd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f87aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.407+0000 7fc1bdd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f87aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48156/0 (socket says 172.21.15.37:48156) 2024-05-09T01:09:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.407+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/61783720 learned_addr learned my addr 172.21.15.37:0/61783720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.409+0000 7fc1c6d9d700 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f8668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.409+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/61783720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 msgr2=0x55f54f865310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.409+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f865310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.409+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/61783720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 msgr2=0x55f54f8668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.409+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f8668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.410+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/61783720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f54f868890 con 0x55f54f759d00 2024-05-09T01:09:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.416+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f87aa80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0000c00 tx=0x7fc1b00040b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd4fb6c903b91f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.421+0000 7fc1affff700 1 -- 172.21.15.37:0/61783720 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0048070 con 0x55f54f759d00 2024-05-09T01:09:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.421+0000 7fc1affff700 1 -- 172.21.15.37:0/61783720 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1b0030b90 con 0x55f54f759d00 2024-05-09T01:09:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.421+0000 7fc1affff700 1 -- 172.21.15.37:0/61783720 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b003f040 con 0x55f54f759d00 2024-05-09T01:09:28.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.423+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/61783720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 msgr2=0x55f54f87aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.423+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f87aa80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0000c00 tx=0x7fc1b00040b0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.423+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/61783720 shutdown_connections 2024-05-09T01:09:28.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.423+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f85c400 0x55f54f8668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.423+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f6df4a0 0x55f54f865310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.423+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/61783720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f87aa80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.423+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/61783720 >> 172.21.15.37:0/61783720 conn(0x55f54f6e2f70 msgr2=0x55f54f850ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:28.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.430+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/61783720 shutdown_connections 2024-05-09T01:09:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.434+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/61783720 wait complete. 2024-05-09T01:09:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.434+0000 7fc1db7b5b80 1 -- start start 2024-05-09T01:09:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.435+0000 7fc1db7b5b80 1 Processor -- start 2024-05-09T01:09:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.435+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f6df4a0 0x55f54f894980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.436+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f894ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.436+0000 7fc1db7b5b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f85c400 0x55f54f891f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.436+0000 7fc1bdd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f894ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.436+0000 7fc1bdd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f894ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48170/0 (socket says 172.21.15.37:48170) 2024-05-09T01:09:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.437+0000 7fc1c6d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f85c400 0x55f54f891f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.437+0000 7fc1c6d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f85c400 0x55f54f891f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51722/0 (socket says 172.21.15.37:51722) 2024-05-09T01:09:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.437+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2316132441 learned_addr learned my addr 172.21.15.37:0/2316132441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.437+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c80712a0 con 0x55f54f6df4a0 2024-05-09T01:09:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.437+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8070bd0 con 0x55f54f85c400 2024-05-09T01:09:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.437+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c819eb10 con 0x55f54f759d00 2024-05-09T01:09:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1db7b5b80 10 client.0 _ll_register_callbacks cb 0x55f54f5f06c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1c659c700 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f6df4a0 0x55f54f894980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2316132441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f85c400 msgr2=0x55f54f891f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f85c400 0x55f54f891f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2316132441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f6df4a0 msgr2=0x55f54f894980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f6df4a0 0x55f54f894980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1bdd9b700 1 -- 172.21.15.37:0/2316132441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f54f892680 con 0x55f54f759d00 2024-05-09T01:09:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.438+0000 7fc1c659c700 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f6df4a0 0x55f54f894980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:09:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.439+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b0030b90 con 0x55f54f759d00 2024-05-09T01:09:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.440+0000 7fc1bdd9b700 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f894ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0046040 tx=0x7fc1b00057b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5efce0515be3f417 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.440+0000 7fc1adffb700 10 client.26353 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:28.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.441+0000 7fc1adffb700 1 -- 172.21.15.37:0/2316132441 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0048040 con 0x55f54f759d00 2024-05-09T01:09:28.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.441+0000 7fc1adffb700 1 -- 172.21.15.37:0/2316132441 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc1b00437d0 con 0x55f54f759d00 2024-05-09T01:09:28.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.441+0000 7fc1adffb700 1 -- 172.21.15.37:0/2316132441 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc1b003f040 con 0x55f54f759d00 2024-05-09T01:09:28.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.441+0000 7fc1db7b5b80 10 client.26353 fetch_fsmap learned FSMap version 39 2024-05-09T01:09:28.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.441+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55f54f8f96c0 con 0x55f54f759d00 2024-05-09T01:09:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.442+0000 7fc1adffb700 1 -- 172.21.15.37:0/2316132441 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 39) ==== 8354+0+0 (secure 0 0 0) 0x7fc1b0043a10 con 0x55f54f759d00 2024-05-09T01:09:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.442+0000 7fc1db7b5b80 10 client.26353 fetch_fsmap finished waiting for FSMap version 39 2024-05-09T01:09:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.442+0000 7fc1db7b5b80 10 client.26353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.442+0000 7fc1db7b5b80 20 client.26353 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.442+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f8f9b60 0x55f54f8fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.442+0000 7fc1db7b5b80 4 client.26353 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:09:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.442+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f54f78ca80 con 0x55f54f8f9b60 2024-05-09T01:09:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.443+0000 7fc1c659c700 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f8f9b60 0x55f54f8fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.447+0000 7fc1c659c700 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f8f9b60 0x55f54f8fbf80 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdc15a974b428620 server_cookie=b767126342370494 in_seq=0 out_seq=0 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.447+0000 7fc1adffb700 10 client.26353 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.447+0000 7fc1adffb700 1 -- 172.21.15.37:0/2316132441 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f54f78ca80 con 0x55f54f8f9b60 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.447+0000 7fc1adffb700 10 client.26353 handle_command_reply: tid=0 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.447+0000 7fc1db7b5b80 1 client.26353 shutdown 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 msgr2=0x55f54f894ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f894ec0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0046040 tx=0x7fc1b00057b0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 shutdown_connections 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f54f8f9b60 0x55f54f8fbf80 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f54f85c400 0x55f54f891f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1adffb700 0 client.26353 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f54f6df4a0 0x55f54f894980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 --2- 172.21.15.37:0/2316132441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f54f759d00 0x55f54f894ec0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.448+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 >> 172.21.15.37:0/2316132441 conn(0x55f54f6e2f70 msgr2=0x55f54f865070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:28.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.449+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 shutdown_connections 2024-05-09T01:09:28.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.449+0000 7fc1db7b5b80 1 -- 172.21.15.37:0/2316132441 wait complete. 2024-05-09T01:09:28.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.449+0000 7fc1db7b5b80 20 client.26353 trim_cache size 0 max 16384 2024-05-09T01:09:28.451 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:09:28.451 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:09:28.451 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:09:28.452 INFO:teuthology.orchestra.run.smithi037.stdout: "2adbe8c6-41d8-4b41-912a-877f9d952df5": { 2024-05-09T01:09:28.452 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:09:28.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "2adbe8c6-41d8-4b41-912a-877f9d952df5", 2024-05-09T01:09:28.452 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:09:28.452 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:09:28.452 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:09:28.452 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:09:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1b40b2880 msgr2=0x7fc1b40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1b40b2880 0x7fc1b40b4d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8107c80 tx=0x7fc1b0009260 comp rx=0 tx=0).stop 2024-05-09T01:09:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 msgr2=0x7fc1c8075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:28.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 0x7fc1c8075ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80098e0 tx=0x7fc1b8004270 comp rx=0 tx=0).stop 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 shutdown_connections 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc1b40b2880 0x7fc1b40b4d90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c8076540 0x7fc1c81a9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1c8108f20 0x7fc1c8075ac0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 --2- 172.21.15.37:0/1949631926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c8109870 0x7fc1c8076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.451+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 >> 172.21.15.37:0/1949631926 conn(0x7fc1c8100040 msgr2=0x7fc1c8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.452+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 shutdown_connections 2024-05-09T01:09:28.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:09:28.452+0000 7fc1ccd9f700 1 -- 172.21.15.37:0/1949631926 wait complete. 2024-05-09T01:09:28.709 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:28 smithi037 ceph-mon[30122]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.3 MiB/s wr, 684 op/s 2024-05-09T01:09:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:28 smithi151 ceph-mon[34780]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.3 MiB/s wr, 684 op/s 2024-05-09T01:09:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:28 smithi136 ceph-mon[34110]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.3 MiB/s wr, 684 op/s 2024-05-09T01:09:29.175 INFO:tasks.cephfs.filesystem:scrub status for tag:2adbe8c6-41d8-4b41-912a-877f9d952df5 - {'path': '/', 'tag': '2adbe8c6-41d8-4b41-912a-877f9d952df5', 'options': 'recursive,force'} 2024-05-09T01:09:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 430.0 s, 2568.6 tps, lat 39.391 ms stddev 47.475 2024-05-09T01:09:30.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:30 smithi037 ceph-mon[30122]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.4 MiB/s wr, 678 op/s 2024-05-09T01:09:30.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:30 smithi151 ceph-mon[34780]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.4 MiB/s wr, 678 op/s 2024-05-09T01:09:30.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:30 smithi136 ceph-mon[34110]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 7.4 MiB/s wr, 678 op/s 2024-05-09T01:09:32.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:32 smithi037 ceph-mon[30122]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.1 MiB/s wr, 798 op/s 2024-05-09T01:09:32.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:32 smithi151 ceph-mon[34780]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.1 MiB/s wr, 798 op/s 2024-05-09T01:09:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:32 smithi136 ceph-mon[34110]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.1 MiB/s wr, 798 op/s 2024-05-09T01:09:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:33 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:09:33.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:33 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:09:33.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:33 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:09:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:34 smithi037 ceph-mon[30122]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.0 MiB/s wr, 806 op/s 2024-05-09T01:09:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:34 smithi151 ceph-mon[34780]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.0 MiB/s wr, 806 op/s 2024-05-09T01:09:34.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:34 smithi136 ceph-mon[34110]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 8.0 MiB/s wr, 806 op/s 2024-05-09T01:09:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 435.0 s, 2010.8 tps, lat 49.475 ms stddev 54.397 2024-05-09T01:09:36.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:36 smithi136 ceph-mon[34110]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 7.9 MiB/s wr, 797 op/s 2024-05-09T01:09:36.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:36 smithi037 ceph-mon[30122]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 7.9 MiB/s wr, 797 op/s 2024-05-09T01:09:36.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:36 smithi151 ceph-mon[34780]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 7.9 MiB/s wr, 797 op/s 2024-05-09T01:09:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:38 smithi136 ceph-mon[34110]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 7.2 MiB/s wr, 770 op/s 2024-05-09T01:09:38.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:09:38.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:09:38.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:09:38.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:09:38.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:09:38.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:38 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:09:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:38 smithi037 ceph-mon[30122]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 7.2 MiB/s wr, 770 op/s 2024-05-09T01:09:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:09:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:09:38.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:38 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:38 smithi151 ceph-mon[34780]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 7.2 MiB/s wr, 770 op/s 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:09:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:38 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 -- 172.21.15.37:0/499540128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760103d90 msgr2=0x7f97601041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 --2- 172.21.15.37:0/499540128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760103d90 0x7f97601041a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9758009ca0 tx=0x7f975802a8c0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 -- 172.21.15.37:0/499540128 shutdown_connections 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 --2- 172.21.15.37:0/499540128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f976006a4f0 0x7f976006a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 --2- 172.21.15.37:0/499540128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760103d90 0x7f97601041a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 --2- 172.21.15.37:0/499540128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9760102b50 0x7f9760103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 -- 172.21.15.37:0/499540128 >> 172.21.15.37:0/499540128 conn(0x7f97600fdd40 msgr2=0x7f97601001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 -- 172.21.15.37:0/499540128 shutdown_connections 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.944+0000 7f9765b1f640 1 -- 172.21.15.37:0/499540128 wait complete. 2024-05-09T01:09:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 Processor -- start 2024-05-09T01:09:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 -- start start 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f976006a4f0 0x7f976019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760102b50 0x7f976019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9760103d90 0x7f97601a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9760111990 con 0x7f9760102b50 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9760111810 con 0x7f9760103d90 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.945+0000 7f9765b1f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9760111b10 con 0x7f976006a4f0 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760102b50 0x7f976019ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760102b50 0x7f976019ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35352/0 (socket says 172.21.15.37:35352) 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9760103d90 0x7f97601a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975effd640 1 -- 172.21.15.37:0/1199263667 learned_addr learned my addr 172.21.15.37:0/1199263667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975f7fe640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f976006a4f0 0x7f976019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975f7fe640 1 -- 172.21.15.37:0/1199263667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9760103d90 msgr2=0x7f97601a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975f7fe640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9760103d90 0x7f97601a3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975f7fe640 1 -- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760102b50 msgr2=0x7f976019ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975f7fe640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760102b50 0x7f976019ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975f7fe640 1 -- 172.21.15.37:0/1199263667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97601a4080 con 0x7f976006a4f0 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.946+0000 7f975ffff640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9760103d90 0x7f97601a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.947+0000 7f975f7fe640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f976006a4f0 0x7f976019c540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9760102420 tx=0x7f975400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.947+0000 7f975cff9640 1 -- 172.21.15.37:0/1199263667 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975400cc40 con 0x7f976006a4f0 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.947+0000 7f975cff9640 1 -- 172.21.15.37:0/1199263667 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f975400cde0 con 0x7f976006a4f0 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.947+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97601a4370 con 0x7f976006a4f0 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.947+0000 7f975cff9640 1 -- 172.21.15.37:0/1199263667 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754010430 con 0x7f976006a4f0 2024-05-09T01:09:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.947+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97601a48c0 con 0x7f976006a4f0 2024-05-09T01:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 Processor -- start 2024-05-09T01:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 -- start start 2024-05-09T01:09:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ef34d0 0x55a76a2bf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a76a21c7c0 con 0x55a769f141b0 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a76a1b80e0 con 0x55a769ef34d0 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f976c9cf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a76a218780 con 0x55a769eeb2f0 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ef34d0 0x55a76a2bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35354/0 (socket says 172.21.15.37:35354) 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975ffff640 1 -- 172.21.15.37:0/969470841 learned_addr learned my addr 172.21.15.37:0/969470841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975effd640 1 -- 172.21.15.37:0/969470841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 msgr2=0x55a76a2b8a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975effd640 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2b8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975effd640 1 -- 172.21.15.37:0/969470841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 msgr2=0x55a76a2b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:39.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975effd640 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975effd640 1 -- 172.21.15.37:0/969470841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76a1e17c0 con 0x55a769ef34d0 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.950+0000 7f975ffff640 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.951+0000 7f975cff9640 1 -- 172.21.15.37:0/1199263667 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f97540105d0 con 0x7f976006a4f0 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.951+0000 7f975effd640 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ef34d0 0x55a76a2bf980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9758000f80 tx=0x7f9758009410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54471d9ec0e3e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.951+0000 7f9745ffb640 1 -- 172.21.15.37:0/969470841 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758031650 con 0x55a769ef34d0 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.951+0000 7f9745ffb640 1 -- 172.21.15.37:0/969470841 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9758036030 con 0x55a769ef34d0 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.951+0000 7f9745ffb640 1 -- 172.21.15.37:0/969470841 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97580047a0 con 0x55a769ef34d0 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.951+0000 7f975cff9640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97480b2860 0x7f97480b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.952+0000 7f975ffff640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97480b2860 0x7f97480b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.952+0000 7f975cff9640 1 -- 172.21.15.37:0/1199263667 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97540e2560 con 0x7f976006a4f0 2024-05-09T01:09:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.952+0000 7f976c9cf740 1 -- 172.21.15.37:0/969470841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ef34d0 msgr2=0x55a76a2bf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.952+0000 7f976c9cf740 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ef34d0 0x55a76a2bf980 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9758000f80 tx=0x7f9758009410 comp rx=0 tx=0).stop 2024-05-09T01:09:39.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.954+0000 7f975ffff640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97480b2860 0x7f97480b4d70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a76a2b96d0 tx=0x7f9750005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.954+0000 7f976c9cf740 1 -- 172.21.15.37:0/969470841 shutdown_connections 2024-05-09T01:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.954+0000 7f976c9cf740 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ef34d0 0x55a76a2bf980 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9758000f80 tx=0x7f9758009410 comp rx=0 tx=0).stop 2024-05-09T01:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.954+0000 7f976c9cf740 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.954+0000 7f976c9cf740 1 --2- 172.21.15.37:0/969470841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.954+0000 7f976c9cf740 1 -- 172.21.15.37:0/969470841 >> 172.21.15.37:0/969470841 conn(0x55a769f08300 msgr2=0x55a76a2b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.955+0000 7f976c9cf740 1 -- 172.21.15.37:0/969470841 shutdown_connections 2024-05-09T01:09:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.955+0000 7f976c9cf740 1 -- 172.21.15.37:0/969470841 wait complete. 2024-05-09T01:09:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.955+0000 7f976c9cf740 1 -- start start 2024-05-09T01:09:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 1 Processor -- start 2024-05-09T01:09:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769eeb2f0 0x55a76a2c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a76a2c01f0 con 0x55a769f141b0 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a76a1a39c0 con 0x55a769eeb2f0 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a76a2c0370 con 0x55a769ed2d80 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f976c9cf740 10 client.0 _ll_register_callbacks cb 0x55a76a1d0020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769eeb2f0 0x55a76a2c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769eeb2f0 0x55a76a2c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37122/0 (socket says 172.21.15.37:37122) 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 -- 172.21.15.37:0/1286204161 learned_addr learned my addr 172.21.15.37:0/1286204161 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 -- 172.21.15.37:0/1286204161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 msgr2=0x55a76a2c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 -- 172.21.15.37:0/1286204161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 msgr2=0x55a76a2c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.956+0000 7f975f7fe640 1 -- 172.21.15.37:0/1286204161 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76a1ca1f0 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f975f7fe640 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769eeb2f0 0x55a76a2c2270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f97540a9bb0 tx=0x7f97540a5470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b04d9d6ab015ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f973effd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f973effd640 1 -- 172.21.15.37:0/1286204161 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97540adfd0 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f973effd640 1 -- 172.21.15.37:0/1286204161 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97540c42a0 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9758036030 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f973effd640 1 -- 172.21.15.37:0/1286204161 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f97540b2a80 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f976c9cf740 10 client.26384 fetch_fsmap learned FSMap version 41 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a769f7f790 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f973effd640 1 -- 172.21.15.37:0/1286204161 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9758036030 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.957+0000 7f973effd640 1 -- 172.21.15.37:0/1286204161 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f97540a5590 con 0x55a769eeb2f0 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f976c9cf740 10 client.26384 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:09:39.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f976c9cf740 10 client.26384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f976c9cf740 20 client.26384 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f976c9cf740 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a769ea81c0 0x55a76a2d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f976c9cf740 4 client.26384 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a76a22a3d0 con 0x55a769ea81c0 2024-05-09T01:09:39.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f975effd640 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a769ea81c0 0x55a76a2d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.958+0000 7f975effd640 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a769ea81c0 0x55a76a2d0120 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8154af5db839d9bb server_cookie=662f0356984deb90 in_seq=0 out_seq=0 2024-05-09T01:09:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.959+0000 7f973effd640 10 client.26384 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.959+0000 7f973effd640 1 -- 172.21.15.37:0/1286204161 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a76a22a3d0 con 0x55a769ea81c0 2024-05-09T01:09:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.959+0000 7f973effd640 10 client.26384 handle_command_reply: tid=0 2024-05-09T01:09:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.959+0000 7f976c9cf740 1 client.26384 shutdown 2024-05-09T01:09:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769eeb2f0 msgr2=0x55a76a2c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769eeb2f0 0x55a76a2c2270 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f97540a9bb0 tx=0x7f97540a5470 comp rx=0 tx=0).stop 2024-05-09T01:09:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 shutdown_connections 2024-05-09T01:09:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a769ea81c0 0x55a76a2d0120 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a2c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 --2- 172.21.15.37:0/1286204161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769eeb2f0 0x55a76a2c2270 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f973effd640 0 client.26384 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 >> 172.21.15.37:0/1286204161 conn(0x55a769f08300 msgr2=0x55a76a2b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:39.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 shutdown_connections 2024-05-09T01:09:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 1 -- 172.21.15.37:0/1286204161 wait complete. 2024-05-09T01:09:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.960+0000 7f976c9cf740 20 client.26384 trim_cache size 0 max 16384 2024-05-09T01:09:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.982+0000 7f976c9cf740 1 Processor -- start 2024-05-09T01:09:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.982+0000 7f976c9cf740 1 -- start start 2024-05-09T01:09:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.982+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769eeb2f0 0x55a76a2b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769f141b0 0x55a76a2b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f975effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769eeb2f0 0x55a76a2b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f975effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769eeb2f0 0x55a76a2b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35380/0 (socket says 172.21.15.37:35380) 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f975effd640 1 -- 172.21.15.37:0/4230084841 learned_addr learned my addr 172.21.15.37:0/4230084841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97601ad350 con 0x55a769eeb2f0 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97601aef20 con 0x55a769f141b0 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97601ada20 con 0x55a769ed2d80 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f975f7fe640 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.983+0000 7f975ffff640 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769f141b0 0x55a76a2b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975effd640 1 -- 172.21.15.37:0/4230084841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 msgr2=0x55a76a2bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975effd640 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2bc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975effd640 1 -- 172.21.15.37:0/4230084841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769f141b0 msgr2=0x55a76a2b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975effd640 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769f141b0 0x55a76a2b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975effd640 1 -- 172.21.15.37:0/4230084841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a769ff65f0 con 0x55a769eeb2f0 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975ffff640 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769f141b0 0x55a76a2b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975f7fe640 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f975effd640 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769eeb2f0 0x55a76a2b3850 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f975802ade0 tx=0x7f9758009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c191128330876bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f97457fa640 1 -- 172.21.15.37:0/4230084841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975804a040 con 0x55a769eeb2f0 2024-05-09T01:09:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f97457fa640 1 -- 172.21.15.37:0/4230084841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9758031650 con 0x55a769eeb2f0 2024-05-09T01:09:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.984+0000 7f97457fa640 1 -- 172.21.15.37:0/4230084841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758030820 con 0x55a769eeb2f0 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769eeb2f0 msgr2=0x55a76a2b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769eeb2f0 0x55a76a2b3850 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f975802ade0 tx=0x7f9758009360 comp rx=0 tx=0).stop 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 shutdown_connections 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769f141b0 0x55a76a2b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769eeb2f0 0x55a76a2b3850 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 --2- 172.21.15.37:0/4230084841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769ed2d80 0x55a76a2bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 >> 172.21.15.37:0/4230084841 conn(0x55a769f08300 msgr2=0x55a76a2bb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 shutdown_connections 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.985+0000 7f976c9cf740 1 -- 172.21.15.37:0/4230084841 wait complete. 2024-05-09T01:09:39.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 -- start start 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 Processor -- start 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ed2d80 0x55a76a2c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a336720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97601ae850 con 0x55a769f141b0 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97601ae180 con 0x55a769ed2d80 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97601ab310 con 0x55a769eeb2f0 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f976c9cf740 10 client.0 _ll_register_callbacks cb 0x7f9754003950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f975effd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f975f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ed2d80 0x55a76a2c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f975f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ed2d80 0x55a76a2c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37138/0 (socket says 172.21.15.37:37138) 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f975f7fe640 1 -- 172.21.15.37:0/228590498 learned_addr learned my addr 172.21.15.37:0/228590498 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f975ffff640 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a336720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.986+0000 7f975effd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37030/0 (socket says 172.21.15.37:37030) 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f975effd640 1 -- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ed2d80 msgr2=0x55a76a2c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f975effd640 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ed2d80 0x55a76a2c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f975effd640 1 -- 172.21.15.37:0/228590498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 msgr2=0x55a76a336720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f975effd640 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a336720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f975effd640 1 -- 172.21.15.37:0/228590498 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76a1e0ed0 con 0x55a769eeb2f0 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f975f7fe640 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ed2d80 0x55a76a2c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f975effd640 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2c8790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9758033040 tx=0x7f9758009410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c262289ceb2b2a9d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f973effd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.987+0000 7f973effd640 1 -- 172.21.15.37:0/228590498 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758060020 con 0x55a769eeb2f0 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9758031650 con 0x55a769eeb2f0 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f973effd640 1 -- 172.21.15.37:0/228590498 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f975802f660 con 0x55a769eeb2f0 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f973effd640 1 -- 172.21.15.37:0/228590498 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9758004b40 con 0x55a769eeb2f0 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 10 client.26368 fetch_fsmap learned FSMap version 41 2024-05-09T01:09:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a76a337d40 con 0x55a769eeb2f0 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f973effd640 1 -- 172.21.15.37:0/228590498 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9758031650 con 0x55a769eeb2f0 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f973effd640 1 -- 172.21.15.37:0/228590498 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f9758043070 con 0x55a769eeb2f0 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 10 client.26368 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 10 client.26368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 20 client.26368 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a76a3384c0 0x55a76a33a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 4 client.26368 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:09:39.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.988+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a76a224240 con 0x55a76a3384c0 2024-05-09T01:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.991+0000 7f975f7fe640 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a76a3384c0 0x55a76a33a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.991+0000 7f973effd640 10 client.26368 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:39.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:39.991+0000 7f975f7fe640 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a76a3384c0 0x55a76a33a8e0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e293add910c67d4 server_cookie=5ee862745990402 in_seq=0 out_seq=0 2024-05-09T01:09:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.002+0000 7f973effd640 1 -- 172.21.15.37:0/228590498 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55a76a224240 con 0x55a76a3384c0 2024-05-09T01:09:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.002+0000 7f973effd640 10 client.26368 handle_command_reply: tid=0 2024-05-09T01:09:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.002+0000 7f976c9cf740 1 client.26368 shutdown 2024-05-09T01:09:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 msgr2=0x55a76a2c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2c8790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9758033040 tx=0x7f9758009410 comp rx=0 tx=0).stop 2024-05-09T01:09:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 shutdown_connections 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a76a3384c0 0x55a76a33a8e0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f973effd640 0 client.26368 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a769f141b0 0x55a76a336720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a769eeb2f0 0x55a76a2c8790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 --2- 172.21.15.37:0/228590498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a769ed2d80 0x55a76a2c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 >> 172.21.15.37:0/228590498 conn(0x55a769f08300 msgr2=0x55a76a2b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 shutdown_connections 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 1 -- 172.21.15.37:0/228590498 wait complete. 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.003+0000 7f976c9cf740 20 client.26368 trim_cache size 0 max 16384 2024-05-09T01:09:40.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:09:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:09:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:09:40.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97480b2860 msgr2=0x7f97480b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97480b2860 0x7f97480b4d70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55a76a2b96d0 tx=0x7f9750005f90 comp rx=0 tx=0).stop 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f976006a4f0 msgr2=0x7f976019c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f976006a4f0 0x7f976019c540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9760102420 tx=0x7f975400ee50 comp rx=0 tx=0).stop 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 shutdown_connections 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97480b2860 0x7f97480b4d70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9760103d90 0x7f97601a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9760102b50 0x7f976019ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 --2- 172.21.15.37:0/1199263667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f976006a4f0 0x7f976019c540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 >> 172.21.15.37:0/1199263667 conn(0x7f97600fdd40 msgr2=0x7f9760108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 shutdown_connections 2024-05-09T01:09:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:40.004+0000 7f9765b1f640 1 -- 172.21.15.37:0/1199263667 wait complete. 2024-05-09T01:09:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 440.0 s, 2186.6 tps, lat 46.104 ms stddev 51.690 2024-05-09T01:09:40.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:40 smithi136 ceph-mon[34110]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.1 MiB/s wr, 736 op/s 2024-05-09T01:09:40.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:40 smithi037 ceph-mon[30122]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.1 MiB/s wr, 736 op/s 2024-05-09T01:09:40.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:40 smithi151 ceph-mon[34780]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 7.1 MiB/s wr, 736 op/s 2024-05-09T01:09:42.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:42 smithi136 ceph-mon[34110]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.9 MiB/s wr, 748 op/s 2024-05-09T01:09:42.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:42 smithi037 ceph-mon[30122]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.9 MiB/s wr, 748 op/s 2024-05-09T01:09:42.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:42 smithi151 ceph-mon[34780]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.9 MiB/s wr, 748 op/s 2024-05-09T01:09:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:44 smithi136 ceph-mon[34110]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-05-09T01:09:44.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:44 smithi037 ceph-mon[30122]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-05-09T01:09:44.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:44 smithi151 ceph-mon[34780]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-05-09T01:09:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 445.0 s, 2121.4 tps, lat 47.367 ms stddev 57.349 2024-05-09T01:09:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:46 smithi136 ceph-mon[34110]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-05-09T01:09:46.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:46 smithi037 ceph-mon[30122]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-05-09T01:09:46.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:46 smithi151 ceph-mon[34780]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-05-09T01:09:48.776 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:48 smithi037 ceph-mon[30122]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 634 op/s 2024-05-09T01:09:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:48 smithi136 ceph-mon[34110]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 634 op/s 2024-05-09T01:09:48.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:48 smithi151 ceph-mon[34780]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 MiB/s wr, 634 op/s 2024-05-09T01:09:50.233 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 450.0 s, 2288.0 tps, lat 43.285 ms stddev 52.466 2024-05-09T01:09:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:50 smithi037 ceph-mon[30122]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.0 MiB/s wr, 668 op/s 2024-05-09T01:09:50.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:50 smithi136 ceph-mon[34110]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.0 MiB/s wr, 668 op/s 2024-05-09T01:09:50.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:50 smithi151 ceph-mon[34780]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 7.0 MiB/s wr, 668 op/s 2024-05-09T01:09:51.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:51 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:09:51.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:51 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:09:51.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:51 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:09:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:52 smithi136 ceph-mon[34110]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 676 op/s 2024-05-09T01:09:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:52 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:09:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:52 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:09:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:52 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:09:52.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:52 smithi037 ceph-mon[30122]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 676 op/s 2024-05-09T01:09:52.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:52 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:09:52.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:52 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:09:52.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:52 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:09:52.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:52 smithi151 ceph-mon[34780]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 676 op/s 2024-05-09T01:09:52.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:52 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:09:52.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:52 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:09:52.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:52 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:09:53.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 -- 172.21.15.37:0/151408480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c108230 msgr2=0x7f512c10a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 --2- 172.21.15.37:0/151408480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c108230 0x7f512c10a650 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5124009ca0 tx=0x7f512402a8c0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 -- 172.21.15.37:0/151408480 shutdown_connections 2024-05-09T01:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 --2- 172.21.15.37:0/151408480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c108230 0x7f512c10a650 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 --2- 172.21.15.37:0/151408480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 0x7f512c103940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 --2- 172.21.15.37:0/151408480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f512c1022f0 0x7f512c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 -- 172.21.15.37:0/151408480 >> 172.21.15.37:0/151408480 conn(0x7f512c0fd4c0 msgr2=0x7f512c0ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 -- 172.21.15.37:0/151408480 shutdown_connections 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.120+0000 7f51318d9640 1 -- 172.21.15.37:0/151408480 wait complete. 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.121+0000 7f51318d9640 1 Processor -- start 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.121+0000 7f51318d9640 1 -- start start 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f51318d9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f512c1022f0 0x7f512c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f51318d9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 0x7f512c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f51318d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c108230 0x7f512c1a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f51318d9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f512c10f790 con 0x7f512c108230 2024-05-09T01:09:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f51318d9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f512c10f610 con 0x7f512c1022f0 2024-05-09T01:09:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f51318d9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f512c10f910 con 0x7f512c103530 2024-05-09T01:09:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f512a7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 0x7f512c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f512a7fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 0x7f512c19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51562/0 (socket says 172.21.15.37:51562) 2024-05-09T01:09:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.122+0000 7f512a7fc640 1 -- 172.21.15.37:0/2103203421 learned_addr learned my addr 172.21.15.37:0/2103203421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:53.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f512a7fc640 1 -- 172.21.15.37:0/2103203421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f512c1022f0 msgr2=0x7f512c19a330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:09:53.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f512a7fc640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f512c1022f0 0x7f512c19a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f512a7fc640 1 -- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c108230 msgr2=0x7f512c1a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f512a7fc640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c108230 0x7f512c1a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f512a7fc640 1 -- 172.21.15.37:0/2103203421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c19f7f0 con 0x7f512c103530 2024-05-09T01:09:53.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f512a7fc640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 0x7f512c19a870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f512000d770 tx=0x7f512000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:53.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f51308d7640 1 -- 172.21.15.37:0/2103203421 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120017070 con 0x7f512c103530 2024-05-09T01:09:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f51308d7640 1 -- 172.21.15.37:0/2103203421 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51200054d0 con 0x7f512c103530 2024-05-09T01:09:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.123+0000 7f51308d7640 1 -- 172.21.15.37:0/2103203421 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120004c30 con 0x7f512c103530 2024-05-09T01:09:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.124+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c19fae0 con 0x7f512c103530 2024-05-09T01:09:53.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.124+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c19ffe0 con 0x7f512c103530 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.127+0000 7f513878d740 1 Processor -- start 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f513878d740 1 -- start start 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f51308d7640 1 -- 172.21.15.37:0/2103203421 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5120010460 con 0x7f512c103530 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f513878d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8466c1b0 0x55ad84a10500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f513878d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad846432f0 0x55ad84a10a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f513878d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 0x55ad84a17980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f513878d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad849747c0 con 0x55ad8466c1b0 2024-05-09T01:09:53.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f513878d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ad849100e0 con 0x55ad8464b4d0 2024-05-09T01:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f513878d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad84970780 con 0x55ad846432f0 2024-05-09T01:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8466c1b0 0x55ad84a10500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8466c1b0 0x55ad84a10500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37694/0 (socket says 172.21.15.37:37694) 2024-05-09T01:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 -- 172.21.15.37:0/1774571123 learned_addr learned my addr 172.21.15.37:0/1774571123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512a7fc640 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 0x55ad84a17980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512affd640 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad846432f0 0x55ad84a10a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 -- 172.21.15.37:0/1774571123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad846432f0 msgr2=0x55ad84a10a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad846432f0 0x55ad84a10a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 -- 172.21.15.37:0/1774571123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 msgr2=0x55ad84a17980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 0x55ad84a17980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.128+0000 7f512b7fe640 1 -- 172.21.15.37:0/1774571123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad849397c0 con 0x55ad8466c1b0 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.129+0000 7f512b7fe640 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8466c1b0 0x55ad84a10500 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f51240097b0 tx=0x7f512402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3205d426713fbd3d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.129+0000 7f51308d7640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51140b2930 0x7f51140b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.129+0000 7f5111ffb640 1 -- 172.21.15.37:0/1774571123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124031650 con 0x55ad8466c1b0 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.129+0000 7f512affd640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51140b2930 0x7f51140b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.129+0000 7f5111ffb640 1 -- 172.21.15.37:0/1774571123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f512403f070 con 0x55ad8466c1b0 2024-05-09T01:09:53.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.129+0000 7f5111ffb640 1 -- 172.21.15.37:0/1774571123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124004560 con 0x55ad8466c1b0 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.129+0000 7f51308d7640 1 -- 172.21.15.37:0/2103203421 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f51200e1bb0 con 0x7f512c103530 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 -- 172.21.15.37:0/1774571123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8466c1b0 msgr2=0x55ad84a10500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f512affd640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51140b2930 0x7f51140b4e40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55ad84a118e0 tx=0x7f511c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8466c1b0 0x55ad84a10500 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f51240097b0 tx=0x7f512402f3a0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 -- 172.21.15.37:0/1774571123 shutdown_connections 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 0x55ad84a17980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad846432f0 0x55ad84a10a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 --2- 172.21.15.37:0/1774571123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8466c1b0 0x55ad84a10500 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 -- 172.21.15.37:0/1774571123 >> 172.21.15.37:0/1774571123 conn(0x55ad84660300 msgr2=0x55ad84a0be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 -- 172.21.15.37:0/1774571123 shutdown_connections 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 -- 172.21.15.37:0/1774571123 wait complete. 2024-05-09T01:09:53.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.130+0000 7f513878d740 1 -- start start 2024-05-09T01:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 1 Processor -- start 2024-05-09T01:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a1a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8464b4d0 0x55ad84a1a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8466c1b0 0x55ad84a21790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad84a18370 con 0x55ad846432f0 2024-05-09T01:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ad848fb9c0 con 0x55ad8466c1b0 2024-05-09T01:09:53.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad84a184f0 con 0x55ad8464b4d0 2024-05-09T01:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f513878d740 10 client.0 _ll_register_callbacks cb 0x55ad84928020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f512affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a1a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f512affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a1a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37698/0 (socket says 172.21.15.37:37698) 2024-05-09T01:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f512affd640 1 -- 172.21.15.37:0/4049297268 learned_addr learned my addr 172.21.15.37:0/4049297268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f512b7fe640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8466c1b0 0x55ad84a21790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.131+0000 7f512a7fc640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8464b4d0 0x55ad84a1a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f512affd640 1 -- 172.21.15.37:0/4049297268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8464b4d0 msgr2=0x55ad84a1a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f512affd640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8464b4d0 0x55ad84a1a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f512affd640 1 -- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8466c1b0 msgr2=0x55ad84a21790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f512affd640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8466c1b0 0x55ad84a21790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f512affd640 1 -- 172.21.15.37:0/4049297268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad849221f0 con 0x55ad846432f0 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f512b7fe640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8466c1b0 0x55ad84a21790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f512affd640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a1a2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f511c009560 tx=0x7f511c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e790b1b3fac639b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f510affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:09:53.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f510affd640 1 -- 172.21.15.37:0/4049297268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c005220 con 0x55ad846432f0 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f510affd640 1 -- 172.21.15.37:0/4049297268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f511c0053c0 con 0x55ad846432f0 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f512403f070 con 0x55ad846432f0 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f510affd640 1 -- 172.21.15.37:0/4049297268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f511c0055c0 con 0x55ad846432f0 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f513878d740 10 client.16584 fetch_fsmap learned FSMap version 41 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ad846d7790 con 0x55ad846432f0 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.132+0000 7f510affd640 1 -- 172.21.15.37:0/4049297268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f512403f070 con 0x55ad846432f0 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f510affd640 1 -- 172.21.15.37:0/4049297268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f511c01cc50 con 0x55ad846432f0 2024-05-09T01:09:53.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f513878d740 10 client.16584 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f513878d740 10 client.16584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f513878d740 20 client.16584 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f513878d740 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad8462ad80 0x55ad84a27d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f513878d740 4 client.16584 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad849823d0 con 0x55ad8462ad80 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f512a7fc640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad8462ad80 0x55ad84a27d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f510affd640 10 client.16584 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:53.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.133+0000 7f512a7fc640 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad8462ad80 0x55ad84a27d60 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52a63885f2fa441c server_cookie=789463f8ca0f14e8 in_seq=0 out_seq=0 2024-05-09T01:09:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f510affd640 1 -- 172.21.15.37:0/4049297268 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ad849823d0 con 0x55ad8462ad80 2024-05-09T01:09:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f510affd640 10 client.16584 handle_command_reply: tid=0 2024-05-09T01:09:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 client.16584 shutdown 2024-05-09T01:09:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 msgr2=0x55ad84a1a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a1a2f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f511c009560 tx=0x7f511c004730 comp rx=0 tx=0).stop 2024-05-09T01:09:53.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 shutdown_connections 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad8462ad80 0x55ad84a27d60 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8466c1b0 0x55ad84a21790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8464b4d0 0x55ad84a1a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f510affd640 0 client.16584 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 --2- 172.21.15.37:0/4049297268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a1a2f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 >> 172.21.15.37:0/4049297268 conn(0x55ad84660300 msgr2=0x55ad84a0a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 shutdown_connections 2024-05-09T01:09:53.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 1 -- 172.21.15.37:0/4049297268 wait complete. 2024-05-09T01:09:53.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.134+0000 7f513878d740 20 client.16584 trim_cache size 0 max 16384 2024-05-09T01:09:53.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.165+0000 7f513878d740 1 Processor -- start 2024-05-09T01:09:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.166+0000 7f513878d740 1 -- start start 2024-05-09T01:09:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.166+0000 7f513878d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a19030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.166+0000 7f513878d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 0x55ad84a21720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.166+0000 7f513878d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 0x55ad84a21c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.166+0000 7f513878d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f511800e330 con 0x55ad846432f0 2024-05-09T01:09:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.166+0000 7f513878d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f511800ff00 con 0x55ad8464b4d0 2024-05-09T01:09:53.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.166+0000 7f513878d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f511800ea00 con 0x55ad8466c1b0 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.167+0000 7f512affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a19030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a19030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37702/0 (socket says 172.21.15.37:37702) 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 -- 172.21.15.37:0/1109235398 learned_addr learned my addr 172.21.15.37:0/1109235398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 -- 172.21.15.37:0/1109235398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 msgr2=0x55ad84a21c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 --2- 172.21.15.37:0/1109235398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 0x55ad84a21c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 -- 172.21.15.37:0/1109235398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 msgr2=0x55ad84a21720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 --2- 172.21.15.37:0/1109235398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 0x55ad84a21720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 -- 172.21.15.37:0/1109235398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad8474e5f0 con 0x55ad846432f0 2024-05-09T01:09:53.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.168+0000 7f512affd640 1 --2- 172.21.15.37:0/1109235398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a19030 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f511c009ab0 tx=0x7f511c004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fdd60e49eea52 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.171+0000 7f51117fa640 1 -- 172.21.15.37:0/1109235398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c0276a0 con 0x55ad846432f0 2024-05-09T01:09:53.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.171+0000 7f51117fa640 1 -- 172.21.15.37:0/1109235398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f511c027840 con 0x55ad846432f0 2024-05-09T01:09:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.172+0000 7f513878d740 1 -- 172.21.15.37:0/1109235398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 msgr2=0x55ad84a19030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.172+0000 7f513878d740 1 --2- 172.21.15.37:0/1109235398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a19030 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f511c009ab0 tx=0x7f511c004680 comp rx=0 tx=0).stop 2024-05-09T01:09:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.175+0000 7f513878d740 1 -- 172.21.15.37:0/1109235398 shutdown_connections 2024-05-09T01:09:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.175+0000 7f513878d740 1 --2- 172.21.15.37:0/1109235398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 0x55ad84a21c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.175+0000 7f513878d740 1 --2- 172.21.15.37:0/1109235398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad8464b4d0 0x55ad84a21720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.175+0000 7f513878d740 1 --2- 172.21.15.37:0/1109235398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad846432f0 0x55ad84a19030 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.175+0000 7f513878d740 1 -- 172.21.15.37:0/1109235398 >> 172.21.15.37:0/1109235398 conn(0x55ad84660300 msgr2=0x55ad84a18920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:53.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.180+0000 7f513878d740 1 -- 172.21.15.37:0/1109235398 shutdown_connections 2024-05-09T01:09:53.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.182+0000 7f513878d740 1 -- 172.21.15.37:0/1109235398 wait complete. 2024-05-09T01:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.183+0000 7f513878d740 1 -- start start 2024-05-09T01:09:53.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.183+0000 7f513878d740 1 Processor -- start 2024-05-09T01:09:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f513878d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad846432f0 0x55ad84a1ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f513878d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8464b4d0 0x55ad84a1f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f513878d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 0x55ad84a9f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f513878d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f511800f830 con 0x55ad8464b4d0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f513878d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f511800f160 con 0x55ad846432f0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f513878d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f511800c310 con 0x55ad8466c1b0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f513878d740 10 client.0 _ll_register_callbacks cb 0x7f511c0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f512affd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad846432f0 0x55ad84a1ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f512affd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad846432f0 0x55ad84a1ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:45918/0 (socket says 172.21.15.37:45918) 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.184+0000 7f512affd640 1 -- 172.21.15.37:0/2001042763 learned_addr learned my addr 172.21.15.37:0/2001042763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f512b7fe640 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 0x55ad84a9f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f512affd640 1 -- 172.21.15.37:0/2001042763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 msgr2=0x55ad84a9f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f512affd640 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 0x55ad84a9f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f512affd640 1 -- 172.21.15.37:0/2001042763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8464b4d0 msgr2=0x55ad84a1f1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f512affd640 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8464b4d0 0x55ad84a1f1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f512affd640 1 -- 172.21.15.37:0/2001042763 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad84938ed0 con 0x55ad846432f0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f512affd640 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad846432f0 0x55ad84a1ec90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f511c03c040 tx=0x7f511c027a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd3d98ca7907a6b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:09:53.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.185+0000 7f510affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:09:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.187+0000 7f510affd640 1 -- 172.21.15.37:0/2001042763 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c04a060 con 0x55ad846432f0 2024-05-09T01:09:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.187+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f511c027840 con 0x55ad846432f0 2024-05-09T01:09:53.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.187+0000 7f510affd640 1 -- 172.21.15.37:0/2001042763 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f511c01d8d0 con 0x55ad846432f0 2024-05-09T01:09:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.192+0000 7f510affd640 1 -- 172.21.15.37:0/2001042763 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f511c0276a0 con 0x55ad846432f0 2024-05-09T01:09:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.192+0000 7f513878d740 10 client.26399 fetch_fsmap learned FSMap version 41 2024-05-09T01:09:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.192+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55ad84aa0670 con 0x55ad846432f0 2024-05-09T01:09:53.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f510affd640 1 -- 172.21.15.37:0/2001042763 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f511c027840 con 0x55ad846432f0 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f510affd640 1 -- 172.21.15.37:0/2001042763 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f511c04f070 con 0x55ad846432f0 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f513878d740 10 client.26399 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f513878d740 10 client.26399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f513878d740 20 client.26399 populate_metadata read hostname 'smithi037' 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f513878d740 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad846001c0 0x55ad84aa2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f513878d740 4 client.26399 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.193+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad8497c240 con 0x55ad846001c0 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.194+0000 7f512a7fc640 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad846001c0 0x55ad84aa2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.194+0000 7f510affd640 10 client.26399 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:53.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.195+0000 7f512a7fc640 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad846001c0 0x55ad84aa2fe0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=248c8eed7dc581f1 server_cookie=8034b8fd89e980d4 in_seq=0 out_seq=0 2024-05-09T01:09:53.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.258+0000 7f510affd640 1 -- 172.21.15.37:0/2001042763 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ad8497c240 con 0x55ad846001c0 2024-05-09T01:09:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.258+0000 7f510affd640 10 client.26399 handle_command_reply: tid=0 2024-05-09T01:09:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.258+0000 7f513878d740 1 client.26399 shutdown 2024-05-09T01:09:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad846432f0 msgr2=0x55ad84a1ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad846432f0 0x55ad84a1ec90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f511c03c040 tx=0x7f511c027a80 comp rx=0 tx=0).stop 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 shutdown_connections 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad846001c0 0x55ad84aa2fe0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad8466c1b0 0x55ad84a9f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad8464b4d0 0x55ad84a1f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 --2- 172.21.15.37:0/2001042763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad846432f0 0x55ad84a1ec90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f510affd640 0 client.26399 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 >> 172.21.15.37:0/2001042763 conn(0x55ad84660300 msgr2=0x55ad84a1a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 shutdown_connections 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 1 -- 172.21.15.37:0/2001042763 wait complete. 2024-05-09T01:09:53.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.259+0000 7f513878d740 20 client.26399 trim_cache size 0 max 16384 2024-05-09T01:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:09:53.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51140b2930 msgr2=0x7f51140b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51140b2930 0x7f51140b4e40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55ad84a118e0 tx=0x7f511c005f90 comp rx=0 tx=0).stop 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 msgr2=0x7f512c19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 0x7f512c19a870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f512000d770 tx=0x7f512000dc30 comp rx=0 tx=0).stop 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 shutdown_connections 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c108230 0x7f512c1a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512c103530 0x7f512c19a870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f51140b2930 0x7f51140b4e40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 --2- 172.21.15.37:0/2103203421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f512c1022f0 0x7f512c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 >> 172.21.15.37:0/2103203421 conn(0x7f512c0fd4c0 msgr2=0x7f512c104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:09:53.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 shutdown_connections 2024-05-09T01:09:53.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:09:53.261+0000 7f51318d9640 1 -- 172.21.15.37:0/2103203421 wait complete. 2024-05-09T01:09:54.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:54 smithi136 ceph-mon[34110]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 MiB/s wr, 696 op/s 2024-05-09T01:09:54.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:54 smithi037 ceph-mon[30122]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 MiB/s wr, 696 op/s 2024-05-09T01:09:54.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:54 smithi151 ceph-mon[34780]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 MiB/s wr, 696 op/s 2024-05-09T01:09:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 455.0 s, 1998.6 tps, lat 50.099 ms stddev 62.889 2024-05-09T01:09:56.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:56 smithi136 ceph-mon[34110]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 643 op/s 2024-05-09T01:09:56.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:56 smithi037 ceph-mon[30122]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 643 op/s 2024-05-09T01:09:56.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:56 smithi151 ceph-mon[34780]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 643 op/s 2024-05-09T01:09:57.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:09:57 smithi136 ceph-mon[34110]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2024-05-09T01:09:57.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:09:57 smithi037 ceph-mon[30122]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2024-05-09T01:09:57.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:09:57 smithi151 ceph-mon[34780]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 660 op/s 2024-05-09T01:09:59.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:09:59.564 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 460.0 s, 1873.4 tps, lat 53.492 ms stddev 58.541 2024-05-09T01:10:00.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:00 smithi037 ceph-mon[30122]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 MiB/s wr, 625 op/s 2024-05-09T01:10:00.318 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:00 smithi037 ceph-mon[30122]: overall HEALTH_OK 2024-05-09T01:10:00.478 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:00 smithi151 ceph-mon[34780]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 MiB/s wr, 625 op/s 2024-05-09T01:10:00.478 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:00 smithi151 ceph-mon[34780]: overall HEALTH_OK 2024-05-09T01:10:00.580 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:00 smithi136 ceph-mon[34110]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 MiB/s wr, 625 op/s 2024-05-09T01:10:00.580 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:00 smithi136 ceph-mon[34110]: overall HEALTH_OK 2024-05-09T01:10:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.717+0000 7f100b873700 1 -- 172.21.15.37:0/3718979720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10041034c0 msgr2=0x7f10041038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.717+0000 7f100b873700 1 --2- 172.21.15.37:0/3718979720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10041034c0 0x7f10041038d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f10000099c0 tx=0x7f1000009cd0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.720+0000 7f100b873700 1 -- 172.21.15.37:0/3718979720 shutdown_connections 2024-05-09T01:10:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.720+0000 7f100b873700 1 --2- 172.21.15.37:0/3718979720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1004108740 0x7f10041100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.720+0000 7f100b873700 1 --2- 172.21.15.37:0/3718979720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10041034c0 0x7f10041038d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.720+0000 7f100b873700 1 --2- 172.21.15.37:0/3718979720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1004107df0 0x7f1004108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.720+0000 7f100b873700 1 -- 172.21.15.37:0/3718979720 >> 172.21.15.37:0/3718979720 conn(0x7f10040fedc0 msgr2=0x7f10041011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.720+0000 7f100b873700 1 -- 172.21.15.37:0/3718979720 shutdown_connections 2024-05-09T01:10:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.721+0000 7f100b873700 1 -- 172.21.15.37:0/3718979720 wait complete. 2024-05-09T01:10:01.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.722+0000 7f100b873700 1 Processor -- start 2024-05-09T01:10:01.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.722+0000 7f100b873700 1 -- start start 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.722+0000 7f100b873700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10041034c0 0x7f1004112620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.722+0000 7f100b873700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1004107df0 0x7f1004110a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f100b873700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1004108740 0x7f1004111060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1004107df0 0x7f1004110a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1004107df0 0x7f1004110a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38558/0 (socket says 172.21.15.37:38558) 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 -- 172.21.15.37:0/753225899 learned_addr learned my addr 172.21.15.37:0/753225899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10041144c0 con 0x7f1004108740 2024-05-09T01:10:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f100960f700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10041034c0 0x7f1004112620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1004114340 con 0x7f10041034c0 2024-05-09T01:10:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1004114640 con 0x7f1004107df0 2024-05-09T01:10:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1009e10700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1004108740 0x7f1004111060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 -- 172.21.15.37:0/753225899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10041034c0 msgr2=0x7f1004112620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10041034c0 0x7f1004112620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 -- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1004108740 msgr2=0x7f1004111060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1004108740 0x7f1004111060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.723+0000 7f1008e0e700 1 -- 172.21.15.37:0/753225899 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1004111890 con 0x7f1004107df0 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.724+0000 7f1008e0e700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1004107df0 0x7f1004110a80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400e970 tx=0x7f0ff400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.724+0000 7f0ffa7fc700 1 -- 172.21.15.37:0/753225899 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400cbd0 con 0x7f1004107df0 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.724+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10041ad8c0 con 0x7f1004107df0 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.724+0000 7f0ffa7fc700 1 -- 172.21.15.37:0/753225899 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ff400cd70 con 0x7f1004107df0 2024-05-09T01:10:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.724+0000 7f0ffa7fc700 1 -- 172.21.15.37:0/753225899 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff400cbd0 con 0x7f1004107df0 2024-05-09T01:10:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.724+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10041ade20 con 0x7f1004107df0 2024-05-09T01:10:01.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.731+0000 7f101a289b80 1 Processor -- start 2024-05-09T01:10:01.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.731+0000 7f101a289b80 1 -- start start 2024-05-09T01:10:01.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f101a289b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f101a289b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f101a289b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9dc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f101a289b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bf9a8ff0a0 con 0x55bf9a85f4a0 2024-05-09T01:10:01.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f101a289b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55bf9a8a49a0 con 0x55bf9a9dc400 2024-05-09T01:10:01.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f100960f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f1009e10700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f101a289b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bf9a8fb060 con 0x55bf9a8d9d00 2024-05-09T01:10:01.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f1009e10700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38562/0 (socket says 172.21.15.37:38562) 2024-05-09T01:10:01.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f1009e10700 1 -- 172.21.15.37:0/2391050343 learned_addr learned my addr 172.21.15.37:0/2391050343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:01.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f0ffa7fc700 1 -- 172.21.15.37:0/753225899 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0ff4005400 con 0x7f1004107df0 2024-05-09T01:10:01.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.732+0000 7f1008e0e700 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f1009e10700 1 -- 172.21.15.37:0/2391050343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 msgr2=0x55bf9a9dc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:01.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f1009e10700 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9dc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f1009e10700 1 -- 172.21.15.37:0/2391050343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 msgr2=0x55bf9a9e2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:01.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f1009e10700 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f1009e10700 1 -- 172.21.15.37:0/2391050343 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9a895500 con 0x55bf9a8d9d00 2024-05-09T01:10:01.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f1008e0e700 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9dc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:10:01.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f1009e10700 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e2240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009440 tx=0x7f0ffc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a097256fc5f13a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:01.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f0fef7fe700 1 -- 172.21.15.37:0/2391050343 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc013750 con 0x55bf9a8d9d00 2024-05-09T01:10:01.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f0fef7fe700 1 -- 172.21.15.37:0/2391050343 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc013da0 con 0x55bf9a8d9d00 2024-05-09T01:10:01.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.733+0000 7f0fef7fe700 1 -- 172.21.15.37:0/2391050343 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc015e40 con 0x55bf9a8d9d00 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.734+0000 7f0ffa7fc700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ff00b2a80 0x7f0ff00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.734+0000 7f0ffa7fc700 1 -- 172.21.15.37:0/753225899 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0ff40e2080 con 0x7f1004107df0 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.734+0000 7f100960f700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ff00b2a80 0x7f0ff00b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 -- 172.21.15.37:0/2391050343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a8d9d00 msgr2=0x55bf9a9e2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f100960f700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ff00b2a80 0x7f0ff00b4f90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1000005b40 tx=0x7f100001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e2240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009440 tx=0x7f0ffc009920 comp rx=0 tx=0).stop 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 -- 172.21.15.37:0/2391050343 shutdown_connections 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9dc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e2240 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 --2- 172.21.15.37:0/2391050343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 -- 172.21.15.37:0/2391050343 >> 172.21.15.37:0/2391050343 conn(0x55bf9a862f70 msgr2=0x55bf9a9d7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 -- 172.21.15.37:0/2391050343 shutdown_connections 2024-05-09T01:10:01.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 -- 172.21.15.37:0/2391050343 wait complete. 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.735+0000 7f101a289b80 1 -- start start 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 1 Processor -- start 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bf9a9dd160 con 0x55bf9a8d9d00 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55bf9a899b20 con 0x55bf9a9dc400 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bf9a9e9020 con 0x55bf9a85f4a0 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f101a289b80 10 client.0 _ll_register_callbacks cb 0x55bf9a7706c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f100960f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.736+0000 7f100960f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38578/0 (socket says 172.21.15.37:38578) 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f100960f700 1 -- 172.21.15.37:0/2734665331 learned_addr learned my addr 172.21.15.37:0/2734665331 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f1009e10700 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f1008e0e700 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f100960f700 1 -- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 msgr2=0x55bf9a9e6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f100960f700 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f100960f700 1 -- 172.21.15.37:0/2734665331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a8d9d00 msgr2=0x55bf9a9e65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f100960f700 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f100960f700 1 -- 172.21.15.37:0/2734665331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf9a77a490 con 0x55bf9a85f4a0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f100960f700 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e60b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1000015000 tx=0x7f1000005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd5cf8fbf050edb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f0fecff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f0fecff9700 1 -- 172.21.15.37:0/2734665331 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000035060 con 0x55bf9a85f4a0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f0fecff9700 1 -- 172.21.15.37:0/2734665331 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f100000b990 con 0x55bf9a85f4a0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.737+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ffc013da0 con 0x55bf9a85f4a0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.738+0000 7f0fecff9700 1 -- 172.21.15.37:0/2734665331 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f100000bb90 con 0x55bf9a85f4a0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.738+0000 7f101a289b80 10 client.26392 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.738+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55bf9a9f39e0 con 0x55bf9a85f4a0 2024-05-09T01:10:01.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.738+0000 7f0fecff9700 1 -- 172.21.15.37:0/2734665331 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc013da0 con 0x55bf9a85f4a0 2024-05-09T01:10:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.738+0000 7f0fecff9700 1 -- 172.21.15.37:0/2734665331 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f100000f460 con 0x55bf9a85f4a0 2024-05-09T01:10:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.738+0000 7f101a289b80 10 client.26392 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.738+0000 7f101a289b80 10 client.26392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.739+0000 7f101a289b80 20 client.26392 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.739+0000 7f101a289b80 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9a9f5fa0 0x55bf9a9f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.739+0000 7f101a289b80 4 client.26392 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.739+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf9a90ca80 con 0x55bf9a9f5fa0 2024-05-09T01:10:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.739+0000 7f1008e0e700 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9a9f5fa0 0x55bf9a9f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.740+0000 7f0fecff9700 10 client.26392 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:01.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.740+0000 7f1008e0e700 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9a9f5fa0 0x55bf9a9f8400 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56bc88738c53eb74 server_cookie=d994011421593d19 in_seq=0 out_seq=0 2024-05-09T01:10:01.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.749+0000 7f0fecff9700 1 -- 172.21.15.37:0/2734665331 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f0ff4083e50 con 0x55bf9a9f5fa0 2024-05-09T01:10:01.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.749+0000 7f0fecff9700 10 client.26392 handle_command_reply: tid=0 2024-05-09T01:10:01.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.749+0000 7f101a289b80 1 client.26392 shutdown 2024-05-09T01:10:01.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.753+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 msgr2=0x55bf9a9e60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.753+0000 7f101a289b80 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e60b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1000015000 tx=0x7f1000005040 comp rx=0 tx=0).stop 2024-05-09T01:10:01.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.754+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 shutdown_connections 2024-05-09T01:10:01.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.754+0000 7f101a289b80 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9a9f5fa0 0x55bf9a9f8400 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.754+0000 7f0fecff9700 0 client.26392 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:01.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.754+0000 7f101a289b80 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.754+0000 7f101a289b80 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9e60b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.754+0000 7f101a289b80 1 --2- 172.21.15.37:0/2734665331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.754+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 >> 172.21.15.37:0/2734665331 conn(0x55bf9a862f70 msgr2=0x55bf9a9d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:01.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.758+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 shutdown_connections 2024-05-09T01:10:01.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.759+0000 7f101a289b80 1 -- 172.21.15.37:0/2734665331 wait complete. 2024-05-09T01:10:01.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.760+0000 7f101a289b80 20 client.26392 trim_cache size 0 max 16384 2024-05-09T01:10:01.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.808+0000 7f101a289b80 1 Processor -- start 2024-05-09T01:10:01.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.808+0000 7f101a289b80 1 -- start start 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.808+0000 7f101a289b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9dbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.808+0000 7f101a289b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.808+0000 7f101a289b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.809+0000 7f101a289b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10041b50c0 con 0x55bf9a85f4a0 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.809+0000 7f101a289b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f10041b6c90 con 0x55bf9a8d9d00 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.809+0000 7f101a289b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f10041b5790 con 0x55bf9a9dc400 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.809+0000 7f1009e10700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.809+0000 7f1009e10700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38584/0 (socket says 172.21.15.37:38584) 2024-05-09T01:10:01.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.809+0000 7f1009e10700 1 -- 172.21.15.37:0/556254577 learned_addr learned my addr 172.21.15.37:0/556254577 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f1009e10700 1 -- 172.21.15.37:0/556254577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 msgr2=0x55bf9a9f1e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:10:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f1009e10700 1 --2- 172.21.15.37:0/556254577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9f1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f1009e10700 1 -- 172.21.15.37:0/556254577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 msgr2=0x55bf9a9dbe20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:10:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f1009e10700 1 --2- 172.21.15.37:0/556254577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9dbe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f1009e10700 1 -- 172.21.15.37:0/556254577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf9a9e4620 con 0x55bf9a9dc400 2024-05-09T01:10:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f1009e10700 1 --2- 172.21.15.37:0/556254577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6620 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009440 tx=0x7f0ffc009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daf591bcf49348b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f0feeffd700 1 -- 172.21.15.37:0/556254577 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc015c90 con 0x55bf9a9dc400 2024-05-09T01:10:01.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.810+0000 7f0feeffd700 1 -- 172.21.15.37:0/556254577 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc015e30 con 0x55bf9a9dc400 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 -- 172.21.15.37:0/556254577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a9dc400 msgr2=0x55bf9a9e6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 --2- 172.21.15.37:0/556254577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6620 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009440 tx=0x7f0ffc009510 comp rx=0 tx=0).stop 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 -- 172.21.15.37:0/556254577 shutdown_connections 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 --2- 172.21.15.37:0/556254577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a9dc400 0x55bf9a9e6620 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 --2- 172.21.15.37:0/556254577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9dbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 --2- 172.21.15.37:0/556254577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 -- 172.21.15.37:0/556254577 >> 172.21.15.37:0/556254577 conn(0x55bf9a862f70 msgr2=0x55bf9a9d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 -- 172.21.15.37:0/556254577 shutdown_connections 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 -- 172.21.15.37:0/556254577 wait complete. 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 -- start start 2024-05-09T01:10:01.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.812+0000 7f101a289b80 1 Processor -- start 2024-05-09T01:10:01.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.813+0000 7f101a289b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.813+0000 7f101a289b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9ec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.813+0000 7f101a289b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a9dc400 0x55bf9a9ec850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.813+0000 7f101a289b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10041b65c0 con 0x55bf9a9dc400 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.813+0000 7f101a289b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f10041b5ef0 con 0x55bf9a8d9d00 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.813+0000 7f101a289b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f10041b3080 con 0x55bf9a85f4a0 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.813+0000 7f101a289b80 10 client.0 _ll_register_callbacks cb 0x55bf9a7706c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.814+0000 7f1009e10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a9dc400 0x55bf9a9ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.814+0000 7f1009e10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a9dc400 0x55bf9a9ec850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39726/0 (socket says 172.21.15.37:39726) 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.814+0000 7f1009e10700 1 -- 172.21.15.37:0/211570757 learned_addr learned my addr 172.21.15.37:0/211570757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.814+0000 7f100960f700 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.814+0000 7f1008e0e700 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.816+0000 7f100960f700 1 -- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 msgr2=0x55bf9a9ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:01.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.816+0000 7f100960f700 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.816+0000 7f100960f700 1 -- 172.21.15.37:0/211570757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a9dc400 msgr2=0x55bf9a9ec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:01.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.816+0000 7f100960f700 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a9dc400 0x55bf9a9ec850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.816+0000 7f100960f700 1 -- 172.21.15.37:0/211570757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf9aa707d0 con 0x55bf9a85f4a0 2024-05-09T01:10:01.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.817+0000 7f100960f700 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9ebdd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1000003760 tx=0x7f100000fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb7e869411740401 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:01.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.819+0000 7f0fecff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:01.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.823+0000 7f0fecff9700 1 -- 172.21.15.37:0/211570757 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100003f020 con 0x55bf9a85f4a0 2024-05-09T01:10:01.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.823+0000 7f0fecff9700 1 -- 172.21.15.37:0/211570757 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f100000f660 con 0x55bf9a85f4a0 2024-05-09T01:10:01.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.823+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ffc015e30 con 0x55bf9a85f4a0 2024-05-09T01:10:01.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.823+0000 7f0fecff9700 1 -- 172.21.15.37:0/211570757 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f100000b9a0 con 0x55bf9a85f4a0 2024-05-09T01:10:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.826+0000 7f101a289b80 10 client.26398 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:01.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.826+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55bf9aa71a10 con 0x55bf9a85f4a0 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.826+0000 7f0fecff9700 1 -- 172.21.15.37:0/211570757 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc015e30 con 0x55bf9a85f4a0 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.826+0000 7f0fecff9700 1 -- 172.21.15.37:0/211570757 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f1000025420 con 0x55bf9a85f4a0 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.827+0000 7f101a289b80 10 client.26398 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.827+0000 7f101a289b80 10 client.26398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.827+0000 7f101a289b80 20 client.26398 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.827+0000 7f101a289b80 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9aa72070 0x55bf9aa74490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.827+0000 7f101a289b80 4 client.26398 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:10:01.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.827+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bf9a906b20 con 0x55bf9aa72070 2024-05-09T01:10:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.827+0000 7f1008e0e700 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9aa72070 0x55bf9aa74490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:01.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.828+0000 7f0fecff9700 10 client.26398 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.829+0000 7f1008e0e700 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9aa72070 0x55bf9aa74490 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f3d8db9a7529e78 server_cookie=79be6c9ca2a18182 in_seq=0 out_seq=0 2024-05-09T01:10:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.829+0000 7f0fecff9700 1 -- 172.21.15.37:0/211570757 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bf9a906b20 con 0x55bf9aa72070 2024-05-09T01:10:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.829+0000 7f0fecff9700 10 client.26398 handle_command_reply: tid=0 2024-05-09T01:10:01.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.829+0000 7f101a289b80 1 client.26398 shutdown 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.831+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 msgr2=0x55bf9a9ebdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.831+0000 7f101a289b80 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9ebdd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1000003760 tx=0x7f100000fd70 comp rx=0 tx=0).stop 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 shutdown_connections 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f101a289b80 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bf9aa72070 0x55bf9aa74490 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f101a289b80 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf9a9dc400 0x55bf9a9ec850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f101a289b80 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf9a85f4a0 0x55bf9a9ebdd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f101a289b80 1 --2- 172.21.15.37:0/211570757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bf9a8d9d00 0x55bf9a9ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 >> 172.21.15.37:0/211570757 conn(0x55bf9a862f70 msgr2=0x55bf9a9dfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:01.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f0fecff9700 0 client.26398 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:01.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.832+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 shutdown_connections 2024-05-09T01:10:01.834 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:10:01.835 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:10:01.835 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:10:01.835 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:10:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.833+0000 7f101a289b80 1 -- 172.21.15.37:0/211570757 wait complete. 2024-05-09T01:10:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.833+0000 7f101a289b80 20 client.26398 trim_cache size 0 max 16384 2024-05-09T01:10:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.833+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ff00b2a80 msgr2=0x7f0ff00b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.833+0000 7f100b873700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ff00b2a80 0x7f0ff00b4f90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1000005b40 tx=0x7f100001a040 comp rx=0 tx=0).stop 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.833+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1004107df0 msgr2=0x7f1004110a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.833+0000 7f100b873700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1004107df0 0x7f1004110a80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400e970 tx=0x7f0ff400ec80 comp rx=0 tx=0).stop 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 shutdown_connections 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ff00b2a80 0x7f0ff00b4f90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1004108740 0x7f1004111060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10041034c0 0x7f1004112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 --2- 172.21.15.37:0/753225899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1004107df0 0x7f1004110a80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 >> 172.21.15.37:0/753225899 conn(0x7f10040fedc0 msgr2=0x7f1004101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 shutdown_connections 2024-05-09T01:10:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:01.834+0000 7f100b873700 1 -- 172.21.15.37:0/753225899 wait complete. 2024-05-09T01:10:02.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:02 smithi037 ceph-mon[30122]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 673 op/s 2024-05-09T01:10:02.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:02 smithi151 ceph-mon[34780]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 673 op/s 2024-05-09T01:10:02.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:02 smithi136 ceph-mon[34110]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 673 op/s 2024-05-09T01:10:02.909 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:10:02.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:10:03.324 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:04.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:04 smithi037 ceph-mon[30122]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.9 MiB/s wr, 688 op/s 2024-05-09T01:10:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:04 smithi136 ceph-mon[34110]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.9 MiB/s wr, 688 op/s 2024-05-09T01:10:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:04 smithi151 ceph-mon[34780]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.9 MiB/s wr, 688 op/s 2024-05-09T01:10:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 465.0 s, 1991.8 tps, lat 49.888 ms stddev 56.087 2024-05-09T01:10:05.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 -- 172.21.15.37:0/676474467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff968103a30 msgr2=0x7ff968110750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 --2- 172.21.15.37:0/676474467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff968103a30 0x7ff968110750 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009990 tx=0x7ff95c009ca0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 -- 172.21.15.37:0/676474467 shutdown_connections 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 --2- 172.21.15.37:0/676474467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968110c90 0x7ff9681130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 --2- 172.21.15.37:0/676474467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9681030e0 0x7ff9681034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 --2- 172.21.15.37:0/676474467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff968103a30 0x7ff968110750 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 -- 172.21.15.37:0/676474467 >> 172.21.15.37:0/676474467 conn(0x7ff9680fedc0 msgr2=0x7ff9681011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 -- 172.21.15.37:0/676474467 shutdown_connections 2024-05-09T01:10:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.516+0000 7ff96d248700 1 -- 172.21.15.37:0/676474467 wait complete. 2024-05-09T01:10:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.517+0000 7ff96d248700 1 Processor -- start 2024-05-09T01:10:05.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.518+0000 7ff96d248700 1 -- start start 2024-05-09T01:10:05.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.518+0000 7ff96d248700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9681030e0 0x7ff96810f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:05.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.518+0000 7ff96d248700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968103a30 0x7ff96810fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:05.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.518+0000 7ff96d248700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff968110c90 0x7ff9681a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:05.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.518+0000 7ff96d248700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9681064f0 con 0x7ff9681030e0 2024-05-09T01:10:05.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.518+0000 7ff96d248700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff968106370 con 0x7ff968110c90 2024-05-09T01:10:05.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.518+0000 7ff96d248700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff968106670 con 0x7ff968103a30 2024-05-09T01:10:05.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968103a30 0x7ff96810fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:05.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff966d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9681030e0 0x7ff96810f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:05.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96759e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff968110c90 0x7ff9681a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:05.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968103a30 0x7ff96810fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38614/0 (socket says 172.21.15.37:38614) 2024-05-09T01:10:05.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96659c700 1 -- 172.21.15.37:0/1365342748 learned_addr learned my addr 172.21.15.37:0/1365342748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:05.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff966d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9681030e0 0x7ff96810f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39742/0 (socket says 172.21.15.37:39742) 2024-05-09T01:10:05.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96759e700 1 -- 172.21.15.37:0/1365342748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968103a30 msgr2=0x7ff96810fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:05.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96759e700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968103a30 0x7ff96810fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96759e700 1 -- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9681030e0 msgr2=0x7ff96810f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:05.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96759e700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9681030e0 0x7ff96810f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96759e700 1 -- 172.21.15.37:0/1365342748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9681a6530 con 0x7ff968110c90 2024-05-09T01:10:05.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96659c700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968103a30 0x7ff96810fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:05.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff966d9d700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9681030e0 0x7ff96810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:05.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96759e700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff968110c90 0x7ff9681a5e90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff96000ab40 tx=0x7ff96000ae50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:05.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff94ffff700 1 -- 172.21.15.37:0/1365342748 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960017020 con 0x7ff968110c90 2024-05-09T01:10:05.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9681a6820 con 0x7ff968110c90 2024-05-09T01:10:05.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.519+0000 7ff94ffff700 1 -- 172.21.15.37:0/1365342748 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff960004bb0 con 0x7ff968110c90 2024-05-09T01:10:05.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.520+0000 7ff94ffff700 1 -- 172.21.15.37:0/1365342748 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960005280 con 0x7ff968110c90 2024-05-09T01:10:05.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.520+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9681ae140 con 0x7ff968110c90 2024-05-09T01:10:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.522+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9680512c0 con 0x7ff968110c90 2024-05-09T01:10:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.523+0000 7ff94ffff700 1 -- 172.21.15.37:0/1365342748 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff96000c580 con 0x7ff968110c90 2024-05-09T01:10:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.524+0000 7ff94ffff700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9500b2900 0x7ff9500b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.525+0000 7ff94ffff700 1 -- 172.21.15.37:0/1365342748 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff9600e1720 con 0x7ff968110c90 2024-05-09T01:10:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.525+0000 7ff966d9d700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9500b2900 0x7ff9500b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:05.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.525+0000 7ff966d9d700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9500b2900 0x7ff9500b4e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff958011490 tx=0x7ff958009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:05.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.529+0000 7ff94ffff700 1 -- 172.21.15.37:0/1365342748 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff960021020 con 0x7ff968110c90 2024-05-09T01:10:05.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.941+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff968110a70 con 0x7ff968110c90 2024-05-09T01:10:05.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.941+0000 7ff94ffff700 1 -- 172.21.15.37:0/1365342748 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11941 (secure 0 0 0) 0x7ff9600a94d0 con 0x7ff968110c90 2024-05-09T01:10:05.943 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:10:05.943 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:09:36.663141+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[0,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24454,24445,24467,24446]},"id":1}]} 2024-05-09T01:10:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9500b2900 msgr2=0x7ff9500b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9500b2900 0x7ff9500b4e10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff958011490 tx=0x7ff958009260 comp rx=0 tx=0).stop 2024-05-09T01:10:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff968110c90 msgr2=0x7ff9681a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff968110c90 0x7ff9681a5e90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff96000ab40 tx=0x7ff96000ae50 comp rx=0 tx=0).stop 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 shutdown_connections 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff9500b2900 0x7ff9500b4e10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff968110c90 0x7ff9681a5e90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9681030e0 0x7ff96810f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 --2- 172.21.15.37:0/1365342748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff968103a30 0x7ff96810fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 >> 172.21.15.37:0/1365342748 conn(0x7ff9680fedc0 msgr2=0x7ff968112900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 shutdown_connections 2024-05-09T01:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:05.945+0000 7ff96d248700 1 -- 172.21.15.37:0/1365342748 wait complete. 2024-05-09T01:10:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 41 2024-05-09T01:10:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.416+0000 7f92477fe640 1 -- 172.21.15.37:0/2602727616 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238040770 con 0x7f9248110190 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.417+0000 7f924efb2640 1 -- 172.21.15.37:0/2602727616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 msgr2=0x7f92481125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.417+0000 7f924efb2640 1 --2- 172.21.15.37:0/2602727616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f92481125b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f923801a910 tx=0x7f923803b450 comp rx=0 tx=0).stop 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.418+0000 7f924efb2640 1 -- 172.21.15.37:0/2602727616 shutdown_connections 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.418+0000 7f924efb2640 1 --2- 172.21.15.37:0/2602727616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f92481125b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.418+0000 7f924efb2640 1 --2- 172.21.15.37:0/2602727616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f924810b490 0x7f924810b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.418+0000 7f924efb2640 1 --2- 172.21.15.37:0/2602727616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f924810a450 0x7f924810af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.418+0000 7f924efb2640 1 -- 172.21.15.37:0/2602727616 >> 172.21.15.37:0/2602727616 conn(0x7f9248078f10 msgr2=0x7f924807b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.418+0000 7f924efb2640 1 -- 172.21.15.37:0/2602727616 shutdown_connections 2024-05-09T01:10:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.419+0000 7f924efb2640 1 -- 172.21.15.37:0/2602727616 wait complete. 2024-05-09T01:10:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 Processor -- start 2024-05-09T01:10:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 -- start start 2024-05-09T01:10:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f924810a450 0x7f924806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f924810b490 0x7f924806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f9248073cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f924807f120 con 0x7f924810a450 2024-05-09T01:10:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f924807efa0 con 0x7f9248110190 2024-05-09T01:10:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.420+0000 7f924efb2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f924807f2a0 con 0x7f924810b490 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.421+0000 7f924d54f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f9248073cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.421+0000 7f924d54f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f9248073cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56290/0 (socket says 172.21.15.37:56290) 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.421+0000 7f924d54f640 1 -- 172.21.15.37:0/1303038872 learned_addr learned my addr 172.21.15.37:0/1303038872 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.421+0000 7f924cd4e640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f924810a450 0x7f924806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.422+0000 7f924d54f640 1 -- 172.21.15.37:0/1303038872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f924810b490 msgr2=0x7f924806ce30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.422+0000 7f924d54f640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f924810b490 0x7f924806ce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.422+0000 7f924d54f640 1 -- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f924810a450 msgr2=0x7f924806c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.422+0000 7f924d54f640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f924810a450 0x7f924806c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.422+0000 7f924d54f640 1 -- 172.21.15.37:0/1303038872 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9248074320 con 0x7f9248110190 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.422+0000 7f924d54f640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f9248073cb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9238004aa0 tx=0x7f9238004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.422+0000 7f9245ffb640 1 -- 172.21.15.37:0/1303038872 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923804f070 con 0x7f9248110190 2024-05-09T01:10:06.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.423+0000 7f9245ffb640 1 -- 172.21.15.37:0/1303038872 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9238040bd0 con 0x7f9248110190 2024-05-09T01:10:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.423+0000 7f9245ffb640 1 -- 172.21.15.37:0/1303038872 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238046030 con 0x7f9248110190 2024-05-09T01:10:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.423+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92480745b0 con 0x7f9248110190 2024-05-09T01:10:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.423+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9248074ad0 con 0x7f9248110190 2024-05-09T01:10:06.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.427+0000 7f9255e67740 1 Processor -- start 2024-05-09T01:10:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.429+0000 7f9245ffb640 1 -- 172.21.15.37:0/1303038872 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9238052070 con 0x7f9248110190 2024-05-09T01:10:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.430+0000 7f9255e67740 1 -- start start 2024-05-09T01:10:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.430+0000 7f9255e67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.430+0000 7f9255e67740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d022f0 0x55b9e10cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.430+0000 7f9255e67740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.430+0000 7f9255e67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b9e10337c0 con 0x55b9e0d2b1b0 2024-05-09T01:10:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.430+0000 7f9255e67740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b9e0fcf0e0 con 0x55b9e0d022f0 2024-05-09T01:10:06.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.430+0000 7f9255e67740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b9e102f780 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38642/0 (socket says 172.21.15.37:38642) 2024-05-09T01:10:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 -- 172.21.15.37:0/1544549667 learned_addr learned my addr 172.21.15.37:0/1544549667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f924cd4e640 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d022f0 0x55b9e10cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 -- 172.21.15.37:0/1544549667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d022f0 msgr2=0x55b9e10cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d022f0 0x55b9e10cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 -- 172.21.15.37:0/1544549667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 msgr2=0x55b9e10cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.431+0000 7f9247fff640 1 -- 172.21.15.37:0/1544549667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e0ff87c0 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.432+0000 7f9247fff640 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d6980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9240009f20 tx=0x7f92400094e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f263daf029e9e424 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.432+0000 7f923effd640 1 -- 172.21.15.37:0/1544549667 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240003970 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.432+0000 7f923effd640 1 -- 172.21.15.37:0/1544549667 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9240017070 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.432+0000 7f9245ffb640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f922c0b2830 0x7f922c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.432+0000 7f923effd640 1 -- 172.21.15.37:0/1544549667 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240004280 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.432+0000 7f924cd4e640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f922c0b2830 0x7f922c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.432+0000 7f9245ffb640 1 -- 172.21.15.37:0/1303038872 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f92381137b0 con 0x7f9248110190 2024-05-09T01:10:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 -- 172.21.15.37:0/1544549667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 msgr2=0x55b9e10d6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f924cd4e640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f922c0b2830 0x7f922c0b4d40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55b9e10d08e0 tx=0x7f9234008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d6980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9240009f20 tx=0x7f92400094e0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 -- 172.21.15.37:0/1544549667 shutdown_connections 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d6980 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d022f0 0x55b9e10cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 --2- 172.21.15.37:0/1544549667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 -- 172.21.15.37:0/1544549667 >> 172.21.15.37:0/1544549667 conn(0x55b9e0d1f300 msgr2=0x55b9e10cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 -- 172.21.15.37:0/1544549667 shutdown_connections 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.433+0000 7f9255e67740 1 -- 172.21.15.37:0/1544549667 wait complete. 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.434+0000 7f9255e67740 1 -- start start 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.434+0000 7f9255e67740 1 Processor -- start 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.434+0000 7f9255e67740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d022f0 0x55b9e10d9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.434+0000 7f9255e67740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.434+0000 7f9255e67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.434+0000 7f9255e67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b9e10d73d0 con 0x55b9e0d2b1b0 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f9255e67740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b9e0fba9c0 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f9255e67740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b9e10d7550 con 0x55b9e0d022f0 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d022f0 0x55b9e10d9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d022f0 0x55b9e10d9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38648/0 (socket says 172.21.15.37:38648) 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 -- 172.21.15.37:0/528569496 learned_addr learned my addr 172.21.15.37:0/528569496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924d54f640 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f9255e67740 10 client.0 _ll_register_callbacks cb 0x55b9e0fe7020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f9247fff640 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 -- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 msgr2=0x55b9e10d98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 -- 172.21.15.37:0/528569496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 msgr2=0x55b9e10e07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 -- 172.21.15.37:0/528569496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e0fe11f0 con 0x55b9e0d022f0 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f924cd4e640 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d022f0 0x55b9e10d9370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92340167b0 tx=0x7f92340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab0a9d07dfb2ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.435+0000 7f922bfff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.436+0000 7f922bfff640 1 -- 172.21.15.37:0/528569496 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923401c050 con 0x55b9e0d022f0 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.436+0000 7f922bfff640 1 -- 172.21.15.37:0/528569496 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9234014930 con 0x55b9e0d022f0 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.436+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9240017070 con 0x55b9e0d022f0 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.436+0000 7f922bfff640 1 -- 172.21.15.37:0/528569496 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9234014b30 con 0x55b9e0d022f0 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.436+0000 7f9255e67740 10 client.26407 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:06.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.436+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55b9e0d96790 con 0x55b9e0d022f0 2024-05-09T01:10:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.438+0000 7f922bfff640 1 -- 172.21.15.37:0/528569496 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9240017070 con 0x55b9e0d022f0 2024-05-09T01:10:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.439+0000 7f922bfff640 1 -- 172.21.15.37:0/528569496 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f92340059c0 con 0x55b9e0d022f0 2024-05-09T01:10:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.439+0000 7f9255e67740 10 client.26407 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:06.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.439+0000 7f9255e67740 10 client.26407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.439+0000 7f9255e67740 20 client.26407 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.439+0000 7f9255e67740 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e0ce9d80 0x55b9e10e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.439+0000 7f9255e67740 4 client.26407 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.439+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9e10413d0 con 0x55b9e0ce9d80 2024-05-09T01:10:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.440+0000 7f9247fff640 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e0ce9d80 0x55b9e10e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.440+0000 7f922bfff640 10 client.26407 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:06.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.440+0000 7f9247fff640 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e0ce9d80 0x55b9e10e6d10 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a66c264372f01e1 server_cookie=7567414dc6458b38 in_seq=0 out_seq=0 2024-05-09T01:10:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f922bfff640 1 -- 172.21.15.37:0/528569496 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b9e10413d0 con 0x55b9e0ce9d80 2024-05-09T01:10:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f922bfff640 10 client.26407 handle_command_reply: tid=0 2024-05-09T01:10:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 client.26407 shutdown 2024-05-09T01:10:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d022f0 msgr2=0x55b9e10d9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d022f0 0x55b9e10d9370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92340167b0 tx=0x7f92340046c0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 shutdown_connections 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e0ce9d80 0x55b9e10e6d10 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f922bfff640 0 client.26407 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10d98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 --2- 172.21.15.37:0/528569496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d022f0 0x55b9e10d9370 secure :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92340167b0 tx=0x7f92340046c0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.441+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 >> 172.21.15.37:0/528569496 conn(0x55b9e0d1f300 msgr2=0x55b9e10c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.442+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 shutdown_connections 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.442+0000 7f9255e67740 1 -- 172.21.15.37:0/528569496 wait complete. 2024-05-09T01:10:06.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.442+0000 7f9255e67740 20 client.26407 trim_cache size 0 max 16384 2024-05-09T01:10:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 Processor -- start 2024-05-09T01:10:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 -- start start 2024-05-09T01:10:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10e0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92481b1950 con 0x55b9e0cbf1c0 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92481b3520 con 0x55b9e0d2b1b0 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f9255e67740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92481b2020 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.465+0000 7f924cd4e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924d54f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10e0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38660/0 (socket says 172.21.15.37:38660) 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 -- 172.21.15.37:0/2181602402 learned_addr learned my addr 172.21.15.37:0/2181602402 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f9247fff640 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 -- 172.21.15.37:0/2181602402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d2b1b0 msgr2=0x55b9e10e0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 -- 172.21.15.37:0/2181602402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0cbf1c0 msgr2=0x55b9e10e0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10e0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 -- 172.21.15.37:0/2181602402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e0e0d5f0 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f924cd4e640 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10c9e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9234005de0 tx=0x7f9234006060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68414b308c5b40b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f923e7fc640 1 -- 172.21.15.37:0/2181602402 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923401c040 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f923e7fc640 1 -- 172.21.15.37:0/2181602402 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9234026070 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.466+0000 7f923e7fc640 1 -- 172.21.15.37:0/2181602402 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9234021440 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.467+0000 7f9255e67740 1 -- 172.21.15.37:0/2181602402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 msgr2=0x55b9e10c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10c9e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9234005de0 tx=0x7f9234006060 comp rx=0 tx=0).stop 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 -- 172.21.15.37:0/2181602402 shutdown_connections 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10e0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10e0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 --2- 172.21.15.37:0/2181602402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10c9e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 -- 172.21.15.37:0/2181602402 >> 172.21.15.37:0/2181602402 conn(0x55b9e0d1f300 msgr2=0x55b9e10c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 -- 172.21.15.37:0/2181602402 shutdown_connections 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.468+0000 7f9255e67740 1 -- 172.21.15.37:0/2181602402 wait complete. 2024-05-09T01:10:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.469+0000 7f9255e67740 1 -- start start 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.469+0000 7f9255e67740 1 Processor -- start 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9255e67740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9255e67740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10deae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9255e67740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9255e67740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92481b2e50 con 0x55b9e0d2b1b0 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9255e67740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92481b2780 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9255e67740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92481af930 con 0x55b9e0cbf1c0 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9255e67740 10 client.0 _ll_register_callbacks cb 0x7f923400b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10deae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56328/0 (socket says 172.21.15.37:56328) 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 -- 172.21.15.37:0/2906528410 learned_addr learned my addr 172.21.15.37:0/2906528410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f924cd4e640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f924d54f640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 -- 172.21.15.37:0/2906528410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0cbf1c0 msgr2=0x55b9e10de5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10de5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 -- 172.21.15.37:0/2906528410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 msgr2=0x55b9e10dfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10dfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f9247fff640 1 -- 172.21.15.37:0/2906528410 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e0ff7ed0 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.470+0000 7f924cd4e640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10de5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f9247fff640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10deae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9240009f20 tx=0x7f9240005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ec18f97b0701434 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f922bfff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f922bfff640 1 -- 172.21.15.37:0/2906528410 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240013240 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f922bfff640 1 -- 172.21.15.37:0/2906528410 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f924000c7f0 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9234026070 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f922bfff640 1 -- 172.21.15.37:0/2906528410 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f92400133e0 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f9255e67740 10 client.26435 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:06.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55b9e10e10c0 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.471+0000 7f922bfff640 1 -- 172.21.15.37:0/2906528410 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9234026070 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f922bfff640 1 -- 172.21.15.37:0/2906528410 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f9240032050 con 0x55b9e0d0a4d0 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f9255e67740 10 client.26435 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f9255e67740 10 client.26435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f9255e67740 20 client.26435 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f9255e67740 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e114f320 0x55b9e1151740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f9255e67740 4 client.26435 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9e103b240 con 0x55b9e114f320 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.472+0000 7f924cd4e640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e114f320 0x55b9e1151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.473+0000 7f924cd4e640 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e114f320 0x55b9e1151740 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e1a94c26dcf3a50 server_cookie=9da9dc5dfee03a70 in_seq=0 out_seq=0 2024-05-09T01:10:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.473+0000 7f922bfff640 10 client.26435 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f922bfff640 1 -- 172.21.15.37:0/2906528410 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b9e103b240 con 0x55b9e114f320 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f922bfff640 10 client.26435 handle_command_reply: tid=0 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 client.26435 shutdown 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 msgr2=0x55b9e10deae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10deae0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9240009f20 tx=0x7f9240005d90 comp rx=0 tx=0).stop 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 shutdown_connections 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b9e114f320 0x55b9e1151740 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9e0d2b1b0 0x55b9e10dfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b9e0d0a4d0 0x55b9e10deae0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 --2- 172.21.15.37:0/2906528410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e0cbf1c0 0x55b9e10de5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 >> 172.21.15.37:0/2906528410 conn(0x55b9e0d1f300 msgr2=0x55b9e10ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.483+0000 7f922bfff640 0 client.26435 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.484+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 shutdown_connections 2024-05-09T01:10:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.484+0000 7f9255e67740 1 -- 172.21.15.37:0/2906528410 wait complete. 2024-05-09T01:10:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.484+0000 7f9255e67740 20 client.26435 trim_cache size 0 max 16384 2024-05-09T01:10:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:10:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:10:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:10:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f922c0b2830 msgr2=0x7f922c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f922c0b2830 0x7f922c0b4d40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55b9e10d08e0 tx=0x7f9234008040 comp rx=0 tx=0).stop 2024-05-09T01:10:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 msgr2=0x7f9248073cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f9248073cb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9238004aa0 tx=0x7f9238004ad0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 shutdown_connections 2024-05-09T01:10:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f922c0b2830 0x7f922c0b4d40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9248110190 0x7f9248073cb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f924810b490 0x7f924806ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 --2- 172.21.15.37:0/1303038872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f924810a450 0x7f924806c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 >> 172.21.15.37:0/1303038872 conn(0x7f9248078f10 msgr2=0x7f924810c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 shutdown_connections 2024-05-09T01:10:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:06.485+0000 7f924efb2640 1 -- 172.21.15.37:0/1303038872 wait complete. 2024-05-09T01:10:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:06 smithi136 ceph-mon[34110]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 630 op/s 2024-05-09T01:10:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:06 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1365342748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:10:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:06 smithi037 ceph-mon[30122]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 630 op/s 2024-05-09T01:10:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:06 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1365342748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:10:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:06 smithi151 ceph-mon[34780]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 630 op/s 2024-05-09T01:10:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:06 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1365342748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:10:06.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:10:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:08 smithi136 ceph-mon[34110]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 660 op/s 2024-05-09T01:10:08.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:08 smithi037 ceph-mon[30122]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 660 op/s 2024-05-09T01:10:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:08 smithi151 ceph-mon[34780]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 660 op/s 2024-05-09T01:10:09.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.154+0000 7f61a8017700 1 -- 172.21.15.37:0/1155606836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a0108b90 msgr2=0x7f61a0102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.154+0000 7f61a8017700 1 --2- 172.21.15.37:0/1155606836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a0108b90 0x7f61a0102580 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f619c0098f0 tx=0x7f619c009c00 comp rx=0 tx=0).stop 2024-05-09T01:10:09.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.156+0000 7f61a8017700 1 -- 172.21.15.37:0/1155606836 shutdown_connections 2024-05-09T01:10:09.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.156+0000 7f61a8017700 1 --2- 172.21.15.37:0/1155606836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a0102ac0 0x7f61a0102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.156+0000 7f61a8017700 1 --2- 172.21.15.37:0/1155606836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61a006a930 0x7f61a01085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.156+0000 7f61a8017700 1 --2- 172.21.15.37:0/1155606836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a0108b90 0x7f61a0102580 secure :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f619c0098f0 tx=0x7f619c009c00 comp rx=0 tx=0).stop 2024-05-09T01:10:09.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.156+0000 7f61a8017700 1 -- 172.21.15.37:0/1155606836 >> 172.21.15.37:0/1155606836 conn(0x7f61a00fe0d0 msgr2=0x7f61a01004f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:09.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.158+0000 7f61a8017700 1 -- 172.21.15.37:0/1155606836 shutdown_connections 2024-05-09T01:10:09.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.159+0000 7f61a8017700 1 -- 172.21.15.37:0/1155606836 wait complete. 2024-05-09T01:10:09.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.160+0000 7f61a8017700 1 Processor -- start 2024-05-09T01:10:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.163+0000 7f61a8017700 1 -- start start 2024-05-09T01:10:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.164+0000 7f61a8017700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a006a930 0x7f61a0112750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.164+0000 7f61a8017700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61a0102ac0 0x7f61a0112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.164+0000 7f61a8017700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a01131d0 0x7f61a0074470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.164+0000 7f61a8017700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61a0110350 con 0x7f61a01131d0 2024-05-09T01:10:09.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.164+0000 7f61a8017700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f61a01101d0 con 0x7f61a0102ac0 2024-05-09T01:10:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.164+0000 7f61a8017700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61a01104d0 con 0x7f61a006a930 2024-05-09T01:10:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.166+0000 7f61a5db3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a006a930 0x7f61a0112750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.166+0000 7f61a5db3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a006a930 0x7f61a0112750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38686/0 (socket says 172.21.15.37:38686) 2024-05-09T01:10:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.166+0000 7f61a5db3700 1 -- 172.21.15.37:0/1913316879 learned_addr learned my addr 172.21.15.37:0/1913316879 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.168+0000 7f61a65b4700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a01131d0 0x7f61a0074470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.171+0000 7f61a55b2700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61a0102ac0 0x7f61a0112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.173+0000 7f61a65b4700 1 -- 172.21.15.37:0/1913316879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a006a930 msgr2=0x7f61a0112750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.173+0000 7f61a65b4700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a006a930 0x7f61a0112750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.173+0000 7f61a65b4700 1 -- 172.21.15.37:0/1913316879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61a0102ac0 msgr2=0x7f61a0112c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.173+0000 7f61a65b4700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61a0102ac0 0x7f61a0112c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.173+0000 7f61a65b4700 1 -- 172.21.15.37:0/1913316879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00749b0 con 0x7f61a01131d0 2024-05-09T01:10:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.175+0000 7f61a65b4700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a01131d0 0x7f61a0074470 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f619800be20 tx=0x7f619800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.175+0000 7f6196ffd700 1 -- 172.21.15.37:0/1913316879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198019070 con 0x7f61a01131d0 2024-05-09T01:10:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.175+0000 7f6196ffd700 1 -- 172.21.15.37:0/1913316879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f619800cc50 con 0x7f61a01131d0 2024-05-09T01:10:09.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.175+0000 7f6196ffd700 1 -- 172.21.15.37:0/1913316879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61980125e0 con 0x7f61a01131d0 2024-05-09T01:10:09.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.176+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a0074ca0 con 0x7f61a01131d0 2024-05-09T01:10:09.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.176+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a0075190 con 0x7f61a01131d0 2024-05-09T01:10:09.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.181+0000 7f6196ffd700 1 -- 172.21.15.37:0/1913316879 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f619801c070 con 0x7f61a01131d0 2024-05-09T01:10:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.191+0000 7f61b6a2db80 1 Processor -- start 2024-05-09T01:10:09.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.191+0000 7f61b6a2db80 1 -- start start 2024-05-09T01:10:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.192+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x5630349cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.192+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348484a0 0x5630349cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.192+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.192+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630348e80a0 con 0x5630348c2d00 2024-05-09T01:10:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.192+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56303488d9a0 con 0x5630349c5400 2024-05-09T01:10:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.192+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5630348e4060 con 0x5630348484a0 2024-05-09T01:10:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.193+0000 7f6196ffd700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f618c0b2a00 0x7f618c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.194+0000 7f61a65b4700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f618c0b2a00 0x7f618c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.194+0000 7f6196ffd700 1 -- 172.21.15.37:0/1913316879 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f61980e2690 con 0x7f61a01131d0 2024-05-09T01:10:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.195+0000 7f61a65b4700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f618c0b2a00 0x7f618c0b4f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f61980a6f20 tx=0x7f6198004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.198+0000 7f61a55b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x5630349cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.198+0000 7f61a55b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x5630349cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39828/0 (socket says 172.21.15.37:39828) 2024-05-09T01:10:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.198+0000 7f61a55b2700 1 -- 172.21.15.37:0/2503055221 learned_addr learned my addr 172.21.15.37:0/2503055221 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.198+0000 7f61a55b2700 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.200+0000 7f61a5db3700 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348484a0 0x5630349cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.204+0000 7f61a55b2700 1 -- 172.21.15.37:0/2503055221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348484a0 msgr2=0x5630349cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.204+0000 7f61a55b2700 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348484a0 0x5630349cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.204+0000 7f61a55b2700 1 -- 172.21.15.37:0/2503055221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 msgr2=0x5630349c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.204+0000 7f61a55b2700 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.205+0000 7f61a55b2700 1 -- 172.21.15.37:0/2503055221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303487e500 con 0x5630348c2d00 2024-05-09T01:10:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.206+0000 7f61a55b2700 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x5630349cb240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f619c017570 tx=0x7f619c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870d275544f033a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.207+0000 7f618bfff700 1 -- 172.21.15.37:0/2503055221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c00f6a0 con 0x5630348c2d00 2024-05-09T01:10:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.207+0000 7f618bfff700 1 -- 172.21.15.37:0/2503055221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f619c022040 con 0x5630348c2d00 2024-05-09T01:10:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.207+0000 7f618bfff700 1 -- 172.21.15.37:0/2503055221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c004970 con 0x5630348c2d00 2024-05-09T01:10:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.208+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2503055221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 msgr2=0x5630349cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.208+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x5630349cb240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f619c017570 tx=0x7f619c005e80 comp rx=0 tx=0).stop 2024-05-09T01:10:09.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.209+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2503055221 shutdown_connections 2024-05-09T01:10:09.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.209+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.209+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x5630349cb240 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.209+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2503055221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348484a0 0x5630349cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.209+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2503055221 >> 172.21.15.37:0/2503055221 conn(0x56303484bf70 msgr2=0x5630349c0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:09.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.209+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2503055221 shutdown_connections 2024-05-09T01:10:09.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.209+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2503055221 wait complete. 2024-05-09T01:10:09.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.210+0000 7f61b6a2db80 1 -- start start 2024-05-09T01:10:09.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.210+0000 7f61b6a2db80 1 Processor -- start 2024-05-09T01:10:09.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5630349c6100 con 0x5630348484a0 2024-05-09T01:10:09.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563034882b20 con 0x5630349c5400 2024-05-09T01:10:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61a55b2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61a55b2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56358/0 (socket says 172.21.15.37:56358) 2024-05-09T01:10:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61a55b2700 1 -- 172.21.15.37:0/910547153 learned_addr learned my addr 172.21.15.37:0/910547153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.211+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5630349d1e70 con 0x5630348c2d00 2024-05-09T01:10:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.212+0000 7f61a5db3700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.212+0000 7f61b6a2db80 10 client.0 _ll_register_callbacks cb 0x5630347596c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:09.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.212+0000 7f61a55b2700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61a5db3700 1 -- 172.21.15.37:0/910547153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 msgr2=0x5630349cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61a5db3700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61a5db3700 1 -- 172.21.15.37:0/910547153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 msgr2=0x5630349ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61a5db3700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61a5db3700 1 -- 172.21.15.37:0/910547153 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563034763490 con 0x5630348c2d00 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61a55b2700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61a5db3700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cf420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5630349c1a00 tx=0x7f6190012a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3dcfc0692dbf9a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61897fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:09.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.213+0000 7f61897fa700 1 -- 172.21.15.37:0/910547153 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190004030 con 0x5630348c2d00 2024-05-09T01:10:09.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.214+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f619c022040 con 0x5630348c2d00 2024-05-09T01:10:09.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.214+0000 7f61897fa700 1 -- 172.21.15.37:0/910547153 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f61900041d0 con 0x5630348c2d00 2024-05-09T01:10:09.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.214+0000 7f61897fa700 1 -- 172.21.15.37:0/910547153 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f61900043d0 con 0x5630348c2d00 2024-05-09T01:10:09.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.214+0000 7f61b6a2db80 10 client.26425 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:09.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.214+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5630349dcac0 con 0x5630348c2d00 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.214+0000 7f61897fa700 1 -- 172.21.15.37:0/910547153 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6190003b30 con 0x5630348c2d00 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.215+0000 7f61897fa700 1 -- 172.21.15.37:0/910547153 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f619001c7f0 con 0x5630348c2d00 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.215+0000 7f61b6a2db80 10 client.26425 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.215+0000 7f61b6a2db80 10 client.26425 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.215+0000 7f61b6a2db80 20 client.26425 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.215+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5630349df100 0x5630349e1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.215+0000 7f61b6a2db80 4 client.26425 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.215+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f619c022040 con 0x5630349df100 2024-05-09T01:10:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.216+0000 7f61a55b2700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5630349df100 0x5630349e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.217+0000 7f61a55b2700 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5630349df100 0x5630349e1520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c511c8d890ee32b7 server_cookie=b50ac9a55a50c13c in_seq=0 out_seq=0 2024-05-09T01:10:09.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.217+0000 7f61897fa700 10 client.26425 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:10:09.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.217+0000 7f61897fa700 1 -- 172.21.15.37:0/910547153 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f619c022040 con 0x5630349df100 2024-05-09T01:10:09.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.217+0000 7f61897fa700 10 client.26425 handle_command_reply: tid=0 2024-05-09T01:10:09.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.218+0000 7f61b6a2db80 1 client.26425 shutdown 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.218+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 msgr2=0x5630349cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.218+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cf420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x5630349c1a00 tx=0x7f6190012a00 comp rx=0 tx=0).stop 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.218+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 shutdown_connections 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.218+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5630349df100 0x5630349e1520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.218+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.218+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.219+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/910547153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cf420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.219+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 >> 172.21.15.37:0/910547153 conn(0x56303484bf70 msgr2=0x5630349b9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.219+0000 7f61897fa700 0 client.26425 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.219+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 shutdown_connections 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.219+0000 7f61b6a2db80 1 -- 172.21.15.37:0/910547153 wait complete. 2024-05-09T01:10:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.219+0000 7f61b6a2db80 20 client.26425 trim_cache size 0 max 16384 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.241+0000 7f61b6a2db80 1 Processor -- start 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.241+0000 7f61b6a2db80 1 -- start start 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349ba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f618400d310 con 0x5630348484a0 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f618400eee0 con 0x5630349c5400 2024-05-09T01:10:09.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f618400d9e0 con 0x5630348c2d00 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61a5db3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61a5db3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38714/0 (socket says 172.21.15.37:38714) 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.242+0000 7f61a5db3700 1 -- 172.21.15.37:0/2396349766 learned_addr learned my addr 172.21.15.37:0/2396349766 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a55b2700 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a5db3700 1 -- 172.21.15.37:0/2396349766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 msgr2=0x5630349ba700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a5db3700 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349ba700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a55b2700 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a5db3700 1 -- 172.21.15.37:0/2396349766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 msgr2=0x5630349ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a5db3700 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a5db3700 1 -- 172.21.15.37:0/2396349766 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630349c1e70 con 0x5630348c2d00 2024-05-09T01:10:09.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.243+0000 7f61a55b2700 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:10:09.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.244+0000 7f61a5db3700 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cde60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f619001cc10 tx=0x7f6190004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d07ed41b2b52393 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:09.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.244+0000 7f618b7fe700 1 -- 172.21.15.37:0/2396349766 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619001c670 con 0x5630348c2d00 2024-05-09T01:10:09.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.244+0000 7f618b7fe700 1 -- 172.21.15.37:0/2396349766 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61900054e0 con 0x5630348c2d00 2024-05-09T01:10:09.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.244+0000 7f618b7fe700 1 -- 172.21.15.37:0/2396349766 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6190004ab0 con 0x5630348c2d00 2024-05-09T01:10:09.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2396349766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 msgr2=0x5630349cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cde60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f619001cc10 tx=0x7f6190004570 comp rx=0 tx=0).stop 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2396349766 shutdown_connections 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630349c5400 0x5630349ba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348484a0 0x5630349ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/2396349766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630348c2d00 0x5630349cde60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2396349766 >> 172.21.15.37:0/2396349766 conn(0x56303484bf70 msgr2=0x5630349b9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2396349766 shutdown_connections 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.246+0000 7f61b6a2db80 1 -- 172.21.15.37:0/2396349766 wait complete. 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.247+0000 7f61b6a2db80 1 -- start start 2024-05-09T01:10:09.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.247+0000 7f61b6a2db80 1 Processor -- start 2024-05-09T01:10:09.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.248+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630348484a0 0x563034a40c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.248+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x563034a411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.248+0000 7f61b6a2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630349c5400 0x5630349d4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.248+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f618400e810 con 0x5630348c2d00 2024-05-09T01:10:09.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.248+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f618400e140 con 0x5630348484a0 2024-05-09T01:10:09.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.248+0000 7f61b6a2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f618400b2b0 con 0x5630349c5400 2024-05-09T01:10:09.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.249+0000 7f61b6a2db80 10 client.0 _ll_register_callbacks cb 0x5630347596c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.249+0000 7f61a55b2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630348484a0 0x563034a40c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.249+0000 7f61a55b2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630348484a0 0x563034a40c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56388/0 (socket says 172.21.15.37:56388) 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.249+0000 7f61a55b2700 1 -- 172.21.15.37:0/3787316155 learned_addr learned my addr 172.21.15.37:0/3787316155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.249+0000 7f61a55b2700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630349c5400 0x5630349d4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.249+0000 7f61a5db3700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x563034a411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61a55b2700 1 -- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630349c5400 msgr2=0x5630349d4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61a55b2700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630349c5400 0x5630349d4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61a55b2700 1 -- 172.21.15.37:0/3787316155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 msgr2=0x563034a411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61a55b2700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x563034a411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61a55b2700 1 -- 172.21.15.37:0/3787316155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630349d4c90 con 0x5630348484a0 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61a5db3700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x563034a411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:10:09.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61a55b2700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630348484a0 0x563034a40c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5630349e1cc0 tx=0x7f619c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a1296e4ec98a32 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:09.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.250+0000 7f61897fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:10:09.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.251+0000 7f61897fa700 1 -- 172.21.15.37:0/3787316155 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c03d060 con 0x5630348484a0 2024-05-09T01:10:09.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.251+0000 7f61897fa700 1 -- 172.21.15.37:0/3787316155 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f619c01c040 con 0x5630348484a0 2024-05-09T01:10:09.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.251+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61900054e0 con 0x5630348484a0 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.251+0000 7f61897fa700 1 -- 172.21.15.37:0/3787316155 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f619c038620 con 0x5630348484a0 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 10 client.26450 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x563034a49240 con 0x5630348484a0 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61897fa700 1 -- 172.21.15.37:0/3787316155 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f619c02e070 con 0x5630348484a0 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61897fa700 1 -- 172.21.15.37:0/3787316155 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f619c017ca0 con 0x5630348484a0 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 10 client.26450 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 10 client.26450 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 20 client.26450 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:09.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563034a49580 0x563034a4b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:09.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 4 client.26450 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:10:09.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.252+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f61900054e0 con 0x563034a49580 2024-05-09T01:10:09.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.253+0000 7f61a5db3700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563034a49580 0x563034a4b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61897fa700 10 client.26450 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61a5db3700 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563034a49580 0x563034a4b9a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f9930128de1a22fd server_cookie=b69933cdadce2c0a in_seq=0 out_seq=0 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61897fa700 1 -- 172.21.15.37:0/3787316155 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f61900054e0 con 0x563034a49580 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61897fa700 10 client.26450 handle_command_reply: tid=0 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61b6a2db80 1 client.26450 shutdown 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630348484a0 msgr2=0x563034a40c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630348484a0 0x563034a40c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5630349e1cc0 tx=0x7f619c005e80 comp rx=0 tx=0).stop 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 shutdown_connections 2024-05-09T01:10:09.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.254+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x563034a49580 0x563034a4b9a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61897fa700 0 client.26450 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630349c5400 0x5630349d4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5630348484a0 0x563034a40c70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61b6a2db80 1 --2- 172.21.15.37:0/3787316155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630348c2d00 0x563034a411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 >> 172.21.15.37:0/3787316155 conn(0x56303484bf70 msgr2=0x5630349c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 shutdown_connections 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61b6a2db80 1 -- 172.21.15.37:0/3787316155 wait complete. 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.255+0000 7f61b6a2db80 20 client.26450 trim_cache size 0 max 16384 2024-05-09T01:10:09.257 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:10:09.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f618c0b2a00 msgr2=0x7f618c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f618c0b2a00 0x7f618c0b4f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f61980a6f20 tx=0x7f6198004ad0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a01131d0 msgr2=0x7f61a0074470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a01131d0 0x7f61a0074470 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f619800be20 tx=0x7f619800bf00 comp rx=0 tx=0).stop 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 shutdown_connections 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f618c0b2a00 0x7f618c0b4f10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a01131d0 0x7f61a0074470 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a006a930 0x7f61a0112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 --2- 172.21.15.37:0/1913316879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61a0102ac0 0x7f61a0112c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 >> 172.21.15.37:0/1913316879 conn(0x7f61a00fe0d0 msgr2=0x7f61a00ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 shutdown_connections 2024-05-09T01:10:09.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:09.256+0000 7f61a8017700 1 -- 172.21.15.37:0/1913316879 wait complete. 2024-05-09T01:10:09.950 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:09 smithi037 ceph-mon[30122]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 630 op/s 2024-05-09T01:10:09.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:09 smithi151 ceph-mon[34780]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 630 op/s 2024-05-09T01:10:09.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:10:10.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:09 smithi136 ceph-mon[34110]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 630 op/s 2024-05-09T01:10:10.233 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 470.0 s, 2038.6 tps, lat 48.477 ms stddev 61.225 2024-05-09T01:10:10.352 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 -- 172.21.15.37:0/243445280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 msgr2=0x7f345c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 --2- 172.21.15.37:0/243445280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1100a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f345400b0d0 tx=0x7f345400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 -- 172.21.15.37:0/243445280 shutdown_connections 2024-05-09T01:10:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 --2- 172.21.15.37:0/243445280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1100a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 --2- 172.21.15.37:0/243445280 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f345c1034c0 0x7f345c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 --2- 172.21.15.37:0/243445280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f345c107df0 0x7f345c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 -- 172.21.15.37:0/243445280 >> 172.21.15.37:0/243445280 conn(0x7f345c0fedc0 msgr2=0x7f345c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 -- 172.21.15.37:0/243445280 shutdown_connections 2024-05-09T01:10:12.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.292+0000 7f346327e700 1 -- 172.21.15.37:0/243445280 wait complete. 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 Processor -- start 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 -- start start 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f345c1034c0 0x7f345c19cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f345c107df0 0x7f345c19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f345c112130 con 0x7f345c108740 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f345c111fb0 con 0x7f345c1034c0 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346327e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f345c1122b0 con 0x7f345c107df0 2024-05-09T01:10:12.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346181b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346101a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f345c1034c0 0x7f345c19cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346181b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45166/0 (socket says 172.21.15.37:45166) 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f346181b700 1 -- 172.21.15.37:0/1021460816 learned_addr learned my addr 172.21.15.37:0/1021460816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.293+0000 7f3460819700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f345c107df0 0x7f345c19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346181b700 1 -- 172.21.15.37:0/1021460816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f345c107df0 msgr2=0x7f345c19d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346181b700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f345c107df0 0x7f345c19d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346181b700 1 -- 172.21.15.37:0/1021460816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f345c1034c0 msgr2=0x7f345c19cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346181b700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f345c1034c0 0x7f345c19cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346181b700 1 -- 172.21.15.37:0/1021460816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c1a1e90 con 0x7f345c108740 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346181b700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1a17f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f34540095c0 tx=0x7f3454007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f34527fc700 1 -- 172.21.15.37:0/1021460816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345401f070 con 0x7f345c108740 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345c1a2120 con 0x7f345c108740 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f34527fc700 1 -- 172.21.15.37:0/1021460816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3454007e20 con 0x7f345c108740 2024-05-09T01:10:12.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f34527fc700 1 -- 172.21.15.37:0/1021460816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345401b4a0 con 0x7f345c108740 2024-05-09T01:10:12.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.294+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345c1a9aa0 con 0x7f345c108740 2024-05-09T01:10:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.300+0000 7f34527fc700 1 -- 172.21.15.37:0/1021460816 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3454022070 con 0x7f345c108740 2024-05-09T01:10:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.300+0000 7f3471c94b80 1 Processor -- start 2024-05-09T01:10:12.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.300+0000 7f3471c94b80 1 -- start start 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.300+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.300+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006094a0 0x559b0078ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.300+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00786ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f3471c94b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b006a8ff0 con 0x559b006f3160 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f346101a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006094a0 0x559b0078ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f3460819700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f346101a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006094a0 0x559b0078ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60662/0 (socket says 172.21.15.37:60662) 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f3460819700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45176/0 (socket says 172.21.15.37:45176) 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f346101a700 1 -- 172.21.15.37:0/1417580439 learned_addr learned my addr 172.21.15.37:0/1417580439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:12.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f34527fc700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34480b2880 0x7f34480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f3471c94b80 1 -- 172.21.15.37:0/1417580439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559b006477f0 con 0x559b006094a0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f3471c94b80 1 -- 172.21.15.37:0/1417580439 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559b006a4fb0 con 0x559b007866a0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f34527fc700 1 -- 172.21.15.37:0/1021460816 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f345400f020 con 0x7f345c108740 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f346181b700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34480b2880 0x7f34480b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f3460819700 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00786ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.301+0000 7f346101a700 1 -- 172.21.15.37:0/1417580439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 msgr2=0x559b00786ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f346101a700 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00786ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f346101a700 1 -- 172.21.15.37:0/1417580439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 msgr2=0x559b0078c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f346101a700 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f346101a700 1 -- 172.21.15.37:0/1417580439 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0063f370 con 0x559b006094a0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f346101a700 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006094a0 0x559b0078ca30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f345800bd70 tx=0x7f34580106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95e055591ec0cba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f346181b700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34480b2880 0x7f34480b4d90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3454009900 tx=0x7f345400b9d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f34477fe700 1 -- 172.21.15.37:0/1417580439 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458010e10 con 0x559b006094a0 2024-05-09T01:10:12.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.302+0000 7f34477fe700 1 -- 172.21.15.37:0/1417580439 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f345801c930 con 0x559b006094a0 2024-05-09T01:10:12.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.303+0000 7f3471c94b80 1 -- 172.21.15.37:0/1417580439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006094a0 msgr2=0x559b0078ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.303+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006094a0 0x559b0078ca30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f345800bd70 tx=0x7f34580106b0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f34477fe700 1 -- 172.21.15.37:0/1417580439 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34580118d0 con 0x559b006094a0 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f3471c94b80 1 -- 172.21.15.37:0/1417580439 shutdown_connections 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00786ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1417580439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006094a0 0x559b0078ca30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f3471c94b80 1 -- 172.21.15.37:0/1417580439 >> 172.21.15.37:0/1417580439 conn(0x559b006696a0 msgr2=0x559b00781400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f3471c94b80 1 -- 172.21.15.37:0/1417580439 shutdown_connections 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.304+0000 7f3471c94b80 1 -- 172.21.15.37:0/1417580439 wait complete. 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 -- start start 2024-05-09T01:10:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 Processor -- start 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006094a0 0x559b007900e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006f3160 0x559b00790620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00790b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b00524ba0 con 0x559b006094a0 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559b00663150 con 0x559b006f3160 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559b007931d0 con 0x559b007866a0 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3471c94b80 10 client.0 _ll_register_callbacks cb 0x559b0051a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.305+0000 7f3460819700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006094a0 0x559b007900e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006094a0 0x559b007900e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45180/0 (socket says 172.21.15.37:45180) 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 -- 172.21.15.37:0/3363366152 learned_addr learned my addr 172.21.15.37:0/3363366152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f346101a700 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006f3160 0x559b00790620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00790b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 -- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006f3160 msgr2=0x559b00790620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006f3160 0x559b00790620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 -- 172.21.15.37:0/3363366152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006094a0 msgr2=0x559b007900e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006094a0 0x559b007900e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 -- 172.21.15.37:0/3363366152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b00524490 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3460819700 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00790b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f345c076ab0 tx=0x7f344c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b05f13c3a2bc97d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.306+0000 7f3444ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3444ff9700 1 -- 172.21.15.37:0/3363366152 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c004830 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3444ff9700 1 -- 172.21.15.37:0/3363366152 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f344c0049d0 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f345801c930 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3444ff9700 1 -- 172.21.15.37:0/3363366152 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f344c028050 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3471c94b80 10 client.26440 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559b0079dc80 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3444ff9700 1 -- 172.21.15.37:0/3363366152 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f345801c930 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3444ff9700 1 -- 172.21.15.37:0/3363366152 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f344c012450 con 0x559b007866a0 2024-05-09T01:10:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3471c94b80 10 client.26440 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3471c94b80 10 client.26440 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.307+0000 7f3471c94b80 20 client.26440 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.308+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b007a0210 0x559b007a2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.308+0000 7f3471c94b80 4 client.26440 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.308+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b006b69d0 con 0x559b007a0210 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.308+0000 7f346101a700 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b007a0210 0x559b007a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.308+0000 7f346101a700 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b007a0210 0x559b007a2630 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a93ebd8807221c1b server_cookie=d93c37911bdaf3e1 in_seq=0 out_seq=0 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.308+0000 7f3444ff9700 10 client.26440 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3444ff9700 1 -- 172.21.15.37:0/3363366152 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559b006b69d0 con 0x559b007a0210 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3444ff9700 10 client.26440 handle_command_reply: tid=0 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 client.26440 shutdown 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 msgr2=0x559b00790b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00790b60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f345c076ab0 tx=0x7f344c004750 comp rx=0 tx=0).stop 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 shutdown_connections 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b007866a0 0x559b00790b60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006094a0 0x559b007900e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b007a0210 0x559b007a2630 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3363366152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b006f3160 0x559b00790620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 >> 172.21.15.37:0/3363366152 conn(0x559b006696a0 msgr2=0x559b007811c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3444ff9700 0 client.26440 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 shutdown_connections 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.309+0000 7f3471c94b80 1 -- 172.21.15.37:0/3363366152 wait complete. 2024-05-09T01:10:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.310+0000 7f3471c94b80 20 client.26440 trim_cache size 0 max 16384 2024-05-09T01:10:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.332+0000 7f3471c94b80 1 Processor -- start 2024-05-09T01:10:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.333+0000 7f3471c94b80 1 -- start start 2024-05-09T01:10:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.333+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.333+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.333+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0079c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.333+0000 7f3471c94b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f345c1b0c00 con 0x559b006f3160 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.333+0000 7f3471c94b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f345c1b27d0 con 0x559b007866a0 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.333+0000 7f3471c94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f345c1b12d0 con 0x559b006094a0 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.335+0000 7f3460819700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.335+0000 7f3460819700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0079c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.335+0000 7f3460819700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34720/0 (socket says 172.21.15.37:34720) 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.335+0000 7f3460819700 1 -- 172.21.15.37:0/3452615273 learned_addr learned my addr 172.21.15.37:0/3452615273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.336+0000 7f3460819700 1 -- 172.21.15.37:0/3452615273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 msgr2=0x559b0079c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.336+0000 7f3460819700 1 --2- 172.21.15.37:0/3452615273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0079c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.336+0000 7f3460819700 1 -- 172.21.15.37:0/3452615273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 msgr2=0x559b0078b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.336+0000 7f3460819700 1 --2- 172.21.15.37:0/3452615273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.336+0000 7f3460819700 1 -- 172.21.15.37:0/3452615273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0078c050 con 0x559b006094a0 2024-05-09T01:10:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.336+0000 7f3460819700 1 --2- 172.21.15.37:0/3452615273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078a7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f344c0129c0 tx=0x7f344c003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8f6acbc51ec61c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.341+0000 7f3446ffd700 1 -- 172.21.15.37:0/3452615273 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c012450 con 0x559b006094a0 2024-05-09T01:10:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.341+0000 7f3446ffd700 1 -- 172.21.15.37:0/3452615273 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c0125f0 con 0x559b006094a0 2024-05-09T01:10:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.341+0000 7f3446ffd700 1 -- 172.21.15.37:0/3452615273 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c010c70 con 0x559b006094a0 2024-05-09T01:10:12.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.343+0000 7f3471c94b80 1 -- 172.21.15.37:0/3452615273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 msgr2=0x559b0078a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.343+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3452615273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078a7c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f344c0129c0 tx=0x7f344c003f90 comp rx=0 tx=0).stop 2024-05-09T01:10:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.348+0000 7f3471c94b80 1 -- 172.21.15.37:0/3452615273 shutdown_connections 2024-05-09T01:10:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.348+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3452615273 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0079c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.348+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3452615273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078a7c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.348+0000 7f3471c94b80 1 --2- 172.21.15.37:0/3452615273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.348+0000 7f3471c94b80 1 -- 172.21.15.37:0/3452615273 >> 172.21.15.37:0/3452615273 conn(0x559b006696a0 msgr2=0x559b0078b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.352+0000 7f3471c94b80 1 -- 172.21.15.37:0/3452615273 shutdown_connections 2024-05-09T01:10:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.352+0000 7f3471c94b80 1 -- 172.21.15.37:0/3452615273 wait complete. 2024-05-09T01:10:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.352+0000 7f3471c94b80 1 -- start start 2024-05-09T01:10:12.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.353+0000 7f3471c94b80 1 Processor -- start 2024-05-09T01:10:12.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.355+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.355+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.355+0000 7f3471c94b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0078cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.355+0000 7f3471c94b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f345c1b2100 con 0x559b006f3160 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.355+0000 7f3471c94b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f345c1b1a30 con 0x559b007866a0 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.355+0000 7f3471c94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f345c1aec20 con 0x559b006094a0 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.355+0000 7f3471c94b80 10 client.0 _ll_register_callbacks cb 0x559b0051a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.356+0000 7f3460819700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.356+0000 7f3460819700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34730/0 (socket says 172.21.15.37:34730) 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.356+0000 7f3460819700 1 -- 172.21.15.37:0/1462377207 learned_addr learned my addr 172.21.15.37:0/1462377207 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.356+0000 7f3460819700 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0078cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.356+0000 7f3460819700 1 -- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 msgr2=0x559b0078cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.356+0000 7f3460819700 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0078cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.356+0000 7f3460819700 1 -- 172.21.15.37:0/1462377207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 msgr2=0x559b0078ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.357+0000 7f3460819700 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.357+0000 7f3460819700 1 -- 172.21.15.37:0/1462377207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b00797570 con 0x559b006094a0 2024-05-09T01:10:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.359+0000 7f3460819700 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078c4f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f344c0046e0 tx=0x7f344c004350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b93a1f1048b53775 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.359+0000 7f3444ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.360+0000 7f3444ff9700 1 -- 172.21.15.37:0/1462377207 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c057030 con 0x559b006094a0 2024-05-09T01:10:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.360+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f344c0125f0 con 0x559b006094a0 2024-05-09T01:10:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.360+0000 7f3444ff9700 1 -- 172.21.15.37:0/1462377207 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f344c010670 con 0x559b006094a0 2024-05-09T01:10:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3444ff9700 1 -- 172.21.15.37:0/1462377207 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f344c010870 con 0x559b006094a0 2024-05-09T01:10:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3471c94b80 10 client.26446 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x559b007987d0 con 0x559b006094a0 2024-05-09T01:10:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3444ff9700 1 -- 172.21.15.37:0/1462377207 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f344c0125f0 con 0x559b006094a0 2024-05-09T01:10:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3444ff9700 1 -- 172.21.15.37:0/1462377207 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f344c0218c0 con 0x559b006094a0 2024-05-09T01:10:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3471c94b80 10 client.26446 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3471c94b80 10 client.26446 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:10:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.361+0000 7f3471c94b80 20 client.26446 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.362+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b0081b9d0 0x559b0081ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.362+0000 7f3471c94b80 4 client.26446 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:10:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.362+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b006b0a70 con 0x559b0081b9d0 2024-05-09T01:10:12.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.363+0000 7f346101a700 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b0081b9d0 0x559b0081ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:12.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.364+0000 7f3444ff9700 10 client.26446 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:10:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.364+0000 7f346101a700 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b0081b9d0 0x559b0081ddf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c7ea6118b985b08 server_cookie=aa1e9fafd893f491 in_seq=0 out_seq=0 2024-05-09T01:10:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.364+0000 7f3444ff9700 1 -- 172.21.15.37:0/1462377207 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b006b0a70 con 0x559b0081b9d0 2024-05-09T01:10:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.364+0000 7f3444ff9700 10 client.26446 handle_command_reply: tid=0 2024-05-09T01:10:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.365+0000 7f3471c94b80 1 client.26446 shutdown 2024-05-09T01:10:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.365+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 msgr2=0x559b0078c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.365+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078c4f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f344c0046e0 tx=0x7f344c004350 comp rx=0 tx=0).stop 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.366+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 shutdown_connections 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.366+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x559b0081b9d0 0x559b0081ddf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.366+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559b007866a0 0x559b0078cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.366+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559b006094a0 0x559b0078c4f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.366+0000 7f3471c94b80 1 --2- 172.21.15.37:0/1462377207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b006f3160 0x559b0078ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.366+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 >> 172.21.15.37:0/1462377207 conn(0x559b006696a0 msgr2=0x559b00789e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.366+0000 7f3444ff9700 0 client.26446 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.367+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 shutdown_connections 2024-05-09T01:10:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.367+0000 7f3471c94b80 1 -- 172.21.15.37:0/1462377207 wait complete. 2024-05-09T01:10:12.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.367+0000 7f3471c94b80 20 client.26446 trim_cache size 0 max 16384 2024-05-09T01:10:12.369 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:10:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34480b2880 msgr2=0x7f34480b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34480b2880 0x7f34480b4d90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3454009900 tx=0x7f345400b9d0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 msgr2=0x7f345c1a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1a17f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f34540095c0 tx=0x7f3454007a20 comp rx=0 tx=0).stop 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 shutdown_connections 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34480b2880 0x7f34480b4d90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f345c108740 0x7f345c1a17f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f345c1034c0 0x7f345c19cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 --2- 172.21.15.37:0/1021460816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f345c107df0 0x7f345c19d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.368+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 >> 172.21.15.37:0/1021460816 conn(0x7f345c0fedc0 msgr2=0x7f345c105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.369+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 shutdown_connections 2024-05-09T01:10:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:12.369+0000 7f346327e700 1 -- 172.21.15.37:0/1021460816 wait complete. 2024-05-09T01:10:12.385 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:12 smithi037 ceph-mon[30122]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 696 op/s 2024-05-09T01:10:12.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:12 smithi151 ceph-mon[34780]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 696 op/s 2024-05-09T01:10:12.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:12 smithi136 ceph-mon[34110]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 696 op/s 2024-05-09T01:10:13.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:10:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:14.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:14 smithi037 ceph-mon[30122]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.4 MiB/s wr, 677 op/s 2024-05-09T01:10:14.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:14 smithi151 ceph-mon[34780]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.4 MiB/s wr, 677 op/s 2024-05-09T01:10:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:14 smithi136 ceph-mon[34110]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.4 MiB/s wr, 677 op/s 2024-05-09T01:10:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 475.0 s, 1817.8 tps, lat 56.018 ms stddev 65.129 2024-05-09T01:10:15.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 -- 172.21.15.37:0/3325498210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 msgr2=0x7f95441038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 --2- 172.21.15.37:0/3325498210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 0x7f95441038f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f95380099c0 tx=0x7f9538009cd0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 -- 172.21.15.37:0/3325498210 shutdown_connections 2024-05-09T01:10:15.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 --2- 172.21.15.37:0/3325498210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9544108760 0x7f95441100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 --2- 172.21.15.37:0/3325498210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 0x7f95441038f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 --2- 172.21.15.37:0/3325498210 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9544107e10 0x7f9544108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 -- 172.21.15.37:0/3325498210 >> 172.21.15.37:0/3325498210 conn(0x7f95440fef30 msgr2=0x7f9544101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:15.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 -- 172.21.15.37:0/3325498210 shutdown_connections 2024-05-09T01:10:15.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.650+0000 7f954b1a5700 1 -- 172.21.15.37:0/3325498210 wait complete. 2024-05-09T01:10:15.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.651+0000 7f954b1a5700 1 Processor -- start 2024-05-09T01:10:15.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.652+0000 7f954b1a5700 1 -- start start 2024-05-09T01:10:15.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f954b1a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 0x7f954419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f954b1a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9544107e10 0x7f954419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f954b1a5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9544108760 0x7f954419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f954b1a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9544113390 con 0x7f95441034e0 2024-05-09T01:10:15.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f954b1a5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9544113210 con 0x7f9544107e10 2024-05-09T01:10:15.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f954b1a5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9544113510 con 0x7f9544108760 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f9548f41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 0x7f954419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f9548f41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 0x7f954419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45220/0 (socket says 172.21.15.37:45220) 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f9549742700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9544108760 0x7f954419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f9548f41700 1 -- 172.21.15.37:0/197517903 learned_addr learned my addr 172.21.15.37:0/197517903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.653+0000 7f9543fff700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9544107e10 0x7f954419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9549742700 1 -- 172.21.15.37:0/197517903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9544107e10 msgr2=0x7f954419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9549742700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9544107e10 0x7f954419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9549742700 1 -- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 msgr2=0x7f954419adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9549742700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 0x7f954419adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9549742700 1 -- 172.21.15.37:0/197517903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954419fcc0 con 0x7f9544108760 2024-05-09T01:10:15.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9549742700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9544108760 0x7f954419f620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f953c00efc0 tx=0x7f953c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:15.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9541ffb700 1 -- 172.21.15.37:0/197517903 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c0092e0 con 0x7f9544108760 2024-05-09T01:10:15.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.654+0000 7f9541ffb700 1 -- 172.21.15.37:0/197517903 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f953c004bb0 con 0x7f9544108760 2024-05-09T01:10:15.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.655+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954419ff50 con 0x7f9544108760 2024-05-09T01:10:15.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.655+0000 7f9541ffb700 1 -- 172.21.15.37:0/197517903 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c004020 con 0x7f9544108760 2024-05-09T01:10:15.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.655+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95441a03d0 con 0x7f9544108760 2024-05-09T01:10:15.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.657+0000 7f9541ffb700 1 -- 172.21.15.37:0/197517903 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f953c01b030 con 0x7f9544108760 2024-05-09T01:10:15.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.658+0000 7f9541ffb700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95340b2900 0x7f95340b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.658+0000 7f9541ffb700 1 -- 172.21.15.37:0/197517903 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f953c0e1bf0 con 0x7f9544108760 2024-05-09T01:10:15.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.658+0000 7f9548f41700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95340b2900 0x7f95340b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.659+0000 7f9548f41700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95340b2900 0x7f95340b4e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9538003760 tx=0x7f953801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:15.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.659+0000 7f9559bbbb80 1 Processor -- start 2024-05-09T01:10:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9559bbbb80 1 -- start start 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754d2b160 0x555754dc44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754dbe6a0 0x555754dbead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555754ce0ff0 con 0x555754d2b160 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555754c7f7f0 con 0x555754c414a0 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555754cdcfb0 con 0x555754dbe6a0 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9549742700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754dbe6a0 0x555754dbead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9548f41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754d2b160 0x555754dc44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9549742700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754dbe6a0 0x555754dbead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34766/0 (socket says 172.21.15.37:34766) 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9549742700 1 -- 172.21.15.37:0/3821244807 learned_addr learned my addr 172.21.15.37:0/3821244807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.660+0000 7f9543fff700 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f9549742700 1 -- 172.21.15.37:0/3821244807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 msgr2=0x555754dc4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f9549742700 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f9549742700 1 -- 172.21.15.37:0/3821244807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754d2b160 msgr2=0x555754dc44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f9549742700 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754d2b160 0x555754dc44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f9549742700 1 -- 172.21.15.37:0/3821244807 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555754c77370 con 0x555754dbe6a0 2024-05-09T01:10:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f9548f41700 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754d2b160 0x555754dc44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f9549742700 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754dbe6a0 0x555754dbead0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f953c00ef90 tx=0x7f953c0a91a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72c796c9cfdcb25f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f952effd700 1 -- 172.21.15.37:0/3821244807 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c0a92a0 con 0x555754dbe6a0 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f952effd700 1 -- 172.21.15.37:0/3821244807 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f953c0ad650 con 0x555754dbe6a0 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.661+0000 7f952effd700 1 -- 172.21.15.37:0/3821244807 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c0a8760 con 0x555754dbe6a0 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 -- 172.21.15.37:0/3821244807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754dbe6a0 msgr2=0x555754dbead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754dbe6a0 0x555754dbead0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f953c00ef90 tx=0x7f953c0a91a0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 -- 172.21.15.37:0/3821244807 shutdown_connections 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754dbe6a0 0x555754dbead0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754d2b160 0x555754dc44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/3821244807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 -- 172.21.15.37:0/3821244807 >> 172.21.15.37:0/3821244807 conn(0x555754ca16a0 msgr2=0x555754db9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 -- 172.21.15.37:0/3821244807 shutdown_connections 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.662+0000 7f9559bbbb80 1 -- 172.21.15.37:0/3821244807 wait complete. 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.663+0000 7f9559bbbb80 1 -- start start 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.663+0000 7f9559bbbb80 1 Processor -- start 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.663+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.663+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.663+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dc8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9548f41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34774/0 (socket says 172.21.15.37:34774) 2024-05-09T01:10:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9548f41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60716/0 (socket says 172.21.15.37:60716) 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 -- 172.21.15.37:0/1099659157 learned_addr learned my addr 172.21.15.37:0/1099659157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9549742700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dc8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555754b5cba0 con 0x555754dbe6a0 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555754c9b150 con 0x555754c414a0 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555754dcb1d0 con 0x555754d2b160 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9559bbbb80 10 client.0 _ll_register_callbacks cb 0x555754b526c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 -- 172.21.15.37:0/1099659157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 msgr2=0x555754dc8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 -- 172.21.15.37:0/1099659157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 msgr2=0x555754dc8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dc8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 -- 172.21.15.37:0/1099659157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555754b5c490 con 0x555754d2b160 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9548f41700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9549742700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dc8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f953c0ad650 con 0x555754d2b160 2024-05-09T01:10:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9543fff700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9530005950 tx=0x7f953000f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad5404fa98d85ee4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.664+0000 7f9523fff700 10 client.26458 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.665+0000 7f9523fff700 1 -- 172.21.15.37:0/1099659157 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530004230 con 0x555754d2b160 2024-05-09T01:10:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.666+0000 7f9523fff700 1 -- 172.21.15.37:0/1099659157 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f95300043d0 con 0x555754d2b160 2024-05-09T01:10:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.666+0000 7f9523fff700 1 -- 172.21.15.37:0/1099659157 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9530003680 con 0x555754d2b160 2024-05-09T01:10:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.667+0000 7f9559bbbb80 10 client.26458 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.667+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=41}) -- 0x555754dd5ba0 con 0x555754d2b160 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9523fff700 1 -- 172.21.15.37:0/1099659157 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f9530003820 con 0x555754d2b160 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9559bbbb80 10 client.26458 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9559bbbb80 10 client.26458 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9559bbbb80 20 client.26458 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754dda590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9559bbbb80 4 client.26458 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555754cee9d0 con 0x555754dd80c0 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.668+0000 7f9548f41700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754dda590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9523fff700 10 client.26458 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9548f41700 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754dda590 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df10e9842265c31a server_cookie=100d59a978bdf99d in_seq=0 out_seq=0 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9523fff700 1 -- 172.21.15.37:0/1099659157 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555754cee9d0 con 0x555754dd80c0 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9523fff700 10 client.26458 handle_command_reply: tid=0 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9559bbbb80 1 client.26458 shutdown 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 msgr2=0x555754dc8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9530005950 tx=0x7f953000f6a0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.669+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 shutdown_connections 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754dda590 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dc8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9523fff700 0 client.26458 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dc8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/1099659157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8780 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 >> 172.21.15.37:0/1099659157 conn(0x555754ca16a0 msgr2=0x555754db91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 shutdown_connections 2024-05-09T01:10:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 1 -- 172.21.15.37:0/1099659157 wait complete. 2024-05-09T01:10:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.670+0000 7f9559bbbb80 20 client.26458 trim_cache size 0 max 16384 2024-05-09T01:10:15.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.700+0000 7f9559bbbb80 1 Processor -- start 2024-05-09T01:10:15.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.701+0000 7f9559bbbb80 1 -- start start 2024-05-09T01:10:15.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.701+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754c414a0 0x555754dc3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.701+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.701+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754dbe6a0 0x555754dc8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.701+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95441ac900 con 0x555754c414a0 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.701+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95441ae4d0 con 0x555754dbe6a0 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.701+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95441acfd0 con 0x555754d2b160 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.702+0000 7f9549742700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754dbe6a0 0x555754dc8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.702+0000 7f9549742700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754dbe6a0 0x555754dc8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60720/0 (socket says 172.21.15.37:60720) 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.702+0000 7f9549742700 1 -- 172.21.15.37:0/158163044 learned_addr learned my addr 172.21.15.37:0/158163044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.703+0000 7f9549742700 1 -- 172.21.15.37:0/158163044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 msgr2=0x555754dc8200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:10:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.703+0000 7f9549742700 1 --2- 172.21.15.37:0/158163044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.703+0000 7f9549742700 1 -- 172.21.15.37:0/158163044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754c414a0 msgr2=0x555754dc3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.703+0000 7f9549742700 1 --2- 172.21.15.37:0/158163044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754c414a0 0x555754dc3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.703+0000 7f9549742700 1 -- 172.21.15.37:0/158163044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555754dcaae0 con 0x555754dbe6a0 2024-05-09T01:10:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.703+0000 7f9549742700 1 --2- 172.21.15.37:0/158163044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754dbe6a0 0x555754dc8740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f953c0a90e0 tx=0x7f953c0a9070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1401ada0a455a811 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.706+0000 7f952e7fc700 1 -- 172.21.15.37:0/158163044 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c004d60 con 0x555754dbe6a0 2024-05-09T01:10:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.706+0000 7f952e7fc700 1 -- 172.21.15.37:0/158163044 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f953c0ad150 con 0x555754dbe6a0 2024-05-09T01:10:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f952e7fc700 1 -- 172.21.15.37:0/158163044 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f953c0a4e50 con 0x555754dbe6a0 2024-05-09T01:10:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f9559bbbb80 1 -- 172.21.15.37:0/158163044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754dbe6a0 msgr2=0x555754dc8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/158163044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754dbe6a0 0x555754dc8740 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f953c0a90e0 tx=0x7f953c0a9070 comp rx=0 tx=0).stop 2024-05-09T01:10:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f9559bbbb80 1 -- 172.21.15.37:0/158163044 shutdown_connections 2024-05-09T01:10:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/158163044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754dbe6a0 0x555754dc8740 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/158163044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754c414a0 0x555754dc3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/158163044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dc8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.707+0000 7f9559bbbb80 1 -- 172.21.15.37:0/158163044 >> 172.21.15.37:0/158163044 conn(0x555754ca16a0 msgr2=0x555754dc3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.709+0000 7f9559bbbb80 1 -- 172.21.15.37:0/158163044 shutdown_connections 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.709+0000 7f9559bbbb80 1 -- 172.21.15.37:0/158163044 wait complete. 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.709+0000 7f9559bbbb80 1 -- start start 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.709+0000 7f9559bbbb80 1 Processor -- start 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dd0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dd0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9559bbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dd3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95441ade00 con 0x555754dbe6a0 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95441ad730 con 0x555754c414a0 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9559bbbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95441aa900 con 0x555754d2b160 2024-05-09T01:10:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9559bbbb80 10 client.0 _ll_register_callbacks cb 0x555754b526c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:15.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.710+0000 7f9543fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dd0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9548f41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dd0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9548f41700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dd0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60726/0 (socket says 172.21.15.37:60726) 2024-05-09T01:10:15.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9548f41700 1 -- 172.21.15.37:0/2287847253 learned_addr learned my addr 172.21.15.37:0/2287847253 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:15.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9549742700 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dd3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9543fff700 1 -- 172.21.15.37:0/2287847253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 msgr2=0x555754dd0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:15.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9543fff700 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dd0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9543fff700 1 -- 172.21.15.37:0/2287847253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 msgr2=0x555754dd3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9543fff700 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dd3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9543fff700 1 -- 172.21.15.37:0/2287847253 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555754dc6280 con 0x555754d2b160 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.711+0000 7f9548f41700 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dd0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.712+0000 7f9543fff700 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dd0960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x555754dc97e0 tx=0x7f953001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9dd003110fe9120 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.712+0000 7f9523fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.712+0000 7f9523fff700 1 -- 172.21.15.37:0/2287847253 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9530027be0 con 0x555754d2b160 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.712+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f953c0ad150 con 0x555754d2b160 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.712+0000 7f9523fff700 1 -- 172.21.15.37:0/2287847253 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9530027d80 con 0x555754d2b160 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.713+0000 7f9523fff700 1 -- 172.21.15.37:0/2287847253 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9530004830 con 0x555754d2b160 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.713+0000 7f9559bbbb80 10 client.26461 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.713+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x555754e3adf0 con 0x555754d2b160 2024-05-09T01:10:15.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.713+0000 7f9523fff700 1 -- 172.21.15.37:0/2287847253 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f953c0ad150 con 0x555754d2b160 2024-05-09T01:10:15.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.714+0000 7f9523fff700 1 -- 172.21.15.37:0/2287847253 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f9530005410 con 0x555754d2b160 2024-05-09T01:10:15.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.714+0000 7f9559bbbb80 10 client.26461 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:15.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.714+0000 7f9559bbbb80 10 client.26461 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:10:15.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.714+0000 7f9559bbbb80 20 client.26461 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:15.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.714+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754e3d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:15.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.714+0000 7f9559bbbb80 4 client.26461 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:10:15.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.714+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555754ce8a70 con 0x555754dd80c0 2024-05-09T01:10:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.715+0000 7f9548f41700 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754e3d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9548f41700 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754e3d540 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c159e1bae28668e server_cookie=cbf7620f8cb3a8b0 in_seq=0 out_seq=0 2024-05-09T01:10:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9523fff700 10 client.26461 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:10:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9523fff700 1 -- 172.21.15.37:0/2287847253 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555754ce8a70 con 0x555754dd80c0 2024-05-09T01:10:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9523fff700 10 client.26461 handle_command_reply: tid=0 2024-05-09T01:10:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9559bbbb80 1 client.26461 shutdown 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 msgr2=0x555754dd0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dd0960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x555754dc97e0 tx=0x7f953001f000 comp rx=0 tx=0).stop 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 shutdown_connections 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.716+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x555754dd80c0 0x555754e3d540 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555754dbe6a0 0x555754dd3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555754c414a0 0x555754dd0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9559bbbb80 1 --2- 172.21.15.37:0/2287847253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555754d2b160 0x555754dd0960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 >> 172.21.15.37:0/2287847253 conn(0x555754ca16a0 msgr2=0x555754dc6750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9523fff700 0 client.26461 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 shutdown_connections 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9559bbbb80 1 -- 172.21.15.37:0/2287847253 wait complete. 2024-05-09T01:10:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.717+0000 7f9559bbbb80 20 client.26461 trim_cache size 0 max 16384 2024-05-09T01:10:15.719 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:10:15.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.718+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95340b2900 msgr2=0x7f95340b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.718+0000 7f954b1a5700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95340b2900 0x7f95340b4e10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9538003760 tx=0x7f953801a040 comp rx=0 tx=0).stop 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.718+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9544108760 msgr2=0x7f954419f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.718+0000 7f954b1a5700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9544108760 0x7f954419f620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f953c00efc0 tx=0x7f953c00c3a0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 shutdown_connections 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95340b2900 0x7f95340b4e10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9544108760 0x7f954419f620 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95441034e0 0x7f954419adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 --2- 172.21.15.37:0/197517903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9544107e10 0x7f954419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 >> 172.21.15.37:0/197517903 conn(0x7f95440fef30 msgr2=0x7f954406c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 shutdown_connections 2024-05-09T01:10:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:15.719+0000 7f954b1a5700 1 -- 172.21.15.37:0/197517903 wait complete. 2024-05-09T01:10:16.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:16 smithi037 ceph-mon[30122]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 624 op/s 2024-05-09T01:10:16.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:16 smithi151 ceph-mon[34780]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 624 op/s 2024-05-09T01:10:16.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:10:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:16 smithi136 ceph-mon[34110]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 624 op/s 2024-05-09T01:10:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:18.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:18 smithi037 ceph-mon[30122]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 639 op/s 2024-05-09T01:10:18.475 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:18 smithi151 ceph-mon[34780]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 639 op/s 2024-05-09T01:10:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:18 smithi136 ceph-mon[34110]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 639 op/s 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 -- 172.21.15.37:0/1080003315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 msgr2=0x7f8da41058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/1080003315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da41058d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009990 tx=0x7f8d94009ca0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 -- 172.21.15.37:0/1080003315 shutdown_connections 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/1080003315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da410e8f0 0x7f8da4110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/1080003315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da41058d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/1080003315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8da4105e10 0x7f8da410e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 -- 172.21.15.37:0/1080003315 >> 172.21.15.37:0/1080003315 conn(0x7f8da40fedc0 msgr2=0x7f8da41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 -- 172.21.15.37:0/1080003315 shutdown_connections 2024-05-09T01:10:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.045+0000 7f8daa3f0700 1 -- 172.21.15.37:0/1080003315 wait complete. 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.046+0000 7f8daa3f0700 1 Processor -- start 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.046+0000 7f8daa3f0700 1 -- start start 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8daa3f0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da419d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8daa3f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da4105e10 0x7f8da419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8daa3f0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8da410e8f0 0x7f8da41a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8daa3f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8da4114530 con 0x7f8da4105e10 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8daa3f0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41143b0 con 0x7f8da410e8f0 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8daa3f0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41146b0 con 0x7f8da41054c0 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da419d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da419d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34812/0 (socket says 172.21.15.37:34812) 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 -- 172.21.15.37:0/4250750131 learned_addr learned my addr 172.21.15.37:0/4250750131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da898d700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8da410e8f0 0x7f8da41a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da37fe700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da4105e10 0x7f8da419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 -- 172.21.15.37:0/4250750131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8da410e8f0 msgr2=0x7f8da41a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8da410e8f0 0x7f8da41a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 -- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da4105e10 msgr2=0x7f8da419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da4105e10 0x7f8da419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.047+0000 7f8da3fff700 1 -- 172.21.15.37:0/4250750131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da41a1f20 con 0x7f8da41054c0 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.048+0000 7f8da3fff700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da419d0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400b5c0 tx=0x7f8d94009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.048+0000 7f8da17fa700 1 -- 172.21.15.37:0/4250750131 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94027070 con 0x7f8da41054c0 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.048+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da41a21b0 con 0x7f8da41054c0 2024-05-09T01:10:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.048+0000 7f8da17fa700 1 -- 172.21.15.37:0/4250750131 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d94003fb0 con 0x7f8da41054c0 2024-05-09T01:10:19.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.048+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da41a9b30 con 0x7f8da41054c0 2024-05-09T01:10:19.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.050+0000 7f8da17fa700 1 -- 172.21.15.37:0/4250750131 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d94022c70 con 0x7f8da41054c0 2024-05-09T01:10:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.051+0000 7f8da17fa700 1 -- 172.21.15.37:0/4250750131 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8d9402a070 con 0x7f8da41054c0 2024-05-09T01:10:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.052+0000 7f8da17fa700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d8c0b2900 0x7f8d8c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.052+0000 7f8db8e06b80 1 Processor -- start 2024-05-09T01:10:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.052+0000 7f8da17fa700 1 -- 172.21.15.37:0/4250750131 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8d940e3030 con 0x7f8da41054c0 2024-05-09T01:10:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.052+0000 7f8da37fe700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d8c0b2900 0x7f8d8c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.052+0000 7f8db8e06b80 1 -- start start 2024-05-09T01:10:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8ec5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8ec6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8eca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0c8de00a0 con 0x55a0c8eca5b0 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a0c8d859a0 con 0x55a0c8dbad00 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a0c8ddc060 con 0x55a0c8d404a0 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8da37fe700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d8c0b2900 0x7f8d8c0b4e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8da4104af0 tx=0x7f8d98008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8da898d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8eca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8ec5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8ec6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8ec5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60756/0 (socket says 172.21.15.37:60756) 2024-05-09T01:10:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.053+0000 7f8da3fff700 1 -- 172.21.15.37:0/1408446585 learned_addr learned my addr 172.21.15.37:0/1408446585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.054+0000 7f8da37fe700 1 -- 172.21.15.37:0/1408446585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 msgr2=0x55a0c8ec5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.054+0000 7f8da37fe700 1 --2- 172.21.15.37:0/1408446585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8ec5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.054+0000 7f8da37fe700 1 -- 172.21.15.37:0/1408446585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 msgr2=0x55a0c8eca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.054+0000 7f8da37fe700 1 --2- 172.21.15.37:0/1408446585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8eca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.054+0000 7f8da37fe700 1 -- 172.21.15.37:0/1408446585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c8d76500 con 0x55a0c8d404a0 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.054+0000 7f8da37fe700 1 --2- 172.21.15.37:0/1408446585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8ec6450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800d440 tx=0x7f8d98010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70dcc9bc9b0f8200 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.054+0000 7f8d8a7fc700 1 -- 172.21.15.37:0/1408446585 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98024070 con 0x55a0c8d404a0 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.055+0000 7f8d8a7fc700 1 -- 172.21.15.37:0/1408446585 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d980148e0 con 0x55a0c8d404a0 2024-05-09T01:10:19.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.055+0000 7f8d8a7fc700 1 -- 172.21.15.37:0/1408446585 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9801f9c0 con 0x55a0c8d404a0 2024-05-09T01:10:19.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 -- 172.21.15.37:0/1408446585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 msgr2=0x55a0c8ec6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/1408446585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8ec6450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800d440 tx=0x7f8d98010000 comp rx=0 tx=0).stop 2024-05-09T01:10:19.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 -- 172.21.15.37:0/1408446585 shutdown_connections 2024-05-09T01:10:19.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/1408446585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8eca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/1408446585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8ec5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/1408446585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8ec6450 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 -- 172.21.15.37:0/1408446585 >> 172.21.15.37:0/1408446585 conn(0x55a0c8d43f70 msgr2=0x55a0c8eb8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 -- 172.21.15.37:0/1408446585 shutdown_connections 2024-05-09T01:10:19.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 -- 172.21.15.37:0/1408446585 wait complete. 2024-05-09T01:10:19.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.056+0000 7f8db8e06b80 1 -- start start 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 1 Processor -- start 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8ecf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8ecfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ed0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0c8ecb2d0 con 0x55a0c8d404a0 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a0c8d7ab20 con 0x55a0c8eca5b0 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a0c8ed2860 con 0x55a0c8dbad00 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8db8e06b80 10 client.0 _ll_register_callbacks cb 0x55a0c8c516c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8ecfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8ecf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8da898d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ed0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8da37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8ecfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34826/0 (socket says 172.21.15.37:34826) 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.057+0000 7f8da37fe700 1 -- 172.21.15.37:0/941346459 learned_addr learned my addr 172.21.15.37:0/941346459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8da37fe700 1 -- 172.21.15.37:0/941346459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 msgr2=0x55a0c8ed0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8da37fe700 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ed0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8da37fe700 1 -- 172.21.15.37:0/941346459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 msgr2=0x55a0c8ecf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8da37fe700 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8ecf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8da37fe700 1 -- 172.21.15.37:0/941346459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c8c5b490 con 0x55a0c8dbad00 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8da37fe700 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8ecfdd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8d98008010 tx=0x7f8d98014660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca12dd9e1108d48 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8d837fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8d837fe700 1 -- 172.21.15.37:0/941346459 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9802d030 con 0x55a0c8dbad00 2024-05-09T01:10:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8d837fe700 1 -- 172.21.15.37:0/941346459 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8d9800f050 con 0x55a0c8dbad00 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.058+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d980148e0 con 0x55a0c8dbad00 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8d837fe700 1 -- 172.21.15.37:0/941346459 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8d98024070 con 0x55a0c8dbad00 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 10 client.26473 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a0c8edd270 con 0x55a0c8dbad00 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8d837fe700 1 -- 172.21.15.37:0/941346459 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d980148e0 con 0x55a0c8dbad00 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8d837fe700 1 -- 172.21.15.37:0/941346459 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f8d98013070 con 0x55a0c8dbad00 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 10 client.26473 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 10 client.26473 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:10:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 20 client.26473 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8edfa60 0x55a0c8ee1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 4 client.26473 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.060+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0c8deda80 con 0x55a0c8edfa60 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.061+0000 7f8da3fff700 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8edfa60 0x55a0c8ee1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.061+0000 7f8d837fe700 10 client.26473 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.061+0000 7f8da3fff700 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8edfa60 0x55a0c8ee1e80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f703a18d42bbeaea server_cookie=1693a9131633f14d in_seq=0 out_seq=0 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8d837fe700 1 -- 172.21.15.37:0/941346459 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a0c8deda80 con 0x55a0c8edfa60 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8d837fe700 10 client.26473 handle_command_reply: tid=0 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 client.26473 shutdown 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 msgr2=0x55a0c8ecfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8ecfdd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8d98008010 tx=0x7f8d98014660 comp rx=0 tx=0).stop 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 shutdown_connections 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ed0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8edfa60 0x55a0c8ee1e80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8ecf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/941346459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8ecfdd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8d837fe700 0 client.26473 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:10:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 >> 172.21.15.37:0/941346459 conn(0x55a0c8d43f70 msgr2=0x55a0c8ebc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 shutdown_connections 2024-05-09T01:10:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 1 -- 172.21.15.37:0/941346459 wait complete. 2024-05-09T01:10:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.062+0000 7f8db8e06b80 20 client.26473 trim_cache size 0 max 16384 2024-05-09T01:10:19.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.093+0000 7f8db8e06b80 1 Processor -- start 2024-05-09T01:10:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.096+0000 7f8db8e06b80 1 -- start start 2024-05-09T01:10:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.097+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8eb8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.097+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8eb2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.097+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8edb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.097+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41ac860 con 0x55a0c8eca5b0 2024-05-09T01:10:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.097+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41ae430 con 0x55a0c8dbad00 2024-05-09T01:10:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.097+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41acf30 con 0x55a0c8d404a0 2024-05-09T01:10:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.099+0000 7f8da898d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8edb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.099+0000 7f8da898d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8edb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45314/0 (socket says 172.21.15.37:45314) 2024-05-09T01:10:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.099+0000 7f8da898d700 1 -- 172.21.15.37:0/2492393962 learned_addr learned my addr 172.21.15.37:0/2492393962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.099+0000 7f8da37fe700 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8eb2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.100+0000 7f8da3fff700 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8eb8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.100+0000 7f8da898d700 1 -- 172.21.15.37:0/2492393962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 msgr2=0x55a0c8eb8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.100+0000 7f8da898d700 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8eb8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.100+0000 7f8da898d700 1 -- 172.21.15.37:0/2492393962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 msgr2=0x55a0c8eb2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.100+0000 7f8da898d700 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8eb2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.100+0000 7f8da898d700 1 -- 172.21.15.37:0/2492393962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c8eb49d0 con 0x55a0c8eca5b0 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.101+0000 7f8da898d700 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8edb6e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007550 tx=0x7f8d9c009130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6204447784469dd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.102+0000 7f8d89ffb700 1 -- 172.21.15.37:0/2492393962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c01b030 con 0x55a0c8eca5b0 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.102+0000 7f8d89ffb700 1 -- 172.21.15.37:0/2492393962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d9c017b00 con 0x55a0c8eca5b0 2024-05-09T01:10:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.102+0000 7f8d89ffb700 1 -- 172.21.15.37:0/2492393962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c01fb00 con 0x55a0c8eca5b0 2024-05-09T01:10:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.104+0000 7f8db8e06b80 1 -- 172.21.15.37:0/2492393962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 msgr2=0x55a0c8edb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.104+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8edb6e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c007550 tx=0x7f8d9c009130 comp rx=0 tx=0).stop 2024-05-09T01:10:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.104+0000 7f8db8e06b80 1 -- 172.21.15.37:0/2492393962 shutdown_connections 2024-05-09T01:10:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.104+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8eca5b0 0x55a0c8edb6e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.104+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8d404a0 0x55a0c8eb8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.104+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/2492393962 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8dbad00 0x55a0c8eb2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.104+0000 7f8db8e06b80 1 -- 172.21.15.37:0/2492393962 >> 172.21.15.37:0/2492393962 conn(0x55a0c8d43f70 msgr2=0x55a0c8eb1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.108+0000 7f8db8e06b80 1 -- 172.21.15.37:0/2492393962 shutdown_connections 2024-05-09T01:10:19.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.109+0000 7f8db8e06b80 1 -- 172.21.15.37:0/2492393962 wait complete. 2024-05-09T01:10:19.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.109+0000 7f8db8e06b80 1 -- start start 2024-05-09T01:10:19.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.110+0000 7f8db8e06b80 1 Processor -- start 2024-05-09T01:10:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8f42940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8f42e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8db8e06b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ee48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41add60 con 0x55a0c8d404a0 2024-05-09T01:10:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8da41ad690 con 0x55a0c8eca5b0 2024-05-09T01:10:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8db8e06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8da406be90 con 0x55a0c8dbad00 2024-05-09T01:10:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8db8e06b80 10 client.0 _ll_register_callbacks cb 0x55a0c8c516c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8f42940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.111+0000 7f8da3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8f42940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45316/0 (socket says 172.21.15.37:45316) 2024-05-09T01:10:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.112+0000 7f8da3fff700 1 -- 172.21.15.37:0/392462858 learned_addr learned my addr 172.21.15.37:0/392462858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.114+0000 7f8da37fe700 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8f42e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.114+0000 7f8da898d700 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ee48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.115+0000 7f8da3fff700 1 -- 172.21.15.37:0/392462858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 msgr2=0x55a0c8f42e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.115+0000 7f8da3fff700 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8f42e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.115+0000 7f8da3fff700 1 -- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 msgr2=0x55a0c8ee48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.115+0000 7f8da3fff700 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ee48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.115+0000 7f8da3fff700 1 -- 172.21.15.37:0/392462858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c8ee4ee0 con 0x55a0c8d404a0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8da3fff700 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8f42940 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098e0 tx=0x7f8d940cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4877eb2f50045984 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8d837fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8d837fe700 1 -- 172.21.15.37:0/392462858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d940b3550 con 0x55a0c8d404a0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8d837fe700 1 -- 172.21.15.37:0/392462858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8d940a6ce0 con 0x55a0c8d404a0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d9c017b00 con 0x55a0c8d404a0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8d837fe700 1 -- 172.21.15.37:0/392462858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f8d940920b0 con 0x55a0c8d404a0 2024-05-09T01:10:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8db8e06b80 10 client.16680 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.116+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55a0c8f49f90 con 0x55a0c8d404a0 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8d837fe700 1 -- 172.21.15.37:0/392462858 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d94092250 con 0x55a0c8d404a0 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8d837fe700 1 -- 172.21.15.37:0/392462858 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f8d940bfb40 con 0x55a0c8d404a0 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8db8e06b80 10 client.16680 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8db8e06b80 10 client.16680 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8db8e06b80 20 client.16680 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8f4a680 0x55a0c8f4caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8db8e06b80 4 client.16680 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.117+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8d9c017b00 con 0x55a0c8f4a680 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.118+0000 7f8da37fe700 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8f4a680 0x55a0c8f4caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.118+0000 7f8d837fe700 10 client.16680 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.118+0000 7f8da37fe700 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8f4a680 0x55a0c8f4caa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b93a31f2527ba8d server_cookie=16c30fede589bdcc in_seq=0 out_seq=0 2024-05-09T01:10:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.118+0000 7f8d837fe700 1 -- 172.21.15.37:0/392462858 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8d9c017b00 con 0x55a0c8f4a680 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.118+0000 7f8d837fe700 10 client.16680 handle_command_reply: tid=0 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.118+0000 7f8db8e06b80 1 client.16680 shutdown 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 msgr2=0x55a0c8f42940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8f42940 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8d940098e0 tx=0x7f8d940cd040 comp rx=0 tx=0).stop 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 shutdown_connections 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0c8eca5b0 0x55a0c8ee48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a0c8f4a680 0x55a0c8f4caa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8d837fe700 0 client.16680 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0c8d404a0 0x55a0c8f42940 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 --2- 172.21.15.37:0/392462858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0c8dbad00 0x55a0c8f42e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.119+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 >> 172.21.15.37:0/392462858 conn(0x55a0c8d43f70 msgr2=0x55a0c8ebc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.120+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 shutdown_connections 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.120+0000 7f8db8e06b80 1 -- 172.21.15.37:0/392462858 wait complete. 2024-05-09T01:10:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.120+0000 7f8db8e06b80 20 client.16680 trim_cache size 0 max 16384 2024-05-09T01:10:19.124 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:10:19.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.121+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d8c0b2900 msgr2=0x7f8d8c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.121+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d8c0b2900 0x7f8d8c0b4e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8da4104af0 tx=0x7f8d98008040 comp rx=0 tx=0).stop 2024-05-09T01:10:19.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.121+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 msgr2=0x7f8da419d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.121+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da419d0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8d9400b5c0 tx=0x7f8d94009ee0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.121+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 shutdown_connections 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.121+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d8c0b2900 0x7f8d8c0b4e10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.122+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8da410e8f0 0x7f8da41a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.122+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8da41054c0 0x7f8da419d0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.122+0000 7f8daa3f0700 1 --2- 172.21.15.37:0/4250750131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da4105e10 0x7f8da419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.122+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 >> 172.21.15.37:0/4250750131 conn(0x7f8da40fedc0 msgr2=0x7f8da41031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.122+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 shutdown_connections 2024-05-09T01:10:19.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:19.122+0000 7f8daa3f0700 1 -- 172.21.15.37:0/4250750131 wait complete. 2024-05-09T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 -- 172.21.15.37:0/613653309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 msgr2=0x7fe814107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 --2- 172.21.15.37:0/613653309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 0x7fe814107530 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe808009900 tx=0x7fe80802a410 comp rx=0 tx=0).stop 2024-05-09T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 -- 172.21.15.37:0/613653309 shutdown_connections 2024-05-09T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 --2- 172.21.15.37:0/613653309 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe81410be20 0x7fe81410e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 --2- 172.21.15.37:0/613653309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 0x7fe814107530 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 --2- 172.21.15.37:0/613653309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 0x7fe814106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 -- 172.21.15.37:0/613653309 >> 172.21.15.37:0/613653309 conn(0x7fe8141010b0 msgr2=0x7fe814103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 -- 172.21.15.37:0/613653309 shutdown_connections 2024-05-09T01:10:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.636+0000 7fe819f72640 1 -- 172.21.15.37:0/613653309 wait complete. 2024-05-09T01:10:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.637+0000 7fe819f72640 1 Processor -- start 2024-05-09T01:10:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe819f72640 1 -- start start 2024-05-09T01:10:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe819f72640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 0x7fe8141a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe819f72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 0x7fe8141a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe819f72640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe81410be20 0x7fe8141a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe819f72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe814111980 con 0x7fe814107120 2024-05-09T01:10:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe819f72640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe814111800 con 0x7fe81410be20 2024-05-09T01:10:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe819f72640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe814111b00 con 0x7fe814105ee0 2024-05-09T01:10:19.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe8137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 0x7fe8141a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe812ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 0x7fe8141a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe8137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 0x7fe8141a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34854/0 (socket says 172.21.15.37:34854) 2024-05-09T01:10:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe8137fe640 1 -- 172.21.15.37:0/1041458007 learned_addr learned my addr 172.21.15.37:0/1041458007 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe813fff640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe81410be20 0x7fe8141a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe8137fe640 1 -- 172.21.15.37:0/1041458007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe81410be20 msgr2=0x7fe8141a7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe8137fe640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe81410be20 0x7fe8141a7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.638+0000 7fe8137fe640 1 -- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 msgr2=0x7fe8141a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe8137fe640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 0x7fe8141a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe8137fe640 1 -- 172.21.15.37:0/1041458007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe814197190 con 0x7fe814105ee0 2024-05-09T01:10:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe8137fe640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 0x7fe8141a0990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e9f0 tx=0x7fe80400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe810ff9640 1 -- 172.21.15.37:0/1041458007 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80400ccc0 con 0x7fe814105ee0 2024-05-09T01:10:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe810ff9640 1 -- 172.21.15.37:0/1041458007 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8040035f0 con 0x7fe814105ee0 2024-05-09T01:10:19.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe810ff9640 1 -- 172.21.15.37:0/1041458007 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80400ce60 con 0x7fe814105ee0 2024-05-09T01:10:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe814197480 con 0x7fe814105ee0 2024-05-09T01:10:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.639+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe814197980 con 0x7fe814105ee0 2024-05-09T01:10:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.642+0000 7fe820e27740 1 Processor -- start 2024-05-09T01:10:19.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe820e27740 1 -- start start 2024-05-09T01:10:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe820e27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467ccd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe820e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679002f0 0x561467ccda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe820e27740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679084d0 0x561467cd4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe820e27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561467c317c0 con 0x5614679291b0 2024-05-09T01:10:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe820e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561467bcd0e0 con 0x5614679002f0 2024-05-09T01:10:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe820e27740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561467c2d780 con 0x5614679084d0 2024-05-09T01:10:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe812ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679084d0 0x561467cd4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe812ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679084d0 0x561467cd4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34862/0 (socket says 172.21.15.37:34862) 2024-05-09T01:10:19.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.643+0000 7fe812ffd640 1 -- 172.21.15.37:0/2037113394 learned_addr learned my addr 172.21.15.37:0/2037113394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.644+0000 7fe810ff9640 1 -- 172.21.15.37:0/1041458007 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe804003aa0 con 0x7fe814105ee0 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.645+0000 7fe813fff640 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467ccd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.645+0000 7fe813fff640 1 -- 172.21.15.37:0/2037113394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679084d0 msgr2=0x561467cd4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.645+0000 7fe813fff640 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679084d0 0x561467cd4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.645+0000 7fe813fff640 1 -- 172.21.15.37:0/2037113394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679002f0 msgr2=0x561467ccda80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.645+0000 7fe813fff640 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679002f0 0x561467ccda80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.645+0000 7fe813fff640 1 -- 172.21.15.37:0/2037113394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561467bf67c0 con 0x5614679291b0 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.645+0000 7fe810ff9640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7fc0b28e0 0x7fe7fc0b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.646+0000 7fe810ff9640 1 -- 172.21.15.37:0/1041458007 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe8040e2450 con 0x7fe814105ee0 2024-05-09T01:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.646+0000 7fe812ffd640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7fc0b28e0 0x7fe7fc0b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.646+0000 7fe813fff640 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467ccd500 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009f00 tx=0x7fe80c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7740bba098f723 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.646+0000 7fe7f9ffb640 1 -- 172.21.15.37:0/2037113394 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c004d20 con 0x5614679291b0 2024-05-09T01:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.646+0000 7fe7f9ffb640 1 -- 172.21.15.37:0/2037113394 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe80c004030 con 0x5614679291b0 2024-05-09T01:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.646+0000 7fe7f9ffb640 1 -- 172.21.15.37:0/2037113394 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c005280 con 0x5614679291b0 2024-05-09T01:10:19.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.647+0000 7fe812ffd640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7fc0b28e0 0x7fe7fc0b4df0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe8080096c0 tx=0x7fe808000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.647+0000 7fe820e27740 1 -- 172.21.15.37:0/2037113394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 msgr2=0x561467ccd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.647+0000 7fe820e27740 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467ccd500 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009f00 tx=0x7fe80c011810 comp rx=0 tx=0).stop 2024-05-09T01:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.647+0000 7fe820e27740 1 -- 172.21.15.37:0/2037113394 shutdown_connections 2024-05-09T01:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.647+0000 7fe820e27740 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679084d0 0x561467cd4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.647+0000 7fe820e27740 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679002f0 0x561467ccda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.647+0000 7fe820e27740 1 --2- 172.21.15.37:0/2037113394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467ccd500 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.648+0000 7fe820e27740 1 -- 172.21.15.37:0/2037113394 >> 172.21.15.37:0/2037113394 conn(0x56146791d300 msgr2=0x561467cc8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.648+0000 7fe820e27740 1 -- 172.21.15.37:0/2037113394 shutdown_connections 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.648+0000 7fe820e27740 1 -- 172.21.15.37:0/2037113394 wait complete. 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.648+0000 7fe820e27740 1 -- start start 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.648+0000 7fe820e27740 1 Processor -- start 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe820e27740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cd73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe820e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cd7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe820e27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467cde860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe820e27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561467cd53d0 con 0x5614679291b0 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe820e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561467bb89c0 con 0x5614679084d0 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe820e27740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561467cd5550 con 0x5614679002f0 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe820e27740 10 client.0 _ll_register_callbacks cb 0x561467be5020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cd73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe813fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467cde860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cd73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34876/0 (socket says 172.21.15.37:34876) 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 -- 172.21.15.37:0/2478994361 learned_addr learned my addr 172.21.15.37:0/2478994361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe812ffd640 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cd7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 -- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 msgr2=0x561467cd7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cd7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 -- 172.21.15.37:0/2478994361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 msgr2=0x561467cde860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467cde860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 -- 172.21.15.37:0/2478994361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561467bdf1f0 con 0x5614679002f0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe8137fe640 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cd73c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe8040a6ce0 tx=0x7fe8040a5200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e2a8ebc7f70339 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe7f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.649+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/2478994361 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040c3060 con 0x5614679002f0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/2478994361 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe8040b2440 con 0x5614679002f0 2024-05-09T01:10:19.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe80c004030 con 0x5614679002f0 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/2478994361 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe8040a9a70 con 0x5614679002f0 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 10 client.26485 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x561467994790 con 0x5614679002f0 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/2478994361 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe804085020 con 0x5614679002f0 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/2478994361 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fe8040cc0d0 con 0x5614679002f0 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 10 client.26485 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 10 client.26485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 20 client.26485 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614678e7d80 0x561467ce4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 4 client.26485 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.650+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe80c004030 con 0x5614678e7d80 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.651+0000 7fe812ffd640 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614678e7d80 0x561467ce4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.651+0000 7fe7f2ffd640 10 client.26485 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.652+0000 7fe812ffd640 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614678e7d80 0x561467ce4d00 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f67d09a1bc167dcd server_cookie=55e173ad315e9758 in_seq=0 out_seq=0 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/2478994361 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fe80c004030 con 0x5614678e7d80 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe7f2ffd640 10 client.26485 handle_command_reply: tid=0 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 client.26485 shutdown 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 msgr2=0x561467cd73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cd73c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe8040a6ce0 tx=0x7fe8040a5200 comp rx=0 tx=0).stop 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 shutdown_connections 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614678e7d80 0x561467ce4d00 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679291b0 0x561467cde860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe7f2ffd640 0 client.26485 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cd7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 --2- 172.21.15.37:0/2478994361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cd73c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 >> 172.21.15.37:0/2478994361 conn(0x56146791d300 msgr2=0x561467ccbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 shutdown_connections 2024-05-09T01:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.653+0000 7fe820e27740 1 -- 172.21.15.37:0/2478994361 wait complete. 2024-05-09T01:10:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.654+0000 7fe820e27740 20 client.26485 trim_cache size 0 max 16384 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.681+0000 7fe820e27740 1 Processor -- start 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.681+0000 7fe820e27740 1 -- start start 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe820e27740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614678e7d80 0x561467cd1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe820e27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679002f0 0x561467cd0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe820e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cde7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe820e27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141a9060 con 0x5614679002f0 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe820e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141aac30 con 0x5614679084d0 2024-05-09T01:10:19.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe820e27740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141a9730 con 0x5614678e7d80 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe8137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614678e7d80 0x561467cd1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe8137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614678e7d80 0x561467cd1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34892/0 (socket says 172.21.15.37:34892) 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe8137fe640 1 -- 172.21.15.37:0/3331642575 learned_addr learned my addr 172.21.15.37:0/3331642575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe813fff640 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cde7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe8137fe640 1 -- 172.21.15.37:0/3331642575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 msgr2=0x561467cde7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.682+0000 7fe8137fe640 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cde7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.683+0000 7fe8137fe640 1 -- 172.21.15.37:0/3331642575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679002f0 msgr2=0x561467cd0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.683+0000 7fe8137fe640 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679002f0 0x561467cd0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.683+0000 7fe8137fe640 1 -- 172.21.15.37:0/3331642575 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561467a0b5f0 con 0x5614678e7d80 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.683+0000 7fe8137fe640 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614678e7d80 0x561467cd1e90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8040a5af0 tx=0x7fe8040a5330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31c6ae550ea499ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.683+0000 7fe7f97fa640 1 -- 172.21.15.37:0/3331642575 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040ade20 con 0x5614678e7d80 2024-05-09T01:10:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.683+0000 7fe7f97fa640 1 -- 172.21.15.37:0/3331642575 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe804085030 con 0x5614678e7d80 2024-05-09T01:10:19.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.683+0000 7fe7f97fa640 1 -- 172.21.15.37:0/3331642575 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b2440 con 0x5614678e7d80 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 -- 172.21.15.37:0/3331642575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614678e7d80 msgr2=0x561467cd1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614678e7d80 0x561467cd1e90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8040a5af0 tx=0x7fe8040a5330 comp rx=0 tx=0).stop 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 -- 172.21.15.37:0/3331642575 shutdown_connections 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cde7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614679002f0 0x561467cd0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 --2- 172.21.15.37:0/3331642575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614678e7d80 0x561467cd1e90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 -- 172.21.15.37:0/3331642575 >> 172.21.15.37:0/3331642575 conn(0x56146791d300 msgr2=0x561467cd0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 -- 172.21.15.37:0/3331642575 shutdown_connections 2024-05-09T01:10:19.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.684+0000 7fe820e27740 1 -- 172.21.15.37:0/3331642575 wait complete. 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 -- start start 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 Processor -- start 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614678e7d80 0x561467cdc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cdcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cdda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141aa560 con 0x5614678e7d80 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141a9e90 con 0x5614679084d0 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe81419e570 con 0x5614679002f0 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.685+0000 7fe820e27740 10 client.0 _ll_register_callbacks cb 0x7fe8040a93c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:19.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe813fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cdda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe8137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614678e7d80 0x561467cdc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe812ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cdcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe813fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cdda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60842/0 (socket says 172.21.15.37:60842) 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe813fff640 1 -- 172.21.15.37:0/1692073712 learned_addr learned my addr 172.21.15.37:0/1692073712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe812ffd640 1 -- 172.21.15.37:0/1692073712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 msgr2=0x561467cdda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe812ffd640 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cdda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe812ffd640 1 -- 172.21.15.37:0/1692073712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614678e7d80 msgr2=0x561467cdc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe812ffd640 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614678e7d80 0x561467cdc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe812ffd640 1 -- 172.21.15.37:0/1692073712 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561467bf5ed0 con 0x5614679002f0 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe812ffd640 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cdcaf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe808031440 tx=0x7fe80802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdcdbb1d443b50f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:19.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe7f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/1692073712 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808035040 con 0x5614679002f0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/1692073712 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe8080037f0 con 0x5614679002f0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.686+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe804085030 con 0x5614679002f0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/1692073712 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe808004490 con 0x5614679002f0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 10 client.26491 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x561467cdf110 con 0x5614679002f0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/1692073712 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe804085030 con 0x5614679002f0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/1692073712 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fe808066040 con 0x5614679002f0 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 10 client.26491 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 10 client.26491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 20 client.26491 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614679291b0 0x561467d4f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 4 client.26491 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:10:19.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561467c3f3d0 con 0x5614679291b0 2024-05-09T01:10:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.687+0000 7fe8137fe640 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614679291b0 0x561467d4f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.688+0000 7fe7f2ffd640 10 client.26491 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:19.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.688+0000 7fe8137fe640 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614679291b0 0x561467d4f5c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c978fb2525a4d44 server_cookie=892dcccf170d7917 in_seq=0 out_seq=0 2024-05-09T01:10:19.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.699+0000 7fe7f2ffd640 1 -- 172.21.15.37:0/1692073712 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x561467c3f3d0 con 0x5614679291b0 2024-05-09T01:10:19.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.699+0000 7fe7f2ffd640 10 client.26491 handle_command_reply: tid=0 2024-05-09T01:10:19.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.699+0000 7fe820e27740 1 client.26491 shutdown 2024-05-09T01:10:19.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.699+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 msgr2=0x561467cdcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.699+0000 7fe820e27740 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cdcaf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe808031440 tx=0x7fe80802a410 comp rx=0 tx=0).stop 2024-05-09T01:10:19.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.699+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 shutdown_connections 2024-05-09T01:10:19.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.699+0000 7fe820e27740 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5614679291b0 0x561467d4f5c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.700+0000 7fe7f2ffd640 0 client.26491 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:19.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.700+0000 7fe820e27740 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614679084d0 0x561467cdda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.700+0000 7fe820e27740 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614679002f0 0x561467cdcaf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.700+0000 7fe820e27740 1 --2- 172.21.15.37:0/1692073712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614678e7d80 0x561467cdc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.700+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 >> 172.21.15.37:0/1692073712 conn(0x56146791d300 msgr2=0x561467ce9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.701+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 shutdown_connections 2024-05-09T01:10:19.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.702+0000 7fe820e27740 1 -- 172.21.15.37:0/1692073712 wait complete. 2024-05-09T01:10:19.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.702+0000 7fe820e27740 20 client.26491 trim_cache size 0 max 16384 2024-05-09T01:10:19.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:10:19.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:10:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:10:19.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.702+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7fc0b28e0 msgr2=0x7fe7fc0b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.702+0000 7fe819f72640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7fc0b28e0 0x7fe7fc0b4df0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe8080096c0 tx=0x7fe808000bc0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.702+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 msgr2=0x7fe8141a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.702+0000 7fe819f72640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 0x7fe8141a0990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e9f0 tx=0x7fe80400eeb0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 shutdown_connections 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe7fc0b28e0 0x7fe7fc0b4df0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe81410be20 0x7fe8141a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe814107120 0x7fe8141a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 --2- 172.21.15.37:0/1041458007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe814105ee0 0x7fe8141a0990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 >> 172.21.15.37:0/1041458007 conn(0x7fe8141010b0 msgr2=0x7fe814107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 shutdown_connections 2024-05-09T01:10:19.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:19.703+0000 7fe819f72640 1 -- 172.21.15.37:0/1041458007 wait complete. 2024-05-09T01:10:19.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:10:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 480.0 s, 1679.8 tps, lat 58.187 ms stddev 64.346 2024-05-09T01:10:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:20.525 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:20 smithi037 ceph-mon[30122]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 643 op/s 2024-05-09T01:10:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:20 smithi136 ceph-mon[34110]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 643 op/s 2024-05-09T01:10:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:20 smithi151 ceph-mon[34780]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 643 op/s 2024-05-09T01:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.224+0000 7f1c60bf8700 1 -- 172.21.15.37:0/3294629387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 msgr2=0x7f1c5c117790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.224+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/3294629387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 0x7f1c5c117790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0098f0 tx=0x7f1c4c009c00 comp rx=0 tx=0).stop 2024-05-09T01:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.225+0000 7f1c60bf8700 1 -- 172.21.15.37:0/3294629387 shutdown_connections 2024-05-09T01:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.225+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/3294629387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 0x7f1c5c117790 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.225+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/3294629387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c5c075b60 0x7f1c5c075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.225+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/3294629387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c0764b0 0x7f1c5c114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.225+0000 7f1c60bf8700 1 -- 172.21.15.37:0/3294629387 >> 172.21.15.37:0/3294629387 conn(0x7f1c5c0fffe0 msgr2=0x7f1c5c102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.225+0000 7f1c60bf8700 1 -- 172.21.15.37:0/3294629387 shutdown_connections 2024-05-09T01:10:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.225+0000 7f1c60bf8700 1 -- 172.21.15.37:0/3294629387 wait complete. 2024-05-09T01:10:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.226+0000 7f1c60bf8700 1 Processor -- start 2024-05-09T01:10:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.226+0000 7f1c60bf8700 1 -- start start 2024-05-09T01:10:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c60bf8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c075b60 0x7f1c5c0754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c60bf8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c5c0764b0 0x7f1c5c06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c60bf8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 0x7f1c5c06ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c60bf8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c11aa70 con 0x7f1c5c0764b0 2024-05-09T01:10:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c60bf8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c11a8f0 con 0x7f1c5c075b60 2024-05-09T01:10:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c075b60 0x7f1c5c0754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c60bf8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c11abf0 con 0x7f1c5c115370 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c59d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c5c0764b0 0x7f1c5c06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c075b60 0x7f1c5c0754c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35598/0 (socket says 172.21.15.37:35598) 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c5a59c700 1 -- 172.21.15.37:0/2551473779 learned_addr learned my addr 172.21.15.37:0/2551473779 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.227+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 0x7f1c5c06ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.228+0000 7f1c5a59c700 1 -- 172.21.15.37:0/2551473779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 msgr2=0x7f1c5c06ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.228+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 0x7f1c5c06ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.228+0000 7f1c5a59c700 1 -- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c5c0764b0 msgr2=0x7f1c5c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.228+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c5c0764b0 0x7f1c5c06e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.228+0000 7f1c5a59c700 1 -- 172.21.15.37:0/2551473779 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c072ff0 con 0x7f1c5c075b60 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.228+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 0x7f1c5c06ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.228+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c075b60 0x7f1c5c0754c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e3c0 tx=0x7f1c5400e6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.234+0000 7f1c4b7fe700 1 -- 172.21.15.37:0/2551473779 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400ee40 con 0x7f1c5c075b60 2024-05-09T01:10:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.235+0000 7f1c4b7fe700 1 -- 172.21.15.37:0/2551473779 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c54003a00 con 0x7f1c5c075b60 2024-05-09T01:10:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.235+0000 7f1c4b7fe700 1 -- 172.21.15.37:0/2551473779 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c54004700 con 0x7f1c5c075b60 2024-05-09T01:10:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.235+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c5c073280 con 0x7f1c5c075b60 2024-05-09T01:10:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.235+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c5c073770 con 0x7f1c5c075b60 2024-05-09T01:10:22.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.237+0000 7f1c4b7fe700 1 -- 172.21.15.37:0/2551473779 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1c5401b030 con 0x7f1c5c075b60 2024-05-09T01:10:22.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.238+0000 7f1c4b7fe700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c440b2a50 0x7f1c440b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.238+0000 7f1c4b7fe700 1 -- 172.21.15.37:0/2551473779 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1c540e1c10 con 0x7f1c5c075b60 2024-05-09T01:10:22.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.238+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c440b2a50 0x7f1c440b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.239+0000 7f1c6f60eb80 1 Processor -- start 2024-05-09T01:10:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.239+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c440b2a50 0x7f1c440b4f60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c117900 tx=0x7f1c50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.239+0000 7f1c6f60eb80 1 -- start start 2024-05-09T01:10:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f07f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f07fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f079ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f07f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f07f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35602/0 (socket says 172.21.15.37:35602) 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c59d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f07fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c59d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f07fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33000/0 (socket says 172.21.15.37:33000) 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2663589662 learned_addr learned my addr 172.21.15.37:0/2663589662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d49ef9bff0 con 0x55d49f0796a0 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.240+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f079ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d49ef3a7f0 con 0x55d49efe6160 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d49ef97fb0 con 0x55d49eefc4a0 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2663589662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 msgr2=0x55d49f07f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f07f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2663589662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 msgr2=0x55d49f079ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f079ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2663589662 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d49ef32370 con 0x55d49eefc4a0 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f07fa30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c50011d40 tx=0x7f1c50014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e3ae0ad7e20056 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c48ff9700 1 -- 172.21.15.37:0/2663589662 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50011d70 con 0x55d49eefc4a0 2024-05-09T01:10:22.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.241+0000 7f1c48ff9700 1 -- 172.21.15.37:0/2663589662 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c50004020 con 0x55d49eefc4a0 2024-05-09T01:10:22.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.242+0000 7f1c48ff9700 1 -- 172.21.15.37:0/2663589662 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50003bc0 con 0x55d49eefc4a0 2024-05-09T01:10:22.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.242+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 msgr2=0x55d49f07fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f07fa30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c50011d40 tx=0x7f1c50014000 comp rx=0 tx=0).stop 2024-05-09T01:10:22.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 shutdown_connections 2024-05-09T01:10:22.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f079ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f07f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2663589662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f07fa30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 >> 172.21.15.37:0/2663589662 conn(0x55d49ef5c6a0 msgr2=0x55d49f074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 shutdown_connections 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.243+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2663589662 wait complete. 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.244+0000 7f1c6f60eb80 1 -- start start 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.244+0000 7f1c6f60eb80 1 Processor -- start 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.244+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f083230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.244+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f083770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.244+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.244+0000 7f1c59d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f083770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c59d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f083770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35610/0 (socket says 172.21.15.37:35610) 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2565848751 learned_addr learned my addr 172.21.15.37:0/2565848751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d49ee17ba0 con 0x55d49f0796a0 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d49ef56150 con 0x55d49efe6160 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d49f0861d0 con 0x55d49eefc4a0 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c6f60eb80 10 client.0 _ll_register_callbacks cb 0x55d49ee0d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2565848751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 msgr2=0x55d49f083230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f083230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2565848751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 msgr2=0x55d49f083cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f083cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.245+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2565848751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d49ee17490 con 0x55d49efe6160 2024-05-09T01:10:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.246+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f083770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1c50005950 tx=0x7f1c500051e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a82f621cdcfffae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.246+0000 7f1c41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:10:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.248+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2565848751 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c50034060 con 0x55d49efe6160 2024-05-09T01:10:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.248+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2565848751 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1c50005620 con 0x55d49efe6160 2024-05-09T01:10:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.248+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c50004020 con 0x55d49efe6160 2024-05-09T01:10:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2565848751 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1c50003860 con 0x55d49efe6160 2024-05-09T01:10:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 10 client.26528 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d49f090bd0 con 0x55d49efe6160 2024-05-09T01:10:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2565848751 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c5001e420 con 0x55d49efe6160 2024-05-09T01:10:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2565848751 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f1c50039070 con 0x55d49efe6160 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 10 client.26528 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 10 client.26528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 20 client.26528 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f093150 0x55d49f095570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 4 client.26528 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.249+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1c50004020 con 0x55d49f093150 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.250+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f093150 0x55d49f095570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.250+0000 7f1c41ffb700 10 client.26528 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.250+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f093150 0x55d49f095570 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30c570dc21d3e8eb server_cookie=ce0c99620224e02c in_seq=0 out_seq=0 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2565848751 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f1c50004020 con 0x55d49f093150 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c41ffb700 10 client.26528 handle_command_reply: tid=0 2024-05-09T01:10:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 client.26528 shutdown 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 msgr2=0x55d49f083770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f083770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1c50005950 tx=0x7f1c500051e0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 shutdown_connections 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f093150 0x55d49f095570 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49f0796a0 0x55d49f083cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49eefc4a0 0x55d49f083230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c41ffb700 0 client.26528 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2565848751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f083770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 >> 172.21.15.37:0/2565848751 conn(0x55d49ef5c6a0 msgr2=0x55d49f0741c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 shutdown_connections 2024-05-09T01:10:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2565848751 wait complete. 2024-05-09T01:10:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.251+0000 7f1c6f60eb80 20 client.26528 trim_cache size 0 max 16384 2024-05-09T01:10:22.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.269+0000 7f1c6f60eb80 1 Processor -- start 2024-05-09T01:10:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.270+0000 7f1c6f60eb80 1 -- start start 2024-05-09T01:10:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.270+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f07d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49efe6160 0x55d49f083af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49f0796a0 0x55d49f08f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f07d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f07d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59084/0 (socket says 172.21.15.37:59084) 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c1bdaa0 con 0x55d49eefc4a0 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c1bf670 con 0x55d49f0796a0 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49efe6160 0x55d49f083af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c1be170 con 0x55d49efe6160 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c5a59c700 1 -- 172.21.15.37:0/4109942971 learned_addr learned my addr 172.21.15.37:0/4109942971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.271+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49f0796a0 0x55d49f08f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.272+0000 7f1c5ad9d700 1 -- 172.21.15.37:0/4109942971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49efe6160 msgr2=0x55d49f083af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.272+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49efe6160 0x55d49f083af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.272+0000 7f1c5ad9d700 1 -- 172.21.15.37:0/4109942971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 msgr2=0x55d49f07d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.272+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f07d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.272+0000 7f1c5ad9d700 1 -- 172.21.15.37:0/4109942971 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d49f075cc0 con 0x55d49f0796a0 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.272+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49f0796a0 0x55d49f08f320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009810 tx=0x7f1c4c005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656788d64af4c01e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.272+0000 7f1c43fff700 1 -- 172.21.15.37:0/4109942971 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c028070 con 0x55d49f0796a0 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.273+0000 7f1c43fff700 1 -- 172.21.15.37:0/4109942971 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c4c0054f0 con 0x55d49f0796a0 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.273+0000 7f1c43fff700 1 -- 172.21.15.37:0/4109942971 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c003e30 con 0x55d49f0796a0 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49f0796a0 msgr2=0x55d49f08f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49f0796a0 0x55d49f08f320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009810 tx=0x7f1c4c005dc0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 shutdown_connections 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49f0796a0 0x55d49f08f320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f07d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/4109942971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49efe6160 0x55d49f083af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 >> 172.21.15.37:0/4109942971 conn(0x55d49ef5c6a0 msgr2=0x55d49f078690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 shutdown_connections 2024-05-09T01:10:22.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/4109942971 wait complete. 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.274+0000 7f1c6f60eb80 1 -- start start 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 1 Processor -- start 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f093980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f093ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49f0796a0 0x55d49f0f5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c1befa0 con 0x55d49eefc4a0 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c1be8d0 con 0x55d49efe6160 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c1bba60 con 0x55d49f0796a0 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c6f60eb80 10 client.0 _ll_register_callbacks cb 0x55d49ee0d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c59d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f093ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c59d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f093ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35616/0 (socket says 172.21.15.37:35616) 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2309608478 learned_addr learned my addr 172.21.15.37:0/2309608478 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f093980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.275+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49f0796a0 0x55d49f0f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2309608478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49f0796a0 msgr2=0x55d49f0f5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49f0796a0 0x55d49f0f5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2309608478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 msgr2=0x55d49f093980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f093980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c59d9b700 1 -- 172.21.15.37:0/2309608478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d49f0f5c10 con 0x55d49efe6160 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c5ad9d700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49f0796a0 0x55d49f0f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c59d9b700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f093ec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000a010 tx=0x7f1c50005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88154e24bd279b2e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2309608478 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5003f070 con 0x55d49efe6160 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2309608478 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1c5002f6f0 con 0x55d49efe6160 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c4c0054f0 con 0x55d49efe6160 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2309608478 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1c50004e80 con 0x55d49efe6160 2024-05-09T01:10:22.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c6f60eb80 10 client.26534 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.276+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d49f0fcf20 con 0x55d49efe6160 2024-05-09T01:10:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2309608478 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c4c0054f0 con 0x55d49efe6160 2024-05-09T01:10:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2309608478 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f1c50039040 con 0x55d49efe6160 2024-05-09T01:10:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c6f60eb80 10 client.26534 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c6f60eb80 10 client.26534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c6f60eb80 20 client.26534 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f0fd4e0 0x55d49f0ff900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c6f60eb80 4 client.26534 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d49efa99d0 con 0x55d49f0fd4e0 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.277+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f0fd4e0 0x55d49f0ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.278+0000 7f1c41ffb700 10 client.26534 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.278+0000 7f1c5a59c700 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f0fd4e0 0x55d49f0ff900 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58382bf33ebbaffa server_cookie=84115b9a8ee6dd2c in_seq=0 out_seq=0 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.278+0000 7f1c41ffb700 1 -- 172.21.15.37:0/2309608478 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d49efa99d0 con 0x55d49f0fd4e0 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.278+0000 7f1c41ffb700 10 client.26534 handle_command_reply: tid=0 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.278+0000 7f1c6f60eb80 1 client.26534 shutdown 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 msgr2=0x55d49f093ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f093ec0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000a010 tx=0x7f1c50005250 comp rx=0 tx=0).stop 2024-05-09T01:10:22.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 shutdown_connections 2024-05-09T01:10:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d49f0fd4e0 0x55d49f0ff900 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d49f0796a0 0x55d49f0f5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d49eefc4a0 0x55d49f093980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:10:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 --2- 172.21.15.37:0/2309608478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d49efe6160 0x55d49f093ec0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 >> 172.21.15.37:0/2309608478 conn(0x55d49ef5c6a0 msgr2=0x55d49f07e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c41ffb700 0 client.26534 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 shutdown_connections 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 1 -- 172.21.15.37:0/2309608478 wait complete. 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.279+0000 7f1c6f60eb80 20 client.26534 trim_cache size 0 max 16384 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c440b2a50 msgr2=0x7f1c440b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c440b2a50 0x7f1c440b4f60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c117900 tx=0x7f1c50009260 comp rx=0 tx=0).stop 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c075b60 msgr2=0x7f1c5c0754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c075b60 0x7f1c5c0754c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400e3c0 tx=0x7f1c5400e6d0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 shutdown_connections 2024-05-09T01:10:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c440b2a50 0x7f1c440b4f60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c5c115370 0x7f1c5c06ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c5c075b60 0x7f1c5c0754c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 --2- 172.21.15.37:0/2551473779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c5c0764b0 0x7f1c5c06e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 >> 172.21.15.37:0/2551473779 conn(0x7f1c5c0fffe0 msgr2=0x7f1c5c1008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 shutdown_connections 2024-05-09T01:10:22.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:22.280+0000 7f1c60bf8700 1 -- 172.21.15.37:0/2551473779 wait complete. 2024-05-09T01:10:22.290 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:22 smithi037 ceph-mon[30122]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 639 op/s 2024-05-09T01:10:22.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:22 smithi136 ceph-mon[34110]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 639 op/s 2024-05-09T01:10:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:22 smithi151 ceph-mon[34780]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 639 op/s 2024-05-09T01:10:24.255 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:10:24.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:10:24.599 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:24 smithi136 ceph-mon[34110]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 646 op/s 2024-05-09T01:10:24.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:24 smithi037 ceph-mon[30122]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 646 op/s 2024-05-09T01:10:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:24 smithi151 ceph-mon[34780]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 646 op/s 2024-05-09T01:10:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 485.0 s, 1633.0 tps, lat 62.732 ms stddev 67.960 2024-05-09T01:10:26.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:26 smithi037 ceph-mon[30122]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-05-09T01:10:26.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:26 smithi136 ceph-mon[34110]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-05-09T01:10:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:26 smithi151 ceph-mon[34780]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-05-09T01:10:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 -- 172.21.15.37:0/170114022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9881054c0 msgr2=0x7fc9881058d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 --2- 172.21.15.37:0/170114022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9881054c0 0x7fc9881058d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc98400b0a0 tx=0x7fc98400b3b0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 -- 172.21.15.37:0/170114022 shutdown_connections 2024-05-09T01:10:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 --2- 172.21.15.37:0/170114022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc98810e8f0 0x7fc988110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 --2- 172.21.15.37:0/170114022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9881054c0 0x7fc9881058d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 --2- 172.21.15.37:0/170114022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc988105e10 0x7fc98810e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 -- 172.21.15.37:0/170114022 >> 172.21.15.37:0/170114022 conn(0x7fc9880fedf0 msgr2=0x7fc988101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 -- 172.21.15.37:0/170114022 shutdown_connections 2024-05-09T01:10:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.730+0000 7fc98fd00700 1 -- 172.21.15.37:0/170114022 wait complete. 2024-05-09T01:10:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 Processor -- start 2024-05-09T01:10:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 -- start start 2024-05-09T01:10:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9881054c0 0x7fc98819adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc988105e10 0x7fc98819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98810e8f0 0x7fc98819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc988114440 con 0x7fc988105e10 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881142c0 con 0x7fc9881054c0 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98fd00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881145c0 con 0x7fc98810e8f0 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98d29b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc988105e10 0x7fc98819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98d29b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc988105e10 0x7fc98819b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59098/0 (socket says 172.21.15.37:59098) 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98d29b700 1 -- 172.21.15.37:0/3490039667 learned_addr learned my addr 172.21.15.37:0/3490039667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98e29d700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98810e8f0 0x7fc98819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.731+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9881054c0 0x7fc98819adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98d29b700 1 -- 172.21.15.37:0/3490039667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98810e8f0 msgr2=0x7fc98819f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98d29b700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98810e8f0 0x7fc98819f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98d29b700 1 -- 172.21.15.37:0/3490039667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9881054c0 msgr2=0x7fc98819adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98d29b700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9881054c0 0x7fc98819adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98d29b700 1 -- 172.21.15.37:0/3490039667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98819fcc0 con 0x7fc988105e10 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9881054c0 0x7fc98819adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98d29b700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc988105e10 0x7fc98819b390 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc97800d950 tx=0x7fc97800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc97effd700 1 -- 172.21.15.37:0/3490039667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978016070 con 0x7fc988105e10 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc97effd700 1 -- 172.21.15.37:0/3490039667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc97800fd40 con 0x7fc988105e10 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98819ffb0 con 0x7fc988105e10 2024-05-09T01:10:26.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc97effd700 1 -- 172.21.15.37:0/3490039667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97800e3b0 con 0x7fc988105e10 2024-05-09T01:10:26.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.732+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9881a78d0 con 0x7fc988105e10 2024-05-09T01:10:26.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.736+0000 7fc97effd700 1 -- 172.21.15.37:0/3490039667 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc978019070 con 0x7fc988105e10 2024-05-09T01:10:26.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc97effd700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc9740b2900 0x7fc9740b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 Processor -- start 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc9740b2900 0x7fc9740b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc97effd700 1 -- 172.21.15.37:0/3490039667 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc9780e1c80 con 0x7fc988105e10 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 -- start start 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208a1f1e0 0x563208ab8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208ab8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ab2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5632089d5070 con 0x563208a1f1e0 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563208973870 con 0x563208ab2720 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc99e716b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5632089d1030 con 0x563208935520 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc9740b2900 0x7fc9740b4e10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc984009fd0 tx=0x7fc98400b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc98da9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208a1f1e0 0x563208ab8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc98da9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208a1f1e0 0x563208ab8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59114/0 (socket says 172.21.15.37:59114) 2024-05-09T01:10:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.737+0000 7fc98da9c700 1 -- 172.21.15.37:0/3623189227 learned_addr learned my addr 172.21.15.37:0/3623189227 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98e29d700 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ab2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98d29b700 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208ab8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98e29d700 1 -- 172.21.15.37:0/3623189227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 msgr2=0x563208ab8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98e29d700 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208ab8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98e29d700 1 -- 172.21.15.37:0/3623189227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208a1f1e0 msgr2=0x563208ab8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98e29d700 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208a1f1e0 0x563208ab8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98e29d700 1 -- 172.21.15.37:0/3623189227 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56320896b3f0 con 0x563208ab2720 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208a1f1e0 0x563208ab8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc98e29d700 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ab2b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc980009c10 tx=0x7fc980009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33e8e10f2cadb07 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc973fff700 1 -- 172.21.15.37:0/3623189227 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980011cb0 con 0x563208ab2720 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc973fff700 1 -- 172.21.15.37:0/3623189227 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc980011e50 con 0x563208ab2720 2024-05-09T01:10:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.738+0000 7fc973fff700 1 -- 172.21.15.37:0/3623189227 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980005280 con 0x563208ab2720 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 -- 172.21.15.37:0/3623189227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 msgr2=0x563208ab2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ab2b50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc980009c10 tx=0x7fc980009f20 comp rx=0 tx=0).stop 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 -- 172.21.15.37:0/3623189227 shutdown_connections 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ab2b50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208a1f1e0 0x563208ab8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3623189227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208ab8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 -- 172.21.15.37:0/3623189227 >> 172.21.15.37:0/3623189227 conn(0x563208995720 msgr2=0x563208aad480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 -- 172.21.15.37:0/3623189227 shutdown_connections 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.739+0000 7fc99e716b80 1 -- 172.21.15.37:0/3623189227 wait complete. 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 -- start start 2024-05-09T01:10:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 Processor -- start 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208abc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208a1f1e0 0x563208abc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208ab2720 0x563208abcc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563208850c20 con 0x563208ab2720 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56320898f1d0 con 0x563208a1f1e0 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563208abf250 con 0x563208935520 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc99e716b80 10 client.0 _ll_register_callbacks cb 0x563208846740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc98e29d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208ab2720 0x563208abcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc98e29d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208ab2720 0x563208abcc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59130/0 (socket says 172.21.15.37:59130) 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc98e29d700 1 -- 172.21.15.37:0/2568531769 learned_addr learned my addr 172.21.15.37:0/2568531769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.740+0000 7fc98da9c700 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208abc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc98d29b700 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208a1f1e0 0x563208abc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc98d29b700 1 -- 172.21.15.37:0/2568531769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 msgr2=0x563208abc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc98d29b700 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208abc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc98d29b700 1 -- 172.21.15.37:0/2568531769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208ab2720 msgr2=0x563208abcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc98d29b700 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208ab2720 0x563208abcc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc98d29b700 1 -- 172.21.15.37:0/2568531769 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563208850510 con 0x563208a1f1e0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc98d29b700 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208a1f1e0 0x563208abc720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9780a8fa0 tx=0x7fc9780a8ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bdf798769cadc81 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc9717fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc9717fa700 1 -- 172.21.15.37:0/2568531769 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978020070 con 0x563208a1f1e0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc9717fa700 1 -- 172.21.15.37:0/2568531769 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc9780dfdf0 con 0x563208a1f1e0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc980011e50 con 0x563208a1f1e0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc9717fa700 1 -- 172.21.15.37:0/2568531769 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc9780ad650 con 0x563208a1f1e0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc99e716b80 10 client.26546 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.741+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x563208acdfd0 con 0x563208a1f1e0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc9717fa700 1 -- 172.21.15.37:0/2568531769 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc980011e50 con 0x563208a1f1e0 2024-05-09T01:10:26.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc9717fa700 1 -- 172.21.15.37:0/2568531769 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fc9780b1c70 con 0x563208a1f1e0 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc99e716b80 10 client.26546 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc99e716b80 10 client.26546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc99e716b80 20 client.26546 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc99e716b80 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208ad0560 0x563208ad29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc99e716b80 4 client.26546 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632089e2a50 con 0x563208ad0560 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.742+0000 7fc98da9c700 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208ad0560 0x563208ad29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.743+0000 7fc9717fa700 10 client.26546 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.743+0000 7fc98da9c700 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208ad0560 0x563208ad29b0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df03df6c7276901c server_cookie=3e0158cb9cd4d1df in_seq=0 out_seq=0 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.743+0000 7fc9717fa700 1 -- 172.21.15.37:0/2568531769 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5632089e2a50 con 0x563208ad0560 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.743+0000 7fc9717fa700 10 client.26546 handle_command_reply: tid=0 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.743+0000 7fc99e716b80 1 client.26546 shutdown 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.743+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208a1f1e0 msgr2=0x563208abc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.743+0000 7fc99e716b80 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208a1f1e0 0x563208abc720 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9780a8fa0 tx=0x7fc9780a8ef0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 shutdown_connections 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208ad0560 0x563208ad29b0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208ab2720 0x563208abcc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208935520 0x563208abc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 --2- 172.21.15.37:0/2568531769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208a1f1e0 0x563208abc720 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 >> 172.21.15.37:0/2568531769 conn(0x563208995720 msgr2=0x563208aad240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc9717fa700 0 client.26546 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 shutdown_connections 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 1 -- 172.21.15.37:0/2568531769 wait complete. 2024-05-09T01:10:26.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.744+0000 7fc99e716b80 20 client.26546 trim_cache size 0 max 16384 2024-05-09T01:10:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 Processor -- start 2024-05-09T01:10:26.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 -- start start 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208abcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208abb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ad81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881ac900 con 0x563208935520 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881ae4d0 con 0x563208ab2720 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc99e716b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881acfd0 con 0x563208a1f1e0 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208abcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208abcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59140/0 (socket says 172.21.15.37:59140) 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 -- 172.21.15.37:0/654873308 learned_addr learned my addr 172.21.15.37:0/654873308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98d29b700 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208abb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98e29d700 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ad81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 -- 172.21.15.37:0/654873308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 msgr2=0x563208abb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208abb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 -- 172.21.15.37:0/654873308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 msgr2=0x563208ad81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ad81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98da9c700 1 -- 172.21.15.37:0/654873308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563208abcfe0 con 0x563208935520 2024-05-09T01:10:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.765+0000 7fc98e29d700 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ad81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:10:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.766+0000 7fc98da9c700 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208abcaa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc98806d150 tx=0x7fc98401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecb01e5c8a9ace9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.766+0000 7fc9737fe700 1 -- 172.21.15.37:0/654873308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984021070 con 0x563208935520 2024-05-09T01:10:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.766+0000 7fc9737fe700 1 -- 172.21.15.37:0/654873308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc984007900 con 0x563208935520 2024-05-09T01:10:26.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.766+0000 7fc9737fe700 1 -- 172.21.15.37:0/654873308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984033750 con 0x563208935520 2024-05-09T01:10:26.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 -- 172.21.15.37:0/654873308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 msgr2=0x563208abcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208abcaa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc98806d150 tx=0x7fc98401d000 comp rx=0 tx=0).stop 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 -- 172.21.15.37:0/654873308 shutdown_connections 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ad81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208abcaa0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 --2- 172.21.15.37:0/654873308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208abb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 -- 172.21.15.37:0/654873308 >> 172.21.15.37:0/654873308 conn(0x563208995720 msgr2=0x563208abaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 -- 172.21.15.37:0/654873308 shutdown_connections 2024-05-09T01:10:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 -- 172.21.15.37:0/654873308 wait complete. 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 -- start start 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.767+0000 7fc99e716b80 1 Processor -- start 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208ac4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208ac09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc99e716b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ac0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc99e716b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881ade00 con 0x563208935520 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc99e716b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881ad730 con 0x563208ab2720 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc99e716b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881aa8e0 con 0x563208a1f1e0 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc99e716b80 10 client.0 _ll_register_callbacks cb 0x563208aad120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208ac4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208ac4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59144/0 (socket says 172.21.15.37:59144) 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 -- 172.21.15.37:0/3490436994 learned_addr learned my addr 172.21.15.37:0/3490436994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98d29b700 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208ac09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98e29d700 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ac0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 -- 172.21.15.37:0/3490436994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 msgr2=0x563208ac09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208ac09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 -- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 msgr2=0x563208ac0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ac0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.768+0000 7fc98da9c700 1 -- 172.21.15.37:0/3490436994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563208ac1420 con 0x563208935520 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc98da9c700 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208ac4630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d010 tx=0x7fc984003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83292408f75757af server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc9717fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc9717fa700 1 -- 172.21.15.37:0/3490436994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc984007ab0 con 0x563208935520 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc9717fa700 1 -- 172.21.15.37:0/3490436994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc984007c50 con 0x563208935520 2024-05-09T01:10:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc984007900 con 0x563208935520 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc9717fa700 1 -- 172.21.15.37:0/3490436994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc984033430 con 0x563208935520 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc99e716b80 10 client.16731 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x563208b3b8f0 con 0x563208935520 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc9717fa700 1 -- 172.21.15.37:0/3490436994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc984007900 con 0x563208935520 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.769+0000 7fc9717fa700 1 -- 172.21.15.37:0/3490436994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fc984011070 con 0x563208935520 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc99e716b80 10 client.16731 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc99e716b80 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc99e716b80 20 client.16731 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208b3bed0 0x563208b3e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc99e716b80 4 client.16731 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5632089dcaf0 con 0x563208b3bed0 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc98d29b700 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208b3bed0 0x563208b3e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc98d29b700 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208b3bed0 0x563208b3e2f0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfba3f4b7a3d644d server_cookie=32fe06a6bb033c in_seq=0 out_seq=0 2024-05-09T01:10:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.770+0000 7fc9717fa700 10 client.16731 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc9717fa700 1 -- 172.21.15.37:0/3490436994 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5632089dcaf0 con 0x563208b3bed0 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc9717fa700 10 client.16731 handle_command_reply: tid=0 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 client.16731 shutdown 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 msgr2=0x563208ac4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208ac4630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d010 tx=0x7fc984003b60 comp rx=0 tx=0).stop 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 shutdown_connections 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563208b3bed0 0x563208b3e2f0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563208ab2720 0x563208ac0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563208935520 0x563208ac4630 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 --2- 172.21.15.37:0/3490436994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563208a1f1e0 0x563208ac09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 >> 172.21.15.37:0/3490436994 conn(0x563208995720 msgr2=0x563208ab1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.771+0000 7fc9717fa700 0 client.16731 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 shutdown_connections 2024-05-09T01:10:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc99e716b80 1 -- 172.21.15.37:0/3490436994 wait complete. 2024-05-09T01:10:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc99e716b80 20 client.16731 trim_cache size 0 max 16384 2024-05-09T01:10:26.779 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:10:26.779 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:10:26.779 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "9ecb07b8-226d-4f86-b0a5-732d20fd5355", 2024-05-09T01:10:26.779 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:10:26.779 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc9740b2900 msgr2=0x7fc9740b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc9740b2900 0x7fc9740b4e10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc984009fd0 tx=0x7fc98400b700 comp rx=0 tx=0).stop 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc988105e10 msgr2=0x7fc98819b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc988105e10 0x7fc98819b390 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc97800d950 tx=0x7fc97800dc60 comp rx=0 tx=0).stop 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 shutdown_connections 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc9740b2900 0x7fc9740b4e10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98810e8f0 0x7fc98819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9881054c0 0x7fc98819adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 --2- 172.21.15.37:0/3490039667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc988105e10 0x7fc98819b390 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:26.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 >> 172.21.15.37:0/3490039667 conn(0x7fc9880fedf0 msgr2=0x7fc988100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:26.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.772+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 shutdown_connections 2024-05-09T01:10:26.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:26.773+0000 7fc98fd00700 1 -- 172.21.15.37:0/3490039667 wait complete. 2024-05-09T01:10:27.128 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:10:26 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:10:26.796+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001a [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact/ auth{1=1,2=1,3=1,4=1} v804 ap=2 f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0) n(v4 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@11} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8323600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001a:[<0x10000000006/pg_xact v414>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000001a:[<0x10000000006/pg_xact v804>,<0x10000000005/data v589>,<0x100000001fb/postgres v324>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v346>,<0x10000000001/sv_1 v364>,<0x10000000000/qa v354>,<0x1/volumes v337>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:02:06.872458+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1)","memory_value.dirstat":"f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0)","memory_value.rstat":"n(v4 rc2024-05-09T01:07:12.327439+0000 b278528 3=2+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:10:27.407 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:27 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:27.407 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:27 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:27.407 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:27 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:27.408 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:27 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:27.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:10:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:27 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:27 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:27 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:27.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:27 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:27 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:27 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:27 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:27.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:27 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:27.797 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:10:28.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:28 smithi037 ceph-mon[30122]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 623 op/s 2024-05-09T01:10:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:10:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:28 smithi136 ceph-mon[34110]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 623 op/s 2024-05-09T01:10:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:10:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:10:28.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:28 smithi151 ceph-mon[34780]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 623 op/s 2024-05-09T01:10:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.120+0000 7f90e4484700 1 -- 172.21.15.37:0/2669151904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 msgr2=0x7f90dc110b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.120+0000 7f90e4484700 1 --2- 172.21.15.37:0/2669151904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 0x7f90dc110b70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0098f0 tx=0x7f90cc009c00 comp rx=0 tx=0).stop 2024-05-09T01:10:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 -- 172.21.15.37:0/2669151904 shutdown_connections 2024-05-09T01:10:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 --2- 172.21.15.37:0/2669151904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90dc1110b0 0x7f90dc117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 --2- 172.21.15.37:0/2669151904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc10b9a0 0x7f90dc10bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 --2- 172.21.15.37:0/2669151904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 0x7f90dc110b70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 -- 172.21.15.37:0/2669151904 >> 172.21.15.37:0/2669151904 conn(0x7f90dc079e70 msgr2=0x7f90dc07c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 -- 172.21.15.37:0/2669151904 shutdown_connections 2024-05-09T01:10:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 -- 172.21.15.37:0/2669151904 wait complete. 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 Processor -- start 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.121+0000 7f90e4484700 1 -- start start 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e4484700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc10b9a0 0x7f90dc1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e4484700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 0x7f90dc1a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e4484700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90dc1110b0 0x7f90dc1a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e2220700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc10b9a0 0x7f90dc1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e2220700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc10b9a0 0x7f90dc1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33108/0 (socket says 172.21.15.37:33108) 2024-05-09T01:10:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e2220700 1 -- 172.21.15.37:0/1880711355 learned_addr learned my addr 172.21.15.37:0/1880711355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc11ab50 con 0x7f90dc1110b0 2024-05-09T01:10:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc11a9d0 con 0x7f90dc110760 2024-05-09T01:10:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc11acd0 con 0x7f90dc10b9a0 2024-05-09T01:10:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.122+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 0x7f90dc1a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.123+0000 7f90e2a21700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90dc1110b0 0x7f90dc1a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.123+0000 7f90e1a1f700 1 -- 172.21.15.37:0/1880711355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc10b9a0 msgr2=0x7f90dc1a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.123+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc10b9a0 0x7f90dc1a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.123+0000 7f90e1a1f700 1 -- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90dc1110b0 msgr2=0x7f90dc1a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.123+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90dc1110b0 0x7f90dc1a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.123+0000 7f90e1a1f700 1 -- 172.21.15.37:0/1880711355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc1a63f0 con 0x7f90dc110760 2024-05-09T01:10:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.124+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 0x7f90dc1a1ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009230 tx=0x7f90cc00fa90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.124+0000 7f90d37fe700 1 -- 172.21.15.37:0/1880711355 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc005270 con 0x7f90dc110760 2024-05-09T01:10:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.124+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90dc1a6680 con 0x7f90dc110760 2024-05-09T01:10:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.124+0000 7f90d37fe700 1 -- 172.21.15.37:0/1880711355 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90cc00ba10 con 0x7f90dc110760 2024-05-09T01:10:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.125+0000 7f90d37fe700 1 -- 172.21.15.37:0/1880711355 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc003ba0 con 0x7f90dc110760 2024-05-09T01:10:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.125+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90dc1a6b30 con 0x7f90dc110760 2024-05-09T01:10:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.130+0000 7f90d37fe700 1 -- 172.21.15.37:0/1880711355 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f90cc005410 con 0x7f90dc110760 2024-05-09T01:10:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.131+0000 7f90f2e9ab80 1 Processor -- start 2024-05-09T01:10:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.131+0000 7f90f2e9ab80 1 -- start start 2024-05-09T01:10:30.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d7f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d79810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5634d0c9c0a0 con 0x5634d0d79400 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5634d0c419a0 con 0x5634d0c76d00 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5634d0c98060 con 0x5634d0bfc4a0 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90e2a21700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d7f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90e2a21700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d7f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:35706/0 (socket says 172.21.15.37:35706) 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90e2a21700 1 -- 172.21.15.37:0/2088863399 learned_addr learned my addr 172.21.15.37:0/2088863399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d79810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.132+0000 7f90e2220700 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90d37fe700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f90c80b2a50 0x7f90c80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90e2a21700 1 -- 172.21.15.37:0/2088863399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0bfc4a0 msgr2=0x5634d0d7f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90e2a21700 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90e2a21700 1 -- 172.21.15.37:0/2088863399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 msgr2=0x5634d0d79810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90e2a21700 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d79810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90e2a21700 1 -- 172.21.15.37:0/2088863399 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d0c32500 con 0x5634d0c76d00 2024-05-09T01:10:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90d37fe700 1 -- 172.21.15.37:0/1880711355 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f90cc0e3080 con 0x7f90dc110760 2024-05-09T01:10:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90e2a21700 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d7f240 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009410 tx=0x7f90d40099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9d0b0eb80ff871 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.133+0000 7f90e2a21700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f90c80b2a50 0x7f90c80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.134+0000 7f90d0d47700 1 -- 172.21.15.37:0/2088863399 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d4012810 con 0x5634d0c76d00 2024-05-09T01:10:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.134+0000 7f90d0d47700 1 -- 172.21.15.37:0/2088863399 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d4016460 con 0x5634d0c76d00 2024-05-09T01:10:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.134+0000 7f90d0d47700 1 -- 172.21.15.37:0/2088863399 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d4014640 con 0x5634d0c76d00 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/2088863399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 msgr2=0x5634d0d7f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90e2a21700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f90c80b2a50 0x7f90c80b4f60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f90d4012fd0 tx=0x7f90d4012ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d7f240 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009410 tx=0x7f90d40099e0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/2088863399 shutdown_connections 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d79810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d7f240 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/2088863399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/2088863399 >> 172.21.15.37:0/2088863399 conn(0x5634d0bfff70 msgr2=0x5634d0d74220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/2088863399 shutdown_connections 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/2088863399 wait complete. 2024-05-09T01:10:30.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 -- start start 2024-05-09T01:10:30.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.135+0000 7f90f2e9ab80 1 Processor -- start 2024-05-09T01:10:30.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d82fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d834f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0d79400 0x5634d0d83a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5634d0d7a160 con 0x5634d0bfc4a0 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5634d0c36b20 con 0x5634d0c76d00 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5634d0d86020 con 0x5634d0d79400 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90f2e9ab80 10 client.0 _ll_register_callbacks cb 0x5634d0b0d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90e2220700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d82fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90e2220700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d82fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59178/0 (socket says 172.21.15.37:59178) 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90e2220700 1 -- 172.21.15.37:0/764485466 learned_addr learned my addr 172.21.15.37:0/764485466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d834f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.136+0000 7f90e2a21700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0d79400 0x5634d0d83a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90e2220700 1 -- 172.21.15.37:0/764485466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0d79400 msgr2=0x5634d0d83a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90e2220700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0d79400 0x5634d0d83a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90e2220700 1 -- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 msgr2=0x5634d0d834f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90e2220700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d834f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90e2220700 1 -- 172.21.15.37:0/764485466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634d0b17490 con 0x5634d0bfc4a0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90e2a21700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0d79400 0x5634d0d83a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90e2220700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d82fb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f90d8022650 tx=0x7f90d8022a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2a983a9037a79b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.137+0000 7f90c5ffb700 1 -- 172.21.15.37:0/764485466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8025660 con 0x5634d0bfc4a0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.138+0000 7f90c5ffb700 1 -- 172.21.15.37:0/764485466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f90d8025800 con 0x5634d0bfc4a0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.138+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90d4016460 con 0x5634d0bfc4a0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.138+0000 7f90c5ffb700 1 -- 172.21.15.37:0/764485466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f90d8025a00 con 0x5634d0bfc4a0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.138+0000 7f90f2e9ab80 10 client.16743 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.138+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5634d0d909f0 con 0x5634d0bfc4a0 2024-05-09T01:10:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.139+0000 7f90c5ffb700 1 -- 172.21.15.37:0/764485466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d8025ba0 con 0x5634d0bfc4a0 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.139+0000 7f90c5ffb700 1 -- 172.21.15.37:0/764485466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f90d802e400 con 0x5634d0bfc4a0 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.139+0000 7f90f2e9ab80 10 client.16743 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.139+0000 7f90f2e9ab80 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.139+0000 7f90f2e9ab80 20 client.16743 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.139+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0d92f80 0x5634d0d953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.140+0000 7f90f2e9ab80 4 client.16743 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.140+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f90d4016460 con 0x5634d0d92f80 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.140+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0d92f80 0x5634d0d953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.140+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0d92f80 0x5634d0d953a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=697fedddf5b510a2 server_cookie=250d8f9f266a8a44 in_seq=0 out_seq=0 2024-05-09T01:10:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.140+0000 7f90c5ffb700 10 client.16743 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90c5ffb700 1 -- 172.21.15.37:0/764485466 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f90d4016460 con 0x5634d0d92f80 2024-05-09T01:10:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90c5ffb700 10 client.16743 handle_command_reply: tid=0 2024-05-09T01:10:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 client.16743 shutdown 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 msgr2=0x5634d0d82fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d82fb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f90d8022650 tx=0x7f90d8022a10 comp rx=0 tx=0).stop 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 shutdown_connections 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0d92f80 0x5634d0d953a0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0d79400 0x5634d0d83a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d82fb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/764485466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0c76d00 0x5634d0d834f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 >> 172.21.15.37:0/764485466 conn(0x5634d0bfff70 msgr2=0x5634d0d6dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90c5ffb700 0 client.16743 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.141+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 shutdown_connections 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.142+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/764485466 wait complete. 2024-05-09T01:10:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.142+0000 7f90f2e9ab80 20 client.16743 trim_cache size 0 max 16384 2024-05-09T01:10:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.171+0000 7f90f2e9ab80 1 Processor -- start 2024-05-09T01:10:30.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.171+0000 7f90f2e9ab80 1 -- start start 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 0x5634d0d6ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0d79400 0x5634d0d83870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc086140 con 0x5634d0bfc4a0 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc1ae3c0 con 0x5634d0d79400 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc086810 con 0x5634d0c76d00 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2220700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2220700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59184/0 (socket says 172.21.15.37:59184) 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2220700 1 -- 172.21.15.37:0/3304315003 learned_addr learned my addr 172.21.15.37:0/3304315003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2a21700 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0d79400 0x5634d0d83870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e1a1f700 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 0x5634d0d6ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2a21700 1 -- 172.21.15.37:0/3304315003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 msgr2=0x5634d0d6ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2a21700 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 0x5634d0d6ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2a21700 1 -- 172.21.15.37:0/3304315003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 msgr2=0x5634d0d7e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2a21700 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2a21700 1 -- 172.21.15.37:0/3304315003 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634d0d751b0 con 0x5634d0d79400 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.172+0000 7f90e2220700 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.173+0000 7f90e2a21700 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0d79400 0x5634d0d83870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f90d40093e0 tx=0x7f90d4023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d15f325a3c62111 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.174+0000 7f90c7fff700 1 -- 172.21.15.37:0/3304315003 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d40143e0 con 0x5634d0d79400 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.174+0000 7f90c7fff700 1 -- 172.21.15.37:0/3304315003 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d4014580 con 0x5634d0d79400 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.174+0000 7f90c7fff700 1 -- 172.21.15.37:0/3304315003 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d4012830 con 0x5634d0d79400 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.174+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/3304315003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0d79400 msgr2=0x5634d0d83870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.174+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0d79400 0x5634d0d83870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f90d40093e0 tx=0x7f90d4023000 comp rx=0 tx=0).stop 2024-05-09T01:10:30.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/3304315003 shutdown_connections 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0d79400 0x5634d0d83870 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0bfc4a0 0x5634d0d7e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/3304315003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 0x5634d0d6ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/3304315003 >> 172.21.15.37:0/3304315003 conn(0x5634d0bfff70 msgr2=0x5634d0d783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/3304315003 shutdown_connections 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/3304315003 wait complete. 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 -- start start 2024-05-09T01:10:30.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 Processor -- start 2024-05-09T01:10:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.175+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0bfc4a0 0x5634d0d9a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 0x5634d0d9a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90f2e9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d9aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc087640 con 0x5634d0d79400 2024-05-09T01:10:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc086f70 con 0x5634d0bfc4a0 2024-05-09T01:10:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90f2e9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f90dc084140 con 0x5634d0c76d00 2024-05-09T01:10:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90f2e9ab80 10 client.0 _ll_register_callbacks cb 0x5634d0b0d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90e2a21700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d9aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90e2a21700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d9aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59186/0 (socket says 172.21.15.37:59186) 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.176+0000 7f90e2a21700 1 -- 172.21.15.37:0/4205896093 learned_addr learned my addr 172.21.15.37:0/4205896093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.177+0000 7f90e2a21700 1 -- 172.21.15.37:0/4205896093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 msgr2=0x5634d0d9a9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.177+0000 7f90e2a21700 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 0x5634d0d9a9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.177+0000 7f90e2a21700 1 -- 172.21.15.37:0/4205896093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0bfc4a0 msgr2=0x5634d0d9a460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.177+0000 7f90e2a21700 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0bfc4a0 0x5634d0d9a460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.177+0000 7f90e2a21700 1 -- 172.21.15.37:0/4205896093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634d0dfc710 con 0x5634d0d79400 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90e2a21700 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d9aee0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009f00 tx=0x7f90d4009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5187d09090fd957f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90c5ffb700 1 -- 172.21.15.37:0/4205896093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d403d030 con 0x5634d0d79400 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90c5ffb700 1 -- 172.21.15.37:0/4205896093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f90d4003a00 con 0x5634d0d79400 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90d4014580 con 0x5634d0d79400 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90c5ffb700 1 -- 172.21.15.37:0/4205896093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f90d4049050 con 0x5634d0d79400 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90f2e9ab80 10 client.16749 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:30.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.178+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5634d0dfd8e0 con 0x5634d0d79400 2024-05-09T01:10:30.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90c5ffb700 1 -- 172.21.15.37:0/4205896093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d4014580 con 0x5634d0d79400 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90c5ffb700 1 -- 172.21.15.37:0/4205896093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f90d4016bd0 con 0x5634d0d79400 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90f2e9ab80 10 client.16749 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90f2e9ab80 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90f2e9ab80 20 client.16749 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0dfdce0 0x5634d0e00100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90f2e9ab80 4 client.16749 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5634d0ca9a80 con 0x5634d0dfdce0 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.179+0000 7f90e2220700 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0dfdce0 0x5634d0e00100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.180+0000 7f90c5ffb700 10 client.16749 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.180+0000 7f90e2220700 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0dfdce0 0x5634d0e00100 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc07fdcf3133feab server_cookie=c5d95c3f6b0e4fe in_seq=0 out_seq=0 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.180+0000 7f90c5ffb700 1 -- 172.21.15.37:0/4205896093 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5634d0ca9a80 con 0x5634d0dfdce0 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.180+0000 7f90c5ffb700 10 client.16749 handle_command_reply: tid=0 2024-05-09T01:10:30.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.180+0000 7f90f2e9ab80 1 client.16749 shutdown 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 msgr2=0x5634d0d9aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d9aee0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f90d4009f00 tx=0x7f90d4009960 comp rx=0 tx=0).stop 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 shutdown_connections 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5634d0dfdce0 0x5634d0e00100 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5634d0d79400 0x5634d0d9aee0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5634d0bfc4a0 0x5634d0d9a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 --2- 172.21.15.37:0/4205896093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634d0c76d00 0x5634d0d9a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90c5ffb700 0 client.16749 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 >> 172.21.15.37:0/4205896093 conn(0x5634d0bfff70 msgr2=0x5634d0d6e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 shutdown_connections 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 1 -- 172.21.15.37:0/4205896093 wait complete. 2024-05-09T01:10:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.181+0000 7f90f2e9ab80 20 client.16749 trim_cache size 0 max 16384 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "9ecb07b8-226d-4f86-b0a5-732d20fd5355": { 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "9ecb07b8-226d-4f86-b0a5-732d20fd5355", 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:10:30.185 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f90c80b2a50 msgr2=0x7f90c80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f90c80b2a50 0x7f90c80b4f60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f90d4012fd0 tx=0x7f90d4012ea0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 msgr2=0x7f90dc1a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 0x7f90dc1a1ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009230 tx=0x7f90cc00fa90 comp rx=0 tx=0).stop 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 shutdown_connections 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f90c80b2a50 0x7f90c80b4f60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90dc1110b0 0x7f90dc1a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc10b9a0 0x7f90dc1a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 --2- 172.21.15.37:0/1880711355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90dc110760 0x7f90dc1a1ac0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 >> 172.21.15.37:0/1880711355 conn(0x7f90dc079e70 msgr2=0x7f90dc07b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 shutdown_connections 2024-05-09T01:10:30.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:10:30.182+0000 7f90e4484700 1 -- 172.21.15.37:0/1880711355 wait complete. 2024-05-09T01:10:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 490.0 s, 1993.0 tps, lat 50.180 ms stddev 89.007 2024-05-09T01:10:30.453 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:30 smithi037 ceph-mon[30122]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 637 op/s 2024-05-09T01:10:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:30 smithi136 ceph-mon[34110]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 637 op/s 2024-05-09T01:10:30.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:30 smithi151 ceph-mon[34780]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.2 MiB/s wr, 637 op/s 2024-05-09T01:10:30.964 INFO:tasks.cephfs.filesystem:scrub status for tag:9ecb07b8-226d-4f86-b0a5-732d20fd5355 - {'path': '/', 'tag': '9ecb07b8-226d-4f86-b0a5-732d20fd5355', 'options': 'recursive,force'} 2024-05-09T01:10:32.527 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:32 smithi151 ceph-mon[34780]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.1 MiB/s wr, 694 op/s 2024-05-09T01:10:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:32 smithi136 ceph-mon[34110]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.1 MiB/s wr, 694 op/s 2024-05-09T01:10:32.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:32 smithi037 ceph-mon[30122]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.1 MiB/s wr, 694 op/s 2024-05-09T01:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.862+0000 7f9fd6d34640 1 -- 172.21.15.37:0/247728169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 msgr2=0x7f9fd01072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.862+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/247728169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01072e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009900 tx=0x7f9fc002a400 comp rx=0 tx=0).stop 2024-05-09T01:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.862+0000 7f9fd6d34640 1 -- 172.21.15.37:0/247728169 shutdown_connections 2024-05-09T01:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.862+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/247728169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd0107820 0x7f9fd0107c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.862+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/247728169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01072e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.862+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/247728169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fd0102560 0x7f9fd0104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.862+0000 7f9fd6d34640 1 -- 172.21.15.37:0/247728169 >> 172.21.15.37:0/247728169 conn(0x7f9fd00fdd90 msgr2=0x7f9fd0100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.863+0000 7f9fd6d34640 1 -- 172.21.15.37:0/247728169 shutdown_connections 2024-05-09T01:10:32.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.863+0000 7f9fd6d34640 1 -- 172.21.15.37:0/247728169 wait complete. 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.863+0000 7f9fd6d34640 1 Processor -- start 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.863+0000 7f9fd6d34640 1 -- start start 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd6d34640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fd0102560 0x7f9fd01a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd6d34640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd6d34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd0107820 0x7f9fd01a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd6d34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0115df0 con 0x7f9fd0107820 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd6d34640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0115c70 con 0x7f9fd0102560 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd6d34640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0115f70 con 0x7f9fd0104ec0 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd4ad0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fd0102560 0x7f9fd01a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42600/0 (socket says 172.21.15.37:42600) 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 -- 172.21.15.37:0/2429150727 learned_addr learned my addr 172.21.15.37:0/2429150727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd4ad0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fd0102560 0x7f9fd01a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42118/0 (socket says 172.21.15.37:42118) 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd0107820 0x7f9fd01a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 -- 172.21.15.37:0/2429150727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fd0102560 msgr2=0x7f9fd01a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fd0102560 0x7f9fd01a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 -- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd0107820 msgr2=0x7f9fd01a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd0107820 0x7f9fd01a7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 -- 172.21.15.37:0/2429150727 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd01a82c0 con 0x7f9fd0104ec0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.864+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01a0cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009850 tx=0x7f9fc0003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.865+0000 7f9fcdffb640 1 -- 172.21.15.37:0/2429150727 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc003f070 con 0x7f9fd0104ec0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.865+0000 7f9fcdffb640 1 -- 172.21.15.37:0/2429150727 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc0031d60 con 0x7f9fd0104ec0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.865+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd01a8550 con 0x7f9fd0104ec0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.865+0000 7f9fcdffb640 1 -- 172.21.15.37:0/2429150727 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0035030 con 0x7f9fd0104ec0 2024-05-09T01:10:32.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.865+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a8a40 con 0x7f9fd0104ec0 2024-05-09T01:10:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.868+0000 7f9fcdffb640 1 -- 172.21.15.37:0/2429150727 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9fc0042070 con 0x7f9fd0104ec0 2024-05-09T01:10:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.869+0000 7f9fcdffb640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9fb80b27e0 0x7f9fb80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.869+0000 7f9fcdffb640 1 -- 172.21.15.37:0/2429150727 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9fc0102f20 con 0x7f9fd0104ec0 2024-05-09T01:10:32.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.870+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9fb80b27e0 0x7f9fb80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.871+0000 7f9fddbe5740 1 Processor -- start 2024-05-09T01:10:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.871+0000 7f9fddbe5740 1 -- start start 2024-05-09T01:10:32.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.871+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9fb80b27e0 0x7f9fb80b4cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4005d00 tx=0x7f9fc400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf5f1b0 0x5555eb303500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf362f0 0x5555eb303a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb30a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5555eb2677c0 con 0x5555eaf5f1b0 2024-05-09T01:10:32.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fd4ad0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf5f1b0 0x5555eb303500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5555eb2030e0 con 0x5555eaf3e4d0 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf362f0 0x5555eb303a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5555eb263780 con 0x5555eaf362f0 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fd4ad0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf5f1b0 0x5555eb303500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42112/0 (socket says 172.21.15.37:42112) 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf362f0 0x5555eb303a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42610/0 (socket says 172.21.15.37:42610) 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fd4ad0640 1 -- 172.21.15.37:0/1726617630 learned_addr learned my addr 172.21.15.37:0/1726617630 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb30a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fcffff640 1 -- 172.21.15.37:0/1726617630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 msgr2=0x5555eb30a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fcffff640 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb30a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fcffff640 1 -- 172.21.15.37:0/1726617630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf5f1b0 msgr2=0x5555eb303500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fcffff640 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf5f1b0 0x5555eb303500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fcffff640 1 -- 172.21.15.37:0/1726617630 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555eb22c7c0 con 0x5555eaf362f0 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb30a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:32.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.872+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf5f1b0 0x5555eb303500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.873+0000 7f9fcffff640 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf362f0 0x5555eb303a80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0100b10 tx=0x7f9fc0005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2e563a1584dda00 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.873+0000 7f9fb6ffd640 1 -- 172.21.15.37:0/1726617630 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0049070 con 0x5555eaf362f0 2024-05-09T01:10:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.873+0000 7f9fb6ffd640 1 -- 172.21.15.37:0/1726617630 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc00d3440 con 0x5555eaf362f0 2024-05-09T01:10:32.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.873+0000 7f9fb6ffd640 1 -- 172.21.15.37:0/1726617630 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00ca8f0 con 0x5555eaf362f0 2024-05-09T01:10:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1726617630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf362f0 msgr2=0x5555eb303a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf362f0 0x5555eb303a80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0100b10 tx=0x7f9fc0005de0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1726617630 shutdown_connections 2024-05-09T01:10:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb30a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf362f0 0x5555eb303a80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1726617630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf5f1b0 0x5555eb303500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1726617630 >> 172.21.15.37:0/1726617630 conn(0x5555eaf53300 msgr2=0x5555eb2fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1726617630 shutdown_connections 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.874+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1726617630 wait complete. 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.875+0000 7f9fddbe5740 1 -- start start 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.875+0000 7f9fddbe5740 1 Processor -- start 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb30d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb30d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb314510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5555eb30b190 con 0x5555eaf3e4d0 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb30d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb30d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb30d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42130/0 (socket says 172.21.15.37:42130) 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb30d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42126/0 (socket says 172.21.15.37:42126) 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 -- 172.21.15.37:0/2885156371 learned_addr learned my addr 172.21.15.37:0/2885156371 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5555eb1ee9c0 con 0x5555eaf362f0 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5555eb30b310 con 0x5555eaf5f1b0 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fddbe5740 10 client.0 _ll_register_callbacks cb 0x5555eb21b020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb314510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 -- 172.21.15.37:0/2885156371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 msgr2=0x5555eb314510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb314510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 -- 172.21.15.37:0/2885156371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 msgr2=0x5555eb30d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb30d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fd4ad0640 1 -- 172.21.15.37:0/2885156371 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555eb2151f0 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.876+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb30d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb30d0e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40117a0 tx=0x7f9fc4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3318275221459d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9faffff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9faffff640 1 -- 172.21.15.37:0/2885156371 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc401fb30 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9faffff640 1 -- 172.21.15.37:0/2885156371 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9fc401fcd0 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc00d3440 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9faffff640 1 -- 172.21.15.37:0/2885156371 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9fc4028440 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9fddbe5740 10 client.26576 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5555eafca790 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.877+0000 7f9faffff640 1 -- 172.21.15.37:0/2885156371 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc00d3440 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9faffff640 1 -- 172.21.15.37:0/2885156371 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f9fc4026070 con 0x5555eaf362f0 2024-05-09T01:10:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fddbe5740 10 client.26576 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fddbe5740 10 client.26576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fddbe5740 20 client.26576 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaf1dd80 0x5555eb31aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fddbe5740 4 client.26576 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555eb2753d0 con 0x5555eaf1dd80 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaf1dd80 0x5555eb31aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaf1dd80 0x5555eb31aa50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54261c16d3654090 server_cookie=64c3685f9ee6b9b5 in_seq=0 out_seq=0 2024-05-09T01:10:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.878+0000 7f9faffff640 10 client.26576 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.879+0000 7f9faffff640 1 -- 172.21.15.37:0/2885156371 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5555eb2753d0 con 0x5555eaf1dd80 2024-05-09T01:10:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.879+0000 7f9faffff640 10 client.26576 handle_command_reply: tid=0 2024-05-09T01:10:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.879+0000 7f9fddbe5740 1 client.26576 shutdown 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.880+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 msgr2=0x5555eb30d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.881+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb30d0e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40117a0 tx=0x7f9fc4004730 comp rx=0 tx=0).stop 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.881+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 shutdown_connections 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.881+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaf1dd80 0x5555eb31aa50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.881+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb314510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.881+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb30d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.882+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2885156371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb30d0e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.882+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 >> 172.21.15.37:0/2885156371 conn(0x5555eaf53300 msgr2=0x5555eb2fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.882+0000 7f9faffff640 0 client.26576 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.882+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 shutdown_connections 2024-05-09T01:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.882+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2885156371 wait complete. 2024-05-09T01:10:32.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.882+0000 7f9fddbe5740 20 client.26576 trim_cache size 0 max 16384 2024-05-09T01:10:32.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 Processor -- start 2024-05-09T01:10:32.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 -- start start 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf362f0 0x5555eb2fde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb3144a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb3149e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b16b0 con 0x5555eaf362f0 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b3280 con 0x5555eaf3e4d0 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b1d80 con 0x5555eaf5f1b0 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb3144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb3144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42142/0 (socket says 172.21.15.37:42142) 2024-05-09T01:10:32.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.901+0000 7f9fcffff640 1 -- 172.21.15.37:0/2202656492 learned_addr learned my addr 172.21.15.37:0/2202656492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb3149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf362f0 0x5555eb2fde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fcffff640 1 -- 172.21.15.37:0/2202656492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 msgr2=0x5555eb3149e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb3149e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fcffff640 1 -- 172.21.15.37:0/2202656492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf362f0 msgr2=0x5555eb2fde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf362f0 0x5555eb2fde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fcffff640 1 -- 172.21.15.37:0/2202656492 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555eb0415f0 con 0x5555eaf3e4d0 2024-05-09T01:10:32.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb3149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.902+0000 7f9fcffff640 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb3144a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ca390 tx=0x7f9fc00ed040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b61543f187b27f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.903+0000 7f9fb67fc640 1 -- 172.21.15.37:0/2202656492 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0049070 con 0x5555eaf3e4d0 2024-05-09T01:10:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.903+0000 7f9fb67fc640 1 -- 172.21.15.37:0/2202656492 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc00b20b0 con 0x5555eaf3e4d0 2024-05-09T01:10:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.903+0000 7f9fb67fc640 1 -- 172.21.15.37:0/2202656492 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00cab50 con 0x5555eaf3e4d0 2024-05-09T01:10:32.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2202656492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 msgr2=0x5555eb3144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb3144a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ca390 tx=0x7f9fc00ed040 comp rx=0 tx=0).stop 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2202656492 shutdown_connections 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb3149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf3e4d0 0x5555eb3144a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/2202656492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf362f0 0x5555eb2fde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2202656492 >> 172.21.15.37:0/2202656492 conn(0x5555eaf53300 msgr2=0x5555eb2fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2202656492 shutdown_connections 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 -- 172.21.15.37:0/2202656492 wait complete. 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 -- start start 2024-05-09T01:10:32.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.904+0000 7f9fddbe5740 1 Processor -- start 2024-05-09T01:10:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb311aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb311fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fddbe5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb380df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b2bb0 con 0x5555eaf3e4d0 2024-05-09T01:10:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fddbe5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b24e0 con 0x5555eaf362f0 2024-05-09T01:10:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb311fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fd52d1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb380df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fd52d1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb380df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42636/0 (socket says 172.21.15.37:42636) 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fd4ad0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb311aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fd52d1640 1 -- 172.21.15.37:0/1646236076 learned_addr learned my addr 172.21.15.37:0/1646236076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01af690 con 0x5555eaf5f1b0 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fddbe5740 10 client.0 _ll_register_callbacks cb 0x7f9fc4011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.905+0000 7f9fd52d1640 1 -- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 msgr2=0x5555eb311aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb311aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fd52d1640 1 -- 172.21.15.37:0/1646236076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 msgr2=0x5555eb311fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb311fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fd52d1640 1 -- 172.21.15.37:0/1646236076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555eb22bed0 con 0x5555eaf5f1b0 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb311aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fd52d1640 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb380df0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80042c0 tx=0x7f9fc8003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f974c097da5145f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:32.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9faffff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9faffff640 1 -- 172.21.15.37:0/1646236076 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8022060 con 0x5555eaf5f1b0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc00b20b0 con 0x5555eaf5f1b0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9faffff640 1 -- 172.21.15.37:0/1646236076 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9fc8012bb0 con 0x5555eaf5f1b0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9faffff640 1 -- 172.21.15.37:0/1646236076 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9fc8012db0 con 0x5555eaf5f1b0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fddbe5740 10 client.26557 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.906+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5555eb382570 con 0x5555eaf5f1b0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9faffff640 1 -- 172.21.15.37:0/1646236076 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc00b20b0 con 0x5555eaf5f1b0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9faffff640 1 -- 172.21.15.37:0/1646236076 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f9fc8027070 con 0x5555eaf5f1b0 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9fddbe5740 10 client.26557 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9fddbe5740 10 client.26557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9fddbe5740 20 client.26557 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaef31c0 0x5555eb384eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9fddbe5740 4 client.26557 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:10:32.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5555eb26f240 con 0x5555eaef31c0 2024-05-09T01:10:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.907+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaef31c0 0x5555eb384eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.908+0000 7f9faffff640 10 client.26557 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:32.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.908+0000 7f9fd4ad0640 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaef31c0 0x5555eb384eb0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99db65a83e730592 server_cookie=5df678c9c90faf5f in_seq=0 out_seq=0 2024-05-09T01:10:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.919+0000 7f9faffff640 1 -- 172.21.15.37:0/1646236076 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5555eb26f240 con 0x5555eaef31c0 2024-05-09T01:10:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.919+0000 7f9faffff640 10 client.26557 handle_command_reply: tid=0 2024-05-09T01:10:32.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.919+0000 7f9fddbe5740 1 client.26557 shutdown 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.919+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 msgr2=0x5555eb380df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.919+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb380df0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80042c0 tx=0x7f9fc8003f90 comp rx=0 tx=0).stop 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 shutdown_connections 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5555eaef31c0 0x5555eb384eb0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555eaf5f1b0 0x5555eb380df0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5555eaf3e4d0 0x5555eb311fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9faffff640 0 client.26557 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 --2- 172.21.15.37:0/1646236076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5555eaf362f0 0x5555eb311aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 >> 172.21.15.37:0/1646236076 conn(0x5555eaf53300 msgr2=0x5555eb2fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 shutdown_connections 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 1 -- 172.21.15.37:0/1646236076 wait complete. 2024-05-09T01:10:32.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.920+0000 7f9fddbe5740 20 client.26557 trim_cache size 0 max 16384 2024-05-09T01:10:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:10:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:10:32.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:10:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9fb80b27e0 msgr2=0x7f9fb80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9fb80b27e0 0x7f9fb80b4cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4005d00 tx=0x7f9fc400b410 comp rx=0 tx=0).stop 2024-05-09T01:10:32.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 msgr2=0x7f9fd01a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01a0cc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009850 tx=0x7f9fc0003f80 comp rx=0 tx=0).stop 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 shutdown_connections 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fd0107820 0x7f9fd01a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0104ec0 0x7f9fd01a0cc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f9fb80b27e0 0x7f9fb80b4cf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 --2- 172.21.15.37:0/2429150727 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fd0102560 0x7f9fd01a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 >> 172.21.15.37:0/2429150727 conn(0x7f9fd00fdd90 msgr2=0x7f9fd0102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 shutdown_connections 2024-05-09T01:10:32.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:32.921+0000 7f9fd6d34640 1 -- 172.21.15.37:0/2429150727 wait complete. 2024-05-09T01:10:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:34 smithi136 ceph-mon[34110]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 714 op/s 2024-05-09T01:10:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:34 smithi037 ceph-mon[30122]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 714 op/s 2024-05-09T01:10:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:34 smithi151 ceph-mon[34780]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 714 op/s 2024-05-09T01:10:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 495.0 s, 1786.0 tps, lat 56.132 ms stddev 63.128 2024-05-09T01:10:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:36 smithi136 ceph-mon[34110]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 710 op/s 2024-05-09T01:10:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:36 smithi037 ceph-mon[30122]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 710 op/s 2024-05-09T01:10:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:36 smithi151 ceph-mon[34780]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 710 op/s 2024-05-09T01:10:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:38 smithi136 ceph-mon[34110]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-05-09T01:10:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:10:38.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:10:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:10:38.630 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:38 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:10:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:38 smithi037 ceph-mon[30122]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:38 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:38 smithi151 ceph-mon[34780]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:10:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:38 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:10:39.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:39 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:10:39.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:39 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:10:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:39 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:10:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 500.0 s, 2503.6 tps, lat 39.673 ms stddev 44.981 2024-05-09T01:10:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:40 smithi136 ceph-mon[34110]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.9 MiB/s wr, 689 op/s 2024-05-09T01:10:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:40 smithi037 ceph-mon[30122]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.9 MiB/s wr, 689 op/s 2024-05-09T01:10:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:40 smithi151 ceph-mon[34780]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.9 MiB/s wr, 689 op/s 2024-05-09T01:10:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:42 smithi136 ceph-mon[34110]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.6 MiB/s wr, 746 op/s 2024-05-09T01:10:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:42 smithi037 ceph-mon[30122]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.6 MiB/s wr, 746 op/s 2024-05-09T01:10:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:42 smithi151 ceph-mon[34780]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.6 MiB/s wr, 746 op/s 2024-05-09T01:10:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:44 smithi136 ceph-mon[34110]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 710 op/s 2024-05-09T01:10:44.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:44 smithi037 ceph-mon[30122]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 710 op/s 2024-05-09T01:10:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:44 smithi151 ceph-mon[34780]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 710 op/s 2024-05-09T01:10:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 505.0 s, 1876.2 tps, lat 53.525 ms stddev 62.374 2024-05-09T01:10:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.058+0000 7f3d5c100640 1 -- 172.21.15.37:0/3622509151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541087e0 msgr2=0x7f3d5410acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.058+0000 7f3d5c100640 1 --2- 172.21.15.37:0/3622509151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541087e0 0x7f3d5410acd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009ca0 tx=0x7f3d4c02a8c0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.058+0000 7f3d5c100640 1 -- 172.21.15.37:0/3622509151 shutdown_connections 2024-05-09T01:10:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.058+0000 7f3d5c100640 1 --2- 172.21.15.37:0/3622509151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541087e0 0x7f3d5410acd0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.058+0000 7f3d5c100640 1 --2- 172.21.15.37:0/3622509151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d54105d50 0x7f3d54108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.058+0000 7f3d5c100640 1 --2- 172.21.15.37:0/3622509151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d541033f0 0x7f3d54105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.058+0000 7f3d5c100640 1 -- 172.21.15.37:0/3622509151 >> 172.21.15.37:0/3622509151 conn(0x7f3d540fd080 msgr2=0x7f3d540ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.059+0000 7f3d5c100640 1 -- 172.21.15.37:0/3622509151 shutdown_connections 2024-05-09T01:10:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.059+0000 7f3d5c100640 1 -- 172.21.15.37:0/3622509151 wait complete. 2024-05-09T01:10:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.060+0000 7f3d5c100640 1 Processor -- start 2024-05-09T01:10:46.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.060+0000 7f3d5c100640 1 -- start start 2024-05-09T01:10:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d5c100640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541033f0 0x7f3d54199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d5c100640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d54105d50 0x7f3d54199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d5c100640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d541087e0 0x7f3d541a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d59e9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541033f0 0x7f3d54199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d5c100640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410e650 con 0x7f3d541033f0 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d59e9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541033f0 0x7f3d54199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49562/0 (socket says 172.21.15.37:49562) 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d59e9c640 1 -- 172.21.15.37:0/4142485878 learned_addr learned my addr 172.21.15.37:0/4142485878 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.061+0000 7f3d5969b640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d54105d50 0x7f3d54199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.062+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d541087e0 0x7f3d541a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.062+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410e4d0 con 0x7f3d541087e0 2024-05-09T01:10:46.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.062+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410e7d0 con 0x7f3d54105d50 2024-05-09T01:10:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.063+0000 7f3d59e9c640 1 -- 172.21.15.37:0/4142485878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d54105d50 msgr2=0x7f3d54199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.063+0000 7f3d59e9c640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d54105d50 0x7f3d54199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.063+0000 7f3d59e9c640 1 -- 172.21.15.37:0/4142485878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d541087e0 msgr2=0x7f3d541a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.063+0000 7f3d59e9c640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d541087e0 0x7f3d541a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.063+0000 7f3d59e9c640 1 -- 172.21.15.37:0/4142485878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d54101e10 con 0x7f3d541033f0 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.063+0000 7f3d59e9c640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541033f0 0x7f3d54199220 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000ead0 tx=0x7f3d5000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.063+0000 7f3d4affd640 1 -- 172.21.15.37:0/4142485878 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5000bbd0 con 0x7f3d541033f0 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.064+0000 7f3d4affd640 1 -- 172.21.15.37:0/4142485878 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d5000bd70 con 0x7f3d541033f0 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.064+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d54102100 con 0x7f3d541033f0 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.064+0000 7f3d4affd640 1 -- 172.21.15.37:0/4142485878 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50017410 con 0x7f3d541033f0 2024-05-09T01:10:46.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.064+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541026a0 con 0x7f3d541033f0 2024-05-09T01:10:46.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.068+0000 7f3d4affd640 1 -- 172.21.15.37:0/4142485878 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3d500175b0 con 0x7f3d541033f0 2024-05-09T01:10:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.068+0000 7f3d62fb5740 1 Processor -- start 2024-05-09T01:10:46.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.069+0000 7f3d62fb5740 1 -- start start 2024-05-09T01:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.069+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f12500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.069+0000 7f3d4affd640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d400b2930 0x7f3d400b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.069+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.069+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f19980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f12500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f12500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37136/0 (socket says 172.21.15.37:37136) 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3503982401 learned_addr learned my addr 172.21.15.37:0/3503982401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f214e767c0 con 0x55f214b4d4d0 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f214e120e0 con 0x55f214b6e1b0 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f214e72780 con 0x55f214b452f0 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f19980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3503982401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 msgr2=0x55f214f12a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f12a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3503982401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 msgr2=0x55f214f19980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f19980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3503982401 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f214e3b7c0 con 0x55f214b6e1b0 2024-05-09T01:10:46.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f12500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c02f540 tx=0x7f3d4c031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbb61936b18de0c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:46.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.070+0000 7f3d59e9c640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d400b2930 0x7f3d400b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.071+0000 7f3d3ffff640 1 -- 172.21.15.37:0/3503982401 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c032ce0 con 0x55f214b6e1b0 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.071+0000 7f3d3ffff640 1 -- 172.21.15.37:0/3503982401 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d4c036040 con 0x55f214b6e1b0 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.071+0000 7f3d4affd640 1 -- 172.21.15.37:0/4142485878 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3d500e1cf0 con 0x7f3d541033f0 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.071+0000 7f3d3ffff640 1 -- 172.21.15.37:0/3503982401 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c003bd0 con 0x55f214b6e1b0 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d59e9c640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d400b2930 0x7f3d400b4e40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3d500a6580 tx=0x7f3d500a5250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 msgr2=0x55f214f12500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f12500 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c02f540 tx=0x7f3d4c031a20 comp rx=0 tx=0).stop 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 shutdown_connections 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f19980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3503982401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f12500 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 >> 172.21.15.37:0/3503982401 conn(0x55f214b62300 msgr2=0x55f214f0de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 shutdown_connections 2024-05-09T01:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3503982401 wait complete. 2024-05-09T01:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 -- start start 2024-05-09T01:10:46.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.073+0000 7f3d62fb5740 1 Processor -- start 2024-05-09T01:10:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.074+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f1c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.074+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f1c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f1c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d62fb5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f214f1a1f0 con 0x55f214b4d4d0 2024-05-09T01:10:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d62fb5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f214dfd9c0 con 0x55f214b6e1b0 2024-05-09T01:10:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d62fb5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f214f1a370 con 0x55f214b452f0 2024-05-09T01:10:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f1c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34118/0 (socket says 172.21.15.37:34118) 2024-05-09T01:10:46.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d62fb5740 10 client.0 _ll_register_callbacks cb 0x55f214e2a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3274969063 learned_addr learned my addr 172.21.15.37:0/3274969063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5969b640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f1c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 msgr2=0x55f214f23590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3274969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 msgr2=0x55f214f1c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f1c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5a69d640 1 -- 172.21.15.37:0/3274969063 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f214e241f0 con 0x55f214b452f0 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.075+0000 7f3d5969b640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f1c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f1c0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c031980 tx=0x7f3d4c02adc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7563a369eb6e3b4c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/3274969063 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c003d80 con 0x55f214b452f0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/3274969063 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3d4c004040 con 0x55f214b452f0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d4c036040 con 0x55f214b452f0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/3274969063 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3d4c004240 con 0x55f214b452f0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d62fb5740 10 client.26566 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.076+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55f214bd9790 con 0x55f214b452f0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/3274969063 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d4c036040 con 0x55f214b452f0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/3274969063 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f3d4c02fcb0 con 0x55f214b452f0 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d62fb5740 10 client.26566 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d62fb5740 10 client.26566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d62fb5740 20 client.26566 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b2cd80 0x55f214f31e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d62fb5740 4 client.26566 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f214e843d0 con 0x55f214b2cd80 2024-05-09T01:10:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.077+0000 7f3d5969b640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b2cd80 0x55f214f31e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.078+0000 7f3d5969b640 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b2cd80 0x55f214f31e60 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd4b91096312989b server_cookie=5fe924c587375c37 in_seq=0 out_seq=0 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.078+0000 7f3d3d7fa640 10 client.26566 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.079+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/3274969063 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f214e843d0 con 0x55f214b2cd80 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.079+0000 7f3d3d7fa640 10 client.26566 handle_command_reply: tid=0 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.079+0000 7f3d62fb5740 1 client.26566 shutdown 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 msgr2=0x55f214f1c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f1c0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c031980 tx=0x7f3d4c02adc0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 shutdown_connections 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b2cd80 0x55f214f31e60 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b4d4d0 0x55f214f1c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/3274969063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f1c0f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 >> 172.21.15.37:0/3274969063 conn(0x55f214b62300 msgr2=0x55f214f10da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d3d7fa640 0 client.26566 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 shutdown_connections 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 1 -- 172.21.15.37:0/3274969063 wait complete. 2024-05-09T01:10:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.080+0000 7f3d62fb5740 20 client.26566 trim_cache size 0 max 16384 2024-05-09T01:10:46.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.109+0000 7f3d62fb5740 1 Processor -- start 2024-05-09T01:10:46.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.112+0000 7f3d62fb5740 1 -- start start 2024-05-09T01:10:46.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.112+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b452f0 0x55f214f37610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b4d4d0 0x55f214f37b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d62fb5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541a9020 con 0x55f214b452f0 2024-05-09T01:10:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d5969b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b4d4d0 0x55f214f37b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d5969b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b4d4d0 0x55f214f37b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34122/0 (socket says 172.21.15.37:34122) 2024-05-09T01:10:46.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d5969b640 1 -- 172.21.15.37:0/232415617 learned_addr learned my addr 172.21.15.37:0/232415617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d62fb5740 1 -- 172.21.15.37:0/232415617 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541aabf0 con 0x55f214b6e1b0 2024-05-09T01:10:46.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.113+0000 7f3d62fb5740 1 -- 172.21.15.37:0/232415617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541a96f0 con 0x55f214b4d4d0 2024-05-09T01:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.114+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b452f0 0x55f214f37610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.114+0000 7f3d5969b640 1 -- 172.21.15.37:0/232415617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 msgr2=0x55f214f23520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.114+0000 7f3d5969b640 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.114+0000 7f3d5969b640 1 -- 172.21.15.37:0/232415617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b452f0 msgr2=0x55f214f37610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.114+0000 7f3d5969b640 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b452f0 0x55f214f37610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.114+0000 7f3d5969b640 1 -- 172.21.15.37:0/232415617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f214c505f0 con 0x55f214b4d4d0 2024-05-09T01:10:46.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.114+0000 7f3d5969b640 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b4d4d0 0x55f214f37b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55f214f138e0 tx=0x7f3d440138d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86527c5a097c5557 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.117+0000 7f3d3f7fe640 1 -- 172.21.15.37:0/232415617 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44004250 con 0x55f214b4d4d0 2024-05-09T01:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.117+0000 7f3d3f7fe640 1 -- 172.21.15.37:0/232415617 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d44025070 con 0x55f214b4d4d0 2024-05-09T01:10:46.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.117+0000 7f3d3f7fe640 1 -- 172.21.15.37:0/232415617 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44003970 con 0x55f214b4d4d0 2024-05-09T01:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.119+0000 7f3d62fb5740 1 -- 172.21.15.37:0/232415617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b4d4d0 msgr2=0x55f214f37b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.119+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b4d4d0 0x55f214f37b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55f214f138e0 tx=0x7f3d440138d0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.123+0000 7f3d62fb5740 1 -- 172.21.15.37:0/232415617 shutdown_connections 2024-05-09T01:10:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.123+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b6e1b0 0x55f214f23520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.123+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b4d4d0 0x55f214f37b50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.123+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/232415617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b452f0 0x55f214f37610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.124+0000 7f3d62fb5740 1 -- 172.21.15.37:0/232415617 >> 172.21.15.37:0/232415617 conn(0x55f214b62300 msgr2=0x55f214f166a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.124+0000 7f3d62fb5740 1 -- 172.21.15.37:0/232415617 shutdown_connections 2024-05-09T01:10:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.124+0000 7f3d62fb5740 1 -- 172.21.15.37:0/232415617 wait complete. 2024-05-09T01:10:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.124+0000 7f3d62fb5740 1 -- start start 2024-05-09T01:10:46.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.125+0000 7f3d62fb5740 1 Processor -- start 2024-05-09T01:10:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.125+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f20e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b4d4d0 0x55f214f21390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d62fb5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b6e1b0 0x55f214f981b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d5a69d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f20e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d5a69d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f20e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34130/0 (socket says 172.21.15.37:34130) 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d5969b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b4d4d0 0x55f214f21390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d5969b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b4d4d0 0x55f214f21390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37154/0 (socket says 172.21.15.37:37154) 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d5a69d640 1 -- 172.21.15.37:0/1358950224 learned_addr learned my addr 172.21.15.37:0/1358950224 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541aa520 con 0x55f214b6e1b0 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541a9e50 con 0x55f214b4d4d0 2024-05-09T01:10:46.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.126+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541a7000 con 0x55f214b452f0 2024-05-09T01:10:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d62fb5740 10 client.0 _ll_register_callbacks cb 0x7f3d44005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d5a69d640 1 -- 172.21.15.37:0/1358950224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b4d4d0 msgr2=0x55f214f21390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b4d4d0 0x55f214f21390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d5a69d640 1 -- 172.21.15.37:0/1358950224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b6e1b0 msgr2=0x55f214f981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b6e1b0 0x55f214f981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d5a69d640 1 -- 172.21.15.37:0/1358950224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f214e3aed0 con 0x55f214b452f0 2024-05-09T01:10:46.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d44025070 con 0x55f214b452f0 2024-05-09T01:10:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d5a69d640 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f20e50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c002230 tx=0x7f3d4c005c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6d0292c3d41299c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.127+0000 7f3d3d7fa640 10 client.26572 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.129+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/1358950224 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c067050 con 0x55f214b452f0 2024-05-09T01:10:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.129+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/1358950224 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3d4c0043e0 con 0x55f214b452f0 2024-05-09T01:10:46.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.129+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/1358950224 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f3d4c0045e0 con 0x55f214b452f0 2024-05-09T01:10:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.129+0000 7f3d62fb5740 10 client.26572 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:46.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.129+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55f214f996f0 con 0x55f214b452f0 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.136+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/1358950224 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f3d4c060070 con 0x55f214b452f0 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.136+0000 7f3d62fb5740 10 client.26572 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.136+0000 7f3d62fb5740 10 client.26572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.136+0000 7f3d62fb5740 20 client.26572 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.136+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b021c0 0x55f214f9bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.136+0000 7f3d62fb5740 4 client.26572 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.137+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f3d44025070 con 0x55f214b021c0 2024-05-09T01:10:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.137+0000 7f3d5969b640 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b021c0 0x55f214f9bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.143+0000 7f3d5969b640 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b021c0 0x55f214f9bfd0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff304b1b7a7eae2 server_cookie=c4c709eebba144c6 in_seq=0 out_seq=0 2024-05-09T01:10:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.143+0000 7f3d3d7fa640 10 client.26572 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.177+0000 7f3d3d7fa640 1 -- 172.21.15.37:0/1358950224 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f3d44025070 con 0x55f214b021c0 2024-05-09T01:10:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.177+0000 7f3d3d7fa640 10 client.26572 handle_command_reply: tid=0 2024-05-09T01:10:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.177+0000 7f3d62fb5740 1 client.26572 shutdown 2024-05-09T01:10:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.177+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 msgr2=0x55f214f20e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.177+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f20e50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c002230 tx=0x7f3d4c005c60 comp rx=0 tx=0).stop 2024-05-09T01:10:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 shutdown_connections 2024-05-09T01:10:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55f214b021c0 0x55f214f9bfd0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f214b6e1b0 0x55f214f981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f214b4d4d0 0x55f214f21390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 --2- 172.21.15.37:0/1358950224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f214b452f0 0x55f214f20e50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 >> 172.21.15.37:0/1358950224 conn(0x55f214b62300 msgr2=0x55f214f1bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d3d7fa640 0 client.26572 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 shutdown_connections 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 1 -- 172.21.15.37:0/1358950224 wait complete. 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.178+0000 7f3d62fb5740 20 client.26572 trim_cache size 0 max 16384 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:10:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:10:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:10:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d400b2930 msgr2=0x7f3d400b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d400b2930 0x7f3d400b4e40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3d500a6580 tx=0x7f3d500a5250 comp rx=0 tx=0).stop 2024-05-09T01:10:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541033f0 msgr2=0x7f3d54199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541033f0 0x7f3d54199220 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000ead0 tx=0x7f3d5000ef90 comp rx=0 tx=0).stop 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 shutdown_connections 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d400b2930 0x7f3d400b4e40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d541087e0 0x7f3d541a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d54105d50 0x7f3d54199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 --2- 172.21.15.37:0/4142485878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d541033f0 0x7f3d54199220 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 >> 172.21.15.37:0/4142485878 conn(0x7f3d540fd080 msgr2=0x7f3d54103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 shutdown_connections 2024-05-09T01:10:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:46.179+0000 7f3d5c100640 1 -- 172.21.15.37:0/4142485878 wait complete. 2024-05-09T01:10:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:46 smithi136 ceph-mon[34110]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.2 MiB/s wr, 655 op/s 2024-05-09T01:10:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:46 smithi037 ceph-mon[30122]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.2 MiB/s wr, 655 op/s 2024-05-09T01:10:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:46 smithi151 ceph-mon[34780]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.2 MiB/s wr, 655 op/s 2024-05-09T01:10:48.541 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:48 smithi037 ceph-mon[30122]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 680 op/s 2024-05-09T01:10:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:48 smithi136 ceph-mon[34110]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 680 op/s 2024-05-09T01:10:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:48 smithi151 ceph-mon[34780]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 680 op/s 2024-05-09T01:10:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 510.0 s, 2134.0 tps, lat 46.121 ms stddev 53.630 2024-05-09T01:10:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:50 smithi136 ceph-mon[34110]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 653 op/s 2024-05-09T01:10:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:50 smithi037 ceph-mon[30122]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 653 op/s 2024-05-09T01:10:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:50 smithi151 ceph-mon[34780]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 653 op/s 2024-05-09T01:10:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:52 smithi136 ceph-mon[34110]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 685 op/s 2024-05-09T01:10:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:52 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:10:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:52 smithi037 ceph-mon[30122]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 685 op/s 2024-05-09T01:10:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:52 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:10:52.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:52 smithi151 ceph-mon[34780]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 685 op/s 2024-05-09T01:10:52.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:52 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:10:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:54 smithi136 ceph-mon[34110]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.4 MiB/s wr, 647 op/s 2024-05-09T01:10:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:54 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:54 smithi037 ceph-mon[30122]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.4 MiB/s wr, 647 op/s 2024-05-09T01:10:54.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:54 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:54 smithi151 ceph-mon[34780]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.4 MiB/s wr, 647 op/s 2024-05-09T01:10:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:54 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 515.0 s, 1477.0 tps, lat 68.118 ms stddev 73.100 2024-05-09T01:10:55.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:55.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:55.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:55 smithi037 ceph-mon[30122]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-09T01:10:55.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:10:55.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:55 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:10:55.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:55.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:55.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:55 smithi151 ceph-mon[34780]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-09T01:10:55.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:10:55.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:55 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:10:56.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:56.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:56.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:55 smithi136 ceph-mon[34110]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-09T01:10:56.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:10:56.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:55 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:10:56.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:56.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:56 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:57.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:56 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:10:57.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:10:57 smithi037 ceph-mon[30122]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 664 op/s 2024-05-09T01:10:57.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:10:57 smithi151 ceph-mon[34780]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 664 op/s 2024-05-09T01:10:58.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:10:57 smithi136 ceph-mon[34110]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 664 op/s 2024-05-09T01:10:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.327+0000 7f04bb8ee640 1 -- 172.21.15.37:0/304754959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4108aa0 msgr2=0x7f04b410aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.327+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/304754959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4108aa0 0x7f04b410aec0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009ca0 tx=0x7f04ac02a8c0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.327+0000 7f04bb8ee640 1 -- 172.21.15.37:0/304754959 shutdown_connections 2024-05-09T01:10:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.327+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/304754959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4108aa0 0x7f04b410aec0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.327+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/304754959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b4103da0 0x7f04b41041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.327+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/304754959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b4102b60 0x7f04b4103860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.327+0000 7f04bb8ee640 1 -- 172.21.15.37:0/304754959 >> 172.21.15.37:0/304754959 conn(0x7f04b40fdd50 msgr2=0x7f04b4100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.330+0000 7f04bb8ee640 1 -- 172.21.15.37:0/304754959 shutdown_connections 2024-05-09T01:10:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.330+0000 7f04bb8ee640 1 -- 172.21.15.37:0/304754959 wait complete. 2024-05-09T01:10:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 Processor -- start 2024-05-09T01:10:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 -- start start 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b4102b60 0x7f04b419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4103da0 0x7f04b419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b4108aa0 0x7f04b41a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04b410e6c0 con 0x7f04b4103da0 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04b410e540 con 0x7f04b4102b60 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04bb8ee640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04b410e840 con 0x7f04b4108aa0 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04b8e89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4103da0 0x7f04b419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04b8e89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4103da0 0x7f04b419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50138/0 (socket says 172.21.15.37:50138) 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04b8e89640 1 -- 172.21.15.37:0/2545372085 learned_addr learned my addr 172.21.15.37:0/2545372085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b4108aa0 0x7f04b41a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.331+0000 7f04b968a640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b4102b60 0x7f04b419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b9e8b640 1 -- 172.21.15.37:0/2545372085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b4102b60 msgr2=0x7f04b419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b4102b60 0x7f04b419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b9e8b640 1 -- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4103da0 msgr2=0x7f04b419a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4103da0 0x7f04b419a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b9e8b640 1 -- 172.21.15.37:0/2545372085 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b41a1e20 con 0x7f04b4108aa0 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b968a640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b4102b60 0x7f04b419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b8e89640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4103da0 0x7f04b419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b4108aa0 0x7f04b41a17b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f04ac02aeb0 tx=0x7f04ac0316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04aa7fc640 1 -- 172.21.15.37:0/2545372085 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac003b70 con 0x7f04b4108aa0 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b41a20b0 con 0x7f04b4108aa0 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04aa7fc640 1 -- 172.21.15.37:0/2545372085 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04ac003d10 con 0x7f04b4108aa0 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04aa7fc640 1 -- 172.21.15.37:0/2545372085 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac02fae0 con 0x7f04b4108aa0 2024-05-09T01:10:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.332+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b41a2650 con 0x7f04b4108aa0 2024-05-09T01:10:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.336+0000 7f04aa7fc640 1 -- 172.21.15.37:0/2545372085 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f04ac02fc80 con 0x7f04b4108aa0 2024-05-09T01:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 Processor -- start 2024-05-09T01:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 -- start start 2024-05-09T01:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04aa7fc640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04a00b27e0 0x7f04a00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c5641b0 0x56171c908500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c53b2f0 0x56171c908a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 0x56171c90f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56171c86c7c0 con 0x56171c5434d0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56171c8080e0 con 0x56171c53b2f0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04c27a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56171c868780 con 0x56171c5641b0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04b8e89640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04a00b27e0 0x7f04a00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04aa7fc640 1 -- 172.21.15.37:0/2545372085 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f04ac103580 con 0x7f04b4108aa0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04b968a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c5641b0 0x56171c908500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04b9e8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 0x56171c90f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04b968a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c5641b0 0x56171c908500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43986/0 (socket says 172.21.15.37:43986) 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04b968a640 1 -- 172.21.15.37:0/281605937 learned_addr learned my addr 172.21.15.37:0/281605937 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.337+0000 7f04b8e89640 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c53b2f0 0x56171c908a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f04b968a640 1 -- 172.21.15.37:0/281605937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c53b2f0 msgr2=0x56171c908a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f04b968a640 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c53b2f0 0x56171c908a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f04b968a640 1 -- 172.21.15.37:0/281605937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 msgr2=0x56171c90f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f04b968a640 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 0x56171c90f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f04b968a640 1 -- 172.21.15.37:0/281605937 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171c8317c0 con 0x56171c5641b0 2024-05-09T01:10:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f04b8e89640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04a00b27e0 0x7f04a00b4cf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x56171c9098e0 tx=0x7f04a4009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f04b968a640 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c5641b0 0x56171c908500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f04b00114f0 tx=0x7f04b00119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0cdec565b7a0b96 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f049f7fe640 1 -- 172.21.15.37:0/281605937 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0005020 con 0x56171c5641b0 2024-05-09T01:10:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f049f7fe640 1 -- 172.21.15.37:0/281605937 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b00047a0 con 0x56171c5641b0 2024-05-09T01:10:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.338+0000 7f049f7fe640 1 -- 172.21.15.37:0/281605937 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b000f820 con 0x56171c5641b0 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 -- 172.21.15.37:0/281605937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c5641b0 msgr2=0x56171c908500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c5641b0 0x56171c908500 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f04b00114f0 tx=0x7f04b00119b0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 -- 172.21.15.37:0/281605937 shutdown_connections 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 0x56171c90f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c53b2f0 0x56171c908a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 --2- 172.21.15.37:0/281605937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c5641b0 0x56171c908500 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 -- 172.21.15.37:0/281605937 >> 172.21.15.37:0/281605937 conn(0x56171c558300 msgr2=0x56171c903e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 -- 172.21.15.37:0/281605937 shutdown_connections 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.339+0000 7f04c27a2740 1 -- 172.21.15.37:0/281605937 wait complete. 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.340+0000 7f04c27a2740 1 -- start start 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.340+0000 7f04c27a2740 1 Processor -- start 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.341+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c9121e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.341+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 0x56171c912720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.341+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5641b0 0x56171c919680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.341+0000 7f04c27a2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56171c9103d0 con 0x56171c5434d0 2024-05-09T01:10:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.341+0000 7f04c27a2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56171c7f39c0 con 0x56171c5641b0 2024-05-09T01:10:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.341+0000 7f04c27a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56171c910550 con 0x56171c53b2f0 2024-05-09T01:10:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.342+0000 7f04c27a2740 10 client.0 _ll_register_callbacks cb 0x56171c820020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.342+0000 7f04b9e8b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5641b0 0x56171c919680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.342+0000 7f04b968a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c9121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.342+0000 7f04b9e8b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5641b0 0x56171c919680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:53574/0 (socket says 172.21.15.37:53574) 2024-05-09T01:10:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.342+0000 7f04b9e8b640 1 -- 172.21.15.37:0/1226773941 learned_addr learned my addr 172.21.15.37:0/1226773941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04b9e8b640 1 -- 172.21.15.37:0/1226773941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 msgr2=0x56171c9121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c9121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04b9e8b640 1 -- 172.21.15.37:0/1226773941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 msgr2=0x56171c912720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 0x56171c912720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04b9e8b640 1 -- 172.21.15.37:0/1226773941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171c81a1f0 con 0x56171c5641b0 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5641b0 0x56171c919680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04ac042000 tx=0x7f04ac0ca5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d4eafbd9cbec66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f049cff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f049cff9640 1 -- 172.21.15.37:0/1226773941 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac0ca6b0 con 0x56171c5641b0 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f049cff9640 1 -- 172.21.15.37:0/1226773941 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f04ac0c6e30 con 0x56171c5641b0 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b00047a0 con 0x56171c5641b0 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f049cff9640 1 -- 172.21.15.37:0/1226773941 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f04ac0cb2a0 con 0x56171c5641b0 2024-05-09T01:10:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.343+0000 7f04c27a2740 10 client.26612 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56171c5cf790 con 0x56171c5641b0 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f049cff9640 1 -- 172.21.15.37:0/1226773941 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b00047a0 con 0x56171c5641b0 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f049cff9640 1 -- 172.21.15.37:0/1226773941 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f04ac004610 con 0x56171c5641b0 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04c27a2740 10 client.26612 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04c27a2740 10 client.26612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04c27a2740 20 client.26612 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04c27a2740 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c522d80 0x56171c91ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04c27a2740 4 client.26612 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56171c87a3d0 con 0x56171c522d80 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.344+0000 7f04b968a640 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c522d80 0x56171c91ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.345+0000 7f049cff9640 10 client.26612 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.345+0000 7f04b968a640 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c522d80 0x56171c91ce20 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adf06a5e4e041cb server_cookie=f3a1c9b7b701433b in_seq=0 out_seq=0 2024-05-09T01:10:59.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.345+0000 7f049cff9640 1 -- 172.21.15.37:0/1226773941 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56171c87a3d0 con 0x56171c522d80 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.345+0000 7f049cff9640 10 client.26612 handle_command_reply: tid=0 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.345+0000 7f04c27a2740 1 client.26612 shutdown 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5641b0 msgr2=0x56171c919680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5641b0 0x56171c919680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f04ac042000 tx=0x7f04ac0ca5b0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 shutdown_connections 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c522d80 0x56171c91ce20 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5641b0 0x56171c919680 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5434d0 0x56171c912720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f049cff9640 0 client.26612 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 --2- 172.21.15.37:0/1226773941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c9121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 >> 172.21.15.37:0/1226773941 conn(0x56171c558300 msgr2=0x56171c902700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 shutdown_connections 2024-05-09T01:10:59.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 1 -- 172.21.15.37:0/1226773941 wait complete. 2024-05-09T01:10:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.346+0000 7f04c27a2740 20 client.26612 trim_cache size 0 max 16384 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.369+0000 7f04c27a2740 1 Processor -- start 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.369+0000 7f04c27a2740 1 -- start start 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c903780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c903cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c902700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04c27a2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41a8fe0 con 0x56171c5641b0 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04c27a2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41aabb0 con 0x56171c5434d0 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04c27a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41a96b0 con 0x56171c53b2f0 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b9e8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c902700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b9e8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c902700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50172/0 (socket says 172.21.15.37:50172) 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b9e8b640 1 -- 172.21.15.37:0/4031917224 learned_addr learned my addr 172.21.15.37:0/4031917224 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b968a640 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c903780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b8e89640 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c903cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b968a640 1 -- 172.21.15.37:0/4031917224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 msgr2=0x56171c903cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b968a640 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c903cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b968a640 1 -- 172.21.15.37:0/4031917224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 msgr2=0x56171c902700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b968a640 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c902700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.370+0000 7f04b968a640 1 -- 172.21.15.37:0/4031917224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171c6465f0 con 0x56171c53b2f0 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.371+0000 7f04b968a640 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c903780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c00 tx=0x7f04b00096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5bdea74d7e2be7f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.371+0000 7f049effd640 1 -- 172.21.15.37:0/4031917224 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011050 con 0x56171c53b2f0 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.371+0000 7f049effd640 1 -- 172.21.15.37:0/4031917224 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b00111f0 con 0x56171c53b2f0 2024-05-09T01:10:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.371+0000 7f049effd640 1 -- 172.21.15.37:0/4031917224 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0004e90 con 0x56171c53b2f0 2024-05-09T01:10:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.372+0000 7f04c27a2740 1 -- 172.21.15.37:0/4031917224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 msgr2=0x56171c903780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.372+0000 7f04c27a2740 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c903780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f04b0000c00 tx=0x7f04b00096e0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 -- 172.21.15.37:0/4031917224 shutdown_connections 2024-05-09T01:10:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c902700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c903cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 --2- 172.21.15.37:0/4031917224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c903780 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 -- 172.21.15.37:0/4031917224 >> 172.21.15.37:0/4031917224 conn(0x56171c558300 msgr2=0x56171c90c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 -- 172.21.15.37:0/4031917224 shutdown_connections 2024-05-09T01:10:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 -- 172.21.15.37:0/4031917224 wait complete. 2024-05-09T01:10:59.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 -- start start 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.373+0000 7f04c27a2740 1 Processor -- start 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c918bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c915740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04c27a2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c915ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04c27a2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41aa4e0 con 0x56171c5641b0 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04c27a2740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41a9e10 con 0x56171c5434d0 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04c27a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41a6fe0 con 0x56171c53b2f0 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04c27a2740 10 client.0 _ll_register_callbacks cb 0x7f04ac009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b9e8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c915ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b968a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c918bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b9e8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c915ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50180/0 (socket says 172.21.15.37:50180) 2024-05-09T01:10:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b9e8b640 1 -- 172.21.15.37:0/175669901 learned_addr learned my addr 172.21.15.37:0/175669901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b8e89640 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c915740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b968a640 1 -- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 msgr2=0x56171c915740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b968a640 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c915740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b968a640 1 -- 172.21.15.37:0/175669901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 msgr2=0x56171c915ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b968a640 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c915ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b968a640 1 -- 172.21.15.37:0/175669901 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171c830ed0 con 0x56171c53b2f0 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b9e8b640 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c915ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f04b968a640 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c918bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56171c91b7d0 tx=0x7f04b0005000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f599d8c5386987a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.374+0000 7f049cff9640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.375+0000 7f049cff9640 1 -- 172.21.15.37:0/175669901 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0011050 con 0x56171c53b2f0 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.375+0000 7f049cff9640 1 -- 172.21.15.37:0/175669901 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f04b0029050 con 0x56171c53b2f0 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.375+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04b00111f0 con 0x56171c53b2f0 2024-05-09T01:10:59.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.375+0000 7f049cff9640 1 -- 172.21.15.37:0/175669901 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f04b0005380 con 0x56171c53b2f0 2024-05-09T01:10:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.376+0000 7f04c27a2740 10 client.26590 fetch_fsmap learned FSMap version 41 2024-05-09T01:10:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.376+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56171c9901c0 con 0x56171c53b2f0 2024-05-09T01:10:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.385+0000 7f049cff9640 1 -- 172.21.15.37:0/175669901 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b00111f0 con 0x56171c53b2f0 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.385+0000 7f049cff9640 1 -- 172.21.15.37:0/175669901 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f04b003e050 con 0x56171c53b2f0 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.387+0000 7f04c27a2740 10 client.26590 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.387+0000 7f04c27a2740 10 client.26590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.387+0000 7f04c27a2740 20 client.26590 populate_metadata read hostname 'smithi037' 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.387+0000 7f04c27a2740 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c4f81c0 0x56171c992920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.387+0000 7f04c27a2740 4 client.26590 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.387+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56171c874240 con 0x56171c4f81c0 2024-05-09T01:10:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.390+0000 7f04b8e89640 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c4f81c0 0x56171c992920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:10:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.397+0000 7f04b8e89640 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c4f81c0 0x56171c992920 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c09445e18d21bf server_cookie=b63cc538467fb3f4 in_seq=0 out_seq=0 2024-05-09T01:10:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.397+0000 7f049cff9640 10 client.26590 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:59.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f049cff9640 1 -- 172.21.15.37:0/175669901 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56171c874240 con 0x56171c4f81c0 2024-05-09T01:10:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f049cff9640 10 client.26590 handle_command_reply: tid=0 2024-05-09T01:10:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 client.26590 shutdown 2024-05-09T01:10:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 msgr2=0x56171c918bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c918bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56171c91b7d0 tx=0x7f04b0005000 comp rx=0 tx=0).stop 2024-05-09T01:10:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 shutdown_connections 2024-05-09T01:10:59.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56171c4f81c0 0x56171c992920 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f049cff9640 0 client.26590 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56171c5641b0 0x56171c915ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56171c5434d0 0x56171c915740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 --2- 172.21.15.37:0/175669901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56171c53b2f0 0x56171c918bc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 >> 172.21.15.37:0/175669901 conn(0x56171c558300 msgr2=0x56171c906d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 shutdown_connections 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.425+0000 7f04c27a2740 1 -- 172.21.15.37:0/175669901 wait complete. 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.426+0000 7f04c27a2740 20 client.26590 trim_cache size 0 max 16384 2024-05-09T01:10:59.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:10:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:10:59.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:10:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.426+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04a00b27e0 msgr2=0x7f04a00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.426+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04a00b27e0 0x7f04a00b4cf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x56171c9098e0 tx=0x7f04a4009590 comp rx=0 tx=0).stop 2024-05-09T01:10:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.426+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b4108aa0 msgr2=0x7f04b41a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:10:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.426+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b4108aa0 0x7f04b41a17b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f04ac02aeb0 tx=0x7f04ac0316f0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 shutdown_connections 2024-05-09T01:10:59.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b4108aa0 0x7f04b41a17b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04b4103da0 0x7f04b419a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f04a00b27e0 0x7f04a00b4cf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 --2- 172.21.15.37:0/2545372085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04b4102b60 0x7f04b419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 >> 172.21.15.37:0/2545372085 conn(0x7f04b40fdd50 msgr2=0x7f04b4101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 shutdown_connections 2024-05-09T01:10:59.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:10:59.427+0000 7f04bb8ee640 1 -- 172.21.15.37:0/2545372085 wait complete. 2024-05-09T01:11:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 520.0 s, 1643.8 tps, lat 61.017 ms stddev 64.409 2024-05-09T01:11:00.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:00 smithi136 ceph-mon[34110]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-05-09T01:11:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:00 smithi037 ceph-mon[30122]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-05-09T01:11:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:00 smithi151 ceph-mon[34780]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.7 MiB/s wr, 577 op/s 2024-05-09T01:11:00.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:11:01.360 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:02.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:02 smithi136 ceph-mon[34110]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 634 op/s 2024-05-09T01:11:02.521 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:02 smithi037 ceph-mon[30122]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 634 op/s 2024-05-09T01:11:02.526 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:02 smithi151 ceph-mon[34780]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 634 op/s 2024-05-09T01:11:03.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.336+0000 7fc0c8ae7700 1 -- 172.21.15.37:0/590579390 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0092e0 con 0x7fc0c4103310 2024-05-09T01:11:03.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/590579390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 msgr2=0x7fc0c410f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/590579390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 0x7fc0c410f890 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009f90 tx=0x7fc0bc00b330 comp rx=0 tx=0).stop 2024-05-09T01:11:03.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/590579390 shutdown_connections 2024-05-09T01:11:03.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/590579390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 0x7fc0c410f890 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/590579390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41089f0 0x7fc0c4108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/590579390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0c41029c0 0x7fc0c4102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/590579390 >> 172.21.15.37:0/590579390 conn(0x7fc0c40fe6f0 msgr2=0x7fc0c4100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:03.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/590579390 shutdown_connections 2024-05-09T01:11:03.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.337+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/590579390 wait complete. 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.338+0000 7fc0cbd4d700 1 Processor -- start 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.338+0000 7fc0cbd4d700 1 -- start start 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0cbd4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41029c0 0x7fc0c40febd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0cbd4d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 0x7fc0c40ff110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0cbd4d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0c41089f0 0x7fc0c40ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0cbd4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41133c0 con 0x7fc0c41029c0 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0cbd4d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4113240 con 0x7fc0c4103310 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0cbd4d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c4113540 con 0x7fc0c41089f0 2024-05-09T01:11:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41029c0 0x7fc0c40febd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41029c0 0x7fc0c40febd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50496/0 (socket says 172.21.15.37:50496) 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1469354856 learned_addr learned my addr 172.21.15.37:0/1469354856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0c41089f0 0x7fc0c40ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 0x7fc0c40ff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1469354856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0c41089f0 msgr2=0x7fc0c40ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0c41089f0 0x7fc0c40ff650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1469354856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 msgr2=0x7fc0c40ff110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 0x7fc0c40ff110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1469354856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c41a91b0 con 0x7fc0c41029c0 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.339+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41029c0 0x7fc0c40febd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000e9c0 tx=0x7fc0c000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.340+0000 7fc0baffd700 1 -- 172.21.15.37:0/1469354856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0004a30 con 0x7fc0c41029c0 2024-05-09T01:11:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.340+0000 7fc0baffd700 1 -- 172.21.15.37:0/1469354856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c000cc70 con 0x7fc0c41029c0 2024-05-09T01:11:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.340+0000 7fc0baffd700 1 -- 172.21.15.37:0/1469354856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0005510 con 0x7fc0c41029c0 2024-05-09T01:11:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.340+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c41a94a0 con 0x7fc0c41029c0 2024-05-09T01:11:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.340+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c41a9990 con 0x7fc0c41029c0 2024-05-09T01:11:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.342+0000 7fc0baffd700 1 -- 172.21.15.37:0/1469354856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc0c0021440 con 0x7fc0c41029c0 2024-05-09T01:11:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.344+0000 7fc0da763b80 1 Processor -- start 2024-05-09T01:11:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.344+0000 7fc0baffd700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc0b00b2880 0x7fc0b00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.344+0000 7fc0baffd700 1 -- 172.21.15.37:0/1469354856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc0c00e2200 con 0x7fc0c41029c0 2024-05-09T01:11:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.344+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc0b00b2880 0x7fc0b00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0da763b80 1 -- start start 2024-05-09T01:11:03.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203318d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc0b00b2880 0x7fc0b00b4d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc006130 tx=0x7fc0bc0060c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:03.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55920318d4a0 0x559203319280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x5592033132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0da763b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55920322cff0 con 0x559203277160 2024-05-09T01:11:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0da763b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5592031cb7f0 con 0x55920318d4a0 2024-05-09T01:11:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0da763b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559203228fb0 con 0x559203312eb0 2024-05-09T01:11:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203318d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.345+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203318d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50502/0 (socket says 172.21.15.37:50502) 2024-05-09T01:11:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/3695651085 learned_addr learned my addr 172.21.15.37:0/3695651085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x5592033132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55920318d4a0 0x559203319280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0c92e8700 1 -- 172.21.15.37:0/3695651085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 msgr2=0x5592033132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x5592033132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0c92e8700 1 -- 172.21.15.37:0/3695651085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 msgr2=0x559203318d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203318d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.346+0000 7fc0c92e8700 1 -- 172.21.15.37:0/3695651085 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592031c3370 con 0x55920318d4a0 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.347+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203318d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.347+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x5592033132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.347+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55920318d4a0 0x559203319280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4076210 tx=0x7fc0b4009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20a53f827f44c802 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.347+0000 7fc0affff700 1 -- 172.21.15.37:0/3695651085 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4011c80 con 0x55920318d4a0 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.347+0000 7fc0affff700 1 -- 172.21.15.37:0/3695651085 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b4011e20 con 0x55920318d4a0 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.347+0000 7fc0affff700 1 -- 172.21.15.37:0/3695651085 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4005280 con 0x55920318d4a0 2024-05-09T01:11:03.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 -- 172.21.15.37:0/3695651085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55920318d4a0 msgr2=0x559203319280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55920318d4a0 0x559203319280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4076210 tx=0x7fc0b4009f60 comp rx=0 tx=0).stop 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 -- 172.21.15.37:0/3695651085 shutdown_connections 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x5592033132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203318d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 --2- 172.21.15.37:0/3695651085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55920318d4a0 0x559203319280 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 -- 172.21.15.37:0/3695651085 >> 172.21.15.37:0/3695651085 conn(0x5592031ed6a0 msgr2=0x559203305400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.348+0000 7fc0da763b80 1 -- 172.21.15.37:0/3695651085 shutdown_connections 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.349+0000 7fc0da763b80 1 -- 172.21.15.37:0/3695651085 wait complete. 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.349+0000 7fc0da763b80 1 -- start start 2024-05-09T01:11:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.349+0000 7fc0da763b80 1 Processor -- start 2024-05-09T01:11:03.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920331ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x55920331d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0da763b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5592030a8ba0 con 0x55920318d4a0 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0da763b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5592031e7150 con 0x559203277160 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0da763b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559203313d20 con 0x559203312eb0 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920331ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920331ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50518/0 (socket says 172.21.15.37:50518) 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1148974978 learned_addr learned my addr 172.21.15.37:0/1148974978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0da763b80 10 client.0 _ll_register_callbacks cb 0x55920309e6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:03.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x55920331d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.350+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1148974978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 msgr2=0x55920331d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x55920331d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 msgr2=0x55920331cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1148974978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592030a8490 con 0x55920318d4a0 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x55920331d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920331ca20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00dfdf0 tx=0x7fc0c00a9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c4305f2f793f46 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1148974978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00a9fc0 con 0x55920318d4a0 2024-05-09T01:11:03.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1148974978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc0c0004bd0 con 0x55920318d4a0 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b4011e20 con 0x55920318d4a0 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1148974978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc0c00a98c0 con 0x55920318d4a0 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0da763b80 10 client.16809 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.351+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55920332a310 con 0x55920318d4a0 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1148974978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0b4011e20 con 0x55920318d4a0 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1148974978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fc0c00b2290 con 0x55920318d4a0 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0da763b80 10 client.16809 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0da763b80 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0da763b80 20 client.16809 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55920332c950 0x55920332ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0da763b80 4 client.16809 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55920323a9d0 con 0x55920332c950 2024-05-09T01:11:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.352+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55920332c950 0x55920332ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.353+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55920332c950 0x55920332ed70 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a78702e686481 server_cookie=45fa6b2d5f3c5062 in_seq=0 out_seq=0 2024-05-09T01:11:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.353+0000 7fc0ad7fa700 10 client.16809 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.354+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1148974978 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55920323a9d0 con 0x55920332c950 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.354+0000 7fc0ad7fa700 10 client.16809 handle_command_reply: tid=0 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.354+0000 7fc0da763b80 1 client.16809 shutdown 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 msgr2=0x55920331ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920331ca20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00dfdf0 tx=0x7fc0c00a9500 comp rx=0 tx=0).stop 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 shutdown_connections 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55920332c950 0x55920332ed70 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x55920331d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920331ca20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0ad7fa700 0 client.16809 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1148974978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 >> 172.21.15.37:0/1148974978 conn(0x5592031ed6a0 msgr2=0x5592033051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 shutdown_connections 2024-05-09T01:11:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 1 -- 172.21.15.37:0/1148974978 wait complete. 2024-05-09T01:11:03.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.355+0000 7fc0da763b80 20 client.16809 trim_cache size 0 max 16384 2024-05-09T01:11:03.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.380+0000 7fc0da763b80 1 Processor -- start 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.380+0000 7fc0da763b80 1 -- start start 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920330a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x559203328800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0da763b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ac970 con 0x55920318d4a0 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0da763b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ae540 con 0x559203277160 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0da763b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ad040 con 0x559203312eb0 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920330a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920330a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50522/0 (socket says 172.21.15.37:50522) 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/4009881776 learned_addr learned my addr 172.21.15.37:0/4009881776 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x559203328800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/4009881776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 msgr2=0x559203328800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x559203328800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/4009881776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 msgr2=0x55920331d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/4009881776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559203306d00 con 0x55920318d4a0 2024-05-09T01:11:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.381+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920330a0c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00a5940 tx=0x7fc0c00cae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9970b155058b4cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.383+0000 7fc0af7fe700 1 -- 172.21.15.37:0/4009881776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00a9210 con 0x55920318d4a0 2024-05-09T01:11:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.383+0000 7fc0af7fe700 1 -- 172.21.15.37:0/4009881776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c00b2720 con 0x55920318d4a0 2024-05-09T01:11:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.383+0000 7fc0af7fe700 1 -- 172.21.15.37:0/4009881776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00a9b20 con 0x55920318d4a0 2024-05-09T01:11:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 -- 172.21.15.37:0/4009881776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 msgr2=0x55920330a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920330a0c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc0c00a5940 tx=0x7fc0c00cae00 comp rx=0 tx=0).stop 2024-05-09T01:11:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 -- 172.21.15.37:0/4009881776 shutdown_connections 2024-05-09T01:11:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559203312eb0 0x559203328800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55920318d4a0 0x55920330a0c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 --2- 172.21.15.37:0/4009881776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203277160 0x55920331d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 -- 172.21.15.37:0/4009881776 >> 172.21.15.37:0/4009881776 conn(0x5592031ed6a0 msgr2=0x55920331b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 -- 172.21.15.37:0/4009881776 shutdown_connections 2024-05-09T01:11:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.385+0000 7fc0da763b80 1 -- 172.21.15.37:0/4009881776 wait complete. 2024-05-09T01:11:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.386+0000 7fc0da763b80 1 -- start start 2024-05-09T01:11:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.386+0000 7fc0da763b80 1 Processor -- start 2024-05-09T01:11:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.386+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55920318d4a0 0x5592033209a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.386+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203320ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0da763b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203312eb0 0x559203321420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55920318d4a0 0x5592033209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55920318d4a0 0x5592033209a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37244/0 (socket says 172.21.15.37:37244) 2024-05-09T01:11:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1341419146 learned_addr learned my addr 172.21.15.37:0/1341419146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ade70 con 0x559203277160 2024-05-09T01:11:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ad7a0 con 0x559203312eb0 2024-05-09T01:11:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c419ea50 con 0x55920318d4a0 2024-05-09T01:11:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0da763b80 10 client.0 _ll_register_callbacks cb 0x55920309e6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0ca2ea700 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203312eb0 0x559203321420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203312eb0 msgr2=0x559203321420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203312eb0 0x559203321420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1341419146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 msgr2=0x559203320ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203320ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.387+0000 7fc0c9ae9700 1 -- 172.21.15.37:0/1341419146 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592033962a0 con 0x55920318d4a0 2024-05-09T01:11:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.388+0000 7fc0c9ae9700 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55920318d4a0 0x5592033209a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0004fb0 tx=0x7fc0c00b24c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=788e8b7bca974ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.388+0000 7fc0ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.388+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1341419146 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0096060 con 0x55920318d4a0 2024-05-09T01:11:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.388+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0c00b2720 con 0x55920318d4a0 2024-05-09T01:11:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.388+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1341419146 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc0c00a8b20 con 0x55920318d4a0 2024-05-09T01:11:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.389+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1341419146 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc0c00a9210 con 0x55920318d4a0 2024-05-09T01:11:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.389+0000 7fc0da763b80 10 client.26605 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.389+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5592033962a0 con 0x55920318d4a0 2024-05-09T01:11:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.390+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1341419146 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0c00b2720 con 0x55920318d4a0 2024-05-09T01:11:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.391+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1341419146 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fc0c00a5230 con 0x55920318d4a0 2024-05-09T01:11:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.391+0000 7fc0da763b80 10 client.26605 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.391+0000 7fc0da763b80 10 client.26605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.391+0000 7fc0da763b80 20 client.26605 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.391+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592033977b0 0x559203399bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.391+0000 7fc0da763b80 4 client.26605 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:11:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.391+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559203234a70 con 0x5592033977b0 2024-05-09T01:11:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.392+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592033977b0 0x559203399bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.406+0000 7fc0ad7fa700 10 client.26605 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.406+0000 7fc0c92e8700 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592033977b0 0x559203399bd0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee85059f045fb6e server_cookie=c4c1a9b879d7d325 in_seq=0 out_seq=0 2024-05-09T01:11:03.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.408+0000 7fc0ad7fa700 1 -- 172.21.15.37:0/1341419146 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559203234a70 con 0x5592033977b0 2024-05-09T01:11:03.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.408+0000 7fc0ad7fa700 10 client.26605 handle_command_reply: tid=0 2024-05-09T01:11:03.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.408+0000 7fc0da763b80 1 client.26605 shutdown 2024-05-09T01:11:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.413+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55920318d4a0 msgr2=0x5592033209a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.413+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55920318d4a0 0x5592033209a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0004fb0 tx=0x7fc0c00b24c0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.416+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 shutdown_connections 2024-05-09T01:11:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.416+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592033977b0 0x559203399bd0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.416+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559203312eb0 0x559203321420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.416+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55920318d4a0 0x5592033209a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.416+0000 7fc0da763b80 1 --2- 172.21.15.37:0/1341419146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559203277160 0x559203320ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.416+0000 7fc0ad7fa700 0 client.26605 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:03.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.416+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 >> 172.21.15.37:0/1341419146 conn(0x5592031ed6a0 msgr2=0x559203305310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.420+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 shutdown_connections 2024-05-09T01:11:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.420+0000 7fc0da763b80 1 -- 172.21.15.37:0/1341419146 wait complete. 2024-05-09T01:11:03.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.420+0000 7fc0da763b80 20 client.26605 trim_cache size 0 max 16384 2024-05-09T01:11:03.425 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:11:03.425 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:11:03.425 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:11:03.425 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:11:03.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc0b00b2880 msgr2=0x7fc0b00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc0b00b2880 0x7fc0b00b4d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc006130 tx=0x7fc0bc0060c0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41029c0 msgr2=0x7fc0c40febd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41029c0 0x7fc0c40febd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000e9c0 tx=0x7fc0c000ecd0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 shutdown_connections 2024-05-09T01:11:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc0b00b2880 0x7fc0b00b4d90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0c41089f0 0x7fc0c40ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0c41029c0 0x7fc0c40febd0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 --2- 172.21.15.37:0/1469354856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0c4103310 0x7fc0c40ff110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.427+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 >> 172.21.15.37:0/1469354856 conn(0x7fc0c40fe6f0 msgr2=0x7fc0c41011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.428+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 shutdown_connections 2024-05-09T01:11:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:03.429+0000 7fc0cbd4d700 1 -- 172.21.15.37:0/1469354856 wait complete. 2024-05-09T01:11:04.147 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:11:04.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:11:04.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:04 smithi037 ceph-mon[30122]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 MiB/s wr, 673 op/s 2024-05-09T01:11:04.516 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:04.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:04 smithi136 ceph-mon[34110]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 MiB/s wr, 673 op/s 2024-05-09T01:11:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:04 smithi151 ceph-mon[34780]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 MiB/s wr, 673 op/s 2024-05-09T01:11:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 525.0 s, 1854.4 tps, lat 54.203 ms stddev 60.991 2024-05-09T01:11:06.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:06 smithi037 ceph-mon[30122]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-05-09T01:11:06.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:06 smithi136 ceph-mon[34110]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-05-09T01:11:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:06 smithi151 ceph-mon[34780]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-05-09T01:11:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 -- 172.21.15.37:0/2076513145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788103100 msgr2=0x7f9788103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 --2- 172.21.15.37:0/2076513145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788103100 0x7f9788103510 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9784009f90 tx=0x7f978400b330 comp rx=0 tx=0).stop 2024-05-09T01:11:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 -- 172.21.15.37:0/2076513145 shutdown_connections 2024-05-09T01:11:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 --2- 172.21.15.37:0/2076513145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788110cb0 0x7f97881130d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 --2- 172.21.15.37:0/2076513145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788103100 0x7f9788103510 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 --2- 172.21.15.37:0/2076513145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9788103a50 0x7f9788110770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 -- 172.21.15.37:0/2076513145 >> 172.21.15.37:0/2076513145 conn(0x7f97880fedc0 msgr2=0x7f97881011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.836+0000 7f9790528700 1 -- 172.21.15.37:0/2076513145 shutdown_connections 2024-05-09T01:11:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.837+0000 7f9790528700 1 -- 172.21.15.37:0/2076513145 wait complete. 2024-05-09T01:11:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.838+0000 7f9790528700 1 Processor -- start 2024-05-09T01:11:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.839+0000 7f9790528700 1 -- start start 2024-05-09T01:11:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f9790528700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788103100 0x7f978819d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f9790528700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9788103a50 0x7f978819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f9790528700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788110cb0 0x7f97881a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f978e2c4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788103100 0x7f978819d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f978e2c4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788103100 0x7f978819d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37266/0 (socket says 172.21.15.37:37266) 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f978e2c4700 1 -- 172.21.15.37:0/1509961865 learned_addr learned my addr 172.21.15.37:0/1509961865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97881166b0 con 0x7f9788103a50 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9788116530 con 0x7f9788110cb0 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f978eac5700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788110cb0 0x7f97881a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.840+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9788116830 con 0x7f9788103100 2024-05-09T01:11:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978dac3700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9788103a50 0x7f978819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978eac5700 1 -- 172.21.15.37:0/1509961865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788103100 msgr2=0x7f978819d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978eac5700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788103100 0x7f978819d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978eac5700 1 -- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9788103a50 msgr2=0x7f978819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978eac5700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9788103a50 0x7f978819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978eac5700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97881a1f10 con 0x7f9788110cb0 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978e2c4700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788103100 0x7f978819d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f978eac5700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788110cb0 0x7f97881a1870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f978000e900 tx=0x7f978000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.841+0000 7f977f7fe700 1 -- 172.21.15.37:0/1509961865 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780004220 con 0x7f9788110cb0 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.842+0000 7f977f7fe700 1 -- 172.21.15.37:0/1509961865 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97800043c0 con 0x7f9788110cb0 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.842+0000 7f977f7fe700 1 -- 172.21.15.37:0/1509961865 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780003d30 con 0x7f9788110cb0 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.842+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97881a2200 con 0x7f9788110cb0 2024-05-09T01:11:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.842+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97881a2600 con 0x7f9788110cb0 2024-05-09T01:11:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.844+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97880512c0 con 0x7f9788110cb0 2024-05-09T01:11:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.845+0000 7f977f7fe700 1 -- 172.21.15.37:0/1509961865 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f978000c7c0 con 0x7f9788110cb0 2024-05-09T01:11:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.847+0000 7f977f7fe700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97740b2980 0x7f97740b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.847+0000 7f977f7fe700 1 -- 172.21.15.37:0/1509961865 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97800e21b0 con 0x7f9788110cb0 2024-05-09T01:11:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.848+0000 7f978e2c4700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97740b2980 0x7f97740b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.849+0000 7f978e2c4700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97740b2980 0x7f97740b4e90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9784009da0 tx=0x7f9784009700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:06.851+0000 7f977f7fe700 1 -- 172.21.15.37:0/1509961865 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f97800a9ed0 con 0x7f9788110cb0 2024-05-09T01:11:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.328+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f978802e5f0 con 0x7f9788110cb0 2024-05-09T01:11:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.330+0000 7f977f7fe700 1 -- 172.21.15.37:0/1509961865 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11941 (secure 0 0 0) 0x7f97800a97d0 con 0x7f9788110cb0 2024-05-09T01:11:07.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:11:07.332 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:09:36.663141+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[0,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24454,24445,24467,24446]},"id":1}]} 2024-05-09T01:11:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97740b2980 msgr2=0x7f97740b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97740b2980 0x7f97740b4e90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9784009da0 tx=0x7f9784009700 comp rx=0 tx=0).stop 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788110cb0 msgr2=0x7f97881a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788110cb0 0x7f97881a1870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f978000e900 tx=0x7f978000ec10 comp rx=0 tx=0).stop 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 shutdown_connections 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97740b2980 0x7f97740b4e90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9788110cb0 0x7f97881a1870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9788103100 0x7f978819d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 --2- 172.21.15.37:0/1509961865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9788103a50 0x7f978819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 >> 172.21.15.37:0/1509961865 conn(0x7f97880fedc0 msgr2=0x7f97881128d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 shutdown_connections 2024-05-09T01:11:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:07.333+0000 7f9790528700 1 -- 172.21.15.37:0/1509961865 wait complete. 2024-05-09T01:11:07.336 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 41 2024-05-09T01:11:08.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:11:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:08 smithi037 ceph-mon[30122]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-05-09T01:11:08.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:08 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1509961865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:11:08.617 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:08 smithi136 ceph-mon[34110]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-05-09T01:11:08.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:08 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1509961865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:11:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:08 smithi151 ceph-mon[34780]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 657 op/s 2024-05-09T01:11:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:08 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1509961865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:11:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 530.0 s, 2308.4 tps, lat 43.013 ms stddev 58.310 2024-05-09T01:11:10.404 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:10 smithi037 ceph-mon[30122]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.8 MiB/s wr, 600 op/s 2024-05-09T01:11:10.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:10 smithi136 ceph-mon[34110]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.8 MiB/s wr, 600 op/s 2024-05-09T01:11:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:10 smithi151 ceph-mon[34780]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.8 MiB/s wr, 600 op/s 2024-05-09T01:11:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.579+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2849791856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 msgr2=0x7f2f64111120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.579+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2849791856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 0x7f2f64111120 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00b0a0 tx=0x7f2f5c00b3b0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.579+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2849791856 shutdown_connections 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.579+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2849791856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 0x7f2f64111120 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.579+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2849791856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f6410a3e0 0x7f2f6410a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.579+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2849791856 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f641027e0 0x7f2f64102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.579+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2849791856 >> 172.21.15.37:0/2849791856 conn(0x7f2f640fe6f0 msgr2=0x7f2f64100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.580+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2849791856 shutdown_connections 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.581+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2849791856 wait complete. 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 Processor -- start 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 -- start start 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f641027e0 0x7f2f641106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 0x7f2f64110c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f6410a3e0 0x7f2f641a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f641144d0 con 0x7f2f64103130 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f64114350 con 0x7f2f6410a3e0 2024-05-09T01:11:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f61d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 0x7f2f64110c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f68ac7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f64114650 con 0x7f2f641027e0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.582+0000 7f2f62d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f6410a3e0 0x7f2f641a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f641027e0 0x7f2f641106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f61d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 0x7f2f64110c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50564/0 (socket says 172.21.15.37:50564) 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f61d9b700 1 -- 172.21.15.37:0/2689561104 learned_addr learned my addr 172.21.15.37:0/2689561104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f6259c700 1 -- 172.21.15.37:0/2689561104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f6410a3e0 msgr2=0x7f2f641a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f6259c700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f6410a3e0 0x7f2f641a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f6259c700 1 -- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 msgr2=0x7f2f64110c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f6259c700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 0x7f2f64110c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f6259c700 1 -- 172.21.15.37:0/2689561104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f641a6100 con 0x7f2f641027e0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.583+0000 7f2f6259c700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f641027e0 0x7f2f641106e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400e9f0 tx=0x7f2f5400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.584+0000 7f2f537fe700 1 -- 172.21.15.37:0/2689561104 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400c9c0 con 0x7f2f641027e0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.584+0000 7f2f537fe700 1 -- 172.21.15.37:0/2689561104 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f5400cb60 con 0x7f2f641027e0 2024-05-09T01:11:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.584+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f641a63f0 con 0x7f2f641027e0 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.584+0000 7f2f537fe700 1 -- 172.21.15.37:0/2689561104 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54018680 con 0x7f2f641027e0 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.584+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f641add10 con 0x7f2f641027e0 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.590+0000 7f2f537fe700 1 -- 172.21.15.37:0/2689561104 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2f54018820 con 0x7f2f641027e0 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.591+0000 7f2f774ddb80 1 Processor -- start 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.591+0000 7f2f774ddb80 1 -- start start 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.591+0000 7f2f537fe700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f4c0b2a90 0x7f2f4c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.591+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f4c0b2a90 0x7f2f4c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe8090a160 0x55fe809a34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808204a0 0x55fe809a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe8099dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f774ddb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe808bfff0 con 0x55fe808204a0 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f774ddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fe8085e7f0 con 0x55fe8099d6a0 2024-05-09T01:11:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f774ddb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fe808bbfb0 con 0x55fe8090a160 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe8090a160 0x55fe809a34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f62d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe8099dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f62d9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe8099dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:58388/0 (socket says 172.21.15.37:58388) 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f62d9d700 1 -- 172.21.15.37:0/1793467574 learned_addr learned my addr 172.21.15.37:0/1793467574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f61d9b700 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808204a0 0x55fe809a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f6259c700 1 -- 172.21.15.37:0/1793467574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 msgr2=0x55fe8099dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f6259c700 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe8099dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f4c0b2a90 0x7f2f4c0b4fa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009e60 tx=0x7f2f5c0093c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f6259c700 1 -- 172.21.15.37:0/1793467574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808204a0 msgr2=0x55fe809a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f6259c700 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808204a0 0x55fe809a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f6259c700 1 -- 172.21.15.37:0/1793467574 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe80856370 con 0x55fe8090a160 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.592+0000 7f2f537fe700 1 -- 172.21.15.37:0/2689561104 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2f540e21b0 con 0x7f2f641027e0 2024-05-09T01:11:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.593+0000 7f2f6259c700 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe8090a160 0x55fe809a34f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400c5b0 tx=0x7f2f54011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76e7b3b4eff15388 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.597+0000 7f2f50ff9700 1 -- 172.21.15.37:0/1793467574 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540a9ed0 con 0x55fe8090a160 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.597+0000 7f2f50ff9700 1 -- 172.21.15.37:0/1793467574 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540a97d0 con 0x55fe8090a160 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.598+0000 7f2f50ff9700 1 -- 172.21.15.37:0/1793467574 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400cd10 con 0x55fe8090a160 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.600+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1793467574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe8090a160 msgr2=0x55fe809a34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.600+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe8090a160 0x55fe809a34f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400c5b0 tx=0x7f2f54011000 comp rx=0 tx=0).stop 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.601+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1793467574 shutdown_connections 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.601+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe8099dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.601+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe8090a160 0x55fe809a34f0 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400c5b0 tx=0x7f2f54011000 comp rx=0 tx=0).stop 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.601+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1793467574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808204a0 0x55fe809a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.601+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1793467574 >> 172.21.15.37:0/1793467574 conn(0x55fe808806a0 msgr2=0x55fe80998400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.602+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1793467574 shutdown_connections 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.606+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1793467574 wait complete. 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.606+0000 7f2f774ddb80 1 -- start start 2024-05-09T01:11:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.606+0000 7f2f774ddb80 1 Processor -- start 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.607+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.607+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.607+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe809a7c80 0x55fe809c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.607+0000 7f2f774ddb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe8073bba0 con 0x55fe8099d6a0 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.607+0000 7f2f774ddb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fe8087a150 con 0x55fe809a7c80 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.607+0000 7f2f774ddb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fe809aa1d0 con 0x55fe808204a0 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.607+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.608+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37288/0 (socket says 172.21.15.37:37288) 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.608+0000 7f2f6259c700 1 -- 172.21.15.37:0/1689975264 learned_addr learned my addr 172.21.15.37:0/1689975264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.608+0000 7f2f774ddb80 10 client.0 _ll_register_callbacks cb 0x55fe807316c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.610+0000 7f2f6259c700 1 -- 172.21.15.37:0/1689975264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe809a7c80 msgr2=0x55fe809c4490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.610+0000 7f2f6259c700 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe809a7c80 0x55fe809c4490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.610+0000 7f2f6259c700 1 -- 172.21.15.37:0/1689975264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 msgr2=0x55fe809a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.610+0000 7f2f6259c700 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.610+0000 7f2f6259c700 1 -- 172.21.15.37:0/1689975264 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe8073b490 con 0x55fe808204a0 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.616+0000 7f2f6259c700 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809a7200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f540a9760 tx=0x7f2f540a57c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d664b7be832704f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.618+0000 7f2f49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.618+0000 7f2f49ffb700 1 -- 172.21.15.37:0/1689975264 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540b2630 con 0x55fe808204a0 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.618+0000 7f2f49ffb700 1 -- 172.21.15.37:0/1689975264 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2f540a5dc0 con 0x55fe808204a0 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.618+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f540a97d0 con 0x55fe808204a0 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.619+0000 7f2f49ffb700 1 -- 172.21.15.37:0/1689975264 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2f540de050 con 0x55fe808204a0 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.621+0000 7f2f774ddb80 10 client.26623 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.621+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55fe809aaac0 con 0x55fe808204a0 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f49ffb700 1 -- 172.21.15.37:0/1689975264 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540a9ed0 con 0x55fe808204a0 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f49ffb700 1 -- 172.21.15.37:0/1689975264 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f2f540a5140 con 0x55fe808204a0 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f774ddb80 10 client.26623 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f774ddb80 10 client.26623 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f774ddb80 20 client.26623 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809acf90 0x55fe809af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f774ddb80 4 client.26623 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.622+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2f540a97d0 con 0x55fe809acf90 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.623+0000 7f2f61d9b700 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809acf90 0x55fe809af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.624+0000 7f2f61d9b700 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809acf90 0x55fe809af3b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=95770d782050b18b server_cookie=8bc4f177ae804df4 in_seq=0 out_seq=0 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.624+0000 7f2f49ffb700 10 client.26623 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.625+0000 7f2f49ffb700 1 -- 172.21.15.37:0/1689975264 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f2f540a97d0 con 0x55fe809acf90 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.625+0000 7f2f49ffb700 10 client.26623 handle_command_reply: tid=0 2024-05-09T01:11:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.625+0000 7f2f774ddb80 1 client.26623 shutdown 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 msgr2=0x55fe809a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809a7200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f540a9760 tx=0x7f2f540a57c0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 shutdown_connections 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809acf90 0x55fe809af3b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe809a7c80 0x55fe809c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809a7200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/1689975264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 >> 172.21.15.37:0/1689975264 conn(0x55fe808806a0 msgr2=0x55fe809981c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f49ffb700 0 client.26623 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 shutdown_connections 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.628+0000 7f2f774ddb80 1 -- 172.21.15.37:0/1689975264 wait complete. 2024-05-09T01:11:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.629+0000 7f2f774ddb80 20 client.26623 trim_cache size 0 max 16384 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.661+0000 7f2f774ddb80 1 Processor -- start 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.661+0000 7f2f774ddb80 1 -- start start 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.661+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808806a0 0x55fe809a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.661+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe808204a0 0x55fe809a2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.661+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808806a0 0x55fe809a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.661+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808806a0 0x55fe809a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37290/0 (socket says 172.21.15.37:37290) 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.662+0000 7f2f61d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe808204a0 0x55fe809a2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.662+0000 7f2f61d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe808204a0 0x55fe809a2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:58400/0 (socket says 172.21.15.37:58400) 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.662+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.662+0000 7f2f6259c700 1 -- 172.21.15.37:0/2792379688 learned_addr learned my addr 172.21.15.37:0/2792379688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.662+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400d300 con 0x55fe8099d6a0 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.662+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400eed0 con 0x55fe808204a0 2024-05-09T01:11:11.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.662+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400d9d0 con 0x55fe808806a0 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f6259c700 1 -- 172.21.15.37:0/2792379688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe808204a0 msgr2=0x55fe809a2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f6259c700 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe808204a0 0x55fe809a2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f6259c700 1 -- 172.21.15.37:0/2792379688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 msgr2=0x55fe809a2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f6259c700 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f6259c700 1 -- 172.21.15.37:0/2792379688 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe80999d00 con 0x55fe808806a0 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f61d9b700 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe808204a0 0x55fe809a2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f6259c700 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808806a0 0x55fe809a9670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f54010c90 tx=0x7f2f540dfd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2b28f1366d7cf29 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f4bfff700 1 -- 172.21.15.37:0/2792379688 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540b2630 con 0x55fe808806a0 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f4bfff700 1 -- 172.21.15.37:0/2792379688 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540a97d0 con 0x55fe808806a0 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.663+0000 7f2f4bfff700 1 -- 172.21.15.37:0/2792379688 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540aab00 con 0x55fe808806a0 2024-05-09T01:11:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808806a0 msgr2=0x55fe809a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808806a0 0x55fe809a9670 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f54010c90 tx=0x7f2f540dfd30 comp rx=0 tx=0).stop 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 shutdown_connections 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe8099d6a0 0x55fe809a2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808806a0 0x55fe809a9670 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/2792379688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe808204a0 0x55fe809a2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 >> 172.21.15.37:0/2792379688 conn(0x55fe8099de10 msgr2=0x55fe809a5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 shutdown_connections 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.665+0000 7f2f774ddb80 1 -- 172.21.15.37:0/2792379688 wait complete. 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.666+0000 7f2f774ddb80 1 -- start start 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.666+0000 7f2f774ddb80 1 Processor -- start 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.667+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.667+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808806a0 0x55fe809af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.667+0000 7f2f774ddb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe80a41d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.667+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.667+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37294/0 (socket says 172.21.15.37:37294) 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.667+0000 7f2f6259c700 1 -- 172.21.15.37:0/3286611656 learned_addr learned my addr 172.21.15.37:0/3286611656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.667+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe80a41d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400e800 con 0x55fe808806a0 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400e130 con 0x55fe8099d6a0 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4400b2a0 con 0x55fe808204a0 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f61d9b700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808806a0 0x55fe809af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f774ddb80 10 client.0 _ll_register_callbacks cb 0x55fe807316c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f62d9d700 1 -- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 msgr2=0x55fe809aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f62d9d700 1 -- 172.21.15.37:0/3286611656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808806a0 msgr2=0x55fe809af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:11.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808806a0 0x55fe809af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f62d9d700 1 -- 172.21.15.37:0/3286611656 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe809afce0 con 0x55fe8099d6a0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f61d9b700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808806a0 0x55fe809af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.668+0000 7f2f6259c700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.669+0000 7f2f62d9d700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe80a41d70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00d010 tx=0x7f2f5c00b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed79cfaffaba918 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.669+0000 7f2f49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.670+0000 7f2f49ffb700 1 -- 172.21.15.37:0/3286611656 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c007b20 con 0x55fe8099d6a0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.670+0000 7f2f49ffb700 1 -- 172.21.15.37:0/3286611656 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2f5c007cc0 con 0x55fe8099d6a0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.670+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f540a97d0 con 0x55fe8099d6a0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f49ffb700 1 -- 172.21.15.37:0/3286611656 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2f5c031470 con 0x55fe8099d6a0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f774ddb80 10 client.26657 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55fe80a43170 con 0x55fe8099d6a0 2024-05-09T01:11:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f49ffb700 1 -- 172.21.15.37:0/3286611656 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540a97d0 con 0x55fe8099d6a0 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f49ffb700 1 -- 172.21.15.37:0/3286611656 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f2f5c011070 con 0x55fe8099d6a0 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f774ddb80 10 client.26657 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f774ddb80 10 client.26657 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f774ddb80 20 client.26657 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.671+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809a7c80 0x55fe80a457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.672+0000 7f2f774ddb80 4 client.26657 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.672+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe808cd9d0 con 0x55fe809a7c80 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.672+0000 7f2f6259c700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809a7c80 0x55fe80a457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.672+0000 7f2f6259c700 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809a7c80 0x55fe80a457f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a390db45e816a78e server_cookie=74b89aab3484380c in_seq=0 out_seq=0 2024-05-09T01:11:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.672+0000 7f2f49ffb700 10 client.26657 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.673+0000 7f2f49ffb700 1 -- 172.21.15.37:0/3286611656 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe808cd9d0 con 0x55fe809a7c80 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.673+0000 7f2f49ffb700 10 client.26657 handle_command_reply: tid=0 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.673+0000 7f2f774ddb80 1 client.26657 shutdown 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.674+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 msgr2=0x55fe80a41d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.674+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe80a41d70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00d010 tx=0x7f2f5c00b3b0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.675+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 shutdown_connections 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.675+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55fe809a7c80 0x55fe80a457f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.675+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fe8099d6a0 0x55fe80a41d70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.675+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe808204a0 0x55fe809aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.675+0000 7f2f49ffb700 0 client.26657 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.676+0000 7f2f774ddb80 1 --2- 172.21.15.37:0/3286611656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe808806a0 0x55fe809af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.676+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 >> 172.21.15.37:0/3286611656 conn(0x55fe8099de10 msgr2=0x55fe809a2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.676+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 shutdown_connections 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.676+0000 7f2f774ddb80 1 -- 172.21.15.37:0/3286611656 wait complete. 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.676+0000 7f2f774ddb80 20 client.26657 trim_cache size 0 max 16384 2024-05-09T01:11:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f4c0b2a90 msgr2=0x7f2f4c0b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f4c0b2a90 0x7f2f4c0b4fa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009e60 tx=0x7f2f5c0093c0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f641027e0 msgr2=0x7f2f641106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f641027e0 0x7f2f641106e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400e9f0 tx=0x7f2f5400ed00 comp rx=0 tx=0).stop 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 shutdown_connections 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f4c0b2a90 0x7f2f4c0b4fa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f6410a3e0 0x7f2f641a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f641027e0 0x7f2f641106e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 --2- 172.21.15.37:0/2689561104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f64103130 0x7f2f64110c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 >> 172.21.15.37:0/2689561104 conn(0x7f2f640fe6f0 msgr2=0x7f2f6410b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 shutdown_connections 2024-05-09T01:11:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:10.677+0000 7f2f68ac7700 1 -- 172.21.15.37:0/2689561104 wait complete. 2024-05-09T01:11:12.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:11:12.378 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:12 smithi136 ceph-mon[34110]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-05-09T01:11:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.589+0000 7fa18f0bd640 1 -- 172.21.15.37:0/65596609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa188075a10 msgr2=0x7fa18810b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.589+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/65596609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa188075a10 0x7fa18810b6a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa174009900 tx=0x7fa17402a410 comp rx=0 tx=0).stop 2024-05-09T01:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.589+0000 7fa18f0bd640 1 -- 172.21.15.37:0/65596609 shutdown_connections 2024-05-09T01:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.589+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/65596609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa18810bbe0 0x7fa18810e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.589+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/65596609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa188075a10 0x7fa18810b6a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.589+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/65596609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1880750c0 0x7fa1880754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.589+0000 7fa18f0bd640 1 -- 172.21.15.37:0/65596609 >> 172.21.15.37:0/65596609 conn(0x7fa1880fee60 msgr2=0x7fa188101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.590+0000 7fa18f0bd640 1 -- 172.21.15.37:0/65596609 shutdown_connections 2024-05-09T01:11:12.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.590+0000 7fa18f0bd640 1 -- 172.21.15.37:0/65596609 wait complete. 2024-05-09T01:11:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.591+0000 7fa18f0bd640 1 Processor -- start 2024-05-09T01:11:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.591+0000 7fa18f0bd640 1 -- start start 2024-05-09T01:11:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.591+0000 7fa18f0bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1880750c0 0x7fa18819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18f0bd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa188075a10 0x7fa18819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1880750c0 0x7fa18819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1880750c0 0x7fa18819c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49370/0 (socket says 172.21.15.37:49370) 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18ce59640 1 -- 172.21.15.37:0/167286234 learned_addr learned my addr 172.21.15.37:0/167286234 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18810bbe0 0x7fa1881a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881119f0 con 0x7fa1880750c0 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa187fff640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa188075a10 0x7fa18819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18d65a640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18810bbe0 0x7fa1881a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa188111870 con 0x7fa18810bbe0 2024-05-09T01:11:12.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.592+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa188111b70 con 0x7fa188075a10 2024-05-09T01:11:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.593+0000 7fa18d65a640 1 -- 172.21.15.37:0/167286234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa188075a10 msgr2=0x7fa18819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.593+0000 7fa18d65a640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa188075a10 0x7fa18819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.593+0000 7fa18d65a640 1 -- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1880750c0 msgr2=0x7fa18819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.593+0000 7fa18d65a640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1880750c0 0x7fa18819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.593+0000 7fa18d65a640 1 -- 172.21.15.37:0/167286234 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1881a3ed0 con 0x7fa18810bbe0 2024-05-09T01:11:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.593+0000 7fa18d65a640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18810bbe0 0x7fa1881a3860 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa180005fd0 tx=0x7fa18000edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.593+0000 7fa185ffb640 1 -- 172.21.15.37:0/167286234 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180004d20 con 0x7fa18810bbe0 2024-05-09T01:11:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.594+0000 7fa185ffb640 1 -- 172.21.15.37:0/167286234 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa180005020 con 0x7fa18810bbe0 2024-05-09T01:11:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.594+0000 7fa185ffb640 1 -- 172.21.15.37:0/167286234 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800116b0 con 0x7fa18810bbe0 2024-05-09T01:11:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.594+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1881a41c0 con 0x7fa18810bbe0 2024-05-09T01:11:12.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.594+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1881a4660 con 0x7fa18810bbe0 2024-05-09T01:11:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.598+0000 7fa185ffb640 1 -- 172.21.15.37:0/167286234 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa1800054d0 con 0x7fa18810bbe0 2024-05-09T01:11:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.599+0000 7fa185ffb640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b28b0 0x7fa1780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.599+0000 7fa185ffb640 1 -- 172.21.15.37:0/167286234 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa1800e2190 con 0x7fa18810bbe0 2024-05-09T01:11:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.600+0000 7fa18ce59640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b28b0 0x7fa1780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.600+0000 7fa18ce59640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b28b0 0x7fa1780b4dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005bc0 tx=0x7fa17c00b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.601+0000 7fa195f79740 1 Processor -- start 2024-05-09T01:11:12.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.601+0000 7fa195f79740 1 -- start start 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa195f79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dad11b0 0x55664de75500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa195f79740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de75a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dad11b0 0x55664de75500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dad11b0 0x55664de75500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56028/0 (socket says 172.21.15.37:56028) 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa18ce59640 1 -- 172.21.15.37:0/1661552877 learned_addr learned my addr 172.21.15.37:0/1661552877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa195f79740 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dab04d0 0x55664de7c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa187fff640 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de75a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.602+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55664ddd97c0 con 0x55664daa82f0 2024-05-09T01:11:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55664dd750e0 con 0x55664dad11b0 2024-05-09T01:11:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55664ddd5780 con 0x55664dab04d0 2024-05-09T01:11:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa18d65a640 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dab04d0 0x55664de7c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa18d65a640 1 -- 172.21.15.37:0/1661552877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dad11b0 msgr2=0x55664de75500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa18d65a640 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dad11b0 0x55664de75500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa18d65a640 1 -- 172.21.15.37:0/1661552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 msgr2=0x55664de75a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa18d65a640 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de75a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa18d65a640 1 -- 172.21.15.37:0/1661552877 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55664dd9e7c0 con 0x55664dab04d0 2024-05-09T01:11:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.603+0000 7fa18d65a640 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dab04d0 0x55664de7c980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa1800a6ad0 tx=0x7fa1800a8fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3edcc6e125c1723 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.604+0000 7fa172ffd640 1 -- 172.21.15.37:0/1661552877 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18001f070 con 0x55664dab04d0 2024-05-09T01:11:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.604+0000 7fa172ffd640 1 -- 172.21.15.37:0/1661552877 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1800adb60 con 0x55664dab04d0 2024-05-09T01:11:12.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.604+0000 7fa172ffd640 1 -- 172.21.15.37:0/1661552877 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800a8ac0 con 0x55664dab04d0 2024-05-09T01:11:12.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.605+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dab04d0 msgr2=0x55664de7c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.605+0000 7fa195f79740 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dab04d0 0x55664de7c980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa1800a6ad0 tx=0x7fa1800a8fd0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.606+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 shutdown_connections 2024-05-09T01:11:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.606+0000 7fa195f79740 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dab04d0 0x55664de7c980 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.606+0000 7fa195f79740 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de75a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.606+0000 7fa195f79740 1 --2- 172.21.15.37:0/1661552877 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dad11b0 0x55664de75500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.606+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 >> 172.21.15.37:0/1661552877 conn(0x55664dac5300 msgr2=0x55664de70e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.606+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 shutdown_connections 2024-05-09T01:11:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.606+0000 7fa195f79740 1 -- 172.21.15.37:0/1661552877 wait complete. 2024-05-09T01:11:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.607+0000 7fa195f79740 1 -- start start 2024-05-09T01:11:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.607+0000 7fa195f79740 1 Processor -- start 2024-05-09T01:11:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.608+0000 7fa195f79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664daa82f0 0x55664de7f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.608+0000 7fa195f79740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dab04d0 0x55664de7f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.608+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664daa82f0 0x55664de7f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.608+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664daa82f0 0x55664de7f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56032/0 (socket says 172.21.15.37:56032) 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.608+0000 7fa18ce59640 1 -- 172.21.15.37:0/363400448 learned_addr learned my addr 172.21.15.37:0/363400448 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.608+0000 7fa195f79740 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de86790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55664de7d3d0 con 0x55664dab04d0 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa187fff640 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dab04d0 0x55664de7f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa18d65a640 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de86790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55664dd609c0 con 0x55664daa82f0 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55664de7d550 con 0x55664dad11b0 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa195f79740 10 client.0 _ll_register_callbacks cb 0x55664dd8d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa18ce59640 1 -- 172.21.15.37:0/363400448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 msgr2=0x55664de86790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa18ce59640 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de86790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa18ce59640 1 -- 172.21.15.37:0/363400448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dab04d0 msgr2=0x55664de7f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa18ce59640 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dab04d0 0x55664de7f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.609+0000 7fa18ce59640 1 -- 172.21.15.37:0/363400448 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55664dd871f0 con 0x55664daa82f0 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1800adb60 con 0x55664daa82f0 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa18ce59640 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664daa82f0 0x55664de7f2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0116c0 tx=0x7fa17c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf9b40d27525a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa167fff640 10 client.26669 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa167fff640 1 -- 172.21.15.37:0/363400448 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c01f900 con 0x55664daa82f0 2024-05-09T01:11:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa167fff640 1 -- 172.21.15.37:0/363400448 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa17c01faa0 con 0x55664daa82f0 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa167fff640 1 -- 172.21.15.37:0/363400448 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa17c01fce0 con 0x55664daa82f0 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa195f79740 10 client.26669 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.610+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55664db3c790 con 0x55664daa82f0 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa167fff640 1 -- 172.21.15.37:0/363400448 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fa17c026070 con 0x55664daa82f0 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa195f79740 10 client.26669 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa195f79740 10 client.26669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa195f79740 20 client.26669 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa195f79740 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da8fd80 0x55664de8c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa195f79740 4 client.26669 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55664dde73d0 con 0x55664da8fd80 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.611+0000 7fa187fff640 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da8fd80 0x55664de8c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.612+0000 7fa187fff640 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da8fd80 0x55664de8c8e0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d06df51e845f051 server_cookie=e156497c4a8f6b1e in_seq=0 out_seq=0 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.612+0000 7fa167fff640 10 client.26669 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa167fff640 1 -- 172.21.15.37:0/363400448 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55664dde73d0 con 0x55664da8fd80 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa167fff640 10 client.26669 handle_command_reply: tid=0 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 client.26669 shutdown 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664daa82f0 msgr2=0x55664de7f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664daa82f0 0x55664de7f2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0116c0 tx=0x7fa17c004730 comp rx=0 tx=0).stop 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 shutdown_connections 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da8fd80 0x55664de8c8e0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de86790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dab04d0 0x55664de7f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 --2- 172.21.15.37:0/363400448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664daa82f0 0x55664de7f2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 >> 172.21.15.37:0/363400448 conn(0x55664dac5300 msgr2=0x55664de73da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.613+0000 7fa167fff640 0 client.26669 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.614+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 shutdown_connections 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.614+0000 7fa195f79740 1 -- 172.21.15.37:0/363400448 wait complete. 2024-05-09T01:11:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.614+0000 7fa195f79740 20 client.26669 trim_cache size 0 max 16384 2024-05-09T01:11:12.638 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:12 smithi037 ceph-mon[30122]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-05-09T01:11:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.641+0000 7fa195f79740 1 Processor -- start 2024-05-09T01:11:12.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa195f79740 1 -- start start 2024-05-09T01:11:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa195f79740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664daa82f0 0x55664de70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa195f79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de86720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa195f79740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dad11b0 0x55664de86c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa195f79740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881ad280 con 0x55664dad11b0 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa195f79740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881aee50 con 0x55664dab04d0 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa195f79740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881ad950 con 0x55664daa82f0 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.642+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664daa82f0 0x55664de70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa187fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de86720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664daa82f0 0x55664de70710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38328/0 (socket says 172.21.15.37:38328) 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 -- 172.21.15.37:0/2784348563 learned_addr learned my addr 172.21.15.37:0/2784348563 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18d65a640 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dad11b0 0x55664de86c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 -- 172.21.15.37:0/2784348563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 msgr2=0x55664de86720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de86720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 -- 172.21.15.37:0/2784348563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dad11b0 msgr2=0x55664de86c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dad11b0 0x55664de86c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 -- 172.21.15.37:0/2784348563 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55664dbb35f0 con 0x55664daa82f0 2024-05-09T01:11:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18d65a640 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dad11b0 0x55664de86c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa18ce59640 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664daa82f0 0x55664de70710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa17c032490 tx=0x7fa17c021040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d10d5d5644c6c75 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa1727fc640 1 -- 172.21.15.37:0/2784348563 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0328d0 con 0x55664daa82f0 2024-05-09T01:11:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa1727fc640 1 -- 172.21.15.37:0/2784348563 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1800adb60 con 0x55664daa82f0 2024-05-09T01:11:12.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.643+0000 7fa1727fc640 1 -- 172.21.15.37:0/2784348563 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c028a50 con 0x55664daa82f0 2024-05-09T01:11:12.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 -- 172.21.15.37:0/2784348563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664daa82f0 msgr2=0x55664de70710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664daa82f0 0x55664de70710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa17c032490 tx=0x7fa17c021040 comp rx=0 tx=0).stop 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 -- 172.21.15.37:0/2784348563 shutdown_connections 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664dad11b0 0x55664de86c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de86720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 --2- 172.21.15.37:0/2784348563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664daa82f0 0x55664de70710 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 -- 172.21.15.37:0/2784348563 >> 172.21.15.37:0/2784348563 conn(0x55664dac5300 msgr2=0x55664de73c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 -- 172.21.15.37:0/2784348563 shutdown_connections 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.644+0000 7fa195f79740 1 -- 172.21.15.37:0/2784348563 wait complete. 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 -- start start 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 Processor -- start 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de83eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de843f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de85320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881ae780 con 0x55664daa82f0 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881ae0b0 con 0x55664dab04d0 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881ab260 con 0x55664dad11b0 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa195f79740 10 client.0 _ll_register_callbacks cb 0x7fa17c003dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.645+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de83eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de83eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49408/0 (socket says 172.21.15.37:49408) 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa187fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 -- 172.21.15.37:0/1583198450 learned_addr learned my addr 172.21.15.37:0/1583198450 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18d65a640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de85320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 -- 172.21.15.37:0/1583198450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 msgr2=0x55664de85320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de85320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 -- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 msgr2=0x55664de843f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:12.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de843f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 -- 172.21.15.37:0/1583198450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55664dd9ded0 con 0x55664daa82f0 2024-05-09T01:11:12.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18d65a640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de85320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:12.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa187fff640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de843f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa18ce59640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de83eb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa17c029a90 tx=0x7fa17c029ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293b1835a8790d8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa167fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa167fff640 1 -- 172.21.15.37:0/1583198450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c043070 con 0x55664daa82f0 2024-05-09T01:11:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1800adb60 con 0x55664daa82f0 2024-05-09T01:11:12.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa167fff640 1 -- 172.21.15.37:0/1583198450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa17c0328d0 con 0x55664daa82f0 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa167fff640 1 -- 172.21.15.37:0/1583198450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fa17c005610 con 0x55664daa82f0 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.646+0000 7fa195f79740 10 client.16848 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55664de869a0 con 0x55664daa82f0 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa167fff640 1 -- 172.21.15.37:0/1583198450 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1800adb60 con 0x55664daa82f0 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa167fff640 1 -- 172.21.15.37:0/1583198450 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fa17c026040 con 0x55664daa82f0 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa195f79740 10 client.16848 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa195f79740 10 client.16848 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa195f79740 20 client.16848 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa195f79740 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da651c0 0x55664def6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa195f79740 4 client.16848 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55664dde1240 con 0x55664da651c0 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.647+0000 7fa187fff640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da651c0 0x55664def6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:12.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.648+0000 7fa187fff640 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da651c0 0x55664def6e20 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=270184738d380f32 server_cookie=415de18cef8f61c2 in_seq=0 out_seq=0 2024-05-09T01:11:12.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.648+0000 7fa167fff640 10 client.16848 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.657+0000 7fa167fff640 1 -- 172.21.15.37:0/1583198450 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55664dde1240 con 0x55664da651c0 2024-05-09T01:11:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.657+0000 7fa167fff640 10 client.16848 handle_command_reply: tid=0 2024-05-09T01:11:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.657+0000 7fa195f79740 1 client.16848 shutdown 2024-05-09T01:11:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.657+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 msgr2=0x55664de83eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.657+0000 7fa195f79740 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de83eb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa17c029a90 tx=0x7fa17c029ac0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 shutdown_connections 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55664da651c0 0x55664def6e20 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55664dad11b0 0x55664de85320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa167fff640 0 client.16848 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55664dab04d0 0x55664de843f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 --2- 172.21.15.37:0/1583198450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55664daa82f0 0x55664de83eb0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 >> 172.21.15.37:0/1583198450 conn(0x55664dac5300 msgr2=0x55664de79700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 shutdown_connections 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 1 -- 172.21.15.37:0/1583198450 wait complete. 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.658+0000 7fa195f79740 20 client.16848 trim_cache size 0 max 16384 2024-05-09T01:11:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:11:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:11:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:11:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b28b0 msgr2=0x7fa1780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b28b0 0x7fa1780b4dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005bc0 tx=0x7fa17c00b480 comp rx=0 tx=0).stop 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18810bbe0 msgr2=0x7fa1881a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18810bbe0 0x7fa1881a3860 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa180005fd0 tx=0x7fa18000edd0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 shutdown_connections 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1780b28b0 0x7fa1780b4dc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa18810bbe0 0x7fa1881a3860 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa188075a10 0x7fa18819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 --2- 172.21.15.37:0/167286234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1880750c0 0x7fa18819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 >> 172.21.15.37:0/167286234 conn(0x7fa1880fee60 msgr2=0x7fa188107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 shutdown_connections 2024-05-09T01:11:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:12.659+0000 7fa18f0bd640 1 -- 172.21.15.37:0/167286234 wait complete. 2024-05-09T01:11:12.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:12 smithi151 ceph-mon[34780]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-05-09T01:11:14.348 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:14 smithi037 ceph-mon[30122]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 10 MiB/s wr, 754 op/s 2024-05-09T01:11:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:14 smithi136 ceph-mon[34110]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 10 MiB/s wr, 754 op/s 2024-05-09T01:11:14.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:14 smithi151 ceph-mon[34780]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 10 MiB/s wr, 754 op/s 2024-05-09T01:11:14.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.828+0000 7f1c28bd5700 1 -- 172.21.15.37:0/2610819505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2411d930 msgr2=0x7f1c2411fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.828+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/2610819505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2411d930 0x7f1c2411fd50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00b0a0 tx=0x7f1c1c00b3b0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.830+0000 7f1c28bd5700 1 -- 172.21.15.37:0/2610819505 shutdown_connections 2024-05-09T01:11:14.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.830+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/2610819505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2411d930 0x7f1c2411fd50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.830+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/2610819505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c2410a930 0x7f1c2410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.830+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/2610819505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c2410b280 0x7f1c2411d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.830+0000 7f1c28bd5700 1 -- 172.21.15.37:0/2610819505 >> 172.21.15.37:0/2610819505 conn(0x7f1c2406f4d0 msgr2=0x7f1c2406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:14.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.838+0000 7f1c28bd5700 1 -- 172.21.15.37:0/2610819505 shutdown_connections 2024-05-09T01:11:14.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.838+0000 7f1c28bd5700 1 -- 172.21.15.37:0/2610819505 wait complete. 2024-05-09T01:11:14.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.839+0000 7f1c28bd5700 1 Processor -- start 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.842+0000 7f1c28bd5700 1 -- start start 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.842+0000 7f1c28bd5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c2410a930 0x7f1c2411bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.842+0000 7f1c28bd5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2410b280 0x7f1c24114ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.842+0000 7f1c28bd5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c2411d930 0x7f1c241154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.842+0000 7f1c28bd5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24123340 con 0x7f1c2411d930 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.842+0000 7f1c28bd5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241231c0 con 0x7f1c2410b280 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.842+0000 7f1c28bd5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241234c0 con 0x7f1c2410a930 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.843+0000 7f1c21d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2410b280 0x7f1c24114ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.843+0000 7f1c21d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2410b280 0x7f1c24114ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56076/0 (socket says 172.21.15.37:56076) 2024-05-09T01:11:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.843+0000 7f1c21d9b700 1 -- 172.21.15.37:0/4250653787 learned_addr learned my addr 172.21.15.37:0/4250653787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.844+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c2411d930 0x7f1c241154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.844+0000 7f1c2259c700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c2410a930 0x7f1c2411bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.845+0000 7f1c21d9b700 1 -- 172.21.15.37:0/4250653787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c2410a930 msgr2=0x7f1c2411bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.845+0000 7f1c21d9b700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c2410a930 0x7f1c2411bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.845+0000 7f1c21d9b700 1 -- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c2411d930 msgr2=0x7f1c241154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.845+0000 7f1c21d9b700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c2411d930 0x7f1c241154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.846+0000 7f1c21d9b700 1 -- 172.21.15.37:0/4250653787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c241198c0 con 0x7f1c2410b280 2024-05-09T01:11:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.846+0000 7f1c2259c700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c2410a930 0x7f1c2411bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.847+0000 7f1c21d9b700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2410b280 0x7f1c24114ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800b530 tx=0x7f1c1800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.848+0000 7f1c137fe700 1 -- 172.21.15.37:0/4250653787 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18015020 con 0x7f1c2410b280 2024-05-09T01:11:14.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.848+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c24119bb0 con 0x7f1c2410b280 2024-05-09T01:11:14.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.848+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2411a0f0 con 0x7f1c2410b280 2024-05-09T01:11:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.851+0000 7f1c137fe700 1 -- 172.21.15.37:0/4250653787 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c18011ce0 con 0x7f1c2410b280 2024-05-09T01:11:14.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.851+0000 7f1c137fe700 1 -- 172.21.15.37:0/4250653787 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18010dd0 con 0x7f1c2410b280 2024-05-09T01:11:14.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.853+0000 7f1c375ebb80 1 Processor -- start 2024-05-09T01:11:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.854+0000 7f1c375ebb80 1 -- start start 2024-05-09T01:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.855+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc092d00 0x5610bc19b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.855+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc19b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.855+0000 7f1c22d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc092d00 0x5610bc19b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.855+0000 7f1c22d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc092d00 0x5610bc19b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38364/0 (socket says 172.21.15.37:38364) 2024-05-09T01:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.855+0000 7f1c22d9d700 1 -- 172.21.15.37:0/636001545 learned_addr learned my addr 172.21.15.37:0/636001545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.856+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc195400 0x5610bc195810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.856+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5610bc0b80a0 con 0x5610bc195400 2024-05-09T01:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.856+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5610bc05d9a0 con 0x5610bc0184a0 2024-05-09T01:11:14.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.856+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5610bc0b4060 con 0x5610bc092d00 2024-05-09T01:11:14.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.856+0000 7f1c2259c700 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.857+0000 7f1c2259c700 1 -- 172.21.15.37:0/636001545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc092d00 msgr2=0x5610bc19b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.858+0000 7f1c2259c700 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc092d00 0x5610bc19b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.858+0000 7f1c2259c700 1 -- 172.21.15.37:0/636001545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc195400 msgr2=0x5610bc195810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.858+0000 7f1c2259c700 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc195400 0x5610bc195810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.858+0000 7f1c2259c700 1 -- 172.21.15.37:0/636001545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610bc04e500 con 0x5610bc0184a0 2024-05-09T01:11:14.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.859+0000 7f1c2259c700 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc19b780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1c24116710 tx=0x7f1c14008eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68159a7c244dceda server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:14.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.861+0000 7f1c137fe700 1 -- 172.21.15.37:0/4250653787 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1c18018020 con 0x7f1c2410b280 2024-05-09T01:11:14.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.861+0000 7f1c10ff9700 1 -- 172.21.15.37:0/636001545 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14014070 con 0x5610bc0184a0 2024-05-09T01:11:14.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.861+0000 7f1c10ff9700 1 -- 172.21.15.37:0/636001545 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c140044d0 con 0x5610bc0184a0 2024-05-09T01:11:14.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.862+0000 7f1c137fe700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c0c0b2a90 0x7f1c0c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.862+0000 7f1c137fe700 1 -- 172.21.15.37:0/4250653787 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1c180e1880 con 0x7f1c2410b280 2024-05-09T01:11:14.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.863+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c0c0b2a90 0x7f1c0c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.864+0000 7f1c10ff9700 1 -- 172.21.15.37:0/636001545 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14010430 con 0x5610bc0184a0 2024-05-09T01:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.864+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 msgr2=0x5610bc19b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.864+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc19b780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1c24116710 tx=0x7f1c14008eb0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.864+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c0c0b2a90 0x7f1c0c0b4fa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009e60 tx=0x7f1c1c0098c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.865+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 shutdown_connections 2024-05-09T01:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.865+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc195400 0x5610bc195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.865+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc092d00 0x5610bc19b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.865+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/636001545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc19b780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.865+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 >> 172.21.15.37:0/636001545 conn(0x5610bc01bf70 msgr2=0x5610bc190220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.865+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 shutdown_connections 2024-05-09T01:11:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.865+0000 7f1c375ebb80 1 -- 172.21.15.37:0/636001545 wait complete. 2024-05-09T01:11:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.866+0000 7f1c375ebb80 1 -- start start 2024-05-09T01:11:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.866+0000 7f1c375ebb80 1 Processor -- start 2024-05-09T01:11:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.870+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc0184a0 0x5610bc19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.870+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.871+0000 7f1c2259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc0184a0 0x5610bc19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.871+0000 7f1c2259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc0184a0 0x5610bc19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38380/0 (socket says 172.21.15.37:38380) 2024-05-09T01:11:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.871+0000 7f1c2259c700 1 -- 172.21.15.37:0/1177330677 learned_addr learned my addr 172.21.15.37:0/1177330677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.871+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc195400 0x5610bc19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.872+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5610bc1961b0 con 0x5610bc092d00 2024-05-09T01:11:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5610bc052b20 con 0x5610bc195400 2024-05-09T01:11:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5610bc1a2020 con 0x5610bc0184a0 2024-05-09T01:11:14.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc195400 0x5610bc19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c2259c700 1 -- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc195400 msgr2=0x5610bc19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c2259c700 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc195400 0x5610bc19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c2259c700 1 -- 172.21.15.37:0/1177330677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 msgr2=0x5610bc19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c2259c700 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c2259c700 1 -- 172.21.15.37:0/1177330677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610bbf33490 con 0x5610bc0184a0 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.873+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc195400 0x5610bc19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.876+0000 7f1c375ebb80 10 client.0 _ll_register_callbacks cb 0x5610bbf296c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.876+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c140044d0 con 0x5610bc0184a0 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.876+0000 7f1c2259c700 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc0184a0 0x5610bc19ef90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c140046a0 tx=0x7f1c14003dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40aefe94bedcdd5f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.876+0000 7f1c09ffb700 10 client.26656 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.876+0000 7f1c09ffb700 1 -- 172.21.15.37:0/1177330677 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14014070 con 0x5610bc0184a0 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.876+0000 7f1c09ffb700 1 -- 172.21.15.37:0/1177330677 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1c14004750 con 0x5610bc0184a0 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c09ffb700 1 -- 172.21.15.37:0/1177330677 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1c14004950 con 0x5610bc0184a0 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 10 client.26656 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=41}) -- 0x5610bc1ac670 con 0x5610bc0184a0 2024-05-09T01:11:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c09ffb700 1 -- 172.21.15.37:0/1177330677 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f1c14004af0 con 0x5610bc0184a0 2024-05-09T01:11:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 10 client.26656 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 10 client.26656 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:11:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 20 client.26656 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc1aeb40 0x5610bc1b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 4 client.26656 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.877+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610bc0c5a80 con 0x5610bc1aeb40 2024-05-09T01:11:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.878+0000 7f1c21d9b700 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc1aeb40 0x5610bc1b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.878+0000 7f1c21d9b700 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc1aeb40 0x5610bc1b0f60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e29438f6d802554d server_cookie=f17964d66bb4b355 in_seq=0 out_seq=0 2024-05-09T01:11:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.878+0000 7f1c09ffb700 10 client.26656 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.879+0000 7f1c09ffb700 1 -- 172.21.15.37:0/1177330677 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5610bc0c5a80 con 0x5610bc1aeb40 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.879+0000 7f1c09ffb700 10 client.26656 handle_command_reply: tid=0 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.879+0000 7f1c375ebb80 1 client.26656 shutdown 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.879+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc0184a0 msgr2=0x5610bc19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.879+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc0184a0 0x5610bc19ef90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1c140046a0 tx=0x7f1c14003dd0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 shutdown_connections 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc1aeb40 0x5610bc1b0f60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc195400 0x5610bc19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc0184a0 0x5610bc19ef90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1177330677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 >> 172.21.15.37:0/1177330677 conn(0x5610bc01bf70 msgr2=0x5610bc189ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c09ffb700 0 client.26656 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:11:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 shutdown_connections 2024-05-09T01:11:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1177330677 wait complete. 2024-05-09T01:11:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.880+0000 7f1c375ebb80 20 client.26656 trim_cache size 0 max 16384 2024-05-09T01:11:14.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.907+0000 7f1c375ebb80 1 Processor -- start 2024-05-09T01:11:14.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.907+0000 7f1c375ebb80 1 -- start start 2024-05-09T01:11:14.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc0184a0 0x5610bc1900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc092d00 0x5610bc19a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1ab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c375ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0400d1a0 con 0x5610bc0184a0 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c375ebb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0400ed70 con 0x5610bc092d00 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c375ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0400d870 con 0x5610bc195400 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c22d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.908+0000 7f1c22d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1ab280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38396/0 (socket says 172.21.15.37:38396) 2024-05-09T01:11:14.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c22d9d700 1 -- 172.21.15.37:0/1507130670 learned_addr learned my addr 172.21.15.37:0/1507130670 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:14.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c21d9b700 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc092d00 0x5610bc19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c2259c700 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc0184a0 0x5610bc1900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c22d9d700 1 -- 172.21.15.37:0/1507130670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc092d00 msgr2=0x5610bc19a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:14.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc092d00 0x5610bc19a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c22d9d700 1 -- 172.21.15.37:0/1507130670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc0184a0 msgr2=0x5610bc1900d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:14.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc0184a0 0x5610bc1900d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.909+0000 7f1c22d9d700 1 -- 172.21.15.37:0/1507130670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610bc19e2b0 con 0x5610bc195400 2024-05-09T01:11:14.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.910+0000 7f1c2259c700 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc0184a0 0x5610bc1900d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:14.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.910+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1ab280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c003d50 tx=0x7f1c1c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8d1e00e32692c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:14.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.911+0000 7f1c0bfff700 1 -- 172.21.15.37:0/1507130670 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c023070 con 0x5610bc195400 2024-05-09T01:11:14.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.911+0000 7f1c0bfff700 1 -- 172.21.15.37:0/1507130670 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c02e070 con 0x5610bc195400 2024-05-09T01:11:14.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.911+0000 7f1c0bfff700 1 -- 172.21.15.37:0/1507130670 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c005a50 con 0x5610bc195400 2024-05-09T01:11:14.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1507130670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 msgr2=0x5610bc1ab280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1ab280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c003d50 tx=0x7f1c1c01f000 comp rx=0 tx=0).stop 2024-05-09T01:11:14.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1507130670 shutdown_connections 2024-05-09T01:11:14.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1ab280 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc0184a0 0x5610bc1900d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/1507130670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc092d00 0x5610bc19a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1507130670 >> 172.21.15.37:0/1507130670 conn(0x5610bc01bf70 msgr2=0x5610bc19a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:14.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.912+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1507130670 shutdown_connections 2024-05-09T01:11:14.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.913+0000 7f1c375ebb80 1 -- 172.21.15.37:0/1507130670 wait complete. 2024-05-09T01:11:14.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.913+0000 7f1c375ebb80 1 -- start start 2024-05-09T01:11:14.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.913+0000 7f1c375ebb80 1 Processor -- start 2024-05-09T01:11:14.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc1b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc1b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c375ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c375ebb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0400e6a0 con 0x5610bc092d00 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c375ebb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0400dfd0 con 0x5610bc0184a0 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c375ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0400b140 con 0x5610bc195400 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c375ebb80 10 client.0 _ll_register_callbacks cb 0x5610bbf296c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c21d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc1b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.914+0000 7f1c22d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c21d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc1b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49446/0 (socket says 172.21.15.37:49446) 2024-05-09T01:11:14.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c21d9b700 1 -- 172.21.15.37:0/490808110 learned_addr learned my addr 172.21.15.37:0/490808110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c22d9d700 1 -- 172.21.15.37:0/490808110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 msgr2=0x5610bc1b0b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc1b0b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c22d9d700 1 -- 172.21.15.37:0/490808110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 msgr2=0x5610bc1b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc1b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c22d9d700 1 -- 172.21.15.37:0/490808110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610bc217150 con 0x5610bc195400 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c22d9d700 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1b15d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009a20 tx=0x7f1c1c005a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45b3b8499d422fd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.915+0000 7f1c09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.916+0000 7f1c09ffb700 1 -- 172.21.15.37:0/490808110 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c007c60 con 0x5610bc195400 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.916+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c1c02e070 con 0x5610bc195400 2024-05-09T01:11:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.916+0000 7f1c09ffb700 1 -- 172.21.15.37:0/490808110 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1c1c007e00 con 0x5610bc195400 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.916+0000 7f1c09ffb700 1 -- 172.21.15.37:0/490808110 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f1c1c03b480 con 0x5610bc195400 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.916+0000 7f1c375ebb80 10 client.26662 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.916+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5610bc2183d0 con 0x5610bc195400 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c09ffb700 1 -- 172.21.15.37:0/490808110 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c1c02e070 con 0x5610bc195400 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c09ffb700 1 -- 172.21.15.37:0/490808110 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f1c1c011070 con 0x5610bc195400 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c375ebb80 10 client.26662 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c375ebb80 10 client.26662 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:11:14.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c375ebb80 20 client.26662 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc218a50 0x5610bc21ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c375ebb80 4 client.26662 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.917+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5610bc0bfb20 con 0x5610bc218a50 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.918+0000 7f1c2259c700 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc218a50 0x5610bc21ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.918+0000 7f1c2259c700 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc218a50 0x5610bc21ae70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5d87c0bf80e471e server_cookie=f63dbc48c5365bd in_seq=0 out_seq=0 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.919+0000 7f1c09ffb700 10 client.26662 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.919+0000 7f1c09ffb700 1 -- 172.21.15.37:0/490808110 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5610bc0bfb20 con 0x5610bc218a50 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.919+0000 7f1c09ffb700 10 client.26662 handle_command_reply: tid=0 2024-05-09T01:11:14.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.919+0000 7f1c375ebb80 1 client.26662 shutdown 2024-05-09T01:11:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.919+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 msgr2=0x5610bc1b15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.919+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1b15d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009a20 tx=0x7f1c1c005a30 comp rx=0 tx=0).stop 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 shutdown_connections 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610bc195400 0x5610bc1b15d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5610bc218a50 0x5610bc21ae70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610bc0184a0 0x5610bc1b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 --2- 172.21.15.37:0/490808110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610bc092d00 0x5610bc1b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c09ffb700 0 client.26662 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 >> 172.21.15.37:0/490808110 conn(0x5610bc01bf70 msgr2=0x5610bc198cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 shutdown_connections 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 1 -- 172.21.15.37:0/490808110 wait complete. 2024-05-09T01:11:14.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.920+0000 7f1c375ebb80 20 client.26662 trim_cache size 0 max 16384 2024-05-09T01:11:14.924 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:11:14.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c0c0b2a90 msgr2=0x7f1c0c0b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c0c0b2a90 0x7f1c0c0b4fa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009e60 tx=0x7f1c1c0098c0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2410b280 msgr2=0x7f1c24114ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:14.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2410b280 0x7f1c24114ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800b530 tx=0x7f1c1800b840 comp rx=0 tx=0).stop 2024-05-09T01:11:14.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 shutdown_connections 2024-05-09T01:11:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1c0c0b2a90 0x7f1c0c0b4fa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c2411d930 0x7f1c241154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c2410a930 0x7f1c2411bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 --2- 172.21.15.37:0/4250653787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c2410b280 0x7f1c24114ec0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.921+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 >> 172.21.15.37:0/4250653787 conn(0x7f1c2406f4d0 msgr2=0x7f1c24072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.922+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 shutdown_connections 2024-05-09T01:11:14.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:14.922+0000 7f1c28bd5700 1 -- 172.21.15.37:0/4250653787 wait complete. 2024-05-09T01:11:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 535.0 s, 1669.2 tps, lat 59.505 ms stddev 72.231 2024-05-09T01:11:15.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:11:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:16.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:16 smithi037 ceph-mon[30122]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 729 op/s 2024-05-09T01:11:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:16 smithi136 ceph-mon[34110]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 729 op/s 2024-05-09T01:11:16.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:16 smithi151 ceph-mon[34780]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 729 op/s 2024-05-09T01:11:18.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.141+0000 7f934d353700 1 -- 172.21.15.37:0/2577711338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93481034c0 msgr2=0x7f93481038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.141+0000 7f934d353700 1 --2- 172.21.15.37:0/2577711338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93481034c0 0x7f93481038d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f934000b0d0 tx=0x7f934000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.143+0000 7f934d353700 1 -- 172.21.15.37:0/2577711338 shutdown_connections 2024-05-09T01:11:18.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.143+0000 7f934d353700 1 --2- 172.21.15.37:0/2577711338 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 0x7f93481100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.143+0000 7f934d353700 1 --2- 172.21.15.37:0/2577711338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93481034c0 0x7f93481038d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.143+0000 7f934d353700 1 --2- 172.21.15.37:0/2577711338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9348107df0 0x7f9348108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.143+0000 7f934d353700 1 -- 172.21.15.37:0/2577711338 >> 172.21.15.37:0/2577711338 conn(0x7f93480fedc0 msgr2=0x7f93481011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:18.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.143+0000 7f934d353700 1 -- 172.21.15.37:0/2577711338 shutdown_connections 2024-05-09T01:11:18.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.143+0000 7f934d353700 1 -- 172.21.15.37:0/2577711338 wait complete. 2024-05-09T01:11:18.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.144+0000 7f934d353700 1 Processor -- start 2024-05-09T01:11:18.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.144+0000 7f934d353700 1 -- start start 2024-05-09T01:11:18.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.145+0000 7f934d353700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93481034c0 0x7f934810c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.145+0000 7f934d353700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348107df0 0x7f934810ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.145+0000 7f934d353700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 0x7f9348075230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.145+0000 7f934d353700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9348112410 con 0x7f9348107df0 2024-05-09T01:11:18.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.145+0000 7f934d353700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9348112290 con 0x7f9348108740 2024-05-09T01:11:18.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.145+0000 7f934d353700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9348112590 con 0x7f93481034c0 2024-05-09T01:11:18.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.148+0000 7f93477fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 0x7f9348075230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.148+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93481034c0 0x7f934810c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.148+0000 7f93477fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 0x7f9348075230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56120/0 (socket says 172.21.15.37:56120) 2024-05-09T01:11:18.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.148+0000 7f93477fe700 1 -- 172.21.15.37:0/4152256391 learned_addr learned my addr 172.21.15.37:0/4152256391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:18.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.152+0000 7f93477fe700 1 -- 172.21.15.37:0/4152256391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93481034c0 msgr2=0x7f934810c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.152+0000 7f93477fe700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93481034c0 0x7f934810c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.152+0000 7f93477fe700 1 -- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348107df0 msgr2=0x7f934810ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.152+0000 7f93477fe700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348107df0 0x7f934810ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.152+0000 7f93477fe700 1 -- 172.21.15.37:0/4152256391 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934810d3f0 con 0x7f9348108740 2024-05-09T01:11:18.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.152+0000 7f93477fe700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 0x7f9348075230 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f933800b4a0 tx=0x7f933800b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:18.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.155+0000 7f9344ff9700 1 -- 172.21.15.37:0/4152256391 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338015020 con 0x7f9348108740 2024-05-09T01:11:18.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.156+0000 7f9344ff9700 1 -- 172.21.15.37:0/4152256391 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9338011ce0 con 0x7f9348108740 2024-05-09T01:11:18.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.156+0000 7f9344ff9700 1 -- 172.21.15.37:0/4152256391 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338010dc0 con 0x7f9348108740 2024-05-09T01:11:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.158+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93481b62e0 con 0x7f9348108740 2024-05-09T01:11:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.159+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93481b6740 con 0x7f9348108740 2024-05-09T01:11:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.176+0000 7f935bd69b80 1 Processor -- start 2024-05-09T01:11:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.176+0000 7f935bd69b80 1 -- start start 2024-05-09T01:11:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.177+0000 7f9344ff9700 1 -- 172.21.15.37:0/4152256391 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9338018020 con 0x7f9348108740 2024-05-09T01:11:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.177+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc064f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.177+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc06a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.177+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31dc006a0 0x55d31dc00ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.177+0000 7f933ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc064f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.177+0000 7f933ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc064f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56126/0 (socket says 172.21.15.37:56126) 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.178+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc06a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.178+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc06a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38420/0 (socket says 172.21.15.37:38420) 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.178+0000 7f933ffff700 1 -- 172.21.15.37:0/727963749 learned_addr learned my addr 172.21.15.37:0/727963749 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.178+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d31db22ff0 con 0x55d31dc006a0 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.178+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d31dac17f0 con 0x55d31db6d160 2024-05-09T01:11:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.178+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d31db1efb0 con 0x55d31da834a0 2024-05-09T01:11:18.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.179+0000 7f933ffff700 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31dc006a0 0x55d31dc00ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.179+0000 7f9346ffd700 1 -- 172.21.15.37:0/727963749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 msgr2=0x55d31dc064f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.179+0000 7f9346ffd700 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc064f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.179+0000 7f9346ffd700 1 -- 172.21.15.37:0/727963749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31dc006a0 msgr2=0x55d31dc00ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.179+0000 7f9346ffd700 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31dc006a0 0x55d31dc00ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.179+0000 7f9346ffd700 1 -- 172.21.15.37:0/727963749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31dab9370 con 0x55d31da834a0 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.179+0000 7f9346ffd700 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc06a30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f934000b820 tx=0x7f934000bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7a060df05f1dd30 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.180+0000 7f933d7fa700 1 -- 172.21.15.37:0/727963749 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93400092d0 con 0x55d31da834a0 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.180+0000 7f933d7fa700 1 -- 172.21.15.37:0/727963749 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9340020070 con 0x55d31da834a0 2024-05-09T01:11:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.180+0000 7f933d7fa700 1 -- 172.21.15.37:0/727963749 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93400075c0 con 0x55d31da834a0 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.181+0000 7f9344ff9700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93340b2a80 0x7f93340b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.181+0000 7f9344ff9700 1 -- 172.21.15.37:0/4152256391 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93380e16e0 con 0x7f9348108740 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.181+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 msgr2=0x55d31dc06a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.181+0000 7f935bd69b80 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc06a30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f934000b820 tx=0x7f934000bfd0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.181+0000 7f933ffff700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93340b2a80 0x7f93340b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.182+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 shutdown_connections 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.182+0000 7f935bd69b80 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31dc006a0 0x55d31dc00ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.182+0000 7f935bd69b80 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.182+0000 7f935bd69b80 1 --2- 172.21.15.37:0/727963749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc06a30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.182+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 >> 172.21.15.37:0/727963749 conn(0x55d31dae36a0 msgr2=0x55d31dbfb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.182+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 shutdown_connections 2024-05-09T01:11:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.183+0000 7f935bd69b80 1 -- 172.21.15.37:0/727963749 wait complete. 2024-05-09T01:11:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.184+0000 7f935bd69b80 1 -- start start 2024-05-09T01:11:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.184+0000 7f935bd69b80 1 Processor -- start 2024-05-09T01:11:18.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.185+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31da834a0 0x55d31dc0a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.185+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc0a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.185+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31da834a0 0x55d31dc0a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.186+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31da834a0 0x55d31dc0a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49482/0 (socket says 172.21.15.37:49482) 2024-05-09T01:11:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.186+0000 7f9346ffd700 1 -- 172.21.15.37:0/1809541312 learned_addr learned my addr 172.21.15.37:0/1809541312 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:18.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.186+0000 7f935bd69b80 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc0abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.186+0000 7f933ffff700 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc0a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.187+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d31d99eba0 con 0x55d31da834a0 2024-05-09T01:11:18.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.187+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d31dadd150 con 0x55d31db6d160 2024-05-09T01:11:18.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.187+0000 7f93477fe700 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc0abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.187+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d31dc0d1d0 con 0x55d31dc006a0 2024-05-09T01:11:18.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.188+0000 7f935bd69b80 10 client.0 _ll_register_callbacks cb 0x55d31d9946c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.188+0000 7f933ffff700 1 -- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 msgr2=0x55d31dc0abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.188+0000 7f933ffff700 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc0abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.188+0000 7f933ffff700 1 -- 172.21.15.37:0/1809541312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31da834a0 msgr2=0x55d31dc0a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.188+0000 7f933ffff700 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31da834a0 0x55d31dc0a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.188+0000 7f933ffff700 1 -- 172.21.15.37:0/1809541312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31d99e490 con 0x55d31db6d160 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.189+0000 7f933ffff700 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc0a6a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55d31dc070c0 tx=0x7f93300198d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08b0791cd12fa8c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.189+0000 7f932e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.189+0000 7f933ffff700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93340b2a80 0x7f93340b4f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9330016000 tx=0x7f933001d000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.189+0000 7f932e7fc700 1 -- 172.21.15.37:0/1809541312 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933000bc80 con 0x55d31db6d160 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.189+0000 7f932e7fc700 1 -- 172.21.15.37:0/1809541312 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f933001c960 con 0x55d31db6d160 2024-05-09T01:11:18.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.190+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9340020070 con 0x55d31db6d160 2024-05-09T01:11:18.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.190+0000 7f932e7fc700 1 -- 172.21.15.37:0/1809541312 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f933001cba0 con 0x55d31db6d160 2024-05-09T01:11:18.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.190+0000 7f935bd69b80 10 client.26699 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:18.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.191+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d31dc17990 con 0x55d31db6d160 2024-05-09T01:11:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.195+0000 7f932e7fc700 1 -- 172.21.15.37:0/1809541312 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9330020050 con 0x55d31db6d160 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.196+0000 7f932e7fc700 1 -- 172.21.15.37:0/1809541312 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f9330023030 con 0x55d31db6d160 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.196+0000 7f935bd69b80 10 client.26699 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.196+0000 7f935bd69b80 10 client.26699 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.196+0000 7f935bd69b80 20 client.26699 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.196+0000 7f935bd69b80 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc1a070 0x55d31dc1c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.196+0000 7f935bd69b80 4 client.26699 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.196+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9340020070 con 0x55d31dc1a070 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.197+0000 7f9346ffd700 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc1a070 0x55d31dc1c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.197+0000 7f9346ffd700 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc1a070 0x55d31dc1c4c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c12ce34dcf4db38a server_cookie=c15da2074efdc1db in_seq=0 out_seq=0 2024-05-09T01:11:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.197+0000 7f932e7fc700 10 client.26699 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:11:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.198+0000 7f932e7fc700 1 -- 172.21.15.37:0/1809541312 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f9340020070 con 0x55d31dc1a070 2024-05-09T01:11:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.198+0000 7f932e7fc700 10 client.26699 handle_command_reply: tid=0 2024-05-09T01:11:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.198+0000 7f935bd69b80 1 client.26699 shutdown 2024-05-09T01:11:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 msgr2=0x55d31dc0a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc0a6a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55d31dc070c0 tx=0x7f93300198d0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 shutdown_connections 2024-05-09T01:11:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc1a070 0x55d31dc1c4c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc0abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31da834a0 0x55d31dc0a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 --2- 172.21.15.37:0/1809541312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31db6d160 0x55d31dc0a6a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 >> 172.21.15.37:0/1809541312 conn(0x55d31dae36a0 msgr2=0x55d31dbfb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.199+0000 7f932e7fc700 0 client.26699 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:11:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.200+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 shutdown_connections 2024-05-09T01:11:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.200+0000 7f935bd69b80 1 -- 172.21.15.37:0/1809541312 wait complete. 2024-05-09T01:11:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.200+0000 7f935bd69b80 20 client.26699 trim_cache size 0 max 16384 2024-05-09T01:11:18.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.227+0000 7f935bd69b80 1 Processor -- start 2024-05-09T01:11:18.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.228+0000 7f935bd69b80 1 -- start start 2024-05-09T01:11:18.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.228+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31da834a0 0x55d31dc090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.229+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc0aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.229+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31da834a0 0x55d31dc090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.229+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31da834a0 0x55d31dc090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56136/0 (socket says 172.21.15.37:56136) 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.229+0000 7f933ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc0aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.230+0000 7f933ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc0aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49488/0 (socket says 172.21.15.37:49488) 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.230+0000 7f933ffff700 1 -- 172.21.15.37:0/2831867044 learned_addr learned my addr 172.21.15.37:0/2831867044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.230+0000 7f935bd69b80 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc04510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.230+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93481bd7d0 con 0x55d31db6d160 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.230+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93481bf3a0 con 0x55d31da834a0 2024-05-09T01:11:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.230+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93481bdea0 con 0x55d31dc006a0 2024-05-09T01:11:18.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.230+0000 7f93477fe700 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc04510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.231+0000 7f9346ffd700 1 -- 172.21.15.37:0/2831867044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 msgr2=0x55d31dc04510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.231+0000 7f9346ffd700 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc04510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.231+0000 7f9346ffd700 1 -- 172.21.15.37:0/2831867044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 msgr2=0x55d31dc0aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.231+0000 7f9346ffd700 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc0aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.231+0000 7f9346ffd700 1 -- 172.21.15.37:0/2831867044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d31dc086d0 con 0x55d31da834a0 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.231+0000 7f9346ffd700 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31da834a0 0x55d31dc090c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55d31dc1cc00 tx=0x7f934000b3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28e10375f5d10f57 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.231+0000 7f933cff9700 1 -- 172.21.15.37:0/2831867044 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340000f40 con 0x55d31da834a0 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.232+0000 7f933cff9700 1 -- 172.21.15.37:0/2831867044 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9340020030 con 0x55d31da834a0 2024-05-09T01:11:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.232+0000 7f933cff9700 1 -- 172.21.15.37:0/2831867044 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934002d3b0 con 0x55d31da834a0 2024-05-09T01:11:18.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31da834a0 msgr2=0x55d31dc090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31da834a0 0x55d31dc090c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55d31dc1cc00 tx=0x7f934000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 shutdown_connections 2024-05-09T01:11:18.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31dc006a0 0x55d31dc04510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31da834a0 0x55d31dc090c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 --2- 172.21.15.37:0/2831867044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc0aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 >> 172.21.15.37:0/2831867044 conn(0x55d31dae36a0 msgr2=0x55d31dc03e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 shutdown_connections 2024-05-09T01:11:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 -- 172.21.15.37:0/2831867044 wait complete. 2024-05-09T01:11:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.233+0000 7f935bd69b80 1 -- start start 2024-05-09T01:11:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 1 Processor -- start 2024-05-09T01:11:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc12660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc21230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31dc006a0 0x55d31dc21770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93481becd0 con 0x55d31db6d160 2024-05-09T01:11:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93481be600 con 0x55d31dc006a0 2024-05-09T01:11:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93481bb880 con 0x55d31da834a0 2024-05-09T01:11:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f935bd69b80 10 client.0 _ll_register_callbacks cb 0x55d31d9946c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f933ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc21230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc12660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f9346ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc12660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38440/0 (socket says 172.21.15.37:38440) 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f9346ffd700 1 -- 172.21.15.37:0/4140993523 learned_addr learned my addr 172.21.15.37:0/4140993523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.234+0000 7f933ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc21230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49498/0 (socket says 172.21.15.37:49498) 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f93477fe700 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31dc006a0 0x55d31dc21770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f9346ffd700 1 -- 172.21.15.37:0/4140993523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31dc006a0 msgr2=0x55d31dc21770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f9346ffd700 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31dc006a0 0x55d31dc21770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f9346ffd700 1 -- 172.21.15.37:0/4140993523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 msgr2=0x55d31dc21230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f9346ffd700 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc21230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f9346ffd700 1 -- 172.21.15.37:0/4140993523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d31dc21d30 con 0x55d31da834a0 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f9346ffd700 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc12660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9340013ed0 tx=0x7f934000b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e793f320263166ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.235+0000 7f932e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f932e7fc700 1 -- 172.21.15.37:0/4140993523 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934003a060 con 0x55d31da834a0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f932e7fc700 1 -- 172.21.15.37:0/4140993523 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93400092e0 con 0x55d31da834a0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9340020030 con 0x55d31da834a0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f932e7fc700 1 -- 172.21.15.37:0/4140993523 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f9340003a00 con 0x55d31da834a0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 10 client.26677 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55d31dc95530 con 0x55d31da834a0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f932e7fc700 1 -- 172.21.15.37:0/4140993523 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9340020030 con 0x55d31da834a0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f932e7fc700 1 -- 172.21.15.37:0/4140993523 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f934003f070 con 0x55d31da834a0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 10 client.26677 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 10 client.26677 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 20 client.26677 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc957b0 0x55d31dc97bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 4 client.26677 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.236+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d31db309d0 con 0x55d31dc957b0 2024-05-09T01:11:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.237+0000 7f933ffff700 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc957b0 0x55d31dc97bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.237+0000 7f932e7fc700 10 client.26677 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:11:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.237+0000 7f933ffff700 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc957b0 0x55d31dc97bd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88c42b03eaba14b server_cookie=79ee1ead9889ad9d in_seq=0 out_seq=0 2024-05-09T01:11:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f932e7fc700 1 -- 172.21.15.37:0/4140993523 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d31db309d0 con 0x55d31dc957b0 2024-05-09T01:11:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f932e7fc700 10 client.26677 handle_command_reply: tid=0 2024-05-09T01:11:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 client.26677 shutdown 2024-05-09T01:11:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 msgr2=0x55d31dc12660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc12660 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9340013ed0 tx=0x7f934000b950 comp rx=0 tx=0).stop 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 shutdown_connections 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55d31dc957b0 0x55d31dc97bd0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d31dc006a0 0x55d31dc21770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d31da834a0 0x55d31dc12660 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 --2- 172.21.15.37:0/4140993523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d31db6d160 0x55d31dc21230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 >> 172.21.15.37:0/4140993523 conn(0x55d31dae36a0 msgr2=0x55d31dbff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.238+0000 7f932e7fc700 0 client.26677 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.239+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 shutdown_connections 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.239+0000 7f935bd69b80 1 -- 172.21.15.37:0/4140993523 wait complete. 2024-05-09T01:11:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.242+0000 7f935bd69b80 20 client.26677 trim_cache size 0 max 16384 2024-05-09T01:11:18.244 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:11:18.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.242+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93340b2a80 msgr2=0x7f93340b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.242+0000 7f934d353700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93340b2a80 0x7f93340b4f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9330016000 tx=0x7f933001d000 comp rx=0 tx=0).stop 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.242+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 msgr2=0x7f9348075230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.242+0000 7f934d353700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 0x7f9348075230 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f933800b4a0 tx=0x7f933800b7b0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 shutdown_connections 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93340b2a80 0x7f93340b4f90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9348108740 0x7f9348075230 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93481034c0 0x7f934810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 --2- 172.21.15.37:0/4152256391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9348107df0 0x7f934810ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 >> 172.21.15.37:0/4152256391 conn(0x7f93480fedc0 msgr2=0x7f9348107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 shutdown_connections 2024-05-09T01:11:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:18.243+0000 7f934d353700 1 -- 172.21.15.37:0/4152256391 wait complete. 2024-05-09T01:11:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:18 smithi136 ceph-mon[34110]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 779 op/s 2024-05-09T01:11:18.640 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:18 smithi037 ceph-mon[30122]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 779 op/s 2024-05-09T01:11:18.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:18 smithi151 ceph-mon[34780]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 779 op/s 2024-05-09T01:11:19.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:11:19.536 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 540.0 s, 1593.0 tps, lat 63.612 ms stddev 78.549 2024-05-09T01:11:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:20 smithi136 ceph-mon[34110]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 739 op/s 2024-05-09T01:11:20.695 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:20 smithi037 ceph-mon[30122]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 739 op/s 2024-05-09T01:11:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:20 smithi151 ceph-mon[34780]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 739 op/s 2024-05-09T01:11:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.591+0000 7f62d6864700 1 -- 172.21.15.37:0/186967165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010a930 msgr2=0x7f62d010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.591+0000 7f62d6864700 1 --2- 172.21.15.37:0/186967165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010a930 0x7f62d010ad40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009f90 tx=0x7f62c800b330 comp rx=0 tx=0).stop 2024-05-09T01:11:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.591+0000 7f62d6864700 1 -- 172.21.15.37:0/186967165 shutdown_connections 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.591+0000 7f62d6864700 1 --2- 172.21.15.37:0/186967165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 0x7f62d011fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.591+0000 7f62d6864700 1 --2- 172.21.15.37:0/186967165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010a930 0x7f62d010ad40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.591+0000 7f62d6864700 1 --2- 172.21.15.37:0/186967165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62d010b280 0x7f62d011d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.591+0000 7f62d6864700 1 -- 172.21.15.37:0/186967165 >> 172.21.15.37:0/186967165 conn(0x7f62d006f4d0 msgr2=0x7f62d006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.592+0000 7f62d6864700 1 -- 172.21.15.37:0/186967165 shutdown_connections 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.592+0000 7f62d6864700 1 -- 172.21.15.37:0/186967165 wait complete. 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.593+0000 7f62d6864700 1 Processor -- start 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.593+0000 7f62d6864700 1 -- start start 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.593+0000 7f62d6864700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62d010a930 0x7f62d011d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d6864700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010b280 0x7f62d0119400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d6864700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 0x7f62d0119980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d6864700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62d0115410 con 0x7f62d010a930 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d6864700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f62d0115290 con 0x7f62d010b280 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d6864700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f62d0115590 con 0x7f62d011d930 2024-05-09T01:11:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 0x7f62d0119980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 0x7f62d0119980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38454/0 (socket says 172.21.15.37:38454) 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 -- 172.21.15.37:0/797237047 learned_addr learned my addr 172.21.15.37:0/797237047 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010b280 0x7f62d0119400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62cffff700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62d010a930 0x7f62d011d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 -- 172.21.15.37:0/797237047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010b280 msgr2=0x7f62d0119400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010b280 0x7f62d0119400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 -- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62d010a930 msgr2=0x7f62d011d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62d010a930 0x7f62d011d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.594+0000 7f62d4e01700 1 -- 172.21.15.37:0/797237047 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d011a1b0 con 0x7f62d011d930 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.595+0000 7f62d4e01700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 0x7f62d0119980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62c001c8c0 tx=0x7f62c001cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.595+0000 7f62cd7fa700 1 -- 172.21.15.37:0/797237047 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0013070 con 0x7f62d011d930 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.595+0000 7f62cd7fa700 1 -- 172.21.15.37:0/797237047 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c0005020 con 0x7f62d011d930 2024-05-09T01:11:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.595+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d01cf990 con 0x7f62d011d930 2024-05-09T01:11:21.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.595+0000 7f62cd7fa700 1 -- 172.21.15.37:0/797237047 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c000fa70 con 0x7f62d011d930 2024-05-09T01:11:21.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.595+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d01cfea0 con 0x7f62d011d930 2024-05-09T01:11:21.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.598+0000 7f62cd7fa700 1 -- 172.21.15.37:0/797237047 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f62c00051d0 con 0x7f62d011d930 2024-05-09T01:11:21.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.599+0000 7f62cd7fa700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f62b80b2940 0x7f62b80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.599+0000 7f62cffff700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f62b80b2940 0x7f62b80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.599+0000 7f62cd7fa700 1 -- 172.21.15.37:0/797237047 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f62c00e22c0 con 0x7f62d011d930 2024-05-09T01:11:21.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.600+0000 7f62cffff700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f62b80b2940 0x7f62b80b4e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f62c8000f80 tx=0x7f62c8009c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:21.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.600+0000 7f62e527ab80 1 Processor -- start 2024-05-09T01:11:21.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.600+0000 7f62e527ab80 1 -- start start 2024-05-09T01:11:21.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71ab240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70284a0 0x5585c71ab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c71a5400 0x5585c71a5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62e527ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5585c70c80a0 con 0x5585c70284a0 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62e527ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5585c706d9a0 con 0x5585c71a5400 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62e527ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5585c70c4060 con 0x5585c70a2d00 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70284a0 0x5585c71ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70284a0 0x5585c71ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49528/0 (socket says 172.21.15.37:49528) 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62cf7fe700 1 -- 172.21.15.37:0/2334378881 learned_addr learned my addr 172.21.15.37:0/2334378881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62cffff700 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.601+0000 7f62d4e01700 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c71a5400 0x5585c71a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.602+0000 7f62d4e01700 1 -- 172.21.15.37:0/2334378881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 msgr2=0x5585c71ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.602+0000 7f62d4e01700 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.602+0000 7f62d4e01700 1 -- 172.21.15.37:0/2334378881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70284a0 msgr2=0x5585c71ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.602+0000 7f62d4e01700 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70284a0 0x5585c71ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.602+0000 7f62d4e01700 1 -- 172.21.15.37:0/2334378881 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c705e500 con 0x5585c71a5400 2024-05-09T01:11:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.602+0000 7f62d4e01700 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c71a5400 0x5585c71a5810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62c00046e0 tx=0x7f62c00a9180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6d42e300cfcd04 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:21.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.603+0000 7f62b67fc700 1 -- 172.21.15.37:0/2334378881 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c00a5070 con 0x5585c71a5400 2024-05-09T01:11:21.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.603+0000 7f62b67fc700 1 -- 172.21.15.37:0/2334378881 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c008fe50 con 0x5585c71a5400 2024-05-09T01:11:21.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.603+0000 7f62b67fc700 1 -- 172.21.15.37:0/2334378881 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c00b22b0 con 0x5585c71a5400 2024-05-09T01:11:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 -- 172.21.15.37:0/2334378881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c71a5400 msgr2=0x5585c71a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c71a5400 0x5585c71a5810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f62c00046e0 tx=0x7f62c00a9180 comp rx=0 tx=0).stop 2024-05-09T01:11:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 -- 172.21.15.37:0/2334378881 shutdown_connections 2024-05-09T01:11:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c71a5400 0x5585c71a5810 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2334378881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70284a0 0x5585c71ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 -- 172.21.15.37:0/2334378881 >> 172.21.15.37:0/2334378881 conn(0x5585c702bf70 msgr2=0x5585c71a0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 -- 172.21.15.37:0/2334378881 shutdown_connections 2024-05-09T01:11:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.606+0000 7f62e527ab80 1 -- 172.21.15.37:0/2334378881 wait complete. 2024-05-09T01:11:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.607+0000 7f62e527ab80 1 -- start start 2024-05-09T01:11:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.607+0000 7f62e527ab80 1 Processor -- start 2024-05-09T01:11:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71af170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62e527ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5585c71a6160 con 0x5585c71a5400 2024-05-09T01:11:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62e527ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5585c7062b20 con 0x5585c70284a0 2024-05-09T01:11:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62e527ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5585c71b2020 con 0x5585c70a2d00 2024-05-09T01:11:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62d4e01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62e527ab80 10 client.0 _ll_register_callbacks cb 0x5585c6f396c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39406/0 (socket says 172.21.15.37:39406) 2024-05-09T01:11:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62cf7fe700 1 -- 172.21.15.37:0/459666465 learned_addr learned my addr 172.21.15.37:0/459666465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62cffff700 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62d4e01700 1 -- 172.21.15.37:0/459666465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 msgr2=0x5585c71af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62d4e01700 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62d4e01700 1 -- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 msgr2=0x5585c71af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62d4e01700 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.608+0000 7f62d4e01700 1 -- 172.21.15.37:0/459666465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c6f43490 con 0x5585c71a5400 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62d4e01700 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71afbf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f62c00a9870 tx=0x7f62c00a9d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65f8db31d255d98 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62af7fe700 1 -- 172.21.15.37:0/459666465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c00adc90 con 0x5585c71a5400 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62af7fe700 1 -- 172.21.15.37:0/459666465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f62c00a5ed0 con 0x5585c71a5400 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62c008fe50 con 0x5585c71a5400 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62af7fe700 1 -- 172.21.15.37:0/459666465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f62c00b2740 con 0x5585c71a5400 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62e527ab80 10 client.16881 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.609+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5585c71bc940 con 0x5585c71a5400 2024-05-09T01:11:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62af7fe700 1 -- 172.21.15.37:0/459666465 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c00b24c0 con 0x5585c71a5400 2024-05-09T01:11:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62af7fe700 1 -- 172.21.15.37:0/459666465 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f62c00a5250 con 0x5585c71a5400 2024-05-09T01:11:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62e527ab80 10 client.16881 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62e527ab80 10 client.16881 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:11:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62e527ab80 20 client.16881 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62e527ab80 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c71c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62e527ab80 4 client.16881 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f62c008fe50 con 0x5585c71bee10 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.610+0000 7f62cffff700 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c71c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.611+0000 7f62af7fe700 10 client.16881 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.611+0000 7f62cffff700 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c71c1230 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89f2e5912bb1e7f5 server_cookie=bebd34b574acedce in_seq=0 out_seq=0 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.611+0000 7f62af7fe700 1 -- 172.21.15.37:0/459666465 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f62c008fe50 con 0x5585c71bee10 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.611+0000 7f62af7fe700 10 client.16881 handle_command_reply: tid=0 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 client.16881 shutdown 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 msgr2=0x5585c71afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71afbf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f62c00a9870 tx=0x7f62c00a9d70 comp rx=0 tx=0).stop 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 shutdown_connections 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c71c1230 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71afbf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62af7fe700 0 client.16881 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:11:21.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 --2- 172.21.15.37:0/459666465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70a2d00 0x5585c71af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.612+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 >> 172.21.15.37:0/459666465 conn(0x5585c702bf70 msgr2=0x5585c7199ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:21.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.613+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 shutdown_connections 2024-05-09T01:11:21.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.613+0000 7f62e527ab80 1 -- 172.21.15.37:0/459666465 wait complete. 2024-05-09T01:11:21.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.613+0000 7f62e527ab80 20 client.16881 trim_cache size 0 max 16384 2024-05-09T01:11:21.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.633+0000 7f62e527ab80 1 Processor -- start 2024-05-09T01:11:21.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62e527ab80 1 -- start start 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70284a0 0x5585c71aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70a2d00 0x5585c719a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62e527ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62d01d7280 con 0x5585c71a5400 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62e527ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f62d01d8e50 con 0x5585c70a2d00 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62e527ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f62d01d7950 con 0x5585c70284a0 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62d4e01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62d4e01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33546/0 (socket says 172.21.15.37:33546) 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62d4e01700 1 -- 172.21.15.37:0/2923573943 learned_addr learned my addr 172.21.15.37:0/2923573943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70a2d00 0x5585c719a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.634+0000 7f62cffff700 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70284a0 0x5585c71aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62cf7fe700 1 -- 172.21.15.37:0/2923573943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70284a0 msgr2=0x5585c71aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70284a0 0x5585c71aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62cf7fe700 1 -- 172.21.15.37:0/2923573943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 msgr2=0x5585c71c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62cf7fe700 1 -- 172.21.15.37:0/2923573943 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585c71a9c10 con 0x5585c70a2d00 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70a2d00 0x5585c719a700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5585c719ca10 tx=0x7f62c4009c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77096933b98fc761 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62b5ffb700 1 -- 172.21.15.37:0/2923573943 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4022070 con 0x5585c70a2d00 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62b5ffb700 1 -- 172.21.15.37:0/2923573943 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c4014c90 con 0x5585c70a2d00 2024-05-09T01:11:21.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.635+0000 7f62b5ffb700 1 -- 172.21.15.37:0/2923573943 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c401dd10 con 0x5585c70a2d00 2024-05-09T01:11:21.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.636+0000 7f62e527ab80 1 -- 172.21.15.37:0/2923573943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70a2d00 msgr2=0x5585c719a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.636+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70a2d00 0x5585c719a700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x5585c719ca10 tx=0x7f62c4009c10 comp rx=0 tx=0).stop 2024-05-09T01:11:21.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 -- 172.21.15.37:0/2923573943 shutdown_connections 2024-05-09T01:11:21.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c71a5400 0x5585c71c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c70284a0 0x5585c71aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 --2- 172.21.15.37:0/2923573943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70a2d00 0x5585c719a700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 -- 172.21.15.37:0/2923573943 >> 172.21.15.37:0/2923573943 conn(0x5585c702bf70 msgr2=0x5585c7199ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 -- 172.21.15.37:0/2923573943 shutdown_connections 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 -- 172.21.15.37:0/2923573943 wait complete. 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 -- start start 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.637+0000 7f62e527ab80 1 Processor -- start 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70a2d00 0x5585c71c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62e527ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c71a5400 0x5585c71c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62e527ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62d01d8780 con 0x5585c70a2d00 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62e527ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f62d01d80b0 con 0x5585c70284a0 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62e527ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f62d01d5240 con 0x5585c71a5400 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62e527ab80 10 client.0 _ll_register_callbacks cb 0x5585c6f396c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:21.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70a2d00 0x5585c71c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70a2d00 0x5585c71c1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33548/0 (socket says 172.21.15.37:33548) 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cf7fe700 1 -- 172.21.15.37:0/1776911460 learned_addr learned my addr 172.21.15.37:0/1776911460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62d4e01700 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c71a5400 0x5585c71c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cffff700 1 -- 172.21.15.37:0/1776911460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c71a5400 msgr2=0x5585c71c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cffff700 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c71a5400 0x5585c71c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cffff700 1 -- 172.21.15.37:0/1776911460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70a2d00 msgr2=0x5585c71c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.638+0000 7f62cffff700 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70a2d00 0x5585c71c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62cffff700 1 -- 172.21.15.37:0/1776911460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585c71c2310 con 0x5585c70284a0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70a2d00 0x5585c71c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62cffff700 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71c4470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5585c7062b50 tx=0x7f62c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6321ac4ce36336 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62af7fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62af7fe700 1 -- 172.21.15.37:0/1776911460 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c8036070 con 0x5585c70284a0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62c4014c90 con 0x5585c70284a0 2024-05-09T01:11:21.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62af7fe700 1 -- 172.21.15.37:0/1776911460 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f62c8032590 con 0x5585c70284a0 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62af7fe700 1 -- 172.21.15.37:0/1776911460 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f62c80327d0 con 0x5585c70284a0 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62e527ab80 10 client.26723 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5585c7228f60 con 0x5585c70284a0 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.639+0000 7f62af7fe700 1 -- 172.21.15.37:0/1776911460 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c4014c90 con 0x5585c70284a0 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62af7fe700 1 -- 172.21.15.37:0/1776911460 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7f62c8011070 con 0x5585c70284a0 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62e527ab80 10 client.26723 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62e527ab80 10 client.26723 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62e527ab80 20 client.26723 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62e527ab80 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c722b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62e527ab80 4 client.26723 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585c70d5a80 con 0x5585c71bee10 2024-05-09T01:11:21.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.640+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c722b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62af7fe700 10 client.26723 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62cf7fe700 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c722b660 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4a0a7e5cc61046 server_cookie=de886ed5a42b009d in_seq=0 out_seq=0 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62af7fe700 1 -- 172.21.15.37:0/1776911460 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585c70d5a80 con 0x5585c71bee10 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62af7fe700 10 client.26723 handle_command_reply: tid=0 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 client.26723 shutdown 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 msgr2=0x5585c71c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71c4470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x5585c7062b50 tx=0x7f62c800b330 comp rx=0 tx=0).stop 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 shutdown_connections 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c71a5400 0x5585c71c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5585c70284a0 0x5585c71c4470 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x5585c71bee10 0x5585c722b660 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 --2- 172.21.15.37:0/1776911460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585c70a2d00 0x5585c71c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 >> 172.21.15.37:0/1776911460 conn(0x5585c702bf70 msgr2=0x5585c719a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:21.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62af7fe700 0 client.26723 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:11:21.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 shutdown_connections 2024-05-09T01:11:21.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 1 -- 172.21.15.37:0/1776911460 wait complete. 2024-05-09T01:11:21.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.643+0000 7f62e527ab80 20 client.26723 trim_cache size 0 max 16384 2024-05-09T01:11:21.647 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f62b80b2940 msgr2=0x7f62b80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f62b80b2940 0x7f62b80b4e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f62c8000f80 tx=0x7f62c8009c80 comp rx=0 tx=0).stop 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 msgr2=0x7f62d0119980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 0x7f62d0119980 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62c001c8c0 tx=0x7f62c001cbd0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 shutdown_connections 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f62b80b2940 0x7f62b80b4e50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62d011d930 0x7f62d0119980 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62d010a930 0x7f62d011d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 --2- 172.21.15.37:0/797237047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62d010b280 0x7f62d0119400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 >> 172.21.15.37:0/797237047 conn(0x7f62d006f4d0 msgr2=0x7f62d011df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 shutdown_connections 2024-05-09T01:11:21.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:21.644+0000 7f62d6864700 1 -- 172.21.15.37:0/797237047 wait complete. 2024-05-09T01:11:22.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:11:22.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:22 smithi037 ceph-mon[30122]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 788 op/s 2024-05-09T01:11:22.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:22 smithi136 ceph-mon[34110]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 788 op/s 2024-05-09T01:11:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:22 smithi151 ceph-mon[34780]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 788 op/s 2024-05-09T01:11:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:24.461 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:24 smithi037 ceph-mon[30122]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 726 op/s 2024-05-09T01:11:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:24 smithi136 ceph-mon[34110]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 726 op/s 2024-05-09T01:11:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:24 smithi151 ceph-mon[34780]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 726 op/s 2024-05-09T01:11:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.764+0000 7fd545ef6700 1 -- 172.21.15.37:0/889200881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 msgr2=0x7fd540108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.764+0000 7fd545ef6700 1 --2- 172.21.15.37:0/889200881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 0x7fd540108200 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd5340099c0 tx=0x7fd534009cd0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.764+0000 7fd545ef6700 1 -- 172.21.15.37:0/889200881 shutdown_connections 2024-05-09T01:11:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.764+0000 7fd545ef6700 1 --2- 172.21.15.37:0/889200881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540108740 0x7fd5401100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.764+0000 7fd545ef6700 1 --2- 172.21.15.37:0/889200881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5401034c0 0x7fd5401038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.764+0000 7fd545ef6700 1 --2- 172.21.15.37:0/889200881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 0x7fd540108200 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.764+0000 7fd545ef6700 1 -- 172.21.15.37:0/889200881 >> 172.21.15.37:0/889200881 conn(0x7fd5400fedc0 msgr2=0x7fd5401011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.765+0000 7fd545ef6700 1 -- 172.21.15.37:0/889200881 shutdown_connections 2024-05-09T01:11:24.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.765+0000 7fd545ef6700 1 -- 172.21.15.37:0/889200881 wait complete. 2024-05-09T01:11:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.766+0000 7fd545ef6700 1 Processor -- start 2024-05-09T01:11:24.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.766+0000 7fd545ef6700 1 -- start start 2024-05-09T01:11:24.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.766+0000 7fd545ef6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5401034c0 0x7fd54019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd545ef6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 0x7fd54019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd545ef6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540108740 0x7fd54019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd545ef6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd540113350 con 0x7fd540107df0 2024-05-09T01:11:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd545ef6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd5401131d0 con 0x7fd540108740 2024-05-09T01:11:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd545ef6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd5401134d0 con 0x7fd5401034c0 2024-05-09T01:11:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 0x7fd54019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5401034c0 0x7fd54019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 0x7fd54019b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33568/0 (socket says 172.21.15.37:33568) 2024-05-09T01:11:24.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53effd700 1 -- 172.21.15.37:0/3019546252 learned_addr learned my addr 172.21.15.37:0/3019546252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53ffff700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540108740 0x7fd54019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53ffff700 1 -- 172.21.15.37:0/3019546252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5401034c0 msgr2=0x7fd54019adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53ffff700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5401034c0 0x7fd54019adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.767+0000 7fd53ffff700 1 -- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 msgr2=0x7fd54019b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd53ffff700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 0x7fd54019b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd53ffff700 1 -- 172.21.15.37:0/3019546252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54019fcc0 con 0x7fd540108740 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5401034c0 0x7fd54019adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd53ffff700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540108740 0x7fd54019f620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd53800efc0 tx=0x7fd53800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd53cff9700 1 -- 172.21.15.37:0/3019546252 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5380092e0 con 0x7fd540108740 2024-05-09T01:11:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd53cff9700 1 -- 172.21.15.37:0/3019546252 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd538004bb0 con 0x7fd540108740 2024-05-09T01:11:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd53cff9700 1 -- 172.21.15.37:0/3019546252 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538004020 con 0x7fd540108740 2024-05-09T01:11:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54019ff50 con 0x7fd540108740 2024-05-09T01:11:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.768+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5401a0440 con 0x7fd540108740 2024-05-09T01:11:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.772+0000 7fd53cff9700 1 -- 172.21.15.37:0/3019546252 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd53801b030 con 0x7fd540108740 2024-05-09T01:11:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 Processor -- start 2024-05-09T01:11:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 -- start start 2024-05-09T01:11:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51b4ad00 0x55fc51c53240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c53780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c4d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc51b700a0 con 0x55fc51ad04a0 2024-05-09T01:11:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fc51b159a0 con 0x55fc51b4ad00 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd55490cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fc51b6c060 con 0x55fc51c4d400 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd53cff9700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5280b2980 0x7fd5280b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd53effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51b4ad00 0x55fc51c53240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd53effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51b4ad00 0x55fc51c53240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49574/0 (socket says 172.21.15.37:49574) 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd53effd700 1 -- 172.21.15.37:0/3065407918 learned_addr learned my addr 172.21.15.37:0/3065407918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c53780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.774+0000 7fd53effd700 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c4d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53ffff700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5280b2980 0x7fd5280b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53effd700 1 -- 172.21.15.37:0/3065407918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 msgr2=0x55fc51c4d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53effd700 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c4d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53effd700 1 -- 172.21.15.37:0/3065407918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 msgr2=0x55fc51c53780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53effd700 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c53780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53effd700 1 -- 172.21.15.37:0/3065407918 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc51b06500 con 0x55fc51b4ad00 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53cff9700 1 -- 172.21.15.37:0/3019546252 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd5380e1c20 con 0x7fd540108740 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53effd700 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51b4ad00 0x55fc51c53240 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd5340092c0 tx=0x7fd534009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc731698fdd8356e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.775+0000 7fd53ffff700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5280b2980 0x7fd5280b4e90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd5380dcdb0 tx=0x7fd5380a5270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.776+0000 7fd525ffb700 1 -- 172.21.15.37:0/3065407918 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534005460 con 0x55fc51b4ad00 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.776+0000 7fd525ffb700 1 -- 172.21.15.37:0/3065407918 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd534005600 con 0x55fc51b4ad00 2024-05-09T01:11:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd525ffb700 1 -- 172.21.15.37:0/3065407918 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53400bd30 con 0x55fc51b4ad00 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 -- 172.21.15.37:0/3065407918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51b4ad00 msgr2=0x55fc51c53240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51b4ad00 0x55fc51c53240 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd5340092c0 tx=0x7fd534009250 comp rx=0 tx=0).stop 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 -- 172.21.15.37:0/3065407918 shutdown_connections 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c4d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51b4ad00 0x55fc51c53240 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 --2- 172.21.15.37:0/3065407918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c53780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 -- 172.21.15.37:0/3065407918 >> 172.21.15.37:0/3065407918 conn(0x55fc51ad3f70 msgr2=0x55fc51c48220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 -- 172.21.15.37:0/3065407918 shutdown_connections 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 -- 172.21.15.37:0/3065407918 wait complete. 2024-05-09T01:11:24.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.777+0000 7fd55490cb80 1 -- start start 2024-05-09T01:11:24.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 1 Processor -- start 2024-05-09T01:11:24.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51ad04a0 0x55fc51c56f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c574a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc51c4e1a0 con 0x55fc51b4ad00 2024-05-09T01:11:24.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fc51b0ab20 con 0x55fc51c4d400 2024-05-09T01:11:24.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fc51c6b030 con 0x55fc51ad04a0 2024-05-09T01:11:24.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd55490cb80 10 client.0 _ll_register_callbacks cb 0x55fc519e16c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:24.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd53f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd53effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51ad04a0 0x55fc51c56f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.778+0000 7fd53effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51ad04a0 0x55fc51c56f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39432/0 (socket says 172.21.15.37:39432) 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53effd700 1 -- 172.21.15.37:0/2112142023 learned_addr learned my addr 172.21.15.37:0/2112142023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53effd700 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53f7fe700 1 -- 172.21.15.37:0/2112142023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51ad04a0 msgr2=0x55fc51c56f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51ad04a0 0x55fc51c56f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53f7fe700 1 -- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 msgr2=0x55fc51c579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53f7fe700 1 -- 172.21.15.37:0/2112142023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc519eb490 con 0x55fc51b4ad00 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53effd700 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51ad04a0 0x55fc51c56f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c574a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x55fc51c49c90 tx=0x7fd530009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f0e948c904d7d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd51effd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd51effd700 1 -- 172.21.15.37:0/2112142023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd530004050 con 0x55fc51b4ad00 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd51effd700 1 -- 172.21.15.37:0/2112142023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd5300041f0 con 0x55fc51b4ad00 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.779+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd534005600 con 0x55fc51b4ad00 2024-05-09T01:11:24.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd51effd700 1 -- 172.21.15.37:0/2112142023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fd5300043f0 con 0x55fc51b4ad00 2024-05-09T01:11:24.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 10 client.16899 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:24.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55fc51c75a70 con 0x55fc51b4ad00 2024-05-09T01:11:24.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd51effd700 1 -- 172.21.15.37:0/2112142023 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd534005600 con 0x55fc51b4ad00 2024-05-09T01:11:24.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd51effd700 1 -- 172.21.15.37:0/2112142023 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fd530003b80 con 0x55fc51b4ad00 2024-05-09T01:11:24.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 10 client.16899 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:24.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 20 client.16899 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51c780b0 0x55fc51c7a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 4 client.16899 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.780+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc51b7da80 con 0x55fc51c780b0 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.781+0000 7fd53effd700 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51c780b0 0x55fc51c7a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.781+0000 7fd53effd700 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51c780b0 0x55fc51c7a4d0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a21ae860a0bc3a9 server_cookie=1a61a57217e3c750 in_seq=0 out_seq=0 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.782+0000 7fd51effd700 10 client.16899 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.782+0000 7fd51effd700 1 -- 172.21.15.37:0/2112142023 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fc51b7da80 con 0x55fc51c780b0 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.782+0000 7fd51effd700 10 client.16899 handle_command_reply: tid=0 2024-05-09T01:11:24.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.782+0000 7fd55490cb80 1 client.16899 shutdown 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 msgr2=0x55fc51c574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c574a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x55fc51c49c90 tx=0x7fd530009e20 comp rx=0 tx=0).stop 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 shutdown_connections 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51c780b0 0x55fc51c7a4d0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51ad04a0 0x55fc51c56f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2112142023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c574a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 >> 172.21.15.37:0/2112142023 conn(0x55fc51ad3f70 msgr2=0x55fc51c41ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd51effd700 0 client.16899 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 shutdown_connections 2024-05-09T01:11:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.783+0000 7fd55490cb80 1 -- 172.21.15.37:0/2112142023 wait complete. 2024-05-09T01:11:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.784+0000 7fd55490cb80 20 client.16899 trim_cache size 0 max 16384 2024-05-09T01:11:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.802+0000 7fd55490cb80 1 Processor -- start 2024-05-09T01:11:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.802+0000 7fd55490cb80 1 -- start start 2024-05-09T01:11:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c56280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51b4ad00 0x55fc51c57820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c73f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd55490cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd540072130 con 0x55fc51ad04a0 2024-05-09T01:11:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd55490cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd540073d00 con 0x55fc51c4d400 2024-05-09T01:11:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd55490cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd540072800 con 0x55fc51b4ad00 2024-05-09T01:11:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c56280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c56280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33594/0 (socket says 172.21.15.37:33594) 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 -- 172.21.15.37:0/1181815902 learned_addr learned my addr 172.21.15.37:0/1181815902 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c73f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51b4ad00 0x55fc51c57820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 -- 172.21.15.37:0/1181815902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51b4ad00 msgr2=0x55fc51c57820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51b4ad00 0x55fc51c57820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 -- 172.21.15.37:0/1181815902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 msgr2=0x55fc51c73f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c73f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.803+0000 7fd53effd700 1 -- 172.21.15.37:0/1181815902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc51c449d0 con 0x55fc51ad04a0 2024-05-09T01:11:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.804+0000 7fd53effd700 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c56280 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd53400b700 tx=0x7fd534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60a193a29d7b6dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.804+0000 7fd5257fa700 1 -- 172.21.15.37:0/1181815902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53402c040 con 0x55fc51ad04a0 2024-05-09T01:11:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.804+0000 7fd5257fa700 1 -- 172.21.15.37:0/1181815902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd534003c70 con 0x55fc51ad04a0 2024-05-09T01:11:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.804+0000 7fd5257fa700 1 -- 172.21.15.37:0/1181815902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53400fbd0 con 0x55fc51ad04a0 2024-05-09T01:11:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 -- 172.21.15.37:0/1181815902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 msgr2=0x55fc51c56280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c56280 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd53400b700 tx=0x7fd534009250 comp rx=0 tx=0).stop 2024-05-09T01:11:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 -- 172.21.15.37:0/1181815902 shutdown_connections 2024-05-09T01:11:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51c4d400 0x55fc51c73f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51ad04a0 0x55fc51c56280 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 --2- 172.21.15.37:0/1181815902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51b4ad00 0x55fc51c57820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 -- 172.21.15.37:0/1181815902 >> 172.21.15.37:0/1181815902 conn(0x55fc51ad3f70 msgr2=0x55fc51c51340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 -- 172.21.15.37:0/1181815902 shutdown_connections 2024-05-09T01:11:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.805+0000 7fd55490cb80 1 -- 172.21.15.37:0/1181815902 wait complete. 2024-05-09T01:11:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.806+0000 7fd55490cb80 1 -- start start 2024-05-09T01:11:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.806+0000 7fd55490cb80 1 Processor -- start 2024-05-09T01:11:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.806+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51ad04a0 0x55fc51c6b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.806+0000 7fd55490cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c6b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51ad04a0 0x55fc51c6b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53effd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51ad04a0 0x55fc51c6b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49604/0 (socket says 172.21.15.37:49604) 2024-05-09T01:11:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53effd700 1 -- 172.21.15.37:0/2301767434 learned_addr learned my addr 172.21.15.37:0/2301767434 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c6bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd540073630 con 0x55fc51b4ad00 2024-05-09T01:11:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd540072f60 con 0x55fc51ad04a0 2024-05-09T01:11:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd5400700f0 con 0x55fc51c4d400 2024-05-09T01:11:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53effd700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c6bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53effd700 1 -- 172.21.15.37:0/2301767434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 msgr2=0x55fc51c6bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53effd700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c6bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53effd700 1 -- 172.21.15.37:0/2301767434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 msgr2=0x55fc51c6b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.808+0000 7fd55490cb80 10 client.0 _ll_register_callbacks cb 0x55fc519e16c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.807+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c6b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.808+0000 7fd53effd700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c6b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.808+0000 7fd53effd700 1 -- 172.21.15.37:0/2301767434 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc51ce0810 con 0x55fc51ad04a0 2024-05-09T01:11:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.808+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c6b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:11:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.808+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd534003c70 con 0x55fc51ad04a0 2024-05-09T01:11:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.808+0000 7fd53effd700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51ad04a0 0x55fc51c6b240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd534003e80 tx=0x7fd534009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1083bf50b0fbd15c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.808+0000 7fd51effd700 10 client.26741 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:11:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.809+0000 7fd51effd700 1 -- 172.21.15.37:0/2301767434 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534003880 con 0x55fc51ad04a0 2024-05-09T01:11:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.809+0000 7fd51effd700 1 -- 172.21.15.37:0/2301767434 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd53402c040 con 0x55fc51ad04a0 2024-05-09T01:11:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.809+0000 7fd51effd700 1 -- 172.21.15.37:0/2301767434 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fd534003a20 con 0x55fc51ad04a0 2024-05-09T01:11:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.809+0000 7fd55490cb80 10 client.26741 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.809+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55fc51ce1970 con 0x55fc51ad04a0 2024-05-09T01:11:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd51effd700 1 -- 172.21.15.37:0/2301767434 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fd534032040 con 0x55fc51ad04a0 2024-05-09T01:11:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd55490cb80 10 client.26741 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd55490cb80 10 client.26741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd55490cb80 20 client.26741 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51ce1b40 0x55fc51ce3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd55490cb80 4 client.26741 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:11:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fc51b77b20 con 0x55fc51ce1b40 2024-05-09T01:11:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.810+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51ce1b40 0x55fc51ce3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd51effd700 10 client.26741 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd53f7fe700 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51ce1b40 0x55fc51ce3f60 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402732c61a5147a3 server_cookie=5503245d2e85b954 in_seq=0 out_seq=0 2024-05-09T01:11:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd51effd700 1 -- 172.21.15.37:0/2301767434 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fc51b77b20 con 0x55fc51ce1b40 2024-05-09T01:11:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd51effd700 10 client.26741 handle_command_reply: tid=0 2024-05-09T01:11:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 client.26741 shutdown 2024-05-09T01:11:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51ad04a0 msgr2=0x55fc51c6b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51ad04a0 0x55fc51c6b240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd534003e80 tx=0x7fd534009cd0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 shutdown_connections 2024-05-09T01:11:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc51ce1b40 0x55fc51ce3f60 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc51c4d400 0x55fc51c6bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc51ad04a0 0x55fc51c6b240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 --2- 172.21.15.37:0/2301767434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc51b4ad00 0x55fc51c6b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 >> 172.21.15.37:0/2301767434 conn(0x55fc51ad3f70 msgr2=0x55fc51c4c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd51effd700 0 client.26741 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 shutdown_connections 2024-05-09T01:11:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 1 -- 172.21.15.37:0/2301767434 wait complete. 2024-05-09T01:11:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.811+0000 7fd55490cb80 20 client.26741 trim_cache size 0 max 16384 2024-05-09T01:11:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:11:24.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5280b2980 msgr2=0x7fd5280b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5280b2980 0x7fd5280b4e90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd5380dcdb0 tx=0x7fd5380a5270 comp rx=0 tx=0).stop 2024-05-09T01:11:24.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540108740 msgr2=0x7fd54019f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540108740 0x7fd54019f620 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd53800efc0 tx=0x7fd53800c3a0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 shutdown_connections 2024-05-09T01:11:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd5280b2980 0x7fd5280b4e90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540108740 0x7fd54019f620 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5401034c0 0x7fd54019adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 --2- 172.21.15.37:0/3019546252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd540107df0 0x7fd54019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 >> 172.21.15.37:0/3019546252 conn(0x7fd5400fedc0 msgr2=0x7fd5401096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:24.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 shutdown_connections 2024-05-09T01:11:24.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:24.812+0000 7fd545ef6700 1 -- 172.21.15.37:0/3019546252 wait complete. 2024-05-09T01:11:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 545.0 s, 1695.0 tps, lat 58.870 ms stddev 68.788 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 -- 172.21.15.37:0/2953090824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c101ef0 msgr2=0x7fec9c102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 --2- 172.21.15.37:0/2953090824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c101ef0 0x7fec9c102340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009900 tx=0x7fec8c02a3f0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 -- 172.21.15.37:0/2953090824 shutdown_connections 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 --2- 172.21.15.37:0/2953090824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c107aa0 0x7fec9c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 --2- 172.21.15.37:0/2953090824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec9c102930 0x7fec9c102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 --2- 172.21.15.37:0/2953090824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c101ef0 0x7fec9c102340 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 -- 172.21.15.37:0/2953090824 >> 172.21.15.37:0/2953090824 conn(0x7fec9c0fd4c0 msgr2=0x7fec9c0ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 -- 172.21.15.37:0/2953090824 shutdown_connections 2024-05-09T01:11:25.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.819+0000 7feca2314640 1 -- 172.21.15.37:0/2953090824 wait complete. 2024-05-09T01:11:25.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.820+0000 7feca2314640 1 Processor -- start 2024-05-09T01:11:25.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.820+0000 7feca2314640 1 -- start start 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca2314640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec9c101ef0 0x7fec9c1a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca2314640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c102930 0x7fec9c1a0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca2314640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c107aa0 0x7fec9c1a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca2314640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c115d70 con 0x7fec9c102930 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca2314640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c115bf0 con 0x7fec9c107aa0 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca2314640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c115ef0 con 0x7fec9c101ef0 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c102930 0x7fec9c1a0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c107aa0 0x7fec9c1a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c107aa0 0x7fec9c1a7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49620/0 (socket says 172.21.15.37:49620) 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c102930 0x7fec9c1a0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33626/0 (socket says 172.21.15.37:33626) 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 -- 172.21.15.37:0/3288666602 learned_addr learned my addr 172.21.15.37:0/3288666602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7fec9bfff640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec9c101ef0 0x7fec9c1a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 -- 172.21.15.37:0/3288666602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec9c101ef0 msgr2=0x7fec9c1a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec9c101ef0 0x7fec9c1a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 -- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c102930 msgr2=0x7fec9c1a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c102930 0x7fec9c1a0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.821+0000 7feca08b1640 1 -- 172.21.15.37:0/3288666602 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c1a8470 con 0x7fec9c107aa0 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.822+0000 7feca08b1640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c107aa0 0x7fec9c1a7e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fec9400eb10 tx=0x7fec9400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.822+0000 7fec997fa640 1 -- 172.21.15.37:0/3288666602 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94004b20 con 0x7fec9c107aa0 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.822+0000 7fec997fa640 1 -- 172.21.15.37:0/3288666602 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec94004cc0 con 0x7fec9c107aa0 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.822+0000 7fec997fa640 1 -- 172.21.15.37:0/3288666602 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94010670 con 0x7fec9c107aa0 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.822+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9c1a8760 con 0x7fec9c107aa0 2024-05-09T01:11:25.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.823+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9c1a8c60 con 0x7fec9c107aa0 2024-05-09T01:11:25.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.826+0000 7fec997fa640 1 -- 172.21.15.37:0/3288666602 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fec94010830 con 0x7fec9c107aa0 2024-05-09T01:11:25.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.826+0000 7feca91c6740 1 Processor -- start 2024-05-09T01:11:25.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.826+0000 7feca91c6740 1 -- start start 2024-05-09T01:11:25.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7feca91c6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379be01b0 0x564379f84500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7feca91c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f84a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7feca91c6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7feca91c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564379ee87c0 con 0x564379bb72f0 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7feca91c6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564379e840e0 con 0x564379bbf4d0 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7feca91c6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564379ee4780 con 0x564379be01b0 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f84a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379be01b0 0x564379f84500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f84a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33628/0 (socket says 172.21.15.37:33628) 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9bfff640 1 -- 172.21.15.37:0/2392486735 learned_addr learned my addr 172.21.15.37:0/2392486735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec997fa640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fec840b29b0 0x7fec840b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9b7fe640 1 -- 172.21.15.37:0/2392486735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 msgr2=0x564379f8b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7feca08b1640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fec840b29b0 0x7fec840b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9b7fe640 1 -- 172.21.15.37:0/2392486735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 msgr2=0x564379f84a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f84a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9b7fe640 1 -- 172.21.15.37:0/2392486735 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564379ead7c0 con 0x564379be01b0 2024-05-09T01:11:25.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.827+0000 7fec9bfff640 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f84a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:25.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.828+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379be01b0 0x564379f84500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fec90005d00 tx=0x7fec90005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd9d2d64bde7dab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.828+0000 7fec997fa640 1 -- 172.21.15.37:0/3288666602 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fec940e25e0 con 0x7fec9c107aa0 2024-05-09T01:11:25.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.828+0000 7fec827fc640 1 -- 172.21.15.37:0/2392486735 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90012c80 con 0x564379be01b0 2024-05-09T01:11:25.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.828+0000 7fec827fc640 1 -- 172.21.15.37:0/2392486735 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec90012e20 con 0x564379be01b0 2024-05-09T01:11:25.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.828+0000 7fec827fc640 1 -- 172.21.15.37:0/2392486735 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90004a00 con 0x564379be01b0 2024-05-09T01:11:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.830+0000 7feca91c6740 1 -- 172.21.15.37:0/2392486735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379be01b0 msgr2=0x564379f84500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.830+0000 7feca91c6740 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379be01b0 0x564379f84500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fec90005d00 tx=0x7fec90005c90 comp rx=0 tx=0).stop 2024-05-09T01:11:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.830+0000 7feca08b1640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fec840b29b0 0x7fec840b4ec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec940a6e70 tx=0x7fec94013000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 -- 172.21.15.37:0/2392486735 shutdown_connections 2024-05-09T01:11:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f84a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 --2- 172.21.15.37:0/2392486735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379be01b0 0x564379f84500 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 -- 172.21.15.37:0/2392486735 >> 172.21.15.37:0/2392486735 conn(0x564379bd4300 msgr2=0x564379f7fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 -- 172.21.15.37:0/2392486735 shutdown_connections 2024-05-09T01:11:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 -- 172.21.15.37:0/2392486735 wait complete. 2024-05-09T01:11:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.831+0000 7feca91c6740 1 -- start start 2024-05-09T01:11:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 1 Processor -- start 2024-05-09T01:11:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bb72f0 0x564379f8e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379be01b0 0x564379f957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564379f8c3d0 con 0x564379be01b0 2024-05-09T01:11:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564379e6f9c0 con 0x564379bbf4d0 2024-05-09T01:11:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564379f8c550 con 0x564379bb72f0 2024-05-09T01:11:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7feca91c6740 10 client.0 _ll_register_callbacks cb 0x564379e9c020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bb72f0 0x564379f8e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bb72f0 0x564379f8e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39486/0 (socket says 172.21.15.37:39486) 2024-05-09T01:11:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7fec9b7fe640 1 -- 172.21.15.37:0/3631319381 learned_addr learned my addr 172.21.15.37:0/3631319381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.832+0000 7fec9bfff640 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379be01b0 0x564379f957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec9b7fe640 1 -- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 msgr2=0x564379f8e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec9b7fe640 1 -- 172.21.15.37:0/3631319381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379be01b0 msgr2=0x564379f957c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379be01b0 0x564379f957c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec9b7fe640 1 -- 172.21.15.37:0/3631319381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564379e961f0 con 0x564379bb72f0 2024-05-09T01:11:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bb72f0 0x564379f8e320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fec90012d30 tx=0x7fec9001b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556892293306dab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec7b7fe640 1 -- 172.21.15.37:0/3631319381 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900109d0 con 0x564379bb72f0 2024-05-09T01:11:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7fec7b7fe640 1 -- 172.21.15.37:0/3631319381 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fec90010b70 con 0x564379bb72f0 2024-05-09T01:11:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.833+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec90012e20 con 0x564379bb72f0 2024-05-09T01:11:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7fec7b7fe640 1 -- 172.21.15.37:0/3631319381 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fec90010d70 con 0x564379bb72f0 2024-05-09T01:11:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 10 client.26725 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564379c4b790 con 0x564379bb72f0 2024-05-09T01:11:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7fec7b7fe640 1 -- 172.21.15.37:0/3631319381 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec90016040 con 0x564379bb72f0 2024-05-09T01:11:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7fec7b7fe640 1 -- 172.21.15.37:0/3631319381 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fec9002a5b0 con 0x564379bb72f0 2024-05-09T01:11:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 10 client.26725 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 10 client.26725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 20 client.26725 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379b9ed80 0x564379f9b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 4 client.26725 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fec90012e20 con 0x564379b9ed80 2024-05-09T01:11:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.834+0000 7fec9bfff640 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379b9ed80 0x564379f9b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.835+0000 7fec9bfff640 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379b9ed80 0x564379f9b710 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156278b1923a0f65 server_cookie=fc9ad77e410bdb50 in_seq=0 out_seq=0 2024-05-09T01:11:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.835+0000 7fec7b7fe640 10 client.26725 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.836+0000 7fec7b7fe640 1 -- 172.21.15.37:0/3631319381 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fec90012e20 con 0x564379b9ed80 2024-05-09T01:11:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.836+0000 7fec7b7fe640 10 client.26725 handle_command_reply: tid=0 2024-05-09T01:11:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.836+0000 7feca91c6740 1 client.26725 shutdown 2024-05-09T01:11:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bb72f0 msgr2=0x564379f8e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bb72f0 0x564379f8e320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fec90012d30 tx=0x7fec9001b040 comp rx=0 tx=0).stop 2024-05-09T01:11:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 shutdown_connections 2024-05-09T01:11:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379b9ed80 0x564379f9b710 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7fec7b7fe640 0 client.26725 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379be01b0 0x564379f957c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bbf4d0 0x564379f8e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 --2- 172.21.15.37:0/3631319381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bb72f0 0x564379f8e320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 >> 172.21.15.37:0/3631319381 conn(0x564379bd4300 msgr2=0x564379f7e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 shutdown_connections 2024-05-09T01:11:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 1 -- 172.21.15.37:0/3631319381 wait complete. 2024-05-09T01:11:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.837+0000 7feca91c6740 20 client.26725 trim_cache size 0 max 16384 2024-05-09T01:11:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.858+0000 7feca91c6740 1 Processor -- start 2024-05-09T01:11:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7feca91c6740 1 -- start start 2024-05-09T01:11:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7feca91c6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379b9ed80 0x564379f8cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7feca91c6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bb72f0 0x564379f8e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7feca91c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bbf4d0 0x564379f833a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7feca91c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec8800e320 con 0x564379bbf4d0 2024-05-09T01:11:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7feca91c6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec8800fef0 con 0x564379bb72f0 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7feca91c6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec8800e9f0 con 0x564379b9ed80 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bb72f0 0x564379f8e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379b9ed80 0x564379f8cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bb72f0 0x564379f8e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49660/0 (socket says 172.21.15.37:49660) 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9bfff640 1 -- 172.21.15.37:0/1303002145 learned_addr learned my addr 172.21.15.37:0/1303002145 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bbf4d0 0x564379f833a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9b7fe640 1 -- 172.21.15.37:0/1303002145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bb72f0 msgr2=0x564379f8e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bb72f0 0x564379f8e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9b7fe640 1 -- 172.21.15.37:0/1303002145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bbf4d0 msgr2=0x564379f833a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bbf4d0 0x564379f833a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9b7fe640 1 -- 172.21.15.37:0/1303002145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564379cc25f0 con 0x564379b9ed80 2024-05-09T01:11:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.859+0000 7fec9bfff640 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bb72f0 0x564379f8e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.860+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379b9ed80 0x564379f8cff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fec90012570 tx=0x7fec9000be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23834425efd18b10 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.860+0000 7fec81ffb640 1 -- 172.21.15.37:0/1303002145 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900109d0 con 0x564379b9ed80 2024-05-09T01:11:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.860+0000 7fec81ffb640 1 -- 172.21.15.37:0/1303002145 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec90016070 con 0x564379b9ed80 2024-05-09T01:11:25.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.860+0000 7fec81ffb640 1 -- 172.21.15.37:0/1303002145 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90003830 con 0x564379b9ed80 2024-05-09T01:11:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.861+0000 7feca91c6740 1 -- 172.21.15.37:0/1303002145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379b9ed80 msgr2=0x564379f8cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.861+0000 7feca91c6740 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379b9ed80 0x564379f8cff0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fec90012570 tx=0x7fec9000be20 comp rx=0 tx=0).stop 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.861+0000 7feca91c6740 1 -- 172.21.15.37:0/1303002145 shutdown_connections 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.861+0000 7feca91c6740 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bbf4d0 0x564379f833a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.861+0000 7feca91c6740 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379bb72f0 0x564379f8e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.861+0000 7feca91c6740 1 --2- 172.21.15.37:0/1303002145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379b9ed80 0x564379f8cff0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.861+0000 7feca91c6740 1 -- 172.21.15.37:0/1303002145 >> 172.21.15.37:0/1303002145 conn(0x564379bd4300 msgr2=0x564379f82c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.862+0000 7feca91c6740 1 -- 172.21.15.37:0/1303002145 shutdown_connections 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.862+0000 7feca91c6740 1 -- 172.21.15.37:0/1303002145 wait complete. 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.862+0000 7feca91c6740 1 -- start start 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 1 Processor -- start 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379b9ed80 0x564379f92030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f92570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bbf4d0 0x564379f934a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec8800f820 con 0x564379bb72f0 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec8800f150 con 0x564379b9ed80 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec8800c300 con 0x564379bbf4d0 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7feca91c6740 10 client.0 _ll_register_callbacks cb 0x7fec8c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379b9ed80 0x564379f92030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f92570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379b9ed80 0x564379f92030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:49674/0 (socket says 172.21.15.37:49674) 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7fec9b7fe640 1 -- 172.21.15.37:0/2800978274 learned_addr learned my addr 172.21.15.37:0/2800978274 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.863+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bbf4d0 0x564379f934a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec9bfff640 1 -- 172.21.15.37:0/2800978274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bbf4d0 msgr2=0x564379f934a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec9bfff640 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bbf4d0 0x564379f934a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec9bfff640 1 -- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379b9ed80 msgr2=0x564379f92030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec9bfff640 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379b9ed80 0x564379f92030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec9bfff640 1 -- 172.21.15.37:0/2800978274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564379eaced0 con 0x564379bb72f0 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379b9ed80 0x564379f92030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec9bfff640 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f92570 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec8c006010 tx=0x7fec8c031940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a0d24a181b5c6c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec7b7fe640 1 -- 172.21.15.37:0/2800978274 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c035040 con 0x564379bb72f0 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec7b7fe640 1 -- 172.21.15.37:0/2800978274 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fec8c046720 con 0x564379bb72f0 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec90016070 con 0x564379bb72f0 2024-05-09T01:11:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec7b7fe640 1 -- 172.21.15.37:0/2800978274 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fec8c046920 con 0x564379bb72f0 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7feca91c6740 10 client.16920 fetch_fsmap learned FSMap version 41 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564379f94bf0 con 0x564379bb72f0 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.864+0000 7fec7b7fe640 1 -- 172.21.15.37:0/2800978274 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec8c04a070 con 0x564379bb72f0 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7fec7b7fe640 1 -- 172.21.15.37:0/2800978274 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 41) ==== 8366+0+0 (secure 0 0 0) 0x7fec8c04e410 con 0x564379bb72f0 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7feca91c6740 10 client.16920 fetch_fsmap finished waiting for FSMap version 41 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7feca91c6740 10 client.16920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7feca91c6740 20 client.16920 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7feca91c6740 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379be01b0 0x56437a005c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7feca91c6740 4 client.16920 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fec90016070 con 0x564379be01b0 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.865+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379be01b0 0x56437a005c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.866+0000 7fec9b7fe640 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379be01b0 0x56437a005c90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdd4d7d1e9fa3c53 server_cookie=f647fafd86421489 in_seq=0 out_seq=0 2024-05-09T01:11:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.866+0000 7fec7b7fe640 10 client.16920 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7fec7b7fe640 1 -- 172.21.15.37:0/2800978274 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fec90016070 con 0x564379be01b0 2024-05-09T01:11:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7fec7b7fe640 10 client.16920 handle_command_reply: tid=0 2024-05-09T01:11:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 client.16920 shutdown 2024-05-09T01:11:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 msgr2=0x564379f92570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f92570 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fec8c006010 tx=0x7fec8c031940 comp rx=0 tx=0).stop 2024-05-09T01:11:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 shutdown_connections 2024-05-09T01:11:25.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564379be01b0 0x56437a005c90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564379bbf4d0 0x564379f934a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564379bb72f0 0x564379f92570 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 --2- 172.21.15.37:0/2800978274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564379b9ed80 0x564379f92030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 >> 172.21.15.37:0/2800978274 conn(0x564379bd4300 msgr2=0x564379f836c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.880+0000 7fec7b7fe640 0 client.16920 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 shutdown_connections 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca91c6740 1 -- 172.21.15.37:0/2800978274 wait complete. 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca91c6740 20 client.16920 trim_cache size 0 max 16384 2024-05-09T01:11:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:11:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:11:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fec840b29b0 msgr2=0x7fec840b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fec840b29b0 0x7fec840b4ec0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fec940a6e70 tx=0x7fec94013000 comp rx=0 tx=0).stop 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c107aa0 msgr2=0x7fec9c1a7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c107aa0 0x7fec9c1a7e00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fec9400eb10 tx=0x7fec9400c2d0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 shutdown_connections 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fec840b29b0 0x7fec840b4ec0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec9c107aa0 0x7fec9c1a7e00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9c102930 0x7fec9c1a0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 --2- 172.21.15.37:0/3288666602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec9c101ef0 0x7fec9c1a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.881+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 >> 172.21.15.37:0/3288666602 conn(0x7fec9c0fd4c0 msgr2=0x7fec9c103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.882+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 shutdown_connections 2024-05-09T01:11:25.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:25.882+0000 7feca2314640 1 -- 172.21.15.37:0/3288666602 wait complete. 2024-05-09T01:11:26.617 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:11:26.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:11:26.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:26 smithi136 ceph-mon[34110]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 651 op/s 2024-05-09T01:11:26.659 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:26 smithi037 ceph-mon[30122]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 651 op/s 2024-05-09T01:11:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:26 smithi151 ceph-mon[34780]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 651 op/s 2024-05-09T01:11:27.044 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:28.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:28 smithi037 ceph-mon[30122]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 633 op/s 2024-05-09T01:11:28.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:28 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:11:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:28 smithi136 ceph-mon[34110]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 633 op/s 2024-05-09T01:11:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:28 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:11:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:28 smithi151 ceph-mon[34780]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 633 op/s 2024-05-09T01:11:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:28 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:11:28.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 -- 172.21.15.37:0/1020356738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d081034c0 msgr2=0x7f1d081038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/1020356738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d081034c0 0x7f1d081038d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80099c0 tx=0x7f1cf8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 -- 172.21.15.37:0/1020356738 shutdown_connections 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/1020356738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d08108740 0x7f1d081100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/1020356738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d081034c0 0x7f1d081038d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/1020356738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d08107df0 0x7f1d08108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 -- 172.21.15.37:0/1020356738 >> 172.21.15.37:0/1020356738 conn(0x7f1d080fedc0 msgr2=0x7f1d081011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 -- 172.21.15.37:0/1020356738 shutdown_connections 2024-05-09T01:11:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.730+0000 7f1d0dcce700 1 -- 172.21.15.37:0/1020356738 wait complete. 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 Processor -- start 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 -- start start 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d081034c0 0x7f1d0819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d08107df0 0x7f1d0819c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d08108740 0x7f1d0819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08113370 con 0x7f1d08108740 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081131f0 con 0x7f1d081034c0 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.731+0000 7f1d0dcce700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081134f0 con 0x7f1d08107df0 2024-05-09T01:11:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d08108740 0x7f1d0819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d08108740 0x7f1d0819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33686/0 (socket says 172.21.15.37:33686) 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 -- 172.21.15.37:0/3476159575 learned_addr learned my addr 172.21.15.37:0/3476159575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d077fe700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d081034c0 0x7f1d0819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d08107df0 0x7f1d0819c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 -- 172.21.15.37:0/3476159575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d08107df0 msgr2=0x7f1d0819c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d08107df0 0x7f1d0819c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 -- 172.21.15.37:0/3476159575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d081034c0 msgr2=0x7f1d0819bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d081034c0 0x7f1d0819bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 -- 172.21.15.37:0/3476159575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d081a6f80 con 0x7f1d08108740 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d07fff700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d08108740 0x7f1d0819c6d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000ef30 tx=0x7f1d0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d04ff9700 1 -- 172.21.15.37:0/3476159575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000092e0 con 0x7f1d08108740 2024-05-09T01:11:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d04ff9700 1 -- 172.21.15.37:0/3476159575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d00004bb0 con 0x7f1d08108740 2024-05-09T01:11:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d081a7210 con 0x7f1d08108740 2024-05-09T01:11:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d04ff9700 1 -- 172.21.15.37:0/3476159575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00004020 con 0x7f1d08108740 2024-05-09T01:11:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.732+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d081a7750 con 0x7f1d08108740 2024-05-09T01:11:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.735+0000 7f1d04ff9700 1 -- 172.21.15.37:0/3476159575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1d0001b030 con 0x7f1d08108740 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.736+0000 7f1d04ff9700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cf00b2900 0x7f1cf00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.736+0000 7f1d077fe700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cf00b2900 0x7f1cf00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.736+0000 7f1d04ff9700 1 -- 172.21.15.37:0/3476159575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1d000e1c20 con 0x7f1d08108740 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.736+0000 7f1d1c6e4b80 1 Processor -- start 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.736+0000 7f1d1c6e4b80 1 -- start start 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.736+0000 7f1d077fe700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cf00b2900 0x7f1cf00b4e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8000c00 tx=0x7f1cf801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x56110103e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x56110103eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561101038720 0x561101038b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561100f5b070 con 0x561100ebb520 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561100ef9870 con 0x561100fa51e0 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561100f57030 con 0x561101038720 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x56110103eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x56110103eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33696/0 (socket says 172.21.15.37:33696) 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 -- 172.21.15.37:0/3045855487 learned_addr learned my addr 172.21.15.37:0/3045855487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d077fe700 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x56110103e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d07fff700 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561101038720 0x561101038b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 -- 172.21.15.37:0/3045855487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561101038720 msgr2=0x561101038b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561101038720 0x561101038b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 -- 172.21.15.37:0/3045855487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 msgr2=0x56110103e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x56110103e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 -- 172.21.15.37:0/3045855487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561100ef13f0 con 0x561100ebb520 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x56110103eab0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009cf0 tx=0x7f1cfc011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae4179d1e04d9ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1cedffb700 1 -- 172.21.15.37:0/3045855487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc011d80 con 0x561100ebb520 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1cedffb700 1 -- 172.21.15.37:0/3045855487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cfc004500 con 0x561100ebb520 2024-05-09T01:11:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.737+0000 7f1cedffb700 1 -- 172.21.15.37:0/3045855487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc005310 con 0x561100ebb520 2024-05-09T01:11:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3045855487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 msgr2=0x56110103eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x56110103eab0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009cf0 tx=0x7f1cfc011440 comp rx=0 tx=0).stop 2024-05-09T01:11:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3045855487 shutdown_connections 2024-05-09T01:11:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561101038720 0x561101038b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x56110103e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3045855487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x56110103eab0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3045855487 >> 172.21.15.37:0/3045855487 conn(0x561100f1b720 msgr2=0x561101033480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3045855487 shutdown_connections 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.738+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3045855487 wait complete. 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.739+0000 7f1d1c6e4b80 1 -- start start 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.739+0000 7f1d1c6e4b80 1 Processor -- start 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100ebb520 0x5611010422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x5611010427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x561101042d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561100dd6c20 con 0x561101038720 2024-05-09T01:11:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561100f151d0 con 0x561100fa51e0 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561101049660 con 0x561100ebb520 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 10 client.0 _ll_register_callbacks cb 0x561100dcc740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x561101042d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x561101042d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33704/0 (socket says 172.21.15.37:33704) 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 -- 172.21.15.37:0/601435027 learned_addr learned my addr 172.21.15.37:0/601435027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d077fe700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100ebb520 0x5611010422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x5611010427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 -- 172.21.15.37:0/601435027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100ebb520 msgr2=0x5611010422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100ebb520 0x5611010422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 -- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 msgr2=0x5611010427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x5611010427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 -- 172.21.15.37:0/601435027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561100dd6510 con 0x561101038720 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x5611010427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d07fff700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x561101042d30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000ef00 tx=0x7f1d0000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760366915a79dbdb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1ce6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/601435027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000c3060 con 0x561101038720 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/601435027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1d000dfd90 con 0x561101038720 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.740+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cfc004500 con 0x561101038720 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/601435027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d000ca050 con 0x561101038720 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 10 client.16932 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561101054100 con 0x561101038720 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/601435027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cfc004500 con 0x561101038720 2024-05-09T01:11:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/601435027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7f1d000c3b30 con 0x561101038720 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 10 client.16932 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 20 client.16932 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561101056690 0x561101058ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 4 client.16932 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561100f68a50 con 0x561101056690 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.741+0000 7f1d077fe700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561101056690 0x561101058ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.742+0000 7f1d077fe700 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561101056690 0x561101058ab0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43e03d205e1a5778 server_cookie=68e62d469bb5ddb9 in_seq=0 out_seq=0 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.742+0000 7f1ce6ffd700 10 client.16932 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/601435027 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561100f68a50 con 0x561101056690 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1ce6ffd700 10 client.16932 handle_command_reply: tid=0 2024-05-09T01:11:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 client.16932 shutdown 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 msgr2=0x561101042d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x561101042d30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000ef00 tx=0x7f1d0000ca90 comp rx=0 tx=0).stop 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 shutdown_connections 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561101056690 0x561101058ab0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x561101042d30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100ebb520 0x5611010422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/601435027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100fa51e0 0x5611010427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 >> 172.21.15.37:0/601435027 conn(0x561100f1b720 msgr2=0x561101033240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1ce6ffd700 0 client.16932 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 shutdown_connections 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/601435027 wait complete. 2024-05-09T01:11:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.743+0000 7f1d1c6e4b80 20 client.16932 trim_cache size 0 max 16384 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.766+0000 7f1d1c6e4b80 1 Processor -- start 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.766+0000 7f1d1c6e4b80 1 -- start start 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.766+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x561101038140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.766+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x561101042b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.766+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561101038720 0x56110105e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081ac830 con 0x561100ebb520 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081ae3a0 con 0x561101038720 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081acf00 con 0x561100fa51e0 2024-05-09T01:11:28.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x561101038140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x561101038140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33712/0 (socket says 172.21.15.37:33712) 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 -- 172.21.15.37:0/1765406746 learned_addr learned my addr 172.21.15.37:0/1765406746 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x561101042b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d07fff700 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561101038720 0x56110105e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 -- 172.21.15.37:0/1765406746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 msgr2=0x561101042b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x561101042b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 -- 172.21.15.37:0/1765406746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561101038720 msgr2=0x56110105e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561101038720 0x56110105e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 -- 172.21.15.37:0/1765406746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561101034d80 con 0x561100ebb520 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d07fff700 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561101038720 0x56110105e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x561101042b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1d077fe700 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x561101038140 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80098e0 tx=0x7f1cf8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c420f7429011da64 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.767+0000 7f1ced7fa700 1 -- 172.21.15.37:0/1765406746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8038070 con 0x561100ebb520 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1ced7fa700 1 -- 172.21.15.37:0/1765406746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf800be40 con 0x561100ebb520 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1ced7fa700 1 -- 172.21.15.37:0/1765406746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf800fd00 con 0x561100ebb520 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/1765406746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 msgr2=0x561101038140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x561101038140 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80098e0 tx=0x7f1cf8009cd0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/1765406746 shutdown_connections 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561101038720 0x56110105e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561100ebb520 0x561101038140 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/1765406746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x561101042b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.768+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/1765406746 >> 172.21.15.37:0/1765406746 conn(0x561100f1b720 msgr2=0x56110103c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.769+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/1765406746 shutdown_connections 2024-05-09T01:11:28.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.769+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/1765406746 wait complete. 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.769+0000 7f1d1c6e4b80 1 -- start start 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.769+0000 7f1d1c6e4b80 1 Processor -- start 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.769+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100ebb520 0x56110104b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x56110104bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d1c6e4b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x56110104c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081adcd0 con 0x561101038720 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081ad600 con 0x561100ebb520 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d1c6e4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d081aa7f0 con 0x561100fa51e0 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d1c6e4b80 10 client.0 _ll_register_callbacks cb 0x561100dcc740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x56110104c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x56110104c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33718/0 (socket says 172.21.15.37:33718) 2024-05-09T01:11:28.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 -- 172.21.15.37:0/3924264239 learned_addr learned my addr 172.21.15.37:0/3924264239 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d077fe700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100ebb520 0x56110104b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x56110104bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 -- 172.21.15.37:0/3924264239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 msgr2=0x56110104bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x56110104bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 -- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100ebb520 msgr2=0x56110104b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100ebb520 0x56110104b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 -- 172.21.15.37:0/3924264239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561101041280 con 0x561101038720 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d06ffd700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x56110104bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1d07fff700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x56110104c190 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009c10 tx=0x7f1d000b1f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49513bed4326eb4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1ce6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.770+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/3924264239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000a99d0 con 0x561101038720 2024-05-09T01:11:28.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/3924264239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1d000ad170 con 0x561101038720 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cf800be40 con 0x561101038720 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/3924264239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d00087070 con 0x561101038720 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 10 client.16938 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5611010c1e30 con 0x561101038720 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/3924264239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cf800be40 con 0x561101038720 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/3924264239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7f1d000a7fa0 con 0x561101038720 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 10 client.16938 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 20 client.16938 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5611010c2540 0x5611010c4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 4 client.16938 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561100f62af0 con 0x5611010c2540 2024-05-09T01:11:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.771+0000 7f1d077fe700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5611010c2540 0x5611010c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:28.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.772+0000 7f1ce6ffd700 10 client.16938 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:28.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.772+0000 7f1d077fe700 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5611010c2540 0x5611010c4960 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f2c9b54b68934b server_cookie=9ffb978f7d4aada0 in_seq=0 out_seq=0 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1ce6ffd700 1 -- 172.21.15.37:0/3924264239 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561100f62af0 con 0x5611010c2540 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1ce6ffd700 10 client.16938 handle_command_reply: tid=0 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 client.16938 shutdown 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 msgr2=0x56110104c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x56110104c190 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009c10 tx=0x7f1d000b1f80 comp rx=0 tx=0).stop 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 shutdown_connections 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5611010c2540 0x5611010c4960 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561101038720 0x56110104c190 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561100ebb520 0x56110104b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1ce6ffd700 0 client.16938 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 --2- 172.21.15.37:0/3924264239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561100fa51e0 0x56110104bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.773+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 >> 172.21.15.37:0/3924264239 conn(0x561100f1b720 msgr2=0x561101032960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.774+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 shutdown_connections 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.774+0000 7f1d1c6e4b80 1 -- 172.21.15.37:0/3924264239 wait complete. 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.774+0000 7f1d1c6e4b80 20 client.16938 trim_cache size 0 max 16384 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:11:28.782 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:11:28.783 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "a10a9bf9-2aaf-44a9-a56e-9a42c141a04c", 2024-05-09T01:11:28.783 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:11:28.783 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:11:28.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.774+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cf00b2900 msgr2=0x7f1cf00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.774+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cf00b2900 0x7f1cf00b4e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8000c00 tx=0x7f1cf801a040 comp rx=0 tx=0).stop 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.774+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d08108740 msgr2=0x7f1d0819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.774+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d08108740 0x7f1d0819c6d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000ef30 tx=0x7f1d0000c3a0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 shutdown_connections 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cf00b2900 0x7f1cf00b4e10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d08108740 0x7f1d0819c6d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d081034c0 0x7f1d0819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 --2- 172.21.15.37:0/3476159575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d08107df0 0x7f1d0819c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:28.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 >> 172.21.15.37:0/3476159575 conn(0x7f1d080fedc0 msgr2=0x7f1d08101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:28.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 shutdown_connections 2024-05-09T01:11:28.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:28.775+0000 7f1d0dcce700 1 -- 172.21.15.37:0/3476159575 wait complete. 2024-05-09T01:11:29.128 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:11:28 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:11:28.798+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001a [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact/ auth{1=1,2=1,3=1,4=1} v957 ap=2 f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0) n(v5 rc2024-05-09T01:11:07.336413+0000 b401408 3=2+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@11} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8323600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001a:[<0x10000000006/pg_xact v414>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000001a:[<0x10000000006/pg_xact v957>,<0x10000000005/data v633>,<0x100000001fb/postgres v354>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v377>,<0x10000000001/sv_1 v394>,<0x10000000000/qa v382>,<0x1/volumes v365>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:02:06.872458+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:11:07.336413+0000 b401408 3=2+1)","memory_value.dirstat":"f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0)","memory_value.rstat":"n(v5 rc2024-05-09T01:11:07.336413+0000 b401408 3=2+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:11:29.128 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:11:28 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:11:28.803+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans/ auth{1=1,2=1,3=1,4=1} v961 ap=2 f(v25 m2024-05-09T01:11:07.347413+0000 8=8+0) n(v28 rc2024-05-09T01:11:07.347413+0000 b1572864 9=8+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@54} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8371600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v316>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v961>,<0x10000000005/data v633>,<0x100000001fb/postgres v354>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v377>,<0x10000000001/sv_1 v394>,<0x10000000000/qa v382>,<0x1/volumes v365>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:11:01.436488+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:11:07.347413+0000 b1572864 9=8+1)","memory_value.dirstat":"f(v25 m2024-05-09T01:11:07.347413+0000 8=8+0)","memory_value.rstat":"n(v28 rc2024-05-09T01:11:07.347413+0000 b1572864 9=8+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:11:29.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:29 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:29.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:29 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:29.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:29 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:29.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:29 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:29.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:11:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:29 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:29 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:29 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:29.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:29 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:29.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:29 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:29.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:29 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:29.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:29 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:29.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:29 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:11:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 550.0 s, 1587.2 tps, lat 62.940 ms stddev 127.000 2024-05-09T01:11:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:11:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:30 smithi136 ceph-mon[34110]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 581 op/s 2024-05-09T01:11:30.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:11:30.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:30 smithi037 ceph-mon[30122]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 581 op/s 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:11:30.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:30 smithi151 ceph-mon[34780]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 581 op/s 2024-05-09T01:11:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.454+0000 7fa5f3fff700 1 -- 172.21.15.37:0/1985798183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f410a7c0 msgr2=0x7fa5f410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.454+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/1985798183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f410a7c0 0x7fa5f410abd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009990 tx=0x7fa5dc009ca0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.454+0000 7fa5f3fff700 1 -- 172.21.15.37:0/1985798183 shutdown_connections 2024-05-09T01:11:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.454+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/1985798183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5f411d930 0x7fa5f411fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.454+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/1985798183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f410a7c0 0x7fa5f410abd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.454+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/1985798183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f410b110 0x7fa5f411d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.454+0000 7fa5f3fff700 1 -- 172.21.15.37:0/1985798183 >> 172.21.15.37:0/1985798183 conn(0x7fa5f406f290 msgr2=0x7fa5f406f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.458+0000 7fa5f3fff700 1 -- 172.21.15.37:0/1985798183 shutdown_connections 2024-05-09T01:11:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.459+0000 7fa5f3fff700 1 -- 172.21.15.37:0/1985798183 wait complete. 2024-05-09T01:11:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 Processor -- start 2024-05-09T01:11:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 -- start start 2024-05-09T01:11:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5f410b110 0x7fa5f411ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f411d930 0x7fa5f4114a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f4114fd0 0x7fa5f41153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4123190 con 0x7fa5f410b110 2024-05-09T01:11:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4123010 con 0x7fa5f4114fd0 2024-05-09T01:11:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.460+0000 7fa5f3fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f4123310 con 0x7fa5f411d930 2024-05-09T01:11:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.464+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f411d930 0x7fa5f4114a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.464+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5f410b110 0x7fa5f411ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.464+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f411d930 0x7fa5f4114a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54350/0 (socket says 172.21.15.37:54350) 2024-05-09T01:11:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.464+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5f410b110 0x7fa5f411ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57148/0 (socket says 172.21.15.37:57148) 2024-05-09T01:11:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.464+0000 7fa5f27fc700 1 -- 172.21.15.37:0/3042369180 learned_addr learned my addr 172.21.15.37:0/3042369180 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:32.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.465+0000 7fa5f37fe700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f4114fd0 0x7fa5f41153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.466+0000 7fa5f37fe700 1 -- 172.21.15.37:0/3042369180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f411d930 msgr2=0x7fa5f4114a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.466+0000 7fa5f37fe700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f411d930 0x7fa5f4114a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.466+0000 7fa5f37fe700 1 -- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5f410b110 msgr2=0x7fa5f411ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.466+0000 7fa5f37fe700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5f410b110 0x7fa5f411ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.466+0000 7fa5f37fe700 1 -- 172.21.15.37:0/3042369180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f4119490 con 0x7fa5f4114fd0 2024-05-09T01:11:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.467+0000 7fa5f37fe700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f4114fd0 0x7fa5f41153e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00e970 tx=0x7fa5ec00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.467+0000 7fa5ebfff700 1 -- 172.21.15.37:0/3042369180 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec00cbd0 con 0x7fa5f4114fd0 2024-05-09T01:11:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.468+0000 7fa5ebfff700 1 -- 172.21.15.37:0/3042369180 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5ec0044d0 con 0x7fa5f4114fd0 2024-05-09T01:11:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.468+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f4119780 con 0x7fa5f4114fd0 2024-05-09T01:11:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.468+0000 7fa5ebfff700 1 -- 172.21.15.37:0/3042369180 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec005040 con 0x7fa5f4114fd0 2024-05-09T01:11:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.468+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f4119cc0 con 0x7fa5f4114fd0 2024-05-09T01:11:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.473+0000 7fa607ce0b80 1 Processor -- start 2024-05-09T01:11:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.475+0000 7fa5ebfff700 1 -- 172.21.15.37:0/3042369180 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa5ec004750 con 0x7fa5f4114fd0 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.476+0000 7fa607ce0b80 1 -- start start 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.476+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da77740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.476+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d8f44a0 0x560a0da77c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.476+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da71c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.476+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560a0d993ff0 con 0x560a0da71800 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.476+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560a0d9327f0 con 0x560a0d8f44a0 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.476+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560a0d98ffb0 con 0x560a0d9de160 2024-05-09T01:11:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.478+0000 7fa5ebfff700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e00b2930 0x7fa5e00b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.478+0000 7fa5ebfff700 1 -- 172.21.15.37:0/3042369180 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa5ec0e20a0 con 0x7fa5f4114fd0 2024-05-09T01:11:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.479+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da71c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.479+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da71c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57156/0 (socket says 172.21.15.37:57156) 2024-05-09T01:11:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.479+0000 7fa5f27fc700 1 -- 172.21.15.37:0/4220860021 learned_addr learned my addr 172.21.15.37:0/4220860021 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.479+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da77740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.481+0000 7fa5f37fe700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e00b2930 0x7fa5e00b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.482+0000 7fa5f37fe700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e00b2930 0x7fa5e00b4e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec01d030 tx=0x7fa5ec004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.483+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d8f44a0 0x560a0da77c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.483+0000 7fa5f27fc700 1 -- 172.21.15.37:0/4220860021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d8f44a0 msgr2=0x560a0da77c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.483+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d8f44a0 0x560a0da77c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.483+0000 7fa5f27fc700 1 -- 172.21.15.37:0/4220860021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 msgr2=0x560a0da71c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.483+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da71c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.483+0000 7fa5f27fc700 1 -- 172.21.15.37:0/4220860021 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0d92a370 con 0x560a0d9de160 2024-05-09T01:11:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.483+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d8f44a0 0x560a0da77c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:11:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.486+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da77740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4012b60 tx=0x7fa5e4009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af181879f180420f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.486+0000 7fa5e97fa700 1 -- 172.21.15.37:0/4220860021 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4014770 con 0x560a0d9de160 2024-05-09T01:11:32.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.486+0000 7fa5e97fa700 1 -- 172.21.15.37:0/4220860021 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5e401d070 con 0x560a0d9de160 2024-05-09T01:11:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.486+0000 7fa5e97fa700 1 -- 172.21.15.37:0/4220860021 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4018aa0 con 0x560a0d9de160 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.487+0000 7fa607ce0b80 1 -- 172.21.15.37:0/4220860021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 msgr2=0x560a0da77740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.487+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da77740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4012b60 tx=0x7fa5e4009490 comp rx=0 tx=0).stop 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.488+0000 7fa607ce0b80 1 -- 172.21.15.37:0/4220860021 shutdown_connections 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.488+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da71c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.488+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da77740 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.488+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/4220860021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d8f44a0 0x560a0da77c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.488+0000 7fa607ce0b80 1 -- 172.21.15.37:0/4220860021 >> 172.21.15.37:0/4220860021 conn(0x560a0d9546a0 msgr2=0x560a0da6c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.488+0000 7fa607ce0b80 1 -- 172.21.15.37:0/4220860021 shutdown_connections 2024-05-09T01:11:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.488+0000 7fa607ce0b80 1 -- 172.21.15.37:0/4220860021 wait complete. 2024-05-09T01:11:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.489+0000 7fa607ce0b80 1 -- start start 2024-05-09T01:11:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.489+0000 7fa607ce0b80 1 Processor -- start 2024-05-09T01:11:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da7b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0da71800 0x560a0da7be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560a0d80fba0 con 0x560a0d8f44a0 2024-05-09T01:11:32.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560a0d94e150 con 0x560a0da71800 2024-05-09T01:11:32.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560a0da7e420 con 0x560a0d9de160 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa607ce0b80 10 client.0 _ll_register_callbacks cb 0x560a0d8056c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0da71800 0x560a0da7be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0da71800 0x560a0da7be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47754/0 (socket says 172.21.15.37:47754) 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa5f27fc700 1 -- 172.21.15.37:0/38986623 learned_addr learned my addr 172.21.15.37:0/38986623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.490+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da7b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.491+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0da71800 msgr2=0x560a0da7be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.491+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0da71800 0x560a0da7be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.491+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/38986623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 msgr2=0x560a0da7b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.491+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.491+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/38986623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a0d80f490 con 0x560a0d9de160 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.491+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0da71800 0x560a0da7be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da7b8d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa5f41162e0 tx=0x7fa5dc00baa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e351a6f07e22a60 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:32.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa5da7fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa5da7fc700 1 -- 172.21.15.37:0/38986623 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc005690 con 0x560a0d9de160 2024-05-09T01:11:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa5da7fc700 1 -- 172.21.15.37:0/38986623 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa5dc003680 con 0x560a0d9de160 2024-05-09T01:11:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5e401d070 con 0x560a0d9de160 2024-05-09T01:11:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa5da7fc700 1 -- 172.21.15.37:0/38986623 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa5dc003880 con 0x560a0d9de160 2024-05-09T01:11:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa607ce0b80 10 client.26761 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.492+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560a0da88cd0 con 0x560a0d9de160 2024-05-09T01:11:32.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa5da7fc700 1 -- 172.21.15.37:0/38986623 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5e401d070 con 0x560a0d9de160 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa5da7fc700 1 -- 172.21.15.37:0/38986623 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7fa5dc00fba0 con 0x560a0d9de160 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa607ce0b80 10 client.26761 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa607ce0b80 10 client.26761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa607ce0b80 20 client.26761 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0da8b260 0x560a0da8d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa607ce0b80 4 client.26761 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a0d9a19d0 con 0x560a0da8b260 2024-05-09T01:11:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.493+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0da8b260 0x560a0da8d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.494+0000 7fa5da7fc700 10 client.26761 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:32.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.494+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0da8b260 0x560a0da8d6f0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46583a3dfb4fdead server_cookie=59118303351c0b79 in_seq=0 out_seq=0 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.495+0000 7fa5da7fc700 1 -- 172.21.15.37:0/38986623 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560a0d9a19d0 con 0x560a0da8b260 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.495+0000 7fa5da7fc700 10 client.26761 handle_command_reply: tid=0 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.495+0000 7fa607ce0b80 1 client.26761 shutdown 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 msgr2=0x560a0da7b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da7b8d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa5f41162e0 tx=0x7fa5dc00baa0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 shutdown_connections 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0da8b260 0x560a0da8d6f0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0da71800 0x560a0da7be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/38986623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d9de160 0x560a0da7b8d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 >> 172.21.15.37:0/38986623 conn(0x560a0d9546a0 msgr2=0x560a0da6c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa5da7fc700 0 client.26761 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 shutdown_connections 2024-05-09T01:11:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 1 -- 172.21.15.37:0/38986623 wait complete. 2024-05-09T01:11:32.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.496+0000 7fa607ce0b80 20 client.26761 trim_cache size 0 max 16384 2024-05-09T01:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.538+0000 7fa607ce0b80 1 Processor -- start 2024-05-09T01:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.538+0000 7fa607ce0b80 1 -- start start 2024-05-09T01:11:32.539 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:32 smithi037 ceph-mon[30122]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 692 op/s 2024-05-09T01:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.538+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.539+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da87260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.539+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.539+0000 7fa5f27fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57164/0 (socket says 172.21.15.37:57164) 2024-05-09T01:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.539+0000 7fa5f27fc700 1 -- 172.21.15.37:0/643341785 learned_addr learned my addr 172.21.15.37:0/643341785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.540+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da87260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.540+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0da71800 0x560a0da7b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.540+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41c61f0 con 0x560a0d8f44a0 2024-05-09T01:11:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.540+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41c7d60 con 0x560a0d9de160 2024-05-09T01:11:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.540+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41c68c0 con 0x560a0da71800 2024-05-09T01:11:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.541+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/643341785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0da71800 msgr2=0x560a0da7b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.541+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0da71800 0x560a0da7b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.541+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/643341785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 msgr2=0x560a0da7a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.541+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.541+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/643341785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0da674d0 con 0x560a0d9de160 2024-05-09T01:11:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.541+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da87260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc000c00 tx=0x7fa5dc0214d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2cbd44b7c90c4ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.542+0000 7fa5e8ff9700 1 -- 172.21.15.37:0/643341785 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc003680 con 0x560a0d9de160 2024-05-09T01:11:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.542+0000 7fa5e8ff9700 1 -- 172.21.15.37:0/643341785 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5dc009310 con 0x560a0d9de160 2024-05-09T01:11:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.542+0000 7fa5e8ff9700 1 -- 172.21.15.37:0/643341785 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc021cd0 con 0x560a0d9de160 2024-05-09T01:11:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 msgr2=0x560a0da87260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da87260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc000c00 tx=0x7fa5dc0214d0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 shutdown_connections 2024-05-09T01:11:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0da71800 0x560a0da7b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0d8f44a0 0x560a0da7a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/643341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da87260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 >> 172.21.15.37:0/643341785 conn(0x560a0d9546a0 msgr2=0x560a0da79c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 shutdown_connections 2024-05-09T01:11:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.543+0000 7fa607ce0b80 1 -- 172.21.15.37:0/643341785 wait complete. 2024-05-09T01:11:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.544+0000 7fa607ce0b80 1 -- start start 2024-05-09T01:11:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.544+0000 7fa607ce0b80 1 Processor -- start 2024-05-09T01:11:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.544+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d8f44a0 0x560a0da92a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.544+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da92fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa607ce0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da93500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41c7690 con 0x560a0da71800 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa607ce0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41c6fc0 con 0x560a0d9de160 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da92fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da92fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47778/0 (socket says 172.21.15.37:47778) 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/2010055220 learned_addr learned my addr 172.21.15.37:0/2010055220 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f41c41d0 con 0x560a0d8f44a0 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d8f44a0 0x560a0da92a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da93500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa607ce0b80 10 client.0 _ll_register_callbacks cb 0x560a0d8056c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/2010055220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d8f44a0 msgr2=0x560a0da92a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d8f44a0 0x560a0da92a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/2010055220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 msgr2=0x560a0da93500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da93500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f2ffd700 1 -- 172.21.15.37:0/2010055220 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a0daf4cf0 con 0x560a0d9de160 2024-05-09T01:11:32.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.545+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da93500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.546+0000 7fa5f2ffd700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da92fc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc006010 tx=0x7fa5dc005670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=950cbab19939303d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.546+0000 7fa5da7fc700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.546+0000 7fa5da7fc700 1 -- 172.21.15.37:0/2010055220 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc003c30 con 0x560a0d9de160 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.546+0000 7fa5da7fc700 1 -- 172.21.15.37:0/2010055220 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa5dc021950 con 0x560a0d9de160 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.546+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5dc009310 con 0x560a0d9de160 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.547+0000 7fa5da7fc700 1 -- 172.21.15.37:0/2010055220 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa5dc042050 con 0x560a0d9de160 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.547+0000 7fa607ce0b80 10 client.26789 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.547+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560a0daf5f40 con 0x560a0d9de160 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.547+0000 7fa5da7fc700 1 -- 172.21.15.37:0/2010055220 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5dc003dd0 con 0x560a0d9de160 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.547+0000 7fa5da7fc700 1 -- 172.21.15.37:0/2010055220 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7fa5dc034400 con 0x560a0d9de160 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.548+0000 7fa607ce0b80 10 client.26789 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.548+0000 7fa607ce0b80 10 client.26789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.548+0000 7fa607ce0b80 20 client.26789 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.548+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0daf6420 0x560a0daf8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.548+0000 7fa607ce0b80 4 client.26789 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.548+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa5dc009310 con 0x560a0daf6420 2024-05-09T01:11:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.548+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0daf6420 0x560a0daf8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa5da7fc700 10 client.26789 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa5f27fc700 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0daf6420 0x560a0daf8840 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436f131ad4e360ed server_cookie=3a5cc918d9baab64 in_seq=0 out_seq=0 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa5da7fc700 1 -- 172.21.15.37:0/2010055220 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fa5dc009310 con 0x560a0daf6420 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa5da7fc700 10 client.26789 handle_command_reply: tid=0 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 client.26789 shutdown 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 msgr2=0x560a0da92fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da92fc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc006010 tx=0x7fa5dc005670 comp rx=0 tx=0).stop 2024-05-09T01:11:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 shutdown_connections 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x560a0daf6420 0x560a0daf8840 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560a0da71800 0x560a0da93500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a0d8f44a0 0x560a0da92a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 --2- 172.21.15.37:0/2010055220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560a0d9de160 0x560a0da92fc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 >> 172.21.15.37:0/2010055220 conn(0x560a0d9546a0 msgr2=0x560a0da7b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.549+0000 7fa5da7fc700 0 client.26789 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.550+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 shutdown_connections 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.550+0000 7fa607ce0b80 1 -- 172.21.15.37:0/2010055220 wait complete. 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.550+0000 7fa607ce0b80 20 client.26789 trim_cache size 0 max 16384 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:11:32.552 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout: "a10a9bf9-2aaf-44a9-a56e-9a42c141a04c": { 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "a10a9bf9-2aaf-44a9-a56e-9a42c141a04c", 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:11:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e00b2930 msgr2=0x7fa5e00b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e00b2930 0x7fa5e00b4e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec01d030 tx=0x7fa5ec004a40 comp rx=0 tx=0).stop 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f4114fd0 msgr2=0x7fa5f41153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f4114fd0 0x7fa5f41153e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00e970 tx=0x7fa5ec00ed30 comp rx=0 tx=0).stop 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 shutdown_connections 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa5e00b2930 0x7fa5e00b4e40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f4114fd0 0x7fa5f41153e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5f410b110 0x7fa5f411ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 --2- 172.21.15.37:0/3042369180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f411d930 0x7fa5f4114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 >> 172.21.15.37:0/3042369180 conn(0x7fa5f406f290 msgr2=0x7fa5f411fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 shutdown_connections 2024-05-09T01:11:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:11:32.551+0000 7fa5f3fff700 1 -- 172.21.15.37:0/3042369180 wait complete. 2024-05-09T01:11:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:32 smithi136 ceph-mon[34110]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 692 op/s 2024-05-09T01:11:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:32 smithi151 ceph-mon[34780]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 692 op/s 2024-05-09T01:11:33.250 INFO:tasks.cephfs.filesystem:scrub status for tag:a10a9bf9-2aaf-44a9-a56e-9a42c141a04c - {'path': '/', 'tag': 'a10a9bf9-2aaf-44a9-a56e-9a42c141a04c', 'options': 'recursive,force'} 2024-05-09T01:11:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:34 smithi136 ceph-mon[34110]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 14 MiB/s wr, 695 op/s 2024-05-09T01:11:34.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:34 smithi151 ceph-mon[34780]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 14 MiB/s wr, 695 op/s 2024-05-09T01:11:34.728 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:34 smithi037 ceph-mon[30122]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 14 MiB/s wr, 695 op/s 2024-05-09T01:11:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 555.0 s, 1846.6 tps, lat 53.674 ms stddev 63.811 2024-05-09T01:11:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:36 smithi136 ceph-mon[34110]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 13 MiB/s wr, 704 op/s 2024-05-09T01:11:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:36 smithi037 ceph-mon[30122]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 13 MiB/s wr, 704 op/s 2024-05-09T01:11:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:36 smithi151 ceph-mon[34780]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 13 MiB/s wr, 704 op/s 2024-05-09T01:11:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:38 smithi136 ceph-mon[34110]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 14 MiB/s wr, 746 op/s 2024-05-09T01:11:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:38 smithi037 ceph-mon[30122]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 14 MiB/s wr, 746 op/s 2024-05-09T01:11:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:38 smithi151 ceph-mon[34780]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 14 MiB/s wr, 746 op/s 2024-05-09T01:11:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.039+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2530679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcbc103dc0 msgr2=0x7fdcbc1041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.039+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2530679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1041d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009ca0 tx=0x7fdcb402e9d0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.044+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2530679 shutdown_connections 2024-05-09T01:11:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.044+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2530679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcbc108ac0 0x7fdcbc10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.044+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2530679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1041d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.044+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2530679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc102b80 0x7fdcbc103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.044+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2530679 >> 172.21.15.37:0/2530679 conn(0x7fdcbc0fdd90 msgr2=0x7fdcbc100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.050+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2530679 shutdown_connections 2024-05-09T01:11:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.052+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2530679 wait complete. 2024-05-09T01:11:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 Processor -- start 2024-05-09T01:11:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 -- start start 2024-05-09T01:11:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcbc102b80 0x7fdcbc1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcbc108ac0 0x7fdcbc1a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc115f00 con 0x7fdcbc102b80 2024-05-09T01:11:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc115d80 con 0x7fdcbc108ac0 2024-05-09T01:11:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.053+0000 7fdcc35e8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdcbc116080 con 0x7fdcbc103dc0 2024-05-09T01:11:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.055+0000 7fdcc0b83640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.055+0000 7fdcc0b83640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54402/0 (socket says 172.21.15.37:54402) 2024-05-09T01:11:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.055+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2168865208 learned_addr learned my addr 172.21.15.37:0/2168865208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.055+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcbc108ac0 0x7fdcbc1a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.056+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2168865208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcbc108ac0 msgr2=0x7fdcbc1a8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.056+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcbc108ac0 0x7fdcbc1a8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.056+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcbc102b80 msgr2=0x7fdcbc1a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.056+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcbc102b80 0x7fdcbc1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.056+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2168865208 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcbc06c820 con 0x7fdcbc103dc0 2024-05-09T01:11:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.056+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1a1070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000f80 tx=0x7fdcb4032620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.056+0000 7fdcb27fc640 1 -- 172.21.15.37:0/2168865208 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4040030 con 0x7fdcbc103dc0 2024-05-09T01:11:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.057+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcbc06cab0 con 0x7fdcbc103dc0 2024-05-09T01:11:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.057+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcbc06d070 con 0x7fdcbc103dc0 2024-05-09T01:11:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.057+0000 7fdcb27fc640 1 -- 172.21.15.37:0/2168865208 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcb4003e20 con 0x7fdcbc103dc0 2024-05-09T01:11:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.058+0000 7fdcb27fc640 1 -- 172.21.15.37:0/2168865208 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4037050 con 0x7fdcbc103dc0 2024-05-09T01:11:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.062+0000 7fdcca570740 1 Processor -- start 2024-05-09T01:11:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcb27fc640 1 -- 172.21.15.37:0/2168865208 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdcb403a070 con 0x7fdcbc103dc0 2024-05-09T01:11:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcca570740 1 -- start start 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcca570740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e86500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcca570740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 0x559546e86a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcca570740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e8d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcca570740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559546dea7c0 con 0x559546ae21b0 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcca570740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559546d860e0 con 0x559546ac14d0 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.064+0000 7fdcca570740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559546de6780 con 0x559546ab92f0 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e86500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e86500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57200/0 (socket says 172.21.15.37:57200) 2024-05-09T01:11:39.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 -- 172.21.15.37:0/1142465990 learned_addr learned my addr 172.21.15.37:0/1142465990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 -- 172.21.15.37:0/1142465990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 msgr2=0x559546e86a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:11:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/1142465990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 0x559546e86a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 -- 172.21.15.37:0/1142465990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 msgr2=0x559546e8d980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:11:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/1142465990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e8d980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.065+0000 7fdcc1b85640 1 -- 172.21.15.37:0/1142465990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559546daf7c0 con 0x559546ae21b0 2024-05-09T01:11:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.066+0000 7fdcb27fc640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdca80b2930 0x7fdca80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.066+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/1142465990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e86500 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b7a0 tx=0x7fdcac00bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c51b34ffe623103 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.066+0000 7fdcb27fc640 1 -- 172.21.15.37:0/2168865208 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdcb4102540 con 0x7fdcbc103dc0 2024-05-09T01:11:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.067+0000 7fdca77fe640 1 -- 172.21.15.37:0/1142465990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac00d950 con 0x559546ae21b0 2024-05-09T01:11:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.067+0000 7fdcc1384640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdca80b2930 0x7fdca80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.067+0000 7fdca77fe640 1 -- 172.21.15.37:0/1142465990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcac012420 con 0x559546ae21b0 2024-05-09T01:11:39.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.067+0000 7fdca77fe640 1 -- 172.21.15.37:0/1142465990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac014650 con 0x559546ae21b0 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 -- 172.21.15.37:0/1142465990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 msgr2=0x559546e86500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 --2- 172.21.15.37:0/1142465990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e86500 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fdcac00b7a0 tx=0x7fdcac00bc60 comp rx=0 tx=0).stop 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcc1384640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdca80b2930 0x7fdca80b4e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb8006c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 -- 172.21.15.37:0/1142465990 shutdown_connections 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 --2- 172.21.15.37:0/1142465990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e8d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 --2- 172.21.15.37:0/1142465990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 0x559546e86a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 --2- 172.21.15.37:0/1142465990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e86500 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 -- 172.21.15.37:0/1142465990 >> 172.21.15.37:0/1142465990 conn(0x559546ad6300 msgr2=0x559546e81e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 -- 172.21.15.37:0/1142465990 shutdown_connections 2024-05-09T01:11:39.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.068+0000 7fdcca570740 1 -- 172.21.15.37:0/1142465990 wait complete. 2024-05-09T01:11:39.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.069+0000 7fdcca570740 1 -- start start 2024-05-09T01:11:39.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.069+0000 7fdcca570740 1 Processor -- start 2024-05-09T01:11:39.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcca570740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e903e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcca570740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e90920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcca570740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e97880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcca570740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559546e8e3d0 con 0x559546ab92f0 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcca570740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559546d719c0 con 0x559546ac14d0 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcca570740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559546e8e550 con 0x559546ae21b0 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcca570740 10 client.0 _ll_register_callbacks cb 0x559546d9e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcc1384640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcc1b85640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e97880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcc1b85640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e97880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:54412/0 (socket says 172.21.15.37:54412) 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcc1b85640 1 -- 172.21.15.37:0/293642153 learned_addr learned my addr 172.21.15.37:0/293642153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcc1384640 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e903e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57206/0 (socket says 172.21.15.37:57206) 2024-05-09T01:11:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.070+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e90920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdcc1b85640 1 -- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 msgr2=0x559546e90920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e90920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdcc1b85640 1 -- 172.21.15.37:0/293642153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 msgr2=0x559546e903e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e903e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdcc1b85640 1 -- 172.21.15.37:0/293642153 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559546d981f0 con 0x559546ae21b0 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e97880 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006f40 tx=0x7fdcac00db80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab872753be5b120 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdca4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdca4ff9640 1 -- 172.21.15.37:0/293642153 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcac022070 con 0x559546ae21b0 2024-05-09T01:11:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.071+0000 7fdca4ff9640 1 -- 172.21.15.37:0/293642153 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdcac0127d0 con 0x559546ae21b0 2024-05-09T01:11:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.072+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcac012420 con 0x559546ae21b0 2024-05-09T01:11:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.072+0000 7fdca4ff9640 1 -- 172.21.15.37:0/293642153 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fdcac02c050 con 0x559546ae21b0 2024-05-09T01:11:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.072+0000 7fdcca570740 10 client.26770 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.072+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559546b4d790 con 0x559546ae21b0 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.072+0000 7fdca4ff9640 1 -- 172.21.15.37:0/293642153 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcac012420 con 0x559546ae21b0 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdca4ff9640 1 -- 172.21.15.37:0/293642153 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7fdcac013070 con 0x559546ae21b0 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdcca570740 10 client.26770 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdcca570740 10 client.26770 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdcca570740 20 client.26770 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdcca570740 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546aa0d80 0x559546e9da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdcca570740 4 client.26770 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559546df83d0 con 0x559546aa0d80 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdcc1384640 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546aa0d80 0x559546e9da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.073+0000 7fdca4ff9640 10 client.26770 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.074+0000 7fdcc1384640 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546aa0d80 0x559546e9da80 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21630fe0d7c31df0 server_cookie=bbf1ab357e7aabf0 in_seq=0 out_seq=0 2024-05-09T01:11:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.077+0000 7fdca4ff9640 1 -- 172.21.15.37:0/293642153 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559546df83d0 con 0x559546aa0d80 2024-05-09T01:11:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.077+0000 7fdca4ff9640 10 client.26770 handle_command_reply: tid=0 2024-05-09T01:11:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.077+0000 7fdcca570740 1 client.26770 shutdown 2024-05-09T01:11:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 msgr2=0x559546e97880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e97880 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdcac006f40 tx=0x7fdcac00db80 comp rx=0 tx=0).stop 2024-05-09T01:11:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 shutdown_connections 2024-05-09T01:11:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546aa0d80 0x559546e9da80 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e97880 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e90920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 --2- 172.21.15.37:0/293642153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e903e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 >> 172.21.15.37:0/293642153 conn(0x559546ad6300 msgr2=0x559546e84da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdca4ff9640 0 client.26770 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 shutdown_connections 2024-05-09T01:11:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 1 -- 172.21.15.37:0/293642153 wait complete. 2024-05-09T01:11:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.079+0000 7fdcca570740 20 client.26770 trim_cache size 0 max 16384 2024-05-09T01:11:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.099+0000 7fdcca570740 1 Processor -- start 2024-05-09T01:11:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.099+0000 7fdcca570740 1 -- start start 2024-05-09T01:11:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.099+0000 7fdcca570740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 0x559546e8ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcca570740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e81f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcca570740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcca570740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdca000e400 con 0x559546ae21b0 2024-05-09T01:11:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcca570740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdca000ff70 con 0x559546ac14d0 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcca570740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdca000ead0 con 0x559546ab92f0 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e81f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e81f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:47818/0 (socket says 172.21.15.37:47818) 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2777831114 learned_addr learned my addr 172.21.15.37:0/2777831114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc1384640 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 0x559546e8ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2777831114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 msgr2=0x559546e8ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 0x559546e8ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2777831114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 msgr2=0x559546e977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 -- 172.21.15.37:0/2777831114 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559546bc45f0 con 0x559546ac14d0 2024-05-09T01:11:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.100+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e81f60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40c5be0 tx=0x7fdcb40123e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866496ad52306a67 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.101+0000 7fdca6ffd640 1 -- 172.21.15.37:0/2777831114 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb404a070 con 0x559546ac14d0 2024-05-09T01:11:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.101+0000 7fdca6ffd640 1 -- 172.21.15.37:0/2777831114 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcb40c9670 con 0x559546ac14d0 2024-05-09T01:11:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.101+0000 7fdca6ffd640 1 -- 172.21.15.37:0/2777831114 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb41020c0 con 0x559546ac14d0 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 -- 172.21.15.37:0/2777831114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 msgr2=0x559546e81f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e81f60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40c5be0 tx=0x7fdcb40123e0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 -- 172.21.15.37:0/2777831114 shutdown_connections 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ae21b0 0x559546e977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e81f60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 --2- 172.21.15.37:0/2777831114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ab92f0 0x559546e8ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 -- 172.21.15.37:0/2777831114 >> 172.21.15.37:0/2777831114 conn(0x559546ad6300 msgr2=0x559546e81850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 -- 172.21.15.37:0/2777831114 shutdown_connections 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 -- 172.21.15.37:0/2777831114 wait complete. 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 -- start start 2024-05-09T01:11:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.102+0000 7fdcca570740 1 Processor -- start 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcca570740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e95330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcca570740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e95870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcca570740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcc1384640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e95330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcc1384640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e95330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57218/0 (socket says 172.21.15.37:57218) 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcc1384640 1 -- 172.21.15.37:0/3453413166 learned_addr learned my addr 172.21.15.37:0/3453413166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdca000f8a0 con 0x559546ab92f0 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e95870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdca000f1d0 con 0x559546ac14d0 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcc1b85640 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.103+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdca000c3e0 con 0x559546ae21b0 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcca570740 10 client.0 _ll_register_callbacks cb 0x7fdcac00b5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:39.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcc0b83640 1 -- 172.21.15.37:0/3453413166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 msgr2=0x559546e967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcc0b83640 1 -- 172.21.15.37:0/3453413166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 msgr2=0x559546e95330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e95330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcc0b83640 1 -- 172.21.15.37:0/3453413166 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559546daeed0 con 0x559546ac14d0 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcc0b83640 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e95870 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40c9af0 tx=0x7fdcb40c5b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da783a402c9348bb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdca4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcb40c9670 con 0x559546ac14d0 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdca4ff9640 1 -- 172.21.15.37:0/3453413166 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb40e2070 con 0x559546ac14d0 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdca4ff9640 1 -- 172.21.15.37:0/3453413166 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdcb4003b80 con 0x559546ac14d0 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.104+0000 7fdca4ff9640 1 -- 172.21.15.37:0/3453413166 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fdcb404a070 con 0x559546ac14d0 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.105+0000 7fdcca570740 10 client.26801 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.105+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=42}) -- 0x559546e97d20 con 0x559546ac14d0 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.106+0000 7fdca4ff9640 1 -- 172.21.15.37:0/3453413166 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7fdcb4004b40 con 0x559546ac14d0 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.107+0000 7fdcca570740 10 client.26801 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.107+0000 7fdcca570740 10 client.26801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.107+0000 7fdcca570740 20 client.26801 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.107+0000 7fdcca570740 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546a761c0 0x559546f07ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.107+0000 7fdcca570740 4 client.26801 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.107+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559546df2240 con 0x559546a761c0 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.107+0000 7fdcc1384640 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546a761c0 0x559546f07ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.108+0000 7fdca4ff9640 10 client.26801 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:39.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.108+0000 7fdcc1384640 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546a761c0 0x559546f07ca0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7920b8d8c242d03 server_cookie=3302377661066360 in_seq=0 out_seq=0 2024-05-09T01:11:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdca4ff9640 1 -- 172.21.15.37:0/3453413166 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x559546df2240 con 0x559546a761c0 2024-05-09T01:11:39.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdca4ff9640 10 client.26801 handle_command_reply: tid=0 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 client.26801 shutdown 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 msgr2=0x559546e95870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e95870 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40c9af0 tx=0x7fdcb40c5b50 comp rx=0 tx=0).stop 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 shutdown_connections 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559546a761c0 0x559546f07ca0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdca4ff9640 0 client.26801 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559546ae21b0 0x559546e967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559546ac14d0 0x559546e95870 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 --2- 172.21.15.37:0/3453413166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559546ab92f0 0x559546e95330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 >> 172.21.15.37:0/3453413166 conn(0x559546ad6300 msgr2=0x559546e903c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 shutdown_connections 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 1 -- 172.21.15.37:0/3453413166 wait complete. 2024-05-09T01:11:39.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.117+0000 7fdcca570740 20 client.26801 trim_cache size 0 max 16384 2024-05-09T01:11:39.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:11:39.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:11:39.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdca80b2930 msgr2=0x7fdca80b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdca80b2930 0x7fdca80b4e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8006fd0 tx=0x7fdcb8006c40 comp rx=0 tx=0).stop 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc103dc0 msgr2=0x7fdcbc1a1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1a1070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000f80 tx=0x7fdcb4032620 comp rx=0 tx=0).stop 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 shutdown_connections 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdca80b2930 0x7fdca80b4e40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcbc108ac0 0x7fdcbc1a8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc103dc0 0x7fdcbc1a1070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 --2- 172.21.15.37:0/2168865208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcbc102b80 0x7fdcbc1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 >> 172.21.15.37:0/2168865208 conn(0x7fdcbc0fdd90 msgr2=0x7fdcbc104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:39.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 shutdown_connections 2024-05-09T01:11:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:39.118+0000 7fdcc35e8640 1 -- 172.21.15.37:0/2168865208 wait complete. 2024-05-09T01:11:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 560.0 s, 1580.0 tps, lat 64.001 ms stddev 72.507 2024-05-09T01:11:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:40 smithi136 ceph-mon[34110]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 14 MiB/s wr, 712 op/s 2024-05-09T01:11:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:40 smithi037 ceph-mon[30122]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 14 MiB/s wr, 712 op/s 2024-05-09T01:11:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:40 smithi151 ceph-mon[34780]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 14 MiB/s wr, 712 op/s 2024-05-09T01:11:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:42 smithi136 ceph-mon[34110]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 766 op/s 2024-05-09T01:11:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:42 smithi037 ceph-mon[30122]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 766 op/s 2024-05-09T01:11:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:42 smithi151 ceph-mon[34780]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 13 MiB/s wr, 766 op/s 2024-05-09T01:11:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:11:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:11:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:11:43.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:11:43.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:11:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:11:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:11:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:11:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:11:43.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:11:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:11:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:11:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:11:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:11:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:11:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:44 smithi136 ceph-mon[34110]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 714 op/s 2024-05-09T01:11:44.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:44 smithi037 ceph-mon[30122]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 714 op/s 2024-05-09T01:11:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:44 smithi151 ceph-mon[34780]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 13 MiB/s wr, 714 op/s 2024-05-09T01:11:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 565.0 s, 1656.4 tps, lat 60.044 ms stddev 67.209 2024-05-09T01:11:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:46 smithi136 ceph-mon[34110]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 660 op/s 2024-05-09T01:11:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:46 smithi037 ceph-mon[30122]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 660 op/s 2024-05-09T01:11:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:46 smithi151 ceph-mon[34780]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 660 op/s 2024-05-09T01:11:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:48 smithi136 ceph-mon[34110]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 636 op/s 2024-05-09T01:11:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:48 smithi037 ceph-mon[30122]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 636 op/s 2024-05-09T01:11:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:48 smithi151 ceph-mon[34780]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 MiB/s wr, 636 op/s 2024-05-09T01:11:50.233 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 570.0 s, 1352.6 tps, lat 50.912 ms stddev 88.935 2024-05-09T01:11:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:50 smithi037 ceph-mon[30122]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 10 MiB/s wr, 597 op/s 2024-05-09T01:11:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:50 smithi151 ceph-mon[34780]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 10 MiB/s wr, 597 op/s 2024-05-09T01:11:50.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:50 smithi136 ceph-mon[34110]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 10 MiB/s wr, 597 op/s 2024-05-09T01:11:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 -- 172.21.15.37:0/2225220898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 msgr2=0x7f944c106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 --2- 172.21.15.37:0/2225220898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c106b60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f943c009900 tx=0x7f943c02a410 comp rx=0 tx=0).stop 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 -- 172.21.15.37:0/2225220898 shutdown_connections 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 --2- 172.21.15.37:0/2225220898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f944c109a00 0x7f944c10be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 --2- 172.21.15.37:0/2225220898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f944c1070a0 0x7f944c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 --2- 172.21.15.37:0/2225220898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c106b60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 -- 172.21.15.37:0/2225220898 >> 172.21.15.37:0/2225220898 conn(0x7f944c0fdd40 msgr2=0x7f944c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 -- 172.21.15.37:0/2225220898 shutdown_connections 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.224+0000 7f94529b2640 1 -- 172.21.15.37:0/2225220898 wait complete. 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 Processor -- start 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 -- start start 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c103b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f944c1070a0 0x7f944c102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f944c109a00 0x7f944c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f944c10f750 con 0x7f944c104740 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f944c10f5d0 con 0x7f944c109a00 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f94529b2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f944c10f8d0 con 0x7f944c1070a0 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f944bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c103b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f944bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c103b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37424/0 (socket says 172.21.15.37:37424) 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f944b7fe640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f944c1070a0 0x7f944c102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f944bfff640 1 -- 172.21.15.37:0/690620448 learned_addr learned my addr 172.21.15.37:0/690620448 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.225+0000 7f9450f4f640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f944c109a00 0x7f944c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f944b7fe640 1 -- 172.21.15.37:0/690620448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f944c109a00 msgr2=0x7f944c102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f944b7fe640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f944c109a00 0x7f944c102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f944b7fe640 1 -- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 msgr2=0x7f944c103b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f944b7fe640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c103b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f944b7fe640 1 -- 172.21.15.37:0/690620448 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c102ea0 con 0x7f944c1070a0 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f944bfff640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f944b7fe640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f944c1070a0 0x7f944c102230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f944000e9f0 tx=0x7f944000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f94497fa640 1 -- 172.21.15.37:0/690620448 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944000ccc0 con 0x7f944c1070a0 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f944c1a4440 con 0x7f944c1070a0 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f944c1a4930 con 0x7f944c1070a0 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f94497fa640 1 -- 172.21.15.37:0/690620448 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94400108e0 con 0x7f944c1070a0 2024-05-09T01:11:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.226+0000 7f94497fa640 1 -- 172.21.15.37:0/690620448 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9440018750 con 0x7f944c1070a0 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 Processor -- start 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 -- start start 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f94497fa640 1 -- 172.21.15.37:0/690620448 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f94400188f0 con 0x7f944c1070a0 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e80500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e80a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e87980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562771de47c0 con 0x562771adc1b0 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562771d800e0 con 0x562771abb4d0 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f945985f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562771de0780 con 0x562771ab32f0 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f9450f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e80500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f9450f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e80500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37432/0 (socket says 172.21.15.37:37432) 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f9450f4f640 1 -- 172.21.15.37:0/3679692415 learned_addr learned my addr 172.21.15.37:0/3679692415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f944bfff640 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e80a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.229+0000 7f944b7fe640 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e87980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f9450f4f640 1 -- 172.21.15.37:0/3679692415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 msgr2=0x562771e80a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f9450f4f640 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e80a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f9450f4f640 1 -- 172.21.15.37:0/3679692415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 msgr2=0x562771e87980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f9450f4f640 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e87980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f9450f4f640 1 -- 172.21.15.37:0/3679692415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562771da97c0 con 0x562771adc1b0 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f944bfff640 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e80a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f9450f4f640 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e80500 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9444009f90 tx=0x7f94440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c575e41067e392a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f94497fa640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94340b27e0 0x7f94340b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f94327fc640 1 -- 172.21.15.37:0/3679692415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444004d20 con 0x562771adc1b0 2024-05-09T01:11:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f94327fc640 1 -- 172.21.15.37:0/3679692415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9444004050 con 0x562771adc1b0 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f94327fc640 1 -- 172.21.15.37:0/3679692415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444005280 con 0x562771adc1b0 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f944bfff640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94340b27e0 0x7f94340b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.230+0000 7f94497fa640 1 -- 172.21.15.37:0/690620448 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f94400e2410 con 0x7f944c1070a0 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 -- 172.21.15.37:0/3679692415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 msgr2=0x562771e80500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e80500 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9444009f90 tx=0x7f94440118d0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f944bfff640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94340b27e0 0x7f94340b4cf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f943c004730 tx=0x7f943c0046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 -- 172.21.15.37:0/3679692415 shutdown_connections 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e87980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e80a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 --2- 172.21.15.37:0/3679692415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e80500 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 -- 172.21.15.37:0/3679692415 >> 172.21.15.37:0/3679692415 conn(0x562771ad0300 msgr2=0x562771e7be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 -- 172.21.15.37:0/3679692415 shutdown_connections 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 -- 172.21.15.37:0/3679692415 wait complete. 2024-05-09T01:11:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.231+0000 7f945985f740 1 -- start start 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 1 Processor -- start 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e8a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e8a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562771e883d0 con 0x562771adc1b0 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562771d6b9c0 con 0x562771abb4d0 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562771e88550 con 0x562771ab32f0 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f945985f740 10 client.0 _ll_register_callbacks cb 0x562771d98020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f9450f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f9450f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37444/0 (socket says 172.21.15.37:37444) 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f9450f4f640 1 -- 172.21.15.37:0/1605095959 learned_addr learned my addr 172.21.15.37:0/1605095959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f944bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e8a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f944b7fe640 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e8a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f944bfff640 1 -- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 msgr2=0x562771e8a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.232+0000 7f944bfff640 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e8a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f944bfff640 1 -- 172.21.15.37:0/1605095959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 msgr2=0x562771e91760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f944bfff640 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f944bfff640 1 -- 172.21.15.37:0/1605095959 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562771d921f0 con 0x562771ab32f0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f9450f4f640 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f944bfff640 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e8a2c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f943c031440 tx=0x7f943c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e3c9593be0f600b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f942b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f942b7fe640 1 -- 172.21.15.37:0/1605095959 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c035040 con 0x562771ab32f0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f942b7fe640 1 -- 172.21.15.37:0/1605095959 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f943c003800 con 0x562771ab32f0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9444004050 con 0x562771ab32f0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f942b7fe640 1 -- 172.21.15.37:0/1605095959 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f943c003a00 con 0x562771ab32f0 2024-05-09T01:11:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f945985f740 10 client.26788 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562771b47790 con 0x562771ab32f0 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.233+0000 7f942b7fe640 1 -- 172.21.15.37:0/1605095959 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9444004050 con 0x562771ab32f0 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f942b7fe640 1 -- 172.21.15.37:0/1605095959 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7f943c044030 con 0x562771ab32f0 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f945985f740 10 client.26788 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f945985f740 10 client.26788 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f945985f740 20 client.26788 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f945985f740 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a9ad80 0x562771e97c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f945985f740 4 client.26788 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562771df23d0 con 0x562771a9ad80 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f944b7fe640 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a9ad80 0x562771e97c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f942b7fe640 10 client.26788 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.234+0000 7f944b7fe640 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a9ad80 0x562771e97c50 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36a34b6adacc4946 server_cookie=971ca9ed59400db3 in_seq=0 out_seq=0 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f942b7fe640 1 -- 172.21.15.37:0/1605095959 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562771df23d0 con 0x562771a9ad80 2024-05-09T01:11:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f942b7fe640 10 client.26788 handle_command_reply: tid=0 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 client.26788 shutdown 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 msgr2=0x562771e8a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e8a2c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f943c031440 tx=0x7f943c009260 comp rx=0 tx=0).stop 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 shutdown_connections 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a9ad80 0x562771e97c50 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771abb4d0 0x562771e8a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f942b7fe640 0 client.26788 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 --2- 172.21.15.37:0/1605095959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771ab32f0 0x562771e8a2c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 >> 172.21.15.37:0/1605095959 conn(0x562771ad0300 msgr2=0x562771e7eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 shutdown_connections 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.235+0000 7f945985f740 1 -- 172.21.15.37:0/1605095959 wait complete. 2024-05-09T01:11:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.236+0000 7f945985f740 20 client.26788 trim_cache size 0 max 16384 2024-05-09T01:11:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 Processor -- start 2024-05-09T01:11:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 -- start start 2024-05-09T01:11:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771ab32f0 0x562771e8a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e916f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f943800e330 con 0x562771adc1b0 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f943800fea0 con 0x562771ab32f0 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f945985f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f943800ea00 con 0x562771abb4d0 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f944bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771ab32f0 0x562771e8a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37454/0 (socket says 172.21.15.37:37454) 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 -- 172.21.15.37:0/698145208 learned_addr learned my addr 172.21.15.37:0/698145208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f944b7fe640 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 -- 172.21.15.37:0/698145208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 msgr2=0x562771e916f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e916f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 -- 172.21.15.37:0/698145208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771ab32f0 msgr2=0x562771e8a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771ab32f0 0x562771e8a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f9450f4f640 1 -- 172.21.15.37:0/698145208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562771bbe5f0 con 0x562771adc1b0 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.251+0000 7f944bfff640 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771ab32f0 0x562771e8a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.252+0000 7f9450f4f640 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91c30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9444011dd0 tx=0x7f9444004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d719596228859d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.252+0000 7f9431ffb640 1 -- 172.21.15.37:0/698145208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444003c30 con 0x562771adc1b0 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.252+0000 7f9431ffb640 1 -- 172.21.15.37:0/698145208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9444004650 con 0x562771adc1b0 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.252+0000 7f9431ffb640 1 -- 172.21.15.37:0/698145208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9444005570 con 0x562771adc1b0 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- 172.21.15.37:0/698145208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 msgr2=0x562771e91c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91c30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9444011dd0 tx=0x7f9444004200 comp rx=0 tx=0).stop 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- 172.21.15.37:0/698145208 shutdown_connections 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771adc1b0 0x562771e91c30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e916f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 --2- 172.21.15.37:0/698145208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771ab32f0 0x562771e8a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- 172.21.15.37:0/698145208 >> 172.21.15.37:0/698145208 conn(0x562771ad0300 msgr2=0x562771e89e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- 172.21.15.37:0/698145208 shutdown_connections 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- 172.21.15.37:0/698145208 wait complete. 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- start start 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 Processor -- start 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771ab32f0 0x562771e8e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e8ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771adc1b0 0x562771efdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f943800f7d0 con 0x562771ab32f0 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f943800f100 con 0x562771adc1b0 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.253+0000 7f945985f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f943800c310 con 0x562771abb4d0 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f945985f740 10 client.0 _ll_register_callbacks cb 0x7f943c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771ab32f0 0x562771e8e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771ab32f0 0x562771e8e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37460/0 (socket says 172.21.15.37:37460) 2024-05-09T01:11:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f9450f4f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771adc1b0 0x562771efdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 -- 172.21.15.37:0/2675629393 learned_addr learned my addr 172.21.15.37:0/2675629393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944b7fe640 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e8ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 -- 172.21.15.37:0/2675629393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 msgr2=0x562771e8ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e8ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 -- 172.21.15.37:0/2675629393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771adc1b0 msgr2=0x562771efdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771adc1b0 0x562771efdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 -- 172.21.15.37:0/2675629393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562771da8ed0 con 0x562771ab32f0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f944bfff640 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771ab32f0 0x562771e8e8c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f943c042040 tx=0x7f943c0045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab76e8fb69b19b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f942b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f942b7fe640 1 -- 172.21.15.37:0/2675629393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c062070 con 0x562771ab32f0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f942b7fe640 1 -- 172.21.15.37:0/2675629393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f943c051470 con 0x562771ab32f0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.254+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562771dec240 con 0x562771ab32f0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f942b7fe640 1 -- 172.21.15.37:0/2675629393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f943c035040 con 0x562771ab32f0 2024-05-09T01:11:52.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 10 client.16986 fetch_fsmap learned FSMap version 42 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562771eff250 con 0x562771ab32f0 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f942b7fe640 1 -- 172.21.15.37:0/2675629393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562771dec240 con 0x562771ab32f0 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f942b7fe640 1 -- 172.21.15.37:0/2675629393 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 42) ==== 8358+0+0 (secure 0 0 0) 0x7f943c065020 con 0x562771ab32f0 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 10 client.16986 fetch_fsmap finished waiting for FSMap version 42 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 20 client.16986 populate_metadata read hostname 'smithi037' 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a701c0 0x562771f01c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:11:52.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 4 client.16986 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:11:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562771d67350 con 0x562771a701c0 2024-05-09T01:11:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.255+0000 7f944b7fe640 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a701c0 0x562771f01c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:11:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.256+0000 7f942b7fe640 10 client.16986 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:11:52.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:11:52.256+0000 7f944b7fe640 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a701c0 0x562771f01c90 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85f1c36b6f1bb55 server_cookie=d5ac7f4188feb919 in_seq=0 out_seq=0 2024-05-09T01:11:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:52 smithi037 ceph-mon[30122]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 979 op/s 2024-05-09T01:11:52.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:52 smithi151 ceph-mon[34780]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 979 op/s 2024-05-09T01:11:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:52 smithi136 ceph-mon[34110]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 979 op/s 2024-05-09T01:11:54.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:54 smithi037 ceph-mon[30122]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 25 MiB/s wr, 1.27k op/s 2024-05-09T01:11:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:54 smithi151 ceph-mon[34780]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 25 MiB/s wr, 1.27k op/s 2024-05-09T01:11:54.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:54 smithi136 ceph-mon[34110]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 25 MiB/s wr, 1.27k op/s 2024-05-09T01:11:55.236 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 575.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-05-09T01:11:56.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:56 smithi037 ceph-mon[30122]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 28 MiB/s wr, 1.38k op/s 2024-05-09T01:11:56.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:56 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:11:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:56 smithi151 ceph-mon[34780]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 28 MiB/s wr, 1.38k op/s 2024-05-09T01:11:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:56 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:11:56.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:56 smithi136 ceph-mon[34110]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 28 MiB/s wr, 1.38k op/s 2024-05-09T01:11:56.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:56 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:11:57.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:11:57.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:11:57.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:11:57.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:11:57.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:57.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:11:57.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:11:57.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:11:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:11:58 smithi136 ceph-mon[34110]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 30 MiB/s wr, 1.41k op/s 2024-05-09T01:11:58.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:11:58 smithi037 ceph-mon[30122]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 30 MiB/s wr, 1.41k op/s 2024-05-09T01:11:58.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:11:58 smithi151 ceph-mon[34780]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 30 MiB/s wr, 1.41k op/s 2024-05-09T01:12:00.237 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 580.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-05-09T01:12:00.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:00 smithi136 ceph-mon[34110]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 29 MiB/s wr, 1.31k op/s 2024-05-09T01:12:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f942b7fe640 1 -- 172.21.15.37:0/2675629393 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562771d67350 con 0x562771a701c0 2024-05-09T01:12:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f942b7fe640 10 client.16986 handle_command_reply: tid=0 2024-05-09T01:12:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 client.16986 shutdown 2024-05-09T01:12:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771ab32f0 msgr2=0x562771e8e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771ab32f0 0x562771e8e8c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f943c042040 tx=0x7f943c0045b0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 shutdown_connections 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562771a701c0 0x562771f01c90 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562771adc1b0 0x562771efdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562771abb4d0 0x562771e8ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 --2- 172.21.15.37:0/2675629393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562771ab32f0 0x562771e8e8c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f942b7fe640 0 client.16986 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 >> 172.21.15.37:0/2675629393 conn(0x562771ad0300 msgr2=0x562771e7ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 shutdown_connections 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.916+0000 7f945985f740 1 -- 172.21.15.37:0/2675629393 wait complete. 2024-05-09T01:12:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.917+0000 7f945985f740 20 client.16986 trim_cache size 0 max 16384 2024-05-09T01:12:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:12:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:12:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.917+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94340b27e0 msgr2=0x7f94340b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.917+0000 7f94529b2640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94340b27e0 0x7f94340b4cf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f943c004730 tx=0x7f943c0046c0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.917+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f944c1070a0 msgr2=0x7f944c102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.917+0000 7f94529b2640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f944c1070a0 0x7f944c102230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f944000e9f0 tx=0x7f944000eeb0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 shutdown_connections 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f94340b27e0 0x7f94340b4cf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f944c109a00 0x7f944c102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f944c1070a0 0x7f944c102230 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 --2- 172.21.15.37:0/690620448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944c104740 0x7f944c103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 >> 172.21.15.37:0/690620448 conn(0x7f944c0fdd40 msgr2=0x7f944c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 shutdown_connections 2024-05-09T01:12:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:00.918+0000 7f94529b2640 1 -- 172.21.15.37:0/690620448 wait complete. 2024-05-09T01:12:00.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:00 smithi037 ceph-mon[30122]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 29 MiB/s wr, 1.31k op/s 2024-05-09T01:12:00.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:00 smithi151 ceph-mon[34780]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 29 MiB/s wr, 1.31k op/s 2024-05-09T01:12:02.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:02 smithi136 ceph-mon[34110]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 28 MiB/s wr, 1.25k op/s 2024-05-09T01:12:02.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:02 smithi037 ceph-mon[30122]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 28 MiB/s wr, 1.25k op/s 2024-05-09T01:12:02.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:02 smithi151 ceph-mon[34780]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 28 MiB/s wr, 1.25k op/s 2024-05-09T01:12:03.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:12:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:03.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:03 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:03.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:03 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:03.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:03 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:04.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:04 smithi037 ceph-mon[30122]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 20 MiB/s wr, 838 op/s 2024-05-09T01:12:04.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:04 smithi136 ceph-mon[34110]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 20 MiB/s wr, 838 op/s 2024-05-09T01:12:04.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:04 smithi151 ceph-mon[34780]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 20 MiB/s wr, 838 op/s 2024-05-09T01:12:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 585.0 s, 1677.2 tps, lat 197.252 ms stddev 1339.430 2024-05-09T01:12:05.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.756+0000 7fcfe0618700 1 -- 172.21.15.37:0/3926135958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 msgr2=0x7fcfd810cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.756+0000 7fcfe0618700 1 --2- 172.21.15.37:0/3926135958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd810cc50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009f90 tx=0x7fcfd000b330 comp rx=0 tx=0).stop 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.757+0000 7fcfe0618700 1 -- 172.21.15.37:0/3926135958 shutdown_connections 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.757+0000 7fcfe0618700 1 --2- 172.21.15.37:0/3926135958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8110fb0 0x7fcfd81188f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.757+0000 7fcfe0618700 1 --2- 172.21.15.37:0/3926135958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd810cc50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.757+0000 7fcfe0618700 1 --2- 172.21.15.37:0/3926135958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd8110660 0x7fcfd8110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.757+0000 7fcfe0618700 1 -- 172.21.15.37:0/3926135958 >> 172.21.15.37:0/3926135958 conn(0x7fcfd806f4d0 msgr2=0x7fcfd806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.757+0000 7fcfe0618700 1 -- 172.21.15.37:0/3926135958 shutdown_connections 2024-05-09T01:12:05.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.757+0000 7fcfe0618700 1 -- 172.21.15.37:0/3926135958 wait complete. 2024-05-09T01:12:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.758+0000 7fcfe0618700 1 Processor -- start 2024-05-09T01:12:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.759+0000 7fcfe0618700 1 -- start start 2024-05-09T01:12:05.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.759+0000 7fcfe0618700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd81a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.759+0000 7fcfe0618700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8110660 0x7fcfd81a6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.759+0000 7fcfe0618700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd8110fb0 0x7fcfd81a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.759+0000 7fcfe0618700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd811bcd0 con 0x7fcfd8110660 2024-05-09T01:12:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.759+0000 7fcfe0618700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd811bb50 con 0x7fcfd8110fb0 2024-05-09T01:12:05.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.759+0000 7fcfe0618700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd811be50 con 0x7fcfd810c840 2024-05-09T01:12:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd81a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd81a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41448/0 (socket says 172.21.15.37:41448) 2024-05-09T01:12:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 -- 172.21.15.37:0/2704282095 learned_addr learned my addr 172.21.15.37:0/2704282095 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8110660 0x7fcfd81a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd8110fb0 0x7fcfd81a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 -- 172.21.15.37:0/2704282095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd8110fb0 msgr2=0x7fcfd81a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd8110fb0 0x7fcfd81a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 -- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8110660 msgr2=0x7fcfd81a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8110660 0x7fcfd81a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.760+0000 7fcfde3b4700 1 -- 172.21.15.37:0/2704282095 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd81a1ae0 con 0x7fcfd810c840 2024-05-09T01:12:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.761+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8110660 0x7fcfd81a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:05.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.761+0000 7fcfde3b4700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd81a60f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009660 tx=0x7fcfd0009460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.766+0000 7fcfd77fe700 1 -- 172.21.15.37:0/2704282095 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0021070 con 0x7fcfd810c840 2024-05-09T01:12:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.767+0000 7fcfd77fe700 1 -- 172.21.15.37:0/2704282095 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfd0007b40 con 0x7fcfd810c840 2024-05-09T01:12:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.767+0000 7fcfd77fe700 1 -- 172.21.15.37:0/2704282095 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00052a0 con 0x7fcfd810c840 2024-05-09T01:12:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.767+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd81a1d70 con 0x7fcfd810c840 2024-05-09T01:12:05.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.767+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd81abe10 con 0x7fcfd810c840 2024-05-09T01:12:05.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.792+0000 7fcfef02eb80 1 Processor -- start 2024-05-09T01:12:05.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.792+0000 7fcfef02eb80 1 -- start start 2024-05-09T01:12:05.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0d176a0 0x55eec0d17ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eec0c39ff0 con 0x55eec0d176a0 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55eec0bd87f0 con 0x55eec0c84160 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55eec0c35fb0 con 0x55eec0b9a4a0 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfdebb5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfdebb5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55684/0 (socket says 172.21.15.37:55684) 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfdebb5700 1 -- 172.21.15.37:0/2327819038 learned_addr learned my addr 172.21.15.37:0/2327819038 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:05.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.793+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0d176a0 0x55eec0d17ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.794+0000 7fcfdebb5700 1 -- 172.21.15.37:0/2327819038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0b9a4a0 msgr2=0x55eec0d1da30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.794+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.794+0000 7fcfdebb5700 1 -- 172.21.15.37:0/2327819038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0d176a0 msgr2=0x55eec0d17ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.794+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0d176a0 0x55eec0d17ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.794+0000 7fcfdebb5700 1 -- 172.21.15.37:0/2327819038 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec0bd0370 con 0x55eec0c84160 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.794+0000 7fcfd77fe700 1 -- 172.21.15.37:0/2704282095 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fcfd0024070 con 0x7fcfd810c840 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.794+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1d4f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800b7f0 tx=0x7fcfc800bb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740f1d2d484e76f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.795+0000 7fcfd4ff9700 1 -- 172.21.15.37:0/2327819038 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80125f0 con 0x55eec0c84160 2024-05-09T01:12:05.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.795+0000 7fcfd4ff9700 1 -- 172.21.15.37:0/2327819038 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfc8018070 con 0x55eec0c84160 2024-05-09T01:12:05.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.795+0000 7fcfd4ff9700 1 -- 172.21.15.37:0/2327819038 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8013d20 con 0x55eec0c84160 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.795+0000 7fcfd77fe700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcfc00b2a90 0x7fcfc00b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfd77fe700 1 -- 172.21.15.37:0/2704282095 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcfd000f020 con 0x7fcfd810c840 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfde3b4700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcfc00b2a90 0x7fcfc00b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2327819038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 msgr2=0x55eec0d1d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1d4f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800b7f0 tx=0x7fcfc800bb00 comp rx=0 tx=0).stop 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfde3b4700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcfc00b2a90 0x7fcfc00b4fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00a7ed0 tx=0x7fcfd000b330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2327819038 shutdown_connections 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0d176a0 0x55eec0d17ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1d4f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2327819038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.796+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2327819038 >> 172.21.15.37:0/2327819038 conn(0x55eec0bfa6a0 msgr2=0x55eec0d12400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.797+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2327819038 shutdown_connections 2024-05-09T01:12:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.797+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2327819038 wait complete. 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.797+0000 7fcfef02eb80 1 -- start start 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.797+0000 7fcfef02eb80 1 Processor -- start 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d21c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eec0ab5ba0 con 0x55eec0b9a4a0 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55eec0bf4150 con 0x55eec0d176a0 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55eec0d241d0 con 0x55eec0c84160 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfef02eb80 10 client.0 _ll_register_callbacks cb 0x55eec0aab6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfddbb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfddbb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d216e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41450/0 (socket says 172.21.15.37:41450) 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfddbb3700 1 -- 172.21.15.37:0/3572702137 learned_addr learned my addr 172.21.15.37:0/3572702137 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.798+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d21c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfddbb3700 1 -- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 msgr2=0x55eec0d21c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d21c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfddbb3700 1 -- 172.21.15.37:0/3572702137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 msgr2=0x55eec0d211a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d211a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfddbb3700 1 -- 172.21.15.37:0/3572702137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec0ab5490 con 0x55eec0c84160 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d216e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc012810 tx=0x7fcfcc012b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7c118d12d87cedc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfbdffb700 1 -- 172.21.15.37:0/3572702137 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc004240 con 0x55eec0c84160 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc8018070 con 0x55eec0c84160 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfbdffb700 1 -- 172.21.15.37:0/3572702137 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcfcc0043e0 con 0x55eec0c84160 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfbdffb700 1 -- 172.21.15.37:0/3572702137 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fcfcc003680 con 0x55eec0c84160 2024-05-09T01:12:05.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfef02eb80 10 client.26803 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.799+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55eec0d2ece0 con 0x55eec0c84160 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfbdffb700 1 -- 172.21.15.37:0/3572702137 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfc8018070 con 0x55eec0c84160 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfbdffb700 1 -- 172.21.15.37:0/3572702137 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fcfcc011ac0 con 0x55eec0c84160 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfef02eb80 10 client.26803 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfef02eb80 10 client.26803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfef02eb80 20 client.26803 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d31270 0x55eec0d33690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfef02eb80 4 client.26803 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eec0c479d0 con 0x55eec0d31270 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.800+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d31270 0x55eec0d33690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.801+0000 7fcfbdffb700 10 client.26803 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.801+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d31270 0x55eec0d33690 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40f01a9f2308582b server_cookie=9194bd5c31e73177 in_seq=0 out_seq=0 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.801+0000 7fcfbdffb700 1 -- 172.21.15.37:0/3572702137 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55eec0c479d0 con 0x55eec0d31270 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.801+0000 7fcfbdffb700 10 client.26803 handle_command_reply: tid=0 2024-05-09T01:12:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.801+0000 7fcfef02eb80 1 client.26803 shutdown 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.801+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 msgr2=0x55eec0d216e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.801+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d216e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc012810 tx=0x7fcfcc012b20 comp rx=0 tx=0).stop 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 shutdown_connections 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d31270 0x55eec0d33690 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d21c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d211a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfbdffb700 0 client.26803 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/3572702137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d216e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 >> 172.21.15.37:0/3572702137 conn(0x55eec0bfa6a0 msgr2=0x55eec0d121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 shutdown_connections 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 1 -- 172.21.15.37:0/3572702137 wait complete. 2024-05-09T01:12:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.802+0000 7fcfef02eb80 20 client.26803 trim_cache size 0 max 16384 2024-05-09T01:12:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.825+0000 7fcfef02eb80 1 Processor -- start 2024-05-09T01:12:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.826+0000 7fcfef02eb80 1 -- start start 2024-05-09T01:12:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.826+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.826+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d19e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d16da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc400d240 con 0x55eec0b9a4a0 2024-05-09T01:12:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc400ed80 con 0x55eec0d176a0 2024-05-09T01:12:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc400d910 con 0x55eec0c84160 2024-05-09T01:12:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfddbb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d19e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfddbb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d19e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41452/0 (socket says 172.21.15.37:41452) 2024-05-09T01:12:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfddbb3700 1 -- 172.21.15.37:0/2928964610 learned_addr learned my addr 172.21.15.37:0/2928964610 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d16da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfdebb5700 1 -- 172.21.15.37:0/2928964610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 msgr2=0x55eec0d19e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.827+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d19e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.828+0000 7fcfdebb5700 1 -- 172.21.15.37:0/2928964610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 msgr2=0x55eec0d1fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.828+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.828+0000 7fcfdebb5700 1 -- 172.21.15.37:0/2928964610 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec0d20f70 con 0x55eec0d176a0 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.828+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d16da0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55eec0d20a20 tx=0x7fcfc8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3fe7d51e1e1281 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.828+0000 7fcfbffff700 1 -- 172.21.15.37:0/2928964610 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8013af0 con 0x55eec0d176a0 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.828+0000 7fcfbffff700 1 -- 172.21.15.37:0/2928964610 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfc8018070 con 0x55eec0d176a0 2024-05-09T01:12:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.828+0000 7fcfbffff700 1 -- 172.21.15.37:0/2928964610 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80039a0 con 0x55eec0d176a0 2024-05-09T01:12:05.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2928964610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 msgr2=0x55eec0d16da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d16da0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x55eec0d20a20 tx=0x7fcfc8008040 comp rx=0 tx=0).stop 2024-05-09T01:12:05.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2928964610 shutdown_connections 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0d176a0 0x55eec0d16da0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2928964610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0c84160 0x55eec0d19e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2928964610 >> 172.21.15.37:0/2928964610 conn(0x55eec0bfa6a0 msgr2=0x55eec0d16690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.829+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2928964610 shutdown_connections 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2928964610 wait complete. 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 -- start start 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 Processor -- start 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0d176a0 0x55eec0d279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc400e6b0 con 0x55eec0b9a4a0 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc400dfe0 con 0x55eec0c84160 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc400b1e0 con 0x55eec0d176a0 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.830+0000 7fcfef02eb80 10 client.0 _ll_register_callbacks cb 0x55eec0d12010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfdebb5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55702/0 (socket says 172.21.15.37:55702) 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 -- 172.21.15.37:0/2702447827 learned_addr learned my addr 172.21.15.37:0/2702447827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0d176a0 0x55eec0d279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 -- 172.21.15.37:0/2702447827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0d176a0 msgr2=0x55eec0d279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0d176a0 0x55eec0d279f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 -- 172.21.15.37:0/2702447827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 msgr2=0x55eec0d1e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 -- 172.21.15.37:0/2702447827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec0d1efc0 con 0x55eec0c84160 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfddbb3700 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1e7c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000c00 tx=0x7fcfcc012e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45131d423f808887 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfbdffb700 1 -- 172.21.15.37:0/2702447827 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc02c040 con 0x55eec0c84160 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc8018070 con 0x55eec0c84160 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.831+0000 7fcfbdffb700 1 -- 172.21.15.37:0/2702447827 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fcfcc003820 con 0x55eec0c84160 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfbdffb700 1 -- 172.21.15.37:0/2702447827 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fcfcc003a60 con 0x55eec0c84160 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 10 client.26837 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55eec0d9bf00 con 0x55eec0c84160 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfbdffb700 1 -- 172.21.15.37:0/2702447827 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfc8018070 con 0x55eec0c84160 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfbdffb700 1 -- 172.21.15.37:0/2702447827 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fcfcc00f530 con 0x55eec0c84160 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 10 client.26837 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 10 client.26837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 20 client.26837 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d9c690 0x55eec0d9eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 4 client.26837 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:12:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eec0c41a70 con 0x55eec0d9c690 2024-05-09T01:12:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.832+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d9c690 0x55eec0d9eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.833+0000 7fcfbdffb700 10 client.26837 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.833+0000 7fcfdebb5700 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d9c690 0x55eec0d9eab0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdfd7f46c36b41a9 server_cookie=7395a535fcce226a in_seq=0 out_seq=0 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.835+0000 7fcfbdffb700 1 -- 172.21.15.37:0/2702447827 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55eec0c41a70 con 0x55eec0d9c690 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.835+0000 7fcfbdffb700 10 client.26837 handle_command_reply: tid=0 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.835+0000 7fcfef02eb80 1 client.26837 shutdown 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.835+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 msgr2=0x55eec0d1e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.835+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1e7c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000c00 tx=0x7fcfcc012e70 comp rx=0 tx=0).stop 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.835+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 shutdown_connections 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.835+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55eec0d9c690 0x55eec0d9eab0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eec0d176a0 0x55eec0d279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eec0b9a4a0 0x55eec0d1e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfef02eb80 1 --2- 172.21.15.37:0/2702447827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55eec0c84160 0x55eec0d1e7c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 >> 172.21.15.37:0/2702447827 conn(0x55eec0bfa6a0 msgr2=0x55eec0d1ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfbdffb700 0 client.26837 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 shutdown_connections 2024-05-09T01:12:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfef02eb80 1 -- 172.21.15.37:0/2702447827 wait complete. 2024-05-09T01:12:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.836+0000 7fcfef02eb80 20 client.26837 trim_cache size 0 max 16384 2024-05-09T01:12:05.840 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:12:05.840 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:12:05.840 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:12:05.840 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcfc00b2a90 msgr2=0x7fcfc00b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcfc00b2a90 0x7fcfc00b4fa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00a7ed0 tx=0x7fcfd000b330 comp rx=0 tx=0).stop 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 msgr2=0x7fcfd81a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd81a60f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0009660 tx=0x7fcfd0009460 comp rx=0 tx=0).stop 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 shutdown_connections 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fcfc00b2a90 0x7fcfc00b4fa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd8110fb0 0x7fcfd81a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfd810c840 0x7fcfd81a60f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 --2- 172.21.15.37:0/2704282095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfd8110660 0x7fcfd81a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 >> 172.21.15.37:0/2704282095 conn(0x7fcfd806f4d0 msgr2=0x7fcfd810efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 shutdown_connections 2024-05-09T01:12:05.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:05.837+0000 7fcfe0618700 1 -- 172.21.15.37:0/2704282095 wait complete. 2024-05-09T01:12:06.653 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:12:06.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:12:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:06 smithi136 ceph-mon[34110]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 489 op/s 2024-05-09T01:12:06.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:06 smithi037 ceph-mon[30122]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 489 op/s 2024-05-09T01:12:06.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:06 smithi151 ceph-mon[34780]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 489 op/s 2024-05-09T01:12:07.021 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:08.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:08 smithi037 ceph-mon[30122]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.3 MiB/s wr, 399 op/s 2024-05-09T01:12:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:08 smithi136 ceph-mon[34110]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.3 MiB/s wr, 399 op/s 2024-05-09T01:12:08.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:08 smithi151 ceph-mon[34780]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 9.3 MiB/s wr, 399 op/s 2024-05-09T01:12:09.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.043+0000 7f73f13e7700 1 -- 172.21.15.37:0/2703568851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec1045f0 msgr2=0x7f73ec104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:09.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.043+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2703568851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec1045f0 0x7f73ec104a00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0099c0 tx=0x7f73dc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.045+0000 7f73f13e7700 1 -- 172.21.15.37:0/2703568851 shutdown_connections 2024-05-09T01:12:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.045+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2703568851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec109870 0x7f73ec1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.045+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2703568851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec1045f0 0x7f73ec104a00 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.045+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2703568851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 0x7f73ec109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.045+0000 7f73f13e7700 1 -- 172.21.15.37:0/2703568851 >> 172.21.15.37:0/2703568851 conn(0x7f73ec100040 msgr2=0x7f73ec102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.045+0000 7f73f13e7700 1 -- 172.21.15.37:0/2703568851 shutdown_connections 2024-05-09T01:12:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.045+0000 7f73f13e7700 1 -- 172.21.15.37:0/2703568851 wait complete. 2024-05-09T01:12:09.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.046+0000 7f73f13e7700 1 Processor -- start 2024-05-09T01:12:09.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.046+0000 7f73f13e7700 1 -- start start 2024-05-09T01:12:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.047+0000 7f73f13e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec1045f0 0x7f73ec1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.047+0000 7f73f13e7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 0x7f73ec1a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.047+0000 7f73eaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec1045f0 0x7f73ec1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.047+0000 7f73eaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec1045f0 0x7f73ec1a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41480/0 (socket says 172.21.15.37:41480) 2024-05-09T01:12:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.047+0000 7f73ea7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 0x7f73ec1a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.048+0000 7f73ea7fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 0x7f73ec1a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55718/0 (socket says 172.21.15.37:55718) 2024-05-09T01:12:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.048+0000 7f73eaffd700 1 -- 172.21.15.37:0/2234291260 learned_addr learned my addr 172.21.15.37:0/2234291260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.048+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec109870 0x7f73ec1a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.048+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec112360 con 0x7f73ec109870 2024-05-09T01:12:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.048+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec1121e0 con 0x7f73ec108f20 2024-05-09T01:12:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.048+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec1124e0 con 0x7f73ec1045f0 2024-05-09T01:12:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.048+0000 7f73eb7fe700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec109870 0x7f73ec1a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73eb7fe700 1 -- 172.21.15.37:0/2234291260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec1045f0 msgr2=0x7f73ec1a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73eb7fe700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec1045f0 0x7f73ec1a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73eb7fe700 1 -- 172.21.15.37:0/2234291260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 msgr2=0x7f73ec1a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73eb7fe700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 0x7f73ec1a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73eb7fe700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec1a6430 con 0x7f73ec109870 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73ea7fc700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 0x7f73ec1a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73eaffd700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec1045f0 0x7f73ec1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:12:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.049+0000 7f73eb7fe700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec109870 0x7f73ec1a5d90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f73e400be20 tx=0x7f73e400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.050+0000 7f73d3fff700 1 -- 172.21.15.37:0/2234291260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4019070 con 0x7f73ec109870 2024-05-09T01:12:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.050+0000 7f73d3fff700 1 -- 172.21.15.37:0/2234291260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e400cd10 con 0x7f73ec109870 2024-05-09T01:12:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.050+0000 7f73d3fff700 1 -- 172.21.15.37:0/2234291260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e40126a0 con 0x7f73ec109870 2024-05-09T01:12:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.050+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ec1a6720 con 0x7f73ec109870 2024-05-09T01:12:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.050+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ec1ae040 con 0x7f73ec109870 2024-05-09T01:12:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.051+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d8005330 con 0x7f73ec109870 2024-05-09T01:12:09.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.053+0000 7f73d3fff700 1 -- 172.21.15.37:0/2234291260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f73e401c070 con 0x7f73ec109870 2024-05-09T01:12:09.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.054+0000 7f73d3fff700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f73d40b2870 0x7f73d40b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:09.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.054+0000 7f73d3fff700 1 -- 172.21.15.37:0/2234291260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f73e40e17b0 con 0x7f73ec109870 2024-05-09T01:12:09.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.057+0000 7f73eaffd700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f73d40b2870 0x7f73d40b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:09.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.057+0000 7f73eaffd700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f73d40b2870 0x7f73d40b4d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f73dc003800 tx=0x7f73dc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:09.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.065+0000 7f73d3fff700 1 -- 172.21.15.37:0/2234291260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f73e40a9570 con 0x7f73ec109870 2024-05-09T01:12:09.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.507+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73d80058f0 con 0x7f73ec109870 2024-05-09T01:12:09.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.508+0000 7f73d3fff700 1 -- 172.21.15.37:0/2234291260 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11936 (secure 0 0 0) 0x7f73e40a8e70 con 0x7f73ec109870 2024-05-09T01:12:09.509 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:12:09.509 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:12:01.665325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24454,24491,24445,24446,24467]},"id":1}]} 2024-05-09T01:12:09.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.511+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f73d40b2870 msgr2=0x7f73d40b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:09.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.511+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f73d40b2870 0x7f73d40b4d80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f73dc003800 tx=0x7f73dc005fb0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.511+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec109870 msgr2=0x7f73ec1a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec109870 0x7f73ec1a5d90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f73e400be20 tx=0x7f73e400bf00 comp rx=0 tx=0).stop 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 shutdown_connections 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f73d40b2870 0x7f73d40b4d80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73ec109870 0x7f73ec1a5d90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73ec1045f0 0x7f73ec1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 --2- 172.21.15.37:0/2234291260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73ec108f20 0x7f73ec1a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 >> 172.21.15.37:0/2234291260 conn(0x7f73ec100040 msgr2=0x7f73ec108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:09.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 shutdown_connections 2024-05-09T01:12:09.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:09.512+0000 7f73f13e7700 1 -- 172.21.15.37:0/2234291260 wait complete. 2024-05-09T01:12:09.515 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 43 2024-05-09T01:12:09.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:09 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2234291260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:12:09.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:09 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2234291260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:12:09.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:09 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2234291260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:12:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 590.0 s, 1840.3 tps, lat 54.664 ms stddev 62.636 2024-05-09T01:12:10.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:12:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:10 smithi037 ceph-mon[30122]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.8 MiB/s wr, 360 op/s 2024-05-09T01:12:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:10.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:10 smithi136 ceph-mon[34110]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.8 MiB/s wr, 360 op/s 2024-05-09T01:12:10.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:10 smithi151 ceph-mon[34780]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.8 MiB/s wr, 360 op/s 2024-05-09T01:12:11.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:11 smithi136 ceph-mon[34110]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.3 MiB/s wr, 490 op/s 2024-05-09T01:12:11.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:11 smithi037 ceph-mon[30122]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.3 MiB/s wr, 490 op/s 2024-05-09T01:12:11.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:11 smithi151 ceph-mon[34780]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.3 MiB/s wr, 490 op/s 2024-05-09T01:12:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.915+0000 7f2b56cbc700 1 -- 172.21.15.37:0/2097960839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b501034c0 msgr2=0x7f2b501038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.915+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/2097960839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b501034c0 0x7f2b501038d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009990 tx=0x7f2b40009ca0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.917+0000 7f2b56cbc700 1 -- 172.21.15.37:0/2097960839 shutdown_connections 2024-05-09T01:12:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.917+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/2097960839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b50108740 0x7f2b501100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.917+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/2097960839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b501034c0 0x7f2b501038d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.917+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/2097960839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b50107df0 0x7f2b50108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.917+0000 7f2b56cbc700 1 -- 172.21.15.37:0/2097960839 >> 172.21.15.37:0/2097960839 conn(0x7f2b500fedc0 msgr2=0x7f2b501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.917+0000 7f2b56cbc700 1 -- 172.21.15.37:0/2097960839 shutdown_connections 2024-05-09T01:12:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.918+0000 7f2b56cbc700 1 -- 172.21.15.37:0/2097960839 wait complete. 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.918+0000 7f2b56cbc700 1 Processor -- start 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.918+0000 7f2b56cbc700 1 -- start start 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b56cbc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b501034c0 0x7f2b5019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b56cbc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b50107df0 0x7f2b5019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b56cbc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50108740 0x7f2b50198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b56cbc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501122d0 con 0x7f2b501034c0 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b56cbc700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50112150 con 0x7f2b50108740 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b56cbc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50112450 con 0x7f2b50107df0 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b55259700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50108740 0x7f2b50198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b54a58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b501034c0 0x7f2b5019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b55259700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50108740 0x7f2b50198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50712/0 (socket says 172.21.15.37:50712) 2024-05-09T01:12:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b55259700 1 -- 172.21.15.37:0/368347777 learned_addr learned my addr 172.21.15.37:0/368347777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.919+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b50107df0 0x7f2b5019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.920+0000 7f2b55259700 1 -- 172.21.15.37:0/368347777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b50107df0 msgr2=0x7f2b5019ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.920+0000 7f2b55259700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b50107df0 0x7f2b5019ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.920+0000 7f2b55259700 1 -- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b501034c0 msgr2=0x7f2b5019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.920+0000 7f2b55259700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b501034c0 0x7f2b5019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.920+0000 7f2b55259700 1 -- 172.21.15.37:0/368347777 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b501991d0 con 0x7f2b50108740 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.920+0000 7f2b55259700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50108740 0x7f2b50198af0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800ee10 tx=0x7f2b4800c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.921+0000 7f2b4dffb700 1 -- 172.21.15.37:0/368347777 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b480092d0 con 0x7f2b50108740 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.921+0000 7f2b4dffb700 1 -- 172.21.15.37:0/368347777 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b48017070 con 0x7f2b50108740 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.921+0000 7f2b4dffb700 1 -- 172.21.15.37:0/368347777 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004820 con 0x7f2b50108740 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.921+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b501994c0 con 0x7f2b50108740 2024-05-09T01:12:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.921+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b501998f0 con 0x7f2b50108740 2024-05-09T01:12:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.924+0000 7f2b4dffb700 1 -- 172.21.15.37:0/368347777 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2b480135c0 con 0x7f2b50108740 2024-05-09T01:12:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.926+0000 7f2b656d2b80 1 Processor -- start 2024-05-09T01:12:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.926+0000 7f2b656d2b80 1 -- start start 2024-05-09T01:12:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.926+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954aea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.926+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.926+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.926+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954aea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50728/0 (socket says 172.21.15.37:50728) 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b54a58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b54a58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52292/0 (socket says 172.21.15.37:52292) 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 0x5625954a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5625953c30a0 con 0x5625953234a0 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b4ffff700 1 -- 172.21.15.37:0/2874199034 learned_addr learned my addr 172.21.15.37:0/2874199034 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b656d2b80 1 -- 172.21.15.37:0/2874199034 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5625953689a0 con 0x56259539dd00 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b656d2b80 1 -- 172.21.15.37:0/2874199034 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5625953bf060 con 0x5625954a8c10 2024-05-09T01:12:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b4dffb700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2b380b2a50 0x7f2b380b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b55259700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2b380b2a50 0x7f2b380b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b4ffff700 1 -- 172.21.15.37:0/2874199034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 msgr2=0x5625954a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 0x5625954a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b4ffff700 1 -- 172.21.15.37:0/2874199034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 msgr2=0x5625954aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.927+0000 7f2b4ffff700 1 -- 172.21.15.37:0/2874199034 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562595359500 con 0x56259539dd00 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.928+0000 7f2b54a58700 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.928+0000 7f2b4dffb700 1 -- 172.21.15.37:0/368347777 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2b480e5d70 con 0x7f2b50108740 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.928+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954aea50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009d80 tx=0x7f2b440116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f97863b6b96a28 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.928+0000 7f2b55259700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2b380b2a50 0x7f2b380b4f60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b4801d760 tx=0x7f2b48015040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.928+0000 7f2b36ffd700 1 -- 172.21.15.37:0/2874199034 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44011e20 con 0x56259539dd00 2024-05-09T01:12:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.928+0000 7f2b36ffd700 1 -- 172.21.15.37:0/2874199034 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b44012900 con 0x56259539dd00 2024-05-09T01:12:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.928+0000 7f2b36ffd700 1 -- 172.21.15.37:0/2874199034 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400f8a0 con 0x56259539dd00 2024-05-09T01:12:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.929+0000 7f2b656d2b80 1 -- 172.21.15.37:0/2874199034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 msgr2=0x5625954aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.929+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954aea50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009d80 tx=0x7f2b440116c0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.930+0000 7f2b656d2b80 1 -- 172.21.15.37:0/2874199034 shutdown_connections 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.930+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 0x5625954a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.930+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954aea50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.930+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/2874199034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.930+0000 7f2b656d2b80 1 -- 172.21.15.37:0/2874199034 >> 172.21.15.37:0/2874199034 conn(0x562595326f70 msgr2=0x56259549b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.930+0000 7f2b656d2b80 1 -- 172.21.15.37:0/2874199034 shutdown_connections 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.930+0000 7f2b656d2b80 1 -- 172.21.15.37:0/2874199034 wait complete. 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.931+0000 7f2b656d2b80 1 -- start start 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.931+0000 7f2b656d2b80 1 Processor -- start 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.932+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.932+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.932+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 0x5625954b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.932+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5625954a9970 con 0x5625953234a0 2024-05-09T01:12:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.932+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56259535db20 con 0x56259539dd00 2024-05-09T01:12:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.932+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5625954b5830 con 0x5625954a8c10 2024-05-09T01:12:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.932+0000 7f2b656d2b80 10 client.0 _ll_register_callbacks cb 0x5625952346c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:12.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.933+0000 7f2b54a58700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.936+0000 7f2b54a58700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50740/0 (socket says 172.21.15.37:50740) 2024-05-09T01:12:12.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.936+0000 7f2b54a58700 1 -- 172.21.15.37:0/4018816573 learned_addr learned my addr 172.21.15.37:0/4018816573 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.939+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.939+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 0x5625954b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.940+0000 7f2b54a58700 1 -- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 msgr2=0x5625954b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.940+0000 7f2b54a58700 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 0x5625954b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.940+0000 7f2b54a58700 1 -- 172.21.15.37:0/4018816573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 msgr2=0x5625954b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.940+0000 7f2b54a58700 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.940+0000 7f2b54a58700 1 -- 172.21.15.37:0/4018816573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56259523e490 con 0x56259539dd00 2024-05-09T01:12:12.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.952+0000 7f2b54a58700 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954b2dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009990 tx=0x7f2b4000d400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83a33d1095abe2b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.953+0000 7f2b2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.953+0000 7f2b2ffff700 1 -- 172.21.15.37:0/4018816573 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40025060 con 0x56259539dd00 2024-05-09T01:12:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.953+0000 7f2b2ffff700 1 -- 172.21.15.37:0/4018816573 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2b4000d820 con 0x56259539dd00 2024-05-09T01:12:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.954+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b44012900 con 0x56259539dd00 2024-05-09T01:12:12.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.958+0000 7f2b2ffff700 1 -- 172.21.15.37:0/4018816573 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2b4001a040 con 0x56259539dd00 2024-05-09T01:12:12.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.961+0000 7f2b656d2b80 10 client.26852 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:12.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.961+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5625954c0090 con 0x56259539dd00 2024-05-09T01:12:12.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b2ffff700 1 -- 172.21.15.37:0/4018816573 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b40005070 con 0x56259539dd00 2024-05-09T01:12:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b2ffff700 1 -- 172.21.15.37:0/4018816573 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f2b40020470 con 0x56259539dd00 2024-05-09T01:12:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b656d2b80 10 client.26852 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b656d2b80 10 client.26852 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:12:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b656d2b80 20 client.26852 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x5625954c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b656d2b80 4 client.26852 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:12.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.965+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2b44012900 con 0x5625954c25c0 2024-05-09T01:12:12.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.968+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x5625954c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:12.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.969+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x5625954c49e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fcaaf84b867e3da2 server_cookie=e2fbf7050c40b169 in_seq=0 out_seq=0 2024-05-09T01:12:12.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.969+0000 7f2b2ffff700 10 client.26852 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:12:12.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.971+0000 7f2b2ffff700 1 -- 172.21.15.37:0/4018816573 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f2b44012900 con 0x5625954c25c0 2024-05-09T01:12:12.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.971+0000 7f2b2ffff700 10 client.26852 handle_command_reply: tid=0 2024-05-09T01:12:12.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.971+0000 7f2b656d2b80 1 client.26852 shutdown 2024-05-09T01:12:12.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.971+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 msgr2=0x5625954b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:12.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.971+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954b2dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009990 tx=0x7f2b4000d400 comp rx=0 tx=0).stop 2024-05-09T01:12:12.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.972+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 shutdown_connections 2024-05-09T01:12:12.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.972+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x5625954c49e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.972+0000 7f2b2ffff700 0 client.26852 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:12:12.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.972+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625954a8c10 0x5625954b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.972+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625953234a0 0x5625954b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.972+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/4018816573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954b2dd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:12.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.972+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 >> 172.21.15.37:0/4018816573 conn(0x562595326f70 msgr2=0x562595494ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:12.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.974+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 shutdown_connections 2024-05-09T01:12:12.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.974+0000 7f2b656d2b80 1 -- 172.21.15.37:0/4018816573 wait complete. 2024-05-09T01:12:12.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:12.975+0000 7f2b656d2b80 20 client.26852 trim_cache size 0 max 16384 2024-05-09T01:12:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.001+0000 7f2b656d2b80 1 Processor -- start 2024-05-09T01:12:13.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.001+0000 7f2b656d2b80 1 -- start start 2024-05-09T01:12:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56259539dd00 0x5625954be640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625954a8c10 0x5625954beb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501ac950 con 0x56259539dd00 2024-05-09T01:12:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501ae490 con 0x5625954a8c10 2024-05-09T01:12:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501ad020 con 0x5625953234a0 2024-05-09T01:12:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625954a8c10 0x5625954beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b4ffff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625954a8c10 0x5625954beb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50756/0 (socket says 172.21.15.37:50756) 2024-05-09T01:12:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b4ffff700 1 -- 172.21.15.37:0/865461016 learned_addr learned my addr 172.21.15.37:0/865461016 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.002+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b4ffff700 1 -- 172.21.15.37:0/865461016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 msgr2=0x5625954b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b4ffff700 1 -- 172.21.15.37:0/865461016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56259539dd00 msgr2=0x5625954be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56259539dd00 0x5625954be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b4ffff700 1 -- 172.21.15.37:0/865461016 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625954979d0 con 0x5625954a8c10 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625954a8c10 0x5625954beb80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009d20 tx=0x7f2b4400f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=623fe77899ed3f5b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b367fc700 1 -- 172.21.15.37:0/865461016 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44005380 con 0x5625954a8c10 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b367fc700 1 -- 172.21.15.37:0/865461016 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b44005520 con 0x5625954a8c10 2024-05-09T01:12:13.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.003+0000 7f2b367fc700 1 -- 172.21.15.37:0/865461016 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44012830 con 0x5625954a8c10 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 -- 172.21.15.37:0/865461016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625954a8c10 msgr2=0x5625954beb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625954a8c10 0x5625954beb80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009d20 tx=0x7f2b4400f440 comp rx=0 tx=0).stop 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 -- 172.21.15.37:0/865461016 shutdown_connections 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5625954a8c10 0x5625954beb80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/865461016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56259539dd00 0x5625954be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 -- 172.21.15.37:0/865461016 >> 172.21.15.37:0/865461016 conn(0x562595326f70 msgr2=0x5625954ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.004+0000 7f2b656d2b80 1 -- 172.21.15.37:0/865461016 shutdown_connections 2024-05-09T01:12:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.005+0000 7f2b656d2b80 1 -- 172.21.15.37:0/865461016 wait complete. 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.005+0000 7f2b656d2b80 1 -- start start 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.005+0000 7f2b656d2b80 1 Processor -- start 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.005+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b656d2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625954a8c10 0x5625954c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501addc0 con 0x5625954a8c10 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501ad6f0 con 0x56259539dd00 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b656d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501aa930 con 0x5625953234a0 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b656d2b80 10 client.0 _ll_register_callbacks cb 0x5625954a95d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b54a58700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b54a58700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50758/0 (socket says 172.21.15.37:50758) 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b54a58700 1 -- 172.21.15.37:0/796838028 learned_addr learned my addr 172.21.15.37:0/796838028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625954a8c10 0x5625954c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.006+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.007+0000 7f2b4ffff700 1 -- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 msgr2=0x5625954ba9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.007+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954ba9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.007+0000 7f2b4ffff700 1 -- 172.21.15.37:0/796838028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 msgr2=0x5625954baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.007+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954baf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.007+0000 7f2b4ffff700 1 -- 172.21.15.37:0/796838028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625954c96b0 con 0x5625954a8c10 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.008+0000 7f2b4ffff700 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625954a8c10 0x5625954c9170 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2b44001eb0 tx=0x7f2b44014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca247bcd1a0dfd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.008+0000 7f2b2ffff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.008+0000 7f2b2ffff700 1 -- 172.21.15.37:0/796838028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44003680 con 0x5625954a8c10 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.008+0000 7f2b2ffff700 1 -- 172.21.15.37:0/796838028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2b44003820 con 0x5625954a8c10 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.008+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b44005520 con 0x5625954a8c10 2024-05-09T01:12:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.009+0000 7f2b2ffff700 1 -- 172.21.15.37:0/796838028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f2b44003a20 con 0x5625954a8c10 2024-05-09T01:12:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.009+0000 7f2b656d2b80 10 client.17019 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.009+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56259552c3b0 con 0x5625954a8c10 2024-05-09T01:12:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.009+0000 7f2b2ffff700 1 -- 172.21.15.37:0/796838028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b44003bc0 con 0x5625954a8c10 2024-05-09T01:12:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b2ffff700 1 -- 172.21.15.37:0/796838028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f2b4402a0e0 con 0x5625954a8c10 2024-05-09T01:12:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b656d2b80 10 client.17019 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b656d2b80 10 client.17019 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:12:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b656d2b80 20 client.17019 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x56259552e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b656d2b80 4 client.17019 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:12:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2b44005520 con 0x5625954c25c0 2024-05-09T01:12:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b54a58700 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x56259552e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b2ffff700 10 client.17019 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:12:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.010+0000 7f2b54a58700 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x56259552e770 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6bf5bfa6761d509d server_cookie=6593a5eaea96e75e in_seq=0 out_seq=0 2024-05-09T01:12:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b2ffff700 1 -- 172.21.15.37:0/796838028 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2b44005520 con 0x5625954c25c0 2024-05-09T01:12:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b2ffff700 10 client.17019 handle_command_reply: tid=0 2024-05-09T01:12:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 client.17019 shutdown 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625954a8c10 msgr2=0x5625954c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625954a8c10 0x5625954c9170 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2b44001eb0 tx=0x7f2b44014040 comp rx=0 tx=0).stop 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 shutdown_connections 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5625954c25c0 0x56259552e770 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5625954a8c10 0x5625954c9170 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625953234a0 0x5625954ba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 --2- 172.21.15.37:0/796838028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56259539dd00 0x5625954baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 >> 172.21.15.37:0/796838028 conn(0x562595326f70 msgr2=0x5625954ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b2ffff700 0 client.17019 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:12:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 shutdown_connections 2024-05-09T01:12:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 1 -- 172.21.15.37:0/796838028 wait complete. 2024-05-09T01:12:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.011+0000 7f2b656d2b80 20 client.17019 trim_cache size 0 max 16384 2024-05-09T01:12:13.016 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:12:13.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2b380b2a50 msgr2=0x7f2b380b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:13.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2b380b2a50 0x7f2b380b4f60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2b4801d760 tx=0x7f2b48015040 comp rx=0 tx=0).stop 2024-05-09T01:12:13.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50108740 msgr2=0x7f2b50198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50108740 0x7f2b50198af0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800ee10 tx=0x7f2b4800c650 comp rx=0 tx=0).stop 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 shutdown_connections 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2b380b2a50 0x7f2b380b4f60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50108740 0x7f2b50198af0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b501034c0 0x7f2b5019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 --2- 172.21.15.37:0/368347777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b50107df0 0x7f2b5019ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 >> 172.21.15.37:0/368347777 conn(0x7f2b500fedc0 msgr2=0x7f2b501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 shutdown_connections 2024-05-09T01:12:13.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:13.012+0000 7f2b56cbc700 1 -- 172.21.15.37:0/368347777 wait complete. 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 -- 172.21.15.37:0/3987509295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb4105e90 msgr2=0x7f3cb4106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 --2- 172.21.15.37:0/3987509295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb4105e90 0x7f3cb4106b90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009900 tx=0x7f3cb002a410 comp rx=0 tx=0).stop 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 -- 172.21.15.37:0/3987509295 shutdown_connections 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 --2- 172.21.15.37:0/3987509295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cb410bdd0 0x7f3cb410e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 --2- 172.21.15.37:0/3987509295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cb41070d0 0x7f3cb41074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 --2- 172.21.15.37:0/3987509295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb4105e90 0x7f3cb4106b90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 -- 172.21.15.37:0/3987509295 >> 172.21.15.37:0/3987509295 conn(0x7f3cb4101060 msgr2=0x7f3cb4103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 -- 172.21.15.37:0/3987509295 shutdown_connections 2024-05-09T01:12:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.070+0000 7f3cbb896640 1 -- 172.21.15.37:0/3987509295 wait complete. 2024-05-09T01:12:14.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.071+0000 7f3cbb896640 1 Processor -- start 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.071+0000 7f3cbb896640 1 -- start start 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cbb896640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cb4105e90 0x7f3cb419c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cbb896640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb41070d0 0x7f3cb419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cbb896640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cb410bdd0 0x7f3cb41a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cbb896640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41119c0 con 0x7f3cb41070d0 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cbb896640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4111840 con 0x7f3cb4105e90 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cbb896640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4111b40 con 0x7f3cb410bdd0 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cb9632640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cb4105e90 0x7f3cb419c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cb8e31640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb41070d0 0x7f3cb419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cb8e31640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb41070d0 0x7f3cb419caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52326/0 (socket says 172.21.15.37:52326) 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cb9632640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cb4105e90 0x7f3cb419c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50778/0 (socket says 172.21.15.37:50778) 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cb8e31640 1 -- 172.21.15.37:0/2298951831 learned_addr learned my addr 172.21.15.37:0/2298951831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:14.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.072+0000 7f3cb9e33640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cb410bdd0 0x7f3cb41a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.073+0000 7f3cb9e33640 1 -- 172.21.15.37:0/2298951831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cb4105e90 msgr2=0x7f3cb419c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.073+0000 7f3cb9e33640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cb4105e90 0x7f3cb419c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.073+0000 7f3cb9e33640 1 -- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb41070d0 msgr2=0x7f3cb419caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.073+0000 7f3cb9e33640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb41070d0 0x7f3cb419caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.073+0000 7f3cb9e33640 1 -- 172.21.15.37:0/2298951831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb41a40a0 con 0x7f3cb410bdd0 2024-05-09T01:12:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.073+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb41070d0 0x7f3cb419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.075+0000 7f3cb9e33640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cb410bdd0 0x7f3cb41a3a30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009fd0 tx=0x7f3cac00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.075+0000 7f3caa7fc640 1 -- 172.21.15.37:0/2298951831 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00ce20 con 0x7f3cb410bdd0 2024-05-09T01:12:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.075+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb41a4390 con 0x7f3cb410bdd0 2024-05-09T01:12:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.075+0000 7f3caa7fc640 1 -- 172.21.15.37:0/2298951831 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cac005020 con 0x7f3cb410bdd0 2024-05-09T01:12:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.075+0000 7f3caa7fc640 1 -- 172.21.15.37:0/2298951831 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac010690 con 0x7f3cb410bdd0 2024-05-09T01:12:14.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.075+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb41a48e0 con 0x7f3cb410bdd0 2024-05-09T01:12:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.078+0000 7f3cc2828740 1 Processor -- start 2024-05-09T01:12:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3caa7fc640 1 -- 172.21.15.37:0/2298951831 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3cac010830 con 0x7f3cb410bdd0 2024-05-09T01:12:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cc2828740 1 -- start start 2024-05-09T01:12:14.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f3a1c1b0 0x5581f3dc0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f39fb4d0 0x5581f3dc7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cc2828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581f3d247c0 con 0x5581f39fb4d0 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cc2828740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5581f3cc00e0 con 0x5581f3a1c1b0 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cc2828740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5581f3d20780 con 0x5581f39f32f0 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cb8e31640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f3a1c1b0 0x5581f3dc0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.079+0000 7f3cb8e31640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f3a1c1b0 0x5581f3dc0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50790/0 (socket says 172.21.15.37:50790) 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 -- 172.21.15.37:0/3080110889 learned_addr learned my addr 172.21.15.37:0/3080110889 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f39fb4d0 0x5581f3dc7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb9632640 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 -- 172.21.15.37:0/3080110889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 msgr2=0x5581f3dc0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 -- 172.21.15.37:0/3080110889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f39fb4d0 msgr2=0x5581f3dc7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f39fb4d0 0x5581f3dc7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 -- 172.21.15.37:0/3080110889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f3ce97c0 con 0x5581f3a1c1b0 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb9632640 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3caa7fc640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ca00b27e0 0x7f3ca00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f3a1c1b0 0x5581f3dc0500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4011cc0 tx=0x7f3ca4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd4ed933d1f3d887 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.080+0000 7f3caa7fc640 1 -- 172.21.15.37:0/2298951831 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3cac0e28f0 con 0x7f3cb410bdd0 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.081+0000 7f3cb9632640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ca00b27e0 0x7f3ca00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.081+0000 7f3c9f7fe640 1 -- 172.21.15.37:0/3080110889 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400fc50 con 0x5581f3a1c1b0 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.081+0000 7f3c9f7fe640 1 -- 172.21.15.37:0/3080110889 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca400fdf0 con 0x5581f3a1c1b0 2024-05-09T01:12:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.081+0000 7f3c9f7fe640 1 -- 172.21.15.37:0/3080110889 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400e640 con 0x5581f3a1c1b0 2024-05-09T01:12:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 -- 172.21.15.37:0/3080110889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f3a1c1b0 msgr2=0x5581f3dc0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f3a1c1b0 0x5581f3dc0500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4011cc0 tx=0x7f3ca4009c60 comp rx=0 tx=0).stop 2024-05-09T01:12:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cb9632640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ca00b27e0 0x7f3ca00b4cf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3cb002aa00 tx=0x7f3cb00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:14.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 -- 172.21.15.37:0/3080110889 shutdown_connections 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f39fb4d0 0x5581f3dc7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 --2- 172.21.15.37:0/3080110889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f3a1c1b0 0x5581f3dc0500 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 -- 172.21.15.37:0/3080110889 >> 172.21.15.37:0/3080110889 conn(0x5581f3a10300 msgr2=0x5581f3dbbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 -- 172.21.15.37:0/3080110889 shutdown_connections 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 -- 172.21.15.37:0/3080110889 wait complete. 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.083+0000 7f3cc2828740 1 -- start start 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 1 Processor -- start 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5581f3dc83d0 con 0x5581f3a1c1b0 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5581f3cab9c0 con 0x5581f39fb4d0 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5581f3dc8550 con 0x5581f39f32f0 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cc2828740 10 client.0 _ll_register_callbacks cb 0x5581f3cd8020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cb8e31640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cb9e33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cb8e31640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50802/0 (socket says 172.21.15.37:50802) 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cb8e31640 1 -- 172.21.15.37:0/1410583092 learned_addr learned my addr 172.21.15.37:0/1410583092 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.084+0000 7f3cb9632640 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3cb8e31640 1 -- 172.21.15.37:0/1410583092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 msgr2=0x5581f3dca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3cb8e31640 1 -- 172.21.15.37:0/1410583092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 msgr2=0x5581f3dd17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3cb8e31640 1 -- 172.21.15.37:0/1410583092 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581f3cd21f0 con 0x5581f39fb4d0 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dca860 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009c30 tx=0x7f3ca4005440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=661881d58d87792f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3c9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1410583092 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4004ad0 con 0x5581f39fb4d0 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1410583092 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3ca4004c70 con 0x5581f39fb4d0 2024-05-09T01:12:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca400fdf0 con 0x5581f39fb4d0 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.085+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1410583092 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3ca400fc20 con 0x5581f39fb4d0 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 10 client.26870 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5581f3a87790 con 0x5581f39fb4d0 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1410583092 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca400fdf0 con 0x5581f39fb4d0 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1410583092 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f3ca4026070 con 0x5581f39fb4d0 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 10 client.26870 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 10 client.26870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 20 client.26870 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39dad80 0x5581f3dd79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 4 client.26870 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581f3d323d0 con 0x5581f39dad80 2024-05-09T01:12:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.086+0000 7f3cb9632640 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39dad80 0x5581f3dd79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.087+0000 7f3c9cff9640 10 client.26870 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.087+0000 7f3cb9632640 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39dad80 0x5581f3dd79f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c2e77728cc3613 server_cookie=e7949acf7c30ae29 in_seq=0 out_seq=0 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1410583092 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5581f3d323d0 con 0x5581f39dad80 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3c9cff9640 10 client.26870 handle_command_reply: tid=0 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 client.26870 shutdown 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 msgr2=0x5581f3dca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dca860 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009c30 tx=0x7f3ca4005440 comp rx=0 tx=0).stop 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 shutdown_connections 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39dad80 0x5581f3dd79f0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dca860 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1410583092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 >> 172.21.15.37:0/1410583092 conn(0x5581f3a10300 msgr2=0x5581f3dba700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.088+0000 7f3c9cff9640 0 client.26870 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.089+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 shutdown_connections 2024-05-09T01:12:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.089+0000 7f3cc2828740 1 -- 172.21.15.37:0/1410583092 wait complete. 2024-05-09T01:12:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.089+0000 7f3cc2828740 20 client.26870 trim_cache size 0 max 16384 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 Processor -- start 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 -- start start 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dc8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ad3d0 con 0x5581f3a1c1b0 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41aef10 con 0x5581f39fb4d0 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.113+0000 7f3cc2828740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41adaa0 con 0x5581f39f32f0 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48280/0 (socket says 172.21.15.37:48280) 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 -- 172.21.15.37:0/2533803643 learned_addr learned my addr 172.21.15.37:0/2533803643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dc8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9e33640 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 -- 172.21.15.37:0/2533803643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 msgr2=0x5581f3dc8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dc8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 -- 172.21.15.37:0/2533803643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 msgr2=0x5581f3dd16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 -- 172.21.15.37:0/2533803643 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581f3afe5f0 con 0x5581f39f32f0 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9e33640 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.114+0000 7f3cb9632640 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc88f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb0040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c725ce31e975109 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.115+0000 7f3c9effd640 1 -- 172.21.15.37:0/2533803643 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb005a070 con 0x5581f39f32f0 2024-05-09T01:12:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.115+0000 7f3c9effd640 1 -- 172.21.15.37:0/2533803643 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cb00315a0 con 0x5581f39f32f0 2024-05-09T01:12:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.115+0000 7f3c9effd640 1 -- 172.21.15.37:0/2533803643 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0035040 con 0x5581f39f32f0 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 -- 172.21.15.37:0/2533803643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 msgr2=0x5581f3dc88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc88f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb0040000 comp rx=0 tx=0).stop 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 -- 172.21.15.37:0/2533803643 shutdown_connections 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dd16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dc8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 --2- 172.21.15.37:0/2533803643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dc88f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 -- 172.21.15.37:0/2533803643 >> 172.21.15.37:0/2533803643 conn(0x5581f3a10300 msgr2=0x5581f3dc47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 -- 172.21.15.37:0/2533803643 shutdown_connections 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 -- 172.21.15.37:0/2533803643 wait complete. 2024-05-09T01:12:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.116+0000 7f3cc2828740 1 -- start start 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 1 Processor -- start 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dd1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dcecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ae840 con 0x5581f3a1c1b0 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ae170 con 0x5581f39fb4d0 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ab3b0 con 0x5581f39f32f0 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cc2828740 10 client.0 _ll_register_callbacks cb 0x7f3ca4011780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cb9632640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dd1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cb9632640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dd1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48294/0 (socket says 172.21.15.37:48294) 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cb9632640 1 -- 172.21.15.37:0/1629353170 learned_addr learned my addr 172.21.15.37:0/1629353170 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.117+0000 7f3cb9e33640 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dcecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cb9632640 1 -- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 msgr2=0x5581f3dce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cb9632640 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cb9632640 1 -- 172.21.15.37:0/1629353170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 msgr2=0x5581f3dcecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cb9632640 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dcecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cb9632640 1 -- 172.21.15.37:0/1629353170 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581f3ce8ed0 con 0x5581f39f32f0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cb9632640 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dd1b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0054040 tx=0x7f3cb00095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e80fbacf214009a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3c9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1629353170 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0035050 con 0x5581f39f32f0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1629353170 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3cb0003930 con 0x5581f39f32f0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb00315a0 con 0x5581f39f32f0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1629353170 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3cb005a070 con 0x5581f39f32f0 2024-05-09T01:12:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cc2828740 10 client.26839 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:14.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.118+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5581f3e3ea80 con 0x5581f39f32f0 2024-05-09T01:12:14.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1629353170 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cb005f460 con 0x5581f39f32f0 2024-05-09T01:12:14.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1629353170 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f3cb0044070 con 0x5581f39f32f0 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3cc2828740 10 client.26839 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3cc2828740 10 client.26839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3cc2828740 20 client.26839 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39b01c0 0x5581f3e41450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3cc2828740 4 client.26839 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.119+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f3cb00315a0 con 0x5581f39b01c0 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.120+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39b01c0 0x5581f3e41450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.121+0000 7f3cb8e31640 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39b01c0 0x5581f3e41450 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da312f9e3dbc718 server_cookie=223d1ddaabf21714 in_seq=0 out_seq=0 2024-05-09T01:12:14.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.121+0000 7f3c9cff9640 10 client.26839 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.132+0000 7f3c9cff9640 1 -- 172.21.15.37:0/1629353170 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f3cb00315a0 con 0x5581f39b01c0 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3c9cff9640 10 client.26839 handle_command_reply: tid=0 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 client.26839 shutdown 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 msgr2=0x5581f3dd1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dd1b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0054040 tx=0x7f3cb00095f0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 shutdown_connections 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5581f39b01c0 0x5581f3e41450 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5581f3a1c1b0 0x5581f3dcecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5581f39fb4d0 0x5581f3dce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 --2- 172.21.15.37:0/1629353170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581f39f32f0 0x5581f3dd1b80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 >> 172.21.15.37:0/1629353170 conn(0x5581f3a10300 msgr2=0x5581f3dc88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3c9cff9640 0 client.26839 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 shutdown_connections 2024-05-09T01:12:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 1 -- 172.21.15.37:0/1629353170 wait complete. 2024-05-09T01:12:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.133+0000 7f3cc2828740 20 client.26839 trim_cache size 0 max 16384 2024-05-09T01:12:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:12:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:12:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:12:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ca00b27e0 msgr2=0x7f3ca00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ca00b27e0 0x7f3ca00b4cf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3cb002aa00 tx=0x7f3cb00314a0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cb410bdd0 msgr2=0x7f3cb41a3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cb410bdd0 0x7f3cb41a3a30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009fd0 tx=0x7f3cac00ef10 comp rx=0 tx=0).stop 2024-05-09T01:12:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 shutdown_connections 2024-05-09T01:12:14.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cb410bdd0 0x7f3cb41a3a30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb41070d0 0x7f3cb419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3ca00b27e0 0x7f3ca00b4cf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 --2- 172.21.15.37:0/2298951831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cb4105e90 0x7f3cb419c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 >> 172.21.15.37:0/2298951831 conn(0x7f3cb4101060 msgr2=0x7f3cb4107db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 shutdown_connections 2024-05-09T01:12:14.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:14.134+0000 7f3cbb896640 1 -- 172.21.15.37:0/2298951831 wait complete. 2024-05-09T01:12:14.472 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:14.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:14 smithi037 ceph-mon[30122]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.9 MiB/s wr, 566 op/s 2024-05-09T01:12:14.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:14 smithi136 ceph-mon[34110]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.9 MiB/s wr, 566 op/s 2024-05-09T01:12:14.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:14 smithi151 ceph-mon[34780]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.9 MiB/s wr, 566 op/s 2024-05-09T01:12:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 595.0 s, 1938.0 tps, lat 51.977 ms stddev 66.140 2024-05-09T01:12:16.455 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:16 smithi037 ceph-mon[30122]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.9 MiB/s wr, 626 op/s 2024-05-09T01:12:16.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:16 smithi136 ceph-mon[34110]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.9 MiB/s wr, 626 op/s 2024-05-09T01:12:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.630+0000 7fd08b0c8700 1 -- 172.21.15.37:0/3530950492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0841034c0 msgr2=0x7fd0841038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.630+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/3530950492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0841034c0 0x7fd0841038d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd0780099c0 tx=0x7fd078009cd0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.631+0000 7fd08b0c8700 1 -- 172.21.15.37:0/3530950492 shutdown_connections 2024-05-09T01:12:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.631+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/3530950492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd084108740 0x7fd0841100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.631+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/3530950492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0841034c0 0x7fd0841038d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.631+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/3530950492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd084107df0 0x7fd084108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.631+0000 7fd08b0c8700 1 -- 172.21.15.37:0/3530950492 >> 172.21.15.37:0/3530950492 conn(0x7fd0840fedc0 msgr2=0x7fd0841011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.631+0000 7fd08b0c8700 1 -- 172.21.15.37:0/3530950492 shutdown_connections 2024-05-09T01:12:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.632+0000 7fd08b0c8700 1 -- 172.21.15.37:0/3530950492 wait complete. 2024-05-09T01:12:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.633+0000 7fd08b0c8700 1 Processor -- start 2024-05-09T01:12:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.633+0000 7fd08b0c8700 1 -- start start 2024-05-09T01:12:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.634+0000 7fd08b0c8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0841034c0 0x7fd08419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.634+0000 7fd08b0c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd084107df0 0x7fd08419d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.634+0000 7fd088e64700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0841034c0 0x7fd08419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.635+0000 7fd088e64700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0841034c0 0x7fd08419cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48322/0 (socket says 172.21.15.37:48322) 2024-05-09T01:12:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.635+0000 7fd088e64700 1 -- 172.21.15.37:0/1826891298 learned_addr learned my addr 172.21.15.37:0/1826891298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.635+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd084108740 0x7fd0841a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.635+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841122d0 con 0x7fd084107df0 2024-05-09T01:12:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.635+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd084112150 con 0x7fd084108740 2024-05-09T01:12:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.635+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd084112450 con 0x7fd0841034c0 2024-05-09T01:12:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd089665700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd084108740 0x7fd0841a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd083fff700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd084107df0 0x7fd08419d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd089665700 1 -- 172.21.15.37:0/1826891298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0841034c0 msgr2=0x7fd08419cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd089665700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0841034c0 0x7fd08419cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd089665700 1 -- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd084107df0 msgr2=0x7fd08419d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd089665700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd084107df0 0x7fd08419d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd089665700 1 -- 172.21.15.37:0/1826891298 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0841a1e80 con 0x7fd084108740 2024-05-09T01:12:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.636+0000 7fd089665700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd084108740 0x7fd0841a17e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00efc0 tx=0x7fd07c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.637+0000 7fd081ffb700 1 -- 172.21.15.37:0/1826891298 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0092e0 con 0x7fd084108740 2024-05-09T01:12:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.637+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0841a2110 con 0x7fd084108740 2024-05-09T01:12:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.637+0000 7fd081ffb700 1 -- 172.21.15.37:0/1826891298 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd07c004bb0 con 0x7fd084108740 2024-05-09T01:12:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.637+0000 7fd081ffb700 1 -- 172.21.15.37:0/1826891298 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c004020 con 0x7fd084108740 2024-05-09T01:12:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.637+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0841a9a90 con 0x7fd084108740 2024-05-09T01:12:16.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.643+0000 7fd099adeb80 1 Processor -- start 2024-05-09T01:12:16.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.643+0000 7fd081ffb700 1 -- 172.21.15.37:0/1826891298 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd07c01b030 con 0x7fd084108740 2024-05-09T01:12:16.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.643+0000 7fd099adeb80 1 -- start start 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcae780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdca8400 0x5631cdca8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd099adeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5631cdbcb0a0 con 0x5631cdca8400 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd083fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd083fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:50868/0 (socket says 172.21.15.37:50868) 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd083fff700 1 -- 172.21.15.37:0/2838183810 learned_addr learned my addr 172.21.15.37:0/2838183810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd099adeb80 1 -- 172.21.15.37:0/2838183810 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5631cdb709a0 con 0x5631cdba5d00 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd081ffb700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b28e0 0x7fd0740b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.644+0000 7fd099adeb80 1 -- 172.21.15.37:0/2838183810 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5631cdbc7060 con 0x5631cdb2b4a0 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd088e64700 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd081ffb700 1 -- 172.21.15.37:0/1826891298 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd07c0e1b80 con 0x7fd084108740 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd083fff700 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdca8400 0x5631cdca8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd083fff700 1 -- 172.21.15.37:0/2838183810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 msgr2=0x5631cdcae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd083fff700 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcae780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd083fff700 1 -- 172.21.15.37:0/2838183810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdca8400 msgr2=0x5631cdca8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd083fff700 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdca8400 0x5631cdca8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd083fff700 1 -- 172.21.15.37:0/2838183810 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631cdb61500 con 0x5631cdba5d00 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.645+0000 7fd089665700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b28e0 0x7fd0740b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.646+0000 7fd083fff700 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcae240 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd070011860 tx=0x7fd0700098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7354a47526a1275d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.646+0000 7fd06effd700 1 -- 172.21.15.37:0/2838183810 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070004030 con 0x5631cdba5d00 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.647+0000 7fd06effd700 1 -- 172.21.15.37:0/2838183810 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd070003680 con 0x5631cdba5d00 2024-05-09T01:12:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.647+0000 7fd06effd700 1 -- 172.21.15.37:0/2838183810 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07000e610 con 0x5631cdba5d00 2024-05-09T01:12:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.648+0000 7fd099adeb80 1 -- 172.21.15.37:0/2838183810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 msgr2=0x5631cdcae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.648+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcae240 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd070011860 tx=0x7fd0700098e0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.648+0000 7fd099adeb80 1 -- 172.21.15.37:0/2838183810 shutdown_connections 2024-05-09T01:12:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.648+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdca8400 0x5631cdca8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.648+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcae240 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.648+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2838183810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.649+0000 7fd099adeb80 1 -- 172.21.15.37:0/2838183810 >> 172.21.15.37:0/2838183810 conn(0x5631cdb2ef70 msgr2=0x5631cdca3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.649+0000 7fd089665700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b28e0 0x7fd0740b4df0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00ef90 tx=0x7fd07c00c940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.649+0000 7fd099adeb80 1 -- 172.21.15.37:0/2838183810 shutdown_connections 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.649+0000 7fd099adeb80 1 -- 172.21.15.37:0/2838183810 wait complete. 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.650+0000 7fd099adeb80 1 -- start start 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.650+0000 7fd099adeb80 1 Processor -- start 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.650+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.650+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdba5d00 0x5631cdcb25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdca8400 0x5631cdcb2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd099adeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5631cdca9100 con 0x5631cdba5d00 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48332/0 (socket says 172.21.15.37:48332) 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 -- 172.21.15.37:0/3586609162 learned_addr learned my addr 172.21.15.37:0/3586609162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5631cdb65b20 con 0x5631cdca8400 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd088e64700 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdba5d00 0x5631cdcb25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5631cdcbe200 con 0x5631cdb2b4a0 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd099adeb80 10 client.0 _ll_register_callbacks cb 0x5631cda3c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdca8400 0x5631cdcb2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 -- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdca8400 msgr2=0x5631cdcb2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdca8400 0x5631cdcb2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 -- 172.21.15.37:0/3586609162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdba5d00 msgr2=0x5631cdcb25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdba5d00 0x5631cdcb25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 -- 172.21.15.37:0/3586609162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631cda46490 con 0x5631cdb2b4a0 2024-05-09T01:12:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd083fff700 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb20b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd070009a40 tx=0x7fd070009950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69e85df0853eede6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.651+0000 7fd063fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd063fff700 1 -- 172.21.15.37:0/3586609162 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0700040e0 con 0x5631cdb2b4a0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd063fff700 1 -- 172.21.15.37:0/3586609162 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd070004280 con 0x5631cdb2b4a0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd070003680 con 0x5631cdb2b4a0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd063fff700 1 -- 172.21.15.37:0/3586609162 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fd070004480 con 0x5631cdb2b4a0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd099adeb80 10 client.26851 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5631cdcbfb60 con 0x5631cdb2b4a0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd063fff700 1 -- 172.21.15.37:0/3586609162 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd070003680 con 0x5631cdb2b4a0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd063fff700 1 -- 172.21.15.37:0/3586609162 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fd0700051b0 con 0x5631cdb2b4a0 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd099adeb80 10 client.26851 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd099adeb80 10 client.26851 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd099adeb80 20 client.26851 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.652+0000 7fd099adeb80 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdcc2140 0x5631cdcc4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.653+0000 7fd099adeb80 4 client.26851 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.653+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631cdbd8a80 con 0x5631cdcc2140 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.653+0000 7fd088e64700 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdcc2140 0x5631cdcc4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.653+0000 7fd063fff700 10 client.26851 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.653+0000 7fd088e64700 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdcc2140 0x5631cdcc4560 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c69855435bc2d51 server_cookie=a8c1a057dd081bbb in_seq=0 out_seq=0 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.654+0000 7fd063fff700 1 -- 172.21.15.37:0/3586609162 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5631cdbd8a80 con 0x5631cdcc2140 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.654+0000 7fd063fff700 10 client.26851 handle_command_reply: tid=0 2024-05-09T01:12:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.654+0000 7fd099adeb80 1 client.26851 shutdown 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.654+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 msgr2=0x5631cdcb20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.654+0000 7fd099adeb80 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb20b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd070009a40 tx=0x7fd070009950 comp rx=0 tx=0).stop 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 shutdown_connections 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdcc2140 0x5631cdcc4560 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd063fff700 0 client.26851 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdca8400 0x5631cdcb2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb20b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 --2- 172.21.15.37:0/3586609162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdba5d00 0x5631cdcb25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 >> 172.21.15.37:0/3586609162 conn(0x5631cdb2ef70 msgr2=0x5631cdc9cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 shutdown_connections 2024-05-09T01:12:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 1 -- 172.21.15.37:0/3586609162 wait complete. 2024-05-09T01:12:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.656+0000 7fd099adeb80 20 client.26851 trim_cache size 0 max 16384 2024-05-09T01:12:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.674+0000 7fd099adeb80 1 Processor -- start 2024-05-09T01:12:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.674+0000 7fd099adeb80 1 -- start start 2024-05-09T01:12:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdc9d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcb25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd099adeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841b0d30 con 0x5631cdb2b4a0 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd099adeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841b2870 con 0x5631cdba5d00 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd099adeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841b1400 con 0x5631cdb2ef70 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd083fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdc9d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52404/0 (socket says 172.21.15.37:52404) 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 -- 172.21.15.37:0/801879541 learned_addr learned my addr 172.21.15.37:0/801879541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd083fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdc9d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48340/0 (socket says 172.21.15.37:48340) 2024-05-09T01:12:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd083fff700 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcb25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 -- 172.21.15.37:0/801879541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 msgr2=0x5631cdc9d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdc9d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 -- 172.21.15.37:0/801879541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 msgr2=0x5631cdcb25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcb25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.675+0000 7fd088e64700 1 -- 172.21.15.37:0/801879541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631cdca8f50 con 0x5631cdb2b4a0 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.676+0000 7fd083fff700 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdc9d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.676+0000 7fd088e64700 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb2070 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd07800b580 tx=0x7fd078005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383edca3ed147066 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.677+0000 7fd06e7fc700 1 -- 172.21.15.37:0/801879541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07802e070 con 0x5631cdb2b4a0 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.677+0000 7fd06e7fc700 1 -- 172.21.15.37:0/801879541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd078005690 con 0x5631cdb2b4a0 2024-05-09T01:12:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.677+0000 7fd06e7fc700 1 -- 172.21.15.37:0/801879541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07800bdc0 con 0x5631cdb2b4a0 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 -- 172.21.15.37:0/801879541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 msgr2=0x5631cdcb2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb2070 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd07800b580 tx=0x7fd078005040 comp rx=0 tx=0).stop 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 -- 172.21.15.37:0/801879541 shutdown_connections 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcb25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdc9d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 --2- 172.21.15.37:0/801879541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcb2070 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 -- 172.21.15.37:0/801879541 >> 172.21.15.37:0/801879541 conn(0x5631cdcbe5c0 msgr2=0x5631cdc9cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 -- 172.21.15.37:0/801879541 shutdown_connections 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.678+0000 7fd099adeb80 1 -- 172.21.15.37:0/801879541 wait complete. 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.679+0000 7fd099adeb80 1 -- start start 2024-05-09T01:12:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.679+0000 7fd099adeb80 1 Processor -- start 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.679+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdcba670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd099adeb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcaede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd099adeb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841b21a0 con 0x5631cdb2b4a0 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd099adeb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841b1ad0 con 0x5631cdba5d00 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd099adeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd0841aed10 con 0x5631cdb2ef70 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd083fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd099adeb80 10 client.0 _ll_register_callbacks cb 0x5631cdca8dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd083fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcba130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52410/0 (socket says 172.21.15.37:52410) 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd083fff700 1 -- 172.21.15.37:0/2431106326 learned_addr learned my addr 172.21.15.37:0/2431106326 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd088e64700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdcba670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd083fff700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcaede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd088e64700 1 -- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 msgr2=0x5631cdcaede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd088e64700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcaede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd088e64700 1 -- 172.21.15.37:0/2431106326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 msgr2=0x5631cdcba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd088e64700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcba130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd088e64700 1 -- 172.21.15.37:0/2431106326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631cdcaf320 con 0x5631cdb2ef70 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd083fff700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcaede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd088e64700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdcba670 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd078003760 tx=0x7fd0780051d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e899ce2ff1ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd063fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.680+0000 7fd063fff700 1 -- 172.21.15.37:0/2431106326 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07802e040 con 0x5631cdb2ef70 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.681+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd078005690 con 0x5631cdb2ef70 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.681+0000 7fd063fff700 1 -- 172.21.15.37:0/2431106326 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd07800bc40 con 0x5631cdb2ef70 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.681+0000 7fd063fff700 1 -- 172.21.15.37:0/2431106326 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fd07800be80 con 0x5631cdb2ef70 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.681+0000 7fd099adeb80 10 client.26857 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.681+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5631cdd2bcd0 con 0x5631cdb2ef70 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.681+0000 7fd063fff700 1 -- 172.21.15.37:0/2431106326 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd078005690 con 0x5631cdb2ef70 2024-05-09T01:12:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.681+0000 7fd063fff700 1 -- 172.21.15.37:0/2431106326 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fd07803a030 con 0x5631cdb2ef70 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.682+0000 7fd099adeb80 10 client.26857 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.682+0000 7fd099adeb80 10 client.26857 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.682+0000 7fd099adeb80 20 client.26857 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.682+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdca8400 0x5631cdd2e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.682+0000 7fd099adeb80 4 client.26857 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.682+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631cdbd2b20 con 0x5631cdca8400 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.683+0000 7fd083fff700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdca8400 0x5631cdd2e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:16.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.683+0000 7fd083fff700 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdca8400 0x5631cdd2e2d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=183fb6709cc6a88b server_cookie=85261ef2fedd9f5d in_seq=0 out_seq=0 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.683+0000 7fd063fff700 10 client.26857 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd063fff700 1 -- 172.21.15.37:0/2431106326 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631cdbd2b20 con 0x5631cdca8400 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd063fff700 10 client.26857 handle_command_reply: tid=0 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 client.26857 shutdown 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 msgr2=0x5631cdcba670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdcba670 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd078003760 tx=0x7fd0780051d0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 shutdown_connections 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x5631cdca8400 0x5631cdd2e2d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd063fff700 0 client.26857 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5631cdba5d00 0x5631cdcaede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631cdb2b4a0 0x5631cdcba130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 --2- 172.21.15.37:0/2431106326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5631cdb2ef70 0x5631cdcba670 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.684+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 >> 172.21.15.37:0/2431106326 conn(0x5631cdcbe5c0 msgr2=0x5631cdcb0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.685+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 shutdown_connections 2024-05-09T01:12:16.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.685+0000 7fd099adeb80 1 -- 172.21.15.37:0/2431106326 wait complete. 2024-05-09T01:12:16.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.685+0000 7fd099adeb80 20 client.26857 trim_cache size 0 max 16384 2024-05-09T01:12:16.690 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:12:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.685+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b28e0 msgr2=0x7fd0740b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.685+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b28e0 0x7fd0740b4df0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00ef90 tx=0x7fd07c00c940 comp rx=0 tx=0).stop 2024-05-09T01:12:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.685+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd084108740 msgr2=0x7fd0841a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.685+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd084108740 0x7fd0841a17e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd07c00efc0 tx=0x7fd07c00c3a0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 shutdown_connections 2024-05-09T01:12:16.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd0740b28e0 0x7fd0740b4df0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd084108740 0x7fd0841a17e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0841034c0 0x7fd08419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 --2- 172.21.15.37:0/1826891298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd084107df0 0x7fd08419d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 >> 172.21.15.37:0/1826891298 conn(0x7fd0840fedc0 msgr2=0x7fd084101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 shutdown_connections 2024-05-09T01:12:16.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:16.686+0000 7fd08b0c8700 1 -- 172.21.15.37:0/1826891298 wait complete. 2024-05-09T01:12:16.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:16 smithi151 ceph-mon[34780]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.9 MiB/s wr, 626 op/s 2024-05-09T01:12:17.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:12:17.926 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:18.308 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:18 smithi037 ceph-mon[30122]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 662 op/s 2024-05-09T01:12:18.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:18 smithi136 ceph-mon[34110]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 662 op/s 2024-05-09T01:12:18.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:18 smithi151 ceph-mon[34780]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 662 op/s 2024-05-09T01:12:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.679+0000 7f97aa489700 1 -- 172.21.15.37:0/1222319203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 msgr2=0x7f97a4108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.679+0000 7f97aa489700 1 --2- 172.21.15.37:0/1222319203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a4108250 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f978c0099c0 tx=0x7f978c009cd0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.679+0000 7f97aa489700 1 -- 172.21.15.37:0/1222319203 shutdown_connections 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.679+0000 7f97aa489700 1 --2- 172.21.15.37:0/1222319203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a4108790 0x7f97a41100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.679+0000 7f97aa489700 1 --2- 172.21.15.37:0/1222319203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 0x7f97a4104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.679+0000 7f97aa489700 1 --2- 172.21.15.37:0/1222319203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a4108250 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.679+0000 7f97aa489700 1 -- 172.21.15.37:0/1222319203 >> 172.21.15.37:0/1222319203 conn(0x7f97a40fe6f0 msgr2=0x7f97a4100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.680+0000 7f97aa489700 1 -- 172.21.15.37:0/1222319203 shutdown_connections 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.680+0000 7f97aa489700 1 -- 172.21.15.37:0/1222319203 wait complete. 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.681+0000 7f97aa489700 1 Processor -- start 2024-05-09T01:12:19.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.681+0000 7f97aa489700 1 -- start start 2024-05-09T01:12:19.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97aa489700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 0x7f97a419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97aa489700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a419b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97aa489700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a4108790 0x7f97a419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f979bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a419b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 0x7f97a419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 0x7f97a419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48374/0 (socket says 172.21.15.37:48374) 2024-05-09T01:12:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f979bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a419b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52436/0 (socket says 172.21.15.37:52436) 2024-05-09T01:12:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 -- 172.21.15.37:0/3547509862 learned_addr learned my addr 172.21.15.37:0/3547509862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113390 con 0x7f97a4107e40 2024-05-09T01:12:19.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113210 con 0x7f97a4108790 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4113510 con 0x7f97a4103c40 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a8a26700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a4108790 0x7f97a419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 -- 172.21.15.37:0/3547509862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a4108790 msgr2=0x7f97a419f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a4108790 0x7f97a419f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 -- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 msgr2=0x7f97a419b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a419b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f97a3fff700 1 -- 172.21.15.37:0/3547509862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a419fcd0 con 0x7f97a4103c40 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.682+0000 7f979bfff700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a419b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.683+0000 7f97a3fff700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 0x7f97a419ae10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f979400e970 tx=0x7f979400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.683+0000 7f97a1ffb700 1 -- 172.21.15.37:0/3547509862 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979400cbd0 con 0x7f97a4103c40 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.683+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a419ffc0 con 0x7f97a4103c40 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.683+0000 7f97a1ffb700 1 -- 172.21.15.37:0/3547509862 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97940044d0 con 0x7f97a4103c40 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.683+0000 7f97a1ffb700 1 -- 172.21.15.37:0/3547509862 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794003e40 con 0x7f97a4103c40 2024-05-09T01:12:19.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.683+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a41a78e0 con 0x7f97a4103c40 2024-05-09T01:12:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.689+0000 7f97b8e9fb80 1 Processor -- start 2024-05-09T01:12:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.693+0000 7f97a1ffb700 1 -- 172.21.15.37:0/3547509862 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f97940104b0 con 0x7f97a4103c40 2024-05-09T01:12:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.694+0000 7f97a1ffb700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97900b2980 0x7f97900b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.694+0000 7f97a1ffb700 1 -- 172.21.15.37:0/3547509862 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97940e29d0 con 0x7f97a4103c40 2024-05-09T01:12:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97b8e9fb80 1 -- start start 2024-05-09T01:12:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28a88160 0x55ea28b204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b20a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 0x55ea28b1bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea28a3dff0 con 0x55ea2899e4a0 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea289dc7f0 con 0x55ea28b1b6a0 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea28a39fb0 con 0x55ea28a88160 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f979bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b20a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28a88160 0x55ea28b204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28a88160 0x55ea28b204a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48378/0 (socket says 172.21.15.37:48378) 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.696+0000 7f97a3fff700 1 -- 172.21.15.37:0/422733563 learned_addr learned my addr 172.21.15.37:0/422733563 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.701+0000 7f97a8a26700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97900b2980 0x7f97900b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.701+0000 7f979bfff700 1 -- 172.21.15.37:0/422733563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28a88160 msgr2=0x55ea28b204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.701+0000 7f979bfff700 1 --2- 172.21.15.37:0/422733563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28a88160 0x55ea28b204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.701+0000 7f979bfff700 1 -- 172.21.15.37:0/422733563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 msgr2=0x55ea28b1bad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:12:19.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.701+0000 7f979bfff700 1 --2- 172.21.15.37:0/422733563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 0x55ea28b1bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.701+0000 7f979bfff700 1 -- 172.21.15.37:0/422733563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea289d4370 con 0x55ea2899e4a0 2024-05-09T01:12:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.701+0000 7f979bfff700 1 --2- 172.21.15.37:0/422733563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b20a00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b580 tx=0x7f978c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c06c15c6ee8956a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:19.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.704+0000 7f97a8a26700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97900b2980 0x7f97900b4e90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f979c009550 tx=0x7f979c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.705+0000 7f979a7fc700 1 -- 172.21.15.37:0/422733563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c026070 con 0x55ea2899e4a0 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.705+0000 7f979a7fc700 1 -- 172.21.15.37:0/422733563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f978c0037c0 con 0x55ea2899e4a0 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.705+0000 7f979a7fc700 1 -- 172.21.15.37:0/422733563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c00ba80 con 0x55ea2899e4a0 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.706+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/422733563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 msgr2=0x55ea28b20a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.706+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/422733563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b20a00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f978c00b580 tx=0x7f978c009510 comp rx=0 tx=0).stop 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.706+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/422733563 shutdown_connections 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.706+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/422733563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 0x55ea28b1bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.706+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/422733563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28a88160 0x55ea28b204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.706+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/422733563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b20a00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.706+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/422733563 >> 172.21.15.37:0/422733563 conn(0x55ea289fe6a0 msgr2=0x55ea28b16660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:19.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.709+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/422733563 shutdown_connections 2024-05-09T01:12:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.714+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/422733563 wait complete. 2024-05-09T01:12:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.714+0000 7f97b8e9fb80 1 -- start start 2024-05-09T01:12:19.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.715+0000 7f97b8e9fb80 1 Processor -- start 2024-05-09T01:12:19.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.715+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.715+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28a88160 0x55ea28b2b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.715+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 0x55ea28b25330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.715+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea288b9ba0 con 0x55ea28a88160 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.715+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea289f8150 con 0x55ea28b1b6a0 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.716+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea28b1c510 con 0x55ea2899e4a0 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.716+0000 7f97b8e9fb80 10 client.0 _ll_register_callbacks cb 0x55ea288af6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.716+0000 7f979bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28a88160 0x55ea28b2b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.716+0000 7f979bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28a88160 0x55ea28b2b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52450/0 (socket says 172.21.15.37:52450) 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.716+0000 7f979bfff700 1 -- 172.21.15.37:0/634029019 learned_addr learned my addr 172.21.15.37:0/634029019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.716+0000 7f97a3fff700 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.717+0000 7f97a3fff700 1 -- 172.21.15.37:0/634029019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 msgr2=0x55ea28b25330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.717+0000 7f97a3fff700 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 0x55ea28b25330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.717+0000 7f97a3fff700 1 -- 172.21.15.37:0/634029019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28a88160 msgr2=0x55ea28b2b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.717+0000 7f97a3fff700 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28a88160 0x55ea28b2b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.717+0000 7f97a3fff700 1 -- 172.21.15.37:0/634029019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea288b9490 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.717+0000 7f97a3fff700 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2af30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f97940aa060 tx=0x7f97940a9a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36b571bea9d9963 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.717+0000 7f97837fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.718+0000 7f97837fe700 1 -- 172.21.15.37:0/634029019 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97940c9060 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.718+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f978c0037c0 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.718+0000 7f97837fe700 1 -- 172.21.15.37:0/634029019 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97940041f0 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.718+0000 7f97837fe700 1 -- 172.21.15.37:0/634029019 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f97940a9840 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.718+0000 7f97b8e9fb80 10 client.26869 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.718+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55ea28b31db0 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97837fe700 1 -- 172.21.15.37:0/634029019 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f978c0037c0 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97837fe700 1 -- 172.21.15.37:0/634029019 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f97940a8da0 con 0x55ea2899e4a0 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97b8e9fb80 10 client.26869 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:19.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97b8e9fb80 10 client.26869 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:12:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97b8e9fb80 20 client.26869 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b34340 0x55ea28b367c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97b8e9fb80 4 client.26869 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.719+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea28a4b9d0 con 0x55ea28b34340 2024-05-09T01:12:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.720+0000 7f979bfff700 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b34340 0x55ea28b367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.721+0000 7f979bfff700 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b34340 0x55ea28b367c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c56f562b0b4a4470 server_cookie=659a1d623b9754ca in_seq=0 out_seq=0 2024-05-09T01:12:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.721+0000 7f97837fe700 10 client.26869 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:12:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.725+0000 7f97837fe700 1 -- 172.21.15.37:0/634029019 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ea28a4b9d0 con 0x55ea28b34340 2024-05-09T01:12:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.725+0000 7f97837fe700 10 client.26869 handle_command_reply: tid=0 2024-05-09T01:12:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 client.26869 shutdown 2024-05-09T01:12:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 msgr2=0x55ea28b2af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2af30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f97940aa060 tx=0x7f97940a9a20 comp rx=0 tx=0).stop 2024-05-09T01:12:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 shutdown_connections 2024-05-09T01:12:19.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b34340 0x55ea28b367c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28b1b6a0 0x55ea28b25330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2af30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/634029019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28a88160 0x55ea28b2b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 >> 172.21.15.37:0/634029019 conn(0x55ea289fe6a0 msgr2=0x55ea28b204a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97837fe700 0 client.26869 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 shutdown_connections 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/634029019 wait complete. 2024-05-09T01:12:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.726+0000 7f97b8e9fb80 20 client.26869 trim_cache size 0 max 16384 2024-05-09T01:12:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.748+0000 7f97b8e9fb80 1 Processor -- start 2024-05-09T01:12:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.748+0000 7f97b8e9fb80 1 -- start start 2024-05-09T01:12:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b16720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28b1b6a0 0x55ea28b36350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52454/0 (socket says 172.21.15.37:52454) 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97a3fff700 1 -- 172.21.15.37:0/4065741870 learned_addr learned my addr 172.21.15.37:0/4065741870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4071f80 con 0x55ea2899e4a0 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4073ac0 con 0x55ea28a88160 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4072650 con 0x55ea28b1b6a0 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.749+0000 7f97a8a26700 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28b1b6a0 0x55ea28b36350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f979bfff700 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b16720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f97a8a26700 1 -- 172.21.15.37:0/4065741870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 msgr2=0x55ea28b16720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f97a8a26700 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b16720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f97a8a26700 1 -- 172.21.15.37:0/4065741870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 msgr2=0x55ea28b161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f97a8a26700 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b161e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f97a8a26700 1 -- 172.21.15.37:0/4065741870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea28b1f800 con 0x55ea28b1b6a0 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f979bfff700 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b16720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f97a8a26700 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28b1b6a0 0x55ea28b36350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f979c007b70 tx=0x7f979c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9fd5808674a97ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f9799ffb700 1 -- 172.21.15.37:0/4065741870 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c026070 con 0x55ea28b1b6a0 2024-05-09T01:12:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f9799ffb700 1 -- 172.21.15.37:0/4065741870 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c0218b0 con 0x55ea28b1b6a0 2024-05-09T01:12:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.750+0000 7f9799ffb700 1 -- 172.21.15.37:0/4065741870 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c014750 con 0x55ea28b1b6a0 2024-05-09T01:12:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.751+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28b1b6a0 msgr2=0x55ea28b36350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.751+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28b1b6a0 0x55ea28b36350 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f979c007b70 tx=0x7f979c012000 comp rx=0 tx=0).stop 2024-05-09T01:12:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.752+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 shutdown_connections 2024-05-09T01:12:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.752+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea28b1b6a0 0x55ea28b36350 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.752+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea2899e4a0 0x55ea28b161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.752+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/4065741870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b16720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.752+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 >> 172.21.15.37:0/4065741870 conn(0x55ea289fe6a0 msgr2=0x55ea28b2af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.752+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 shutdown_connections 2024-05-09T01:12:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.752+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/4065741870 wait complete. 2024-05-09T01:12:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 -- start start 2024-05-09T01:12:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 Processor -- start 2024-05-09T01:12:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b2e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28b1b6a0 0x55ea28b2e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97a40733f0 con 0x55ea28b1b6a0 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4072d20 con 0x55ea28a88160 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97a406ff40 con 0x55ea2899e4a0 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.753+0000 7f97b8e9fb80 10 client.0 _ll_register_callbacks cb 0x55ea288af6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48392/0 (socket says 172.21.15.37:48392) 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 -- 172.21.15.37:0/3688689724 learned_addr learned my addr 172.21.15.37:0/3688689724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f979bfff700 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b2e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a8a26700 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28b1b6a0 0x55ea28b2e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 -- 172.21.15.37:0/3688689724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 msgr2=0x55ea28b2e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b2e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 -- 172.21.15.37:0/3688689724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28b1b6a0 msgr2=0x55ea28b2e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28b1b6a0 0x55ea28b2e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 -- 172.21.15.37:0/3688689724 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea28b9ddd0 con 0x55ea2899e4a0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97a3fff700 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2df20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f97940a9dd0 tx=0x7f97940038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dafa979b8812dd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97837fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97837fe700 1 -- 172.21.15.37:0/3688689724 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97940b2c40 con 0x55ea2899e4a0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.754+0000 7f97837fe700 1 -- 172.21.15.37:0/3688689724 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9794070440 con 0x55ea2899e4a0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f979c0218b0 con 0x55ea2899e4a0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97837fe700 1 -- 172.21.15.37:0/3688689724 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f97940a9be0 con 0x55ea2899e4a0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 10 client.26875 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55ea28b9f030 con 0x55ea2899e4a0 2024-05-09T01:12:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97837fe700 1 -- 172.21.15.37:0/3688689724 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97940ae3a0 con 0x55ea2899e4a0 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97837fe700 1 -- 172.21.15.37:0/3688689724 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f97940e08f0 con 0x55ea2899e4a0 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 10 client.26875 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 10 client.26875 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 20 client.26875 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b9f5b0 0x55ea28ba19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 4 client.26875 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f979c0218b0 con 0x55ea28b9f5b0 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.755+0000 7f979bfff700 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b9f5b0 0x55ea28ba19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.756+0000 7f97837fe700 10 client.26875 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.756+0000 7f979bfff700 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b9f5b0 0x55ea28ba19d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd774a1c6f6b64fc server_cookie=8ba39acb1582fa75 in_seq=0 out_seq=0 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.756+0000 7f97837fe700 1 -- 172.21.15.37:0/3688689724 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f979c0218b0 con 0x55ea28b9f5b0 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.756+0000 7f97837fe700 10 client.26875 handle_command_reply: tid=0 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.756+0000 7f97b8e9fb80 1 client.26875 shutdown 2024-05-09T01:12:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 msgr2=0x55ea28b2df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2df20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f97940a9dd0 tx=0x7f97940038b0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 shutdown_connections 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea28b9f5b0 0x55ea28ba19d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea28b1b6a0 0x55ea28b2e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea2899e4a0 0x55ea28b2df20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 --2- 172.21.15.37:0/3688689724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea28a88160 0x55ea28b2e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 >> 172.21.15.37:0/3688689724 conn(0x55ea289fe6a0 msgr2=0x55ea28b2af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97837fe700 0 client.26875 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 shutdown_connections 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 1 -- 172.21.15.37:0/3688689724 wait complete. 2024-05-09T01:12:19.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.757+0000 7f97b8e9fb80 20 client.26875 trim_cache size 0 max 16384 2024-05-09T01:12:19.764 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97900b2980 msgr2=0x7f97900b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97900b2980 0x7f97900b4e90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f979c009550 tx=0x7f979c009040 comp rx=0 tx=0).stop 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 msgr2=0x7f97a419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 0x7f97a419ae10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f979400e970 tx=0x7f979400ed30 comp rx=0 tx=0).stop 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 shutdown_connections 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97900b2980 0x7f97900b4e90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97a4108790 0x7f97a419f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a4103c40 0x7f97a419ae10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 --2- 172.21.15.37:0/3547509862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97a4107e40 0x7f97a419b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 >> 172.21.15.37:0/3547509862 conn(0x7f97a40fe6f0 msgr2=0x7f97a4100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.758+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 shutdown_connections 2024-05-09T01:12:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:19.759+0000 7f97aa489700 1 -- 172.21.15.37:0/3547509862 wait complete. 2024-05-09T01:12:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 600.0 s, 1649.8 tps, lat 59.577 ms stddev 68.426 2024-05-09T01:12:20.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:20 smithi037 ceph-mon[30122]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.6 MiB/s wr, 611 op/s 2024-05-09T01:12:20.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:20 smithi136 ceph-mon[34110]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.6 MiB/s wr, 611 op/s 2024-05-09T01:12:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:20 smithi151 ceph-mon[34780]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.6 MiB/s wr, 611 op/s 2024-05-09T01:12:20.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:12:21.187 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:22.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:22 smithi136 ceph-mon[34110]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 664 op/s 2024-05-09T01:12:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:22 smithi037 ceph-mon[30122]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 664 op/s 2024-05-09T01:12:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:22 smithi151 ceph-mon[34780]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.6 MiB/s wr, 664 op/s 2024-05-09T01:12:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 -- 172.21.15.37:0/3816999490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f504010b730 msgr2=0x7f504010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 --2- 172.21.15.37:0/3816999490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f504010b730 0x7f504010bb40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f503c00a9d0 tx=0x7f503c00ace0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 -- 172.21.15.37:0/3816999490 shutdown_connections 2024-05-09T01:12:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 --2- 172.21.15.37:0/3816999490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5040110710 0x7f5040118070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 --2- 172.21.15.37:0/3816999490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f504010b730 0x7f504010bb40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 --2- 172.21.15.37:0/3816999490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f504010fdc0 0x7f50401101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 -- 172.21.15.37:0/3816999490 >> 172.21.15.37:0/3816999490 conn(0x7f504006f4d0 msgr2=0x7f504006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:23.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.201+0000 7f5047d6d700 1 -- 172.21.15.37:0/3816999490 shutdown_connections 2024-05-09T01:12:23.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.202+0000 7f5047d6d700 1 -- 172.21.15.37:0/3816999490 wait complete. 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.202+0000 7f5047d6d700 1 Processor -- start 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5047d6d700 1 -- start start 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5047d6d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f504010b730 0x7f50401a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5047d6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f504010fdc0 0x7f50401a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5047d6d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5040110710 0x7f50401a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5047d6d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f504011ab10 con 0x7f504010fdc0 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5047d6d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f504011a990 con 0x7f504010b730 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5047d6d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f504011ac90 con 0x7f5040110710 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.203+0000 7f5045b09700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f504010b730 0x7f50401a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.204+0000 7f5045b09700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f504010b730 0x7f50401a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46136/0 (socket says 172.21.15.37:46136) 2024-05-09T01:12:23.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.204+0000 7f5045b09700 1 -- 172.21.15.37:0/2465459339 learned_addr learned my addr 172.21.15.37:0/2465459339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.204+0000 7f504630a700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5040110710 0x7f50401a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.205+0000 7f5045b09700 1 -- 172.21.15.37:0/2465459339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5040110710 msgr2=0x7f50401a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.205+0000 7f5045b09700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5040110710 0x7f50401a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.205+0000 7f5045b09700 1 -- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f504010fdc0 msgr2=0x7f50401a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.205+0000 7f5045b09700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f504010fdc0 0x7f50401a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.205+0000 7f5045b09700 1 -- 172.21.15.37:0/2465459339 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50401b5eb0 con 0x7f504010b730 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.205+0000 7f5045b09700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f504010b730 0x7f50401a1310 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f503c00b680 tx=0x7f503c00e7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.206+0000 7f5036ffd700 1 -- 172.21.15.37:0/2465459339 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c025070 con 0x7f504010b730 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.206+0000 7f5036ffd700 1 -- 172.21.15.37:0/2465459339 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f503c00ea50 con 0x7f504010b730 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.206+0000 7f5036ffd700 1 -- 172.21.15.37:0/2465459339 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c01a040 con 0x7f504010b730 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.206+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50401b60e0 con 0x7f504010b730 2024-05-09T01:12:23.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.206+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50401b64e0 con 0x7f504010b730 2024-05-09T01:12:23.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.211+0000 7f5056783b80 1 Processor -- start 2024-05-09T01:12:23.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.211+0000 7f5036ffd700 1 -- 172.21.15.37:0/2465459339 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f503c015420 con 0x7f504010b730 2024-05-09T01:12:23.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.212+0000 7f5056783b80 1 -- start start 2024-05-09T01:12:23.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.212+0000 7f5056783b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c65574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5056783b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6557a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5036ffd700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f502c0b2980 0x7f502c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5056783b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c6551ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5056783b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4c6473ff0 con 0x55d4c65516a0 2024-05-09T01:12:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5056783b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d4c64127f0 con 0x55d4c64be160 2024-05-09T01:12:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5045b09700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6557a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5045308700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f502c0b2980 0x7f502c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5045b09700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6557a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48518/0 (socket says 172.21.15.37:48518) 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5045b09700 1 -- 172.21.15.37:0/45503373 learned_addr learned my addr 172.21.15.37:0/45503373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f504630a700 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c65574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5056783b80 1 -- 172.21.15.37:0/45503373 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d4c646ffb0 con 0x55d4c63d44a0 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.213+0000 7f5036ffd700 1 -- 172.21.15.37:0/2465459339 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f503c0e31c0 con 0x7f504010b730 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f504630a700 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c6551ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f5045b09700 1 -- 172.21.15.37:0/45503373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 msgr2=0x55d4c65574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f5045b09700 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c65574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f5045308700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f502c0b2980 0x7f502c0b4e90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f504006fb90 tx=0x7f503000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f5045b09700 1 -- 172.21.15.37:0/45503373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 msgr2=0x55d4c6551ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f5045b09700 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c6551ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f5045b09700 1 -- 172.21.15.37:0/45503373 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c640a370 con 0x55d4c63d44a0 2024-05-09T01:12:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f5045b09700 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6557a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f503c02d030 tx=0x7f503c0d9df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7b04d8bb0df2bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.214+0000 7f502bfff700 1 -- 172.21.15.37:0/45503373 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c0a6730 con 0x55d4c63d44a0 2024-05-09T01:12:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.215+0000 7f502bfff700 1 -- 172.21.15.37:0/45503373 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f503c0782d0 con 0x55d4c63d44a0 2024-05-09T01:12:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.215+0000 7f502bfff700 1 -- 172.21.15.37:0/45503373 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c019200 con 0x55d4c63d44a0 2024-05-09T01:12:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.217+0000 7f5056783b80 1 -- 172.21.15.37:0/45503373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 msgr2=0x55d4c6557a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.217+0000 7f5056783b80 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6557a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f503c02d030 tx=0x7f503c0d9df0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.217+0000 7f5056783b80 1 -- 172.21.15.37:0/45503373 shutdown_connections 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.217+0000 7f5056783b80 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c6551ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.217+0000 7f5056783b80 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c65574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.217+0000 7f5056783b80 1 --2- 172.21.15.37:0/45503373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6557a30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.217+0000 7f5056783b80 1 -- 172.21.15.37:0/45503373 >> 172.21.15.37:0/45503373 conn(0x55d4c64346a0 msgr2=0x55d4c654c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.218+0000 7f5056783b80 1 -- 172.21.15.37:0/45503373 shutdown_connections 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.218+0000 7f5056783b80 1 -- 172.21.15.37:0/45503373 wait complete. 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.218+0000 7f5056783b80 1 -- start start 2024-05-09T01:12:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.218+0000 7f5056783b80 1 Processor -- start 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5056783b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c63d44a0 0x55d4c6560db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5056783b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c64be160 0x55d4c65612f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5056783b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5045b09700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c63d44a0 0x55d4c6560db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5045b09700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c63d44a0 0x55d4c6560db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46152/0 (socket says 172.21.15.37:46152) 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5045308700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c64be160 0x55d4c65612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5045308700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c64be160 0x55d4c65612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48530/0 (socket says 172.21.15.37:48530) 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5045b09700 1 -- 172.21.15.37:0/607724650 learned_addr learned my addr 172.21.15.37:0/607724650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4c62efba0 con 0x55d4c65516a0 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.219+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d4c642e150 con 0x55d4c63d44a0 2024-05-09T01:12:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d4c6552360 con 0x55d4c64be160 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f504630a700 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5056783b80 10 client.0 _ll_register_callbacks cb 0x55d4c62e56c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5045b09700 1 -- 172.21.15.37:0/607724650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c64be160 msgr2=0x55d4c65612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5045b09700 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c64be160 0x55d4c65612f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5045b09700 1 -- 172.21.15.37:0/607724650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 msgr2=0x55d4c655b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5045b09700 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5045b09700 1 -- 172.21.15.37:0/607724650 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c62ef490 con 0x55d4c63d44a0 2024-05-09T01:12:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.220+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4c64819d0 con 0x55d4c63d44a0 2024-05-09T01:12:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.222+0000 7f5045b09700 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c63d44a0 0x55d4c6560db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f503c000c00 tx=0x7f503c0aae70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8acc5108ac891fdf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.222+0000 7f50297fa700 10 client.26915 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.228+0000 7f50297fa700 1 -- 172.21.15.37:0/607724650 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c0a9fe0 con 0x55d4c63d44a0 2024-05-09T01:12:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.228+0000 7f50297fa700 1 -- 172.21.15.37:0/607724650 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f503c0b31b0 con 0x55d4c63d44a0 2024-05-09T01:12:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.228+0000 7f50297fa700 1 -- 172.21.15.37:0/607724650 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f503c0aa1c0 con 0x55d4c63d44a0 2024-05-09T01:12:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.228+0000 7f5056783b80 10 client.26915 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.228+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=43}) -- 0x55d4c6568850 con 0x55d4c63d44a0 2024-05-09T01:12:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.230+0000 7f50297fa700 1 -- 172.21.15.37:0/607724650 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f503c00b040 con 0x55d4c63d44a0 2024-05-09T01:12:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.231+0000 7f5056783b80 10 client.26915 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.231+0000 7f5056783b80 10 client.26915 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:12:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.231+0000 7f5056783b80 20 client.26915 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.231+0000 7f5056783b80 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c656ab50 0x55d4c656cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.231+0000 7f5056783b80 4 client.26915 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.231+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4c647ba70 con 0x55d4c656ab50 2024-05-09T01:12:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.232+0000 7f5045308700 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c656ab50 0x55d4c656cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.237+0000 7f5045308700 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c656ab50 0x55d4c656cf70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f506469b0a1b39a server_cookie=92d3c252cda90725 in_seq=0 out_seq=0 2024-05-09T01:12:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.237+0000 7f50297fa700 10 client.26915 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:12:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.238+0000 7f50297fa700 1 -- 172.21.15.37:0/607724650 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d4c647ba70 con 0x55d4c656ab50 2024-05-09T01:12:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.238+0000 7f50297fa700 10 client.26915 handle_command_reply: tid=0 2024-05-09T01:12:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.238+0000 7f5056783b80 1 client.26915 shutdown 2024-05-09T01:12:23.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c63d44a0 msgr2=0x55d4c6560db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c63d44a0 0x55d4c6560db0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f503c000c00 tx=0x7f503c0aae70 comp rx=0 tx=0).stop 2024-05-09T01:12:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 shutdown_connections 2024-05-09T01:12:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c656ab50 0x55d4c656cf70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c63d44a0 0x55d4c6560db0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 --2- 172.21.15.37:0/607724650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c64be160 0x55d4c65612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.246+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 >> 172.21.15.37:0/607724650 conn(0x55d4c64346a0 msgr2=0x55d4c654c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.248+0000 7f50297fa700 0 client.26915 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.248+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 shutdown_connections 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.248+0000 7f5056783b80 1 -- 172.21.15.37:0/607724650 wait complete. 2024-05-09T01:12:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.248+0000 7f5056783b80 20 client.26915 trim_cache size 0 max 16384 2024-05-09T01:12:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.281+0000 7f5056783b80 1 Processor -- start 2024-05-09T01:12:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.282+0000 7f5056783b80 1 -- start start 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.282+0000 7f5056783b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6572570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.282+0000 7f5056783b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6572ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.282+0000 7f5056783b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.282+0000 7f5056783b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f502400d2f0 con 0x55d4c65516a0 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.282+0000 7f5056783b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f502400ee30 con 0x55d4c64be160 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.283+0000 7f5056783b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f502400d9c0 con 0x55d4c63d44a0 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.283+0000 7f504630a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.283+0000 7f504630a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45698/0 (socket says 172.21.15.37:45698) 2024-05-09T01:12:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.283+0000 7f504630a700 1 -- 172.21.15.37:0/762378621 learned_addr learned my addr 172.21.15.37:0/762378621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.285+0000 7f5045308700 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6572ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.285+0000 7f5045b09700 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6572570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.288+0000 7f5045b09700 1 -- 172.21.15.37:0/762378621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 msgr2=0x55d4c6572ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.288+0000 7f5045b09700 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6572ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.288+0000 7f5045b09700 1 -- 172.21.15.37:0/762378621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 msgr2=0x55d4c655aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.288+0000 7f5045b09700 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.288+0000 7f5045b09700 1 -- 172.21.15.37:0/762378621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c654dcc0 con 0x55d4c63d44a0 2024-05-09T01:12:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.290+0000 7f5045b09700 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6572570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f503c0aa8e0 tx=0x7f503c0cd000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14fa9eb24faa1ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.292+0000 7f502b7fe700 1 -- 172.21.15.37:0/762378621 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c0d9e60 con 0x55d4c63d44a0 2024-05-09T01:12:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.292+0000 7f502b7fe700 1 -- 172.21.15.37:0/762378621 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d4c64819d0 con 0x55d4c63d44a0 2024-05-09T01:12:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.292+0000 7f502b7fe700 1 -- 172.21.15.37:0/762378621 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c0aa640 con 0x55d4c63d44a0 2024-05-09T01:12:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.294+0000 7f5056783b80 1 -- 172.21.15.37:0/762378621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 msgr2=0x55d4c6572570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.294+0000 7f5056783b80 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6572570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f503c0aa8e0 tx=0x7f503c0cd000 comp rx=0 tx=0).stop 2024-05-09T01:12:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.295+0000 7f5056783b80 1 -- 172.21.15.37:0/762378621 shutdown_connections 2024-05-09T01:12:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.295+0000 7f5056783b80 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c65516a0 0x55d4c655aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.295+0000 7f5056783b80 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c63d44a0 0x55d4c6572570 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.295+0000 7f5056783b80 1 --2- 172.21.15.37:0/762378621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6572ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.295+0000 7f5056783b80 1 -- 172.21.15.37:0/762378621 >> 172.21.15.37:0/762378621 conn(0x55d4c64346a0 msgr2=0x55d4c6559ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.298+0000 7f5056783b80 1 -- 172.21.15.37:0/762378621 shutdown_connections 2024-05-09T01:12:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.298+0000 7f5056783b80 1 -- 172.21.15.37:0/762378621 wait complete. 2024-05-09T01:12:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.298+0000 7f5056783b80 1 -- start start 2024-05-09T01:12:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.299+0000 7f5056783b80 1 Processor -- start 2024-05-09T01:12:23.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.300+0000 7f5056783b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c63d44a0 0x55d4c6566b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.300+0000 7f5056783b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6567070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.300+0000 7f5056783b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c65516a0 0x55d4c65675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.300+0000 7f5045308700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6567070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.300+0000 7f5045308700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6567070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46176/0 (socket says 172.21.15.37:46176) 2024-05-09T01:12:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.301+0000 7f504630a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c65516a0 0x55d4c65675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.301+0000 7f5056783b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f502400e760 con 0x55d4c63d44a0 2024-05-09T01:12:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.301+0000 7f5056783b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f502400e090 con 0x55d4c64be160 2024-05-09T01:12:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.301+0000 7f5056783b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f502400b290 con 0x55d4c65516a0 2024-05-09T01:12:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.301+0000 7f5056783b80 10 client.0 _ll_register_callbacks cb 0x55d4c62e56c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.301+0000 7f5045308700 1 -- 172.21.15.37:0/1669203646 learned_addr learned my addr 172.21.15.37:0/1669203646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.301+0000 7f5045b09700 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c63d44a0 0x55d4c6566b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.302+0000 7f504630a700 1 -- 172.21.15.37:0/1669203646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 msgr2=0x55d4c6567070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.302+0000 7f504630a700 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6567070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.302+0000 7f504630a700 1 -- 172.21.15.37:0/1669203646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c63d44a0 msgr2=0x55d4c6566b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.302+0000 7f504630a700 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c63d44a0 0x55d4c6566b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.302+0000 7f504630a700 1 -- 172.21.15.37:0/1669203646 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c655bff0 con 0x55d4c65516a0 2024-05-09T01:12:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.302+0000 7f5045b09700 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c63d44a0 0x55d4c6566b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.303+0000 7f504630a700 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c65516a0 0x55d4c65675b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5038009fd0 tx=0x7f5038016540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44206f1eca3e06cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.303+0000 7f50297fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.303+0000 7f50297fa700 1 -- 172.21.15.37:0/1669203646 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038014040 con 0x55d4c65516a0 2024-05-09T01:12:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.304+0000 7f50297fa700 1 -- 172.21.15.37:0/1669203646 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5038003a00 con 0x55d4c65516a0 2024-05-09T01:12:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.304+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4c64819d0 con 0x55d4c65516a0 2024-05-09T01:12:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.304+0000 7f50297fa700 1 -- 172.21.15.37:0/1669203646 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f5038003c00 con 0x55d4c65516a0 2024-05-09T01:12:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.307+0000 7f5056783b80 10 client.26890 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.307+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55d4c65e61c0 con 0x55d4c65516a0 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f50297fa700 1 -- 172.21.15.37:0/1669203646 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d4c64819d0 con 0x55d4c65516a0 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f50297fa700 1 -- 172.21.15.37:0/1669203646 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f5038004590 con 0x55d4c65516a0 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f5056783b80 10 client.26890 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f5056783b80 10 client.26890 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f5056783b80 20 client.26890 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f5056783b80 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c65e68b0 0x55d4c65e8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f5056783b80 4 client.26890 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.309+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4c62ef970 con 0x55d4c65e68b0 2024-05-09T01:12:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.310+0000 7f5045b09700 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c65e68b0 0x55d4c65e8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:23.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.310+0000 7f5045b09700 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c65e68b0 0x55d4c65e8cd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b0763b9382b2de9 server_cookie=86d8dc14f350b2ef in_seq=0 out_seq=0 2024-05-09T01:12:23.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.310+0000 7f50297fa700 10 client.26890 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.311+0000 7f50297fa700 1 -- 172.21.15.37:0/1669203646 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4c62ef970 con 0x55d4c65e68b0 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.311+0000 7f50297fa700 10 client.26890 handle_command_reply: tid=0 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.311+0000 7f5056783b80 1 client.26890 shutdown 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.312+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c65516a0 msgr2=0x55d4c65675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.312+0000 7f5056783b80 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c65516a0 0x55d4c65675b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5038009fd0 tx=0x7f5038016540 comp rx=0 tx=0).stop 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.312+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 shutdown_connections 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.312+0000 7f5056783b80 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4c65516a0 0x55d4c65675b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.312+0000 7f5056783b80 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55d4c65e68b0 0x55d4c65e8cd0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.313+0000 7f5056783b80 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4c63d44a0 0x55d4c6566b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.313+0000 7f50297fa700 0 client.26890 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:12:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.313+0000 7f5056783b80 1 --2- 172.21.15.37:0/1669203646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d4c64be160 0x55d4c6567070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.313+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 >> 172.21.15.37:0/1669203646 conn(0x55d4c64346a0 msgr2=0x55d4c6550690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.313+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 shutdown_connections 2024-05-09T01:12:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.313+0000 7f5056783b80 1 -- 172.21.15.37:0/1669203646 wait complete. 2024-05-09T01:12:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.313+0000 7f5056783b80 20 client.26890 trim_cache size 0 max 16384 2024-05-09T01:12:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:12:23.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.314+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f502c0b2980 msgr2=0x7f502c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.314+0000 7f5047d6d700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f502c0b2980 0x7f502c0b4e90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f504006fb90 tx=0x7f503000d040 comp rx=0 tx=0).stop 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.314+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f504010b730 msgr2=0x7f50401a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.314+0000 7f5047d6d700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f504010b730 0x7f50401a1310 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f503c00b680 tx=0x7f503c00e7b0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.315+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 shutdown_connections 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.315+0000 7f5047d6d700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f502c0b2980 0x7f502c0b4e90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.315+0000 7f5047d6d700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5040110710 0x7f50401a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.315+0000 7f5047d6d700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f504010b730 0x7f50401a1310 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.315+0000 7f5047d6d700 1 --2- 172.21.15.37:0/2465459339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f504010fdc0 0x7f50401a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.315+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 >> 172.21.15.37:0/2465459339 conn(0x7f504006f4d0 msgr2=0x7f504010df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:23.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.316+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 shutdown_connections 2024-05-09T01:12:23.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:23.316+0000 7f5047d6d700 1 -- 172.21.15.37:0/2465459339 wait complete. 2024-05-09T01:12:24.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:12:24.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:24 smithi037 ceph-mon[30122]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 612 op/s 2024-05-09T01:12:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:24.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:24 smithi136 ceph-mon[34110]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 612 op/s 2024-05-09T01:12:24.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:24 smithi151 ceph-mon[34780]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 612 op/s 2024-05-09T01:12:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 605.0 s, 1815.6 tps, lat 55.854 ms stddev 74.849 2024-05-09T01:12:26.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:26 smithi037 ceph-mon[30122]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 614 op/s 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 -- 172.21.15.37:0/2349015083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce810e6d0 msgr2=0x7f1ce8110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 --2- 172.21.15.37:0/2349015083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce810e6d0 0x7f1ce8110bb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009f90 tx=0x7f1ce000b330 comp rx=0 tx=0).stop 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 -- 172.21.15.37:0/2349015083 shutdown_connections 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 --2- 172.21.15.37:0/2349015083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce810e6d0 0x7f1ce8110bb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 --2- 172.21.15.37:0/2349015083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce8105260 0x7f1ce8105670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 --2- 172.21.15.37:0/2349015083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce8105bb0 0x7f1ce810e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 -- 172.21.15.37:0/2349015083 >> 172.21.15.37:0/2349015083 conn(0x7f1ce8078bf0 msgr2=0x7f1ce8079030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.487+0000 7f1cedae5700 1 -- 172.21.15.37:0/2349015083 shutdown_connections 2024-05-09T01:12:26.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.488+0000 7f1cedae5700 1 -- 172.21.15.37:0/2349015083 wait complete. 2024-05-09T01:12:26.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 Processor -- start 2024-05-09T01:12:26.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 -- start start 2024-05-09T01:12:26.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8105260 0x7f1ce81a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce8105bb0 0x7f1ce81a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce810e6d0 0x7f1ce819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8114230 con 0x7f1ce8105260 2024-05-09T01:12:26.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cecae3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8105260 0x7f1ce81a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce8105bb0 0x7f1ce81a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cecae3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8105260 0x7f1ce81a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45722/0 (socket says 172.21.15.37:45722) 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cecae3700 1 -- 172.21.15.37:0/4189066437 learned_addr learned my addr 172.21.15.37:0/4189066437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81140b0 con 0x7f1ce8105bb0 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.489+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81143b0 con 0x7f1ce810e6d0 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1cecae3700 1 -- 172.21.15.37:0/4189066437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce810e6d0 msgr2=0x7f1ce819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1cecae3700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce810e6d0 0x7f1ce819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1cecae3700 1 -- 172.21.15.37:0/4189066437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce8105bb0 msgr2=0x7f1ce81a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1cecae3700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce8105bb0 0x7f1ce81a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1cecae3700 1 -- 172.21.15.37:0/4189066437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce819b080 con 0x7f1ce8105260 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1cecae3700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8105260 0x7f1ce81a0760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e9c0 tx=0x7f1cdc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1ce5ffb700 1 -- 172.21.15.37:0/4189066437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00cbd0 con 0x7f1ce8105260 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1ce5ffb700 1 -- 172.21.15.37:0/4189066437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cdc00cd70 con 0x7f1ce8105260 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce819b370 con 0x7f1ce8105260 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.490+0000 7f1ce5ffb700 1 -- 172.21.15.37:0/4189066437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0055a0 con 0x7f1ce8105260 2024-05-09T01:12:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.491+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81a75f0 con 0x7f1ce8105260 2024-05-09T01:12:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.496+0000 7f1ce5ffb700 1 -- 172.21.15.37:0/4189066437 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1cdc004750 con 0x7f1ce8105260 2024-05-09T01:12:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.496+0000 7f1cfd75db80 1 Processor -- start 2024-05-09T01:12:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cfd75db80 1 -- start start 2024-05-09T01:12:26.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x555961894ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617134a0 0x555961895430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x5559618999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cfd75db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5559617b2ff0 con 0x5559618995e0 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cfd75db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5559617517f0 con 0x5559617fd160 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cfd75db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5559617aefb0 con 0x5559617134a0 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x5559618999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x5559618999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45730/0 (socket says 172.21.15.37:45730) 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1ce7fff700 1 -- 172.21.15.37:0/2300911978 learned_addr learned my addr 172.21.15.37:0/2300911978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1cecae3700 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617134a0 0x555961895430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.497+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x555961894ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce7fff700 1 -- 172.21.15.37:0/2300911978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617134a0 msgr2=0x555961895430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617134a0 0x555961895430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce5ffb700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cd80b2880 0x7f1cd80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce7fff700 1 -- 172.21.15.37:0/2300911978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 msgr2=0x555961894ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x555961894ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce7fff700 1 -- 172.21.15.37:0/2300911978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555961749370 con 0x5559618995e0 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x555961894ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cd80b2880 0x7f1cd80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce5ffb700 1 -- 172.21.15.37:0/4189066437 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1cdc0e23b0 con 0x7f1ce8105260 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x5559618999f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4007be0 tx=0x7f1cd4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4633760fa04b5d96 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1cd2ffd700 1 -- 172.21.15.37:0/2300911978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4010c40 con 0x5559618995e0 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1cd2ffd700 1 -- 172.21.15.37:0/2300911978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cd40044e0 con 0x5559618995e0 2024-05-09T01:12:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.498+0000 7f1cd2ffd700 1 -- 172.21.15.37:0/2300911978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd401a470 con 0x5559618995e0 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2300911978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 msgr2=0x5559618999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cd80b2880 0x7f1cd80b4d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x555961895f40 tx=0x7f1ce0009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x5559618999f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4007be0 tx=0x7f1cd4007ef0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2300911978 shutdown_connections 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x5559618999f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x555961894ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2300911978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617134a0 0x555961895430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2300911978 >> 172.21.15.37:0/2300911978 conn(0x5559617736a0 msgr2=0x55596188b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.499+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2300911978 shutdown_connections 2024-05-09T01:12:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.502+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2300911978 wait complete. 2024-05-09T01:12:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.502+0000 7f1cfd75db80 1 -- start start 2024-05-09T01:12:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 1 Processor -- start 2024-05-09T01:12:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617134a0 0x55596189e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x55596189ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55596162eba0 con 0x5559617134a0 2024-05-09T01:12:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55596176d150 con 0x5559617fd160 2024-05-09T01:12:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55596189a390 con 0x5559618995e0 2024-05-09T01:12:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cfd75db80 10 client.0 _ll_register_callbacks cb 0x5559616246c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x55596189ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x55596189ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46206/0 (socket says 172.21.15.37:46206) 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1ce7fff700 1 -- 172.21.15.37:0/359580388 learned_addr learned my addr 172.21.15.37:0/359580388 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1cecae3700 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617134a0 0x55596189e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.503+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1ce7fff700 1 -- 172.21.15.37:0/359580388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 msgr2=0x55596189f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1ce7fff700 1 -- 172.21.15.37:0/359580388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617134a0 msgr2=0x55596189e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617134a0 0x55596189e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1ce7fff700 1 -- 172.21.15.37:0/359580388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55596162e490 con 0x5559617fd160 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x55596189ec90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4000c00 tx=0x7f1cd4003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=688728e360ffefba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1cc7fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1cc7fff700 1 -- 172.21.15.37:0/359580388 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4010c50 con 0x5559617fd160 2024-05-09T01:12:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1cc7fff700 1 -- 172.21.15.37:0/359580388 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1cd4010df0 con 0x5559617fd160 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.504+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd40044e0 con 0x5559617fd160 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cc7fff700 1 -- 172.21.15.37:0/359580388 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1cd4005030 con 0x5559617fd160 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 10 client.26933 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5559618ac030 con 0x5559617fd160 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cc7fff700 1 -- 172.21.15.37:0/359580388 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cd4004750 con 0x5559617fd160 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cc7fff700 1 -- 172.21.15.37:0/359580388 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f1cd4003c20 con 0x5559617fd160 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 10 client.26933 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 10 client.26933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 20 client.26933 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559618ae500 0x5559618b0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 4 client.26933 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.505+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1cd40044e0 con 0x5559618ae500 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.506+0000 7f1cecae3700 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559618ae500 0x5559618b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.506+0000 7f1cecae3700 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559618ae500 0x5559618b0920 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a41c89260e196 server_cookie=17a5411066109a2d in_seq=0 out_seq=0 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.506+0000 7f1cc7fff700 10 client.26933 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cc7fff700 1 -- 172.21.15.37:0/359580388 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f1cdc08ac70 con 0x5559618ae500 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cc7fff700 10 client.26933 handle_command_reply: tid=0 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 client.26933 shutdown 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 msgr2=0x55596189ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x55596189ec90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4000c00 tx=0x7f1cd4003730 comp rx=0 tx=0).stop 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 shutdown_connections 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559618ae500 0x5559618b0920 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617134a0 0x55596189e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/359580388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617fd160 0x55596189ec90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 >> 172.21.15.37:0/359580388 conn(0x5559617736a0 msgr2=0x55596188b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cc7fff700 0 client.26933 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 shutdown_connections 2024-05-09T01:12:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 1 -- 172.21.15.37:0/359580388 wait complete. 2024-05-09T01:12:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.507+0000 7f1cfd75db80 20 client.26933 trim_cache size 0 max 16384 2024-05-09T01:12:26.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.527+0000 7f1cfd75db80 1 Processor -- start 2024-05-09T01:12:26.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.527+0000 7f1cfd75db80 1 -- start start 2024-05-09T01:12:26.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.527+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x55596189d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617fd160 0x5559618999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cecae3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x55596189d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cecae3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x55596189d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46210/0 (socket says 172.21.15.37:46210) 2024-05-09T01:12:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cecae3700 1 -- 172.21.15.37:0/2377019322 learned_addr learned my addr 172.21.15.37:0/2377019322 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81ac760 con 0x5559617fd160 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81ae2a0 con 0x5559617134a0 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81ace30 con 0x5559618995e0 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.528+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.529+0000 7f1cecae3700 1 -- 172.21.15.37:0/2377019322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 msgr2=0x55596189f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.529+0000 7f1cecae3700 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.529+0000 7f1cecae3700 1 -- 172.21.15.37:0/2377019322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617fd160 msgr2=0x5559618999f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.529+0000 7f1cecae3700 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617fd160 0x5559618999f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.529+0000 7f1cecae3700 1 -- 172.21.15.37:0/2377019322 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555961886410 con 0x5559617134a0 2024-05-09T01:12:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.529+0000 7f1cecae3700 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x55596189d6b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0e2710 tx=0x7f1cdc0e7040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e645ee80d94670fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.530+0000 7f1cd27fc700 1 -- 172.21.15.37:0/2377019322 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0a93c0 con 0x5559617134a0 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.530+0000 7f1cd27fc700 1 -- 172.21.15.37:0/2377019322 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cd40044e0 con 0x5559617134a0 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.530+0000 7f1cd27fc700 1 -- 172.21.15.37:0/2377019322 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0a5200 con 0x5559617134a0 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 msgr2=0x55596189d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x55596189d6b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0e2710 tx=0x7f1cdc0e7040 comp rx=0 tx=0).stop 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 shutdown_connections 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559618995e0 0x55596189f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x55596189d6b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/2377019322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559617fd160 0x5559618999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 >> 172.21.15.37:0/2377019322 conn(0x5559617736a0 msgr2=0x55596188f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 shutdown_connections 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 -- 172.21.15.37:0/2377019322 wait complete. 2024-05-09T01:12:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 -- start start 2024-05-09T01:12:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.531+0000 7f1cfd75db80 1 Processor -- start 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.532+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x5559618b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.532+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617fd160 0x5559618b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cfd75db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x555961910a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x5559618b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x5559618b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46212/0 (socket says 172.21.15.37:46212) 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617fd160 0x5559618b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617fd160 0x5559618b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48596/0 (socket says 172.21.15.37:48596) 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 -- 172.21.15.37:0/707702389 learned_addr learned my addr 172.21.15.37:0/707702389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81adbd0 con 0x5559618995e0 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81ad500 con 0x5559617134a0 2024-05-09T01:12:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81aa700 con 0x5559617fd160 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x555961910a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cfd75db80 10 client.0 _ll_register_callbacks cb 0x5559616246c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 -- 172.21.15.37:0/707702389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617fd160 msgr2=0x5559618b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617fd160 0x5559618b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 -- 172.21.15.37:0/707702389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 msgr2=0x555961910a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x555961910a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 -- 172.21.15.37:0/707702389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555961911040 con 0x5559617134a0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1ced2e4700 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x555961910a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cecae3700 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x5559618b0f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0dffa0 tx=0x7f1cdc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e55015b4c4456107 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.533+0000 7f1cc7fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cc7fff700 1 -- 172.21.15.37:0/707702389 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0a91e0 con 0x5559617134a0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cd40044e0 con 0x5559617134a0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cc7fff700 1 -- 172.21.15.37:0/707702389 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1cdc0a9ee0 con 0x5559617134a0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cc7fff700 1 -- 172.21.15.37:0/707702389 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1cdc0a5200 con 0x5559617134a0 2024-05-09T01:12:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 10 client.26939 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5559619182f0 con 0x5559617134a0 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cc7fff700 1 -- 172.21.15.37:0/707702389 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cd40044e0 con 0x5559617134a0 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cc7fff700 1 -- 172.21.15.37:0/707702389 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7f1cdc0cc0e0 con 0x5559617134a0 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 10 client.26939 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 10 client.26939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 20 client.26939 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559619188d0 0x55596191acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 4 client.26939 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5559617c09d0 con 0x5559619188d0 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.534+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559619188d0 0x55596191acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.535+0000 7f1cc7fff700 10 client.26939 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.535+0000 7f1ce7fff700 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559619188d0 0x55596191acf0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76b2f99e657a0551 server_cookie=c7d072606ccbced8 in_seq=0 out_seq=0 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.535+0000 7f1cc7fff700 1 -- 172.21.15.37:0/707702389 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5559617c09d0 con 0x5559619188d0 2024-05-09T01:12:26.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.535+0000 7f1cc7fff700 10 client.26939 handle_command_reply: tid=0 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.535+0000 7f1cfd75db80 1 client.26939 shutdown 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.535+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 msgr2=0x5559618b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.535+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x5559618b0f20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0dffa0 tx=0x7f1cdc000bc0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 shutdown_connections 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5559619188d0 0x55596191acf0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5559618995e0 0x555961910a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5559617134a0 0x5559618b0f20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cc7fff700 0 client.26939 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 --2- 172.21.15.37:0/707702389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5559617fd160 0x5559618b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 >> 172.21.15.37:0/707702389 conn(0x5559617736a0 msgr2=0x55596188aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 shutdown_connections 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 1 -- 172.21.15.37:0/707702389 wait complete. 2024-05-09T01:12:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.536+0000 7f1cfd75db80 20 client.26939 trim_cache size 0 max 16384 2024-05-09T01:12:26.543 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cd80b2880 msgr2=0x7f1cd80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cd80b2880 0x7f1cd80b4d90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x555961895f40 tx=0x7f1ce0009920 comp rx=0 tx=0).stop 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8105260 msgr2=0x7f1ce81a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8105260 0x7f1ce81a0760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e9c0 tx=0x7f1cdc00ecd0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 shutdown_connections 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1cd80b2880 0x7f1cd80b4d90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce810e6d0 0x7f1ce819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce8105260 0x7f1ce81a0760 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 --2- 172.21.15.37:0/4189066437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce8105bb0 0x7f1ce81a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 >> 172.21.15.37:0/4189066437 conn(0x7f1ce8078bf0 msgr2=0x7f1ce80ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 shutdown_connections 2024-05-09T01:12:26.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:26.539+0000 7f1cedae5700 1 -- 172.21.15.37:0/4189066437 wait complete. 2024-05-09T01:12:26.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:26 smithi136 ceph-mon[34110]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 614 op/s 2024-05-09T01:12:26.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:26 smithi151 ceph-mon[34780]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 614 op/s 2024-05-09T01:12:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 -- 172.21.15.37:0/2111203786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc234104ec0 msgr2=0x7fc2341052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 --2- 172.21.15.37:0/2111203786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc234104ec0 0x7fc2341052d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc220009900 tx=0x7fc22002a410 comp rx=0 tx=0).stop 2024-05-09T01:12:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 -- 172.21.15.37:0/2111203786 shutdown_connections 2024-05-09T01:12:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 --2- 172.21.15.37:0/2111203786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234109bc0 0x7fc23410bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 --2- 172.21.15.37:0/2111203786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc234104ec0 0x7fc2341052d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 --2- 172.21.15.37:0/2111203786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234103c80 0x7fc234104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 -- 172.21.15.37:0/2111203786 >> 172.21.15.37:0/2111203786 conn(0x7fc2340fee50 msgr2=0x7fc234101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 -- 172.21.15.37:0/2111203786 shutdown_connections 2024-05-09T01:12:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.265+0000 7fc23b05b640 1 -- 172.21.15.37:0/2111203786 wait complete. 2024-05-09T01:12:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.266+0000 7fc23b05b640 1 Processor -- start 2024-05-09T01:12:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc23b05b640 1 -- start start 2024-05-09T01:12:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc23b05b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234103c80 0x7fc234076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc23b05b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234104ec0 0x7fc234075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc23b05b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc234109bc0 0x7fc234075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc23b05b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc23410f780 con 0x7fc234109bc0 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc23b05b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc23410f600 con 0x7fc234103c80 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc23b05b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc23410f900 con 0x7fc234104ec0 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc238df7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234103c80 0x7fc234076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc238df7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234103c80 0x7fc234076980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46234/0 (socket says 172.21.15.37:46234) 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.267+0000 7fc238df7640 1 -- 172.21.15.37:0/3448481111 learned_addr learned my addr 172.21.15.37:0/3448481111 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.268+0000 7fc238df7640 1 -- 172.21.15.37:0/3448481111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234104ec0 msgr2=0x7fc234075020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.268+0000 7fc238df7640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234104ec0 0x7fc234075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.268+0000 7fc238df7640 1 -- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc234109bc0 msgr2=0x7fc234075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.268+0000 7fc238df7640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc234109bc0 0x7fc234075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.268+0000 7fc238df7640 1 -- 172.21.15.37:0/3448481111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc234075c90 con 0x7fc234103c80 2024-05-09T01:12:27.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.271+0000 7fc238df7640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234103c80 0x7fc234076980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc22800e9f0 tx=0x7fc22800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.276+0000 7fc231ffb640 1 -- 172.21.15.37:0/3448481111 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22800ccc0 con 0x7fc234103c80 2024-05-09T01:12:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.276+0000 7fc231ffb640 1 -- 172.21.15.37:0/3448481111 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2280035f0 con 0x7fc234103c80 2024-05-09T01:12:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.276+0000 7fc231ffb640 1 -- 172.21.15.37:0/3448481111 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22800ce60 con 0x7fc234103c80 2024-05-09T01:12:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.276+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2341a43f0 con 0x7fc234103c80 2024-05-09T01:12:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.277+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2341a4860 con 0x7fc234103c80 2024-05-09T01:12:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.289+0000 7fc241fea740 1 Processor -- start 2024-05-09T01:12:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.289+0000 7fc241fea740 1 -- start start 2024-05-09T01:12:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.289+0000 7fc241fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d767a1b0 0x55d3d7a1e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc241fea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a1ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc2395f8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d767a1b0 0x55d3d7a1e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc2395f8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d767a1b0 0x55d3d7a1e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48614/0 (socket says 172.21.15.37:48614) 2024-05-09T01:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc2395f8640 1 -- 172.21.15.37:0/3274501496 learned_addr learned my addr 172.21.15.37:0/3274501496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc241fea740 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76594d0 0x55d3d7a25980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d3d79827c0 con 0x55d3d76512f0 2024-05-09T01:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d3d791e0e0 con 0x55d3d76594d0 2024-05-09T01:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.290+0000 7fc233fff640 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76594d0 0x55d3d7a25980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.291+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d3d797e780 con 0x55d3d767a1b0 2024-05-09T01:12:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.291+0000 7fc231ffb640 1 -- 172.21.15.37:0/3448481111 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc228010690 con 0x7fc234103c80 2024-05-09T01:12:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.292+0000 7fc238df7640 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a1ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.293+0000 7fc231ffb640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2240b29b0 0x7fc2240b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.293+0000 7fc231ffb640 1 -- 172.21.15.37:0/3448481111 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc2280e2a30 con 0x7fc234103c80 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc233fff640 1 -- 172.21.15.37:0/3274501496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d767a1b0 msgr2=0x55d3d7a1e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc233fff640 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d767a1b0 0x55d3d7a1e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc233fff640 1 -- 172.21.15.37:0/3274501496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 msgr2=0x55d3d7a1ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc233fff640 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a1ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc233fff640 1 -- 172.21.15.37:0/3274501496 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3d79477c0 con 0x55d3d76594d0 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc2395f8640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2240b29b0 0x7fc2240b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc238df7640 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a1ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.296+0000 7fc233fff640 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76594d0 0x55d3d7a25980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc22002a930 tx=0x7fc220031430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35b38073e09f37ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.301+0000 7fc21effd640 1 -- 172.21.15.37:0/3274501496 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22003e030 con 0x55d3d76594d0 2024-05-09T01:12:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.301+0000 7fc21effd640 1 -- 172.21.15.37:0/3274501496 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc220031610 con 0x55d3d76594d0 2024-05-09T01:12:27.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.301+0000 7fc21effd640 1 -- 172.21.15.37:0/3274501496 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220035040 con 0x55d3d76594d0 2024-05-09T01:12:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.302+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76594d0 msgr2=0x55d3d7a25980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.302+0000 7fc241fea740 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76594d0 0x55d3d7a25980 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc22002a930 tx=0x7fc220031430 comp rx=0 tx=0).stop 2024-05-09T01:12:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.305+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 shutdown_connections 2024-05-09T01:12:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.305+0000 7fc241fea740 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76594d0 0x55d3d7a25980 secure :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc22002a930 tx=0x7fc220031430 comp rx=0 tx=0).stop 2024-05-09T01:12:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.305+0000 7fc241fea740 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a1ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.305+0000 7fc241fea740 1 --2- 172.21.15.37:0/3274501496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d767a1b0 0x55d3d7a1e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.305+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 >> 172.21.15.37:0/3274501496 conn(0x55d3d766e300 msgr2=0x55d3d7a19e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.307+0000 7fc2395f8640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2240b29b0 0x7fc2240b4ec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55d3d7a1f6d0 tx=0x7fc22c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:27.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.308+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 shutdown_connections 2024-05-09T01:12:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.313+0000 7fc241fea740 1 -- 172.21.15.37:0/3274501496 wait complete. 2024-05-09T01:12:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.314+0000 7fc241fea740 1 -- start start 2024-05-09T01:12:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.314+0000 7fc241fea740 1 Processor -- start 2024-05-09T01:12:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.315+0000 7fc241fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d76512f0 0x55d3d7a30bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.315+0000 7fc241fea740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a31110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.315+0000 7fc241fea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d7638d80 0x55d3d7a38070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.315+0000 7fc241fea740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d3d7a26370 con 0x55d3d7638d80 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.315+0000 7fc241fea740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d3d79099c0 con 0x55d3d767a1b0 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.315+0000 7fc241fea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d3d7a264f0 con 0x55d3d76512f0 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.315+0000 7fc241fea740 10 client.0 _ll_register_callbacks cb 0x55d3d7936020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.316+0000 7fc2395f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d7638d80 0x55d3d7a38070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a31110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a31110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46244/0 (socket says 172.21.15.37:46244) 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 -- 172.21.15.37:0/3487429802 learned_addr learned my addr 172.21.15.37:0/3487429802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc238df7640 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d76512f0 0x55d3d7a30bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 -- 172.21.15.37:0/3487429802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d76512f0 msgr2=0x55d3d7a30bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d76512f0 0x55d3d7a30bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 -- 172.21.15.37:0/3487429802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d7638d80 msgr2=0x55d3d7a38070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d7638d80 0x55d3d7a38070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.317+0000 7fc233fff640 1 -- 172.21.15.37:0/3487429802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3d79301f0 con 0x55d3d767a1b0 2024-05-09T01:12:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.318+0000 7fc233fff640 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a31110 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc2200057c0 tx=0x7fc22002abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa2021b01e898892 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:27.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.318+0000 7fc213fff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.318+0000 7fc213fff640 1 -- 172.21.15.37:0/3487429802 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220035070 con 0x55d3d767a1b0 2024-05-09T01:12:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.319+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc220031610 con 0x55d3d767a1b0 2024-05-09T01:12:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.319+0000 7fc213fff640 1 -- 172.21.15.37:0/3487429802 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc220031c80 con 0x55d3d767a1b0 2024-05-09T01:12:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.319+0000 7fc213fff640 1 -- 172.21.15.37:0/3487429802 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fc22003e070 con 0x55d3d767a1b0 2024-05-09T01:12:27.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.319+0000 7fc241fea740 10 client.26951 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:27.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.319+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55d3d76e5790 con 0x55d3d767a1b0 2024-05-09T01:12:27.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.319+0000 7fc213fff640 1 -- 172.21.15.37:0/3487429802 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc220031610 con 0x55d3d767a1b0 2024-05-09T01:12:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.320+0000 7fc213fff640 1 -- 172.21.15.37:0/3487429802 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fc22004c4b0 con 0x55d3d767a1b0 2024-05-09T01:12:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.320+0000 7fc241fea740 10 client.26951 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.320+0000 7fc241fea740 10 client.26951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.320+0000 7fc241fea740 20 client.26951 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.320+0000 7fc241fea740 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d760e1c0 0x55d3d7a3e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.320+0000 7fc241fea740 4 client.26951 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:27.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.320+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3d79903d0 con 0x55d3d760e1c0 2024-05-09T01:12:27.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.322+0000 7fc238df7640 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d760e1c0 0x55d3d7a3e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.334+0000 7fc213fff640 10 client.26951 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.334+0000 7fc238df7640 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d760e1c0 0x55d3d7a3e620 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c297d7fa736cb45b server_cookie=da16b9a62b954dd3 in_seq=0 out_seq=0 2024-05-09T01:12:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.335+0000 7fc213fff640 1 -- 172.21.15.37:0/3487429802 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d3d79903d0 con 0x55d3d760e1c0 2024-05-09T01:12:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.335+0000 7fc213fff640 10 client.26951 handle_command_reply: tid=0 2024-05-09T01:12:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.335+0000 7fc241fea740 1 client.26951 shutdown 2024-05-09T01:12:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 msgr2=0x55d3d7a31110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a31110 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc2200057c0 tx=0x7fc22002abc0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 shutdown_connections 2024-05-09T01:12:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d760e1c0 0x55d3d7a3e620 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d7638d80 0x55d3d7a38070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a31110 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 --2- 172.21.15.37:0/3487429802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d76512f0 0x55d3d7a30bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 >> 172.21.15.37:0/3487429802 conn(0x55d3d766e300 msgr2=0x55d3d7a1cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.336+0000 7fc213fff640 0 client.26951 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.338+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 shutdown_connections 2024-05-09T01:12:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.338+0000 7fc241fea740 1 -- 172.21.15.37:0/3487429802 wait complete. 2024-05-09T01:12:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.338+0000 7fc241fea740 20 client.26951 trim_cache size 0 max 16384 2024-05-09T01:12:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.375+0000 7fc241fea740 1 Processor -- start 2024-05-09T01:12:27.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.375+0000 7fc241fea740 1 -- start start 2024-05-09T01:12:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.375+0000 7fc241fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a227e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.375+0000 7fc241fea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a22d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc238df7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a227e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc238df7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a227e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48620/0 (socket says 172.21.15.37:48620) 2024-05-09T01:12:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc238df7640 1 -- 172.21.15.37:0/2608921679 learned_addr learned my addr 172.21.15.37:0/2608921679 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc241fea740 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a38030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc21800e320 con 0x55d3d76512f0 2024-05-09T01:12:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc21800fe60 con 0x55d3d767a1b0 2024-05-09T01:12:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc21800e9f0 con 0x55d3d7638d80 2024-05-09T01:12:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.376+0000 7fc2395f8640 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a38030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.377+0000 7fc233fff640 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a22d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.377+0000 7fc2395f8640 1 -- 172.21.15.37:0/2608921679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 msgr2=0x55d3d7a227e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.377+0000 7fc2395f8640 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a227e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.377+0000 7fc2395f8640 1 -- 172.21.15.37:0/2608921679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 msgr2=0x55d3d7a22d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.377+0000 7fc2395f8640 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a22d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.377+0000 7fc2395f8640 1 -- 172.21.15.37:0/2608921679 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3d775c5f0 con 0x55d3d767a1b0 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.377+0000 7fc233fff640 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a22d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.378+0000 7fc2395f8640 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a38030 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc22c005fd0 tx=0x7fc22c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eeae6bea3fbd82c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.378+0000 7fc21e7fc640 1 -- 172.21.15.37:0/2608921679 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c018070 con 0x55d3d767a1b0 2024-05-09T01:12:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.378+0000 7fc21e7fc640 1 -- 172.21.15.37:0/2608921679 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc22c024030 con 0x55d3d767a1b0 2024-05-09T01:12:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.378+0000 7fc21e7fc640 1 -- 172.21.15.37:0/2608921679 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c010460 con 0x55d3d767a1b0 2024-05-09T01:12:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.379+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 msgr2=0x55d3d7a38030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.379+0000 7fc241fea740 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a38030 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc22c005fd0 tx=0x7fc22c009bd0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.380+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 shutdown_connections 2024-05-09T01:12:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.380+0000 7fc241fea740 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d767a1b0 0x55d3d7a38030 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.380+0000 7fc241fea740 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d76512f0 0x55d3d7a22d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.380+0000 7fc241fea740 1 --2- 172.21.15.37:0/2608921679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a227e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.380+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 >> 172.21.15.37:0/2608921679 conn(0x55d3d766e300 msgr2=0x55d3d7a21920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.382+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 shutdown_connections 2024-05-09T01:12:27.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.382+0000 7fc241fea740 1 -- 172.21.15.37:0/2608921679 wait complete. 2024-05-09T01:12:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.383+0000 7fc241fea740 1 -- start start 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.383+0000 7fc241fea740 1 Processor -- start 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc241fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc241fea740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76512f0 0x55d3d7a34ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc241fea740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d767a1b0 0x55d3d7a37dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc241fea740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc21800f790 con 0x55d3d767a1b0 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc241fea740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc21800f0c0 con 0x55d3d76512f0 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc241fea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc21800c300 con 0x55d3d7638d80 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc241fea740 10 client.0 _ll_register_callbacks cb 0x7fc22c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc238df7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc2395f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d767a1b0 0x55d3d7a37dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc233fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76512f0 0x55d3d7a34ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc238df7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a349a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48622/0 (socket says 172.21.15.37:48622) 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc238df7640 1 -- 172.21.15.37:0/3812080237 learned_addr learned my addr 172.21.15.37:0/3812080237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc233fff640 1 -- 172.21.15.37:0/3812080237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 msgr2=0x55d3d7a349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc233fff640 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a349a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc233fff640 1 -- 172.21.15.37:0/3812080237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d767a1b0 msgr2=0x55d3d7a37dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc233fff640 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d767a1b0 0x55d3d7a37dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.384+0000 7fc233fff640 1 -- 172.21.15.37:0/3812080237 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3d7946ed0 con 0x55d3d76512f0 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc233fff640 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76512f0 0x55d3d7a34ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc22002a930 tx=0x7fc220031430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e92c60031c04121 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc213fff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:27.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc213fff640 1 -- 172.21.15.37:0/3812080237 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220035070 con 0x55d3d76512f0 2024-05-09T01:12:27.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc213fff640 1 -- 172.21.15.37:0/3812080237 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc2200319d0 con 0x55d3d76512f0 2024-05-09T01:12:27.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc22c024030 con 0x55d3d76512f0 2024-05-09T01:12:27.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc213fff640 1 -- 172.21.15.37:0/3812080237 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fc22004c620 con 0x55d3d76512f0 2024-05-09T01:12:27.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc241fea740 10 client.26957 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:27.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.385+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55d3d7aa5050 con 0x55d3d76512f0 2024-05-09T01:12:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc213fff640 1 -- 172.21.15.37:0/3812080237 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc22c024030 con 0x55d3d76512f0 2024-05-09T01:12:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc213fff640 1 -- 172.21.15.37:0/3812080237 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fc220059070 con 0x55d3d76512f0 2024-05-09T01:12:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc241fea740 10 client.26957 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc241fea740 10 client.26957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:27.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc241fea740 20 client.26957 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc241fea740 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d7aa59a0 0x55d3d7aa7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc241fea740 4 client.26957 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:12:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.386+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d3d798a240 con 0x55d3d7aa59a0 2024-05-09T01:12:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.388+0000 7fc238df7640 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d7aa59a0 0x55d3d7aa7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.388+0000 7fc238df7640 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d7aa59a0 0x55d3d7aa7dc0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43a211f87c0ca74e server_cookie=8a4829936624d886 in_seq=0 out_seq=0 2024-05-09T01:12:27.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.388+0000 7fc213fff640 10 client.26957 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc213fff640 1 -- 172.21.15.37:0/3812080237 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55d3d798a240 con 0x55d3d7aa59a0 2024-05-09T01:12:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc213fff640 10 client.26957 handle_command_reply: tid=0 2024-05-09T01:12:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 client.26957 shutdown 2024-05-09T01:12:27.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76512f0 msgr2=0x55d3d7a34ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76512f0 0x55d3d7a34ee0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc22002a930 tx=0x7fc220031430 comp rx=0 tx=0).stop 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 shutdown_connections 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55d3d7aa59a0 0x55d3d7aa7dc0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3d767a1b0 0x55d3d7a37dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d3d76512f0 0x55d3d7a34ee0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 --2- 172.21.15.37:0/3812080237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d3d7638d80 0x55d3d7a349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.400+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 >> 172.21.15.37:0/3812080237 conn(0x55d3d766e300 msgr2=0x55d3d7a227e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc213fff640 0 client.26957 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 shutdown_connections 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc241fea740 1 -- 172.21.15.37:0/3812080237 wait complete. 2024-05-09T01:12:27.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc241fea740 20 client.26957 trim_cache size 0 max 16384 2024-05-09T01:12:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:12:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:12:27.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2240b29b0 msgr2=0x7fc2240b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc23b05b640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2240b29b0 0x7fc2240b4ec0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55d3d7a1f6d0 tx=0x7fc22c009500 comp rx=0 tx=0).stop 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234103c80 msgr2=0x7fc234076980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.401+0000 7fc23b05b640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234103c80 0x7fc234076980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc22800e9f0 tx=0x7fc22800eeb0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 shutdown_connections 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc234109bc0 0x7fc234075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234104ec0 0x7fc234075020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2240b29b0 0x7fc2240b4ec0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 --2- 172.21.15.37:0/3448481111 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc234103c80 0x7fc234076980 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:27.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 >> 172.21.15.37:0/3448481111 conn(0x7fc2340fee50 msgr2=0x7fc234105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:27.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 shutdown_connections 2024-05-09T01:12:27.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:27.402+0000 7fc23b05b640 1 -- 172.21.15.37:0/3448481111 wait complete. 2024-05-09T01:12:28.258 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:12:28.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:12:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:28 smithi136 ceph-mon[34110]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 619 op/s 2024-05-09T01:12:28.642 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:28 smithi037 ceph-mon[30122]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 619 op/s 2024-05-09T01:12:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:28 smithi151 ceph-mon[34780]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.8 MiB/s wr, 619 op/s 2024-05-09T01:12:30.234 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 610.0 s, 1799.4 tps, lat 55.298 ms stddev 60.134 2024-05-09T01:12:30.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:30 smithi037 ceph-mon[30122]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 576 op/s 2024-05-09T01:12:30.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.618+0000 7fbd126c1700 1 -- 172.21.15.37:0/3544906492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106ed0 msgr2=0x7fbd0c113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.618+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3544906492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106ed0 0x7fbd0c113360 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400b0a0 tx=0x7fbd0400b3b0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.618+0000 7fbd126c1700 1 -- 172.21.15.37:0/3544906492 shutdown_connections 2024-05-09T01:12:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.618+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3544906492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106ed0 0x7fbd0c113360 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.618+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3544906492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0c10c5c0 0x7fbd0c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.618+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3544906492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd0c106580 0x7fbd0c106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.618+0000 7fbd126c1700 1 -- 172.21.15.37:0/3544906492 >> 172.21.15.37:0/3544906492 conn(0x7fbd0c102060 msgr2=0x7fbd0c1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.619+0000 7fbd126c1700 1 -- 172.21.15.37:0/3544906492 shutdown_connections 2024-05-09T01:12:30.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.619+0000 7fbd126c1700 1 -- 172.21.15.37:0/3544906492 wait complete. 2024-05-09T01:12:30.652 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:30 smithi136 ceph-mon[34110]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 576 op/s 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 Processor -- start 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 -- start start 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106580 0x7fbd0c19d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0c106ed0 0x7fbd0c19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd0c10c5c0 0x7fbd0c1a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1166f0 con 0x7fbd0c106580 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c116570 con 0x7fbd0c10c5c0 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd126c1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c116870 con 0x7fbd0c106ed0 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106580 0x7fbd0c19d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0c106ed0 0x7fbd0c19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106580 0x7fbd0c19d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45818/0 (socket says 172.21.15.37:45818) 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd0bfff700 1 -- 172.21.15.37:0/3280741550 learned_addr learned my addr 172.21.15.37:0/3280741550 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:30.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.620+0000 7fbd10c5e700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd0c10c5c0 0x7fbd0c1a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd03fff700 1 -- 172.21.15.37:0/3280741550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd0c10c5c0 msgr2=0x7fbd0c1a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd03fff700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd0c10c5c0 0x7fbd0c1a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd03fff700 1 -- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106580 msgr2=0x7fbd0c19d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd03fff700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106580 0x7fbd0c19d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd03fff700 1 -- 172.21.15.37:0/3280741550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c1a1ed0 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd03fff700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0c106ed0 0x7fbd0c19d5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c06b4e0 tx=0x7fbcf400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd09ffb700 1 -- 172.21.15.37:0/3280741550 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4016070 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd09ffb700 1 -- 172.21.15.37:0/3280741550 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcf400fd40 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd09ffb700 1 -- 172.21.15.37:0/3280741550 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4019360 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0c1a21c0 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.621+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd0c1a9ae0 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.626+0000 7fbd09ffb700 1 -- 172.21.15.37:0/3280741550 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbcf4019070 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.627+0000 7fbd09ffb700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbcf80b2900 0x7fbcf80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.627+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbcf80b2900 0x7fbcf80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.627+0000 7fbd09ffb700 1 -- 172.21.15.37:0/3280741550 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbcf40e1c20 con 0x7fbd0c106ed0 2024-05-09T01:12:30.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.627+0000 7fbd210d7b80 1 Processor -- start 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.627+0000 7fbd210d7b80 1 -- start start 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.627+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbcf80b2900 0x7fbcf80b4e10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00bc90 tx=0x7fbcfc00b480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c561c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c561cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c5616b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5610c5539070 con 0x5610c5616720 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5610c54d7870 con 0x5610c55831e0 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5610c5535030 con 0x5610c5499520 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c561c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c561c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46300/0 (socket says 172.21.15.37:46300) 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 -- 172.21.15.37:0/3008859266 learned_addr learned my addr 172.21.15.37:0/3008859266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:30.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd03fff700 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c561cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd10c5e700 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c5616b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 -- 172.21.15.37:0/3008859266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 msgr2=0x5610c561cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c561cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 -- 172.21.15.37:0/3008859266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 msgr2=0x5610c5616b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c5616b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 -- 172.21.15.37:0/3008859266 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610c54cf3f0 con 0x5610c55831e0 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd03fff700 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c561cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd10c5e700 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c5616b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.628+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c561c570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc010fa0 tx=0x7fbcfc013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae8b9745e2ea39e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.629+0000 7fbd027fc700 1 -- 172.21.15.37:0/3008859266 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc01e620 con 0x5610c55831e0 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.629+0000 7fbd027fc700 1 -- 172.21.15.37:0/3008859266 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcfc01ec70 con 0x5610c55831e0 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.629+0000 7fbd027fc700 1 -- 172.21.15.37:0/3008859266 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc01cbb0 con 0x5610c55831e0 2024-05-09T01:12:30.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 -- 172.21.15.37:0/3008859266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 msgr2=0x5610c561c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c561c570 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc010fa0 tx=0x7fbcfc013000 comp rx=0 tx=0).stop 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 -- 172.21.15.37:0/3008859266 shutdown_connections 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c5616b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c561c570 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/3008859266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c561cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 -- 172.21.15.37:0/3008859266 >> 172.21.15.37:0/3008859266 conn(0x5610c54f9720 msgr2=0x5610c5611480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 -- 172.21.15.37:0/3008859266 shutdown_connections 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 -- 172.21.15.37:0/3008859266 wait complete. 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.630+0000 7fbd210d7b80 1 -- start start 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.631+0000 7fbd210d7b80 1 Processor -- start 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.631+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5499520 0x5610c56202e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.631+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c55831e0 0x5610c5620820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.631+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5616720 0x5610c5620d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.631+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5610c53b4c20 con 0x5610c55831e0 2024-05-09T01:12:30.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5610c54f31d0 con 0x5610c5499520 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5610c5623250 con 0x5610c5616720 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5499520 0x5610c56202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd03fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c55831e0 0x5610c5620820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5499520 0x5610c56202e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46312/0 (socket says 172.21.15.37:46312) 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 -- 172.21.15.37:0/1222751353 learned_addr learned my addr 172.21.15.37:0/1222751353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd10c5e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5616720 0x5610c5620d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd210d7b80 10 client.0 _ll_register_callbacks cb 0x5610c53aa740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 -- 172.21.15.37:0/1222751353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5616720 msgr2=0x5610c5620d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5616720 0x5610c5620d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 -- 172.21.15.37:0/1222751353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c55831e0 msgr2=0x5610c5620820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c55831e0 0x5610c5620820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.632+0000 7fbd0bfff700 1 -- 172.21.15.37:0/1222751353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610c53b4510 con 0x5610c5499520 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.633+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5499520 0x5610c56202e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc01c750 tx=0x7fbcfc01e650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eeca208a75538e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:30.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.633+0000 7fbceb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbceb7fe700 1 -- 172.21.15.37:0/1222751353 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc035060 con 0x5610c5499520 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbceb7fe700 1 -- 172.21.15.37:0/1222751353 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbcfc01ea10 con 0x5610c5499520 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcfc01ec70 con 0x5610c5499520 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbceb7fe700 1 -- 172.21.15.37:0/1222751353 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fbcfc01c460 con 0x5610c5499520 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbd210d7b80 10 client.26969 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5610c562dc10 con 0x5610c5499520 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbceb7fe700 1 -- 172.21.15.37:0/1222751353 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcfc01ec70 con 0x5610c5499520 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.634+0000 7fbceb7fe700 1 -- 172.21.15.37:0/1222751353 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fbcfc03a070 con 0x5610c5499520 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd210d7b80 10 client.26969 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd210d7b80 10 client.26969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd210d7b80 20 client.26969 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c5632550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd210d7b80 4 client.26969 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610c5546a50 con 0x5610c5630130 2024-05-09T01:12:30.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd03fff700 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c5632550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbceb7fe700 10 client.26969 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.635+0000 7fbd03fff700 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c5632550 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b343a6ff701881d server_cookie=768a421483c95943 in_seq=0 out_seq=0 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbceb7fe700 1 -- 172.21.15.37:0/1222751353 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5610c5546a50 con 0x5610c5630130 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbceb7fe700 10 client.26969 handle_command_reply: tid=0 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 client.26969 shutdown 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5499520 msgr2=0x5610c56202e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5499520 0x5610c56202e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc01c750 tx=0x7fbcfc01e650 comp rx=0 tx=0).stop 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 shutdown_connections 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c5632550 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5616720 0x5610c5620d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5499520 0x5610c56202e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbceb7fe700 0 client.26969 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.636+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1222751353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c55831e0 0x5610c5620820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.637+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 >> 172.21.15.37:0/1222751353 conn(0x5610c54f9720 msgr2=0x5610c5611240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:30.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.637+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 shutdown_connections 2024-05-09T01:12:30.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.637+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1222751353 wait complete. 2024-05-09T01:12:30.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.637+0000 7fbd210d7b80 20 client.26969 trim_cache size 0 max 16384 2024-05-09T01:12:30.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.682+0000 7fbd210d7b80 1 Processor -- start 2024-05-09T01:12:30.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.686+0000 7fbd210d7b80 1 -- start start 2024-05-09T01:12:30.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.686+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c5615d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.686+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c5620cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.687+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c561a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.687+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b0da0 con 0x5610c5616720 2024-05-09T01:12:30.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.687+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b28e0 con 0x5610c55831e0 2024-05-09T01:12:30.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.687+0000 7fbd210d7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b1470 con 0x5610c5499520 2024-05-09T01:12:30.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.689+0000 7fbd10c5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c561a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.689+0000 7fbd10c5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c561a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45836/0 (socket says 172.21.15.37:45836) 2024-05-09T01:12:30.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.689+0000 7fbd10c5e700 1 -- 172.21.15.37:0/1008250664 learned_addr learned my addr 172.21.15.37:0/1008250664 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:30.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.689+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c5615d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.693+0000 7fbd03fff700 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c5620cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.695+0000 7fbd10c5e700 1 -- 172.21.15.37:0/1008250664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 msgr2=0x5610c5615d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.695+0000 7fbd10c5e700 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c5615d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.695+0000 7fbd10c5e700 1 -- 172.21.15.37:0/1008250664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 msgr2=0x5610c5620cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.695+0000 7fbd10c5e700 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c5620cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.695+0000 7fbd10c5e700 1 -- 172.21.15.37:0/1008250664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610c560afe0 con 0x5610c5616720 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.696+0000 7fbd10c5e700 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c561a590 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400b0a0 tx=0x7fbd04009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2309033bbd7c389 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.697+0000 7fbd01ffb700 1 -- 172.21.15.37:0/1008250664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd04003a00 con 0x5610c5616720 2024-05-09T01:12:30.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.697+0000 7fbd01ffb700 1 -- 172.21.15.37:0/1008250664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd04003ba0 con 0x5610c5616720 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.697+0000 7fbd01ffb700 1 -- 172.21.15.37:0/1008250664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd040052a0 con 0x5610c5616720 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.699+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1008250664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 msgr2=0x5610c561a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.699+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c561a590 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400b0a0 tx=0x7fbd04009180 comp rx=0 tx=0).stop 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.699+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1008250664 shutdown_connections 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.699+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5616720 0x5610c561a590 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.699+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c5499520 0x5610c5615d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.699+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/1008250664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c55831e0 0x5610c5620cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.699+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1008250664 >> 172.21.15.37:0/1008250664 conn(0x5610c54f9720 msgr2=0x5610c5619e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:30.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.703+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1008250664 shutdown_connections 2024-05-09T01:12:30.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.703+0000 7fbd210d7b80 1 -- 172.21.15.37:0/1008250664 wait complete. 2024-05-09T01:12:30.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.704+0000 7fbd210d7b80 1 -- start start 2024-05-09T01:12:30.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.704+0000 7fbd210d7b80 1 Processor -- start 2024-05-09T01:12:30.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.705+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5499520 0x5610c56358c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.705+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c55831e0 0x5610c5633c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.706+0000 7fbd210d7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5616720 0x5610c5634190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.706+0000 7fbd03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c55831e0 0x5610c5633c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.706+0000 7fbd03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c55831e0 0x5610c5633c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48674/0 (socket says 172.21.15.37:48674) 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.706+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5499520 0x5610c56358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.706+0000 7fbd0bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5499520 0x5610c56358c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45844/0 (socket says 172.21.15.37:45844) 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.708+0000 7fbd10c5e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5616720 0x5610c5634190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.709+0000 7fbd10c5e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5616720 0x5610c5634190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46322/0 (socket says 172.21.15.37:46322) 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.709+0000 7fbd03fff700 1 -- 172.21.15.37:0/2725206079 learned_addr learned my addr 172.21.15.37:0/2725206079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.709+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b2210 con 0x5610c5499520 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.709+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1b1b40 con 0x5610c5616720 2024-05-09T01:12:30.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.709+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbd0c1aedc0 con 0x5610c55831e0 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.709+0000 7fbd210d7b80 10 client.0 _ll_register_callbacks cb 0x5610c53aa740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd03fff700 1 -- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5616720 msgr2=0x5610c5634190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd03fff700 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5616720 0x5610c5634190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd03fff700 1 -- 172.21.15.37:0/2725206079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5499520 msgr2=0x5610c56358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd03fff700 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5499520 0x5610c56358c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd03fff700 1 -- 172.21.15.37:0/2725206079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610c5634750 con 0x5610c55831e0 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd10c5e700 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5616720 0x5610c5634190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd03fff700 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c55831e0 0x5610c5633c50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40910b0 tx=0x7fbcf4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e59a8ac273d7556 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.710+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd04003ba0 con 0x5610c55831e0 2024-05-09T01:12:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.714+0000 7fbceb7fe700 10 client.26938 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.714+0000 7fbceb7fe700 1 -- 172.21.15.37:0/2725206079 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4020040 con 0x5610c55831e0 2024-05-09T01:12:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.714+0000 7fbceb7fe700 1 -- 172.21.15.37:0/2725206079 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbcf40ad380 con 0x5610c55831e0 2024-05-09T01:12:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.714+0000 7fbceb7fe700 1 -- 172.21.15.37:0/2725206079 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fbcf406bbe0 con 0x5610c55831e0 2024-05-09T01:12:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.717+0000 7fbd210d7b80 10 client.26938 fetch_fsmap learned FSMap version 43 2024-05-09T01:12:30.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.717+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=43}) -- 0x5610c569b300 con 0x5610c55831e0 2024-05-09T01:12:30.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.718+0000 7fbceb7fe700 1 -- 172.21.15.37:0/2725206079 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 43) ==== 8354+0+0 (secure 0 0 0) 0x7fbcf40a94a0 con 0x5610c55831e0 2024-05-09T01:12:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.718+0000 7fbd210d7b80 10 client.26938 fetch_fsmap finished waiting for FSMap version 43 2024-05-09T01:12:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.718+0000 7fbd210d7b80 10 client.26938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.719+0000 7fbd210d7b80 20 client.26938 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.719+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c569d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.719+0000 7fbd210d7b80 4 client.26938 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:12:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.719+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fbd04003ba0 con 0x5610c5630130 2024-05-09T01:12:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.719+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c569d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.719+0000 7fbd0bfff700 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c569d8a0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc18682e5c60b712 server_cookie=d79c44c74a6165d2 in_seq=0 out_seq=0 2024-05-09T01:12:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.719+0000 7fbceb7fe700 10 client.26938 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.722+0000 7fbceb7fe700 1 -- 172.21.15.37:0/2725206079 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fbd04003ba0 con 0x5610c5630130 2024-05-09T01:12:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.722+0000 7fbceb7fe700 10 client.26938 handle_command_reply: tid=0 2024-05-09T01:12:30.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.722+0000 7fbd210d7b80 1 client.26938 shutdown 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c55831e0 msgr2=0x5610c5633c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c55831e0 0x5610c5633c50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40910b0 tx=0x7fbcf4000bc0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 shutdown_connections 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5610c5630130 0x5610c569d8a0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5610c5616720 0x5610c5634190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5610c5499520 0x5610c56358c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 --2- 172.21.15.37:0/2725206079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610c55831e0 0x5610c5633c50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 >> 172.21.15.37:0/2725206079 conn(0x5610c54f9720 msgr2=0x5610c5620a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbceb7fe700 0 client.26938 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.723+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 shutdown_connections 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.724+0000 7fbd210d7b80 1 -- 172.21.15.37:0/2725206079 wait complete. 2024-05-09T01:12:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.724+0000 7fbd210d7b80 20 client.26938 trim_cache size 0 max 16384 2024-05-09T01:12:30.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:30 smithi151 ceph-mon[34780]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 576 op/s 2024-05-09T01:12:30.726 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:12:30.726 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:12:30.726 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "4db9bc36-f6af-43d9-b65f-cd24f8ebc32a", 2024-05-09T01:12:30.726 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:12:30.726 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:12:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbcf80b2900 msgr2=0x7fbcf80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbcf80b2900 0x7fbcf80b4e10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00bc90 tx=0x7fbcfc00b480 comp rx=0 tx=0).stop 2024-05-09T01:12:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0c106ed0 msgr2=0x7fbd0c19d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0c106ed0 0x7fbd0c19d5a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c06b4e0 tx=0x7fbcf400dc30 comp rx=0 tx=0).stop 2024-05-09T01:12:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 shutdown_connections 2024-05-09T01:12:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbcf80b2900 0x7fbcf80b4e10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbd0c10c5c0 0x7fbd0c1a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd0c106580 0x7fbd0c19d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 --2- 172.21.15.37:0/3280741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0c106ed0 0x7fbd0c19d5a0 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c06b4e0 tx=0x7fbcf400dc30 comp rx=0 tx=0).stop 2024-05-09T01:12:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.725+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 >> 172.21.15.37:0/3280741550 conn(0x7fbd0c102060 msgr2=0x7fbd0c1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.726+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 shutdown_connections 2024-05-09T01:12:30.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:30.726+0000 7fbd126c1700 1 -- 172.21.15.37:0/3280741550 wait complete. 2024-05-09T01:12:31.128 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:12:30 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:12:30.752+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001a [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact/ auth{1=1,2=1,3=1,4=1} v1035 ap=2 f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0) n(v6 rc2024-05-09T01:11:07.336413+0000 b401408 3=2+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@11} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8323600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001a:[<0x10000000006/pg_xact v414>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000001a:[<0x10000000006/pg_xact v1035>,<0x10000000005/data v688>,<0x100000001fb/postgres v390>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v416>,<0x10000000001/sv_1 v431>,<0x10000000000/qa v421>,<0x1/volumes v401>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:02:06.872458+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:11:07.336413+0000 b401408 3=2+1)","memory_value.dirstat":"f(v1 m2024-05-09T01:07:12.322439+0000 2=2+0)","memory_value.rstat":"n(v6 rc2024-05-09T01:11:07.336413+0000 b401408 3=2+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:12:31.128 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:12:30 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:12:30.758+0000 7f55271d5700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000000f [...2,head] /volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans/ auth{1=1,2=1,3=1,4=1} v1018 ap=2 f(v27 m2024-05-09T01:12:02.281721+0000 1=1+0) n(v31 rc2024-05-09T01:12:02.281721+0000 2=1+1) (inest sync->mix g=1,2,3,4) caps={24910=pAsLsXsFs/pAsLsXsFsx@58} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x5556c8371600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v316>,<0x10000000005/data v115>,<0x100000001fb/postgres v19>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v33>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v38>,<0x1/volumes v36>]//[]","memoryvalue":"(2)0x1000000000f:[<0x10000000006/pg_subtrans v1018>,<0x10000000005/data v688>,<0x100000001fb/postgres v390>,<0x100000001fa/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1 v416>,<0x10000000001/sv_1 v431>,<0x10000000000/qa v421>,<0x1/volumes v401>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-09T01:12:02.174722+0000 9=9+0)","ondisk_value.rstat":"n(v0 rc2024-05-09T01:12:02.281721+0000 2=1+1)","memory_value.dirstat":"f(v27 m2024-05-09T01:12:02.281721+0000 1=1+0)","memory_value.rstat":"n(v31 rc2024-05-09T01:12:02.281721+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-09T01:12:31.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:12:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:31 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:31.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:31.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:31 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.727 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.728 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:31 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:31.781 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:12:32.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:12:32.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:32.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:12:32.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:12:32.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:12:32.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:32 smithi037 ceph-mon[30122]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:32 smithi151 ceph-mon[34780]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000001a (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_xact) see mds.b log and `damage ls` output for details 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:12:32.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:32 smithi136 ceph-mon[34110]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.9 MiB/s wr, 651 op/s 2024-05-09T01:12:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 -- 172.21.15.37:0/3299918044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658108740 msgr2=0x7f96581100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 --2- 172.21.15.37:0/3299918044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658108740 0x7f96581100a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f965000d240 tx=0x7f965000d550 comp rx=0 tx=0).stop 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 -- 172.21.15.37:0/3299918044 shutdown_connections 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 --2- 172.21.15.37:0/3299918044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658108740 0x7f96581100a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 --2- 172.21.15.37:0/3299918044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96581034c0 0x7f96581038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 --2- 172.21.15.37:0/3299918044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9658107df0 0x7f9658108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 -- 172.21.15.37:0/3299918044 >> 172.21.15.37:0/3299918044 conn(0x7f96580fedc0 msgr2=0x7f96581011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 -- 172.21.15.37:0/3299918044 shutdown_connections 2024-05-09T01:12:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.715+0000 7f965fa76700 1 -- 172.21.15.37:0/3299918044 wait complete. 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965fa76700 1 Processor -- start 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965fa76700 1 -- start start 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965fa76700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96581034c0 0x7f965819e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965fa76700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658107df0 0x7f965819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965fa76700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9658108740 0x7f96581989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965d812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96581034c0 0x7f965819e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965d812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96581034c0 0x7f965819e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52474/0 (socket says 172.21.15.37:52474) 2024-05-09T01:12:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965d011700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658107df0 0x7f965819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.717+0000 7f965d011700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658107df0 0x7f965819ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34226/0 (socket says 172.21.15.37:34226) 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965d812700 1 -- 172.21.15.37:0/3311774751 learned_addr learned my addr 172.21.15.37:0/3311774751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965e013700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9658108740 0x7f96581989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96581122d0 con 0x7f96581034c0 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9658112150 con 0x7f9658108740 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9658112450 con 0x7f9658107df0 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965e013700 1 -- 172.21.15.37:0/3311774751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658107df0 msgr2=0x7f965819ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965e013700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658107df0 0x7f965819ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965e013700 1 -- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96581034c0 msgr2=0x7f965819e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965e013700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96581034c0 0x7f965819e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965e013700 1 -- 172.21.15.37:0/3311774751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658199080 con 0x7f9658108740 2024-05-09T01:12:33.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.718+0000 7f965d812700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96581034c0 0x7f965819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.719+0000 7f965e013700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9658108740 0x7f96581989d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f965000d8e0 tx=0x7f9650003df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.719+0000 7f964effd700 1 -- 172.21.15.37:0/3311774751 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650021030 con 0x7f9658108740 2024-05-09T01:12:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.719+0000 7f964effd700 1 -- 172.21.15.37:0/3311774751 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96500099e0 con 0x7f9658108740 2024-05-09T01:12:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.719+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9658199310 con 0x7f9658108740 2024-05-09T01:12:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.719+0000 7f964effd700 1 -- 172.21.15.37:0/3311774751 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650005a60 con 0x7f9658108740 2024-05-09T01:12:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.719+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9658199730 con 0x7f9658108740 2024-05-09T01:12:33.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.722+0000 7f964effd700 1 -- 172.21.15.37:0/3311774751 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9650024030 con 0x7f9658108740 2024-05-09T01:12:33.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.723+0000 7f964effd700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96440b2880 0x7f96440b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.723+0000 7f964effd700 1 -- 172.21.15.37:0/3311774751 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9650011020 con 0x7f9658108740 2024-05-09T01:12:33.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.723+0000 7f965d812700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96440b2880 0x7f96440b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.724+0000 7f965d812700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96440b2880 0x7f96440b4d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9654009750 tx=0x7f9654009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.724+0000 7f966e48cb80 1 Processor -- start 2024-05-09T01:12:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.724+0000 7f966e48cb80 1 -- start start 2024-05-09T01:12:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ebf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f966e48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559413de20a0 con 0x559413d424a0 2024-05-09T01:12:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f966e48cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559413d879a0 con 0x559413dbcd00 2024-05-09T01:12:33.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f966e48cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559413dde060 con 0x559413ebf400 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33566/0 (socket says 172.21.15.37:33566) 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 -- 172.21.15.37:0/326052004 learned_addr learned my addr 172.21.15.37:0/326052004 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d011700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965e013700 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ebf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 -- 172.21.15.37:0/326052004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 msgr2=0x559413ebf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ebf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 -- 172.21.15.37:0/326052004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 msgr2=0x559413ec5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 -- 172.21.15.37:0/326052004 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559413d78500 con 0x559413dbcd00 2024-05-09T01:12:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d011700 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.725+0000 7f965d812700 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec5240 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f965401c6f0 tx=0x7f9654014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79af0fd0c1b44a7a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.726+0000 7f9643fff700 1 -- 172.21.15.37:0/326052004 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965401c250 con 0x559413dbcd00 2024-05-09T01:12:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.726+0000 7f9643fff700 1 -- 172.21.15.37:0/326052004 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f965401b8b0 con 0x559413dbcd00 2024-05-09T01:12:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.726+0000 7f9643fff700 1 -- 172.21.15.37:0/326052004 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540267e0 con 0x559413dbcd00 2024-05-09T01:12:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 -- 172.21.15.37:0/326052004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 msgr2=0x559413ec5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec5240 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f965401c6f0 tx=0x7f9654014000 comp rx=0 tx=0).stop 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 -- 172.21.15.37:0/326052004 shutdown_connections 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ebf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec5240 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 --2- 172.21.15.37:0/326052004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 -- 172.21.15.37:0/326052004 >> 172.21.15.37:0/326052004 conn(0x559413d45f70 msgr2=0x559413eba220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 -- 172.21.15.37:0/326052004 shutdown_connections 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 -- 172.21.15.37:0/326052004 wait complete. 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 -- start start 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.727+0000 7f966e48cb80 1 Processor -- start 2024-05-09T01:12:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ec9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f966e48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559413ec0160 con 0x559413d424a0 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f966e48cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559413d7cb20 con 0x559413dbcd00 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f966e48cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559413ecc020 con 0x559413ebf400 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f966e48cb80 10 client.0 _ll_register_callbacks cb 0x559413c536c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f965d812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f965d011700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f965d812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52494/0 (socket says 172.21.15.37:52494) 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f965d011700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33582/0 (socket says 172.21.15.37:33582) 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f965d812700 1 -- 172.21.15.37:0/1673213918 learned_addr learned my addr 172.21.15.37:0/1673213918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.728+0000 7f965e013700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ec9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965d011700 1 -- 172.21.15.37:0/1673213918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 msgr2=0x559413ec9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965d011700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ec9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965d011700 1 -- 172.21.15.37:0/1673213918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 msgr2=0x559413ec9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965d011700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965d011700 1 -- 172.21.15.37:0/1673213918 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559413c5d490 con 0x559413dbcd00 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965e013700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ec9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965d812700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f965d011700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec95c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x559413ebbc90 tx=0x7f9648015db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a817d578c92b0b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f96417fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f96417fa700 1 -- 172.21.15.37:0/1673213918 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648004300 con 0x559413dbcd00 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f96417fa700 1 -- 172.21.15.37:0/1673213918 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f96480044a0 con 0x559413dbcd00 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.729+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f965401b8b0 con 0x559413dbcd00 2024-05-09T01:12:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f96417fa700 1 -- 172.21.15.37:0/1673213918 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9648004830 con 0x559413dbcd00 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 10 client.26987 fetch_fsmap learned FSMap version 44 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559413ed6860 con 0x559413dbcd00 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f96417fa700 1 -- 172.21.15.37:0/1673213918 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f965401b8b0 con 0x559413dbcd00 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f96417fa700 1 -- 172.21.15.37:0/1673213918 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 44) ==== 8358+0+0 (secure 0 0 0) 0x7f964801d030 con 0x559413dbcd00 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 10 client.26987 fetch_fsmap finished waiting for FSMap version 44 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 10 client.26987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 20 client.26987 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413ed8f90 0x559413edb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 4 client.26987 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559413defa80 con 0x559413ed8f90 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.730+0000 7f965d812700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413ed8f90 0x559413edb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.731+0000 7f96417fa700 10 client.26987 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.731+0000 7f965d812700 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413ed8f90 0x559413edb3b0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e84dc6fef36c1fc server_cookie=2c9cf8493870e50 in_seq=0 out_seq=0 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f96417fa700 1 -- 172.21.15.37:0/1673213918 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559413defa80 con 0x559413ed8f90 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f96417fa700 10 client.26987 handle_command_reply: tid=0 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 client.26987 shutdown 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 msgr2=0x559413ec95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec95c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x559413ebbc90 tx=0x7f9648015db0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 shutdown_connections 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413ed8f90 0x559413edb3b0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ec9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f96417fa700 0 client.26987 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ec9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1673213918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ec95c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 >> 172.21.15.37:0/1673213918 conn(0x559413d45f70 msgr2=0x559413eb3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 shutdown_connections 2024-05-09T01:12:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.732+0000 7f966e48cb80 1 -- 172.21.15.37:0/1673213918 wait complete. 2024-05-09T01:12:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.733+0000 7f966e48cb80 20 client.26987 trim_cache size 0 max 16384 2024-05-09T01:12:33.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.758+0000 7f966e48cb80 1 Processor -- start 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.758+0000 7f966e48cb80 1 -- start start 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.758+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413d424a0 0x559413eb4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.758+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ed4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413ebf400 0x559413ed53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f966e48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96581ac830 con 0x559413ebf400 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f966e48cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96581ae3a0 con 0x559413dbcd00 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f966e48cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96581acf00 con 0x559413d424a0 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f965d011700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ed4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f965d011700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ed4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33596/0 (socket says 172.21.15.37:33596) 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f965d011700 1 -- 172.21.15.37:0/2743462063 learned_addr learned my addr 172.21.15.37:0/2743462063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.759+0000 7f965d812700 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413d424a0 0x559413eb4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f965d011700 1 -- 172.21.15.37:0/2743462063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413d424a0 msgr2=0x559413eb4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f965d011700 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413d424a0 0x559413eb4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f965d011700 1 -- 172.21.15.37:0/2743462063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413ebf400 msgr2=0x559413ed53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f965d011700 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413ebf400 0x559413ed53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f965d011700 1 -- 172.21.15.37:0/2743462063 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559413ec8e50 con 0x559413dbcd00 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f965d011700 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ed4e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9648003dc0 tx=0x7f964801e600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9451627a04ed48f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f96437fe700 1 -- 172.21.15.37:0/2743462063 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648036070 con 0x559413dbcd00 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f96437fe700 1 -- 172.21.15.37:0/2743462063 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9648003680 con 0x559413dbcd00 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.760+0000 7f96437fe700 1 -- 172.21.15.37:0/2743462063 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964802d040 con 0x559413dbcd00 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 -- 172.21.15.37:0/2743462063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 msgr2=0x559413ed4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ed4e60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9648003dc0 tx=0x7f964801e600 comp rx=0 tx=0).stop 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 -- 172.21.15.37:0/2743462063 shutdown_connections 2024-05-09T01:12:33.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413ebf400 0x559413ed53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413d424a0 0x559413eb4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 --2- 172.21.15.37:0/2743462063 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ed4e60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 -- 172.21.15.37:0/2743462063 >> 172.21.15.37:0/2743462063 conn(0x559413d45f70 msgr2=0x559413ec7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 -- 172.21.15.37:0/2743462063 shutdown_connections 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.761+0000 7f966e48cb80 1 -- 172.21.15.37:0/2743462063 wait complete. 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 -- start start 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 Processor -- start 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ed1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ee0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ee06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96581adca0 con 0x559413d424a0 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96581ad5d0 con 0x559413dbcd00 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96581aa7f0 con 0x559413ebf400 2024-05-09T01:12:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f966e48cb80 10 client.0 _ll_register_callbacks cb 0x559413c536c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.762+0000 7f965d812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ed1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ed1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52516/0 (socket says 172.21.15.37:52516) 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d812700 1 -- 172.21.15.37:0/1117185183 learned_addr learned my addr 172.21.15.37:0/1117185183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d011700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ee0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965e013700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ee06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d011700 1 -- 172.21.15.37:0/1117185183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 msgr2=0x559413ee06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d011700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ee06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d011700 1 -- 172.21.15.37:0/1117185183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 msgr2=0x559413ed1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d011700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ed1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d011700 1 -- 172.21.15.37:0/1117185183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559413ee0be0 con 0x559413dbcd00 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965e013700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ee06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f965d011700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ee0160 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9648034040 tx=0x7f9648004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed29b558e5debc22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f96417fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:12:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f96417fa700 1 -- 172.21.15.37:0/1117185183 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964803f060 con 0x559413dbcd00 2024-05-09T01:12:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f96417fa700 1 -- 172.21.15.37:0/1117185183 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9648003830 con 0x559413dbcd00 2024-05-09T01:12:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.763+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9648003680 con 0x559413dbcd00 2024-05-09T01:12:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f96417fa700 1 -- 172.21.15.37:0/1117185183 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9648036040 con 0x559413dbcd00 2024-05-09T01:12:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 10 client.26993 fetch_fsmap learned FSMap version 44 2024-05-09T01:12:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x559413f43420 con 0x559413dbcd00 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f96417fa700 1 -- 172.21.15.37:0/1117185183 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9648003680 con 0x559413dbcd00 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f96417fa700 1 -- 172.21.15.37:0/1117185183 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 44) ==== 8358+0+0 (secure 0 0 0) 0x7f9648044070 con 0x559413dbcd00 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 10 client.26993 fetch_fsmap finished waiting for FSMap version 44 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 10 client.26993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 20 client.26993 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413f43ac0 0x559413f45ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 4 client.26993 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.764+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559413de9b20 con 0x559413f43ac0 2024-05-09T01:12:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.765+0000 7f965d812700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413f43ac0 0x559413f45ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.766+0000 7f965d812700 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413f43ac0 0x559413f45ee0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1401749d8718a433 server_cookie=aeac9fa5d39ad859 in_seq=0 out_seq=0 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.766+0000 7f96417fa700 10 client.26993 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.766+0000 7f96417fa700 1 -- 172.21.15.37:0/1117185183 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559413de9b20 con 0x559413f43ac0 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.766+0000 7f96417fa700 10 client.26993 handle_command_reply: tid=0 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.766+0000 7f966e48cb80 1 client.26993 shutdown 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 msgr2=0x559413ee0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ee0160 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9648034040 tx=0x7f9648004790 comp rx=0 tx=0).stop 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 shutdown_connections 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559413f43ac0 0x559413f45ee0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f96417fa700 0 client.26993 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559413ebf400 0x559413ee06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559413d424a0 0x559413ed1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 --2- 172.21.15.37:0/1117185183 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559413dbcd00 0x559413ee0160 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 >> 172.21.15.37:0/1117185183 conn(0x559413d45f70 msgr2=0x559413ebe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 shutdown_connections 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 1 -- 172.21.15.37:0/1117185183 wait complete. 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.767+0000 7f966e48cb80 20 client.26993 trim_cache size 0 max 16384 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout: "4db9bc36-f6af-43d9-b65f-cd24f8ebc32a": { 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "4db9bc36-f6af-43d9-b65f-cd24f8ebc32a", 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:12:33.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:12:33.774 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:12:33.774 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:12:33.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96440b2880 msgr2=0x7f96440b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96440b2880 0x7f96440b4d90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9654009750 tx=0x7f9654009310 comp rx=0 tx=0).stop 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9658108740 msgr2=0x7f96581989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9658108740 0x7f96581989d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f965000d8e0 tx=0x7f9650003df0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 shutdown_connections 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96440b2880 0x7f96440b4d90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9658108740 0x7f96581989d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96581034c0 0x7f965819e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 --2- 172.21.15.37:0/3311774751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9658107df0 0x7f965819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 >> 172.21.15.37:0/3311774751 conn(0x7f96580fedc0 msgr2=0x7f96581096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 shutdown_connections 2024-05-09T01:12:33.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:12:33.768+0000 7f965fa76700 1 -- 172.21.15.37:0/3311774751 wait complete. 2024-05-09T01:12:34.499 INFO:tasks.cephfs.filesystem:scrub status for tag:4db9bc36-f6af-43d9-b65f-cd24f8ebc32a - {'path': '/', 'tag': '4db9bc36-f6af-43d9-b65f-cd24f8ebc32a', 'options': 'recursive,force'} 2024-05-09T01:12:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:34 smithi136 ceph-mon[34110]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.2 MiB/s wr, 649 op/s 2024-05-09T01:12:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:34 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:34 smithi037 ceph-mon[30122]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.2 MiB/s wr, 649 op/s 2024-05-09T01:12:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:34 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:34 smithi151 ceph-mon[34780]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.2 MiB/s wr, 649 op/s 2024-05-09T01:12:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:34 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 615.0 s, 1488.2 tps, lat 67.121 ms stddev 80.560 2024-05-09T01:12:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:36 smithi136 ceph-mon[34110]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 8.3 MiB/s wr, 729 op/s 2024-05-09T01:12:36.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:36 smithi037 ceph-mon[30122]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 8.3 MiB/s wr, 729 op/s 2024-05-09T01:12:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:36 smithi151 ceph-mon[34780]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 8.3 MiB/s wr, 729 op/s 2024-05-09T01:12:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:38 smithi136 ceph-mon[34110]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 7.7 MiB/s wr, 749 op/s 2024-05-09T01:12:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:38 smithi151 ceph-mon[34780]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 7.7 MiB/s wr, 749 op/s 2024-05-09T01:12:38.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:38 smithi037 ceph-mon[30122]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 7.7 MiB/s wr, 749 op/s 2024-05-09T01:12:39.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:39 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:39.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:39 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:39 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:12:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 620.0 s, 1710.6 tps, lat 59.003 ms stddev 74.068 2024-05-09T01:12:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.564+0000 7f7152408640 1 -- 172.21.15.37:0/3638793241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c10b2c0 msgr2=0x7f714c10b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:40.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.564+0000 7f7152408640 1 --2- 172.21.15.37:0/3638793241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c10b2c0 0x7f714c10b6d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7148009900 tx=0x7f714802a420 comp rx=0 tx=0).stop 2024-05-09T01:12:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.564+0000 7f7152408640 1 -- 172.21.15.37:0/3638793241 shutdown_connections 2024-05-09T01:12:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.564+0000 7f7152408640 1 --2- 172.21.15.37:0/3638793241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c10ffe0 0x7f714c1103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.564+0000 7f7152408640 1 --2- 172.21.15.37:0/3638793241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c10b2c0 0x7f714c10b6d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.564+0000 7f7152408640 1 --2- 172.21.15.37:0/3638793241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10a470 0x7f714c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.564+0000 7f7152408640 1 -- 172.21.15.37:0/3638793241 >> 172.21.15.37:0/3638793241 conn(0x7f714c070460 msgr2=0x7f714c072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.565+0000 7f7152408640 1 -- 172.21.15.37:0/3638793241 shutdown_connections 2024-05-09T01:12:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.567+0000 7f7152408640 1 -- 172.21.15.37:0/3638793241 wait complete. 2024-05-09T01:12:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.567+0000 7f7152408640 1 Processor -- start 2024-05-09T01:12:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7152408640 1 -- start start 2024-05-09T01:12:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7152408640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c10a470 0x7f714c1a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7152408640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c10b2c0 0x7f714c1a9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7152408640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10ffe0 0x7f714c1b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7152408640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f714c11e420 con 0x7f714c10a470 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7152408640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f714c11e2a0 con 0x7f714c10ffe0 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7152408640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f714c11e5a0 con 0x7f714c10b2c0 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7151c07640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10ffe0 0x7f714c1b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7151c07640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10ffe0 0x7f714c1b0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33620/0 (socket says 172.21.15.37:33620) 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.568+0000 7f7151c07640 1 -- 172.21.15.37:0/2099545241 learned_addr learned my addr 172.21.15.37:0/2099545241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.569+0000 7f7151c07640 1 -- 172.21.15.37:0/2099545241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c10b2c0 msgr2=0x7f714c1a9570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.569+0000 7f7151c07640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c10b2c0 0x7f714c1a9570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.569+0000 7f7151c07640 1 -- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c10a470 msgr2=0x7f714c1a9030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.569+0000 7f7151c07640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c10a470 0x7f714c1a9030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.569+0000 7f7151c07640 1 -- 172.21.15.37:0/2099545241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c111dc0 con 0x7f714c10ffe0 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.569+0000 7f7151c07640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10ffe0 0x7f714c1b0500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f714400eaa0 tx=0x7f714400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.570+0000 7f71427fc640 1 -- 172.21.15.37:0/2099545241 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714400cdb0 con 0x7f714c10ffe0 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.570+0000 7f71427fc640 1 -- 172.21.15.37:0/2099545241 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7144005020 con 0x7f714c10ffe0 2024-05-09T01:12:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.570+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c1120b0 con 0x7f714c10ffe0 2024-05-09T01:12:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.570+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c112620 con 0x7f714c10ffe0 2024-05-09T01:12:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.570+0000 7f71427fc640 1 -- 172.21.15.37:0/2099545241 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440116b0 con 0x7f714c10ffe0 2024-05-09T01:12:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.576+0000 7f71427fc640 1 -- 172.21.15.37:0/2099545241 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7144011850 con 0x7f714c10ffe0 2024-05-09T01:12:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.577+0000 7f71427fc640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71380b29f0 0x7f71380b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.577+0000 7f71427fc640 1 -- 172.21.15.37:0/2099545241 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f71440e3330 con 0x7f714c10ffe0 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 Processor -- start 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 -- start start 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecb06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecb0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56538ec147c0 con 0x56538e8eb4d0 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56538ebb00e0 con 0x56538e90c1b0 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.579+0000 7f715a5fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56538ec10780 con 0x56538e8e32f0 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.580+0000 7f7150c05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecb0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.580+0000 7f7150c05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecb0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:34288/0 (socket says 172.21.15.37:34288) 2024-05-09T01:12:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.580+0000 7f7150c05640 1 -- 172.21.15.37:0/1306979374 learned_addr learned my addr 172.21.15.37:0/1306979374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.581+0000 7f7150c05640 1 -- 172.21.15.37:0/1306979374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 msgr2=0x56538ecb06c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:12:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.581+0000 7f7150c05640 1 --2- 172.21.15.37:0/1306979374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecb06c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.581+0000 7f7150c05640 1 -- 172.21.15.37:0/1306979374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 msgr2=0x56538ecb7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.581+0000 7f7150c05640 1 --2- 172.21.15.37:0/1306979374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.581+0000 7f7150c05640 1 -- 172.21.15.37:0/1306979374 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56538ebd97c0 con 0x56538e8e32f0 2024-05-09T01:12:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.582+0000 7f7150c05640 1 --2- 172.21.15.37:0/1306979374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecb0c40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7148031440 tx=0x7f7148005160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26ebf2d5fd78e27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.582+0000 7f71377fe640 1 -- 172.21.15.37:0/1306979374 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148060030 con 0x56538e8e32f0 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.582+0000 7f71377fe640 1 -- 172.21.15.37:0/1306979374 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71480046c0 con 0x56538e8e32f0 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.582+0000 7f71377fe640 1 -- 172.21.15.37:0/1306979374 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148035040 con 0x56538e8e32f0 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.583+0000 7f7151406640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71380b29f0 0x7f71380b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.583+0000 7f715a5fd740 1 -- 172.21.15.37:0/1306979374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 msgr2=0x56538ecb0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.583+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1306979374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecb0c40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7148031440 tx=0x7f7148005160 comp rx=0 tx=0).stop 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 -- 172.21.15.37:0/1306979374 shutdown_connections 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1306979374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1306979374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecb0c40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1306979374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecb06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 -- 172.21.15.37:0/1306979374 >> 172.21.15.37:0/1306979374 conn(0x56538e900300 msgr2=0x56538ecac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 -- 172.21.15.37:0/1306979374 shutdown_connections 2024-05-09T01:12:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 -- 172.21.15.37:0/1306979374 wait complete. 2024-05-09T01:12:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.584+0000 7f715a5fd740 1 -- start start 2024-05-09T01:12:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 1 Processor -- start 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8e32f0 0x56538ecba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8eb4d0 0x56538ecba990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56538ecb8530 con 0x56538e8e32f0 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56538eb9b9c0 con 0x56538e8eb4d0 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56538ecb86b0 con 0x56538e90c1b0 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.585+0000 7f715a5fd740 10 client.0 _ll_register_callbacks cb 0x56538ebc8020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7151c07640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7150c05640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8eb4d0 0x56538ecba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7150c05640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8eb4d0 0x56538ecba990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:33634/0 (socket says 172.21.15.37:33634) 2024-05-09T01:12:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7150c05640 1 -- 172.21.15.37:0/3086963972 learned_addr learned my addr 172.21.15.37:0/3086963972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7151c07640 1 -- 172.21.15.37:0/3086963972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8eb4d0 msgr2=0x56538ecba990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7151c07640 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8eb4d0 0x56538ecba990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7151c07640 1 -- 172.21.15.37:0/3086963972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8e32f0 msgr2=0x56538ecba450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:12:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7151c07640 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8e32f0 0x56538ecba450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.586+0000 7f7151c07640 1 -- 172.21.15.37:0/3086963972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56538ebc21f0 con 0x56538e90c1b0 2024-05-09T01:12:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.587+0000 7f7151c07640 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc18f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71440a69d0 tx=0x7f71440aa5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed1339f05e389656 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.587+0000 7f7134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.587+0000 7f7134ff9640 1 -- 172.21.15.37:0/3086963972 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440c4060 con 0x56538e90c1b0 2024-05-09T01:12:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.587+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71480046c0 con 0x56538e90c1b0 2024-05-09T01:12:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.587+0000 7f7134ff9640 1 -- 172.21.15.37:0/3086963972 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7144011b40 con 0x56538e90c1b0 2024-05-09T01:12:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.588+0000 7f7134ff9640 1 -- 172.21.15.37:0/3086963972 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f714401f040 con 0x56538e90c1b0 2024-05-09T01:12:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.588+0000 7f715a5fd740 10 client.26965 fetch_fsmap learned FSMap version 45 2024-05-09T01:12:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.588+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x56538e977790 con 0x56538e90c1b0 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f7151406640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71380b29f0 0x7f71380b4f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x56538ecb1890 tx=0x7f713c006b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f7134ff9640 1 -- 172.21.15.37:0/3086963972 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71480046c0 con 0x56538e90c1b0 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f7134ff9640 1 -- 172.21.15.37:0/3086963972 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f714400f040 con 0x56538e90c1b0 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f715a5fd740 10 client.26965 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f715a5fd740 10 client.26965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f715a5fd740 20 client.26965 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f715a5fd740 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8cad80 0x56538ecc8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f715a5fd740 4 client.26965 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.589+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56538ec223d0 con 0x56538e8cad80 2024-05-09T01:12:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.590+0000 7f7151406640 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8cad80 0x56538ecc8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.590+0000 7f7151406640 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8cad80 0x56538ecc8390 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c35cb7a4eac99bee server_cookie=c4c0b091fa111a83 in_seq=0 out_seq=0 2024-05-09T01:12:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.591+0000 7f7134ff9640 10 client.26965 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.591+0000 7f7134ff9640 1 -- 172.21.15.37:0/3086963972 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56538ec223d0 con 0x56538e8cad80 2024-05-09T01:12:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.591+0000 7f7134ff9640 10 client.26965 handle_command_reply: tid=0 2024-05-09T01:12:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.591+0000 7f715a5fd740 1 client.26965 shutdown 2024-05-09T01:12:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 msgr2=0x56538ecc18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc18f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f71440a69d0 tx=0x7f71440aa5a0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 shutdown_connections 2024-05-09T01:12:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8cad80 0x56538ecc8390 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc18f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8eb4d0 0x56538ecba990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 --2- 172.21.15.37:0/3086963972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8e32f0 0x56538ecba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 >> 172.21.15.37:0/3086963972 conn(0x56538e900300 msgr2=0x56538ecaa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.592+0000 7f7134ff9640 0 client.26965 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.593+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 shutdown_connections 2024-05-09T01:12:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.593+0000 7f715a5fd740 1 -- 172.21.15.37:0/3086963972 wait complete. 2024-05-09T01:12:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.593+0000 7f715a5fd740 20 client.26965 trim_cache size 0 max 16384 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.620+0000 7f715a5fd740 1 Processor -- start 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.620+0000 7f715a5fd740 1 -- start start 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8e32f0 0x56538ecb4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f715a5fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f713000e400 con 0x56538e8eb4d0 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f715a5fd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7130010000 con 0x56538e8e32f0 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f715a5fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f713000ead0 con 0x56538e90c1b0 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7150c05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7150c05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52538/0 (socket says 172.21.15.37:52538) 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7151406640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8e32f0 0x56538ecb4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7150c05640 1 -- 172.21.15.37:0/1921129382 learned_addr learned my addr 172.21.15.37:0/1921129382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7151c07640 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7151406640 1 -- 172.21.15.37:0/1921129382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 msgr2=0x56538ecc1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7151406640 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7151406640 1 -- 172.21.15.37:0/1921129382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 msgr2=0x56538ecb4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7151406640 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7151406640 1 -- 172.21.15.37:0/1921129382 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56538e9ee5f0 con 0x56538e8e32f0 2024-05-09T01:12:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.621+0000 7f7150c05640 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.622+0000 7f7151406640 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8e32f0 0x56538ecb4860 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f713c009fd0 tx=0x7f713c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=579591da5ae05919 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.622+0000 7f7136ffd640 1 -- 172.21.15.37:0/1921129382 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c012cf0 con 0x56538e8e32f0 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.622+0000 7f7136ffd640 1 -- 172.21.15.37:0/1921129382 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f713c0215a0 con 0x56538e8e32f0 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.622+0000 7f7136ffd640 1 -- 172.21.15.37:0/1921129382 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c01f810 con 0x56538e8e32f0 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 -- 172.21.15.37:0/1921129382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8e32f0 msgr2=0x56538ecb4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8e32f0 0x56538ecb4860 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f713c009fd0 tx=0x7f713c012000 comp rx=0 tx=0).stop 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 -- 172.21.15.37:0/1921129382 shutdown_connections 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e90c1b0 0x56538ecc1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecb4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 --2- 172.21.15.37:0/1921129382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e8e32f0 0x56538ecb4860 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 -- 172.21.15.37:0/1921129382 >> 172.21.15.37:0/1921129382 conn(0x56538e900300 msgr2=0x56538ecb8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 -- 172.21.15.37:0/1921129382 shutdown_connections 2024-05-09T01:12:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.624+0000 7f715a5fd740 1 -- 172.21.15.37:0/1921129382 wait complete. 2024-05-09T01:12:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 -- start start 2024-05-09T01:12:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 Processor -- start 2024-05-09T01:12:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecc1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecbe980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecbeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f713000f870 con 0x56538e8eb4d0 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f713000f1a0 con 0x56538e90c1b0 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f715a5fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f713000c3e0 con 0x56538e8e32f0 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f7150c05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecbe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f715a5fd740 10 client.0 _ll_register_callbacks cb 0x7f714400cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7150c05640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecbe980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52542/0 (socket says 172.21.15.37:52542) 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7150c05640 1 -- 172.21.15.37:0/709475415 learned_addr learned my addr 172.21.15.37:0/709475415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7151c07640 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecbeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.625+0000 7f7151406640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecc1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:40 smithi136 ceph-mon[34110]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.5 MiB/s wr, 730 op/s 2024-05-09T01:12:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7150c05640 1 -- 172.21.15.37:0/709475415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 msgr2=0x56538ecc1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7150c05640 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecc1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7150c05640 1 -- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 msgr2=0x56538ecbeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7150c05640 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecbeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.626+0000 7f7150c05640 1 -- 172.21.15.37:0/709475415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56538ebd8ed0 con 0x56538e8eb4d0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.627+0000 7f7151c07640 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecbeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.627+0000 7f7150c05640 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecbe980 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f71480049c0 tx=0x7f71480049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e19b1aed970999 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.627+0000 7f7134ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.628+0000 7f7134ff9640 1 -- 172.21.15.37:0/709475415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148035040 con 0x56538e8eb4d0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.628+0000 7f7134ff9640 1 -- 172.21.15.37:0/709475415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7148004dd0 con 0x56538e8eb4d0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.628+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f713c0215a0 con 0x56538e8eb4d0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.628+0000 7f7134ff9640 1 -- 172.21.15.37:0/709475415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f7148060040 con 0x56538e8eb4d0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.628+0000 7f715a5fd740 10 client.17148 fetch_fsmap learned FSMap version 45 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.628+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x56538ed2f610 con 0x56538e8eb4d0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f7134ff9640 1 -- 172.21.15.37:0/709475415 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f713c0215a0 con 0x56538e8eb4d0 2024-05-09T01:12:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f7134ff9640 1 -- 172.21.15.37:0/709475415 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f7148078030 con 0x56538e8eb4d0 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f715a5fd740 10 client.17148 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f715a5fd740 10 client.17148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f715a5fd740 20 client.17148 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f715a5fd740 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8a01c0 0x56538ed31c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f715a5fd740 4 client.17148 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56538ec1c240 con 0x56538e8a01c0 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.629+0000 7f7151406640 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8a01c0 0x56538ed31c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.631+0000 7f7151406640 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8a01c0 0x56538ed31c40 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676821dfad70db6b server_cookie=2e96fd9d3b6d5978 in_seq=0 out_seq=0 2024-05-09T01:12:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.631+0000 7f7134ff9640 10 client.17148 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.640+0000 7f7134ff9640 1 -- 172.21.15.37:0/709475415 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x56538ec1c240 con 0x56538e8a01c0 2024-05-09T01:12:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.640+0000 7f7134ff9640 10 client.17148 handle_command_reply: tid=0 2024-05-09T01:12:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.641+0000 7f715a5fd740 1 client.17148 shutdown 2024-05-09T01:12:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.641+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 msgr2=0x56538ecbe980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.641+0000 7f715a5fd740 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecbe980 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f71480049c0 tx=0x7f71480049f0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 shutdown_connections 2024-05-09T01:12:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56538e8a01c0 0x56538ed31c40 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56538e90c1b0 0x56538ecbeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f7134ff9640 0 client.17148 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56538e8eb4d0 0x56538ecbe980 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 --2- 172.21.15.37:0/709475415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56538e8e32f0 0x56538ecc1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 >> 172.21.15.37:0/709475415 conn(0x56538e900300 msgr2=0x56538ecb8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 shutdown_connections 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 1 -- 172.21.15.37:0/709475415 wait complete. 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f715a5fd740 20 client.17148 trim_cache size 0 max 16384 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:12:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71380b29f0 msgr2=0x7f71380b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f7152408640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71380b29f0 0x7f71380b4f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x56538ecb1890 tx=0x7f713c006b70 comp rx=0 tx=0).stop 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10ffe0 msgr2=0x7f714c1b0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.642+0000 7f7152408640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10ffe0 0x7f714c1b0500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f714400eaa0 tx=0x7f714400ef60 comp rx=0 tx=0).stop 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 shutdown_connections 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71380b29f0 0x7f71380b4f00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f714c10ffe0 0x7f714c1b0500 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f714c10b2c0 0x7f714c1a9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 --2- 172.21.15.37:0/2099545241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c10a470 0x7f714c1a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 >> 172.21.15.37:0/2099545241 conn(0x7f714c070460 msgr2=0x7f714c10bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 shutdown_connections 2024-05-09T01:12:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:40.643+0000 7f7152408640 1 -- 172.21.15.37:0/2099545241 wait complete. 2024-05-09T01:12:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:40 smithi037 ceph-mon[30122]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.5 MiB/s wr, 730 op/s 2024-05-09T01:12:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:40 smithi151 ceph-mon[34780]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.5 MiB/s wr, 730 op/s 2024-05-09T01:12:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:42 smithi136 ceph-mon[34110]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.4 MiB/s wr, 813 op/s 2024-05-09T01:12:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:42 smithi037 ceph-mon[30122]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.4 MiB/s wr, 813 op/s 2024-05-09T01:12:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:42 smithi151 ceph-mon[34780]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.4 MiB/s wr, 813 op/s 2024-05-09T01:12:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:12:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:12:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:12:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:12:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:43 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:12:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:12:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:12:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:12:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:12:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:43 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:12:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:12:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:12:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:12:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:12:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:43 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:12:44.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:44 smithi037 ceph-mon[30122]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 7.0 MiB/s wr, 739 op/s 2024-05-09T01:12:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:44 smithi151 ceph-mon[34780]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 7.0 MiB/s wr, 739 op/s 2024-05-09T01:12:44.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:44 smithi136 ceph-mon[34110]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 7.0 MiB/s wr, 739 op/s 2024-05-09T01:12:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 625.0 s, 1980.2 tps, lat 49.643 ms stddev 55.078 2024-05-09T01:12:46.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:46 smithi037 ceph-mon[30122]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-05-09T01:12:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:46 smithi151 ceph-mon[34780]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-05-09T01:12:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:46 smithi136 ceph-mon[34110]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 732 op/s 2024-05-09T01:12:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:48 smithi037 ceph-mon[30122]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 657 op/s 2024-05-09T01:12:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:48 smithi151 ceph-mon[34780]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 657 op/s 2024-05-09T01:12:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:48 smithi136 ceph-mon[34110]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 657 op/s 2024-05-09T01:12:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 630.0 s, 1600.0 tps, lat 63.490 ms stddev 70.879 2024-05-09T01:12:50.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:50 smithi037 ceph-mon[30122]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.8 MiB/s wr, 614 op/s 2024-05-09T01:12:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:50 smithi151 ceph-mon[34780]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.8 MiB/s wr, 614 op/s 2024-05-09T01:12:50.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:50 smithi136 ceph-mon[34110]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.8 MiB/s wr, 614 op/s 2024-05-09T01:12:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:52 smithi037 ceph-mon[30122]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 687 op/s 2024-05-09T01:12:52.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:52 smithi151 ceph-mon[34780]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 687 op/s 2024-05-09T01:12:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:52 smithi136 ceph-mon[34110]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 MiB/s wr, 687 op/s 2024-05-09T01:12:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 -- 172.21.15.37:0/1207281610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010a930 msgr2=0x7fe70010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 --2- 172.21.15.37:0/1207281610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010a930 0x7fe70010ad40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009be0 tx=0x7fe6f002a6c0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 -- 172.21.15.37:0/1207281610 shutdown_connections 2024-05-09T01:12:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 --2- 172.21.15.37:0/1207281610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70010c120 0x7fe70010c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 --2- 172.21.15.37:0/1207281610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe70010b7d0 0x7fe70010bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 --2- 172.21.15.37:0/1207281610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010a930 0x7fe70010ad40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 -- 172.21.15.37:0/1207281610 >> 172.21.15.37:0/1207281610 conn(0x7fe700070a90 msgr2=0x7fe700072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 -- 172.21.15.37:0/1207281610 shutdown_connections 2024-05-09T01:12:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.781+0000 7fe707ce0640 1 -- 172.21.15.37:0/1207281610 wait complete. 2024-05-09T01:12:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.782+0000 7fe707ce0640 1 Processor -- start 2024-05-09T01:12:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.782+0000 7fe707ce0640 1 -- start start 2024-05-09T01:12:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.782+0000 7fe707ce0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70010a930 0x7fe7001a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.782+0000 7fe707ce0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe70010b7d0 0x7fe7001a3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.782+0000 7fe707ce0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010c120 0x7fe7001aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.783+0000 7fe707ce0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe700117ff0 con 0x7fe70010b7d0 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.783+0000 7fe707ce0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe700117e70 con 0x7fe70010a930 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.783+0000 7fe707ce0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe700118170 con 0x7fe70010c120 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.783+0000 7fe70527b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe70010b7d0 0x7fe7001a3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.783+0000 7fe70527b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe70010b7d0 0x7fe7001a3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50450/0 (socket says 172.21.15.37:50450) 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.783+0000 7fe70527b640 1 -- 172.21.15.37:0/2022097383 learned_addr learned my addr 172.21.15.37:0/2022097383 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.783+0000 7fe705a7c640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70010a930 0x7fe7001a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.784+0000 7fe70627d640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010c120 0x7fe7001aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.784+0000 7fe705a7c640 1 -- 172.21.15.37:0/2022097383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010c120 msgr2=0x7fe7001aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.784+0000 7fe705a7c640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010c120 0x7fe7001aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.784+0000 7fe705a7c640 1 -- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe70010b7d0 msgr2=0x7fe7001a3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.784+0000 7fe705a7c640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe70010b7d0 0x7fe7001a3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.784+0000 7fe705a7c640 1 -- 172.21.15.37:0/2022097383 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7001aa760 con 0x7fe70010a930 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.784+0000 7fe705a7c640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70010a930 0x7fe7001a2c20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002abe0 tx=0x7fe6f0030d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.785+0000 7fe6feffd640 1 -- 172.21.15.37:0/2022097383 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0036040 con 0x7fe70010a930 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.785+0000 7fe6feffd640 1 -- 172.21.15.37:0/2022097383 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f00318f0 con 0x7fe70010a930 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.785+0000 7fe6feffd640 1 -- 172.21.15.37:0/2022097383 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f003cc00 con 0x7fe70010a930 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.785+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70010db00 con 0x7fe70010a930 2024-05-09T01:12:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.785+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70010dfa0 con 0x7fe70010a930 2024-05-09T01:12:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.789+0000 7fe6feffd640 1 -- 172.21.15.37:0/2022097383 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe6f0003c90 con 0x7fe70010a930 2024-05-09T01:12:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.789+0000 7fe70eb9a740 1 Processor -- start 2024-05-09T01:12:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.789+0000 7fe70eb9a740 1 -- start start 2024-05-09T01:12:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5589ff4277c0 con 0x5589ff0f62f0 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5589ff3c30e0 con 0x5589ff11f1b0 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5589ff423780 con 0x5589ff0fe4d0 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70627d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70627d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42220/0 (socket says 172.21.15.37:42220) 2024-05-09T01:12:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50462/0 (socket says 172.21.15.37:50462) 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70627d640 1 -- 172.21.15.37:0/701916695 learned_addr learned my addr 172.21.15.37:0/701916695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70527b640 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe6feffd640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6e80b2860 0x7fe6e80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70527b640 1 -- 172.21.15.37:0/701916695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 msgr2=0x5589ff4c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70527b640 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70627d640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6e80b2860 0x7fe6e80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70527b640 1 -- 172.21.15.37:0/701916695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 msgr2=0x5589ff4c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70527b640 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe70527b640 1 -- 172.21.15.37:0/701916695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ff3ec7c0 con 0x5589ff0fe4d0 2024-05-09T01:12:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.790+0000 7fe6feffd640 1 -- 172.21.15.37:0/2022097383 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe6f01065d0 con 0x7fe70010a930 2024-05-09T01:12:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.791+0000 7fe70527b640 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4ca980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009c80 tx=0x7fe6f4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9e5531d55d58f06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.791+0000 7fe6e7fff640 1 -- 172.21.15.37:0/701916695 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4004230 con 0x5589ff0fe4d0 2024-05-09T01:12:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.791+0000 7fe6e7fff640 1 -- 172.21.15.37:0/701916695 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f40043d0 con 0x5589ff0fe4d0 2024-05-09T01:12:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.791+0000 7fe6e7fff640 1 -- 172.21.15.37:0/701916695 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4019710 con 0x5589ff0fe4d0 2024-05-09T01:12:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.792+0000 7fe70eb9a740 1 -- 172.21.15.37:0/701916695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 msgr2=0x5589ff4ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.792+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4ca980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009c80 tx=0x7fe6f4011810 comp rx=0 tx=0).stop 2024-05-09T01:12:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.792+0000 7fe70627d640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6e80b2860 0x7fe6e80b4d70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x5589ff4c46d0 tx=0x7fe6f8004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 -- 172.21.15.37:0/701916695 shutdown_connections 2024-05-09T01:12:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4ca980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/701916695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 -- 172.21.15.37:0/701916695 >> 172.21.15.37:0/701916695 conn(0x5589ff113300 msgr2=0x5589ff4bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 -- 172.21.15.37:0/701916695 shutdown_connections 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 -- 172.21.15.37:0/701916695 wait complete. 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.793+0000 7fe70eb9a740 1 -- start start 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 1 Processor -- start 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4d4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5589ff4cb3d0 con 0x5589ff0fe4d0 2024-05-09T01:12:53.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5589ff3ae9c0 con 0x5589ff11f1b0 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5589ff4cb550 con 0x5589ff0f62f0 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.794+0000 7fe70eb9a740 10 client.0 _ll_register_callbacks cb 0x5589ff3db020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37544/0 (socket says 172.21.15.37:37544) 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 -- 172.21.15.37:0/2277125848 learned_addr learned my addr 172.21.15.37:0/2277125848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe70627d640 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4d4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe70527b640 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 -- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 msgr2=0x5589ff4d4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4d4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 -- 172.21.15.37:0/2277125848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 msgr2=0x5589ff4cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 -- 172.21.15.37:0/2277125848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ff3d51f0 con 0x5589ff0f62f0 2024-05-09T01:12:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe705a7c640 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4cd1d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0104170 tx=0x7fe6f0009900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b95ce7889f58d3ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe6e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:12:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe6e57fa640 1 -- 172.21.15.37:0/2277125848 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00cd400 con 0x5589ff0f62f0 2024-05-09T01:12:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe6e57fa640 1 -- 172.21.15.37:0/2277125848 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe6f00d6870 con 0x5589ff0f62f0 2024-05-09T01:12:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.795+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f40043d0 con 0x5589ff0f62f0 2024-05-09T01:12:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe6e57fa640 1 -- 172.21.15.37:0/2277125848 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe6f00d6430 con 0x5589ff0f62f0 2024-05-09T01:12:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 10 client.26983 fetch_fsmap learned FSMap version 45 2024-05-09T01:12:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5589ff18a790 con 0x5589ff0f62f0 2024-05-09T01:12:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe6e57fa640 1 -- 172.21.15.37:0/2277125848 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f40043d0 con 0x5589ff0f62f0 2024-05-09T01:12:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe6e57fa640 1 -- 172.21.15.37:0/2277125848 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fe6f004e020 con 0x5589ff0f62f0 2024-05-09T01:12:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 10 client.26983 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:12:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 10 client.26983 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 20 client.26983 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff0ddd80 0x5589ff4fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 4 client.26983 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:12:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589ff4353d0 con 0x5589ff0ddd80 2024-05-09T01:12:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.796+0000 7fe70527b640 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff0ddd80 0x5589ff4fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.797+0000 7fe6e57fa640 10 client.26983 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.797+0000 7fe70527b640 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff0ddd80 0x5589ff4fccb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=498cd0b1d18079d9 server_cookie=f4090b892b883d0e in_seq=0 out_seq=0 2024-05-09T01:12:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe6e57fa640 1 -- 172.21.15.37:0/2277125848 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5589ff4353d0 con 0x5589ff0ddd80 2024-05-09T01:12:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe6e57fa640 10 client.26983 handle_command_reply: tid=0 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 client.26983 shutdown 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 msgr2=0x5589ff4cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4cd1d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0104170 tx=0x7fe6f0009900 comp rx=0 tx=0).stop 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 shutdown_connections 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff0ddd80 0x5589ff4fccb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff11f1b0 0x5589ff4d4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2277125848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4cd1d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 >> 172.21.15.37:0/2277125848 conn(0x5589ff113300 msgr2=0x5589ff4c1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe6e57fa640 0 client.26983 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 shutdown_connections 2024-05-09T01:12:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2277125848 wait complete. 2024-05-09T01:12:53.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.798+0000 7fe70eb9a740 20 client.26983 trim_cache size 0 max 16384 2024-05-09T01:12:53.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.843+0000 7fe70eb9a740 1 Processor -- start 2024-05-09T01:12:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.846+0000 7fe70eb9a740 1 -- start start 2024-05-09T01:12:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.846+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.846+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4d4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.846+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.846+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe70007bca0 con 0x5589ff0fe4d0 2024-05-09T01:12:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.846+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe70007d8a0 con 0x5589ff113300 2024-05-09T01:12:53.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.846+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe70007c370 con 0x5589ff0f62f0 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.849+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.849+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42252/0 (socket says 172.21.15.37:42252) 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.849+0000 7fe705a7c640 1 -- 172.21.15.37:0/2172900594 learned_addr learned my addr 172.21.15.37:0/2172900594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.849+0000 7fe70527b640 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.850+0000 7fe70627d640 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.851+0000 7fe70527b640 1 -- 172.21.15.37:0/2172900594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 msgr2=0x5589ff4c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.851+0000 7fe70527b640 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.851+0000 7fe70527b640 1 -- 172.21.15.37:0/2172900594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 msgr2=0x5589ff4cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.851+0000 7fe70527b640 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.851+0000 7fe70527b640 1 -- 172.21.15.37:0/2172900594 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ff2015f0 con 0x5589ff0f62f0 2024-05-09T01:12:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.858+0000 7fe70527b640 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4d4600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009620 tx=0x7fe6f40040b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360ba53294e752d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.859+0000 7fe6e77fe640 1 -- 172.21.15.37:0/2172900594 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f401f040 con 0x5589ff0f62f0 2024-05-09T01:12:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.859+0000 7fe6e77fe640 1 -- 172.21.15.37:0/2172900594 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f40035f0 con 0x5589ff0f62f0 2024-05-09T01:12:53.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.859+0000 7fe6e77fe640 1 -- 172.21.15.37:0/2172900594 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f402a340 con 0x5589ff0f62f0 2024-05-09T01:12:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.862+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2172900594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 msgr2=0x5589ff4d4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.862+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4d4600 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4009620 tx=0x7fe6f40040b0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.863+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2172900594 shutdown_connections 2024-05-09T01:12:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.863+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0fe4d0 0x5589ff4cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.863+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0f62f0 0x5589ff4d4600 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.863+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/2172900594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.863+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2172900594 >> 172.21.15.37:0/2172900594 conn(0x5589ff4c6ee0 msgr2=0x5589ff4ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.863+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2172900594 shutdown_connections 2024-05-09T01:12:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.863+0000 7fe70eb9a740 1 -- 172.21.15.37:0/2172900594 wait complete. 2024-05-09T01:12:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.864+0000 7fe70eb9a740 1 -- start start 2024-05-09T01:12:53.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.864+0000 7fe70eb9a740 1 Processor -- start 2024-05-09T01:12:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.865+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.865+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4d1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.865+0000 7fe70eb9a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4d2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.866+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe70007d110 con 0x5589ff0f62f0 2024-05-09T01:12:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.866+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe70007ca40 con 0x5589ff113300 2024-05-09T01:12:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.866+0000 7fe70eb9a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe700079ca0 con 0x5589ff0fe4d0 2024-05-09T01:12:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.866+0000 7fe70eb9a740 10 client.0 _ll_register_callbacks cb 0x7fe6f00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:12:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.866+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.866+0000 7fe705a7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50484/0 (socket says 172.21.15.37:50484) 2024-05-09T01:12:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.866+0000 7fe705a7c640 1 -- 172.21.15.37:0/199864694 learned_addr learned my addr 172.21.15.37:0/199864694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:12:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.867+0000 7fe705a7c640 1 -- 172.21.15.37:0/199864694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 msgr2=0x5589ff4d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.867+0000 7fe705a7c640 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4d1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.867+0000 7fe705a7c640 1 -- 172.21.15.37:0/199864694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 msgr2=0x5589ff4d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:12:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.867+0000 7fe705a7c640 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4d2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.867+0000 7fe705a7c640 1 -- 172.21.15.37:0/199864694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ff3ebed0 con 0x5589ff0f62f0 2024-05-09T01:12:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.868+0000 7fe705a7c640 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4d1a70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00ca230 tx=0x7fe6f0031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b48cd274406f1f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:12:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.872+0000 7fe6e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:12:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.872+0000 7fe6e57fa640 1 -- 172.21.15.37:0/199864694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f00ec070 con 0x5589ff0f62f0 2024-05-09T01:12:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.872+0000 7fe6e57fa640 1 -- 172.21.15.37:0/199864694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe6f00ccef0 con 0x5589ff0f62f0 2024-05-09T01:12:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.873+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f40035f0 con 0x5589ff0f62f0 2024-05-09T01:12:53.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.875+0000 7fe6e57fa640 1 -- 172.21.15.37:0/199864694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe6f00cd400 con 0x5589ff0f62f0 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.876+0000 7fe70eb9a740 10 client.17166 fetch_fsmap learned FSMap version 45 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.876+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5589ff4d4560 con 0x5589ff0f62f0 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe6e57fa640 1 -- 172.21.15.37:0/199864694 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f00ee050 con 0x5589ff0f62f0 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe6e57fa640 1 -- 172.21.15.37:0/199864694 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fe6f004e040 con 0x5589ff0f62f0 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe70eb9a740 10 client.17166 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe70eb9a740 10 client.17166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe70eb9a740 20 client.17166 populate_metadata read hostname 'smithi037' 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff11f1b0 0x5589ff56fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe70eb9a740 4 client.17166 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fe6f40035f0 con 0x5589ff11f1b0 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.877+0000 7fe70527b640 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff11f1b0 0x5589ff56fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:12:53.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.878+0000 7fe6e57fa640 10 client.17166 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:53.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.878+0000 7fe70527b640 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff11f1b0 0x5589ff56fbc0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3846c2aa7a3c91d server_cookie=b624d34f7ec98b81 in_seq=0 out_seq=0 2024-05-09T01:12:53.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.911+0000 7fe6e57fa640 1 -- 172.21.15.37:0/199864694 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fe6f40035f0 con 0x5589ff11f1b0 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.911+0000 7fe6e57fa640 10 client.17166 handle_command_reply: tid=0 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.911+0000 7fe70eb9a740 1 client.17166 shutdown 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 msgr2=0x5589ff4d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4d1a70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe6f00ca230 tx=0x7fe6f0031860 comp rx=0 tx=0).stop 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 shutdown_connections 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589ff11f1b0 0x5589ff56fbc0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589ff113300 0x5589ff4d2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589ff0fe4d0 0x5589ff4d1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe6e57fa640 0 client.17166 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 --2- 172.21.15.37:0/199864694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589ff0f62f0 0x5589ff4d1a70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 >> 172.21.15.37:0/199864694 conn(0x5589ff4c6ee0 msgr2=0x5589ff4c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:53.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 shutdown_connections 2024-05-09T01:12:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 1 -- 172.21.15.37:0/199864694 wait complete. 2024-05-09T01:12:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.912+0000 7fe70eb9a740 20 client.17166 trim_cache size 0 max 16384 2024-05-09T01:12:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:12:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:12:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:12:53.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.913+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6e80b2860 msgr2=0x7fe6e80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.913+0000 7fe707ce0640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6e80b2860 0x7fe6e80b4d70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x5589ff4c46d0 tx=0x7fe6f8004730 comp rx=0 tx=0).stop 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.913+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70010a930 msgr2=0x7fe7001a2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.913+0000 7fe707ce0640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70010a930 0x7fe7001a2c20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe6f002abe0 tx=0x7fe6f0030d00 comp rx=0 tx=0).stop 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 shutdown_connections 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe70010c120 0x7fe7001aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe70010b7d0 0x7fe7001a3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe6e80b2860 0x7fe6e80b4d70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 --2- 172.21.15.37:0/2022097383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe70010a930 0x7fe7001a2c20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 >> 172.21.15.37:0/2022097383 conn(0x7fe700070a90 msgr2=0x7fe700111d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 shutdown_connections 2024-05-09T01:12:53.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:12:53.914+0000 7fe707ce0640 1 -- 172.21.15.37:0/2022097383 wait complete. 2024-05-09T01:12:54.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:54 smithi037 ceph-mon[30122]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 611 op/s 2024-05-09T01:12:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:54 smithi151 ceph-mon[34780]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 611 op/s 2024-05-09T01:12:54.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:54 smithi136 ceph-mon[34110]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.3 MiB/s wr, 611 op/s 2024-05-09T01:12:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 635.0 s, 2468.0 tps, lat 40.562 ms stddev 45.911 2024-05-09T01:12:56.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:56 smithi037 ceph-mon[30122]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 MiB/s wr, 684 op/s 2024-05-09T01:12:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:56 smithi151 ceph-mon[34780]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 MiB/s wr, 684 op/s 2024-05-09T01:12:56.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:56 smithi136 ceph-mon[34110]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.8 MiB/s wr, 684 op/s 2024-05-09T01:12:57.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:57 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:12:57.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:57 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:12:57.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:57 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:12:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:58 smithi037 ceph-mon[30122]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 643 op/s 2024-05-09T01:12:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:58 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:58 smithi151 ceph-mon[34780]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 643 op/s 2024-05-09T01:12:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:58 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:58 smithi136 ceph-mon[34110]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 643 op/s 2024-05-09T01:12:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:58 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:12:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:12:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:12:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:59.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:12:59.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:12:59.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:12:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:12:59.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:12:59.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:12:59.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:12:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:13:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 640.0 s, 1974.6 tps, lat 49.983 ms stddev 63.052 2024-05-09T01:13:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:00 smithi136 ceph-mon[34110]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-05-09T01:13:00.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:00 smithi037 ceph-mon[30122]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-05-09T01:13:00.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:00 smithi151 ceph-mon[34780]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 6.5 MiB/s wr, 602 op/s 2024-05-09T01:13:02.777 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:02 smithi151 ceph-mon[34780]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.6 MiB/s wr, 702 op/s 2024-05-09T01:13:02.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:02 smithi136 ceph-mon[34110]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.6 MiB/s wr, 702 op/s 2024-05-09T01:13:02.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:02 smithi037 ceph-mon[30122]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.6 MiB/s wr, 702 op/s 2024-05-09T01:13:04.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:13:04.862 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:04.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:04 smithi136 ceph-mon[34110]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.8 MiB/s wr, 638 op/s 2024-05-09T01:13:04.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:04 smithi037 ceph-mon[30122]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.8 MiB/s wr, 638 op/s 2024-05-09T01:13:04.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:04 smithi151 ceph-mon[34780]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.8 MiB/s wr, 638 op/s 2024-05-09T01:13:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 645.0 s, 1957.0 tps, lat 50.257 ms stddev 56.192 2024-05-09T01:13:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:06 smithi037 ceph-mon[30122]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 639 op/s 2024-05-09T01:13:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:06 smithi136 ceph-mon[34110]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 639 op/s 2024-05-09T01:13:06.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:06 smithi151 ceph-mon[34780]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.1 MiB/s wr, 639 op/s 2024-05-09T01:13:07.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.067+0000 7f09ef696640 1 -- 172.21.15.37:0/594411065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e81077f0 msgr2=0x7f09e8107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.067+0000 7f09ef696640 1 --2- 172.21.15.37:0/594411065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e81077f0 0x7f09e8107c00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009ca0 tx=0x7f09e002a8f0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.069+0000 7f09ef696640 1 -- 172.21.15.37:0/594411065 shutdown_connections 2024-05-09T01:13:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.069+0000 7f09ef696640 1 --2- 172.21.15.37:0/594411065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e81077f0 0x7f09e8107c00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.069+0000 7f09ef696640 1 --2- 172.21.15.37:0/594411065 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e8104e90 0x7f09e81072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.069+0000 7f09ef696640 1 --2- 172.21.15.37:0/594411065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e8102530 0x7f09e8104950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.069+0000 7f09ef696640 1 -- 172.21.15.37:0/594411065 >> 172.21.15.37:0/594411065 conn(0x7f09e80fdd40 msgr2=0x7f09e81001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.071+0000 7f09ef696640 1 -- 172.21.15.37:0/594411065 shutdown_connections 2024-05-09T01:13:07.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.071+0000 7f09ef696640 1 -- 172.21.15.37:0/594411065 wait complete. 2024-05-09T01:13:07.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.072+0000 7f09ef696640 1 Processor -- start 2024-05-09T01:13:07.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.073+0000 7f09ef696640 1 -- start start 2024-05-09T01:13:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.073+0000 7f09ef696640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e8102530 0x7f09e8071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.073+0000 7f09ef696640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e8104e90 0x7f09e8072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.073+0000 7f09ef696640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e81077f0 0x7f09e8072f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.073+0000 7f09ef696640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8115e40 con 0x7f09e81077f0 2024-05-09T01:13:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.073+0000 7f09ef696640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8115cc0 con 0x7f09e8104e90 2024-05-09T01:13:07.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.073+0000 7f09ef696640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09e8115fc0 con 0x7f09e8102530 2024-05-09T01:13:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.074+0000 7f09ed432640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e8102530 0x7f09e8071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.074+0000 7f09ed432640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e8102530 0x7f09e8071ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46224/0 (socket says 172.21.15.37:46224) 2024-05-09T01:13:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.074+0000 7f09ed432640 1 -- 172.21.15.37:0/1090043866 learned_addr learned my addr 172.21.15.37:0/1090043866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.074+0000 7f09ecc31640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e8104e90 0x7f09e8072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.075+0000 7f09ed432640 1 -- 172.21.15.37:0/1090043866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e8104e90 msgr2=0x7f09e8072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.075+0000 7f09ed432640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e8104e90 0x7f09e8072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.075+0000 7f09ed432640 1 -- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e81077f0 msgr2=0x7f09e8072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.075+0000 7f09ed432640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e81077f0 0x7f09e8072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.075+0000 7f09ed432640 1 -- 172.21.15.37:0/1090043866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e80735f0 con 0x7f09e8102530 2024-05-09T01:13:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.079+0000 7f09ed432640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e8102530 0x7f09e8071ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e9c0 tx=0x7f09e400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.081+0000 7f09de7fc640 1 -- 172.21.15.37:0/1090043866 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e400cd80 con 0x7f09e8102530 2024-05-09T01:13:07.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.081+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e80738e0 con 0x7f09e8102530 2024-05-09T01:13:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.081+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e8073e30 con 0x7f09e8102530 2024-05-09T01:13:07.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.082+0000 7f09de7fc640 1 -- 172.21.15.37:0/1090043866 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09e40054d0 con 0x7f09e8102530 2024-05-09T01:13:07.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.083+0000 7f09de7fc640 1 -- 172.21.15.37:0/1090043866 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4010430 con 0x7f09e8102530 2024-05-09T01:13:07.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.086+0000 7f09f6625740 1 Processor -- start 2024-05-09T01:13:07.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.087+0000 7f09de7fc640 1 -- 172.21.15.37:0/1090043866 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f09e4010690 con 0x7f09e8102530 2024-05-09T01:13:07.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.088+0000 7f09de7fc640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09d40b29f0 0x7f09d40b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09de7fc640 1 -- 172.21.15.37:0/1090043866 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f09e40e2670 con 0x7f09e8102530 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09f6625740 1 -- start start 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09f6625740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb21160500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09f6625740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb21160a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09f6625740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb21167980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09f6625740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bb210c47c0 con 0x55bb20d9b4d0 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09f6625740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55bb210600e0 con 0x55bb20dbc1b0 2024-05-09T01:13:07.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09f6625740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bb210c0780 con 0x55bb20d932f0 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.089+0000 7f09ecc31640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb21160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.090+0000 7f09ecc31640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb21160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46230/0 (socket says 172.21.15.37:46230) 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.090+0000 7f09ecc31640 1 -- 172.21.15.37:0/2656524430 learned_addr learned my addr 172.21.15.37:0/2656524430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.090+0000 7f09ed432640 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb21160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.090+0000 7f09ecc31640 1 -- 172.21.15.37:0/2656524430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 msgr2=0x55bb21160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.090+0000 7f09ecc31640 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb21160500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.090+0000 7f09ecc31640 1 -- 172.21.15.37:0/2656524430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 msgr2=0x55bb21167980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.091+0000 7f09ecc31640 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb21167980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.091+0000 7f09ecc31640 1 -- 172.21.15.37:0/2656524430 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb210897c0 con 0x55bb20d932f0 2024-05-09T01:13:07.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.091+0000 7f09ecc31640 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb21160a80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f09d800b7f0 tx=0x7f09d800bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40bd59a49b9c600e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.093+0000 7f09d37fe640 1 -- 172.21.15.37:0/2656524430 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d800d950 con 0x55bb20d932f0 2024-05-09T01:13:07.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.093+0000 7f09d37fe640 1 -- 172.21.15.37:0/2656524430 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d8018070 con 0x55bb20d932f0 2024-05-09T01:13:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.094+0000 7f09f6625740 1 -- 172.21.15.37:0/2656524430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 msgr2=0x55bb21160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.094+0000 7f09f6625740 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb21160a80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f09d800b7f0 tx=0x7f09d800bcb0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.096+0000 7f09edc33640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09d40b29f0 0x7f09d40b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.096+0000 7f09f6625740 1 -- 172.21.15.37:0/2656524430 shutdown_connections 2024-05-09T01:13:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.096+0000 7f09f6625740 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb21167980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.096+0000 7f09f6625740 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb21160a80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.096+0000 7f09f6625740 1 --2- 172.21.15.37:0/2656524430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb21160500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.096+0000 7f09f6625740 1 -- 172.21.15.37:0/2656524430 >> 172.21.15.37:0/2656524430 conn(0x55bb20db0300 msgr2=0x55bb2115be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.098+0000 7f09f6625740 1 -- 172.21.15.37:0/2656524430 shutdown_connections 2024-05-09T01:13:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.098+0000 7f09f6625740 1 -- 172.21.15.37:0/2656524430 wait complete. 2024-05-09T01:13:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.099+0000 7f09f6625740 1 -- start start 2024-05-09T01:13:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.099+0000 7f09edc33640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09d40b29f0 0x7f09d40b4f00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f09e00094e0 tx=0x7f09e002adf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.099+0000 7f09f6625740 1 Processor -- start 2024-05-09T01:13:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09f6625740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb2116a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09f6625740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20d9b4d0 0x55bb2116a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09f6625740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20dbc1b0 0x55bb21171650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09f6625740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bb21168420 con 0x55bb20d932f0 2024-05-09T01:13:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09f6625740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55bb2104b9c0 con 0x55bb20d9b4d0 2024-05-09T01:13:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09f6625740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bb211685a0 con 0x55bb20dbc1b0 2024-05-09T01:13:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09f6625740 10 client.0 _ll_register_callbacks cb 0x55bb21078020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09ecc31640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20d9b4d0 0x55bb2116a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09ecc31640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20d9b4d0 0x55bb2116a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57308/0 (socket says 172.21.15.37:57308) 2024-05-09T01:13:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.100+0000 7f09ecc31640 1 -- 172.21.15.37:0/3922820630 learned_addr learned my addr 172.21.15.37:0/3922820630 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.101+0000 7f09edc33640 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20dbc1b0 0x55bb21171650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.101+0000 7f09ecc31640 1 -- 172.21.15.37:0/3922820630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20dbc1b0 msgr2=0x55bb21171650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.101+0000 7f09ecc31640 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20dbc1b0 0x55bb21171650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.101+0000 7f09ecc31640 1 -- 172.21.15.37:0/3922820630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 msgr2=0x55bb2116a220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:13:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.101+0000 7f09ecc31640 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb2116a220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.101+0000 7f09ecc31640 1 -- 172.21.15.37:0/3922820630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb210721f0 con 0x55bb20d9b4d0 2024-05-09T01:13:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.101+0000 7f09ecc31640 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20d9b4d0 0x55bb2116a760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f09d8015040 tx=0x7f09d80136b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff078f2d9677c508 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.102+0000 7f09d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.102+0000 7f09d0ff9640 1 -- 172.21.15.37:0/3922820630 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d800dd60 con 0x55bb20d9b4d0 2024-05-09T01:13:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.102+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d8018070 con 0x55bb20d9b4d0 2024-05-09T01:13:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.102+0000 7f09d0ff9640 1 -- 172.21.15.37:0/3922820630 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f09d8004030 con 0x55bb20d9b4d0 2024-05-09T01:13:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.102+0000 7f09d0ff9640 1 -- 172.21.15.37:0/3922820630 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f09d8004230 con 0x55bb20d9b4d0 2024-05-09T01:13:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.103+0000 7f09f6625740 10 client.27029 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.103+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55bb20e27790 con 0x55bb20d9b4d0 2024-05-09T01:13:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.105+0000 7f09d0ff9640 1 -- 172.21.15.37:0/3922820630 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09d8018070 con 0x55bb20d9b4d0 2024-05-09T01:13:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09d0ff9640 1 -- 172.21.15.37:0/3922820630 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f09d8012640 con 0x55bb20d9b4d0 2024-05-09T01:13:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09f6625740 10 client.27029 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09f6625740 10 client.27029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09f6625740 20 client.27029 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09f6625740 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d7ad80 0x55bb211780b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09f6625740 4 client.27029 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb210d23d0 con 0x55bb20d7ad80 2024-05-09T01:13:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.107+0000 7f09ed432640 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d7ad80 0x55bb211780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.108+0000 7f09ed432640 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d7ad80 0x55bb211780b0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3212a1e20263b31 server_cookie=d84b8e2d2f9ea23 in_seq=0 out_seq=0 2024-05-09T01:13:07.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.108+0000 7f09d0ff9640 10 client.27029 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.109+0000 7f09d0ff9640 1 -- 172.21.15.37:0/3922820630 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bb210d23d0 con 0x55bb20d7ad80 2024-05-09T01:13:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.109+0000 7f09d0ff9640 10 client.27029 handle_command_reply: tid=0 2024-05-09T01:13:07.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.109+0000 7f09f6625740 1 client.27029 shutdown 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20d9b4d0 msgr2=0x55bb2116a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20d9b4d0 0x55bb2116a760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f09d8015040 tx=0x7f09d80136b0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 shutdown_connections 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d7ad80 0x55bb211780b0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20dbc1b0 0x55bb21171650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20d9b4d0 0x55bb2116a760 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 --2- 172.21.15.37:0/3922820630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb2116a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 >> 172.21.15.37:0/3922820630 conn(0x55bb20db0300 msgr2=0x55bb2115a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.110+0000 7f09d0ff9640 0 client.27029 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.111+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 shutdown_connections 2024-05-09T01:13:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.111+0000 7f09f6625740 1 -- 172.21.15.37:0/3922820630 wait complete. 2024-05-09T01:13:07.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.111+0000 7f09f6625740 20 client.27029 trim_cache size 0 max 16384 2024-05-09T01:13:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.138+0000 7f09f6625740 1 Processor -- start 2024-05-09T01:13:07.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.138+0000 7f09f6625740 1 -- start start 2024-05-09T01:13:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09f6625740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb21163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09f6625740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d9b4d0 0x55bb21171570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09f6625740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2115b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09f6625740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc00e2b0 con 0x55bb20d932f0 2024-05-09T01:13:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09f6625740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc00feb0 con 0x55bb20dbc1b0 2024-05-09T01:13:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09f6625740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc00e980 con 0x55bb20d9b4d0 2024-05-09T01:13:07.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb21163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb21163c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38100/0 (socket says 172.21.15.37:38100) 2024-05-09T01:13:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 -- 172.21.15.37:0/3817489903 learned_addr learned my addr 172.21.15.37:0/3817489903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ecc31640 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d9b4d0 0x55bb21171570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09edc33640 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2115b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 -- 172.21.15.37:0/3817489903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d9b4d0 msgr2=0x55bb21171570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d9b4d0 0x55bb21171570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 -- 172.21.15.37:0/3817489903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 msgr2=0x55bb2115b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2115b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.139+0000 7f09ed432640 1 -- 172.21.15.37:0/3817489903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb21169fd0 con 0x55bb20d932f0 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.140+0000 7f09ed432640 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb21163c80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f09e40049b0 tx=0x7f09e400efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08b2e1680d43c68 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.140+0000 7f09d2ffd640 1 -- 172.21.15.37:0/3817489903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40a97a0 con 0x55bb20d932f0 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.140+0000 7f09d2ffd640 1 -- 172.21.15.37:0/3817489903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09e40aa390 con 0x55bb20d932f0 2024-05-09T01:13:07.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.140+0000 7f09d2ffd640 1 -- 172.21.15.37:0/3817489903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40e0280 con 0x55bb20d932f0 2024-05-09T01:13:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 -- 172.21.15.37:0/3817489903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 msgr2=0x55bb21163c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb21163c80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f09e40049b0 tx=0x7f09e400efb0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 -- 172.21.15.37:0/3817489903 shutdown_connections 2024-05-09T01:13:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2115b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d9b4d0 0x55bb21171570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 --2- 172.21.15.37:0/3817489903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d932f0 0x55bb21163c80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 -- 172.21.15.37:0/3817489903 >> 172.21.15.37:0/3817489903 conn(0x55bb20db0300 msgr2=0x55bb21163570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 -- 172.21.15.37:0/3817489903 shutdown_connections 2024-05-09T01:13:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.141+0000 7f09f6625740 1 -- 172.21.15.37:0/3817489903 wait complete. 2024-05-09T01:13:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.142+0000 7f09f6625740 1 -- start start 2024-05-09T01:13:07.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.142+0000 7f09f6625740 1 Processor -- start 2024-05-09T01:13:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09f6625740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb211712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09f6625740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb2116df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09f6625740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2116e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09ecc31640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb2116df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09f6625740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc00f720 con 0x55bb20d9b4d0 2024-05-09T01:13:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09f6625740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc00f050 con 0x55bb20dbc1b0 2024-05-09T01:13:07.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09f6625740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09cc00c340 con 0x55bb20d932f0 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09ecc31640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb2116df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38116/0 (socket says 172.21.15.37:38116) 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09ecc31640 1 -- 172.21.15.37:0/1286276595 learned_addr learned my addr 172.21.15.37:0/1286276595 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09ed432640 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb211712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.143+0000 7f09f6625740 10 client.0 _ll_register_callbacks cb 0x7f09d800b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09edc33640 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2116e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09ed432640 1 -- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 msgr2=0x55bb2116e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09ed432640 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2116e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09ed432640 1 -- 172.21.15.37:0/1286276595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 msgr2=0x55bb2116df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09ed432640 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb2116df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09ed432640 1 -- 172.21.15.37:0/1286276595 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb20e9e5f0 con 0x55bb20d932f0 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09ed432640 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb211712d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f09e40049b0 tx=0x7f09e40b24f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb9fea721135ef31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:07.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09d0ff9640 1 -- 172.21.15.37:0/1286276595 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e40a9c90 con 0x55bb20d932f0 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.144+0000 7f09d0ff9640 1 -- 172.21.15.37:0/1286276595 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f09e40a5f20 con 0x55bb20d932f0 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.145+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09e40aa390 con 0x55bb20d932f0 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.145+0000 7f09d0ff9640 1 -- 172.21.15.37:0/1286276595 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f09e40c4340 con 0x55bb20d932f0 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.145+0000 7f09f6625740 10 client.27004 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.145+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55bb21088ed0 con 0x55bb20d932f0 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.145+0000 7f09d0ff9640 1 -- 172.21.15.37:0/1286276595 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09e40a9ef0 con 0x55bb20d932f0 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09d0ff9640 1 -- 172.21.15.37:0/1286276595 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f09e40c4020 con 0x55bb20d932f0 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09f6625740 10 client.27004 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:07.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09f6625740 10 client.27004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09f6625740 20 client.27004 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09f6625740 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d501c0 0x55bb211e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09f6625740 4 client.27004 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:13:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f09e40aa390 con 0x55bb20d501c0 2024-05-09T01:13:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.146+0000 7f09ecc31640 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d501c0 0x55bb211e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.147+0000 7f09ecc31640 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d501c0 0x55bb211e18f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6509b2352d3cf4 server_cookie=66910380dab77618 in_seq=0 out_seq=0 2024-05-09T01:13:07.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.147+0000 7f09d0ff9640 10 client.27004 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09d0ff9640 1 -- 172.21.15.37:0/1286276595 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f09e40aa390 con 0x55bb20d501c0 2024-05-09T01:13:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09d0ff9640 10 client.27004 handle_command_reply: tid=0 2024-05-09T01:13:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 client.27004 shutdown 2024-05-09T01:13:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 msgr2=0x55bb211712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb211712d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f09e40049b0 tx=0x7f09e40b24f0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 shutdown_connections 2024-05-09T01:13:07.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55bb20d501c0 0x55bb211e18f0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55bb20dbc1b0 0x55bb2116e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bb20d9b4d0 0x55bb2116df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.157+0000 7f09f6625740 1 --2- 172.21.15.37:0/1286276595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bb20d932f0 0x55bb211712d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.158+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 >> 172.21.15.37:0/1286276595 conn(0x55bb20db0300 msgr2=0x55bb2115b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.158+0000 7f09d0ff9640 0 client.27004 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.158+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 shutdown_connections 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.158+0000 7f09f6625740 1 -- 172.21.15.37:0/1286276595 wait complete. 2024-05-09T01:13:07.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.158+0000 7f09f6625740 20 client.27004 trim_cache size 0 max 16384 2024-05-09T01:13:07.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:13:07.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:13:07.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:13:07.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09d40b29f0 msgr2=0x7f09d40b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09d40b29f0 0x7f09d40b4f00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f09e00094e0 tx=0x7f09e002adf0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e8102530 msgr2=0x7f09e8071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e8102530 0x7f09e8071ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e9c0 tx=0x7f09e400ee80 comp rx=0 tx=0).stop 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 shutdown_connections 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e81077f0 0x7f09e8072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f09d40b29f0 0x7f09d40b4f00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e8104e90 0x7f09e8072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 --2- 172.21.15.37:0/1090043866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09e8102530 0x7f09e8071ae0 secure :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e9c0 tx=0x7f09e400ee80 comp rx=0 tx=0).stop 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 >> 172.21.15.37:0/1090043866 conn(0x7f09e80fdd40 msgr2=0x7f09e8103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 shutdown_connections 2024-05-09T01:13:07.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:07.159+0000 7f09ef696640 1 -- 172.21.15.37:0/1090043866 wait complete. 2024-05-09T01:13:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 -- 172.21.15.37:0/1383574720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 msgr2=0x7f802411fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 --2- 172.21.15.37:0/1383574720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 0x7f802411fd50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f80140098f0 tx=0x7f8014009c00 comp rx=0 tx=0).stop 2024-05-09T01:13:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 -- 172.21.15.37:0/1383574720 shutdown_connections 2024-05-09T01:13:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 --2- 172.21.15.37:0/1383574720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 0x7f802411fd50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 --2- 172.21.15.37:0/1383574720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f802410a930 0x7f802410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 --2- 172.21.15.37:0/1383574720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410b280 0x7f802411d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 -- 172.21.15.37:0/1383574720 >> 172.21.15.37:0/1383574720 conn(0x7f802406f4d0 msgr2=0x7f802406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 -- 172.21.15.37:0/1383574720 shutdown_connections 2024-05-09T01:13:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.170+0000 7f80298e8700 1 -- 172.21.15.37:0/1383574720 wait complete. 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 Processor -- start 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 -- start start 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410a930 0x7f80241af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f802410b280 0x7f80241afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 0x7f80241a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80241232c0 con 0x7f802410b280 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8024123140 con 0x7f802410a930 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f80298e8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8024123440 con 0x7f802411d930 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.171+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410a930 0x7f80241af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410a930 0x7f80241af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57332/0 (socket says 172.21.15.37:57332) 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80237fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 0x7f80241a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f8022ffd700 1 -- 172.21.15.37:0/1235430683 learned_addr learned my addr 172.21.15.37:0/1235430683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80227fc700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f802410b280 0x7f80241afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80237fe700 1 -- 172.21.15.37:0/1235430683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410a930 msgr2=0x7f80241af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80237fe700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410a930 0x7f80241af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80237fe700 1 -- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f802410b280 msgr2=0x7f80241afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80237fe700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f802410b280 0x7f80241afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80237fe700 1 -- 172.21.15.37:0/1235430683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80241aa130 con 0x7f802411d930 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f8022ffd700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410a930 0x7f80241af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80237fe700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 0x7f80241a9a80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8014009810 tx=0x7f8014009480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.172+0000 7f80288e6700 1 -- 172.21.15.37:0/1235430683 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014027070 con 0x7f802411d930 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.173+0000 7f80288e6700 1 -- 172.21.15.37:0/1235430683 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80140056b0 con 0x7f802411d930 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.173+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80241aa3c0 con 0x7f802411d930 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.173+0000 7f80288e6700 1 -- 172.21.15.37:0/1235430683 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014004950 con 0x7f802411d930 2024-05-09T01:13:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.173+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80241aa8a0 con 0x7f802411d930 2024-05-09T01:13:07.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.176+0000 7f80288e6700 1 -- 172.21.15.37:0/1235430683 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f801402a070 con 0x7f802411d930 2024-05-09T01:13:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.177+0000 7f80382feb80 1 Processor -- start 2024-05-09T01:13:07.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.177+0000 7f80382feb80 1 -- start start 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.177+0000 7f80382feb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70dc5d00 0x55fc70ece240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.177+0000 7f80382feb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70d4b4a0 0x55fc70ece780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80382feb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70ec8400 0x55fc70ec8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80288e6700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f80100b2880 0x7f80100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80382feb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc70deb0a0 con 0x55fc70ec8400 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80382feb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fc70d909a0 con 0x55fc70d4b4a0 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80382feb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fc70de7060 con 0x55fc70dc5d00 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80227fc700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f80100b2880 0x7f80100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80288e6700 1 -- 172.21.15.37:0/1235430683 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f80140e2ad0 con 0x7f802411d930 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70d4b4a0 0x55fc70ece780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70d4b4a0 0x55fc70ece780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57340/0 (socket says 172.21.15.37:57340) 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 -- 172.21.15.37:0/2965857865 learned_addr learned my addr 172.21.15.37:0/2965857865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80227fc700 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70dc5d00 0x55fc70ece240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 -- 172.21.15.37:0/2965857865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70dc5d00 msgr2=0x55fc70ece240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70dc5d00 0x55fc70ece240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 -- 172.21.15.37:0/2965857865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70ec8400 msgr2=0x55fc70ec8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70ec8400 0x55fc70ec8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f8022ffd700 1 -- 172.21.15.37:0/2965857865 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc70d81500 con 0x55fc70d4b4a0 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.178+0000 7f80227fc700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f80100b2880 0x7f80100b4d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f802411fe30 tx=0x7f800c007a50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.179+0000 7f8022ffd700 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70d4b4a0 0x55fc70ece780 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f801c009510 tx=0x7f801c0099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2c3794413929465 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.179+0000 7f8019ffb700 1 -- 172.21.15.37:0/2965857865 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c01b020 con 0x55fc70d4b4a0 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.179+0000 7f8019ffb700 1 -- 172.21.15.37:0/2965857865 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f801c007e50 con 0x55fc70d4b4a0 2024-05-09T01:13:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.179+0000 7f8019ffb700 1 -- 172.21.15.37:0/2965857865 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c017cc0 con 0x55fc70d4b4a0 2024-05-09T01:13:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.180+0000 7f80382feb80 1 -- 172.21.15.37:0/2965857865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70d4b4a0 msgr2=0x55fc70ece780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.180+0000 7f80382feb80 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70d4b4a0 0x55fc70ece780 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f801c009510 tx=0x7f801c0099e0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.180+0000 7f80382feb80 1 -- 172.21.15.37:0/2965857865 shutdown_connections 2024-05-09T01:13:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.180+0000 7f80382feb80 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70ec8400 0x55fc70ec8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.180+0000 7f80382feb80 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70dc5d00 0x55fc70ece240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.180+0000 7f80382feb80 1 --2- 172.21.15.37:0/2965857865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70d4b4a0 0x55fc70ece780 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f801c009510 tx=0x7f801c0099e0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.180+0000 7f80382feb80 1 -- 172.21.15.37:0/2965857865 >> 172.21.15.37:0/2965857865 conn(0x55fc70d4ef70 msgr2=0x55fc70ec3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.181+0000 7f80382feb80 1 -- 172.21.15.37:0/2965857865 shutdown_connections 2024-05-09T01:13:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.181+0000 7f80382feb80 1 -- 172.21.15.37:0/2965857865 wait complete. 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.181+0000 7f80382feb80 1 -- start start 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 1 Processor -- start 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ed2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 0x55fc70ed26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ede240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc70ec9160 con 0x55fc70dc5d00 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fc70d85b20 con 0x55fc70ed2c00 2024-05-09T01:13:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fc70ed5020 con 0x55fc70ec8400 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.182+0000 7f80382feb80 10 client.0 _ll_register_callbacks cb 0x55fc70c5c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ede240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ede240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57342/0 (socket says 172.21.15.37:57342) 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 -- 172.21.15.37:0/2912717584 learned_addr learned my addr 172.21.15.37:0/2912717584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f8022ffd700 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ed2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 -- 172.21.15.37:0/2912717584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 msgr2=0x55fc70ed26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 0x55fc70ed26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 -- 172.21.15.37:0/2912717584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 msgr2=0x55fc70ed2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ed2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f80237fe700 1 -- 172.21.15.37:0/2912717584 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc70c66490 con 0x55fc70ed2c00 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.183+0000 7f8022ffd700 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ed2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f8002ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f80237fe700 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ede240 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80140e05d0 tx=0x7f80140aa080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb42b4fb23fed47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f8002ffd700 1 -- 172.21.15.37:0/2912717584 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140c4bc0 con 0x55fc70ed2c00 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f801c007e50 con 0x55fc70ed2c00 2024-05-09T01:13:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f8002ffd700 1 -- 172.21.15.37:0/2912717584 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f80140a6770 con 0x55fc70ed2c00 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f8002ffd700 1 -- 172.21.15.37:0/2912717584 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f80140c4bc0 con 0x55fc70ed2c00 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f80382feb80 10 client.27047 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.184+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55fc70ef1030 con 0x55fc70ed2c00 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f8002ffd700 1 -- 172.21.15.37:0/2912717584 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f801c007e50 con 0x55fc70ed2c00 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f8002ffd700 1 -- 172.21.15.37:0/2912717584 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f80140ae140 con 0x55fc70ed2c00 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f80382feb80 10 client.27047 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f80382feb80 10 client.27047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f80382feb80 20 client.27047 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f80382feb80 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70ef5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f80382feb80 4 client.27047 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc70df8a80 con 0x55fc70ef3670 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.185+0000 7f8022ffd700 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70ef5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.186+0000 7f8022ffd700 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70ef5ae0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc11b1eeeb2d8a30 server_cookie=4f6cee7f338945c7 in_seq=0 out_seq=0 2024-05-09T01:13:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.186+0000 7f8002ffd700 10 client.27047 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.186+0000 7f8002ffd700 1 -- 172.21.15.37:0/2912717584 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fc70df8a80 con 0x55fc70ef3670 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.186+0000 7f8002ffd700 10 client.27047 handle_command_reply: tid=0 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 client.27047 shutdown 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 msgr2=0x55fc70ede240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ede240 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f80140e05d0 tx=0x7f80140aa080 comp rx=0 tx=0).stop 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 shutdown_connections 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70ef5ae0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f8002ffd700 0 client.27047 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ede240 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ed2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 --2- 172.21.15.37:0/2912717584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 0x55fc70ed26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 >> 172.21.15.37:0/2912717584 conn(0x55fc70d4ef70 msgr2=0x55fc70ebcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 shutdown_connections 2024-05-09T01:13:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 1 -- 172.21.15.37:0/2912717584 wait complete. 2024-05-09T01:13:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.187+0000 7f80382feb80 20 client.27047 trim_cache size 0 max 16384 2024-05-09T01:13:07.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.216+0000 7f80382feb80 1 Processor -- start 2024-05-09T01:13:07.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.216+0000 7f80382feb80 1 -- start start 2024-05-09T01:13:07.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.216+0000 7f80382feb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ebda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.217+0000 7f80382feb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ec8400 0x55fc70ed44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.217+0000 7f80382feb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ed2c00 0x55fc70ec7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.217+0000 7f80382feb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8024119be0 con 0x55fc70dc5d00 2024-05-09T01:13:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.217+0000 7f80382feb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f80241b6c50 con 0x55fc70ec8400 2024-05-09T01:13:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.217+0000 7f80382feb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f802411a2b0 con 0x55fc70ed2c00 2024-05-09T01:13:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.220+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ebda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.220+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ebda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38142/0 (socket says 172.21.15.37:38142) 2024-05-09T01:13:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.220+0000 7f8022ffd700 1 -- 172.21.15.37:0/3171009104 learned_addr learned my addr 172.21.15.37:0/3171009104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.220+0000 7f80237fe700 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ed2c00 0x55fc70ec7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.221+0000 7f80227fc700 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ec8400 0x55fc70ed44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.221+0000 7f80237fe700 1 -- 172.21.15.37:0/3171009104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ec8400 msgr2=0x55fc70ed44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.221+0000 7f80237fe700 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ec8400 0x55fc70ed44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.221+0000 7f80237fe700 1 -- 172.21.15.37:0/3171009104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 msgr2=0x55fc70ebda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.221+0000 7f80237fe700 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ebda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.221+0000 7f80237fe700 1 -- 172.21.15.37:0/3171009104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc70ed1170 con 0x55fc70ed2c00 2024-05-09T01:13:07.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.222+0000 7f80237fe700 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ed2c00 0x55fc70ec7b00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f80140a6720 tx=0x7f8014009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dcf03304c7a86d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.226+0000 7f80197fa700 1 -- 172.21.15.37:0/3171009104 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140c49e0 con 0x55fc70ed2c00 2024-05-09T01:13:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.226+0000 7f80197fa700 1 -- 172.21.15.37:0/3171009104 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80140aa880 con 0x55fc70ed2c00 2024-05-09T01:13:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.226+0000 7f80197fa700 1 -- 172.21.15.37:0/3171009104 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140b2ac0 con 0x55fc70ed2c00 2024-05-09T01:13:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.227+0000 7f80382feb80 1 -- 172.21.15.37:0/3171009104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ed2c00 msgr2=0x55fc70ec7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.227+0000 7f80382feb80 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ed2c00 0x55fc70ec7b00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f80140a6720 tx=0x7f8014009c00 comp rx=0 tx=0).stop 2024-05-09T01:13:07.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.230+0000 7f80382feb80 1 -- 172.21.15.37:0/3171009104 shutdown_connections 2024-05-09T01:13:07.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.230+0000 7f80382feb80 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ed2c00 0x55fc70ec7b00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.230+0000 7f80382feb80 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70ebda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.230+0000 7f80382feb80 1 --2- 172.21.15.37:0/3171009104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ec8400 0x55fc70ed44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.230+0000 7f80382feb80 1 -- 172.21.15.37:0/3171009104 >> 172.21.15.37:0/3171009104 conn(0x55fc70d4ef70 msgr2=0x55fc70ec73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.231+0000 7f80382feb80 1 -- 172.21.15.37:0/3171009104 shutdown_connections 2024-05-09T01:13:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.235+0000 7f80382feb80 1 -- 172.21.15.37:0/3171009104 wait complete. 2024-05-09T01:13:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.235+0000 7f80382feb80 1 -- start start 2024-05-09T01:13:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.236+0000 7f80382feb80 1 Processor -- start 2024-05-09T01:13:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.236+0000 7f80382feb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70eda3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.237+0000 7f80382feb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 0x55fc70ed71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.237+0000 7f80382feb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ed76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.237+0000 7f80382feb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f802411b050 con 0x55fc70dc5d00 2024-05-09T01:13:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.237+0000 7f80382feb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f802411a980 con 0x55fc70ed2c00 2024-05-09T01:13:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.237+0000 7f80382feb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8024117ba0 con 0x55fc70ec8400 2024-05-09T01:13:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.237+0000 7f80382feb80 10 client.0 _ll_register_callbacks cb 0x55fc70c5c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.237+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70eda3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.238+0000 7f80237fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ed76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.238+0000 7f8022ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70eda3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38146/0 (socket says 172.21.15.37:38146) 2024-05-09T01:13:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.238+0000 7f8022ffd700 1 -- 172.21.15.37:0/3102013644 learned_addr learned my addr 172.21.15.37:0/3102013644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.240+0000 7f80227fc700 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 0x55fc70ed71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.241+0000 7f8022ffd700 1 -- 172.21.15.37:0/3102013644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 msgr2=0x55fc70ed71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.241+0000 7f8022ffd700 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 0x55fc70ed71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.241+0000 7f8022ffd700 1 -- 172.21.15.37:0/3102013644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 msgr2=0x55fc70ed76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.241+0000 7f8022ffd700 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ed76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.241+0000 7f8022ffd700 1 -- 172.21.15.37:0/3102013644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc70edab10 con 0x55fc70dc5d00 2024-05-09T01:13:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.247+0000 7f8022ffd700 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70eda3e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55fc70ec4c90 tx=0x7f801c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b76231ea41fc45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.247+0000 7f8002ffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:13:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.247+0000 7f8002ffd700 1 -- 172.21.15.37:0/3102013644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c01b040 con 0x55fc70dc5d00 2024-05-09T01:13:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.248+0000 7f8002ffd700 1 -- 172.21.15.37:0/3102013644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f801c0178d0 con 0x55fc70dc5d00 2024-05-09T01:13:07.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.248+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80140aa880 con 0x55fc70dc5d00 2024-05-09T01:13:07.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.250+0000 7f8002ffd700 1 -- 172.21.15.37:0/3102013644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f801c034050 con 0x55fc70dc5d00 2024-05-09T01:13:07.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.251+0000 7f80382feb80 10 client.17187 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:07.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.251+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55fc70f5e880 con 0x55fc70dc5d00 2024-05-09T01:13:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f8002ffd700 1 -- 172.21.15.37:0/3102013644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f801c00e740 con 0x55fc70dc5d00 2024-05-09T01:13:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f8002ffd700 1 -- 172.21.15.37:0/3102013644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f801c0261d0 con 0x55fc70dc5d00 2024-05-09T01:13:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f80382feb80 10 client.17187 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f80382feb80 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f80382feb80 20 client.17187 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f80382feb80 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70f60e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f80382feb80 4 client.17187 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:13:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.252+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f80140aa880 con 0x55fc70ef3670 2024-05-09T01:13:07.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.254+0000 7f80227fc700 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70f60e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.255+0000 7f80227fc700 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70f60e10 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75d76492c8bc0c9d server_cookie=ddcf83314e21b4d2 in_seq=0 out_seq=0 2024-05-09T01:13:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.255+0000 7f8002ffd700 10 client.17187 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.255+0000 7f8002ffd700 1 -- 172.21.15.37:0/3102013644 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f80140aa880 con 0x55fc70ef3670 2024-05-09T01:13:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.255+0000 7f8002ffd700 10 client.17187 handle_command_reply: tid=0 2024-05-09T01:13:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.255+0000 7f80382feb80 1 client.17187 shutdown 2024-05-09T01:13:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.255+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 msgr2=0x55fc70eda3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.256+0000 7f80382feb80 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70eda3e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55fc70ec4c90 tx=0x7f801c0095a0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.256+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 shutdown_connections 2024-05-09T01:13:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.256+0000 7f80382feb80 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55fc70ef3670 0x55fc70f60e10 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.256+0000 7f80382feb80 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc70ed2c00 0x55fc70ed76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.256+0000 7f80382feb80 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc70dc5d00 0x55fc70eda3e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.256+0000 7f80382feb80 1 --2- 172.21.15.37:0/3102013644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc70ec8400 0x55fc70ed71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.256+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 >> 172.21.15.37:0/3102013644 conn(0x55fc70d4ef70 msgr2=0x55fc70ebd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.257+0000 7f8002ffd700 0 client.17187 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.257+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 shutdown_connections 2024-05-09T01:13:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.257+0000 7f80382feb80 1 -- 172.21.15.37:0/3102013644 wait complete. 2024-05-09T01:13:07.259 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:13:07.259 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:13:07.259 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:13:07.260 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.257+0000 7f80382feb80 20 client.17187 trim_cache size 0 max 16384 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.258+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f80100b2880 msgr2=0x7f80100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.258+0000 7f80298e8700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f80100b2880 0x7f80100b4d90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f802411fe30 tx=0x7f800c007a50 comp rx=0 tx=0).stop 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.258+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 msgr2=0x7f80241a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.258+0000 7f80298e8700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 0x7f80241a9a80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8014009810 tx=0x7f8014009480 comp rx=0 tx=0).stop 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.259+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 shutdown_connections 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.259+0000 7f80298e8700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f80100b2880 0x7f80100b4d90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.259+0000 7f80298e8700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f802411d930 0x7f80241a9a80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.259+0000 7f80298e8700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f802410a930 0x7f80241af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.259+0000 7f80298e8700 1 --2- 172.21.15.37:0/1235430683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f802410b280 0x7f80241afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.259+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 >> 172.21.15.37:0/1235430683 conn(0x7f802406f4d0 msgr2=0x7f802411b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.259+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 shutdown_connections 2024-05-09T01:13:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:07.260+0000 7f80298e8700 1 -- 172.21.15.37:0/1235430683 wait complete. 2024-05-09T01:13:08.089 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:13:08.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:13:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:08.784 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:08 smithi037 ceph-mon[30122]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.9 MiB/s wr, 640 op/s 2024-05-09T01:13:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:08 smithi136 ceph-mon[34110]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.9 MiB/s wr, 640 op/s 2024-05-09T01:13:08.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:08 smithi151 ceph-mon[34780]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.9 MiB/s wr, 640 op/s 2024-05-09T01:13:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 650.0 s, 1413.0 tps, lat 72.253 ms stddev 79.185 2024-05-09T01:13:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.528+0000 7f410b76d700 1 -- 172.21.15.37:0/4198948485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103a60 msgr2=0x7f41041106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.529+0000 7f410b76d700 1 --2- 172.21.15.37:0/4198948485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103a60 0x7f41041106f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009990 tx=0x7f40f4009ca0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.529+0000 7f410b76d700 1 -- 172.21.15.37:0/4198948485 shutdown_connections 2024-05-09T01:13:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.529+0000 7f410b76d700 1 --2- 172.21.15.37:0/4198948485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4104110c30 0x7f4104113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.530+0000 7f410b76d700 1 --2- 172.21.15.37:0/4198948485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4104103080 0x7f4104103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.530+0000 7f410b76d700 1 --2- 172.21.15.37:0/4198948485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103a60 0x7f41041106f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.530+0000 7f410b76d700 1 -- 172.21.15.37:0/4198948485 >> 172.21.15.37:0/4198948485 conn(0x7f41040fedc0 msgr2=0x7f41041011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.531+0000 7f410b76d700 1 -- 172.21.15.37:0/4198948485 shutdown_connections 2024-05-09T01:13:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.531+0000 7f410b76d700 1 -- 172.21.15.37:0/4198948485 wait complete. 2024-05-09T01:13:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 Processor -- start 2024-05-09T01:13:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 -- start start 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103080 0x7f410419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4104103a60 0x7f410419d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4104110c30 0x7f41041a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4104116660 con 0x7f4104103080 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f41041164e0 con 0x7f4104103a60 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f410b76d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f41041167e0 con 0x7f4104110c30 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f4109509700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103080 0x7f410419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f4109509700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103080 0x7f410419ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38158/0 (socket says 172.21.15.37:38158) 2024-05-09T01:13:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f4109509700 1 -- 172.21.15.37:0/3483123305 learned_addr learned my addr 172.21.15.37:0/3483123305 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f4108d08700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4104103a60 0x7f410419d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.532+0000 7f4109d0a700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4104110c30 0x7f41041a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f4108d08700 1 -- 172.21.15.37:0/3483123305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4104110c30 msgr2=0x7f41041a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f4108d08700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4104110c30 0x7f41041a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f4108d08700 1 -- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103080 msgr2=0x7f410419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f4108d08700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103080 0x7f410419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f4108d08700 1 -- 172.21.15.37:0/3483123305 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41041a1d00 con 0x7f4104103a60 2024-05-09T01:13:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f4108d08700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4104103a60 0x7f410419d3d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f410406c6f0 tx=0x7f40f40057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f40fa7fc700 1 -- 172.21.15.37:0/3483123305 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4027070 con 0x7f4104103a60 2024-05-09T01:13:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f40fa7fc700 1 -- 172.21.15.37:0/3483123305 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40f4022470 con 0x7f4104103a60 2024-05-09T01:13:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41041a1f90 con 0x7f4104103a60 2024-05-09T01:13:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f40fa7fc700 1 -- 172.21.15.37:0/3483123305 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4017650 con 0x7f4104103a60 2024-05-09T01:13:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.533+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41041a2470 con 0x7f4104103a60 2024-05-09T01:13:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.535+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41040512c0 con 0x7f4104103a60 2024-05-09T01:13:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.536+0000 7f40fa7fc700 1 -- 172.21.15.37:0/3483123305 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f40f402a070 con 0x7f4104103a60 2024-05-09T01:13:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.537+0000 7f40fa7fc700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40f00b2900 0x7f40f00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.537+0000 7f4109509700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40f00b2900 0x7f40f00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.537+0000 7f40fa7fc700 1 -- 172.21.15.37:0/3483123305 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f40f40e3080 con 0x7f4104103a60 2024-05-09T01:13:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.537+0000 7f4109509700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40f00b2900 0x7f40f00b4e10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4100009d20 tx=0x7f4100009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:10.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.542+0000 7f40fa7fc700 1 -- 172.21.15.37:0/3483123305 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f40f4013070 con 0x7f4104103a60 2024-05-09T01:13:10.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:10 smithi037 ceph-mon[30122]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.9 MiB/s wr, 620 op/s 2024-05-09T01:13:10.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:10 smithi136 ceph-mon[34110]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.9 MiB/s wr, 620 op/s 2024-05-09T01:13:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.958+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f410402e5f0 con 0x7f4104103a60 2024-05-09T01:13:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.959+0000 7f40fa7fc700 1 -- 172.21.15.37:0/3483123305 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11943 (secure 0 0 0) 0x7f40f40aaeb0 con 0x7f4104103a60 2024-05-09T01:13:10.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:13:10.961 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:12:37.460154+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24454,24445,24467,24446]},"id":1}]} 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40f00b2900 msgr2=0x7f40f00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40f00b2900 0x7f40f00b4e10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4100009d20 tx=0x7f4100009260 comp rx=0 tx=0).stop 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4104103a60 msgr2=0x7f410419d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4104103a60 0x7f410419d3d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f410406c6f0 tx=0x7f40f40057c0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 shutdown_connections 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f40f00b2900 0x7f40f00b4e10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4104110c30 0x7f41041a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4104103080 0x7f410419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 --2- 172.21.15.37:0/3483123305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4104103a60 0x7f410419d3d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 >> 172.21.15.37:0/3483123305 conn(0x7f41040fedc0 msgr2=0x7f41040ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.962+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 shutdown_connections 2024-05-09T01:13:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:10.963+0000 7f410b76d700 1 -- 172.21.15.37:0/3483123305 wait complete. 2024-05-09T01:13:10.965 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 45 2024-05-09T01:13:10.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:10 smithi151 ceph-mon[34780]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.9 MiB/s wr, 620 op/s 2024-05-09T01:13:11.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:11 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3483123305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:13:11.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:13:11.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:11 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3483123305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:13:11.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:11 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3483123305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:13:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:12.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:12 smithi037 ceph-mon[30122]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.0 MiB/s wr, 728 op/s 2024-05-09T01:13:12.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:12 smithi136 ceph-mon[34110]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.0 MiB/s wr, 728 op/s 2024-05-09T01:13:12.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:12 smithi151 ceph-mon[34780]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.0 MiB/s wr, 728 op/s 2024-05-09T01:13:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 -- 172.21.15.37:0/2487317987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8108f40 msgr2=0x7f97e8109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 --2- 172.21.15.37:0/2487317987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8108f40 0x7f97e8109350 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0099c0 tx=0x7f97dc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 -- 172.21.15.37:0/2487317987 shutdown_connections 2024-05-09T01:13:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 --2- 172.21.15.37:0/2487317987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e8109890 0x7f97e81111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 --2- 172.21.15.37:0/2487317987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97e8104610 0x7f97e8104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 --2- 172.21.15.37:0/2487317987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8108f40 0x7f97e8109350 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 -- 172.21.15.37:0/2487317987 >> 172.21.15.37:0/2487317987 conn(0x7f97e807af70 msgr2=0x7f97e807b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.117+0000 7f97ed011700 1 -- 172.21.15.37:0/2487317987 shutdown_connections 2024-05-09T01:13:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.118+0000 7f97ed011700 1 -- 172.21.15.37:0/2487317987 wait complete. 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 Processor -- start 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 -- start start 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97e8104610 0x7f97e810e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e8108f40 0x7f97e810e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8109890 0x7f97e810ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97e80771e0 con 0x7f97e8109890 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97e8077060 con 0x7f97e8108f40 2024-05-09T01:13:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97ed011700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97e8077360 con 0x7f97e8104610 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97e759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8109890 0x7f97e810ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97e759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8109890 0x7f97e810ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39900/0 (socket says 172.21.15.37:39900) 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97e759e700 1 -- 172.21.15.37:0/3510183655 learned_addr learned my addr 172.21.15.37:0/3510183655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97e8104610 0x7f97e810e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.119+0000 7f97e659c700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e8108f40 0x7f97e810e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.120+0000 7f97e6d9d700 1 -- 172.21.15.37:0/3510183655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e8108f40 msgr2=0x7f97e810e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.120+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e8108f40 0x7f97e810e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.120+0000 7f97e6d9d700 1 -- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8109890 msgr2=0x7f97e810ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.120+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8109890 0x7f97e810ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.120+0000 7f97e6d9d700 1 -- 172.21.15.37:0/3510183655 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e81ad640 con 0x7f97e8104610 2024-05-09T01:13:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.120+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97e8104610 0x7f97e810e390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f97d800e9f0 tx=0x7f97d800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.121+0000 7f97e759e700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8109890 0x7f97e810ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.121+0000 7f97cffff700 1 -- 172.21.15.37:0/3510183655 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d800c9c0 con 0x7f97e8104610 2024-05-09T01:13:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.121+0000 7f97cffff700 1 -- 172.21.15.37:0/3510183655 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97d800cb60 con 0x7f97e8104610 2024-05-09T01:13:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.121+0000 7f97cffff700 1 -- 172.21.15.37:0/3510183655 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8018680 con 0x7f97e8104610 2024-05-09T01:13:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.121+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e81ad870 con 0x7f97e8104610 2024-05-09T01:13:14.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.121+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e81adc70 con 0x7f97e8104610 2024-05-09T01:13:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.125+0000 7f97cffff700 1 -- 172.21.15.37:0/3510183655 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f97d8010430 con 0x7f97e8104610 2024-05-09T01:13:14.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.127+0000 7f97cffff700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97d00b2900 0x7f97d00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.127+0000 7f97e659c700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97d00b2900 0x7f97d00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.127+0000 7f97cffff700 1 -- 172.21.15.37:0/3510183655 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97d80e2340 con 0x7f97e8104610 2024-05-09T01:13:14.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.127+0000 7f97fba27b80 1 Processor -- start 2024-05-09T01:13:14.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.127+0000 7f97fba27b80 1 -- start start 2024-05-09T01:13:14.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.127+0000 7f97e659c700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97d00b2900 0x7f97d00b4e10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000c00 tx=0x7f97dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:14.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641311c16a0 0x5641311c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97fba27b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5641310e3ff0 con 0x5641311c16a0 2024-05-09T01:13:14.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97fba27b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5641310827f0 con 0x56413112e160 2024-05-09T01:13:14.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97fba27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5641310dffb0 con 0x5641310444a0 2024-05-09T01:13:14.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97e659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97e659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41490/0 (socket says 172.21.15.37:41490) 2024-05-09T01:13:14.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97e659c700 1 -- 172.21.15.37:0/1893894557 learned_addr learned my addr 172.21.15.37:0/1893894557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:14.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.128+0000 7f97e759e700 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641311c16a0 0x5641311c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.129+0000 7f97e659c700 1 -- 172.21.15.37:0/1893894557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 msgr2=0x5641311c74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:13:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.129+0000 7f97e659c700 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311c74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.129+0000 7f97e659c700 1 -- 172.21.15.37:0/1893894557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641311c16a0 msgr2=0x5641311c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.129+0000 7f97e659c700 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641311c16a0 0x5641311c1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.129+0000 7f97e659c700 1 -- 172.21.15.37:0/1893894557 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56413107a370 con 0x5641310444a0 2024-05-09T01:13:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.129+0000 7f97e659c700 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311c7a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f97dc005b20 tx=0x7f97dc009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17835b7383c4e3a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.130+0000 7f97cd7fa700 1 -- 172.21.15.37:0/1893894557 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc003e20 con 0x5641310444a0 2024-05-09T01:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.130+0000 7f97cd7fa700 1 -- 172.21.15.37:0/1893894557 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97dc00bc40 con 0x5641310444a0 2024-05-09T01:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.130+0000 7f97cd7fa700 1 -- 172.21.15.37:0/1893894557 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc025b30 con 0x5641310444a0 2024-05-09T01:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.131+0000 7f97fba27b80 1 -- 172.21.15.37:0/1893894557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 msgr2=0x5641311c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.131+0000 7f97fba27b80 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311c7a30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f97dc005b20 tx=0x7f97dc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.132+0000 7f97fba27b80 1 -- 172.21.15.37:0/1893894557 shutdown_connections 2024-05-09T01:13:14.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.132+0000 7f97fba27b80 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641311c16a0 0x5641311c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.132+0000 7f97fba27b80 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.132+0000 7f97fba27b80 1 --2- 172.21.15.37:0/1893894557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311c7a30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.132+0000 7f97fba27b80 1 -- 172.21.15.37:0/1893894557 >> 172.21.15.37:0/1893894557 conn(0x5641310a46a0 msgr2=0x5641311bc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:14.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.132+0000 7f97fba27b80 1 -- 172.21.15.37:0/1893894557 shutdown_connections 2024-05-09T01:13:14.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.132+0000 7f97fba27b80 1 -- 172.21.15.37:0/1893894557 wait complete. 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.133+0000 7f97fba27b80 1 -- start start 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.133+0000 7f97fba27b80 1 Processor -- start 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.134+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.134+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.134+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.134+0000 7f97e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.135+0000 7f97fba27b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564130f5fba0 con 0x56413112e160 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.135+0000 7f97fba27b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56413109e150 con 0x5641311c16a0 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.135+0000 7f97fba27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5641311ce1d0 con 0x5641310444a0 2024-05-09T01:13:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.135+0000 7f97fba27b80 10 client.0 _ll_register_callbacks cb 0x564130f556c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:14.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.135+0000 7f97e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39912/0 (socket says 172.21.15.37:39912) 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.135+0000 7f97e659c700 1 -- 172.21.15.37:0/2935460289 learned_addr learned my addr 172.21.15.37:0/2935460289 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.136+0000 7f97e659c700 1 -- 172.21.15.37:0/2935460289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 msgr2=0x5641311cb230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.136+0000 7f97e659c700 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311cb230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.136+0000 7f97e659c700 1 -- 172.21.15.37:0/2935460289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 msgr2=0x5641311cbcb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.136+0000 7f97e659c700 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311cbcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.136+0000 7f97e659c700 1 -- 172.21.15.37:0/2935460289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564130f5f490 con 0x56413112e160 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.136+0000 7f97e659c700 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cb770 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0098e0 tx=0x7f97dc005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83a91fbb9a4f102 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.137+0000 7f97caff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.137+0000 7f97caff5700 1 -- 172.21.15.37:0/2935460289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc035040 con 0x56413112e160 2024-05-09T01:13:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.138+0000 7f97caff5700 1 -- 172.21.15.37:0/2935460289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97dc00b850 con 0x56413112e160 2024-05-09T01:13:14.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.144+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97dc00bc40 con 0x56413112e160 2024-05-09T01:13:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.146+0000 7f97caff5700 1 -- 172.21.15.37:0/2935460289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f97dc00ba50 con 0x56413112e160 2024-05-09T01:13:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.148+0000 7f97fba27b80 10 client.17205 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.148+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5641311d8c10 con 0x56413112e160 2024-05-09T01:13:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.149+0000 7f97caff5700 1 -- 172.21.15.37:0/2935460289 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97dc00bc40 con 0x56413112e160 2024-05-09T01:13:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.149+0000 7f97caff5700 1 -- 172.21.15.37:0/2935460289 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f97dc038070 con 0x56413112e160 2024-05-09T01:13:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.151+0000 7f97fba27b80 10 client.17205 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.151+0000 7f97fba27b80 10 client.17205 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:13:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.151+0000 7f97fba27b80 20 client.17205 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.151+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5641311db0e0 0x5641311dd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.151+0000 7f97fba27b80 4 client.17205 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.151+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641310f19d0 con 0x5641311db0e0 2024-05-09T01:13:14.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.157+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5641311db0e0 0x5641311dd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.159+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5641311db0e0 0x5641311dd500 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=39f13df33270419f server_cookie=c72a36ffac5c0123 in_seq=0 out_seq=0 2024-05-09T01:13:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.160+0000 7f97caff5700 10 client.17205 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:13:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.160+0000 7f97caff5700 1 -- 172.21.15.37:0/2935460289 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5641310f19d0 con 0x5641311db0e0 2024-05-09T01:13:14.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.160+0000 7f97caff5700 10 client.17205 handle_command_reply: tid=0 2024-05-09T01:13:14.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.160+0000 7f97fba27b80 1 client.17205 shutdown 2024-05-09T01:13:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.165+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 msgr2=0x5641311cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.165+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cb770 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0098e0 tx=0x7f97dc005f10 comp rx=0 tx=0).stop 2024-05-09T01:13:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.167+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 shutdown_connections 2024-05-09T01:13:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.167+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x5641311db0e0 0x5641311dd500 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.167+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.167+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.167+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2935460289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cb770 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.167+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 >> 172.21.15.37:0/2935460289 conn(0x5641310a46a0 msgr2=0x5641311bc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.168+0000 7f97caff5700 0 client.17205 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:13:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.168+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 shutdown_connections 2024-05-09T01:13:14.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.168+0000 7f97fba27b80 1 -- 172.21.15.37:0/2935460289 wait complete. 2024-05-09T01:13:14.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.170+0000 7f97fba27b80 20 client.17205 trim_cache size 0 max 16384 2024-05-09T01:13:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.201+0000 7f97fba27b80 1 Processor -- start 2024-05-09T01:13:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.204+0000 7f97fba27b80 1 -- start start 2024-05-09T01:13:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311d73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97fba27b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81b50e0 con 0x56413112e160 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97fba27b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81b6ce0 con 0x5641311c16a0 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97fba27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81b57b0 con 0x5641310444a0 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97e659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39918/0 (socket says 172.21.15.37:39918) 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97e659c700 1 -- 172.21.15.37:0/2419119973 learned_addr learned my addr 172.21.15.37:0/2419119973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97e759e700 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311d73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.205+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.206+0000 7f97e759e700 1 -- 172.21.15.37:0/2419119973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 msgr2=0x5641311bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.206+0000 7f97e759e700 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311bbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.206+0000 7f97e759e700 1 -- 172.21.15.37:0/2419119973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 msgr2=0x5641311cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.206+0000 7f97e759e700 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.206+0000 7f97e759e700 1 -- 172.21.15.37:0/2419119973 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641311cc030 con 0x5641311c16a0 2024-05-09T01:13:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.211+0000 7f97e759e700 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311d73a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009c10 tx=0x7f97e000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d8ebb28950874d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.213+0000 7f97ccff9700 1 -- 172.21.15.37:0/2419119973 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e001a070 con 0x5641311c16a0 2024-05-09T01:13:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.213+0000 7f97ccff9700 1 -- 172.21.15.37:0/2419119973 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97e0004db0 con 0x5641311c16a0 2024-05-09T01:13:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.213+0000 7f97ccff9700 1 -- 172.21.15.37:0/2419119973 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0004020 con 0x5641311c16a0 2024-05-09T01:13:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.214+0000 7f97fba27b80 1 -- 172.21.15.37:0/2419119973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 msgr2=0x5641311d73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.214+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311d73a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009c10 tx=0x7f97e000b040 comp rx=0 tx=0).stop 2024-05-09T01:13:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.214+0000 7f97fba27b80 1 -- 172.21.15.37:0/2419119973 shutdown_connections 2024-05-09T01:13:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.214+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5641311c16a0 0x5641311d73a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.214+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641310444a0 0x5641311bbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.214+0000 7f97fba27b80 1 --2- 172.21.15.37:0/2419119973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56413112e160 0x5641311cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.214+0000 7f97fba27b80 1 -- 172.21.15.37:0/2419119973 >> 172.21.15.37:0/2419119973 conn(0x5641310a46a0 msgr2=0x5641311c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.216+0000 7f97fba27b80 1 -- 172.21.15.37:0/2419119973 shutdown_connections 2024-05-09T01:13:14.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.216+0000 7f97fba27b80 1 -- 172.21.15.37:0/2419119973 wait complete. 2024-05-09T01:13:14.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.216+0000 7f97fba27b80 1 -- start start 2024-05-09T01:13:14.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 1 Processor -- start 2024-05-09T01:13:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641310444a0 0x5641311dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311dd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641311c16a0 0x5641311ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81b6550 con 0x5641310444a0 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81b5e80 con 0x56413112e160 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97e81b30a0 con 0x5641311c16a0 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.217+0000 7f97fba27b80 10 client.0 _ll_register_callbacks cb 0x564130f556c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.218+0000 7f97e659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311dd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.218+0000 7f97e659c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311dd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39550/0 (socket says 172.21.15.37:39550) 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.218+0000 7f97e659c700 1 -- 172.21.15.37:0/200732062 learned_addr learned my addr 172.21.15.37:0/200732062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.218+0000 7f97e759e700 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641311c16a0 0x5641311ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.218+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641310444a0 0x5641311dd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.219+0000 7f97e6d9d700 1 -- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641311c16a0 msgr2=0x5641311ddb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.219+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641311c16a0 0x5641311ddb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.219+0000 7f97e6d9d700 1 -- 172.21.15.37:0/200732062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 msgr2=0x5641311dd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.219+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311dd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.219+0000 7f97e6d9d700 1 -- 172.21.15.37:0/200732062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564131243620 con 0x5641310444a0 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.219+0000 7f97e6d9d700 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641310444a0 0x5641311dd0f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f97d80dff30 tx=0x7f97d80dfdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf4c577c9d0e070 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.220+0000 7f97caff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.220+0000 7f97caff5700 1 -- 172.21.15.37:0/200732062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d80b21a0 con 0x5641310444a0 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.220+0000 7f97caff5700 1 -- 172.21.15.37:0/200732062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f97d80b23d0 con 0x5641310444a0 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.220+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e0004db0 con 0x5641310444a0 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.220+0000 7f97caff5700 1 -- 172.21.15.37:0/200732062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f97d80a9510 con 0x5641310444a0 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.220+0000 7f97fba27b80 10 client.17211 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.220+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x564131244810 con 0x5641310444a0 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97caff5700 1 -- 172.21.15.37:0/200732062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97e0004db0 con 0x5641310444a0 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97caff5700 1 -- 172.21.15.37:0/200732062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f97d80c5050 con 0x5641310444a0 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97fba27b80 10 client.17211 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97fba27b80 10 client.17211 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97fba27b80 20 client.17211 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97fba27b80 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x564131244ea0 0x5641312472c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97fba27b80 4 client.17211 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.221+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5641310eba70 con 0x564131244ea0 2024-05-09T01:13:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.222+0000 7f97e659c700 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x564131244ea0 0x5641312472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:14.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.224+0000 7f97e659c700 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x564131244ea0 0x5641312472c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=226cbd919870e72b server_cookie=ca749d5bb23eaf1b in_seq=0 out_seq=0 2024-05-09T01:13:14.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.224+0000 7f97caff5700 10 client.17211 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:13:14.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.224+0000 7f97caff5700 1 -- 172.21.15.37:0/200732062 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5641310eba70 con 0x564131244ea0 2024-05-09T01:13:14.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.224+0000 7f97caff5700 10 client.17211 handle_command_reply: tid=0 2024-05-09T01:13:14.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 client.17211 shutdown 2024-05-09T01:13:14.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641310444a0 msgr2=0x5641311dd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641310444a0 0x5641311dd0f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f97d80dff30 tx=0x7f97d80dfdb0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 shutdown_connections 2024-05-09T01:13:14.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x564131244ea0 0x5641312472c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641311c16a0 0x5641311ddb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5641310444a0 0x5641311dd0f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97caff5700 0 client.17211 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 --2- 172.21.15.37:0/200732062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56413112e160 0x5641311dd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.225+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 >> 172.21.15.37:0/200732062 conn(0x5641310a46a0 msgr2=0x5641311c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.226+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 shutdown_connections 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.226+0000 7f97fba27b80 1 -- 172.21.15.37:0/200732062 wait complete. 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.227+0000 7f97fba27b80 20 client.17211 trim_cache size 0 max 16384 2024-05-09T01:13:14.228 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.227+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97d00b2900 msgr2=0x7f97d00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.227+0000 7f97ed011700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97d00b2900 0x7f97d00b4e10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f97dc000c00 tx=0x7f97dc01a040 comp rx=0 tx=0).stop 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.227+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97e8104610 msgr2=0x7f97e810e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.227+0000 7f97ed011700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97e8104610 0x7f97e810e390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f97d800e9f0 tx=0x7f97d800ed00 comp rx=0 tx=0).stop 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 shutdown_connections 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f97d00b2900 0x7f97d00b4e10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97e8109890 0x7f97e810ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97e8104610 0x7f97e810e390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 --2- 172.21.15.37:0/3510183655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97e8108f40 0x7f97e810e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 >> 172.21.15.37:0/3510183655 conn(0x7f97e807af70 msgr2=0x7f97e8101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 shutdown_connections 2024-05-09T01:13:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:14.228+0000 7f97ed011700 1 -- 172.21.15.37:0/3510183655 wait complete. 2024-05-09T01:13:14.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:14 smithi037 ceph-mon[30122]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-05-09T01:13:14.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:14 smithi136 ceph-mon[34110]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-05-09T01:13:14.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:14 smithi151 ceph-mon[34780]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 7.0 MiB/s wr, 656 op/s 2024-05-09T01:13:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 655.0 s, 1530.0 tps, lat 65.766 ms stddev 79.504 2024-05-09T01:13:15.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:13:15.679 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:16.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:16 smithi136 ceph-mon[34110]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-05-09T01:13:16.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:16 smithi037 ceph-mon[30122]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-05-09T01:13:16.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:16 smithi151 ceph-mon[34780]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 639 op/s 2024-05-09T01:13:18.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.018+0000 7f349b39c700 1 -- 172.21.15.37:0/1886703488 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f349410b280 msgr2=0x7f349411d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.018+0000 7f349b39c700 1 --2- 172.21.15.37:0/1886703488 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f349410b280 0x7f349411d3f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f348c009f90 tx=0x7f348c00b330 comp rx=0 tx=0).stop 2024-05-09T01:13:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.020+0000 7f349b39c700 1 -- 172.21.15.37:0/1886703488 shutdown_connections 2024-05-09T01:13:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.020+0000 7f349b39c700 1 --2- 172.21.15.37:0/1886703488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f349411d930 0x7f349411fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.020+0000 7f349b39c700 1 --2- 172.21.15.37:0/1886703488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 0x7f349410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.020+0000 7f349b39c700 1 --2- 172.21.15.37:0/1886703488 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f349410b280 0x7f349411d3f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.020+0000 7f349b39c700 1 -- 172.21.15.37:0/1886703488 >> 172.21.15.37:0/1886703488 conn(0x7f349406f4d0 msgr2=0x7f349406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:18.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.023+0000 7f349b39c700 1 -- 172.21.15.37:0/1886703488 shutdown_connections 2024-05-09T01:13:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.023+0000 7f349b39c700 1 -- 172.21.15.37:0/1886703488 wait complete. 2024-05-09T01:13:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.024+0000 7f349b39c700 1 Processor -- start 2024-05-09T01:13:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.025+0000 7f349b39c700 1 -- start start 2024-05-09T01:13:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.025+0000 7f349b39c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 0x7f349411ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.025+0000 7f349b39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f349410b280 0x7f3494116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.025+0000 7f349b39c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f349411d930 0x7f3494117510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.025+0000 7f349b39c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34941130a0 con 0x7f349410a930 2024-05-09T01:13:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.025+0000 7f349b39c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3494112f20 con 0x7f349411d930 2024-05-09T01:13:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.025+0000 7f349b39c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3494113220 con 0x7f349410b280 2024-05-09T01:13:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.026+0000 7f3499138700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 0x7f349411ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.026+0000 7f3499138700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 0x7f349411ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39932/0 (socket says 172.21.15.37:39932) 2024-05-09T01:13:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.026+0000 7f3499138700 1 -- 172.21.15.37:0/3061285963 learned_addr learned my addr 172.21.15.37:0/3061285963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.027+0000 7f3499138700 1 -- 172.21.15.37:0/3061285963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f349410b280 msgr2=0x7f3494116fd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:13:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.027+0000 7f3499138700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f349410b280 0x7f3494116fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.027+0000 7f3499138700 1 -- 172.21.15.37:0/3061285963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f349411d930 msgr2=0x7f3494117510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.027+0000 7f3499138700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f349411d930 0x7f3494117510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.027+0000 7f3499138700 1 -- 172.21.15.37:0/3061285963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3494117a50 con 0x7f349410a930 2024-05-09T01:13:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.027+0000 7f3499138700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 0x7f349411ceb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f349000eb30 tx=0x7f349000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.028+0000 7f348a7fc700 1 -- 172.21.15.37:0/3061285963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349000cd40 con 0x7f349410a930 2024-05-09T01:13:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.028+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3494117d40 con 0x7f349410a930 2024-05-09T01:13:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.028+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34941bee50 con 0x7f349410a930 2024-05-09T01:13:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.034+0000 7f34a9db2b80 1 Processor -- start 2024-05-09T01:13:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.035+0000 7f34a9db2b80 1 -- start start 2024-05-09T01:13:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.035+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.035+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24bb1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.036+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 0x55df24bab810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.036+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df24ace0a0 con 0x55df24a2e4a0 2024-05-09T01:13:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.036+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55df24a739a0 con 0x55df24aa8d00 2024-05-09T01:13:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.036+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55df24aca060 con 0x55df24bab400 2024-05-09T01:13:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.036+0000 7f3499939700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.036+0000 7f3499939700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39570/0 (socket says 172.21.15.37:39570) 2024-05-09T01:13:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.036+0000 7f3499939700 1 -- 172.21.15.37:0/3847607651 learned_addr learned my addr 172.21.15.37:0/3847607651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.037+0000 7f348a7fc700 1 -- 172.21.15.37:0/3061285963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34900218e0 con 0x7f349410a930 2024-05-09T01:13:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.037+0000 7f3499939700 1 -- 172.21.15.37:0/3847607651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 msgr2=0x55df24bab810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:13:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.037+0000 7f3499939700 1 --2- 172.21.15.37:0/3847607651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 0x55df24bab810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.037+0000 7f3499939700 1 -- 172.21.15.37:0/3847607651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 msgr2=0x55df24bb1780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:13:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.037+0000 7f3499939700 1 --2- 172.21.15.37:0/3847607651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24bb1780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.038+0000 7f3499939700 1 -- 172.21.15.37:0/3847607651 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df24a64500 con 0x55df24aa8d00 2024-05-09T01:13:18.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.039+0000 7f3499939700 1 --2- 172.21.15.37:0/3847607651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb1240 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f348400ba40 tx=0x7f348400bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f60df2d6c35005ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:18.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.039+0000 7f348a7fc700 1 -- 172.21.15.37:0/3061285963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490010690 con 0x7f349410a930 2024-05-09T01:13:18.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.039+0000 7f347f7fe700 1 -- 172.21.15.37:0/3847607651 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484016070 con 0x55df24aa8d00 2024-05-09T01:13:18.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.039+0000 7f347f7fe700 1 -- 172.21.15.37:0/3847607651 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f348400d7d0 con 0x55df24aa8d00 2024-05-09T01:13:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.039+0000 7f347f7fe700 1 -- 172.21.15.37:0/3847607651 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484005300 con 0x55df24aa8d00 2024-05-09T01:13:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.039+0000 7f348a7fc700 1 -- 172.21.15.37:0/3061285963 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f34900108f0 con 0x7f349410a930 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.040+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3847607651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 msgr2=0x55df24bb1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.040+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3847607651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb1240 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f348400ba40 tx=0x7f348400bd50 comp rx=0 tx=0).stop 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f348a7fc700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34800b2790 0x7f34800b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3847607651 shutdown_connections 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3847607651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 0x55df24bab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3847607651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb1240 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3847607651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24bb1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3847607651 >> 172.21.15.37:0/3847607651 conn(0x55df24a31f70 msgr2=0x55df24ba6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f348a7fc700 1 -- 172.21.15.37:0/3061285963 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f34900e2430 con 0x7f349410a930 2024-05-09T01:13:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3847607651 shutdown_connections 2024-05-09T01:13:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.041+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3847607651 wait complete. 2024-05-09T01:13:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.042+0000 7f34a9db2b80 1 -- start start 2024-05-09T01:13:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.042+0000 7f34a9db2b80 1 Processor -- start 2024-05-09T01:13:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f3499138700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34800b2790 0x7f34800b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24a2e4a0 0x55df24bb4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bb5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df24bac1b0 con 0x55df24bab400 2024-05-09T01:13:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55df24a68b20 con 0x55df24aa8d00 2024-05-09T01:13:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55df24bb8020 con 0x55df24a2e4a0 2024-05-09T01:13:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.043+0000 7f34a9db2b80 10 client.0 _ll_register_callbacks cb 0x55df2493f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24a2e4a0 0x55df24bb4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24a2e4a0 0x55df24bb4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41536/0 (socket says 172.21.15.37:41536) 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 -- 172.21.15.37:0/3226103311 learned_addr learned my addr 172.21.15.37:0/3226103311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bb5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499138700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34800b2790 0x7f34800b4ca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55df24ba7c90 tx=0x7f3490021a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3498937700 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 -- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 msgr2=0x55df24bb5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 -- 172.21.15.37:0/3226103311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 msgr2=0x55df24bb5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bb5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.044+0000 7f3499939700 1 -- 172.21.15.37:0/3226103311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df24949490 con 0x55df24a2e4a0 2024-05-09T01:13:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.045+0000 7f3499939700 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24a2e4a0 0x55df24bb4fd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3484004b00 tx=0x7f348400b520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de454878b4205276 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.045+0000 7f347cff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.045+0000 7f347cff9700 1 -- 172.21.15.37:0/3226103311 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484016040 con 0x55df24a2e4a0 2024-05-09T01:13:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.045+0000 7f347cff9700 1 -- 172.21.15.37:0/3226103311 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f34840050a0 con 0x55df24a2e4a0 2024-05-09T01:13:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.045+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f348400d7d0 con 0x55df24a2e4a0 2024-05-09T01:13:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.046+0000 7f347cff9700 1 -- 172.21.15.37:0/3226103311 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f34840052a0 con 0x55df24a2e4a0 2024-05-09T01:13:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.046+0000 7f34a9db2b80 10 client.27046 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.046+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55df24bc2870 con 0x55df24a2e4a0 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.046+0000 7f347cff9700 1 -- 172.21.15.37:0/3226103311 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f348400d7d0 con 0x55df24a2e4a0 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f347cff9700 1 -- 172.21.15.37:0/3226103311 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f34840109a0 con 0x55df24a2e4a0 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f34a9db2b80 10 client.27046 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f34a9db2b80 10 client.27046 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f34a9db2b80 20 client.27046 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24bc4da0 0x55df24bc71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f34a9db2b80 4 client.27046 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df24adba80 con 0x55df24bc4da0 2024-05-09T01:13:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.047+0000 7f3498937700 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24bc4da0 0x55df24bc71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.048+0000 7f347cff9700 10 client.27046 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:13:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.048+0000 7f3498937700 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24bc4da0 0x55df24bc71c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=390a408fbc01176f server_cookie=70ef0475f4616832 in_seq=0 out_seq=0 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.048+0000 7f347cff9700 1 -- 172.21.15.37:0/3226103311 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55df24adba80 con 0x55df24bc4da0 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.048+0000 7f347cff9700 10 client.27046 handle_command_reply: tid=0 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 client.27046 shutdown 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24a2e4a0 msgr2=0x55df24bb4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24a2e4a0 0x55df24bb4fd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3484004b00 tx=0x7f348400b520 comp rx=0 tx=0).stop 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 shutdown_connections 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bb5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24a2e4a0 0x55df24bb4fd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24bc4da0 0x55df24bc71c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/3226103311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bb5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f347cff9700 0 client.27046 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:13:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 >> 172.21.15.37:0/3226103311 conn(0x55df24a31f70 msgr2=0x55df24b9fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 shutdown_connections 2024-05-09T01:13:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 1 -- 172.21.15.37:0/3226103311 wait complete. 2024-05-09T01:13:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.049+0000 7f34a9db2b80 20 client.27046 trim_cache size 0 max 16384 2024-05-09T01:13:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 Processor -- start 2024-05-09T01:13:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 -- start start 2024-05-09T01:13:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24ba0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bc0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 0x55df24bb5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f347800d230 con 0x55df24a2e4a0 2024-05-09T01:13:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f347800ee30 con 0x55df24aa8d00 2024-05-09T01:13:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.072+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f347800d900 con 0x55df24bab400 2024-05-09T01:13:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24ba0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24ba0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39942/0 (socket says 172.21.15.37:39942) 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 -- 172.21.15.37:0/1021457792 learned_addr learned my addr 172.21.15.37:0/1021457792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3498937700 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bc0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 0x55df24bb5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 -- 172.21.15.37:0/1021457792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 msgr2=0x55df24bb5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 0x55df24bb5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 -- 172.21.15.37:0/1021457792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 msgr2=0x55df24bc0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bc0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.073+0000 7f3499939700 1 -- 172.21.15.37:0/1021457792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df24bb3f10 con 0x55df24a2e4a0 2024-05-09T01:13:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.074+0000 7f3499939700 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24ba0700 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f348400b300 tx=0x7f348400d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f9d7303f5a868 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.074+0000 7f347effd700 1 -- 172.21.15.37:0/1021457792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484016040 con 0x55df24a2e4a0 2024-05-09T01:13:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.074+0000 7f347effd700 1 -- 172.21.15.37:0/1021457792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f348401e040 con 0x55df24a2e4a0 2024-05-09T01:13:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.074+0000 7f347effd700 1 -- 172.21.15.37:0/1021457792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484005440 con 0x55df24a2e4a0 2024-05-09T01:13:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.076+0000 7f34a9db2b80 1 -- 172.21.15.37:0/1021457792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 msgr2=0x55df24ba0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.076+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24ba0700 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f348400b300 tx=0x7f348400d5c0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.076+0000 7f34a9db2b80 1 -- 172.21.15.37:0/1021457792 shutdown_connections 2024-05-09T01:13:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.076+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24bab400 0x55df24bb5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.076+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24a2e4a0 0x55df24ba0700 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.076+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/1021457792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24aa8d00 0x55df24bc0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.076+0000 7f34a9db2b80 1 -- 172.21.15.37:0/1021457792 >> 172.21.15.37:0/1021457792 conn(0x55df24a31f70 msgr2=0x55df24b9fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.077+0000 7f34a9db2b80 1 -- 172.21.15.37:0/1021457792 shutdown_connections 2024-05-09T01:13:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.077+0000 7f34a9db2b80 1 -- 172.21.15.37:0/1021457792 wait complete. 2024-05-09T01:13:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.077+0000 7f34a9db2b80 1 -- start start 2024-05-09T01:13:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.077+0000 7f34a9db2b80 1 Processor -- start 2024-05-09T01:13:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24a2e4a0 0x55df24bb2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24aa8d00 0x55df24bbd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f34a9db2b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bbd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f347800e6a0 con 0x55df24bab400 2024-05-09T01:13:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f347800dfd0 con 0x55df24a2e4a0 2024-05-09T01:13:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f34a9db2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f347800b1d0 con 0x55df24aa8d00 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24a2e4a0 0x55df24bb2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f34a9db2b80 10 client.0 _ll_register_callbacks cb 0x55df2493f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24a2e4a0 0x55df24bb2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39606/0 (socket says 172.21.15.37:39606) 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 -- 172.21.15.37:0/595243632 learned_addr learned my addr 172.21.15.37:0/595243632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3498937700 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24aa8d00 0x55df24bbd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bbd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 -- 172.21.15.37:0/595243632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24aa8d00 msgr2=0x55df24bbd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24aa8d00 0x55df24bbd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 -- 172.21.15.37:0/595243632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 msgr2=0x55df24bbd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bbd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.078+0000 7f3499939700 1 -- 172.21.15.37:0/595243632 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df24bb1430 con 0x55df24a2e4a0 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f3499939700 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24a2e4a0 0x55df24bb2d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f348400b580 tx=0x7f3484005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6527200ec2b85fb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f347cff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f347cff9700 1 -- 172.21.15.37:0/595243632 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484016030 con 0x55df24a2e4a0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f347cff9700 1 -- 172.21.15.37:0/595243632 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3484004040 con 0x55df24a2e4a0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f348401e040 con 0x55df24a2e4a0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f347cff9700 1 -- 172.21.15.37:0/595243632 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f3484005740 con 0x55df24a2e4a0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f34a9db2b80 10 client.27083 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55df24c2e750 con 0x55df24a2e4a0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.079+0000 7f347cff9700 1 -- 172.21.15.37:0/595243632 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f348401e040 con 0x55df24a2e4a0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f347cff9700 1 -- 172.21.15.37:0/595243632 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f3484044020 con 0x55df24a2e4a0 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f34a9db2b80 10 client.27083 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f34a9db2b80 10 client.27083 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f34a9db2b80 20 client.27083 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24c2ed60 0x55df24c31180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f34a9db2b80 4 client.27083 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df24ad5b20 con 0x55df24c2ed60 2024-05-09T01:13:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.080+0000 7f3498937700 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24c2ed60 0x55df24c31180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f347cff9700 10 client.27083 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:13:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f3498937700 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24c2ed60 0x55df24c31180 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36e137601c70dd57 server_cookie=91491b826839227 in_seq=0 out_seq=0 2024-05-09T01:13:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f347cff9700 1 -- 172.21.15.37:0/595243632 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df24ad5b20 con 0x55df24c2ed60 2024-05-09T01:13:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f347cff9700 10 client.27083 handle_command_reply: tid=0 2024-05-09T01:13:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 client.27083 shutdown 2024-05-09T01:13:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24a2e4a0 msgr2=0x55df24bb2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24a2e4a0 0x55df24bb2d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f348400b580 tx=0x7f3484005fa0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 shutdown_connections 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df24bab400 0x55df24bbd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55df24c2ed60 0x55df24c31180 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55df24a2e4a0 0x55df24bb2d00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 --2- 172.21.15.37:0/595243632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55df24aa8d00 0x55df24bbd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 >> 172.21.15.37:0/595243632 conn(0x55df24a31f70 msgr2=0x55df24baa3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.082+0000 7f347cff9700 0 client.27083 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 shutdown_connections 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f34a9db2b80 1 -- 172.21.15.37:0/595243632 wait complete. 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f34a9db2b80 20 client.27083 trim_cache size 0 max 16384 2024-05-09T01:13:18.086 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:13:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34800b2790 msgr2=0x7f34800b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34800b2790 0x7f34800b4ca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x55df24ba7c90 tx=0x7f3490021a90 comp rx=0 tx=0).stop 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 msgr2=0x7f349411ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 0x7f349411ceb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f349000eb30 tx=0x7f349000eef0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 shutdown_connections 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f34800b2790 0x7f34800b4ca0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f349411d930 0x7f3494117510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f349410a930 0x7f349411ceb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 --2- 172.21.15.37:0/3061285963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f349410b280 0x7f3494116fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.083+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 >> 172.21.15.37:0/3061285963 conn(0x7f349406f4d0 msgr2=0x7f349411df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.084+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 shutdown_connections 2024-05-09T01:13:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:18.084+0000 7f349b39c700 1 -- 172.21.15.37:0/3061285963 wait complete. 2024-05-09T01:13:18.813 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:18 smithi037 ceph-mon[30122]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 695 op/s 2024-05-09T01:13:18.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:13:18.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:18 smithi136 ceph-mon[34110]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 695 op/s 2024-05-09T01:13:18.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:18 smithi151 ceph-mon[34780]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 695 op/s 2024-05-09T01:13:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 660.0 s, 1841.8 tps, lat 53.955 ms stddev 69.945 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/3152037845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0108ac0 msgr2=0x7fd8e010aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/3152037845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0108ac0 0x7fd8e010aee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009be0 tx=0x7fd8d802a6d0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/3152037845 shutdown_connections 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/3152037845 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0108ac0 0x7fd8e010aee0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/3152037845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0103dc0 0x7fd8e01041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/3152037845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e0102b80 0x7fd8e0103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/3152037845 >> 172.21.15.37:0/3152037845 conn(0x7fd8e00fdd90 msgr2=0x7fd8e0100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:20.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/3152037845 shutdown_connections 2024-05-09T01:13:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.294+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/3152037845 wait complete. 2024-05-09T01:13:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 Processor -- start 2024-05-09T01:13:20.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 -- start start 2024-05-09T01:13:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0102b80 0x7fd8e006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0103dc0 0x7fd8e019f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e0108ac0 0x7fd8e01a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e010e690 con 0x7fd8e0108ac0 2024-05-09T01:13:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e010e510 con 0x7fd8e0103dc0 2024-05-09T01:13:20.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8e5a0d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e010e810 con 0x7fd8e0102b80 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e0108ac0 0x7fd8e01a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8de7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0103dc0 0x7fd8e019f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e0108ac0 0x7fd8e01a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39968/0 (socket says 172.21.15.37:39968) 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0102b80 0x7fd8e006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.295+0000 7fd8df7fe640 1 -- 172.21.15.37:0/756940858 learned_addr learned my addr 172.21.15.37:0/756940858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.296+0000 7fd8de7fc640 1 -- 172.21.15.37:0/756940858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0102b80 msgr2=0x7fd8e006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.296+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0102b80 0x7fd8e006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.296+0000 7fd8de7fc640 1 -- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e0108ac0 msgr2=0x7fd8e01a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.296+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e0108ac0 0x7fd8e01a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.296+0000 7fd8de7fc640 1 -- 172.21.15.37:0/756940858 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e01a1e20 con 0x7fd8e0103dc0 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.297+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0103dc0 0x7fd8e019f0b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800e9f0 tx=0x7fd8c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.297+0000 7fd8e4a0b640 1 -- 172.21.15.37:0/756940858 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800ccc0 con 0x7fd8e0103dc0 2024-05-09T01:13:20.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.297+0000 7fd8e4a0b640 1 -- 172.21.15.37:0/756940858 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c80108e0 con 0x7fd8e0103dc0 2024-05-09T01:13:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.298+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e0198ee0 con 0x7fd8e0103dc0 2024-05-09T01:13:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.298+0000 7fd8e4a0b640 1 -- 172.21.15.37:0/756940858 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800ccc0 con 0x7fd8e0103dc0 2024-05-09T01:13:20.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.298+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e0199430 con 0x7fd8e0103dc0 2024-05-09T01:13:20.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.301+0000 7fd8ec995740 1 Processor -- start 2024-05-09T01:13:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.301+0000 7fd8e4a0b640 1 -- 172.21.15.37:0/756940858 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd8c8010a90 con 0x7fd8e0103dc0 2024-05-09T01:13:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.301+0000 7fd8ec995740 1 -- start start 2024-05-09T01:13:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff30d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff31290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff38190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8ec995740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad0fe8c7c0 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8ec995740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ad0fe280e0 con 0x55ad0fb841b0 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8ec995740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad0fe88780 con 0x55ad0fb634d0 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff30d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff31290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff30d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39628/0 (socket says 172.21.15.37:39628) 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 -- 172.21.15.37:0/3420935276 learned_addr learned my addr 172.21.15.37:0/3420935276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff38190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 -- 172.21.15.37:0/3420935276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 msgr2=0x55ad0ff38190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff38190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 -- 172.21.15.37:0/3420935276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 msgr2=0x55ad0ff31290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff31290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 -- 172.21.15.37:0/3420935276 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0fe517c0 con 0x55ad0fb841b0 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff38190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:20.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.302+0000 7fd8df7fe640 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff30d10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80093d0 tx=0x7fd8d80303a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee84ac6d5699a6f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.303+0000 7fd8e4a0b640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8cc0b2bf0 0x7fd8cc0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.303+0000 7fd8d5ffb640 1 -- 172.21.15.37:0/3420935276 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8041030 con 0x55ad0fb841b0 2024-05-09T01:13:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.303+0000 7fd8deffd640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8cc0b2bf0 0x7fd8cc0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.303+0000 7fd8e4a0b640 1 -- 172.21.15.37:0/756940858 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd8c800cac0 con 0x7fd8e0103dc0 2024-05-09T01:13:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.303+0000 7fd8d5ffb640 1 -- 172.21.15.37:0/3420935276 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d8030680 con 0x55ad0fb841b0 2024-05-09T01:13:20.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.303+0000 7fd8d5ffb640 1 -- 172.21.15.37:0/3420935276 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8036040 con 0x55ad0fb841b0 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 -- 172.21.15.37:0/3420935276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 msgr2=0x55ad0ff30d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff30d10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80093d0 tx=0x7fd8d80303a0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8deffd640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8cc0b2bf0 0x7fd8cc0b5100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55ad0ff320f0 tx=0x7fd8d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 -- 172.21.15.37:0/3420935276 shutdown_connections 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff38190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff31290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3420935276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff30d10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 -- 172.21.15.37:0/3420935276 >> 172.21.15.37:0/3420935276 conn(0x55ad0fb78300 msgr2=0x55ad0ff2c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 -- 172.21.15.37:0/3420935276 shutdown_connections 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 -- 172.21.15.37:0/3420935276 wait complete. 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.304+0000 7fd8ec995740 1 -- start start 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 1 Processor -- start 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff3aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff3b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad0ff38b80 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ad0fe139c0 con 0x55ad0fb841b0 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad0ff38d00 con 0x55ad0fb634d0 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8ec995740 10 client.0 _ll_register_callbacks cb 0x55ad0fe40020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff3aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff3aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39992/0 (socket says 172.21.15.37:39992) 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8deffd640 1 -- 172.21.15.37:0/206706232 learned_addr learned my addr 172.21.15.37:0/206706232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8df7fe640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff3b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8deffd640 1 -- 172.21.15.37:0/206706232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 msgr2=0x55ad0ff3b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8deffd640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff3b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.305+0000 7fd8deffd640 1 -- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 msgr2=0x55ad0ff41f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.306+0000 7fd8deffd640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.306+0000 7fd8deffd640 1 -- 172.21.15.37:0/206706232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0fe3a1f0 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.306+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff3b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.307+0000 7fd8deffd640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff3aae0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0005fd0 tx=0x7fd8d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e2e75879faeb46 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.307+0000 7fd8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.307+0000 7fd8beffd640 1 -- 172.21.15.37:0/206706232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d002d060 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.307+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8d8030680 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.307+0000 7fd8beffd640 1 -- 172.21.15.37:0/206706232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd8d0018030 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.308+0000 7fd8beffd640 1 -- 172.21.15.37:0/206706232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd8d0009e00 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.308+0000 7fd8ec995740 10 client.17238 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.308+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ad0fbef790 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.308+0000 7fd8beffd640 1 -- 172.21.15.37:0/206706232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d00288d0 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.308+0000 7fd8beffd640 1 -- 172.21.15.37:0/206706232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fd8d000f720 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.308+0000 7fd8ec995740 10 client.17238 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.308+0000 7fd8ec995740 10 client.17238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.309+0000 7fd8ec995740 20 client.17238 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.309+0000 7fd8ec995740 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb42d80 0x55ad0ff485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.309+0000 7fd8ec995740 4 client.17238 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.309+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd8d8030680 con 0x55ad0fb42d80 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.309+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb42d80 0x55ad0ff485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.309+0000 7fd8beffd640 10 client.17238 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.309+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb42d80 0x55ad0ff485a0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d07af70eaffb3c07 server_cookie=149e43d07273a292 in_seq=0 out_seq=0 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.310+0000 7fd8beffd640 1 -- 172.21.15.37:0/206706232 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fd8d8030680 con 0x55ad0fb42d80 2024-05-09T01:13:20.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.310+0000 7fd8beffd640 10 client.17238 handle_command_reply: tid=0 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.310+0000 7fd8ec995740 1 client.17238 shutdown 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 msgr2=0x55ad0ff3aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff3aae0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0005fd0 tx=0x7fd8d0004730 comp rx=0 tx=0).stop 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 shutdown_connections 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb42d80 0x55ad0ff485a0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff3b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 --2- 172.21.15.37:0/206706232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff3aae0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 >> 172.21.15.37:0/206706232 conn(0x55ad0fb78300 msgr2=0x55ad0ff22700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8beffd640 0 client.17238 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 shutdown_connections 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 1 -- 172.21.15.37:0/206706232 wait complete. 2024-05-09T01:13:20.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.311+0000 7fd8ec995740 20 client.17238 trim_cache size 0 max 16384 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.338+0000 7fd8ec995740 1 Processor -- start 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.338+0000 7fd8ec995740 1 -- start start 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.338+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff22e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff41f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff42450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8ec995740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e01a8fb0 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8ec995740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e01aabb0 con 0x55ad0fb841b0 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8ec995740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e01a9680 con 0x55ad0fb634d0 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff22e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff22e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39994/0 (socket says 172.21.15.37:39994) 2024-05-09T01:13:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 -- 172.21.15.37:0/2640617607 learned_addr learned my addr 172.21.15.37:0/2640617607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 -- 172.21.15.37:0/2640617607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 msgr2=0x55ad0ff41f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:13:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 --2- 172.21.15.37:0/2640617607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff41f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 -- 172.21.15.37:0/2640617607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 msgr2=0x55ad0ff42450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 --2- 172.21.15.37:0/2640617607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff42450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.339+0000 7fd8deffd640 1 -- 172.21.15.37:0/2640617607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0fc665f0 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.340+0000 7fd8deffd640 1 --2- 172.21.15.37:0/2640617607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff22e10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000fbc0 tx=0x7fd8d0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465fedf2ee7f7007 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.342+0000 7fd8d57fa640 1 -- 172.21.15.37:0/2640617607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00313a0 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.342+0000 7fd8d57fa640 1 -- 172.21.15.37:0/2640617607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d000f870 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.344+0000 7fd8ec995740 1 -- 172.21.15.37:0/2640617607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 msgr2=0x55ad0ff22e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.344+0000 7fd8ec995740 1 --2- 172.21.15.37:0/2640617607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff22e10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000fbc0 tx=0x7fd8d0005f30 comp rx=0 tx=0).stop 2024-05-09T01:13:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.348+0000 7fd8ec995740 1 -- 172.21.15.37:0/2640617607 shutdown_connections 2024-05-09T01:13:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.348+0000 7fd8ec995740 1 --2- 172.21.15.37:0/2640617607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb841b0 0x55ad0ff42450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.348+0000 7fd8ec995740 1 --2- 172.21.15.37:0/2640617607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff41f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.348+0000 7fd8ec995740 1 --2- 172.21.15.37:0/2640617607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff22e10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.348+0000 7fd8ec995740 1 -- 172.21.15.37:0/2640617607 >> 172.21.15.37:0/2640617607 conn(0x55ad0fb78300 msgr2=0x55ad0ff22700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.356+0000 7fd8ec995740 1 -- 172.21.15.37:0/2640617607 shutdown_connections 2024-05-09T01:13:20.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.357+0000 7fd8ec995740 1 -- 172.21.15.37:0/2640617607 wait complete. 2024-05-09T01:13:20.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.357+0000 7fd8ec995740 1 -- start start 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.357+0000 7fd8ec995740 1 Processor -- start 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.359+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff40600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.359+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff40b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.359+0000 7fd8ec995740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.359+0000 7fd8ec995740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e01aa420 con 0x55ad0fb841b0 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.359+0000 7fd8ec995740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e01a9d50 con 0x55ad0fb5b2f0 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.359+0000 7fd8ec995740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e01a6fb0 con 0x55ad0fb634d0 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.359+0000 7fd8ec995740 10 client.0 _ll_register_callbacks cb 0x7fd8d001d880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.360+0000 7fd8df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.360+0000 7fd8df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39996/0 (socket says 172.21.15.37:39996) 2024-05-09T01:13:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.360+0000 7fd8df7fe640 1 -- 172.21.15.37:0/3332496484 learned_addr learned my addr 172.21.15.37:0/3332496484 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.361+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff40b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.362+0000 7fd8deffd640 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff40600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.362+0000 7fd8de7fc640 1 -- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb5b2f0 msgr2=0x55ad0ff40600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.362+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff40600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.362+0000 7fd8de7fc640 1 -- 172.21.15.37:0/3332496484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb841b0 msgr2=0x55ad0ff41a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.362+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.362+0000 7fd8de7fc640 1 -- 172.21.15.37:0/3332496484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0fe50ed0 con 0x55ad0fb634d0 2024-05-09T01:13:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.368+0000 7fd8de7fc640 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff40b40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80dfa70 tx=0x7fd8c80a91c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba9ff18dcb0e9a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.371+0000 7fd8beffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.371+0000 7fd8beffd640 1 -- 172.21.15.37:0/3332496484 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80b23a0 con 0x55ad0fb634d0 2024-05-09T01:13:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.371+0000 7fd8beffd640 1 -- 172.21.15.37:0/3332496484 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd8c800ccc0 con 0x55ad0fb634d0 2024-05-09T01:13:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.371+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8d000f870 con 0x55ad0fb634d0 2024-05-09T01:13:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8beffd640 1 -- 172.21.15.37:0/3332496484 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd8c80a5880 con 0x55ad0fb634d0 2024-05-09T01:13:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 10 client.27067 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:20.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ad0ff29c10 con 0x55ad0fb634d0 2024-05-09T01:13:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8beffd640 1 -- 172.21.15.37:0/3332496484 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8d000f870 con 0x55ad0fb634d0 2024-05-09T01:13:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8beffd640 1 -- 172.21.15.37:0/3332496484 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fd8c80a8850 con 0x55ad0fb634d0 2024-05-09T01:13:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 10 client.27067 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 10 client.27067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 20 client.27067 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb181c0 0x55ad0ff2c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:20.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 4 client.27067 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:13:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.373+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad0fe9a3d0 con 0x55ad0fb181c0 2024-05-09T01:13:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.375+0000 7fd8deffd640 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb181c0 0x55ad0ff2c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.376+0000 7fd8deffd640 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb181c0 0x55ad0ff2c740 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a813f532cc4136b server_cookie=39b33120dff0d506 in_seq=0 out_seq=0 2024-05-09T01:13:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.376+0000 7fd8beffd640 10 client.27067 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.386+0000 7fd8beffd640 1 -- 172.21.15.37:0/3332496484 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ad0fe9a3d0 con 0x55ad0fb181c0 2024-05-09T01:13:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.386+0000 7fd8beffd640 10 client.27067 handle_command_reply: tid=0 2024-05-09T01:13:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.387+0000 7fd8ec995740 1 client.27067 shutdown 2024-05-09T01:13:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.387+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 msgr2=0x55ad0ff40b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.387+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff40b40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80dfa70 tx=0x7fd8c80a91c0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 shutdown_connections 2024-05-09T01:13:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad0fb181c0 0x55ad0ff2c740 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad0fb841b0 0x55ad0ff41a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad0fb634d0 0x55ad0ff40b40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 --2- 172.21.15.37:0/3332496484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad0fb5b2f0 0x55ad0ff40600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 >> 172.21.15.37:0/3332496484 conn(0x55ad0fb78300 msgr2=0x55ad0ff2f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8beffd640 0 client.27067 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 shutdown_connections 2024-05-09T01:13:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 1 -- 172.21.15.37:0/3332496484 wait complete. 2024-05-09T01:13:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8ec995740 20 client.27067 trim_cache size 0 max 16384 2024-05-09T01:13:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:13:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:13:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8cc0b2bf0 msgr2=0x7fd8cc0b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8cc0b2bf0 0x7fd8cc0b5100 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55ad0ff320f0 tx=0x7fd8d0009260 comp rx=0 tx=0).stop 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0103dc0 msgr2=0x7fd8e019f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0103dc0 0x7fd8e019f0b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800e9f0 tx=0x7fd8c800eeb0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 shutdown_connections 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8e0108ac0 0x7fd8e01a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd8cc0b2bf0 0x7fd8cc0b5100 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8e0103dc0 0x7fd8e019f0b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 --2- 172.21.15.37:0/756940858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0102b80 0x7fd8e006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.388+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 >> 172.21.15.37:0/756940858 conn(0x7fd8e00fdd90 msgr2=0x7fd8e0104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.389+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 shutdown_connections 2024-05-09T01:13:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:20.389+0000 7fd8e5a0d640 1 -- 172.21.15.37:0/756940858 wait complete. 2024-05-09T01:13:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:20 smithi037 ceph-mon[30122]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 612 op/s 2024-05-09T01:13:20.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:20 smithi136 ceph-mon[34110]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 612 op/s 2024-05-09T01:13:20.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:20 smithi151 ceph-mon[34780]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 612 op/s 2024-05-09T01:13:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.217+0000 7f8e63882700 1 -- 172.21.15.37:0/848123410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c109850 msgr2=0x7f8e5c1111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.217+0000 7f8e63882700 1 --2- 172.21.15.37:0/848123410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c109850 0x7f8e5c1111b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009990 tx=0x7f8e58009ca0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.217+0000 7f8e63882700 1 -- 172.21.15.37:0/848123410 shutdown_connections 2024-05-09T01:13:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.217+0000 7f8e63882700 1 --2- 172.21.15.37:0/848123410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c109850 0x7f8e5c1111b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.217+0000 7f8e63882700 1 --2- 172.21.15.37:0/848123410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c1045d0 0x7f8e5c1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.217+0000 7f8e63882700 1 --2- 172.21.15.37:0/848123410 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e5c108f00 0x7f8e5c109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.217+0000 7f8e63882700 1 -- 172.21.15.37:0/848123410 >> 172.21.15.37:0/848123410 conn(0x7f8e5c0ffea0 msgr2=0x7f8e5c1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.225+0000 7f8e63882700 1 -- 172.21.15.37:0/848123410 shutdown_connections 2024-05-09T01:13:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.226+0000 7f8e63882700 1 -- 172.21.15.37:0/848123410 wait complete. 2024-05-09T01:13:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.227+0000 7f8e63882700 1 Processor -- start 2024-05-09T01:13:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.228+0000 7f8e63882700 1 -- start start 2024-05-09T01:13:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.228+0000 7f8e63882700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c1045d0 0x7f8e5c118bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.228+0000 7f8e63882700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c108f00 0x7f8e5c119150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.228+0000 7f8e63882700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e5c109850 0x7f8e5c113db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.228+0000 7f8e63882700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c112360 con 0x7f8e5c1045d0 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.228+0000 7f8e63882700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c1121e0 con 0x7f8e5c109850 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.228+0000 7f8e63882700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5c1124e0 con 0x7f8e5c108f00 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.230+0000 7f8e60e1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c108f00 0x7f8e5c119150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.230+0000 7f8e60e1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c108f00 0x7f8e5c119150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41606/0 (socket says 172.21.15.37:41606) 2024-05-09T01:13:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.230+0000 7f8e60e1d700 1 -- 172.21.15.37:0/2592838040 learned_addr learned my addr 172.21.15.37:0/2592838040 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.231+0000 7f8e6161e700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c1045d0 0x7f8e5c118bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.231+0000 7f8e60e1d700 1 -- 172.21.15.37:0/2592838040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e5c109850 msgr2=0x7f8e5c113db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:13:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.231+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e5c109850 0x7f8e5c113db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.231+0000 7f8e60e1d700 1 -- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c1045d0 msgr2=0x7f8e5c118bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.231+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c1045d0 0x7f8e5c118bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.232+0000 7f8e60e1d700 1 -- 172.21.15.37:0/2592838040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e5c1145e0 con 0x7f8e5c108f00 2024-05-09T01:13:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.232+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c108f00 0x7f8e5c119150 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00b550 tx=0x7f8e4c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.234+0000 7f8e527fc700 1 -- 172.21.15.37:0/2592838040 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c015020 con 0x7f8e5c108f00 2024-05-09T01:13:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.234+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e5c1148d0 con 0x7f8e5c108f00 2024-05-09T01:13:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.234+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e5c11cad0 con 0x7f8e5c108f00 2024-05-09T01:13:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.234+0000 7f8e527fc700 1 -- 172.21.15.37:0/2592838040 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e4c011ce0 con 0x7f8e5c108f00 2024-05-09T01:13:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.234+0000 7f8e527fc700 1 -- 172.21.15.37:0/2592838040 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c010d50 con 0x7f8e5c108f00 2024-05-09T01:13:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.244+0000 7f8e72298b80 1 Processor -- start 2024-05-09T01:13:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.245+0000 7f8e527fc700 1 -- 172.21.15.37:0/2592838040 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8e4c018020 con 0x7f8e5c108f00 2024-05-09T01:13:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.247+0000 7f8e527fc700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8e480b2a90 0x7f8e480b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.248+0000 7f8e527fc700 1 -- 172.21.15.37:0/2592838040 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8e4c0e1930 con 0x7f8e5c108f00 2024-05-09T01:13:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.248+0000 7f8e72298b80 1 -- start start 2024-05-09T01:13:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.248+0000 7f8e61e1f700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8e480b2a90 0x7f8e480b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84da9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84da36a0 0x55ea84da3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e72298b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea84cc5ff0 con 0x55ea84c264a0 2024-05-09T01:13:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e72298b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea84c647f0 con 0x55ea84d10160 2024-05-09T01:13:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e72298b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea84cc1fb0 con 0x55ea84da36a0 2024-05-09T01:13:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e6161e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e6161e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39666/0 (socket says 172.21.15.37:39666) 2024-05-09T01:13:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.249+0000 7f8e6161e700 1 -- 172.21.15.37:0/2053073356 learned_addr learned my addr 172.21.15.37:0/2053073356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.250+0000 7f8e6161e700 1 -- 172.21.15.37:0/2053073356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84da36a0 msgr2=0x55ea84da3ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.250+0000 7f8e6161e700 1 --2- 172.21.15.37:0/2053073356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84da36a0 0x55ea84da3ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.250+0000 7f8e6161e700 1 -- 172.21.15.37:0/2053073356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 msgr2=0x55ea84da9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.250+0000 7f8e6161e700 1 --2- 172.21.15.37:0/2053073356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84da9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.250+0000 7f8e6161e700 1 -- 172.21.15.37:0/2053073356 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea84c5c370 con 0x55ea84d10160 2024-05-09T01:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.250+0000 7f8e6161e700 1 --2- 172.21.15.37:0/2053073356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da94f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009420 tx=0x7f8e54009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341e7d32aae40fc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.254+0000 7f8e477fe700 1 -- 172.21.15.37:0/2053073356 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54013810 con 0x55ea84d10160 2024-05-09T01:13:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.254+0000 7f8e477fe700 1 -- 172.21.15.37:0/2053073356 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e54015440 con 0x55ea84d10160 2024-05-09T01:13:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.254+0000 7f8e477fe700 1 -- 172.21.15.37:0/2053073356 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54013e60 con 0x55ea84d10160 2024-05-09T01:13:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.255+0000 7f8e72298b80 1 -- 172.21.15.37:0/2053073356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 msgr2=0x55ea84da94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.255+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2053073356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da94f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009420 tx=0x7f8e54009920 comp rx=0 tx=0).stop 2024-05-09T01:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.255+0000 7f8e61e1f700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8e480b2a90 0x7f8e480b4fa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c119820 tx=0x7f8e58005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.257+0000 7f8e72298b80 1 -- 172.21.15.37:0/2053073356 shutdown_connections 2024-05-09T01:13:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.257+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2053073356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84da36a0 0x55ea84da3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.257+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2053073356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da94f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.257+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2053073356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84da9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.257+0000 7f8e72298b80 1 -- 172.21.15.37:0/2053073356 >> 172.21.15.37:0/2053073356 conn(0x55ea84c866a0 msgr2=0x55ea84d9e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.258+0000 7f8e72298b80 1 -- 172.21.15.37:0/2053073356 shutdown_connections 2024-05-09T01:13:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.258+0000 7f8e72298b80 1 -- 172.21.15.37:0/2053073356 wait complete. 2024-05-09T01:13:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.259+0000 7f8e72298b80 1 -- start start 2024-05-09T01:13:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.259+0000 7f8e72298b80 1 Processor -- start 2024-05-09T01:13:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.260+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.260+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dad630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84da36a0 0x55ea84dadb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e6161e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e72298b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea84b41ba0 con 0x55ea84da36a0 2024-05-09T01:13:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e72298b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea84c80150 con 0x55ea84d10160 2024-05-09T01:13:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e72298b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea84db01d0 con 0x55ea84c264a0 2024-05-09T01:13:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e60e1d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e60e1d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39682/0 (socket says 172.21.15.37:39682) 2024-05-09T01:13:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e60e1d700 1 -- 172.21.15.37:0/202647150 learned_addr learned my addr 172.21.15.37:0/202647150 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.261+0000 7f8e72298b80 10 client.0 _ll_register_callbacks cb 0x55ea84b376c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.262+0000 7f8e60e1d700 1 -- 172.21.15.37:0/202647150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 msgr2=0x55ea84dad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.262+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.262+0000 7f8e60e1d700 1 -- 172.21.15.37:0/202647150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84da36a0 msgr2=0x55ea84dadb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.262+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84da36a0 0x55ea84dadb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.262+0000 7f8e60e1d700 1 -- 172.21.15.37:0/202647150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea84b41490 con 0x55ea84d10160 2024-05-09T01:13:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.264+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dad630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0a4fd0 tx=0x7f8e4c0a86c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad9ddd6bf829620 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.264+0000 7f8e44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.264+0000 7f8e44ff9700 1 -- 172.21.15.37:0/202647150 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c0a8f50 con 0x55ea84d10160 2024-05-09T01:13:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.265+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e54015440 con 0x55ea84d10160 2024-05-09T01:13:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.265+0000 7f8e44ff9700 1 -- 172.21.15.37:0/202647150 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8e4c0b1920 con 0x55ea84d10160 2024-05-09T01:13:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.265+0000 7f8e44ff9700 1 -- 172.21.15.37:0/202647150 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8e4c0ad300 con 0x55ea84d10160 2024-05-09T01:13:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.265+0000 7f8e72298b80 10 client.27104 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.265+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ea84dba9f0 con 0x55ea84d10160 2024-05-09T01:13:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.266+0000 7f8e44ff9700 1 -- 172.21.15.37:0/202647150 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e54015440 con 0x55ea84d10160 2024-05-09T01:13:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.266+0000 7f8e44ff9700 1 -- 172.21.15.37:0/202647150 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f8e4c0a48c0 con 0x55ea84d10160 2024-05-09T01:13:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.267+0000 7f8e72298b80 10 client.27104 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.267+0000 7f8e72298b80 10 client.27104 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:13:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.267+0000 7f8e72298b80 20 client.27104 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.267+0000 7f8e72298b80 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84dbcfd0 0x55ea84dbf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.267+0000 7f8e72298b80 4 client.27104 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.267+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea84cd39d0 con 0x55ea84dbcfd0 2024-05-09T01:13:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.267+0000 7f8e6161e700 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84dbcfd0 0x55ea84dbf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.268+0000 7f8e6161e700 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84dbcfd0 0x55ea84dbf410 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c92cf96a2ac0ead server_cookie=ccd18b976f0442e0 in_seq=0 out_seq=0 2024-05-09T01:13:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.268+0000 7f8e44ff9700 10 client.27104 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:13:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.270+0000 7f8e44ff9700 1 -- 172.21.15.37:0/202647150 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ea84cd39d0 con 0x55ea84dbcfd0 2024-05-09T01:13:21.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.270+0000 7f8e44ff9700 10 client.27104 handle_command_reply: tid=0 2024-05-09T01:13:21.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 client.27104 shutdown 2024-05-09T01:13:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 msgr2=0x55ea84dad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dad630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0a4fd0 tx=0x7f8e4c0a86c0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 shutdown_connections 2024-05-09T01:13:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84dbcfd0 0x55ea84dbf410 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84da36a0 0x55ea84dadb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 --2- 172.21.15.37:0/202647150 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dad630 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 >> 172.21.15.37:0/202647150 conn(0x55ea84c866a0 msgr2=0x55ea84d9e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.271+0000 7f8e44ff9700 0 client.27104 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:13:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.272+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 shutdown_connections 2024-05-09T01:13:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.272+0000 7f8e72298b80 1 -- 172.21.15.37:0/202647150 wait complete. 2024-05-09T01:13:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.272+0000 7f8e72298b80 20 client.27104 trim_cache size 0 max 16384 2024-05-09T01:13:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.297+0000 7f8e72298b80 1 Processor -- start 2024-05-09T01:13:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.297+0000 7f8e72298b80 1 -- start start 2024-05-09T01:13:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.297+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c866a0 0x55ea84da76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.297+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84d9d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e72298b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4000d140 con 0x55ea84c264a0 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e72298b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4000ed40 con 0x55ea84d10160 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e72298b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4000d810 con 0x55ea84c866a0 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39688/0 (socket says 172.21.15.37:39688) 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 -- 172.21.15.37:0/2817605723 learned_addr learned my addr 172.21.15.37:0/2817605723 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84d9d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e6161e700 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c866a0 0x55ea84da76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 -- 172.21.15.37:0/2817605723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c866a0 msgr2=0x55ea84da76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c866a0 0x55ea84da76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 -- 172.21.15.37:0/2817605723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 msgr2=0x55ea84d9d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84d9d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e61e1f700 1 -- 172.21.15.37:0/2817605723 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea84d97f60 con 0x55ea84d10160 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.298+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84d9d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.299+0000 7f8e61e1f700 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da5e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8e58015000 tx=0x7f8e5801a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101d7e42c0231a8d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.299+0000 7f8e46ffd700 1 -- 172.21.15.37:0/2817605723 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58003880 con 0x55ea84d10160 2024-05-09T01:13:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.299+0000 7f8e46ffd700 1 -- 172.21.15.37:0/2817605723 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5800f460 con 0x55ea84d10160 2024-05-09T01:13:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.299+0000 7f8e46ffd700 1 -- 172.21.15.37:0/2817605723 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58020660 con 0x55ea84d10160 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.301+0000 7f8e72298b80 1 -- 172.21.15.37:0/2817605723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 msgr2=0x55ea84da5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.301+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da5e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8e58015000 tx=0x7f8e5801a040 comp rx=0 tx=0).stop 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.301+0000 7f8e72298b80 1 -- 172.21.15.37:0/2817605723 shutdown_connections 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.301+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84da5e00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.301+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c866a0 0x55ea84da76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.301+0000 7f8e72298b80 1 --2- 172.21.15.37:0/2817605723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c264a0 0x55ea84d9d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.301+0000 7f8e72298b80 1 -- 172.21.15.37:0/2817605723 >> 172.21.15.37:0/2817605723 conn(0x55ea84da3e10 msgr2=0x55ea84daba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.302+0000 7f8e72298b80 1 -- 172.21.15.37:0/2817605723 shutdown_connections 2024-05-09T01:13:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.302+0000 7f8e72298b80 1 -- 172.21.15.37:0/2817605723 wait complete. 2024-05-09T01:13:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.302+0000 7f8e72298b80 1 -- start start 2024-05-09T01:13:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.302+0000 7f8e72298b80 1 Processor -- start 2024-05-09T01:13:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.303+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dc3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.303+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c866a0 0x55ea84dc4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.303+0000 7f8e72298b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dc4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.303+0000 7f8e72298b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4000e5b0 con 0x55ea84c866a0 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.303+0000 7f8e72298b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4000dee0 con 0x55ea84d10160 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.303+0000 7f8e72298b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4000b0e0 con 0x55ea84c264a0 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.303+0000 7f8e72298b80 10 client.0 _ll_register_callbacks cb 0x55ea84b376c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dc3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dc3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41640/0 (socket says 172.21.15.37:41640) 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 -- 172.21.15.37:0/1839850796 learned_addr learned my addr 172.21.15.37:0/1839850796 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e61e1f700 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dc4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 -- 172.21.15.37:0/1839850796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 msgr2=0x55ea84dc4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dc4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 -- 172.21.15.37:0/1839850796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c866a0 msgr2=0x55ea84dc4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c866a0 0x55ea84dc4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.304+0000 7f8e6161e700 1 -- 172.21.15.37:0/1839850796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea84db46f0 con 0x55ea84c264a0 2024-05-09T01:13:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.305+0000 7f8e6161e700 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dc3bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e540090a0 tx=0x7f8e54003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10acf475d3175ede server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.306+0000 7f8e44ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.306+0000 7f8e44ff9700 1 -- 172.21.15.37:0/1839850796 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54015650 con 0x55ea84c264a0 2024-05-09T01:13:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.306+0000 7f8e44ff9700 1 -- 172.21.15.37:0/1839850796 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8e540157f0 con 0x55ea84c264a0 2024-05-09T01:13:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.306+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e5800f460 con 0x55ea84c264a0 2024-05-09T01:13:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.306+0000 7f8e44ff9700 1 -- 172.21.15.37:0/1839850796 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8e54015a10 con 0x55ea84c264a0 2024-05-09T01:13:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 10 client.27079 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ea84db5950 con 0x55ea84c264a0 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e44ff9700 1 -- 172.21.15.37:0/1839850796 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5800f460 con 0x55ea84c264a0 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e44ff9700 1 -- 172.21.15.37:0/1839850796 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f8e54013790 con 0x55ea84c264a0 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 10 client.27079 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 10 client.27079 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 20 client.27079 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84da36a0 0x55ea84e29790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 4 client.27079 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:13:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.307+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea84ccda70 con 0x55ea84da36a0 2024-05-09T01:13:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.310+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84da36a0 0x55ea84e29790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.311+0000 7f8e44ff9700 10 client.27079 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:13:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.311+0000 7f8e60e1d700 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84da36a0 0x55ea84e29790 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cdec63e0fd7465c1 server_cookie=bf0f0e83eeca8f53 in_seq=0 out_seq=0 2024-05-09T01:13:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e44ff9700 1 -- 172.21.15.37:0/1839850796 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea84ccda70 con 0x55ea84da36a0 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e44ff9700 10 client.27079 handle_command_reply: tid=0 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 client.27079 shutdown 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 msgr2=0x55ea84dc3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dc3bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e540090a0 tx=0x7f8e54003f60 comp rx=0 tx=0).stop 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 shutdown_connections 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55ea84da36a0 0x55ea84e29790 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea84d10160 0x55ea84dc4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea84c264a0 0x55ea84dc3bc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e44ff9700 0 client.27079 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 --2- 172.21.15.37:0/1839850796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea84c866a0 0x55ea84dc4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 >> 172.21.15.37:0/1839850796 conn(0x55ea84da3e10 msgr2=0x55ea84da6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 shutdown_connections 2024-05-09T01:13:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 1 -- 172.21.15.37:0/1839850796 wait complete. 2024-05-09T01:13:21.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.312+0000 7f8e72298b80 20 client.27079 trim_cache size 0 max 16384 2024-05-09T01:13:21.315 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:13:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8e480b2a90 msgr2=0x7f8e480b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8e480b2a90 0x7f8e480b4fa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c119820 tx=0x7f8e58005fd0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c108f00 msgr2=0x7f8e5c119150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c108f00 0x7f8e5c119150 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00b550 tx=0x7f8e4c00b910 comp rx=0 tx=0).stop 2024-05-09T01:13:21.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 shutdown_connections 2024-05-09T01:13:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8e480b2a90 0x7f8e480b4fa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e5c109850 0x7f8e5c113db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e5c1045d0 0x7f8e5c118bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 --2- 172.21.15.37:0/2592838040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e5c108f00 0x7f8e5c119150 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.313+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 >> 172.21.15.37:0/2592838040 conn(0x7f8e5c0ffea0 msgr2=0x7f8e5c108630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.314+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 shutdown_connections 2024-05-09T01:13:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:21.314+0000 7f8e63882700 1 -- 172.21.15.37:0/2592838040 wait complete. 2024-05-09T01:13:22.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:13:22.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:22 smithi037 ceph-mon[30122]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 680 op/s 2024-05-09T01:13:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:22 smithi136 ceph-mon[34110]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 680 op/s 2024-05-09T01:13:22.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:22 smithi151 ceph-mon[34780]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 680 op/s 2024-05-09T01:13:24.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.636+0000 7f4f2d914700 1 -- 172.21.15.37:0/2408745506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2810b280 msgr2=0x7f4f2811d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.636+0000 7f4f2d914700 1 --2- 172.21.15.37:0/2408745506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2810b280 0x7f4f2811d3f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4f1801a9a0 tx=0x7f4f1801acb0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.637+0000 7f4f2d914700 1 -- 172.21.15.37:0/2408745506 shutdown_connections 2024-05-09T01:13:24.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.637+0000 7f4f2d914700 1 --2- 172.21.15.37:0/2408745506 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2811d930 0x7f4f2811fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.637+0000 7f4f2d914700 1 --2- 172.21.15.37:0/2408745506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2810a930 0x7f4f2810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.637+0000 7f4f2d914700 1 --2- 172.21.15.37:0/2408745506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2810b280 0x7f4f2811d3f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.637+0000 7f4f2d914700 1 -- 172.21.15.37:0/2408745506 >> 172.21.15.37:0/2408745506 conn(0x7f4f2806f4d0 msgr2=0x7f4f2806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:24.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.637+0000 7f4f2d914700 1 -- 172.21.15.37:0/2408745506 shutdown_connections 2024-05-09T01:13:24.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.637+0000 7f4f2d914700 1 -- 172.21.15.37:0/2408745506 wait complete. 2024-05-09T01:13:24.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 Processor -- start 2024-05-09T01:13:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 -- start start 2024-05-09T01:13:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2810a930 0x7f4f2811d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2810b280 0x7f4f28119410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2811d930 0x7f4f28119990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28115430 con 0x7f4f2811d930 2024-05-09T01:13:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281152b0 con 0x7f4f2810a930 2024-05-09T01:13:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.639+0000 7f4f2d914700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281155b0 con 0x7f4f2810b280 2024-05-09T01:13:24.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.640+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2810a930 0x7f4f2811d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.640+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2810a930 0x7f4f2811d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:48568/0 (socket says 172.21.15.37:48568) 2024-05-09T01:13:24.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.640+0000 7f4f26ffd700 1 -- 172.21.15.37:0/3512762907 learned_addr learned my addr 172.21.15.37:0/3512762907 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.641+0000 7f4f26ffd700 1 -- 172.21.15.37:0/3512762907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2810b280 msgr2=0x7f4f28119410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:13:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.641+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2810b280 0x7f4f28119410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.641+0000 7f4f26ffd700 1 -- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2811d930 msgr2=0x7f4f28119990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.641+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2811d930 0x7f4f28119990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.641+0000 7f4f26ffd700 1 -- 172.21.15.37:0/3512762907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2811a130 con 0x7f4f2810a930 2024-05-09T01:13:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.642+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2810a930 0x7f4f2811d2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00b550 tx=0x7f4f1c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.642+0000 7f4f2c912700 1 -- 172.21.15.37:0/3512762907 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c015020 con 0x7f4f2810a930 2024-05-09T01:13:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.642+0000 7f4f2c912700 1 -- 172.21.15.37:0/3512762907 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f1c011ce0 con 0x7f4f2810a930 2024-05-09T01:13:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.644+0000 7f4f2c912700 1 -- 172.21.15.37:0/3512762907 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c010e20 con 0x7f4f2810a930 2024-05-09T01:13:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.645+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f281ad8c0 con 0x7f4f2810a930 2024-05-09T01:13:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.645+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f281add80 con 0x7f4f2810a930 2024-05-09T01:13:24.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.653+0000 7f4f2c912700 1 -- 172.21.15.37:0/3512762907 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4f1c018020 con 0x7f4f2810a930 2024-05-09T01:13:24.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.654+0000 7f4f3c32ab80 1 Processor -- start 2024-05-09T01:13:24.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.654+0000 7f4f2c912700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f100b28e0 0x7f4f100b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f2c912700 1 -- 172.21.15.37:0/3512762907 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4f1c0e1140 con 0x7f4f2810a930 2024-05-09T01:13:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f3c32ab80 1 -- start start 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb283164f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb28316a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb28310ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fb28232ff0 con 0x55fb283106a0 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fb281d17f0 con 0x55fb281934a0 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fb2822efb0 con 0x55fb2827d160 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.655+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb28316a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb283164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb28316a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:48572/0 (socket says 172.21.15.37:48572) 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 -- 172.21.15.37:0/4116514921 learned_addr learned my addr 172.21.15.37:0/4116514921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f277fe700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f100b28e0 0x7f4f100b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 -- 172.21.15.37:0/4116514921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 msgr2=0x55fb283164f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4116514921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb283164f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 -- 172.21.15.37:0/4116514921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 msgr2=0x55fb28310ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:13:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4116514921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb28310ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 -- 172.21.15.37:0/4116514921 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb281c9370 con 0x55fb281934a0 2024-05-09T01:13:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4116514921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb28316a30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4f18005b40 tx=0x7f4f1801af30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51a8f51d90464d63 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.656+0000 7f4f277fe700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f100b28e0 0x7f4f100b4df0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55fb283170c0 tx=0x7f4f20008580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.657+0000 7f4f0dffb700 1 -- 172.21.15.37:0/4116514921 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1801c9f0 con 0x55fb281934a0 2024-05-09T01:13:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.657+0000 7f4f0dffb700 1 -- 172.21.15.37:0/4116514921 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f180038c0 con 0x55fb281934a0 2024-05-09T01:13:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.658+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4116514921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 msgr2=0x55fb28316a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.658+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4116514921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb28316a30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4f18005b40 tx=0x7f4f1801af30 comp rx=0 tx=0).stop 2024-05-09T01:13:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.658+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4116514921 shutdown_connections 2024-05-09T01:13:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.658+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4116514921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb28310ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.658+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4116514921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb283164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.659+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4116514921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb28316a30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.659+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4116514921 >> 172.21.15.37:0/4116514921 conn(0x55fb281f36a0 msgr2=0x55fb2830b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.659+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4116514921 shutdown_connections 2024-05-09T01:13:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.660+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4116514921 wait complete. 2024-05-09T01:13:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.660+0000 7f4f3c32ab80 1 -- start start 2024-05-09T01:13:24.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.661+0000 7f4f3c32ab80 1 Processor -- start 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb2831a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb2831a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2831abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fb280aeba0 con 0x55fb283106a0 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fb281ed150 con 0x55fb281934a0 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fb2831d1d0 con 0x55fb2827d160 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb2831a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f3c32ab80 10 client.0 _ll_register_callbacks cb 0x55fb280a46c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb2831a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37446/0 (socket says 172.21.15.37:37446) 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f267fc700 1 -- 172.21.15.37:0/4061338710 learned_addr learned my addr 172.21.15.37:0/4061338710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb2831a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f277fe700 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2831abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f267fc700 1 -- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 msgr2=0x55fb2831a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.662+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb2831a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f267fc700 1 -- 172.21.15.37:0/4061338710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 msgr2=0x55fb2831abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2831abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f267fc700 1 -- 172.21.15.37:0/4061338710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb280ae490 con 0x55fb2827d160 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb2831a680 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4f1801a9a0 tx=0x7f4f18003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7de74129bb6625a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4061338710 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18039070 con 0x55fb2827d160 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4061338710 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4f1801c9f0 con 0x55fb2827d160 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.663+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f180038c0 con 0x55fb2827d160 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4061338710 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4f18045050 con 0x55fb2827d160 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 10 client.27085 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55fb28327990 con 0x55fb2827d160 2024-05-09T01:13:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4061338710 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f1801cbf0 con 0x55fb2827d160 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4061338710 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f4f180323f0 con 0x55fb2827d160 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 10 client.27085 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 10 client.27085 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 20 client.27085 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28329e60 0x55fb2832c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 4 client.27085 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4f180038c0 con 0x55fb28329e60 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.664+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28329e60 0x55fb2832c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.665+0000 7f4f06ffd700 10 client.27085 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:13:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.666+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28329e60 0x55fb2832c280 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=763985799bef8322 server_cookie=ed1aabf32fb6d296 in_seq=0 out_seq=0 2024-05-09T01:13:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.666+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4061338710 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f4f180038c0 con 0x55fb28329e60 2024-05-09T01:13:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.666+0000 7f4f06ffd700 10 client.27085 handle_command_reply: tid=0 2024-05-09T01:13:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 client.27085 shutdown 2024-05-09T01:13:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 msgr2=0x55fb2831a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb2831a680 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4f1801a9a0 tx=0x7f4f18003b20 comp rx=0 tx=0).stop 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 shutdown_connections 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28329e60 0x55fb2832c280 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2831abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb281934a0 0x55fb2831a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4061338710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb2827d160 0x55fb2831a680 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f06ffd700 0 client.27085 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.667+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 >> 172.21.15.37:0/4061338710 conn(0x55fb281f36a0 msgr2=0x55fb2830b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.668+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 shutdown_connections 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.668+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4061338710 wait complete. 2024-05-09T01:13:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.668+0000 7f4f3c32ab80 20 client.27085 trim_cache size 0 max 16384 2024-05-09T01:13:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 Processor -- start 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 -- start start 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb28314860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb2827d160 0x55fb28326430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb283106a0 0x55fb28319140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281b4de0 con 0x55fb2827d160 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281b69e0 con 0x55fb283106a0 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281b54b0 con 0x55fb281934a0 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.694+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb28314860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb2827d160 0x55fb28326430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb2827d160 0x55fb28326430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38508/0 (socket says 172.21.15.37:38508) 2024-05-09T01:13:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 -- 172.21.15.37:0/431756050 learned_addr learned my addr 172.21.15.37:0/431756050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb28314860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37460/0 (socket says 172.21.15.37:37460) 2024-05-09T01:13:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f277fe700 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb283106a0 0x55fb28319140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 -- 172.21.15.37:0/431756050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 msgr2=0x55fb28314860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb28314860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 -- 172.21.15.37:0/431756050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb283106a0 msgr2=0x55fb28319140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb283106a0 0x55fb28319140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 -- 172.21.15.37:0/431756050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb28304f60 con 0x55fb2827d160 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.695+0000 7f4f267fc700 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb2827d160 0x55fb28326430 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4f1801a8f0 tx=0x7f4f18005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af712c99a0ae4d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.696+0000 7f4f0d7fa700 1 -- 172.21.15.37:0/431756050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f18039070 con 0x55fb2827d160 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.696+0000 7f4f0d7fa700 1 -- 172.21.15.37:0/431756050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f18032b60 con 0x55fb2827d160 2024-05-09T01:13:24.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.696+0000 7f4f0d7fa700 1 -- 172.21.15.37:0/431756050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1803e6a0 con 0x55fb2827d160 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.697+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/431756050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb2827d160 msgr2=0x55fb28326430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.697+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb2827d160 0x55fb28326430 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4f1801a8f0 tx=0x7f4f18005740 comp rx=0 tx=0).stop 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.697+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/431756050 shutdown_connections 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.697+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb283106a0 0x55fb28319140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.697+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb28314860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.697+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/431756050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb2827d160 0x55fb28326430 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.698+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/431756050 >> 172.21.15.37:0/431756050 conn(0x55fb281f36a0 msgr2=0x55fb28318a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.698+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/431756050 shutdown_connections 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.698+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/431756050 wait complete. 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.698+0000 7f4f3c32ab80 1 -- start start 2024-05-09T01:13:24.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.699+0000 7f4f3c32ab80 1 Processor -- start 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.699+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb2832f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.699+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb2827d160 0x55fb28329e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f3c32ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2832a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281b6250 con 0x55fb283106a0 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281b5b80 con 0x55fb2827d160 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f3c32ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4f281b2da0 con 0x55fb281934a0 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb2832f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f267fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb2827d160 0x55fb28329e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb2832f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37476/0 (socket says 172.21.15.37:37476) 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 -- 172.21.15.37:0/4157152626 learned_addr learned my addr 172.21.15.37:0/4157152626 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f3c32ab80 10 client.0 _ll_register_callbacks cb 0x55fb280a46c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f277fe700 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2832a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 -- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb2827d160 msgr2=0x55fb28329e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb2827d160 0x55fb28329e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 -- 172.21.15.37:0/4157152626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 msgr2=0x55fb2832a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2832a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 -- 172.21.15.37:0/4157152626 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2832abd0 con 0x55fb281934a0 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb2827d160 0x55fb28329e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f26ffd700 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb2832f560 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0cb230 tx=0x7f4f1c0a46d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b67c58bc6167eb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.700+0000 7f4f06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4157152626 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0acb10 con 0x55fb281934a0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f18032b60 con 0x55fb281934a0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4157152626 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4f1c0a8bd0 con 0x55fb281934a0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4157152626 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f4f1c0b15c0 con 0x55fb281934a0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 10 client.27091 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55fb28393390 con 0x55fb281934a0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4157152626 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f18032b60 con 0x55fb281934a0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4157152626 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f4f1c0a79c0 con 0x55fb281934a0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 10 client.27091 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 10 client.27091 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 20 client.27091 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28393ac0 0x55fb28395ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.701+0000 7f4f3c32ab80 4 client.27091 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.702+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb282409d0 con 0x55fb28393ac0 2024-05-09T01:13:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.702+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28393ac0 0x55fb28395ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.702+0000 7f4f06ffd700 10 client.27091 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.702+0000 7f4f267fc700 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28393ac0 0x55fb28395ee0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3244bf5eb5cd63ad server_cookie=f8f278e889f9be33 in_seq=0 out_seq=0 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.702+0000 7f4f06ffd700 1 -- 172.21.15.37:0/4157152626 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb282409d0 con 0x55fb28393ac0 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.702+0000 7f4f06ffd700 10 client.27091 handle_command_reply: tid=0 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.702+0000 7f4f3c32ab80 1 client.27091 shutdown 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 msgr2=0x55fb2832f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb2832f560 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0cb230 tx=0x7f4f1c0a46d0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 shutdown_connections 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55fb28393ac0 0x55fb28395ee0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fb283106a0 0x55fb2832a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f06ffd700 0 client.27091 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb281934a0 0x55fb2832f560 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 --2- 172.21.15.37:0/4157152626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb2827d160 0x55fb28329e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 >> 172.21.15.37:0/4157152626 conn(0x55fb281f36a0 msgr2=0x55fb2831aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 shutdown_connections 2024-05-09T01:13:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 1 -- 172.21.15.37:0/4157152626 wait complete. 2024-05-09T01:13:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.703+0000 7f4f3c32ab80 20 client.27091 trim_cache size 0 max 16384 2024-05-09T01:13:24.709 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f100b28e0 msgr2=0x7f4f100b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f100b28e0 0x7f4f100b4df0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55fb283170c0 tx=0x7f4f20008580 comp rx=0 tx=0).stop 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2810a930 msgr2=0x7f4f2811d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2810a930 0x7f4f2811d2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00b550 tx=0x7f4f1c00b910 comp rx=0 tx=0).stop 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 shutdown_connections 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4f100b28e0 0x7f4f100b4df0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2811d930 0x7f4f28119990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f2810a930 0x7f4f2811d2d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 --2- 172.21.15.37:0/3512762907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2810b280 0x7f4f28119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 >> 172.21.15.37:0/3512762907 conn(0x7f4f2806f4d0 msgr2=0x7f4f2811df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 shutdown_connections 2024-05-09T01:13:24.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:24.704+0000 7f4f2d914700 1 -- 172.21.15.37:0/3512762907 wait complete. 2024-05-09T01:13:24.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:24 smithi136 ceph-mon[34110]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 627 op/s 2024-05-09T01:13:24.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:24 smithi037 ceph-mon[30122]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 627 op/s 2024-05-09T01:13:24.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:24 smithi151 ceph-mon[34780]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 627 op/s 2024-05-09T01:13:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 665.0 s, 1571.2 tps, lat 63.611 ms stddev 71.253 2024-05-09T01:13:25.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:13:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:25.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:25 smithi037 ceph-mon[30122]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-05-09T01:13:25.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:25 smithi151 ceph-mon[34780]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-05-09T01:13:26.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:25 smithi136 ceph-mon[34110]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 598 op/s 2024-05-09T01:13:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.008+0000 7fee3394b700 1 -- 172.21.15.37:0/830492625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c10a930 msgr2=0x7fee2c10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.008+0000 7fee3394b700 1 --2- 172.21.15.37:0/830492625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c10a930 0x7fee2c10ad40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009990 tx=0x7fee1c009ca0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.009+0000 7fee3394b700 1 -- 172.21.15.37:0/830492625 shutdown_connections 2024-05-09T01:13:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.009+0000 7fee3394b700 1 --2- 172.21.15.37:0/830492625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c10b280 0x7fee2c1198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.009+0000 7fee3394b700 1 --2- 172.21.15.37:0/830492625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c111bd0 0x7fee2c111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.009+0000 7fee3394b700 1 --2- 172.21.15.37:0/830492625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c10a930 0x7fee2c10ad40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.009+0000 7fee3394b700 1 -- 172.21.15.37:0/830492625 >> 172.21.15.37:0/830492625 conn(0x7fee2c06f4d0 msgr2=0x7fee2c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:28.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.010+0000 7fee3394b700 1 -- 172.21.15.37:0/830492625 shutdown_connections 2024-05-09T01:13:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.010+0000 7fee3394b700 1 -- 172.21.15.37:0/830492625 wait complete. 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.011+0000 7fee3394b700 1 Processor -- start 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.011+0000 7fee3394b700 1 -- start start 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee3394b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c10a930 0x7fee2c1a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee3394b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c10b280 0x7fee2c1a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee3394b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c111bd0 0x7fee2c1a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee316e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c10a930 0x7fee2c1a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee316e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c10a930 0x7fee2c1a3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37492/0 (socket says 172.21.15.37:37492) 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee316e7700 1 -- 172.21.15.37:0/2061781827 learned_addr learned my addr 172.21.15.37:0/2061781827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c11cd70 con 0x7fee2c10b280 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c11cbf0 con 0x7fee2c111bd0 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.012+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c11cef0 con 0x7fee2c10a930 2024-05-09T01:13:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.013+0000 7fee31ee8700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c111bd0 0x7fee2c1a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.014+0000 7fee316e7700 1 -- 172.21.15.37:0/2061781827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c111bd0 msgr2=0x7fee2c1a7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.014+0000 7fee316e7700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c111bd0 0x7fee2c1a7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.014+0000 7fee316e7700 1 -- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c10b280 msgr2=0x7fee2c1a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.014+0000 7fee316e7700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c10b280 0x7fee2c1a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.014+0000 7fee316e7700 1 -- 172.21.15.37:0/2061781827 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c1a8600 con 0x7fee2c10a930 2024-05-09T01:13:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.016+0000 7fee316e7700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c10a930 0x7fee2c1a3780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee28009fd0 tx=0x7fee2800b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.020+0000 7fee227fc700 1 -- 172.21.15.37:0/2061781827 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2801d070 con 0x7fee2c10a930 2024-05-09T01:13:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.020+0000 7fee227fc700 1 -- 172.21.15.37:0/2061781827 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee28010e20 con 0x7fee2c10a930 2024-05-09T01:13:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.020+0000 7fee227fc700 1 -- 172.21.15.37:0/2061781827 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28016340 con 0x7fee2c10a930 2024-05-09T01:13:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.021+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c1a88f0 con 0x7fee2c10a930 2024-05-09T01:13:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.021+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c10c5b0 con 0x7fee2c10a930 2024-05-09T01:13:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.027+0000 7fee227fc700 1 -- 172.21.15.37:0/2061781827 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fee28020070 con 0x7fee2c10a930 2024-05-09T01:13:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.028+0000 7fee42361b80 1 Processor -- start 2024-05-09T01:13:28.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.028+0000 7fee42361b80 1 -- start start 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee42361b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee42361b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee42361b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee42361b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea696de0a0 con 0x55ea697c3c10 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee42361b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea696839a0 con 0x55ea6963e4a0 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee42361b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea696da060 con 0x55ea696b8d00 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee30ee6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee30ee6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38544/0 (socket says 172.21.15.37:38544) 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee30ee6700 1 -- 172.21.15.37:0/1917599786 learned_addr learned my addr 172.21.15.37:0/1917599786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee31ee8700 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.029+0000 7fee316e7700 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee227fc700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fee180b2a50 0x7fee180b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee31ee8700 1 -- 172.21.15.37:0/1917599786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 msgr2=0x55ea697c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee31ee8700 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee31ee8700 1 -- 172.21.15.37:0/1917599786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 msgr2=0x55ea697c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee31ee8700 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee31ee8700 1 -- 172.21.15.37:0/1917599786 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea69674500 con 0x55ea696b8d00 2024-05-09T01:13:28.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee227fc700 1 -- 172.21.15.37:0/2061781827 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fee280e50f0 con 0x7fee2c10a930 2024-05-09T01:13:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee31ee8700 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697c9a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee24009f70 tx=0x7fee24009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c3852185a858df server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.030+0000 7fee177fe700 1 -- 172.21.15.37:0/1917599786 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24014620 con 0x55ea696b8d00 2024-05-09T01:13:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.031+0000 7fee31ee8700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fee180b2a50 0x7fee180b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.031+0000 7fee177fe700 1 -- 172.21.15.37:0/1917599786 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee24014c70 con 0x55ea696b8d00 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.031+0000 7fee177fe700 1 -- 172.21.15.37:0/1917599786 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24013cc0 con 0x55ea696b8d00 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee42361b80 1 -- 172.21.15.37:0/1917599786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 msgr2=0x55ea697c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee42361b80 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697c9a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fee24009f70 tx=0x7fee24009650 comp rx=0 tx=0).stop 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee31ee8700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fee180b2a50 0x7fee180b4f60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee24019000 tx=0x7fee24013f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee42361b80 1 -- 172.21.15.37:0/1917599786 shutdown_connections 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee42361b80 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee42361b80 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697c9a20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee42361b80 1 --2- 172.21.15.37:0/1917599786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.032+0000 7fee42361b80 1 -- 172.21.15.37:0/1917599786 >> 172.21.15.37:0/1917599786 conn(0x55ea69641f70 msgr2=0x55ea697b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.033+0000 7fee42361b80 1 -- 172.21.15.37:0/1917599786 shutdown_connections 2024-05-09T01:13:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.033+0000 7fee42361b80 1 -- 172.21.15.37:0/1917599786 wait complete. 2024-05-09T01:13:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.033+0000 7fee42361b80 1 -- start start 2024-05-09T01:13:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 1 Processor -- start 2024-05-09T01:13:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea6963e4a0 0x55ea697cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea696b8d00 0x55ea697cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea697c3c10 0x55ea697ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ea697c4970 con 0x55ea696b8d00 2024-05-09T01:13:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ea69678b20 con 0x55ea697c3c10 2024-05-09T01:13:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea697d0820 con 0x55ea6963e4a0 2024-05-09T01:13:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.034+0000 7fee42361b80 10 client.0 _ll_register_callbacks cb 0x55ea6954f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea6963e4a0 0x55ea697cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee30ee6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea696b8d00 0x55ea697cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea6963e4a0 0x55ea697cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37502/0 (socket says 172.21.15.37:37502) 2024-05-09T01:13:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 -- 172.21.15.37:0/3405057693 learned_addr learned my addr 172.21.15.37:0/3405057693 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee31ee8700 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea697c3c10 0x55ea697ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 -- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea697c3c10 msgr2=0x55ea697ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea697c3c10 0x55ea697ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 -- 172.21.15.37:0/3405057693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea696b8d00 msgr2=0x55ea697cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea696b8d00 0x55ea697cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.035+0000 7fee316e7700 1 -- 172.21.15.37:0/3405057693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea69559490 con 0x55ea6963e4a0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.036+0000 7fee316e7700 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea6963e4a0 0x55ea697cd8a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fee280ac6a0 tx=0x7fee280acc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d43ff18215641a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.036+0000 7fee14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.036+0000 7fee14ff9700 1 -- 172.21.15.37:0/3405057693 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280ac060 con 0x55ea6963e4a0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.036+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee24014c70 con 0x55ea6963e4a0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.036+0000 7fee14ff9700 1 -- 172.21.15.37:0/3405057693 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fee280a8d00 con 0x55ea6963e4a0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.036+0000 7fee14ff9700 1 -- 172.21.15.37:0/3405057693 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fee280abe80 con 0x55ea6963e4a0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.037+0000 7fee42361b80 10 client.27100 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.037+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ea697db2d0 con 0x55ea6963e4a0 2024-05-09T01:13:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.037+0000 7fee14ff9700 1 -- 172.21.15.37:0/3405057693 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee24014c70 con 0x55ea6963e4a0 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee14ff9700 1 -- 172.21.15.37:0/3405057693 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fee280c1b60 con 0x55ea6963e4a0 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee42361b80 10 client.27100 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee42361b80 10 client.27100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee42361b80 20 client.27100 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee42361b80 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea697ddd40 0x55ea697e0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee42361b80 4 client.27100 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea696eba80 con 0x55ea697ddd40 2024-05-09T01:13:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.038+0000 7fee30ee6700 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea697ddd40 0x55ea697e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.039+0000 7fee14ff9700 10 client.27100 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.039+0000 7fee30ee6700 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea697ddd40 0x55ea697e0210 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4060cfbc27e1c3 server_cookie=98ceaec1ef2e325d in_seq=0 out_seq=0 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.039+0000 7fee14ff9700 1 -- 172.21.15.37:0/3405057693 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ea696eba80 con 0x55ea697ddd40 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee14ff9700 10 client.27100 handle_command_reply: tid=0 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 client.27100 shutdown 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea6963e4a0 msgr2=0x55ea697cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea6963e4a0 0x55ea697cd8a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fee280ac6a0 tx=0x7fee280acc50 comp rx=0 tx=0).stop 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 shutdown_connections 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea697ddd40 0x55ea697e0210 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea697c3c10 0x55ea697ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea6963e4a0 0x55ea697cd8a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 --2- 172.21.15.37:0/3405057693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea696b8d00 0x55ea697cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 >> 172.21.15.37:0/3405057693 conn(0x55ea69641f70 msgr2=0x55ea697ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee14ff9700 0 client.27100 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 shutdown_connections 2024-05-09T01:13:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 1 -- 172.21.15.37:0/3405057693 wait complete. 2024-05-09T01:13:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.040+0000 7fee42361b80 20 client.27100 trim_cache size 0 max 16384 2024-05-09T01:13:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.066+0000 7fee42361b80 1 Processor -- start 2024-05-09T01:13:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.066+0000 7fee42361b80 1 -- start start 2024-05-09T01:13:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee42361b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea6963e4a0 0x55ea697cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee42361b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea696b8d00 0x55ea697b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee42361b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea697c3c10 0x55ea697ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee42361b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1b51c0 con 0x55ea6963e4a0 2024-05-09T01:13:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee42361b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1b6dc0 con 0x55ea696b8d00 2024-05-09T01:13:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee42361b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1b5890 con 0x55ea697c3c10 2024-05-09T01:13:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee316e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea6963e4a0 0x55ea697cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee316e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea6963e4a0 0x55ea697cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38570/0 (socket says 172.21.15.37:38570) 2024-05-09T01:13:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee316e7700 1 -- 172.21.15.37:0/1408509440 learned_addr learned my addr 172.21.15.37:0/1408509440 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee31ee8700 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea697c3c10 0x55ea697ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee30ee6700 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea696b8d00 0x55ea697b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee316e7700 1 -- 172.21.15.37:0/1408509440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea697c3c10 msgr2=0x55ea697ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee316e7700 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea697c3c10 0x55ea697ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.067+0000 7fee316e7700 1 -- 172.21.15.37:0/1408509440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea696b8d00 msgr2=0x55ea697b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee316e7700 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea696b8d00 0x55ea697b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee316e7700 1 -- 172.21.15.37:0/1408509440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea697b29d0 con 0x55ea6963e4a0 2024-05-09T01:13:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee31ee8700 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea697c3c10 0x55ea697ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee30ee6700 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea696b8d00 0x55ea697b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee316e7700 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea6963e4a0 0x55ea697cc500 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee280a8790 tx=0x7fee280cf1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf2988d8231e757 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee16ffd700 1 -- 172.21.15.37:0/1408509440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280ac060 con 0x55ea6963e4a0 2024-05-09T01:13:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee16ffd700 1 -- 172.21.15.37:0/1408509440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee280ac220 con 0x55ea6963e4a0 2024-05-09T01:13:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.068+0000 7fee16ffd700 1 -- 172.21.15.37:0/1408509440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee280ab970 con 0x55ea6963e4a0 2024-05-09T01:13:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 -- 172.21.15.37:0/1408509440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea6963e4a0 msgr2=0x55ea697cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea6963e4a0 0x55ea697cc500 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee280a8790 tx=0x7fee280cf1a0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 -- 172.21.15.37:0/1408509440 shutdown_connections 2024-05-09T01:13:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea697c3c10 0x55ea697ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea6963e4a0 0x55ea697cc500 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 --2- 172.21.15.37:0/1408509440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea696b8d00 0x55ea697b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 -- 172.21.15.37:0/1408509440 >> 172.21.15.37:0/1408509440 conn(0x55ea69641f70 msgr2=0x55ea697ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 -- 172.21.15.37:0/1408509440 shutdown_connections 2024-05-09T01:13:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.070+0000 7fee42361b80 1 -- 172.21.15.37:0/1408509440 wait complete. 2024-05-09T01:13:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.071+0000 7fee42361b80 1 -- start start 2024-05-09T01:13:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.071+0000 7fee42361b80 1 Processor -- start 2024-05-09T01:13:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.071+0000 7fee42361b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697d56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee42361b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697d5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee42361b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697d8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee42361b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1b6630 con 0x55ea697c3c10 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee42361b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1b5f60 con 0x55ea6963e4a0 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee42361b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c1b3180 con 0x55ea696b8d00 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee42361b80 10 client.0 _ll_register_callbacks cb 0x55ea6954f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee316e7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697d56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee316e7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697d56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:48642/0 (socket says 172.21.15.37:48642) 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee316e7700 1 -- 172.21.15.37:0/1438583417 learned_addr learned my addr 172.21.15.37:0/1438583417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:28.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee30ee6700 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee31ee8700 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee30ee6700 1 -- 172.21.15.37:0/1438583417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 msgr2=0x55ea697d56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee30ee6700 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697d56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee30ee6700 1 -- 172.21.15.37:0/1438583417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 msgr2=0x55ea697d8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee30ee6700 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697d8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.072+0000 7fee30ee6700 1 -- 172.21.15.37:0/1438583417 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea697d8890 con 0x55ea696b8d00 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.073+0000 7fee30ee6700 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697d5c20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55ea697b7e40 tx=0x7fee1c0096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37ed02ea732add6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.073+0000 7fee14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.073+0000 7fee14ff9700 1 -- 172.21.15.37:0/1438583417 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c003d80 con 0x55ea696b8d00 2024-05-09T01:13:28.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.073+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee280ac220 con 0x55ea696b8d00 2024-05-09T01:13:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.074+0000 7fee14ff9700 1 -- 172.21.15.37:0/1438583417 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fee1c0050b0 con 0x55ea696b8d00 2024-05-09T01:13:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.074+0000 7fee14ff9700 1 -- 172.21.15.37:0/1438583417 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fee1c0052b0 con 0x55ea696b8d00 2024-05-09T01:13:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.075+0000 7fee42361b80 10 client.27106 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:28.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.075+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ea69847c00 con 0x55ea696b8d00 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.075+0000 7fee14ff9700 1 -- 172.21.15.37:0/1438583417 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee280ac220 con 0x55ea696b8d00 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.075+0000 7fee14ff9700 1 -- 172.21.15.37:0/1438583417 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fee1c02e470 con 0x55ea696b8d00 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.075+0000 7fee42361b80 10 client.27106 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.076+0000 7fee42361b80 10 client.27106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.076+0000 7fee42361b80 20 client.27106 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.076+0000 7fee42361b80 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea69848350 0x55ea6984a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.076+0000 7fee42361b80 4 client.27106 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.076+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea696e5b20 con 0x55ea69848350 2024-05-09T01:13:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.076+0000 7fee316e7700 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea69848350 0x55ea6984a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.077+0000 7fee14ff9700 10 client.27106 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.077+0000 7fee316e7700 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea69848350 0x55ea6984a770 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d286eb47e58ba03 server_cookie=531a95d3a05be57a in_seq=0 out_seq=0 2024-05-09T01:13:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.077+0000 7fee14ff9700 1 -- 172.21.15.37:0/1438583417 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea696e5b20 con 0x55ea69848350 2024-05-09T01:13:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.077+0000 7fee14ff9700 10 client.27106 handle_command_reply: tid=0 2024-05-09T01:13:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.077+0000 7fee42361b80 1 client.27106 shutdown 2024-05-09T01:13:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.078+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 msgr2=0x55ea697d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.078+0000 7fee42361b80 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697d5c20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55ea697b7e40 tx=0x7fee1c0096e0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 shutdown_connections 2024-05-09T01:13:28.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ea69848350 0x55ea6984a770 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ea697c3c10 0x55ea697d8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee14ff9700 0 client.27106 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ea6963e4a0 0x55ea697d56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 --2- 172.21.15.37:0/1438583417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea696b8d00 0x55ea697d5c20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 >> 172.21.15.37:0/1438583417 conn(0x55ea69641f70 msgr2=0x55ea697b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 shutdown_connections 2024-05-09T01:13:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 1 -- 172.21.15.37:0/1438583417 wait complete. 2024-05-09T01:13:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.079+0000 7fee42361b80 20 client.27106 trim_cache size 0 max 16384 2024-05-09T01:13:28.081 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:13:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.080+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fee180b2a50 msgr2=0x7fee180b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.080+0000 7fee3394b700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fee180b2a50 0x7fee180b4f60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee24019000 tx=0x7fee24013f90 comp rx=0 tx=0).stop 2024-05-09T01:13:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.080+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c10a930 msgr2=0x7fee2c1a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.080+0000 7fee3394b700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c10a930 0x7fee2c1a3780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fee28009fd0 tx=0x7fee2800b800 comp rx=0 tx=0).stop 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 shutdown_connections 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fee180b2a50 0x7fee180b4f60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fee2c111bd0 0x7fee2c1a7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee2c10a930 0x7fee2c1a3780 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 --2- 172.21.15.37:0/2061781827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2c10b280 0x7fee2c1a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 >> 172.21.15.37:0/2061781827 conn(0x7fee2c06f4d0 msgr2=0x7fee2c1106c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 shutdown_connections 2024-05-09T01:13:28.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:28.081+0000 7fee3394b700 1 -- 172.21.15.37:0/2061781827 wait complete. 2024-05-09T01:13:28.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:28 smithi037 ceph-mon[30122]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 621 op/s 2024-05-09T01:13:28.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:28 smithi136 ceph-mon[34110]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 621 op/s 2024-05-09T01:13:28.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:28 smithi151 ceph-mon[34780]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 621 op/s 2024-05-09T01:13:30.050 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:13:30.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:13:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 670.0 s, 1755.8 tps, lat 57.213 ms stddev 61.678 2024-05-09T01:13:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:30.478 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:30 smithi037 ceph-mon[30122]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2024-05-09T01:13:30.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:30 smithi136 ceph-mon[34110]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2024-05-09T01:13:30.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:30 smithi151 ceph-mon[34780]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 587 op/s 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.390+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2718447627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c90103310 msgr2=0x7f7c9010f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2718447627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c90103310 0x7f7c9010f890 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800b0a0 tx=0x7f7c8800b3b0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2718447627 shutdown_connections 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2718447627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c90103310 0x7f7c9010f890 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2718447627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901089f0 0x7f7c90108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2718447627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c901029c0 0x7f7c90102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2718447627 >> 172.21.15.37:0/2718447627 conn(0x7f7c900fe6f0 msgr2=0x7f7c90100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:32.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2718447627 shutdown_connections 2024-05-09T01:13:32.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.391+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2718447627 wait complete. 2024-05-09T01:13:32.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.393+0000 7f7c94e7a700 1 Processor -- start 2024-05-09T01:13:32.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.393+0000 7f7c94e7a700 1 -- start start 2024-05-09T01:13:32.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.394+0000 7f7c94e7a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901029c0 0x7f7c9019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.394+0000 7f7c94e7a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c90103310 0x7f7c9019edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.394+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901029c0 0x7f7c9019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.394+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901029c0 0x7f7c9019e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56036/0 (socket says 172.21.15.37:56036) 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.394+0000 7f7c8dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c90103310 0x7f7c9019edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.394+0000 7f7c8dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c90103310 0x7f7c9019edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33410/0 (socket says 172.21.15.37:33410) 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.394+0000 7f7c8e59c700 1 -- 172.21.15.37:0/2513117834 learned_addr learned my addr 172.21.15.37:0/2513117834 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c901089f0 0x7f7c90198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c90112360 con 0x7f7c90103310 2024-05-09T01:13:32.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901121e0 con 0x7f7c901029c0 2024-05-09T01:13:32.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901124e0 con 0x7f7c901089f0 2024-05-09T01:13:32.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c901089f0 0x7f7c90198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/2513117834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901029c0 msgr2=0x7f7c9019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901029c0 0x7f7c9019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c90103310 msgr2=0x7f7c9019edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c90103310 0x7f7c9019edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/2513117834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c90199150 con 0x7f7c901089f0 2024-05-09T01:13:32.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.395+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901029c0 0x7f7c9019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:32.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.396+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c901089f0 0x7f7c90198aa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7c88006070 tx=0x7f7c88004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:32.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.396+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2513117834 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88021070 con 0x7f7c901089f0 2024-05-09T01:13:32.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.396+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c901993e0 con 0x7f7c901089f0 2024-05-09T01:13:32.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.396+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c901a5710 con 0x7f7c901089f0 2024-05-09T01:13:32.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.396+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2513117834 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c88007e30 con 0x7f7c901089f0 2024-05-09T01:13:32.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.396+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2513117834 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88004650 con 0x7f7c901089f0 2024-05-09T01:13:32.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.402+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2513117834 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7c8801d450 con 0x7f7c901089f0 2024-05-09T01:13:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.403+0000 7f7ca3890b80 1 Processor -- start 2024-05-09T01:13:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.403+0000 7f7ca3890b80 1 -- start start 2024-05-09T01:13:32.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.404+0000 7f7c7f7fe700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7c780bb160 0x7f7c780bd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.404+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a06864c1e0 0x55a0686e5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.404+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.404+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.404+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a068602070 con 0x55a068562520 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a0685a0870 con 0x55a0686df720 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a0685fe030 con 0x55a06864c1e0 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686dfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686dfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56044/0 (socket says 172.21.15.37:56044) 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/1656017167 learned_addr learned my addr 172.21.15.37:0/1656017167 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7c780bb160 0x7f7c780bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2513117834 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7c8800f020 con 0x7f7c901089f0 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/1656017167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a06864c1e0 msgr2=0x55a0686e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.404+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a06864c1e0 0x55a0686e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a06864c1e0 0x55a0686e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/1656017167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 msgr2=0x55a0686e5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686e5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/1656017167 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0685983f0 con 0x55a0686df720 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a06864c1e0 0x55a0686e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686e5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.405+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686dfb50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7c880aab80 tx=0x7f7c8800b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98e70d386eca9c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.406+0000 7f7c7cff9700 1 -- 172.21.15.37:0/1656017167 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c880ab2f0 con 0x55a0686df720 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.406+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7c780bb160 0x7f7c780bd670 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55a0686e5030 tx=0x7f7c84006de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.406+0000 7f7c7cff9700 1 -- 172.21.15.37:0/1656017167 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c880aabf0 con 0x55a0686df720 2024-05-09T01:13:32.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.406+0000 7f7c7cff9700 1 -- 172.21.15.37:0/1656017167 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c880a50d0 con 0x55a0686df720 2024-05-09T01:13:32.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.407+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1656017167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 msgr2=0x55a0686dfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.407+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686dfb50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7c880aab80 tx=0x7f7c8800b3b0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.407+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1656017167 shutdown_connections 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.407+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686dfb50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.407+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a06864c1e0 0x55a0686e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.407+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1656017167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686e5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.407+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1656017167 >> 172.21.15.37:0/1656017167 conn(0x55a0685c2720 msgr2=0x55a0686da480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.408+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1656017167 shutdown_connections 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.408+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1656017167 wait complete. 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.408+0000 7f7ca3890b80 1 -- start start 2024-05-09T01:13:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.408+0000 7f7ca3890b80 1 Processor -- start 2024-05-09T01:13:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686eed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0686ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686e9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a06847dc20 con 0x55a06864c1e0 2024-05-09T01:13:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a0685bc1d0 con 0x55a0686df720 2024-05-09T01:13:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a0686e03e0 con 0x55a068562520 2024-05-09T01:13:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7ca3890b80 10 client.0 _ll_register_callbacks cb 0x55a068473740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686eed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48914/0 (socket says 172.21.15.37:48914) 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8e59c700 1 -- 172.21.15.37:0/1021102543 learned_addr learned my addr 172.21.15.37:0/1021102543 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0686ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/1021102543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 msgr2=0x55a0686eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/1021102543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 msgr2=0x55a0686ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0686ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8ed9d700 1 -- 172.21.15.37:0/1021102543 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a06847d510 con 0x55a0686df720 2024-05-09T01:13:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.409+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686e9190 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55a0686e6140 tx=0x7f7c880b3330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded2d86b4db506a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7c75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7c75ffb700 1 -- 172.21.15.37:0/1021102543 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c880b39c0 con 0x55a0686df720 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7c75ffb700 1 -- 172.21.15.37:0/1021102543 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7c880aae50 con 0x55a0686df720 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c880aabf0 con 0x55a0686df720 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7c75ffb700 1 -- 172.21.15.37:0/1021102543 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f7c880ab2f0 con 0x55a0686df720 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7ca3890b80 10 client.27155 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a0686f6920 con 0x55a0686df720 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7c75ffb700 1 -- 172.21.15.37:0/1021102543 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c880aabf0 con 0x55a0686df720 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7c75ffb700 1 -- 172.21.15.37:0/1021102543 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f7c88011070 con 0x55a0686df720 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7ca3890b80 10 client.27155 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.410+0000 7f7ca3890b80 10 client.27155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.411+0000 7f7ca3890b80 20 client.27155 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.411+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a0686f8df0 0x55a0686fb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.411+0000 7f7ca3890b80 4 client.27155 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:32.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.411+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a06860fa50 con 0x55a0686f8df0 2024-05-09T01:13:32.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.411+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a0686f8df0 0x55a0686fb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.411+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a0686f8df0 0x55a0686fb210 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5024dbf6076f340 server_cookie=b89e248f4a6eca8b in_seq=0 out_seq=0 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.411+0000 7f7c75ffb700 10 client.27155 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.412+0000 7f7c75ffb700 1 -- 172.21.15.37:0/1021102543 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a06860fa50 con 0x55a0686f8df0 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.412+0000 7f7c75ffb700 10 client.27155 handle_command_reply: tid=0 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.412+0000 7f7ca3890b80 1 client.27155 shutdown 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.412+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 msgr2=0x55a0686e9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.412+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686e9190 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55a0686e6140 tx=0x7f7c880b3330 comp rx=0 tx=0).stop 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.413+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 shutdown_connections 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.413+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a0686f8df0 0x55a0686fb210 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.413+0000 7f7c75ffb700 0 client.27155 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.413+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a0686e9190 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.413+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.413+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/1021102543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0686ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.413+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 >> 172.21.15.37:0/1021102543 conn(0x55a0685c2720 msgr2=0x55a0686da240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:32.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.414+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 shutdown_connections 2024-05-09T01:13:32.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.414+0000 7f7ca3890b80 1 -- 172.21.15.37:0/1021102543 wait complete. 2024-05-09T01:13:32.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.414+0000 7f7ca3890b80 20 client.27155 trim_cache size 0 max 16384 2024-05-09T01:13:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.448+0000 7f7ca3890b80 1 Processor -- start 2024-05-09T01:13:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7ca3890b80 1 -- start start 2024-05-09T01:13:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686e3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0687008a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a068700de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901ac820 con 0x55a06864c1e0 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901ae420 con 0x55a0686df720 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901acef0 con 0x55a068562520 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48922/0 (socket says 172.21.15.37:48922) 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 -- 172.21.15.37:0/2667341010 learned_addr learned my addr 172.21.15.37:0/2667341010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0687008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a068700de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 -- 172.21.15.37:0/2667341010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 msgr2=0x55a068700de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a068700de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 -- 172.21.15.37:0/2667341010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 msgr2=0x55a0687008a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0687008a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.449+0000 7f7c8e59c700 1 -- 172.21.15.37:0/2667341010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0686dbd80 con 0x55a068562520 2024-05-09T01:13:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.450+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a068700de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.450+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686e3590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55a0686fb840 tx=0x7f7c80004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc42e5b026e38b6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.450+0000 7f7c77fff700 1 -- 172.21.15.37:0/2667341010 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000f220 con 0x55a068562520 2024-05-09T01:13:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.450+0000 7f7c77fff700 1 -- 172.21.15.37:0/2667341010 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c80010d60 con 0x55a068562520 2024-05-09T01:13:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.450+0000 7f7c77fff700 1 -- 172.21.15.37:0/2667341010 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80005310 con 0x55a068562520 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 -- 172.21.15.37:0/2667341010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 msgr2=0x55a0686e3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686e3590 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55a0686fb840 tx=0x7f7c80004750 comp rx=0 tx=0).stop 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 -- 172.21.15.37:0/2667341010 shutdown_connections 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a0686df720 0x55a068700de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a068562520 0x55a0686e3590 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/2667341010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06864c1e0 0x55a0687008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 -- 172.21.15.37:0/2667341010 >> 172.21.15.37:0/2667341010 conn(0x55a0685c2720 msgr2=0x55a0686e2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 -- 172.21.15.37:0/2667341010 shutdown_connections 2024-05-09T01:13:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 -- 172.21.15.37:0/2667341010 wait complete. 2024-05-09T01:13:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.454+0000 7f7ca3890b80 1 -- start start 2024-05-09T01:13:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 1 Processor -- start 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a06864c1e0 0x55a0686f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0686df720 0x55a06875d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901adc90 con 0x55a068562520 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901ad5c0 con 0x55a06864c1e0 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901aa7e0 con 0x55a0686df720 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7ca3890b80 10 client.0 _ll_register_callbacks cb 0x55a068473740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7c8e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33436/0 (socket says 172.21.15.37:33436) 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7c8e59c700 1 -- 172.21.15.37:0/3766395772 learned_addr learned my addr 172.21.15.37:0/3766395772 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7c8ed9d700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0686df720 0x55a06875d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.455+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a06864c1e0 0x55a0686f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c8e59c700 1 -- 172.21.15.37:0/3766395772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0686df720 msgr2=0x55a06875d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0686df720 0x55a06875d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c8e59c700 1 -- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a06864c1e0 msgr2=0x55a0686f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a06864c1e0 0x55a0686f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c8e59c700 1 -- 172.21.15.37:0/3766395772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a06875daa0 con 0x55a068562520 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a06864c1e0 0x55a0686f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c8e59c700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686f4750 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7c80010f50 tx=0x7f7c80010a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6096be4b0f5df1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c75ffb700 1 -- 172.21.15.37:0/3766395772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c800049c0 con 0x55a068562520 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c75ffb700 1 -- 172.21.15.37:0/3766395772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7c80004b60 con 0x55a068562520 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c80010d60 con 0x55a068562520 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7c75ffb700 1 -- 172.21.15.37:0/3766395772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f7c80005020 con 0x55a068562520 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.456+0000 7f7ca3890b80 10 client.17292 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55a068764de0 con 0x55a068562520 2024-05-09T01:13:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7c75ffb700 1 -- 172.21.15.37:0/3766395772 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c80010d60 con 0x55a068562520 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7c75ffb700 1 -- 172.21.15.37:0/3766395772 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f7c8000b040 con 0x55a068562520 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7ca3890b80 10 client.17292 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7ca3890b80 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7ca3890b80 20 client.17292 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a068765440 0x55a068767860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7ca3890b80 4 client.17292 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.457+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a068609af0 con 0x55a068765440 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.458+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a068765440 0x55a068767860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.458+0000 7f7c75ffb700 10 client.17292 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.459+0000 7f7c8dd9b700 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a068765440 0x55a068767860 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a13c4c90f69ec5d8 server_cookie=3f9021db20fde073 in_seq=0 out_seq=0 2024-05-09T01:13:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.460+0000 7f7c75ffb700 1 -- 172.21.15.37:0/3766395772 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a068609af0 con 0x55a068765440 2024-05-09T01:13:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.460+0000 7f7c75ffb700 10 client.17292 handle_command_reply: tid=0 2024-05-09T01:13:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.460+0000 7f7ca3890b80 1 client.17292 shutdown 2024-05-09T01:13:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 msgr2=0x55a0686f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686f4750 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7c80010f50 tx=0x7f7c80010a10 comp rx=0 tx=0).stop 2024-05-09T01:13:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 shutdown_connections 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55a068765440 0x55a068767860 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7c75ffb700 0 client.17292 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a0686df720 0x55a06875d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a068562520 0x55a0686f4750 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 --2- 172.21.15.37:0/3766395772 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a06864c1e0 0x55a0686f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 >> 172.21.15.37:0/3766395772 conn(0x55a0685c2720 msgr2=0x55a0686de710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 shutdown_connections 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.461+0000 7f7ca3890b80 1 -- 172.21.15.37:0/3766395772 wait complete. 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.462+0000 7f7ca3890b80 20 client.17292 trim_cache size 0 max 16384 2024-05-09T01:13:32.464 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:13:32.465 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:13:32.465 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "04040421-3354-4557-abbe-9f59dac1f32b", 2024-05-09T01:13:32.465 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:13:32.465 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:13:32.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.462+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7c780bb160 msgr2=0x7f7c780bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.462+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7c780bb160 0x7f7c780bd670 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55a0686e5030 tx=0x7f7c84006de0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.462+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c901089f0 msgr2=0x7f7c90198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.462+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c901089f0 0x7f7c90198aa0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7c88006070 tx=0x7f7c88004cf0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.463+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 shutdown_connections 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.463+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f7c780bb160 0x7f7c780bd670 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.463+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c901089f0 0x7f7c90198aa0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.463+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c901029c0 0x7f7c9019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.463+0000 7f7c94e7a700 1 --2- 172.21.15.37:0/2513117834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c90103310 0x7f7c9019edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.464+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 >> 172.21.15.37:0/2513117834 conn(0x7f7c900fe6f0 msgr2=0x7f7c90100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.464+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 shutdown_connections 2024-05-09T01:13:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:32.464+0000 7f7c94e7a700 1 -- 172.21.15.37:0/2513117834 wait complete. 2024-05-09T01:13:32.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:32 smithi037 ceph-mon[30122]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 641 op/s 2024-05-09T01:13:32.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:32 smithi136 ceph-mon[34110]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 641 op/s 2024-05-09T01:13:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:32 smithi151 ceph-mon[34780]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 641 op/s 2024-05-09T01:13:33.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:13:33.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:13:33.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:33.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:33.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:33 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.555+0000 7f1a72d55640 1 -- 172.21.15.37:0/1449610038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a640958d0 msgr2=0x7f1a640965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.555+0000 7f1a72d55640 1 --2- 172.21.15.37:0/1449610038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a640958d0 0x7f1a640965d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009900 tx=0x7f1a6802a410 comp rx=0 tx=0).stop 2024-05-09T01:13:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.555+0000 7f1a72d55640 1 -- 172.21.15.37:0/1449610038 shutdown_connections 2024-05-09T01:13:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.555+0000 7f1a72d55640 1 --2- 172.21.15.37:0/1449610038 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a6409b810 0x7f1a6409dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.555+0000 7f1a72d55640 1 --2- 172.21.15.37:0/1449610038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a64096b10 0x7f1a64096f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.555+0000 7f1a72d55640 1 --2- 172.21.15.37:0/1449610038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a640958d0 0x7f1a640965d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.555+0000 7f1a72d55640 1 -- 172.21.15.37:0/1449610038 >> 172.21.15.37:0/1449610038 conn(0x7f1a64090ae0 msgr2=0x7f1a64092f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.556+0000 7f1a72d55640 1 -- 172.21.15.37:0/1449610038 shutdown_connections 2024-05-09T01:13:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.556+0000 7f1a72d55640 1 -- 172.21.15.37:0/1449610038 wait complete. 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 Processor -- start 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 -- start start 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a640958d0 0x7f1a6412d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a64096b10 0x7f1a6412d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6409b810 0x7f1a64134600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640a13d0 con 0x7f1a6409b810 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640a1250 con 0x7f1a64096b10 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a640958d0 0x7f1a6412d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a640958d0 0x7f1a6412d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48928/0 (socket says 172.21.15.37:48928) 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a71d53640 1 -- 172.21.15.37:0/3335747330 learned_addr learned my addr 172.21.15.37:0/3335747330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.557+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640a1550 con 0x7f1a640958d0 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.558+0000 7f1a72554640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6409b810 0x7f1a64134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.558+0000 7f1a71552640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a64096b10 0x7f1a6412d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.558+0000 7f1a71d53640 1 -- 172.21.15.37:0/3335747330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a64096b10 msgr2=0x7f1a6412d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.558+0000 7f1a71d53640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a64096b10 0x7f1a6412d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.558+0000 7f1a71d53640 1 -- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6409b810 msgr2=0x7f1a64134600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.558+0000 7f1a71d53640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6409b810 0x7f1a64134600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.558+0000 7f1a71d53640 1 -- 172.21.15.37:0/3335747330 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a64134c70 con 0x7f1a640958d0 2024-05-09T01:13:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.559+0000 7f1a71d53640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a640958d0 0x7f1a6412d130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006010 tx=0x7f1a68004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.559+0000 7f1a62ffd640 1 -- 172.21.15.37:0/3335747330 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6803f030 con 0x7f1a640958d0 2024-05-09T01:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.559+0000 7f1a62ffd640 1 -- 172.21.15.37:0/3335747330 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a68031910 con 0x7f1a640958d0 2024-05-09T01:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.559+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a64134f00 con 0x7f1a640958d0 2024-05-09T01:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.559+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a64135300 con 0x7f1a640958d0 2024-05-09T01:13:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.559+0000 7f1a62ffd640 1 -- 172.21.15.37:0/3335747330 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68035070 con 0x7f1a640958d0 2024-05-09T01:13:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 Processor -- start 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 -- start start 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bb9d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bb9dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bba4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55946bb017c0 con 0x55946b7d02f0 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55946ba9d0e0 con 0x55946b7d84d0 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.563+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55946bafd780 con 0x55946b7f91b0 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bba4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bba4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56100/0 (socket says 172.21.15.37:56100) 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 -- 172.21.15.37:0/2441341760 learned_addr learned my addr 172.21.15.37:0/2441341760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a72554640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bb9d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a62ffd640 1 -- 172.21.15.37:0/3335747330 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1a68042030 con 0x7f1a640958d0 2024-05-09T01:13:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 -- 172.21.15.37:0/2441341760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 msgr2=0x55946bb9d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 --2- 172.21.15.37:0/2441341760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bb9d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 -- 172.21.15.37:0/2441341760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 msgr2=0x55946bb9dc40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:13:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 --2- 172.21.15.37:0/2441341760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bb9dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 -- 172.21.15.37:0/2441341760 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bac67c0 con 0x55946b7d84d0 2024-05-09T01:13:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.564+0000 7f1a71552640 1 --2- 172.21.15.37:0/2441341760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bba4b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009ca0 tx=0x7f1a5c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0d390d3e07dbb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.565+0000 7f1a57fff640 1 -- 172.21.15.37:0/2441341760 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c005220 con 0x55946b7d84d0 2024-05-09T01:13:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.565+0000 7f1a57fff640 1 -- 172.21.15.37:0/2441341760 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a5c004c50 con 0x55946b7d84d0 2024-05-09T01:13:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.565+0000 7f1a57fff640 1 -- 172.21.15.37:0/2441341760 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0196b0 con 0x55946b7d84d0 2024-05-09T01:13:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.565+0000 7f1a62ffd640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1a580b27f0 0x7f1a580b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.565+0000 7f1a62ffd640 1 -- 172.21.15.37:0/3335747330 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1a68102490 con 0x7f1a640958d0 2024-05-09T01:13:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.565+0000 7f1a72554640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1a580b27f0 0x7f1a580b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.566+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2441341760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 msgr2=0x55946bba4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.566+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2441341760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bba4b40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009ca0 tx=0x7f1a5c011810 comp rx=0 tx=0).stop 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.567+0000 7f1a72554640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1a580b27f0 0x7f1a580b4d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c051dc0 tx=0x7f1a6c068de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.567+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2441341760 shutdown_connections 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.567+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2441341760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bba4b40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.567+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2441341760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bb9dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.567+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2441341760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bb9d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.567+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2441341760 >> 172.21.15.37:0/2441341760 conn(0x55946b7ed300 msgr2=0x55946bb99050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.568+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2441341760 shutdown_connections 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.568+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2441341760 wait complete. 2024-05-09T01:13:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.568+0000 7f1a7ae6d740 1 -- start start 2024-05-09T01:13:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.568+0000 7f1a7ae6d740 1 Processor -- start 2024-05-09T01:13:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d02f0 0x55946bbab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7d84d0 0x55946bbabe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7f91b0 0x55946bbb2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55946bba99a0 con 0x55946b7f91b0 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55946ba889c0 con 0x55946b7d02f0 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55946bba9b20 con 0x55946b7d84d0 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a7ae6d740 10 client.0 _ll_register_callbacks cb 0x55946bab5020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a72554640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7f91b0 0x55946bbb2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d02f0 0x55946bbab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a72554640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7f91b0 0x55946bbb2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33472/0 (socket says 172.21.15.37:33472) 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d02f0 0x55946bbab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56112/0 (socket says 172.21.15.37:56112) 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a72554640 1 -- 172.21.15.37:0/1758595082 learned_addr learned my addr 172.21.15.37:0/1758595082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71552640 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7d84d0 0x55946bbabe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71d53640 1 -- 172.21.15.37:0/1758595082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7d84d0 msgr2=0x55946bbabe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71d53640 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7d84d0 0x55946bbabe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71d53640 1 -- 172.21.15.37:0/1758595082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7f91b0 msgr2=0x55946bbb2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71d53640 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7f91b0 0x55946bbb2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a71d53640 1 -- 172.21.15.37:0/1758595082 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55946baaf1f0 con 0x55946b7d02f0 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.569+0000 7f1a72554640 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7f91b0 0x55946bbb2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.570+0000 7f1a71d53640 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d02f0 0x55946bbab8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a68100080 tx=0x7f1a680c9610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd635976959cb90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.570+0000 7f1a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.570+0000 7f1a557fa640 1 -- 172.21.15.37:0/1758595082 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68049040 con 0x55946b7d02f0 2024-05-09T01:13:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.570+0000 7f1a557fa640 1 -- 172.21.15.37:0/1758595082 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1a680c61f0 con 0x55946b7d02f0 2024-05-09T01:13:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.570+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a5c004c50 con 0x55946b7d02f0 2024-05-09T01:13:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.570+0000 7f1a557fa640 1 -- 172.21.15.37:0/1758595082 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1a680b1040 con 0x55946b7d02f0 2024-05-09T01:13:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.571+0000 7f1a7ae6d740 10 client.27173 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.571+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55946b864790 con 0x55946b7d02f0 2024-05-09T01:13:33.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a557fa640 1 -- 172.21.15.37:0/1758595082 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a5c004c50 con 0x55946b7d02f0 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a557fa640 1 -- 172.21.15.37:0/1758595082 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f1a680c5e90 con 0x55946b7d02f0 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a7ae6d740 10 client.27173 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a7ae6d740 10 client.27173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a7ae6d740 20 client.27173 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b7b7d80 0x55946bbb91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a7ae6d740 4 client.27173 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55946bb0f3d0 con 0x55946b7b7d80 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.572+0000 7f1a71552640 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b7b7d80 0x55946bbb91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.573+0000 7f1a557fa640 10 client.27173 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.573+0000 7f1a71552640 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b7b7d80 0x55946bbb91d0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a218c84109a5d940 server_cookie=8c93a92fb24491f8 in_seq=0 out_seq=0 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a557fa640 1 -- 172.21.15.37:0/1758595082 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55946bb0f3d0 con 0x55946b7b7d80 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a557fa640 10 client.27173 handle_command_reply: tid=0 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 client.27173 shutdown 2024-05-09T01:13:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d02f0 msgr2=0x55946bbab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d02f0 0x55946bbab8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a68100080 tx=0x7f1a680c9610 comp rx=0 tx=0).stop 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 shutdown_connections 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b7b7d80 0x55946bbb91d0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7f91b0 0x55946bbb2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7d84d0 0x55946bbabe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/1758595082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d02f0 0x55946bbab8f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a557fa640 0 client.27173 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 >> 172.21.15.37:0/1758595082 conn(0x55946b7ed300 msgr2=0x55946bb98290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 shutdown_connections 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/1758595082 wait complete. 2024-05-09T01:13:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.574+0000 7f1a7ae6d740 20 client.27173 trim_cache size 0 max 16384 2024-05-09T01:13:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 Processor -- start 2024-05-09T01:13:33.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 -- start start 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bbaba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6413bd60 con 0x55946b7d02f0 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6413d960 con 0x55946b7d84d0 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a7ae6d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6413c430 con 0x55946b7f91b0 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbab4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33476/0 (socket says 172.21.15.37:33476) 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a71d53640 1 -- 172.21.15.37:0/2220498603 learned_addr learned my addr 172.21.15.37:0/2220498603 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a72554640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bbaba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.602+0000 7f1a71552640 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a71d53640 1 -- 172.21.15.37:0/2220498603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 msgr2=0x55946bbaba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a71d53640 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bbaba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a71d53640 1 -- 172.21.15.37:0/2220498603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 msgr2=0x55946bbb2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a71d53640 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a71d53640 1 -- 172.21.15.37:0/2220498603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946b8db5f0 con 0x55946b7d02f0 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a71552640 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a71d53640 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbab4c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1a68031500 tx=0x7f1a6802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb881b801ba1b1b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a577fe640 1 -- 172.21.15.37:0/2220498603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68049050 con 0x55946b7d02f0 2024-05-09T01:13:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a577fe640 1 -- 172.21.15.37:0/2220498603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a680c9c00 con 0x55946b7d02f0 2024-05-09T01:13:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.603+0000 7f1a577fe640 1 -- 172.21.15.37:0/2220498603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a680c5e90 con 0x55946b7d02f0 2024-05-09T01:13:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.604+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2220498603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 msgr2=0x55946bbab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.604+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbab4c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1a68031500 tx=0x7f1a6802a410 comp rx=0 tx=0).stop 2024-05-09T01:13:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.605+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2220498603 shutdown_connections 2024-05-09T01:13:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.605+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bbaba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.605+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.605+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/2220498603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbab4c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.605+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2220498603 >> 172.21.15.37:0/2220498603 conn(0x55946b7ed300 msgr2=0x55946bba18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.605+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2220498603 shutdown_connections 2024-05-09T01:13:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:13:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.605+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/2220498603 wait complete. 2024-05-09T01:13:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.606+0000 7f1a7ae6d740 1 -- start start 2024-05-09T01:13:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.606+0000 7f1a7ae6d740 1 Processor -- start 2024-05-09T01:13:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.606+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbafbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a7ae6d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbafbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71d53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbafbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33480/0 (socket says 172.21.15.37:33480) 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71d53640 1 -- 172.21.15.37:0/150793545 learned_addr learned my addr 172.21.15.37:0/150793545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bc1f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6413d1d0 con 0x55946b7d02f0 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71552640 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6413cb00 con 0x55946b7d84d0 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1a64139d20 con 0x55946b7f91b0 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a72554640 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bc1f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a7ae6d740 10 client.0 _ll_register_callbacks cb 0x7f1a68005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71552640 1 -- 172.21.15.37:0/150793545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 msgr2=0x55946bc1f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:33.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71552640 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bc1f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71552640 1 -- 172.21.15.37:0/150793545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 msgr2=0x55946bbafbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71552640 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbafbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a71552640 1 -- 172.21.15.37:0/150793545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55946bac5ed0 con 0x55946b7d84d0 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.607+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a680c9c00 con 0x55946b7d84d0 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.608+0000 7f1a71552640 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb0100 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c01b040 tx=0x7f1a5c0098f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb7fb1e06b1a0ab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.608+0000 7f1a557fa640 10 client.27179 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.608+0000 7f1a557fa640 1 -- 172.21.15.37:0/150793545 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0052b0 con 0x55946b7d84d0 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.608+0000 7f1a557fa640 1 -- 172.21.15.37:0/150793545 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1a5c005450 con 0x55946b7d84d0 2024-05-09T01:13:33.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.608+0000 7f1a557fa640 1 -- 172.21.15.37:0/150793545 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1a5c0035f0 con 0x55946b7d84d0 2024-05-09T01:13:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.608+0000 7f1a7ae6d740 10 client.27179 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:33.614 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.608+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55946bc208e0 con 0x55946b7d84d0 2024-05-09T01:13:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.610+0000 7f1a557fa640 1 -- 172.21.15.37:0/150793545 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7f1a5c003790 con 0x55946b7d84d0 2024-05-09T01:13:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.610+0000 7f1a7ae6d740 10 client.27179 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:33.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.610+0000 7f1a7ae6d740 10 client.27179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.610+0000 7f1a7ae6d740 20 client.27179 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.611+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b78d1c0 0x55946bc23050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.611+0000 7f1a7ae6d740 4 client.27179 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:13:33.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.611+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55946bba13f0 con 0x55946b78d1c0 2024-05-09T01:13:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.625+0000 7f1a71d53640 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b78d1c0 0x55946bc23050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:13:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:33.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:33 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.644+0000 7f1a71d53640 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b78d1c0 0x55946bc23050 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc36131253676d38 server_cookie=ea976cd34c7930c2 in_seq=0 out_seq=0 2024-05-09T01:13:33.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.647+0000 7f1a557fa640 10 client.27179 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a557fa640 1 -- 172.21.15.37:0/150793545 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55946bba13f0 con 0x55946b78d1c0 2024-05-09T01:13:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a557fa640 10 client.27179 handle_command_reply: tid=0 2024-05-09T01:13:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 client.27179 shutdown 2024-05-09T01:13:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 msgr2=0x55946bbb0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb0100 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c01b040 tx=0x7f1a5c0098f0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 shutdown_connections 2024-05-09T01:13:33.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55946b78d1c0 0x55946bc23050 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55946b7f91b0 0x55946bc1f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a557fa640 0 client.27179 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55946b7d84d0 0x55946bbb0100 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 --2- 172.21.15.37:0/150793545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55946b7d02f0 0x55946bbafbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.716+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 >> 172.21.15.37:0/150793545 conn(0x55946b7ed300 msgr2=0x55946bb9be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.717+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 shutdown_connections 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.717+0000 7f1a7ae6d740 1 -- 172.21.15.37:0/150793545 wait complete. 2024-05-09T01:13:33.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.717+0000 7f1a7ae6d740 20 client.27179 trim_cache size 0 max 16384 2024-05-09T01:13:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:13:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:13:33.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.717+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1a580b27f0 msgr2=0x7f1a580b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.717+0000 7f1a72d55640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1a580b27f0 0x7f1a580b4d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c051dc0 tx=0x7f1a6c068de0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.717+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a640958d0 msgr2=0x7f1a6412d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.717+0000 7f1a72d55640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a640958d0 0x7f1a6412d130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006010 tx=0x7f1a68004270 comp rx=0 tx=0).stop 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 shutdown_connections 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6409b810 0x7f1a64134600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1a580b27f0 0x7f1a580b4d00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1a64096b10 0x7f1a6412d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 --2- 172.21.15.37:0/3335747330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a640958d0 0x7f1a6412d130 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 >> 172.21.15.37:0/3335747330 conn(0x7f1a64090ae0 msgr2=0x7f1a64092270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 shutdown_connections 2024-05-09T01:13:33.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:33.718+0000 7f1a72d55640 1 -- 172.21.15.37:0/3335747330 wait complete. 2024-05-09T01:13:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:13:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:33.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:33.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:33 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:34.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:34 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:13:34.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:34 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:13:34.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:34 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:34.633 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:34 smithi136 ceph-mon[34110]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 615 op/s 2024-05-09T01:13:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:34 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:34 smithi037 ceph-mon[30122]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 615 op/s 2024-05-09T01:13:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:34 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:13:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:34 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:13:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:34 smithi151 ceph-mon[34780]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.1 MiB/s wr, 615 op/s 2024-05-09T01:13:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 675.0 s, 1604.2 tps, lat 62.168 ms stddev 72.211 2024-05-09T01:13:35.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 -- 172.21.15.37:0/3600840546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80010a930 msgr2=0x7fd80010ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 --2- 172.21.15.37:0/3600840546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80010a930 0x7fd80010ad40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009990 tx=0x7fd7f0009ca0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 -- 172.21.15.37:0/3600840546 shutdown_connections 2024-05-09T01:13:35.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 --2- 172.21.15.37:0/3600840546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010b280 0x7fd8001198b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 --2- 172.21.15.37:0/3600840546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd800111bd0 0x7fd800111fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 --2- 172.21.15.37:0/3600840546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80010a930 0x7fd80010ad40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 -- 172.21.15.37:0/3600840546 >> 172.21.15.37:0/3600840546 conn(0x7fd80006f4d0 msgr2=0x7fd80006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 -- 172.21.15.37:0/3600840546 shutdown_connections 2024-05-09T01:13:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.716+0000 7fd807bd4700 1 -- 172.21.15.37:0/3600840546 wait complete. 2024-05-09T01:13:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.717+0000 7fd807bd4700 1 Processor -- start 2024-05-09T01:13:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.717+0000 7fd807bd4700 1 -- start start 2024-05-09T01:13:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd807bd4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010a930 0x7fd80010c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd807bd4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd80010b280 0x7fd80010cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd807bd4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd800111bd0 0x7fd80010d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd807bd4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd80011cc60 con 0x7fd800111bd0 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd807bd4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd80011cae0 con 0x7fd80010b280 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd807bd4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd80011cde0 con 0x7fd80010a930 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010a930 0x7fd80010c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd80010b280 0x7fd80010cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd806171700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd800111bd0 0x7fd80010d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd80010b280 0x7fd80010cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56156/0 (socket says 172.21.15.37:56156) 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010a930 0x7fd80010c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48992/0 (socket says 172.21.15.37:48992) 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd80516f700 1 -- 172.21.15.37:0/810065507 learned_addr learned my addr 172.21.15.37:0/810065507 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 -- 172.21.15.37:0/810065507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd80010b280 msgr2=0x7fd80010cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd80010b280 0x7fd80010cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 -- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd800111bd0 msgr2=0x7fd80010d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd800111bd0 0x7fd80010d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 -- 172.21.15.37:0/810065507 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8001b1950 con 0x7fd80010a930 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.718+0000 7fd805970700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010a930 0x7fd80010c680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00e9c0 tx=0x7fd7fc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.719+0000 7fd7f6ffd700 1 -- 172.21.15.37:0/810065507 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc004220 con 0x7fd80010a930 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.719+0000 7fd7f6ffd700 1 -- 172.21.15.37:0/810065507 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7fc0043c0 con 0x7fd80010a930 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.719+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8001b1c40 con 0x7fd80010a930 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.719+0000 7fd7f6ffd700 1 -- 172.21.15.37:0/810065507 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc003c50 con 0x7fd80010a930 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.719+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8001b2180 con 0x7fd80010a930 2024-05-09T01:13:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.721+0000 7fd7f6ffd700 1 -- 172.21.15.37:0/810065507 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd7fc00c7c0 con 0x7fd80010a930 2024-05-09T01:13:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.722+0000 7fd7f6ffd700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd7ec0b2900 0x7fd7ec0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.722+0000 7fd80516f700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd7ec0b2900 0x7fd7ec0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.722+0000 7fd7f6ffd700 1 -- 172.21.15.37:0/810065507 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd7fc0e22f0 con 0x7fd80010a930 2024-05-09T01:13:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 Processor -- start 2024-05-09T01:13:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 -- start start 2024-05-09T01:13:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd80516f700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd7ec0b2900 0x7fd7ec0b4e10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd80006fb00 tx=0x7fd7f0009590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:35.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 0x557fea7b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea6354a0 0x557fea7b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fea6d4ff0 con 0x557fea7b26a0 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557fea6737f0 con 0x557fea6354a0 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd8165eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557fea6d0fb0 con 0x557fea71f160 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea6354a0 0x557fea7b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea6354a0 0x557fea7b8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56158/0 (socket says 172.21.15.37:56158) 2024-05-09T01:13:35.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.723+0000 7fd80516f700 1 -- 172.21.15.37:0/2501572094 learned_addr learned my addr 172.21.15.37:0/2501572094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.724+0000 7fd806171700 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.724+0000 7fd805970700 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 0x557fea7b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.725+0000 7fd806171700 1 -- 172.21.15.37:0/2501572094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 msgr2=0x557fea7b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.725+0000 7fd806171700 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 0x557fea7b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.725+0000 7fd806171700 1 -- 172.21.15.37:0/2501572094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea6354a0 msgr2=0x557fea7b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.725+0000 7fd806171700 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea6354a0 0x557fea7b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.725+0000 7fd806171700 1 -- 172.21.15.37:0/2501572094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fea66b370 con 0x557fea7b26a0 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.725+0000 7fd806171700 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b2ad0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80115a0 tx=0x7fd7f8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299ec115c4b27eb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.726+0000 7fd7ebfff700 1 -- 172.21.15.37:0/2501572094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011ea0 con 0x557fea7b26a0 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.726+0000 7fd7ebfff700 1 -- 172.21.15.37:0/2501572094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f8004bb0 con 0x557fea7b26a0 2024-05-09T01:13:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.726+0000 7fd7ebfff700 1 -- 172.21.15.37:0/2501572094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8004290 con 0x557fea7b26a0 2024-05-09T01:13:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 -- 172.21.15.37:0/2501572094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 msgr2=0x557fea7b2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b2ad0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80115a0 tx=0x7fd7f8009920 comp rx=0 tx=0).stop 2024-05-09T01:13:35.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 -- 172.21.15.37:0/2501572094 shutdown_connections 2024-05-09T01:13:35.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b2ad0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 0x557fea7b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2501572094 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea6354a0 0x557fea7b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 -- 172.21.15.37:0/2501572094 >> 172.21.15.37:0/2501572094 conn(0x557fea6956a0 msgr2=0x557fea7ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:35.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 -- 172.21.15.37:0/2501572094 shutdown_connections 2024-05-09T01:13:35.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.727+0000 7fd8165eab80 1 -- 172.21.15.37:0/2501572094 wait complete. 2024-05-09T01:13:35.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.728+0000 7fd8165eab80 1 -- start start 2024-05-09T01:13:35.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.728+0000 7fd8165eab80 1 Processor -- start 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7bc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 0x557fea7bc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea7b26a0 0x557fea7bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd8165eab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fea550ba0 con 0x557fea6354a0 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd8165eab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557fea68f150 con 0x557fea7b26a0 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd8165eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557fea7bf1d0 con 0x557fea71f160 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd805970700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7bc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd805970700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7bc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33510/0 (socket says 172.21.15.37:33510) 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.729+0000 7fd805970700 1 -- 172.21.15.37:0/2273224528 learned_addr learned my addr 172.21.15.37:0/2273224528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.730+0000 7fd8165eab80 10 client.0 _ll_register_callbacks cb 0x557fea5466c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:35.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.730+0000 7fd806171700 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea7b26a0 0x557fea7bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.731+0000 7fd805970700 1 -- 172.21.15.37:0/2273224528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 msgr2=0x557fea7bc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.731+0000 7fd805970700 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 0x557fea7bc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.731+0000 7fd805970700 1 -- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea7b26a0 msgr2=0x557fea7bcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.731+0000 7fd805970700 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea7b26a0 0x557fea7bcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.731+0000 7fd805970700 1 -- 172.21.15.37:0/2273224528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fea550490 con 0x557fea6354a0 2024-05-09T01:13:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.731+0000 7fd805970700 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7bc1a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0a98a0 tx=0x7fd7fc0a5170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ac43ce3880c5f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:35.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.731+0000 7fd7e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:13:35.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.743+0000 7fd7e97fa700 1 -- 172.21.15.37:0/2273224528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0c2020 con 0x557fea6354a0 2024-05-09T01:13:35.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.743+0000 7fd7e97fa700 1 -- 172.21.15.37:0/2273224528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd7fc0a9b70 con 0x557fea6354a0 2024-05-09T01:13:35.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.746+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f8004bb0 con 0x557fea6354a0 2024-05-09T01:13:35.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.748+0000 7fd7e97fa700 1 -- 172.21.15.37:0/2273224528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd7fc0a9910 con 0x557fea6354a0 2024-05-09T01:13:35.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.748+0000 7fd8165eab80 10 client.17319 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:35.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.748+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x557fea7c9c50 con 0x557fea6354a0 2024-05-09T01:13:35.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd7e97fa700 1 -- 172.21.15.37:0/2273224528 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f8004bb0 con 0x557fea6354a0 2024-05-09T01:13:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd7e97fa700 1 -- 172.21.15.37:0/2273224528 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fd7fc0c7060 con 0x557fea6354a0 2024-05-09T01:13:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd8165eab80 10 client.17319 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd8165eab80 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd8165eab80 20 client.17319 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea7cc290 0x557fea7ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd8165eab80 4 client.17319 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.752+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fea6e29d0 con 0x557fea7cc290 2024-05-09T01:13:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.753+0000 7fd80516f700 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea7cc290 0x557fea7ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.757+0000 7fd80516f700 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea7cc290 0x557fea7ce730 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e6c36a58b3fd361 server_cookie=7826c6e69302ccc in_seq=0 out_seq=0 2024-05-09T01:13:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.757+0000 7fd7e97fa700 10 client.17319 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.758+0000 7fd7e97fa700 1 -- 172.21.15.37:0/2273224528 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fea6e29d0 con 0x557fea7cc290 2024-05-09T01:13:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.758+0000 7fd7e97fa700 10 client.17319 handle_command_reply: tid=0 2024-05-09T01:13:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.758+0000 7fd8165eab80 1 client.17319 shutdown 2024-05-09T01:13:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.758+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 msgr2=0x557fea7bc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.758+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7bc1a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0a98a0 tx=0x7fd7fc0a5170 comp rx=0 tx=0).stop 2024-05-09T01:13:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 shutdown_connections 2024-05-09T01:13:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea7cc290 0x557fea7ce730 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea7b26a0 0x557fea7bcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7bc1a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 --2- 172.21.15.37:0/2273224528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea71f160 0x557fea7bc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 >> 172.21.15.37:0/2273224528 conn(0x557fea6956a0 msgr2=0x557fea7ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd7e97fa700 0 client.17319 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 shutdown_connections 2024-05-09T01:13:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 1 -- 172.21.15.37:0/2273224528 wait complete. 2024-05-09T01:13:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.759+0000 7fd8165eab80 20 client.17319 trim_cache size 0 max 16384 2024-05-09T01:13:35.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.783+0000 7fd8165eab80 1 Processor -- start 2024-05-09T01:13:35.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd8165eab80 1 -- start start 2024-05-09T01:13:35.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea6354a0 0x557fea7b7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd8165eab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001b5290 con 0x557fea7b26a0 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd8165eab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001b6e90 con 0x557fea71f160 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd8165eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001b5960 con 0x557fea6354a0 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd805970700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea6354a0 0x557fea7b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7b67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56176/0 (socket says 172.21.15.37:56176) 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd80516f700 1 -- 172.21.15.37:0/789115207 learned_addr learned my addr 172.21.15.37:0/789115207 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd806171700 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd80516f700 1 -- 172.21.15.37:0/789115207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea6354a0 msgr2=0x557fea7b7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd80516f700 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea6354a0 0x557fea7b7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.784+0000 7fd80516f700 1 -- 172.21.15.37:0/789115207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 msgr2=0x557fea7b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.785+0000 7fd80516f700 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.785+0000 7fd80516f700 1 -- 172.21.15.37:0/789115207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fea7aed00 con 0x557fea71f160 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.785+0000 7fd806171700 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:35.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.785+0000 7fd80516f700 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7b67c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000b2e0 tx=0x7fd7f001e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=162e34ed8e712d8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:35.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.785+0000 7fd7eb7fe700 1 -- 172.21.15.37:0/789115207 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0003740 con 0x557fea71f160 2024-05-09T01:13:35.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.785+0000 7fd7eb7fe700 1 -- 172.21.15.37:0/789115207 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f0003d90 con 0x557fea71f160 2024-05-09T01:13:35.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.785+0000 7fd7eb7fe700 1 -- 172.21.15.37:0/789115207 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000fdc0 con 0x557fea71f160 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 -- 172.21.15.37:0/789115207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 msgr2=0x557fea7b67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7b67c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000b2e0 tx=0x7fd7f001e000 comp rx=0 tx=0).stop 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 -- 172.21.15.37:0/789115207 shutdown_connections 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea7b26a0 0x557fea7b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea6354a0 0x557fea7b7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 --2- 172.21.15.37:0/789115207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7b67c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 -- 172.21.15.37:0/789115207 >> 172.21.15.37:0/789115207 conn(0x557fea6956a0 msgr2=0x557fea7b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 -- 172.21.15.37:0/789115207 shutdown_connections 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 -- 172.21.15.37:0/789115207 wait complete. 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.786+0000 7fd8165eab80 1 -- start start 2024-05-09T01:13:35.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 1 Processor -- start 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7c4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea7b26a0 0x557fea7bf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001b6700 con 0x557fea6354a0 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001b6030 con 0x557fea71f160 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8001a7370 con 0x557fea7b26a0 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd8165eab80 10 client.0 _ll_register_callbacks cb 0x557fea5466c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd80516f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7bf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:56188/0 (socket says 172.21.15.37:56188) 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd80516f700 1 -- 172.21.15.37:0/3603868661 learned_addr learned my addr 172.21.15.37:0/3603868661 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd806171700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea7b26a0 0x557fea7bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.787+0000 7fd805970700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.788+0000 7fd80516f700 1 -- 172.21.15.37:0/3603868661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea7b26a0 msgr2=0x557fea7bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.788+0000 7fd80516f700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea7b26a0 0x557fea7bf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.788+0000 7fd80516f700 1 -- 172.21.15.37:0/3603868661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 msgr2=0x557fea7c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.788+0000 7fd80516f700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.788+0000 7fd80516f700 1 -- 172.21.15.37:0/3603868661 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fea7ce980 con 0x557fea71f160 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.788+0000 7fd805970700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.788+0000 7fd806171700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea7b26a0 0x557fea7bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd80516f700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7bf3e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009350 tx=0x7fd7f00057d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed04bdebf09cf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd7e97fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd7e97fa700 1 -- 172.21.15.37:0/3603868661 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000fa40 con 0x557fea71f160 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd7e97fa700 1 -- 172.21.15.37:0/3603868661 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd7f000fbe0 con 0x557fea71f160 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f0003d90 con 0x557fea71f160 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd7e97fa700 1 -- 172.21.15.37:0/3603868661 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd7f000fde0 con 0x557fea71f160 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd8165eab80 10 client.27197 fetch_fsmap learned FSMap version 45 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x557fea7a6f60 con 0x557fea71f160 2024-05-09T01:13:35.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.789+0000 7fd7e97fa700 1 -- 172.21.15.37:0/3603868661 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f0003d90 con 0x557fea71f160 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd7e97fa700 1 -- 172.21.15.37:0/3603868661 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 45) ==== 8370+0+0 (secure 0 0 0) 0x7fd7f0022070 con 0x557fea71f160 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd8165eab80 10 client.27197 fetch_fsmap finished waiting for FSMap version 45 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd8165eab80 10 client.27197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd8165eab80 20 client.27197 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd8165eab80 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea8379e0 0x557fea839e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd8165eab80 4 client.27197 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557fea6dca70 con 0x557fea8379e0 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd805970700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea8379e0 0x557fea839e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd7e97fa700 10 client.27197 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.790+0000 7fd805970700 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea8379e0 0x557fea839e00 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88178be5636737fb server_cookie=ccfd9da408fde02a in_seq=0 out_seq=0 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd7e97fa700 1 -- 172.21.15.37:0/3603868661 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557fea6dca70 con 0x557fea8379e0 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd7e97fa700 10 client.27197 handle_command_reply: tid=0 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 client.27197 shutdown 2024-05-09T01:13:35.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 msgr2=0x557fea7bf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7bf3e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009350 tx=0x7fd7f00057d0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 shutdown_connections 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557fea8379e0 0x557fea839e00 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557fea7b26a0 0x557fea7bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fea6354a0 0x557fea7c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 --2- 172.21.15.37:0/3603868661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557fea71f160 0x557fea7bf3e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 >> 172.21.15.37:0/3603868661 conn(0x557fea6956a0 msgr2=0x557fea7b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd7e97fa700 0 client.27197 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 shutdown_connections 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 1 -- 172.21.15.37:0/3603868661 wait complete. 2024-05-09T01:13:35.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.791+0000 7fd8165eab80 20 client.27197 trim_cache size 0 max 16384 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: "04040421-3354-4557-abbe-9f59dac1f32b": { 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "04040421-3354-4557-abbe-9f59dac1f32b", 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:13:35.798 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd7ec0b2900 msgr2=0x7fd7ec0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd7ec0b2900 0x7fd7ec0b4e10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd80006fb00 tx=0x7fd7f0009590 comp rx=0 tx=0).stop 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010a930 msgr2=0x7fd80010c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010a930 0x7fd80010c680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00e9c0 tx=0x7fd7fc00ecd0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 shutdown_connections 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd7ec0b2900 0x7fd7ec0b4e10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd800111bd0 0x7fd80010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd80010a930 0x7fd80010c680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 --2- 172.21.15.37:0/810065507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd80010b280 0x7fd80010cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 >> 172.21.15.37:0/810065507 conn(0x7fd80006f4d0 msgr2=0x7fd800110730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:35.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 shutdown_connections 2024-05-09T01:13:35.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:13:35.792+0000 7fd807bd4700 1 -- 172.21.15.37:0/810065507 wait complete. 2024-05-09T01:13:36.562 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:36 smithi037 ceph-mon[30122]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-05-09T01:13:36.594 INFO:tasks.cephfs.filesystem:scrub status for tag:04040421-3354-4557-abbe-9f59dac1f32b - {'path': '/', 'tag': '04040421-3354-4557-abbe-9f59dac1f32b', 'options': 'recursive,force'} 2024-05-09T01:13:36.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:36 smithi136 ceph-mon[34110]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-05-09T01:13:36.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:36 smithi151 ceph-mon[34780]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 639 op/s 2024-05-09T01:13:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:38 smithi136 ceph-mon[34110]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.6 MiB/s wr, 717 op/s 2024-05-09T01:13:38.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:38 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:13:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:38 smithi037 ceph-mon[30122]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.6 MiB/s wr, 717 op/s 2024-05-09T01:13:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:38 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:13:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:38 smithi151 ceph-mon[34780]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.6 MiB/s wr, 717 op/s 2024-05-09T01:13:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:38 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:13:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 680.0 s, 2261.6 tps, lat 43.932 ms stddev 57.747 2024-05-09T01:13:40.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:40 smithi136 ceph-mon[34110]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.6 MiB/s wr, 700 op/s 2024-05-09T01:13:40.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:40 smithi037 ceph-mon[30122]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.6 MiB/s wr, 700 op/s 2024-05-09T01:13:40.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:40 smithi151 ceph-mon[34780]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.6 MiB/s wr, 700 op/s 2024-05-09T01:13:42.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:42 smithi136 ceph-mon[34110]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 6.6 MiB/s wr, 744 op/s 2024-05-09T01:13:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:42 smithi037 ceph-mon[30122]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 6.6 MiB/s wr, 744 op/s 2024-05-09T01:13:42.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:42 smithi151 ceph-mon[34780]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 6.6 MiB/s wr, 744 op/s 2024-05-09T01:13:43.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:43 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:13:43.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:43 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:13:43.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:43 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:13:44.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:44 smithi136 ceph-mon[34110]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.4 MiB/s wr, 776 op/s 2024-05-09T01:13:44.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:44 smithi037 ceph-mon[30122]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.4 MiB/s wr, 776 op/s 2024-05-09T01:13:44.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:44 smithi151 ceph-mon[34780]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.4 MiB/s wr, 776 op/s 2024-05-09T01:13:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 685.0 s, 1592.0 tps, lat 62.962 ms stddev 68.416 2024-05-09T01:13:46.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:46 smithi136 ceph-mon[34110]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.9 MiB/s wr, 738 op/s 2024-05-09T01:13:46.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:46 smithi037 ceph-mon[30122]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.9 MiB/s wr, 738 op/s 2024-05-09T01:13:46.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:46 smithi151 ceph-mon[34780]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.9 MiB/s wr, 738 op/s 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 -- 172.21.15.37:0/3503254578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1023c0 msgr2=0x7fdc7c10be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/3503254578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1023c0 0x7fdc7c10be20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009ca0 tx=0x7fdc7402a8c0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 -- 172.21.15.37:0/3503254578 shutdown_connections 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/3503254578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1023c0 0x7fdc7c10be20 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/3503254578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c1018c0 0x7fdc7c101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/3503254578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c105210 0x7fdc7c105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 -- 172.21.15.37:0/3503254578 >> 172.21.15.37:0/3503254578 conn(0x7fdc7c0fd4c0 msgr2=0x7fdc7c0ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 -- 172.21.15.37:0/3503254578 shutdown_connections 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.843+0000 7fdc82b9d640 1 -- 172.21.15.37:0/3503254578 wait complete. 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 Processor -- start 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 -- start start 2024-05-09T01:13:46.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1018c0 0x7fdc7c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c1023c0 0x7fdc7c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c105210 0x7fdc7c1a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c10f7f0 con 0x7fdc7c1018c0 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c10f670 con 0x7fdc7c105210 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc82b9d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c10f970 con 0x7fdc7c1023c0 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc80939640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1018c0 0x7fdc7c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc80939640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1018c0 0x7fdc7c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41258/0 (socket says 172.21.15.37:41258) 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc80939640 1 -- 172.21.15.37:0/1877529884 learned_addr learned my addr 172.21.15.37:0/1877529884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc8113a640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c105210 0x7fdc7c1a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.844+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c1023c0 0x7fdc7c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc80939640 1 -- 172.21.15.37:0/1877529884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c1023c0 msgr2=0x7fdc7c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc80939640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c1023c0 0x7fdc7c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc80939640 1 -- 172.21.15.37:0/1877529884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c105210 msgr2=0x7fdc7c1a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc80939640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c105210 0x7fdc7c1a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc80939640 1 -- 172.21.15.37:0/1877529884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1a1e70 con 0x7fdc7c1018c0 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc8113a640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c105210 0x7fdc7c1a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc80939640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1018c0 0x7fdc7c19a330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000e9f0 tx=0x7fdc7000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc79ffb640 1 -- 172.21.15.37:0/1877529884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000ccc0 con 0x7fdc7c1018c0 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c1a2160 con 0x7fdc7c1018c0 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc79ffb640 1 -- 172.21.15.37:0/1877529884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc700035f0 con 0x7fdc7c1018c0 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc79ffb640 1 -- 172.21.15.37:0/1877529884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000ce60 con 0x7fdc7c1018c0 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.845+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1a26b0 con 0x7fdc7c1018c0 2024-05-09T01:13:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.848+0000 7fdc79ffb640 1 -- 172.21.15.37:0/1877529884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdc70003aa0 con 0x7fdc7c1018c0 2024-05-09T01:13:46.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.850+0000 7fdc89a52740 1 Processor -- start 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.851+0000 7fdc79ffb640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc6c0b27e0 0x7fdc6c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.851+0000 7fdc79ffb640 1 -- 172.21.15.37:0/1877529884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdc700e24b0 con 0x7fdc7c1018c0 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.851+0000 7fdc89a52740 1 -- start start 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc89a52740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55617f42f7c0 con 0x55617f0fe2f0 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc89a52740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55617f3cb0e0 con 0x55617f1064d0 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc89a52740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55617f42b780 con 0x55617f1271b0 2024-05-09T01:13:46.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc8113a640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc6c0b27e0 0x7fdc6c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41266/0 (socket says 172.21.15.37:41266) 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 -- 172.21.15.37:0/4017187153 learned_addr learned my addr 172.21.15.37:0/4017187153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc80939640 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc8113a640 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 -- 172.21.15.37:0/4017187153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 msgr2=0x55617f4cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 -- 172.21.15.37:0/4017187153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 msgr2=0x55617f4d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc7bfff640 1 -- 172.21.15.37:0/4017187153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617f3f47c0 con 0x55617f0fe2f0 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.852+0000 7fdc80939640 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.853+0000 7fdc8113a640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc6c0b27e0 0x7fdc6c0b4cf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdc74005e30 tx=0x7fdc740099b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.853+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4cba80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009c90 tx=0x7fdc68011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8f7db92ed0a312 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.853+0000 7fdc66ffd640 1 -- 172.21.15.37:0/4017187153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68004230 con 0x55617f0fe2f0 2024-05-09T01:13:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.853+0000 7fdc66ffd640 1 -- 172.21.15.37:0/4017187153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc680043d0 con 0x55617f0fe2f0 2024-05-09T01:13:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.853+0000 7fdc66ffd640 1 -- 172.21.15.37:0/4017187153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68019640 con 0x55617f0fe2f0 2024-05-09T01:13:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 -- 172.21.15.37:0/4017187153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 msgr2=0x55617f4cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4cba80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009c90 tx=0x7fdc68011810 comp rx=0 tx=0).stop 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 -- 172.21.15.37:0/4017187153 shutdown_connections 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4cba80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 --2- 172.21.15.37:0/4017187153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 -- 172.21.15.37:0/4017187153 >> 172.21.15.37:0/4017187153 conn(0x55617f11b300 msgr2=0x55617f4c6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 -- 172.21.15.37:0/4017187153 shutdown_connections 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.854+0000 7fdc89a52740 1 -- 172.21.15.37:0/4017187153 wait complete. 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 -- start start 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 Processor -- start 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1064d0 0x55617f4d5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1271b0 0x55617f4dc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55617f4d33d0 con 0x55617f0fe2f0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55617f3b69c0 con 0x55617f1271b0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55617f4d3550 con 0x55617f1064d0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc89a52740 10 client.0 _ll_register_callbacks cb 0x55617f3e3020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc80939640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc80939640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4d51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41276/0 (socket says 172.21.15.37:41276) 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc80939640 1 -- 172.21.15.37:0/33222998 learned_addr learned my addr 172.21.15.37:0/33222998 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1064d0 0x55617f4d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.855+0000 7fdc8113a640 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1271b0 0x55617f4dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc80939640 1 -- 172.21.15.37:0/33222998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1064d0 msgr2=0x55617f4d5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc80939640 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1064d0 0x55617f4d5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc80939640 1 -- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1271b0 msgr2=0x55617f4dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc80939640 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1271b0 0x55617f4dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc80939640 1 -- 172.21.15.37:0/33222998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55617f3dd1f0 con 0x55617f0fe2f0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc80939640 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4d51d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fdc700e0050 tx=0x7fdc700b2450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24187e16f7c1da9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc5bfff640 1 -- 172.21.15.37:0/33222998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc700c3060 con 0x55617f0fe2f0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc5bfff640 1 -- 172.21.15.37:0/33222998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdc700b2540 con 0x55617f0fe2f0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc680043d0 con 0x55617f0fe2f0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc5bfff640 1 -- 172.21.15.37:0/33222998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdc700c4250 con 0x55617f0fe2f0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc89a52740 10 client.17334 fetch_fsmap learned FSMap version 47 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.856+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55617f192790 con 0x55617f0fe2f0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc5bfff640 1 -- 172.21.15.37:0/33222998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc680043d0 con 0x55617f0fe2f0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc5bfff640 1 -- 172.21.15.37:0/33222998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fdc700a54e0 con 0x55617f0fe2f0 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc89a52740 10 client.17334 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc89a52740 10 client.17334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc89a52740 20 client.17334 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc89a52740 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0e5d80 0x55617f4e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc89a52740 4 client.17334 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:13:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55617f43d3d0 con 0x55617f0e5d80 2024-05-09T01:13:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.857+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0e5d80 0x55617f4e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.859+0000 7fdc5bfff640 10 client.17334 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.859+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0e5d80 0x55617f4e2bd0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c78856be744f3a server_cookie=d79b8de1ec9516fa in_seq=0 out_seq=0 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.859+0000 7fdc5bfff640 1 -- 172.21.15.37:0/33222998 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55617f43d3d0 con 0x55617f0e5d80 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.859+0000 7fdc5bfff640 10 client.17334 handle_command_reply: tid=0 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.859+0000 7fdc89a52740 1 client.17334 shutdown 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 msgr2=0x55617f4d51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4d51d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fdc700e0050 tx=0x7fdc700b2450 comp rx=0 tx=0).stop 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 shutdown_connections 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0e5d80 0x55617f4e2bd0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1271b0 0x55617f4dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1064d0 0x55617f4d5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 --2- 172.21.15.37:0/33222998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f0fe2f0 0x55617f4d51d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc5bfff640 0 client.17334 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 >> 172.21.15.37:0/33222998 conn(0x55617f11b300 msgr2=0x55617f4c5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 shutdown_connections 2024-05-09T01:13:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 1 -- 172.21.15.37:0/33222998 wait complete. 2024-05-09T01:13:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.860+0000 7fdc89a52740 20 client.17334 trim_cache size 0 max 16384 2024-05-09T01:13:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.893+0000 7fdc89a52740 1 Processor -- start 2024-05-09T01:13:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.896+0000 7fdc89a52740 1 -- start start 2024-05-09T01:13:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.897+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f0fe2f0 0x55617f4c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.897+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.897+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1271b0 0x55617f4d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.897+0000 7fdc89a52740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ab2c0 con 0x55617f1271b0 2024-05-09T01:13:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.897+0000 7fdc89a52740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1acf20 con 0x55617f1064d0 2024-05-09T01:13:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.897+0000 7fdc89a52740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ab990 con 0x55617f0fe2f0 2024-05-09T01:13:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.899+0000 7fdc7bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.900+0000 7fdc7bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40122/0 (socket says 172.21.15.37:40122) 2024-05-09T01:13:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.900+0000 7fdc7bfff640 1 -- 172.21.15.37:0/3860049362 learned_addr learned my addr 172.21.15.37:0/3860049362 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.900+0000 7fdc80939640 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f0fe2f0 0x55617f4c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.902+0000 7fdc80939640 1 -- 172.21.15.37:0/3860049362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 msgr2=0x55617f4d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.902+0000 7fdc8113a640 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1271b0 0x55617f4d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.902+0000 7fdc80939640 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.902+0000 7fdc80939640 1 -- 172.21.15.37:0/3860049362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1271b0 msgr2=0x55617f4d3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.902+0000 7fdc80939640 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1271b0 0x55617f4d3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.902+0000 7fdc80939640 1 -- 172.21.15.37:0/3860049362 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617f2095f0 con 0x55617f0fe2f0 2024-05-09T01:13:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.903+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:13:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.904+0000 7fdc8113a640 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1271b0 0x55617f4d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:13:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.907+0000 7fdc80939640 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f0fe2f0 0x55617f4c6f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc700e27d0 tx=0x7fdc700057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efd033025c4cce59 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.914+0000 7fdc667fc640 1 -- 172.21.15.37:0/3860049362 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc700c4250 con 0x55617f0fe2f0 2024-05-09T01:13:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.914+0000 7fdc667fc640 1 -- 172.21.15.37:0/3860049362 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc700adf20 con 0x55617f0fe2f0 2024-05-09T01:13:46.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.914+0000 7fdc667fc640 1 -- 172.21.15.37:0/3860049362 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc700b27a0 con 0x55617f0fe2f0 2024-05-09T01:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.916+0000 7fdc89a52740 1 -- 172.21.15.37:0/3860049362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f0fe2f0 msgr2=0x55617f4c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.916+0000 7fdc89a52740 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f0fe2f0 0x55617f4c6f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc700e27d0 tx=0x7fdc700057f0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.916+0000 7fdc89a52740 1 -- 172.21.15.37:0/3860049362 shutdown_connections 2024-05-09T01:13:46.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.916+0000 7fdc89a52740 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1271b0 0x55617f4d3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.916+0000 7fdc89a52740 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f1064d0 0x55617f4d38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.916+0000 7fdc89a52740 1 --2- 172.21.15.37:0/3860049362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f0fe2f0 0x55617f4c6f60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.916+0000 7fdc89a52740 1 -- 172.21.15.37:0/3860049362 >> 172.21.15.37:0/3860049362 conn(0x55617f11b300 msgr2=0x55617f4c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.919+0000 7fdc89a52740 1 -- 172.21.15.37:0/3860049362 shutdown_connections 2024-05-09T01:13:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.919+0000 7fdc89a52740 1 -- 172.21.15.37:0/3860049362 wait complete. 2024-05-09T01:13:46.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.919+0000 7fdc89a52740 1 -- start start 2024-05-09T01:13:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.920+0000 7fdc89a52740 1 Processor -- start 2024-05-09T01:13:46.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.920+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f0fe2f0 0x55617f5502b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc89a52740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1064d0 0x55617f5507f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc80939640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f0fe2f0 0x55617f5502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc80939640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f0fe2f0 0x55617f5502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40136/0 (socket says 172.21.15.37:40136) 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc80939640 1 -- 172.21.15.37:0/1660127909 learned_addr learned my addr 172.21.15.37:0/1660127909 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc89a52740 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4da510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ac790 con 0x55617f1064d0 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ac0c0 con 0x55617f0fe2f0 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1a92a0 con 0x55617f1271b0 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.921+0000 7fdc8113a640 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc89a52740 10 client.0 _ll_register_callbacks cb 0x7fdc700045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:13:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc80939640 1 -- 172.21.15.37:0/1660127909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 msgr2=0x55617f4da510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc80939640 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4da510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc80939640 1 -- 172.21.15.37:0/1660127909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1064d0 msgr2=0x55617f5507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:13:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc80939640 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1064d0 0x55617f5507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc80939640 1 -- 172.21.15.37:0/1660127909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55617f3f3ed0 con 0x55617f0fe2f0 2024-05-09T01:13:46.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc80939640 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f0fe2f0 0x55617f5502b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdc700a5470 tx=0x7fdc700041e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b52e96a936b00ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:13:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.922+0000 7fdc5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:13:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.923+0000 7fdc5bfff640 1 -- 172.21.15.37:0/1660127909 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc700c4250 con 0x55617f0fe2f0 2024-05-09T01:13:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.923+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc700adf20 con 0x55617f0fe2f0 2024-05-09T01:13:46.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.923+0000 7fdc5bfff640 1 -- 172.21.15.37:0/1660127909 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdc700a9090 con 0x55617f0fe2f0 2024-05-09T01:13:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.924+0000 7fdc5bfff640 1 -- 172.21.15.37:0/1660127909 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdc700a9940 con 0x55617f0fe2f0 2024-05-09T01:13:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.924+0000 7fdc89a52740 10 client.27215 fetch_fsmap learned FSMap version 47 2024-05-09T01:13:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.924+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55617f4dba10 con 0x55617f0fe2f0 2024-05-09T01:13:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.924+0000 7fdc5bfff640 1 -- 172.21.15.37:0/1660127909 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc700a5650 con 0x55617f0fe2f0 2024-05-09T01:13:46.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.924+0000 7fdc5bfff640 1 -- 172.21.15.37:0/1660127909 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fdc700a8a70 con 0x55617f0fe2f0 2024-05-09T01:13:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.925+0000 7fdc89a52740 10 client.27215 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:13:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.925+0000 7fdc89a52740 10 client.27215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:13:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.925+0000 7fdc89a52740 20 client.27215 populate_metadata read hostname 'smithi037' 2024-05-09T01:13:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.925+0000 7fdc89a52740 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0bb1c0 0x55617f566800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:13:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.925+0000 7fdc89a52740 4 client.27215 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:13:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.925+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fdc700adf20 con 0x55617f0bb1c0 2024-05-09T01:13:46.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.926+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0bb1c0 0x55617f566800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:13:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.926+0000 7fdc5bfff640 10 client.27215 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:46.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.926+0000 7fdc7bfff640 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0bb1c0 0x55617f566800 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f897b913ff948ce9 server_cookie=b93d8ac389cef236 in_seq=0 out_seq=0 2024-05-09T01:13:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc5bfff640 1 -- 172.21.15.37:0/1660127909 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fdc700adf20 con 0x55617f0bb1c0 2024-05-09T01:13:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc5bfff640 10 client.27215 handle_command_reply: tid=0 2024-05-09T01:13:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 client.27215 shutdown 2024-05-09T01:13:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f0fe2f0 msgr2=0x55617f5502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f0fe2f0 0x55617f5502b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdc700a5470 tx=0x7fdc700041e0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 shutdown_connections 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55617f0bb1c0 0x55617f566800 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55617f1271b0 0x55617f4da510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55617f1064d0 0x55617f5507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 --2- 172.21.15.37:0/1660127909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55617f0fe2f0 0x55617f5502b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 >> 172.21.15.37:0/1660127909 conn(0x55617f11b300 msgr2=0x55617f4d38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc5bfff640 0 client.27215 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 shutdown_connections 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 1 -- 172.21.15.37:0/1660127909 wait complete. 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.977+0000 7fdc89a52740 20 client.27215 trim_cache size 0 max 16384 2024-05-09T01:13:46.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:13:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:13:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:13:46.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc6c0b27e0 msgr2=0x7fdc6c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc6c0b27e0 0x7fdc6c0b4cf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fdc74005e30 tx=0x7fdc740099b0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1018c0 msgr2=0x7fdc7c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1018c0 0x7fdc7c19a330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000e9f0 tx=0x7fdc7000eeb0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 shutdown_connections 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc6c0b27e0 0x7fdc6c0b4cf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c105210 0x7fdc7c1a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c1023c0 0x7fdc7c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 --2- 172.21.15.37:0/1877529884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1018c0 0x7fdc7c19a330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 >> 172.21.15.37:0/1877529884 conn(0x7fdc7c0fd4c0 msgr2=0x7fdc7c107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 shutdown_connections 2024-05-09T01:13:46.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:13:46.978+0000 7fdc82b9d640 1 -- 172.21.15.37:0/1877529884 wait complete. 2024-05-09T01:13:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:48 smithi136 ceph-mon[34110]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-05-09T01:13:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:13:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:13:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:13:48.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:13:48.629 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:13:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:48 smithi037 ceph-mon[30122]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-05-09T01:13:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:13:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:13:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:13:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:13:48.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:13:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:48 smithi151 ceph-mon[34780]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-05-09T01:13:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:13:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:13:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:13:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:13:48.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:13:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 690.0 s, 1504.6 tps, lat 66.943 ms stddev 74.402 2024-05-09T01:13:50.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:50 smithi136 ceph-mon[34110]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-05-09T01:13:50.638 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:50 smithi037 ceph-mon[30122]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-05-09T01:13:50.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:50 smithi151 ceph-mon[34780]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.3 MiB/s wr, 635 op/s 2024-05-09T01:13:52.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:52 smithi136 ceph-mon[34110]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-05-09T01:13:52.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:52 smithi037 ceph-mon[30122]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-05-09T01:13:52.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:52 smithi151 ceph-mon[34780]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.2 MiB/s wr, 666 op/s 2024-05-09T01:13:54.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:54 smithi136 ceph-mon[34110]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 647 op/s 2024-05-09T01:13:54.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:54 smithi151 ceph-mon[34780]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 647 op/s 2024-05-09T01:13:54.728 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:54 smithi037 ceph-mon[30122]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 647 op/s 2024-05-09T01:13:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 695.0 s, 1793.0 tps, lat 55.106 ms stddev 62.770 2024-05-09T01:13:56.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:56 smithi037 ceph-mon[30122]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 571 op/s 2024-05-09T01:13:56.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:56 smithi151 ceph-mon[34780]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 571 op/s 2024-05-09T01:13:56.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:56 smithi136 ceph-mon[34110]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.3 MiB/s wr, 571 op/s 2024-05-09T01:13:58.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:58 smithi037 ceph-mon[30122]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 616 op/s 2024-05-09T01:13:58.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:58 smithi151 ceph-mon[34780]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 616 op/s 2024-05-09T01:13:58.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:58 smithi136 ceph-mon[34110]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 616 op/s 2024-05-09T01:13:59.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:13:59 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:13:59.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:13:59 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:13:59.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:13:59 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:14:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.135+0000 7fd292ceb640 1 -- 172.21.15.37:0/824683661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10ffe0 msgr2=0x7fd28c1103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.135+0000 7fd292ceb640 1 --2- 172.21.15.37:0/824683661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10ffe0 0x7fd28c1103f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009860 tx=0x7fd27c02a340 comp rx=0 tx=0).stop 2024-05-09T01:14:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.136+0000 7fd292ceb640 1 -- 172.21.15.37:0/824683661 shutdown_connections 2024-05-09T01:14:00.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.136+0000 7fd292ceb640 1 --2- 172.21.15.37:0/824683661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10ffe0 0x7fd28c1103f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.136+0000 7fd292ceb640 1 --2- 172.21.15.37:0/824683661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10b2c0 0x7fd28c10b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.136+0000 7fd292ceb640 1 --2- 172.21.15.37:0/824683661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd28c10a470 0x7fd28c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.136+0000 7fd292ceb640 1 -- 172.21.15.37:0/824683661 >> 172.21.15.37:0/824683661 conn(0x7fd28c070460 msgr2=0x7fd28c072910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.139+0000 7fd292ceb640 1 -- 172.21.15.37:0/824683661 shutdown_connections 2024-05-09T01:14:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.139+0000 7fd292ceb640 1 -- 172.21.15.37:0/824683661 wait complete. 2024-05-09T01:14:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.140+0000 7fd292ceb640 1 Processor -- start 2024-05-09T01:14:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd292ceb640 1 -- start start 2024-05-09T01:14:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd292ceb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10a470 0x7fd28c1171c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd292ceb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10b2c0 0x7fd28c117700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd292ceb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd28c10ffe0 0x7fd28c118660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd292ceb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c11e3c0 con 0x7fd28c10ffe0 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd292ceb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c11e240 con 0x7fd28c10b2c0 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd292ceb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c11e540 con 0x7fd28c10a470 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd291ce9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10a470 0x7fd28c1171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd291ce9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10a470 0x7fd28c1171c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47992/0 (socket says 172.21.15.37:47992) 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd291ce9640 1 -- 172.21.15.37:0/96217419 learned_addr learned my addr 172.21.15.37:0/96217419 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.141+0000 7fd2914e8640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10b2c0 0x7fd28c117700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.142+0000 7fd291ce9640 1 -- 172.21.15.37:0/96217419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10b2c0 msgr2=0x7fd28c117700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.142+0000 7fd291ce9640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10b2c0 0x7fd28c117700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.142+0000 7fd291ce9640 1 -- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd28c10ffe0 msgr2=0x7fd28c118660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:14:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.142+0000 7fd291ce9640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd28c10ffe0 0x7fd28c118660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.142+0000 7fd291ce9640 1 -- 172.21.15.37:0/96217419 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c118cd0 con 0x7fd28c10a470 2024-05-09T01:14:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.142+0000 7fd2914e8640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10b2c0 0x7fd28c117700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:14:00.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.142+0000 7fd291ce9640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10a470 0x7fd28c1171c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd28400b9c0 tx=0x7fd28400be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.146+0000 7fd282ffd640 1 -- 172.21.15.37:0/96217419 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284019070 con 0x7fd28c10a470 2024-05-09T01:14:00.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.146+0000 7fd282ffd640 1 -- 172.21.15.37:0/96217419 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd28400cba0 con 0x7fd28c10a470 2024-05-09T01:14:00.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.147+0000 7fd282ffd640 1 -- 172.21.15.37:0/96217419 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840125a0 con 0x7fd28c10a470 2024-05-09T01:14:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.147+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c118fc0 con 0x7fd28c10a470 2024-05-09T01:14:00.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.147+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c119490 con 0x7fd28c10a470 2024-05-09T01:14:00.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.151+0000 7fd29ae00740 1 Processor -- start 2024-05-09T01:14:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.151+0000 7fd29ae00740 1 -- start start 2024-05-09T01:14:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8dde21b0 0x559a8e1866c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e186c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e18db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd2924ea640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8dde21b0 0x559a8e1866c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd2924ea640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8dde21b0 0x559a8e1866c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59438/0 (socket says 172.21.15.37:59438) 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd29ae00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a8e0ea7c0 con 0x559a8ddb92f0 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd29ae00740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559a8e0860e0 con 0x559a8dde21b0 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd29ae00740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559a8e0e6780 con 0x559a8ddc14d0 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.152+0000 7fd2924ea640 1 -- 172.21.15.37:0/2563455520 learned_addr learned my addr 172.21.15.37:0/2563455520 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.153+0000 7fd2914e8640 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e18db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.153+0000 7fd2924ea640 1 -- 172.21.15.37:0/2563455520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 msgr2=0x559a8e18db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.153+0000 7fd2924ea640 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e18db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.153+0000 7fd2924ea640 1 -- 172.21.15.37:0/2563455520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 msgr2=0x559a8e186c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:14:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.153+0000 7fd2924ea640 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e186c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.153+0000 7fd2924ea640 1 -- 172.21.15.37:0/2563455520 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a8e0af7c0 con 0x559a8dde21b0 2024-05-09T01:14:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.153+0000 7fd2924ea640 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8dde21b0 0x559a8e1866c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd27c005d00 tx=0x7fd27c005e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbc447d057b25a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.154+0000 7fd277fff640 1 -- 172.21.15.37:0/2563455520 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c037050 con 0x559a8dde21b0 2024-05-09T01:14:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.154+0000 7fd277fff640 1 -- 172.21.15.37:0/2563455520 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd27c038040 con 0x559a8dde21b0 2024-05-09T01:14:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.155+0000 7fd29ae00740 1 -- 172.21.15.37:0/2563455520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8dde21b0 msgr2=0x559a8e1866c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.155+0000 7fd29ae00740 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8dde21b0 0x559a8e1866c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd27c005d00 tx=0x7fd27c005e40 comp rx=0 tx=0).stop 2024-05-09T01:14:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.155+0000 7fd29ae00740 1 -- 172.21.15.37:0/2563455520 shutdown_connections 2024-05-09T01:14:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.155+0000 7fd29ae00740 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e18db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.155+0000 7fd29ae00740 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e186c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.155+0000 7fd29ae00740 1 --2- 172.21.15.37:0/2563455520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8dde21b0 0x559a8e1866c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.155+0000 7fd29ae00740 1 -- 172.21.15.37:0/2563455520 >> 172.21.15.37:0/2563455520 conn(0x559a8ddd6300 msgr2=0x559a8e182050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.158+0000 7fd282ffd640 1 -- 172.21.15.37:0/96217419 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd284014440 con 0x7fd28c10a470 2024-05-09T01:14:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.159+0000 7fd29ae00740 1 -- 172.21.15.37:0/2563455520 shutdown_connections 2024-05-09T01:14:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.159+0000 7fd29ae00740 1 -- 172.21.15.37:0/2563455520 wait complete. 2024-05-09T01:14:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.159+0000 7fd282ffd640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2780b2710 0x7fd2780b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.160+0000 7fd282ffd640 1 -- 172.21.15.37:0/96217419 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd2840e1510 con 0x7fd28c10a470 2024-05-09T01:14:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.160+0000 7fd29ae00740 1 -- start start 2024-05-09T01:14:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.160+0000 7fd29ae00740 1 Processor -- start 2024-05-09T01:14:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.160+0000 7fd2914e8640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2780b2710 0x7fd2780b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e1903f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddc14d0 0x559a8e190930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e197890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd29ae00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a8e18e5d0 con 0x559a8ddb92f0 2024-05-09T01:14:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd29ae00740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559a8e0719c0 con 0x559a8ddc14d0 2024-05-09T01:14:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd29ae00740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559a8e18e750 con 0x559a8dde21b0 2024-05-09T01:14:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd29ae00740 10 client.0 _ll_register_callbacks cb 0x559a8e09e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd2924ea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd2924ea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48020/0 (socket says 172.21.15.37:48020) 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd2924ea640 1 -- 172.21.15.37:0/1312167921 learned_addr learned my addr 172.21.15.37:0/1312167921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.161+0000 7fd291ce9640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e1903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd2914e8640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddc14d0 0x559a8e190930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd291ce9640 1 -- 172.21.15.37:0/1312167921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 msgr2=0x559a8e197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd291ce9640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd291ce9640 1 -- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddc14d0 msgr2=0x559a8e190930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd291ce9640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddc14d0 0x559a8e190930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd291ce9640 1 -- 172.21.15.37:0/1312167921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a8e0981f0 con 0x559a8ddb92f0 2024-05-09T01:14:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd2924ea640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd2914e8640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2780b2710 0x7fd2780b4c20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x559a8e182de0 tx=0x7fd288009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd291ce9640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e1903f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd28400b990 tx=0x7fd2840b13d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d89c8688b62094e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.162+0000 7fd2757fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:14:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.163+0000 7fd2757fa640 1 -- 172.21.15.37:0/1312167921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840a8bb0 con 0x559a8ddb92f0 2024-05-09T01:14:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.163+0000 7fd2757fa640 1 -- 172.21.15.37:0/1312167921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd2840e10e0 con 0x559a8ddb92f0 2024-05-09T01:14:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.163+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd27c038040 con 0x559a8ddb92f0 2024-05-09T01:14:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.163+0000 7fd2757fa640 1 -- 172.21.15.37:0/1312167921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd2840acf60 con 0x559a8ddb92f0 2024-05-09T01:14:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.164+0000 7fd29ae00740 10 client.17337 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.164+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x559a8de4d790 con 0x559a8ddb92f0 2024-05-09T01:14:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.164+0000 7fd2757fa640 1 -- 172.21.15.37:0/1312167921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd27c038040 con 0x559a8ddb92f0 2024-05-09T01:14:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd2757fa640 1 -- 172.21.15.37:0/1312167921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fd2840b1580 con 0x559a8ddb92f0 2024-05-09T01:14:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd29ae00740 10 client.17337 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd29ae00740 10 client.17337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd29ae00740 20 client.17337 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dda0d80 0x559a8e19ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd29ae00740 4 client.17337 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a8e0f83d0 con 0x559a8dda0d80 2024-05-09T01:14:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.165+0000 7fd2914e8640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dda0d80 0x559a8e19ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.166+0000 7fd2914e8640 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dda0d80 0x559a8e19ddd0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=375dfbf6191a7333 server_cookie=eefd254c1f46733f in_seq=0 out_seq=0 2024-05-09T01:14:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.166+0000 7fd2757fa640 10 client.17337 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.167+0000 7fd2757fa640 1 -- 172.21.15.37:0/1312167921 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559a8e0f83d0 con 0x559a8dda0d80 2024-05-09T01:14:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.167+0000 7fd2757fa640 10 client.17337 handle_command_reply: tid=0 2024-05-09T01:14:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.167+0000 7fd29ae00740 1 client.17337 shutdown 2024-05-09T01:14:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.167+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 msgr2=0x559a8e1903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.167+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e1903f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd28400b990 tx=0x7fd2840b13d0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.168+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 shutdown_connections 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.168+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dda0d80 0x559a8e19ddd0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.168+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.168+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddc14d0 0x559a8e190930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.168+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1312167921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddb92f0 0x559a8e1903f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.168+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 >> 172.21.15.37:0/1312167921 conn(0x559a8ddd6300 msgr2=0x559a8e181290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.169+0000 7fd2757fa640 0 client.17337 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.169+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 shutdown_connections 2024-05-09T01:14:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.169+0000 7fd29ae00740 1 -- 172.21.15.37:0/1312167921 wait complete. 2024-05-09T01:14:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.169+0000 7fd29ae00740 20 client.17337 trim_cache size 0 max 16384 2024-05-09T01:14:00.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.194+0000 7fd29ae00740 1 Processor -- start 2024-05-09T01:14:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd29ae00740 1 -- start start 2024-05-09T01:14:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e19db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddc14d0 0x559a8e1819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e181f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd29ae00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c1c23b0 con 0x559a8ddc14d0 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd29ae00740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c1c4010 con 0x559a8ddb92f0 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd29ae00740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c1c2a80 con 0x559a8dde21b0 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd291ce9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd291ce9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e19db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:59452/0 (socket says 172.21.15.37:59452) 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.195+0000 7fd291ce9640 1 -- 172.21.15.37:0/879466203 learned_addr learned my addr 172.21.15.37:0/879466203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd2914e8640 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddc14d0 0x559a8e1819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd2924ea640 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e181f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd291ce9640 1 -- 172.21.15.37:0/879466203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 msgr2=0x559a8e181f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd291ce9640 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e181f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd291ce9640 1 -- 172.21.15.37:0/879466203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddc14d0 msgr2=0x559a8e1819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd291ce9640 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddc14d0 0x559a8e1819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd291ce9640 1 -- 172.21.15.37:0/879466203 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a8dec45f0 con 0x559a8ddb92f0 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd291ce9640 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e19db10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd2840ad120 tx=0x7fd284014f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3f222e4ec12ebc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd2777fe640 1 -- 172.21.15.37:0/879466203 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840c7030 con 0x559a8ddb92f0 2024-05-09T01:14:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd2777fe640 1 -- 172.21.15.37:0/879466203 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2840a86c0 con 0x559a8ddb92f0 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.196+0000 7fd2777fe640 1 -- 172.21.15.37:0/879466203 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2840c3290 con 0x559a8ddb92f0 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 -- 172.21.15.37:0/879466203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 msgr2=0x559a8e19db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e19db10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd2840ad120 tx=0x7fd284014f60 comp rx=0 tx=0).stop 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 -- 172.21.15.37:0/879466203 shutdown_connections 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8dde21b0 0x559a8e181f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8ddc14d0 0x559a8e1819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 --2- 172.21.15.37:0/879466203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e19db10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 -- 172.21.15.37:0/879466203 >> 172.21.15.37:0/879466203 conn(0x559a8ddd6300 msgr2=0x559a8e18a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 -- 172.21.15.37:0/879466203 shutdown_connections 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.197+0000 7fd29ae00740 1 -- 172.21.15.37:0/879466203 wait complete. 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 -- start start 2024-05-09T01:14:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 Processor -- start 2024-05-09T01:14:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e191a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e196e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8dde21b0 0x559a8e191fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c1c3880 con 0x559a8dde21b0 2024-05-09T01:14:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c1c31b0 con 0x559a8ddb92f0 2024-05-09T01:14:00.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c1c0390 con 0x559a8ddc14d0 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.198+0000 7fd29ae00740 10 client.0 _ll_register_callbacks cb 0x7fd2840a8390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:48040/0 (socket says 172.21.15.37:48040) 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 -- 172.21.15.37:0/1515788071 learned_addr learned my addr 172.21.15.37:0/1515788071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd291ce9640 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e191a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2924ea640 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8dde21b0 0x559a8e191fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 -- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 msgr2=0x559a8e191a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e191a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 -- 172.21.15.37:0/1515788071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8dde21b0 msgr2=0x559a8e191fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8dde21b0 0x559a8e191fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 -- 172.21.15.37:0/1515788071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a8e0aeed0 con 0x559a8ddc14d0 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2914e8640 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e196e00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x559a8e19e570 tx=0x7fd2880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eca0cc74af6c72 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:00.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2757fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.199+0000 7fd2757fa640 1 -- 172.21.15.37:0/1515788071 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28802b3f0 con 0x559a8ddc14d0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd2757fa640 1 -- 172.21.15.37:0/1515788071 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd28802b590 con 0x559a8ddc14d0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2840a86c0 con 0x559a8ddc14d0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd2757fa640 1 -- 172.21.15.37:0/1515788071 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd28802b790 con 0x559a8ddc14d0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 10 client.27190 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x559a8e205270 con 0x559a8ddc14d0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd2757fa640 1 -- 172.21.15.37:0/1515788071 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd28802b930 con 0x559a8ddc14d0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd2757fa640 1 -- 172.21.15.37:0/1515788071 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fd28800f040 con 0x559a8ddc14d0 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 10 client.27190 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 10 client.27190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 20 client.27190 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dd761c0 0x559a8e207d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 4 client.27190 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:14:00.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd2840a86c0 con 0x559a8dd761c0 2024-05-09T01:14:00.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.200+0000 7fd291ce9640 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dd761c0 0x559a8e207d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:00.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.201+0000 7fd2757fa640 10 client.27190 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:00.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.201+0000 7fd291ce9640 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dd761c0 0x559a8e207d20 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f29fbc11df8430f server_cookie=1b7eb0b7c70d9b0b in_seq=0 out_seq=0 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd2757fa640 1 -- 172.21.15.37:0/1515788071 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fd2840a86c0 con 0x559a8dd761c0 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd2757fa640 10 client.27190 handle_command_reply: tid=0 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 client.27190 shutdown 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 msgr2=0x559a8e196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e196e00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x559a8e19e570 tx=0x7fd2880046c0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 shutdown_connections 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559a8dd761c0 0x559a8e207d20 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a8dde21b0 0x559a8e191fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559a8ddc14d0 0x559a8e196e00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 --2- 172.21.15.37:0/1515788071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559a8ddb92f0 0x559a8e191a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 >> 172.21.15.37:0/1515788071 conn(0x559a8ddd6300 msgr2=0x559a8e18eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd2757fa640 0 client.27190 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 shutdown_connections 2024-05-09T01:14:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 1 -- 172.21.15.37:0/1515788071 wait complete. 2024-05-09T01:14:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.212+0000 7fd29ae00740 20 client.27190 trim_cache size 0 max 16384 2024-05-09T01:14:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:14:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:14:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:14:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2780b2710 msgr2=0x7fd2780b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2780b2710 0x7fd2780b4c20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x559a8e182de0 tx=0x7fd288009260 comp rx=0 tx=0).stop 2024-05-09T01:14:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10a470 msgr2=0x7fd28c1171c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10a470 0x7fd28c1171c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd28400b9c0 tx=0x7fd28400be80 comp rx=0 tx=0).stop 2024-05-09T01:14:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 shutdown_connections 2024-05-09T01:14:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd28c10ffe0 0x7fd28c118660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2780b2710 0x7fd2780b4c20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c10b2c0 0x7fd28c117700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 --2- 172.21.15.37:0/96217419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd28c10a470 0x7fd28c1171c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 >> 172.21.15.37:0/96217419 conn(0x7fd28c070460 msgr2=0x7fd28c10bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 shutdown_connections 2024-05-09T01:14:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:00.213+0000 7fd292ceb640 1 -- 172.21.15.37:0/96217419 wait complete. 2024-05-09T01:14:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 700.0 s, 1677.2 tps, lat 60.216 ms stddev 74.377 2024-05-09T01:14:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:00 smithi037 ceph-mon[30122]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 608 op/s 2024-05-09T01:14:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:00 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:14:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:00 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:14:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:00 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:14:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:00 smithi151 ceph-mon[34780]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 608 op/s 2024-05-09T01:14:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:00 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:14:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:00 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:14:00.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:00 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:14:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:00 smithi136 ceph-mon[34110]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 608 op/s 2024-05-09T01:14:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:00 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:14:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:00 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:14:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:00 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:14:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:02 smithi037 ceph-mon[30122]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-05-09T01:14:02.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:02 smithi151 ceph-mon[34780]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-05-09T01:14:02.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:02 smithi136 ceph-mon[34110]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-05-09T01:14:04.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:04 smithi037 ceph-mon[30122]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 631 op/s 2024-05-09T01:14:04.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:04 smithi151 ceph-mon[34780]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 631 op/s 2024-05-09T01:14:04.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:04 smithi136 ceph-mon[34110]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 631 op/s 2024-05-09T01:14:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 705.0 s, 1536.6 tps, lat 64.742 ms stddev 73.848 2024-05-09T01:14:06.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:14:06.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:06 smithi037 ceph-mon[30122]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 550 op/s 2024-05-09T01:14:06.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:06 smithi151 ceph-mon[34780]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 550 op/s 2024-05-09T01:14:06.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:06 smithi136 ceph-mon[34110]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.6 MiB/s wr, 550 op/s 2024-05-09T01:14:06.945 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:08.653 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:08 smithi037 ceph-mon[30122]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-05-09T01:14:08.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:08 smithi151 ceph-mon[34780]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-05-09T01:14:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.834+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/1559622567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca010a960 msgr2=0x7f8ca010ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.834+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/1559622567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca010a960 0x7f8ca010ad70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8c94009990 tx=0x7f8c94009ca0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.836+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/1559622567 shutdown_connections 2024-05-09T01:14:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.836+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/1559622567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca010b2b0 0x7f8ca0117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.836+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/1559622567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ca0110990 0x7f8ca0110da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.836+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/1559622567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca010a960 0x7f8ca010ad70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.836+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/1559622567 >> 172.21.15.37:0/1559622567 conn(0x7f8ca0076d30 msgr2=0x7f8ca0077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.840+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/1559622567 shutdown_connections 2024-05-09T01:14:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.840+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/1559622567 wait complete. 2024-05-09T01:14:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.841+0000 7f8ca4b4e700 1 Processor -- start 2024-05-09T01:14:08.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.843+0000 7f8ca4b4e700 1 -- start start 2024-05-09T01:14:08.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.843+0000 7f8ca4b4e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca010a960 0x7f8ca0084070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.843+0000 7f8ca4b4e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ca010b2b0 0x7f8ca007f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.843+0000 7f8ca4b4e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca0110990 0x7f8ca007f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.843+0000 7f8ca4b4e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca007d6a0 con 0x7f8ca010a960 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.843+0000 7f8ca4b4e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca007d520 con 0x7f8ca0110990 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.843+0000 7f8ca4b4e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca007d820 con 0x7f8ca010b2b0 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.846+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca010a960 0x7f8ca0084070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.846+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca010a960 0x7f8ca0084070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54826/0 (socket says 172.21.15.37:54826) 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.846+0000 7f8c9e59c700 1 -- 172.21.15.37:0/2043207304 learned_addr learned my addr 172.21.15.37:0/2043207304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.846+0000 7f8c9dd9b700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ca010b2b0 0x7f8ca007f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.847+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca0110990 0x7f8ca007f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.847+0000 7f8c9dd9b700 1 -- 172.21.15.37:0/2043207304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca0110990 msgr2=0x7f8ca007f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.847+0000 7f8c9dd9b700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca0110990 0x7f8ca007f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.847+0000 7f8c9dd9b700 1 -- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca010a960 msgr2=0x7f8ca0084070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.847+0000 7f8c9dd9b700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca010a960 0x7f8ca0084070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.847+0000 7f8c9dd9b700 1 -- 172.21.15.37:0/2043207304 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca007fec0 con 0x7f8ca010b2b0 2024-05-09T01:14:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.847+0000 7f8c9dd9b700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ca010b2b0 0x7f8ca007f240 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c94006010 tx=0x7f8c940057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.849+0000 7f8c8f7fe700 1 -- 172.21.15.37:0/2043207304 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94026070 con 0x7f8ca010b2b0 2024-05-09T01:14:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.849+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca01b6320 con 0x7f8ca010b2b0 2024-05-09T01:14:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.849+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca01b66c0 con 0x7f8ca010b2b0 2024-05-09T01:14:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.849+0000 7f8c8f7fe700 1 -- 172.21.15.37:0/2043207304 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c94003f20 con 0x7f8ca010b2b0 2024-05-09T01:14:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.849+0000 7f8c8f7fe700 1 -- 172.21.15.37:0/2043207304 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9400fce0 con 0x7f8ca010b2b0 2024-05-09T01:14:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.855+0000 7f8cb3564b80 1 Processor -- start 2024-05-09T01:14:08.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.857+0000 7f8cb3564b80 1 -- start start 2024-05-09T01:14:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.860+0000 7f8c8f7fe700 1 -- 172.21.15.37:0/2043207304 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8c94029070 con 0x7f8ca010b2b0 2024-05-09T01:14:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8c8f7fe700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c880b2a90 0x7f8c880b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8c8f7fe700 1 -- 172.21.15.37:0/2043207304 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8c940e2d00 con 0x7f8ca010b2b0 2024-05-09T01:14:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa810c4a0 0x558fa828fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa8289ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558fa81abff0 con 0x558fa810c4a0 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558fa814a7f0 con 0x558fa82896a0 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.862+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558fa81a7fb0 con 0x558fa81f6160 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.863+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.863+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41104/0 (socket says 172.21.15.37:41104) 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.863+0000 7f8c9e59c700 1 -- 172.21.15.37:0/1967326220 learned_addr learned my addr 172.21.15.37:0/1967326220 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.863+0000 7f8c9dd9b700 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa810c4a0 0x558fa828fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.863+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa8289ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.863+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c880b2a90 0x7f8c880b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.864+0000 7f8c9e59c700 1 -- 172.21.15.37:0/1967326220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 msgr2=0x558fa8289ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.864+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa8289ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.864+0000 7f8c9e59c700 1 -- 172.21.15.37:0/1967326220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa810c4a0 msgr2=0x558fa828fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.864+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa810c4a0 0x558fa828fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.864+0000 7f8c9e59c700 1 -- 172.21.15.37:0/1967326220 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fa8142370 con 0x558fa81f6160 2024-05-09T01:14:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.864+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828f4f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009b80 tx=0x7f8c90009e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1e7ae86db4b003c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:08.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.865+0000 7f8c8cff9700 1 -- 172.21.15.37:0/1967326220 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90017070 con 0x558fa81f6160 2024-05-09T01:14:08.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.866+0000 7f8c8cff9700 1 -- 172.21.15.37:0/1967326220 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9000ee40 con 0x558fa81f6160 2024-05-09T01:14:08.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.866+0000 7f8c8cff9700 1 -- 172.21.15.37:0/1967326220 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c900123d0 con 0x558fa81f6160 2024-05-09T01:14:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8cb3564b80 1 -- 172.21.15.37:0/1967326220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 msgr2=0x558fa828f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828f4f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8c90009b80 tx=0x7f8c90009e90 comp rx=0 tx=0).stop 2024-05-09T01:14:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c880b2a90 0x7f8c880b4fa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x558fa82900c0 tx=0x7f8c98005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8cb3564b80 1 -- 172.21.15.37:0/1967326220 shutdown_connections 2024-05-09T01:14:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa8289ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828f4f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/1967326220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa810c4a0 0x558fa828fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.868+0000 7f8cb3564b80 1 -- 172.21.15.37:0/1967326220 >> 172.21.15.37:0/1967326220 conn(0x558fa816c6a0 msgr2=0x558fa8284400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.869+0000 7f8cb3564b80 1 -- 172.21.15.37:0/1967326220 shutdown_connections 2024-05-09T01:14:08.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.869+0000 7f8cb3564b80 1 -- 172.21.15.37:0/1967326220 wait complete. 2024-05-09T01:14:08.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.870+0000 7f8cb3564b80 1 -- start start 2024-05-09T01:14:08.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.870+0000 7f8cb3564b80 1 Processor -- start 2024-05-09T01:14:08.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa8293110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa8293650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa82896a0 0x558fa8293b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558fa8027ba0 con 0x558fa81f6160 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558fa8166150 con 0x558fa810c4a0 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558fa82961d0 con 0x558fa82896a0 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8cb3564b80 10 client.0 _ll_register_callbacks cb 0x558fa801d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8c9ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa82896a0 0x558fa8293b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8c9ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa82896a0 0x558fa8293b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41112/0 (socket says 172.21.15.37:41112) 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.871+0000 7f8c9ed9d700 1 -- 172.21.15.37:0/3896880057 learned_addr learned my addr 172.21.15.37:0/3896880057 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa8293110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c9ed9d700 1 -- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 msgr2=0x558fa8293110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa8293110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c9ed9d700 1 -- 172.21.15.37:0/3896880057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 msgr2=0x558fa8293650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa8293650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c9ed9d700 1 -- 172.21.15.37:0/3896880057 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fa8027490 con 0x558fa82896a0 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa82896a0 0x558fa8293b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8c98017d60 tx=0x7f8c98004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe28fffa72e025c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:08.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.872+0000 7f8c85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:08.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.873+0000 7f8c85ffb700 1 -- 172.21.15.37:0/3896880057 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98027060 con 0x558fa82896a0 2024-05-09T01:14:08.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.873+0000 7f8c85ffb700 1 -- 172.21.15.37:0/3896880057 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8c98012bb0 con 0x558fa82896a0 2024-05-09T01:14:08.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.873+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9000ee40 con 0x558fa82896a0 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.873+0000 7f8c85ffb700 1 -- 172.21.15.37:0/3896880057 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f8c98012db0 con 0x558fa82896a0 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.873+0000 7f8cb3564b80 10 client.27199 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.873+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x558fa82b1c20 con 0x558fa82896a0 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.873+0000 7f8c85ffb700 1 -- 172.21.15.37:0/3896880057 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9000ee40 con 0x558fa82896a0 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8c85ffb700 1 -- 172.21.15.37:0/3896880057 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f8c980213a0 con 0x558fa82896a0 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8cb3564b80 10 client.27199 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8cb3564b80 10 client.27199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8cb3564b80 20 client.27199 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa82b4230 0x558fa82b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8cb3564b80 4 client.27199 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fa81b99d0 con 0x558fa82b4230 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.874+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa82b4230 0x558fa82b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.875+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa82b4230 0x558fa82b6740 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d76ef1d98bd7a2d7 server_cookie=85c9bb2c6719f37e in_seq=0 out_seq=0 2024-05-09T01:14:08.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.875+0000 7f8c85ffb700 10 client.27199 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:08.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:08 smithi136 ceph-mon[34110]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-05-09T01:14:08.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.876+0000 7f8c85ffb700 1 -- 172.21.15.37:0/3896880057 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558fa81b99d0 con 0x558fa82b4230 2024-05-09T01:14:08.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.876+0000 7f8c85ffb700 10 client.27199 handle_command_reply: tid=0 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.876+0000 7f8cb3564b80 1 client.27199 shutdown 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.876+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa82896a0 msgr2=0x558fa8293b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.876+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa82896a0 0x558fa8293b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8c98017d60 tx=0x7f8c98004ad0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 shutdown_connections 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa82b4230 0x558fa82b6740 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa82896a0 0x558fa8293b90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa8293110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/3896880057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa8293650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 >> 172.21.15.37:0/3896880057 conn(0x558fa816c6a0 msgr2=0x558fa82841c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8c85ffb700 0 client.27199 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 shutdown_connections 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 1 -- 172.21.15.37:0/3896880057 wait complete. 2024-05-09T01:14:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.877+0000 7f8cb3564b80 20 client.27199 trim_cache size 0 max 16384 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 Processor -- start 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 -- start start 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa828d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa82896a0 0x558fa828be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8000d230 con 0x558fa82896a0 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8000ee90 con 0x558fa810c4a0 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8cb3564b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8000d900 con 0x558fa81f6160 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8c9ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa82896a0 0x558fa828be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa828d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.909+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa828d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:38484/0 (socket says 172.21.15.37:38484) 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9e59c700 1 -- 172.21.15.37:0/2008325202 learned_addr learned my addr 172.21.15.37:0/2008325202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9dd9b700 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9e59c700 1 -- 172.21.15.37:0/2008325202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 msgr2=0x558fa828e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9e59c700 1 -- 172.21.15.37:0/2008325202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa82896a0 msgr2=0x558fa828be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa82896a0 0x558fa828be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9e59c700 1 -- 172.21.15.37:0/2008325202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fa82b6c70 con 0x558fa810c4a0 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa82896a0 0x558fa828be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa828d720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c90004790 tx=0x7f8c90008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79073d2630642505 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.910+0000 7f8c87fff700 1 -- 172.21.15.37:0/2008325202 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90017040 con 0x558fa810c4a0 2024-05-09T01:14:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.911+0000 7f8c87fff700 1 -- 172.21.15.37:0/2008325202 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9000e990 con 0x558fa810c4a0 2024-05-09T01:14:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.911+0000 7f8c87fff700 1 -- 172.21.15.37:0/2008325202 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c90026730 con 0x558fa810c4a0 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.911+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2008325202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 msgr2=0x558fa828d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.911+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa828d720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c90004790 tx=0x7f8c90008040 comp rx=0 tx=0).stop 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.912+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2008325202 shutdown_connections 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.912+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa82896a0 0x558fa828be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.912+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa810c4a0 0x558fa828d720 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.912+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2008325202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa81f6160 0x558fa828e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.912+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2008325202 >> 172.21.15.37:0/2008325202 conn(0x558fa816c6a0 msgr2=0x558fa828e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.912+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2008325202 shutdown_connections 2024-05-09T01:14:08.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.912+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2008325202 wait complete. 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8cb3564b80 1 -- start start 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8cb3564b80 1 Processor -- start 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa810c4a0 0x558fa829e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa829e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8cb3564b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa829eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8c9dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa829e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa810c4a0 0x558fa829e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8c9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa810c4a0 0x558fa829e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:41130/0 (socket says 172.21.15.37:41130) 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.913+0000 7f8c9dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa829e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54846/0 (socket says 172.21.15.37:54846) 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9e59c700 1 -- 172.21.15.37:0/2137895901 learned_addr learned my addr 172.21.15.37:0/2137895901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8000e700 con 0x558fa81f6160 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8000e030 con 0x558fa82896a0 2024-05-09T01:14:08.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8000b1d0 con 0x558fa810c4a0 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8cb3564b80 10 client.0 _ll_register_callbacks cb 0x558fa82861e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa829eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9ed9d700 1 -- 172.21.15.37:0/2137895901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa810c4a0 msgr2=0x558fa829e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa810c4a0 0x558fa829e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9ed9d700 1 -- 172.21.15.37:0/2137895901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 msgr2=0x558fa829e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa829e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9ed9d700 1 -- 172.21.15.37:0/2137895901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fa8299710 con 0x558fa82896a0 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c9ed9d700 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa829eb10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8c98021770 tx=0x7f8c980066b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1de143e6e914dbd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.914+0000 7f8c85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8c85ffb700 1 -- 172.21.15.37:0/2137895901 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9803a060 con 0x558fa82896a0 2024-05-09T01:14:08.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8c85ffb700 1 -- 172.21.15.37:0/2137895901 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8c98012bb0 con 0x558fa82896a0 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9000e990 con 0x558fa82896a0 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8c85ffb700 1 -- 172.21.15.37:0/2137895901 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f8c98031080 con 0x558fa82896a0 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8cb3564b80 10 client.27242 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x558fa831ec00 con 0x558fa82896a0 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8c85ffb700 1 -- 172.21.15.37:0/2137895901 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9000e990 con 0x558fa82896a0 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.915+0000 7f8c85ffb700 1 -- 172.21.15.37:0/2137895901 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f8c9802c420 con 0x558fa82896a0 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.916+0000 7f8cb3564b80 10 client.27242 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.916+0000 7f8cb3564b80 10 client.27242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.916+0000 7f8cb3564b80 20 client.27242 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.916+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa831f2b0 0x558fa83216d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.916+0000 7f8cb3564b80 4 client.27242 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:14:08.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.916+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558fa81b3a70 con 0x558fa831f2b0 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.916+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa831f2b0 0x558fa83216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8c85ffb700 10 client.27242 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8c9e59c700 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa831f2b0 0x558fa83216d0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642b8d293dd477d8 server_cookie=f5cf5cb3aa64b64f in_seq=0 out_seq=0 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8c85ffb700 1 -- 172.21.15.37:0/2137895901 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558fa81b3a70 con 0x558fa831f2b0 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8c85ffb700 10 client.27242 handle_command_reply: tid=0 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 client.27242 shutdown 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 msgr2=0x558fa829eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa829eb10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8c98021770 tx=0x7f8c980066b0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 shutdown_connections 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558fa831f2b0 0x558fa83216d0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558fa82896a0 0x558fa829eb10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558fa810c4a0 0x558fa829e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 --2- 172.21.15.37:0/2137895901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558fa81f6160 0x558fa829e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8c85ffb700 0 client.27242 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 >> 172.21.15.37:0/2137895901 conn(0x558fa816c6a0 msgr2=0x558fa828ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 shutdown_connections 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 1 -- 172.21.15.37:0/2137895901 wait complete. 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.917+0000 7f8cb3564b80 20 client.27242 trim_cache size 0 max 16384 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:14:08.926 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:14:08.927 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c880b2a90 msgr2=0x7f8c880b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c880b2a90 0x7f8c880b4fa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x558fa82900c0 tx=0x7f8c98005e80 comp rx=0 tx=0).stop 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ca010b2b0 msgr2=0x7f8ca007f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ca010b2b0 0x7f8ca007f240 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c94006010 tx=0x7f8c940057c0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 shutdown_connections 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8c880b2a90 0x7f8c880b4fa0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ca0110990 0x7f8ca007f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca010a960 0x7f8ca0084070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 --2- 172.21.15.37:0/2043207304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ca010b2b0 0x7f8ca007f240 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.918+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 >> 172.21.15.37:0/2043207304 conn(0x7f8ca0076d30 msgr2=0x7f8ca0108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:08.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.919+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 shutdown_connections 2024-05-09T01:14:08.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:08.919+0000 7f8ca4b4e700 1 -- 172.21.15.37:0/2043207304 wait complete. 2024-05-09T01:14:09.977 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:14:09.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:14:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 710.0 s, 1424.4 tps, lat 70.943 ms stddev 77.096 2024-05-09T01:14:10.417 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:10.633 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:10 smithi037 ceph-mon[30122]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 586 op/s 2024-05-09T01:14:10.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:10 smithi151 ceph-mon[34780]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 586 op/s 2024-05-09T01:14:10.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:10 smithi136 ceph-mon[34110]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 586 op/s 2024-05-09T01:14:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.536+0000 7f642b3c4700 1 -- 172.21.15.37:0/748791112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424107df0 msgr2=0x7f6424108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.536+0000 7f642b3c4700 1 --2- 172.21.15.37:0/748791112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424107df0 0x7f6424108200 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f64140099c0 tx=0x7f6414009cd0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.536+0000 7f642b3c4700 1 -- 172.21.15.37:0/748791112 shutdown_connections 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.536+0000 7f642b3c4700 1 --2- 172.21.15.37:0/748791112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6424108740 0x7f64241100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.536+0000 7f642b3c4700 1 --2- 172.21.15.37:0/748791112 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 0x7f64241038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.536+0000 7f642b3c4700 1 --2- 172.21.15.37:0/748791112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424107df0 0x7f6424108200 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.536+0000 7f642b3c4700 1 -- 172.21.15.37:0/748791112 >> 172.21.15.37:0/748791112 conn(0x7f64240fedc0 msgr2=0x7f64241011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.538+0000 7f642b3c4700 1 -- 172.21.15.37:0/748791112 shutdown_connections 2024-05-09T01:14:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.538+0000 7f642b3c4700 1 -- 172.21.15.37:0/748791112 wait complete. 2024-05-09T01:14:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 Processor -- start 2024-05-09T01:14:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 -- start start 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 0x7f642419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6424107df0 0x7f642419c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424108740 0x7f642419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6424113350 con 0x7f6424108740 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f64241131d0 con 0x7f64241034c0 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.539+0000 7f642b3c4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f64241134d0 con 0x7f6424107df0 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429160700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 0x7f642419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429961700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424108740 0x7f642419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429160700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 0x7f642419bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44210/0 (socket says 172.21.15.37:44210) 2024-05-09T01:14:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429160700 1 -- 172.21.15.37:0/1849118079 learned_addr learned my addr 172.21.15.37:0/1849118079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f642895f700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6424107df0 0x7f642419c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429961700 1 -- 172.21.15.37:0/1849118079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6424107df0 msgr2=0x7f642419c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429961700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6424107df0 0x7f642419c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429961700 1 -- 172.21.15.37:0/1849118079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 msgr2=0x7f642419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429961700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 0x7f642419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429961700 1 -- 172.21.15.37:0/1849118079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64241a6fc0 con 0x7f6424108740 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429160700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 0x7f642419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f6429961700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424108740 0x7f642419c710 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f641c00efc0 tx=0x7f641c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f641a7fc700 1 -- 172.21.15.37:0/1849118079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c0092e0 con 0x7f6424108740 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64241a7250 con 0x7f6424108740 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f641a7fc700 1 -- 172.21.15.37:0/1849118079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f641c004bb0 con 0x7f6424108740 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.540+0000 7f641a7fc700 1 -- 172.21.15.37:0/1849118079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c004020 con 0x7f6424108740 2024-05-09T01:14:12.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.541+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64241a7760 con 0x7f6424108740 2024-05-09T01:14:12.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.542+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64240512c0 con 0x7f6424108740 2024-05-09T01:14:12.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.544+0000 7f641a7fc700 1 -- 172.21.15.37:0/1849118079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f641c01b030 con 0x7f6424108740 2024-05-09T01:14:12.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.545+0000 7f641a7fc700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64100b2900 0x7f64100b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:12.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.545+0000 7f641a7fc700 1 -- 172.21.15.37:0/1849118079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f641c0e2630 con 0x7f6424108740 2024-05-09T01:14:12.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.545+0000 7f6429160700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64100b2900 0x7f64100b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:12.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.545+0000 7f6429160700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64100b2900 0x7f64100b4e10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6420011550 tx=0x7f6420009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:12.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.551+0000 7f641a7fc700 1 -- 172.21.15.37:0/1849118079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f641c022020 con 0x7f6424108740 2024-05-09T01:14:12.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:12 smithi037 ceph-mon[30122]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-09T01:14:12.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:12 smithi151 ceph-mon[34780]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-09T01:14:12.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:12 smithi136 ceph-mon[34110]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-09T01:14:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.932+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f642402e7b0 con 0x7f6424108740 2024-05-09T01:14:12.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.933+0000 7f641a7fc700 1 -- 172.21.15.37:0/1849118079 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+11946 (secure 0 0 0) 0x7f641c010040 con 0x7f6424108740 2024-05-09T01:14:12.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:14:12.990 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:13:41.668461+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24454,24491,24445,24446,24467]},"id":1}]} 2024-05-09T01:14:12.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.935+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64100b2900 msgr2=0x7f64100b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:12.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.935+0000 7f642b3c4700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64100b2900 0x7f64100b4e10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6420011550 tx=0x7f6420009260 comp rx=0 tx=0).stop 2024-05-09T01:14:12.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.935+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424108740 msgr2=0x7f642419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:12.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.935+0000 7f642b3c4700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424108740 0x7f642419c710 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f641c00efc0 tx=0x7f641c00c3a0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.935+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 shutdown_connections 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.936+0000 7f642b3c4700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64100b2900 0x7f64100b4e10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.936+0000 7f642b3c4700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6424108740 0x7f642419c710 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.936+0000 7f642b3c4700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f64241034c0 0x7f642419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.936+0000 7f642b3c4700 1 --2- 172.21.15.37:0/1849118079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6424107df0 0x7f642419c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.936+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 >> 172.21.15.37:0/1849118079 conn(0x7f64240fedc0 msgr2=0x7f64241096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.936+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 shutdown_connections 2024-05-09T01:14:12.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:12.936+0000 7f642b3c4700 1 -- 172.21.15.37:0/1849118079 wait complete. 2024-05-09T01:14:12.993 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2024-05-09T01:14:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 -- 172.21.15.37:0/1701845387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 msgr2=0x7f2f5c103860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 --2- 172.21.15.37:0/1701845387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c103860 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009900 tx=0x7f2f4402a410 comp rx=0 tx=0).stop 2024-05-09T01:14:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 -- 172.21.15.37:0/1701845387 shutdown_connections 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 --2- 172.21.15.37:0/1701845387 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f5c108aa0 0x7f2f5c10aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 --2- 172.21.15.37:0/1701845387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c103da0 0x7f2f5c1041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 --2- 172.21.15.37:0/1701845387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c103860 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 -- 172.21.15.37:0/1701845387 >> 172.21.15.37:0/1701845387 conn(0x7f2f5c0fdd30 msgr2=0x7f2f5c100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 -- 172.21.15.37:0/1701845387 shutdown_connections 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.354+0000 7f2f62e30640 1 -- 172.21.15.37:0/1701845387 wait complete. 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 Processor -- start 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 -- start start 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f5c103da0 0x7f2f5c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c108aa0 0x7f2f5c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10f7f0 con 0x7f2f5c102b60 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10f670 con 0x7f2f5c103da0 2024-05-09T01:14:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f62e30640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10f970 con 0x7f2f5c108aa0 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f60bcc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f5c103da0 0x7f2f5c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f60bcc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45220/0 (socket says 172.21.15.37:45220) 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f60bcc640 1 -- 172.21.15.37:0/2608463974 learned_addr learned my addr 172.21.15.37:0/2608463974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.355+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c108aa0 0x7f2f5c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f60bcc640 1 -- 172.21.15.37:0/2608463974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c108aa0 msgr2=0x7f2f5c1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f60bcc640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c108aa0 0x7f2f5c1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f60bcc640 1 -- 172.21.15.37:0/2608463974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f5c103da0 msgr2=0x7f2f5c19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f60bcc640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f5c103da0 0x7f2f5c19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f60bcc640 1 -- 172.21.15.37:0/2608463974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1a1f20 con 0x7f2f5c102b60 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f5c103da0 0x7f2f5c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f613cd640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c108aa0 0x7f2f5c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f60bcc640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c19a3e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2f44031440 tx=0x7f2f44003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f59ffb640 1 -- 172.21.15.37:0/2608463974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4403f070 con 0x7f2f5c102b60 2024-05-09T01:14:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1a21b0 con 0x7f2f5c102b60 2024-05-09T01:14:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f59ffb640 1 -- 172.21.15.37:0/2608463974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f44031c50 con 0x7f2f5c102b60 2024-05-09T01:14:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f59ffb640 1 -- 172.21.15.37:0/2608463974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44035030 con 0x7f2f5c102b60 2024-05-09T01:14:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.356+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1a26f0 con 0x7f2f5c102b60 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.360+0000 7f2f69dbd740 1 Processor -- start 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.360+0000 7f2f69dbd740 1 -- start start 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.360+0000 7f2f59ffb640 1 -- 172.21.15.37:0/2608463974 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2f44042070 con 0x7f2f5c102b60 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.360+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6821b0 0x55b52ca2a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.360+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6592f0 0x55b52ca2ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.360+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6614d0 0x55b52ca31d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.360+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b52c98a7c0 con 0x55b52c6821b0 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b52c9260e0 con 0x55b52c6592f0 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b52c986780 con 0x55b52c6614d0 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6821b0 0x55b52ca2a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f60bcc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6592f0 0x55b52ca2ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6821b0 0x55b52ca2a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45224/0 (socket says 172.21.15.37:45224) 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 -- 172.21.15.37:0/1219412860 learned_addr learned my addr 172.21.15.37:0/1219412860 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6614d0 0x55b52ca31d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 -- 172.21.15.37:0/1219412860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6614d0 msgr2=0x55b52ca31d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6614d0 0x55b52ca31d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 -- 172.21.15.37:0/1219412860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6592f0 msgr2=0x55b52ca2ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6592f0 0x55b52ca2ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 -- 172.21.15.37:0/1219412860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52c94f7c0 con 0x55b52c6821b0 2024-05-09T01:14:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f613cd640 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6821b0 0x55b52ca2a910 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2f54010400 tx=0x7f2f540108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4870fe3cc2c3c3e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f52ffd640 1 -- 172.21.15.37:0/1219412860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54004230 con 0x55b52c6821b0 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f52ffd640 1 -- 172.21.15.37:0/1219412860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540043d0 con 0x55b52c6821b0 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f52ffd640 1 -- 172.21.15.37:0/1219412860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54003a60 con 0x55b52c6821b0 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.361+0000 7f2f59ffb640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f480b27e0 0x7f2f480b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.362+0000 7f2f60bcc640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f480b27e0 0x7f2f480b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.362+0000 7f2f59ffb640 1 -- 172.21.15.37:0/2608463974 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2f44102950 con 0x7f2f5c102b60 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.362+0000 7f2f69dbd740 1 -- 172.21.15.37:0/1219412860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6821b0 msgr2=0x55b52ca2a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.362+0000 7f2f60bcc640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f480b27e0 0x7f2f480b4cf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2f440c7330 tx=0x7f2f441084d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.362+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6821b0 0x55b52ca2a910 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2f54010400 tx=0x7f2f540108c0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 -- 172.21.15.37:0/1219412860 shutdown_connections 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6614d0 0x55b52ca31d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6592f0 0x55b52ca2ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/1219412860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6821b0 0x55b52ca2a910 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 -- 172.21.15.37:0/1219412860 >> 172.21.15.37:0/1219412860 conn(0x55b52c676300 msgr2=0x55b52ca21e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 -- 172.21.15.37:0/1219412860 shutdown_connections 2024-05-09T01:14:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 -- 172.21.15.37:0/1219412860 wait complete. 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 -- start start 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.363+0000 7f2f69dbd740 1 Processor -- start 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.364+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6592f0 0x55b52ca34640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.364+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6614d0 0x55b52ca34b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.364+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6592f0 0x55b52ca34640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.364+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6592f0 0x55b52ca34640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57538/0 (socket says 172.21.15.37:57538) 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.364+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6614d0 0x55b52ca34b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6614d0 0x55b52ca34b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45230/0 (socket says 172.21.15.37:45230) 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f613cd640 1 -- 172.21.15.37:0/2637820620 learned_addr learned my addr 172.21.15.37:0/2637820620 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6821b0 0x55b52ca3bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b52ca327e0 con 0x55b52c6614d0 2024-05-09T01:14:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b52c9119c0 con 0x55b52c6821b0 2024-05-09T01:14:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b52ca32960 con 0x55b52c6592f0 2024-05-09T01:14:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f69dbd740 10 client.0 _ll_register_callbacks cb 0x55b52c93e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f613cd640 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6821b0 0x55b52ca3bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f5bfff640 1 -- 172.21.15.37:0/2637820620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6592f0 msgr2=0x55b52ca34640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6592f0 0x55b52ca34640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f5bfff640 1 -- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6821b0 msgr2=0x55b52ca3bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6821b0 0x55b52ca3bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.365+0000 7f2f5bfff640 1 -- 172.21.15.37:0/2637820620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52c9381f0 con 0x55b52c6614d0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.366+0000 7f2f613cd640 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6821b0 0x55b52ca3bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.366+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f540043d0 con 0x55b52c6614d0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.366+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6614d0 0x55b52ca34b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009fd0 tx=0x7f2f4c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e4d18b8b5f9efe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.366+0000 7f2f3bfff640 10 client.17373 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f3bfff640 1 -- 172.21.15.37:0/2637820620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c010430 con 0x55b52c6614d0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f3bfff640 1 -- 172.21.15.37:0/2637820620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2f4c012e00 con 0x55b52c6614d0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f3bfff640 1 -- 172.21.15.37:0/2637820620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2f4c0105d0 con 0x55b52c6614d0 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 10 client.17373 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:13.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=47}) -- 0x55b52c6ed790 con 0x55b52c6614d0 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f3bfff640 1 -- 172.21.15.37:0/2637820620 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f2f4c010770 con 0x55b52c6614d0 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 10 client.17373 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 10 client.17373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 20 client.17373 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c640d80 0x55b52ca41ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 4 client.17373 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.367+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b52c9983d0 con 0x55b52c640d80 2024-05-09T01:14:13.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.368+0000 7f2f613cd640 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c640d80 0x55b52ca41ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.368+0000 7f2f3bfff640 10 client.17373 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.368+0000 7f2f613cd640 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c640d80 0x55b52ca41ef0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3201a372cb1dced6 server_cookie=8168fb2ba0e22d5c in_seq=0 out_seq=0 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f3bfff640 1 -- 172.21.15.37:0/2637820620 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b52c9983d0 con 0x55b52c640d80 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f3bfff640 10 client.17373 handle_command_reply: tid=0 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 client.17373 shutdown 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6614d0 msgr2=0x55b52ca34b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6614d0 0x55b52ca34b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009fd0 tx=0x7f2f4c012820 comp rx=0 tx=0).stop 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 shutdown_connections 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c640d80 0x55b52ca41ef0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c6821b0 0x55b52ca3bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f3bfff640 0 client.17373 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6614d0 0x55b52ca34b80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/2637820620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c6592f0 0x55b52ca34640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 >> 172.21.15.37:0/2637820620 conn(0x55b52c676300 msgr2=0x55b52ca24da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:13.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 shutdown_connections 2024-05-09T01:14:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 1 -- 172.21.15.37:0/2637820620 wait complete. 2024-05-09T01:14:13.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.369+0000 7f2f69dbd740 20 client.17373 trim_cache size 0 max 16384 2024-05-09T01:14:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 Processor -- start 2024-05-09T01:14:13.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 -- start start 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c676300 0x55b52ca2f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c640d80 0x55b52ca20e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca3ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1a9080 con 0x55b52c6592f0 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1aace0 con 0x55b52c640d80 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1a9750 con 0x55b52c676300 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca3ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c640d80 0x55b52ca20e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca3ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45242/0 (socket says 172.21.15.37:45242) 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f613cd640 1 -- 172.21.15.37:0/956448466 learned_addr learned my addr 172.21.15.37:0/956448466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.390+0000 7f2f613cd640 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c676300 0x55b52ca2f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f5bfff640 1 -- 172.21.15.37:0/956448466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c676300 msgr2=0x55b52ca2f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c676300 0x55b52ca2f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f5bfff640 1 -- 172.21.15.37:0/956448466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 msgr2=0x55b52ca3ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca3ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f5bfff640 1 -- 172.21.15.37:0/956448466 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52c7645f0 con 0x55b52c640d80 2024-05-09T01:14:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c640d80 0x55b52ca20e10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00fda0 tx=0x7f2f4c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cde504b5b628d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f527fc640 1 -- 172.21.15.37:0/956448466 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c02c070 con 0x55b52c640d80 2024-05-09T01:14:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f527fc640 1 -- 172.21.15.37:0/956448466 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540043d0 con 0x55b52c640d80 2024-05-09T01:14:13.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.391+0000 7f2f527fc640 1 -- 172.21.15.37:0/956448466 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c01c420 con 0x55b52c640d80 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 -- 172.21.15.37:0/956448466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c640d80 msgr2=0x55b52ca20e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c640d80 0x55b52ca20e10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00fda0 tx=0x7f2f4c014000 comp rx=0 tx=0).stop 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 -- 172.21.15.37:0/956448466 shutdown_connections 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca3ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c640d80 0x55b52ca20e10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/956448466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c676300 0x55b52ca2f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 -- 172.21.15.37:0/956448466 >> 172.21.15.37:0/956448466 conn(0x55b52ca2af70 msgr2=0x55b52ca20700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:13.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 -- 172.21.15.37:0/956448466 shutdown_connections 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.392+0000 7f2f69dbd740 1 -- 172.21.15.37:0/956448466 wait complete. 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 -- start start 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 Processor -- start 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c640d80 0x55b52ca392e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca39820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c676300 0x55b52caa8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1aa550 con 0x55b52c6592f0 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1a9e80 con 0x55b52c676300 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1a7060 con 0x55b52c640d80 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f69dbd740 10 client.0 _ll_register_callbacks cb 0x7f2f4c00f4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca39820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c640d80 0x55b52ca392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.393+0000 7f2f613cd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c640d80 0x55b52ca392e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57556/0 (socket says 172.21.15.37:57556) 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 -- 172.21.15.37:0/3777041625 learned_addr learned my addr 172.21.15.37:0/3777041625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c676300 0x55b52caa8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 -- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c676300 msgr2=0x55b52caa8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c676300 0x55b52caa8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 -- 172.21.15.37:0/3777041625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 msgr2=0x55b52ca39820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca39820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 -- 172.21.15.37:0/3777041625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52c94eed0 con 0x55b52c640d80 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca39820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f613cd640 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c640d80 0x55b52ca392e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2f54011010 tx=0x7f2f540045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=623a533a3d7469c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f3bfff640 1 -- 172.21.15.37:0/3777041625 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54005040 con 0x55b52c640d80 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f540043d0 con 0x55b52c640d80 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.394+0000 7f2f3bfff640 1 -- 172.21.15.37:0/3777041625 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f2f540051e0 con 0x55b52c640d80 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f3bfff640 1 -- 172.21.15.37:0/3777041625 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f2f540053e0 con 0x55b52c640d80 2024-05-09T01:14:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 10 client.27229 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55b52caa9980 con 0x55b52c640d80 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f3bfff640 1 -- 172.21.15.37:0/3777041625 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f540043d0 con 0x55b52c640d80 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f3bfff640 1 -- 172.21.15.37:0/3777041625 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f2f5402a460 con 0x55b52c640d80 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 10 client.27229 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 10 client.27229 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 20 client.27229 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c6614d0 0x55b52caac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 4 client.27229 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b52c992240 con 0x55b52c6614d0 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.395+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c6614d0 0x55b52caac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.396+0000 7f2f3bfff640 10 client.27229 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.396+0000 7f2f5bfff640 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c6614d0 0x55b52caac210 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=129053fb38b24de5 server_cookie=4b21ee1014a2544a in_seq=0 out_seq=0 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f3bfff640 1 -- 172.21.15.37:0/3777041625 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55b52c992240 con 0x55b52c6614d0 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f3bfff640 10 client.27229 handle_command_reply: tid=0 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 client.27229 shutdown 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c640d80 msgr2=0x55b52ca392e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c640d80 0x55b52ca392e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2f54011010 tx=0x7f2f540045e0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 shutdown_connections 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b52c6614d0 0x55b52caac210 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b52c676300 0x55b52caa8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b52c6592f0 0x55b52ca39820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 --2- 172.21.15.37:0/3777041625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b52c640d80 0x55b52ca392e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f3bfff640 0 client.27229 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 >> 172.21.15.37:0/3777041625 conn(0x55b52ca2af70 msgr2=0x55b52ca20700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 shutdown_connections 2024-05-09T01:14:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.406+0000 7f2f69dbd740 1 -- 172.21.15.37:0/3777041625 wait complete. 2024-05-09T01:14:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.407+0000 7f2f69dbd740 20 client.27229 trim_cache size 0 max 16384 2024-05-09T01:14:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:14:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:14:13.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.407+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f480b27e0 msgr2=0x7f2f480b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.407+0000 7f2f62e30640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f480b27e0 0x7f2f480b4cf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2f440c7330 tx=0x7f2f441084d0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.407+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 msgr2=0x7f2f5c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.407+0000 7f2f62e30640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c19a3e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2f44031440 tx=0x7f2f44003c10 comp rx=0 tx=0).stop 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 shutdown_connections 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c108aa0 0x7f2f5c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f2f480b27e0 0x7f2f480b4cf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f5c103da0 0x7f2f5c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 --2- 172.21.15.37:0/2608463974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f5c102b60 0x7f2f5c19a3e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 >> 172.21.15.37:0/2608463974 conn(0x7f2f5c0fdd30 msgr2=0x7f2f5c104a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 shutdown_connections 2024-05-09T01:14:13.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:13.408+0000 7f2f62e30640 1 -- 172.21.15.37:0/2608463974 wait complete. 2024-05-09T01:14:13.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:13 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1849118079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:14:13.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:13 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1849118079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:14:13.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:14:13.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:13 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1849118079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:14:14.094 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:14.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:14 smithi037 ceph-mon[30122]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 625 op/s 2024-05-09T01:14:14.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:14 smithi151 ceph-mon[34780]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 625 op/s 2024-05-09T01:14:14.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:14 smithi136 ceph-mon[34110]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.0 MiB/s wr, 625 op/s 2024-05-09T01:14:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 715.0 s, 1795.6 tps, lat 55.069 ms stddev 67.236 2024-05-09T01:14:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 -- 172.21.15.37:0/2744828707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 msgr2=0x7f9664109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 --2- 172.21.15.37:0/2744828707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 0x7f9664109320 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f96500099c0 tx=0x7f9650009cd0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 -- 172.21.15.37:0/2744828707 shutdown_connections 2024-05-09T01:14:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 --2- 172.21.15.37:0/2744828707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9664109860 0x7f96641111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 --2- 172.21.15.37:0/2744828707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96641045e0 0x7f96641049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 --2- 172.21.15.37:0/2744828707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 0x7f9664109320 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 -- 172.21.15.37:0/2744828707 >> 172.21.15.37:0/2744828707 conn(0x7f96640ffe70 msgr2=0x7f96641022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:16.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.000+0000 7f966aa70700 1 -- 172.21.15.37:0/2744828707 shutdown_connections 2024-05-09T01:14:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.001+0000 7f966aa70700 1 -- 172.21.15.37:0/2744828707 wait complete. 2024-05-09T01:14:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 Processor -- start 2024-05-09T01:14:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 -- start start 2024-05-09T01:14:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641045e0 0x7f966419af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 0x7f966419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9664109860 0x7f966419f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9664114530 con 0x7f96641045e0 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96641143b0 con 0x7f9664109860 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.002+0000 7f966aa70700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96641146b0 con 0x7f9664108f10 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.003+0000 7f966900d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9664109860 0x7f966419f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.003+0000 7f966900d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9664109860 0x7f966419f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44254/0 (socket says 172.21.15.37:44254) 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.003+0000 7f966900d700 1 -- 172.21.15.37:0/2124461602 learned_addr learned my addr 172.21.15.37:0/2124461602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.003+0000 7f9663fff700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 0x7f966419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.003+0000 7f966880c700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641045e0 0x7f966419af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.004+0000 7f966900d700 1 -- 172.21.15.37:0/2124461602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 msgr2=0x7f966419b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.004+0000 7f966900d700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 0x7f966419b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.004+0000 7f966900d700 1 -- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641045e0 msgr2=0x7f966419af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.004+0000 7f966900d700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641045e0 0x7f966419af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.004+0000 7f966900d700 1 -- 172.21.15.37:0/2124461602 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966419fdf0 con 0x7f9664109860 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.004+0000 7f966880c700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641045e0 0x7f966419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.005+0000 7f966900d700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9664109860 0x7f966419f750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f965c00ef30 tx=0x7f965c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.005+0000 7f9661ffb700 1 -- 172.21.15.37:0/2124461602 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c0092e0 con 0x7f9664109860 2024-05-09T01:14:16.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.005+0000 7f9661ffb700 1 -- 172.21.15.37:0/2124461602 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f965c004bb0 con 0x7f9664109860 2024-05-09T01:14:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.005+0000 7f9661ffb700 1 -- 172.21.15.37:0/2124461602 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c004020 con 0x7f9664109860 2024-05-09T01:14:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.005+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96641a0080 con 0x7f9664109860 2024-05-09T01:14:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.005+0000 7f9663fff700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 0x7f966419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:16.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.005+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9664076b00 con 0x7f9664109860 2024-05-09T01:14:16.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.009+0000 7f9661ffb700 1 -- 172.21.15.37:0/2124461602 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f965c01b030 con 0x7f9664109860 2024-05-09T01:14:16.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.009+0000 7f9661ffb700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96540b6d10 0x7f96540b9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.010+0000 7f9661ffb700 1 -- 172.21.15.37:0/2124461602 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f965c0e1bf0 con 0x7f9664109860 2024-05-09T01:14:16.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.010+0000 7f966880c700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96540b6d10 0x7f96540b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.010+0000 7f966880c700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96540b6d10 0x7f96540b9220 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9658009de0 tx=0x7f9658009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 Processor -- start 2024-05-09T01:14:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 -- start start 2024-05-09T01:14:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f966880c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d62bf200a0 con 0x55d62c005c10 2024-05-09T01:14:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d62bec59a0 con 0x55d62befad00 2024-05-09T01:14:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f966880c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44268/0 (socket says 172.21.15.37:44268) 2024-05-09T01:14:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9679486b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d62bf1c060 con 0x55d62be804a0 2024-05-09T01:14:16.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f966880c700 1 -- 172.21.15.37:0/290730036 learned_addr learned my addr 172.21.15.37:0/290730036 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f966900d700 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.011+0000 7f9663fff700 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.012+0000 7f966880c700 1 -- 172.21.15.37:0/290730036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 msgr2=0x55d62c00bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.012+0000 7f966880c700 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.012+0000 7f966880c700 1 -- 172.21.15.37:0/290730036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 msgr2=0x55d62c006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.012+0000 7f966880c700 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.012+0000 7f966880c700 1 -- 172.21.15.37:0/290730036 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62beb6500 con 0x55d62befad00 2024-05-09T01:14:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.012+0000 7f966880c700 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00ba20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f965800ee60 tx=0x7f9658011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50cc3b50dd64f1e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.014+0000 7f964effd700 1 -- 172.21.15.37:0/290730036 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965801b040 con 0x55d62befad00 2024-05-09T01:14:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.014+0000 7f964effd700 1 -- 172.21.15.37:0/290730036 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9658024070 con 0x55d62befad00 2024-05-09T01:14:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.014+0000 7f964effd700 1 -- 172.21.15.37:0/290730036 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658013c40 con 0x55d62befad00 2024-05-09T01:14:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.014+0000 7f9679486b80 1 -- 172.21.15.37:0/290730036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 msgr2=0x55d62c00ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.014+0000 7f9679486b80 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00ba20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f965800ee60 tx=0x7f9658011000 comp rx=0 tx=0).stop 2024-05-09T01:14:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 -- 172.21.15.37:0/290730036 shutdown_connections 2024-05-09T01:14:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c006020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00ba20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 --2- 172.21.15.37:0/290730036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 -- 172.21.15.37:0/290730036 >> 172.21.15.37:0/290730036 conn(0x55d62be83f70 msgr2=0x55d62bff8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 -- 172.21.15.37:0/290730036 shutdown_connections 2024-05-09T01:14:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 -- 172.21.15.37:0/290730036 wait complete. 2024-05-09T01:14:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 -- start start 2024-05-09T01:14:16.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.015+0000 7f9679486b80 1 Processor -- start 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f9679486b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f9679486b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f9679486b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c0102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f966880c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f966880c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57586/0 (socket says 172.21.15.37:57586) 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f966880c700 1 -- 172.21.15.37:0/2173989972 learned_addr learned my addr 172.21.15.37:0/2173989972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d62c006970 con 0x55d62c005c10 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55d62bebab20 con 0x55d62befad00 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d62c012820 con 0x55d62be804a0 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f966900d700 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c0102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.016+0000 7f9663fff700 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f9679486b80 10 client.0 _ll_register_callbacks cb 0x55d62bd916c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f966880c700 1 -- 172.21.15.37:0/2173989972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 msgr2=0x55d62c00fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f966880c700 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f966880c700 1 -- 172.21.15.37:0/2173989972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 msgr2=0x55d62c0102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f966880c700 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c0102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f966880c700 1 -- 172.21.15.37:0/2173989972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62bd9b490 con 0x55d62be804a0 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f966880c700 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00f830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f96580048a0 tx=0x7f9658016ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b6077c58743bf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.017+0000 7f9643fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.018+0000 7f9643fff700 1 -- 172.21.15.37:0/2173989972 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965802e020 con 0x55d62be804a0 2024-05-09T01:14:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.018+0000 7f9643fff700 1 -- 172.21.15.37:0/2173989972 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9658013ac0 con 0x55d62be804a0 2024-05-09T01:14:16.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.018+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9658024070 con 0x55d62be804a0 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.019+0000 7f9643fff700 1 -- 172.21.15.37:0/2173989972 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f9658013d00 con 0x55d62be804a0 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.019+0000 7f9679486b80 10 client.27241 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.019+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55d62c01d210 con 0x55d62be804a0 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.019+0000 7f9643fff700 1 -- 172.21.15.37:0/2173989972 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9658013ea0 con 0x55d62be804a0 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9643fff700 1 -- 172.21.15.37:0/2173989972 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f965801e030 con 0x55d62be804a0 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9679486b80 10 client.27241 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9679486b80 10 client.27241 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9679486b80 20 client.27241 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9679486b80 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c021b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9679486b80 4 client.27241 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9658024070 con 0x55d62c01f740 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.020+0000 7f9663fff700 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c021b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.021+0000 7f9643fff700 10 client.27241 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:14:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.021+0000 7f9663fff700 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c021b60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=89d482791633fae6 server_cookie=d90cfcfae33900af in_seq=0 out_seq=0 2024-05-09T01:14:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.021+0000 7f9643fff700 1 -- 172.21.15.37:0/2173989972 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f9658024070 con 0x55d62c01f740 2024-05-09T01:14:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.021+0000 7f9643fff700 10 client.27241 handle_command_reply: tid=0 2024-05-09T01:14:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 client.27241 shutdown 2024-05-09T01:14:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 msgr2=0x55d62c00f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00f830 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f96580048a0 tx=0x7f9658016ad0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 shutdown_connections 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c021b60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9643fff700 0 client.27241 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c0102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62be804a0 0x55d62c00f830 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 --2- 172.21.15.37:0/2173989972 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62befad00 0x55d62c00fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.022+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 >> 172.21.15.37:0/2173989972 conn(0x55d62be83f70 msgr2=0x55d62bffc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.023+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 shutdown_connections 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.023+0000 7f9679486b80 1 -- 172.21.15.37:0/2173989972 wait complete. 2024-05-09T01:14:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.023+0000 7f9679486b80 20 client.27241 trim_cache size 0 max 16384 2024-05-09T01:14:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.043+0000 7f9679486b80 1 Processor -- start 2024-05-09T01:14:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.043+0000 7f9679486b80 1 -- start start 2024-05-09T01:14:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9679486b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62be804a0 0x55d62bff2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9679486b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9679486b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c01b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9679486b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96641aca30 con 0x55d62c005c10 2024-05-09T01:14:16.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9679486b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ae690 con 0x55d62be804a0 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9679486b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ad100 con 0x55d62befad00 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f966880c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62be804a0 0x55d62bff2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0100f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57590/0 (socket says 172.21.15.37:57590) 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 -- 172.21.15.37:0/3620180785 learned_addr learned my addr 172.21.15.37:0/3620180785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f966900d700 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c01b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 -- 172.21.15.37:0/3620180785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62be804a0 msgr2=0x55d62bff2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62be804a0 0x55d62bff2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 -- 172.21.15.37:0/3620180785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 msgr2=0x55d62c01b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c01b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.044+0000 7f9663fff700 1 -- 172.21.15.37:0/3620180785 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62bff8cf0 con 0x55d62befad00 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.045+0000 7f966900d700 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c01b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:14:16.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.045+0000 7f9663fff700 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0100f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9650000c00 tx=0x7f9650005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e35fc0a03943499d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.045+0000 7f964e7fc700 1 -- 172.21.15.37:0/3620180785 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650005370 con 0x55d62befad00 2024-05-09T01:14:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.046+0000 7f964e7fc700 1 -- 172.21.15.37:0/3620180785 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9650005510 con 0x55d62befad00 2024-05-09T01:14:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.046+0000 7f964e7fc700 1 -- 172.21.15.37:0/3620180785 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650029560 con 0x55d62befad00 2024-05-09T01:14:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 -- 172.21.15.37:0/3620180785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 msgr2=0x55d62c0100f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0100f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9650000c00 tx=0x7f9650005040 comp rx=0 tx=0).stop 2024-05-09T01:14:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 -- 172.21.15.37:0/3620180785 shutdown_connections 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62c005c10 0x55d62c01b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62be804a0 0x55d62bff2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 --2- 172.21.15.37:0/3620180785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0100f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 -- 172.21.15.37:0/3620180785 >> 172.21.15.37:0/3620180785 conn(0x55d62be83f70 msgr2=0x55d62c00e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 -- 172.21.15.37:0/3620180785 shutdown_connections 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 -- 172.21.15.37:0/3620180785 wait complete. 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 -- start start 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.047+0000 7f9679486b80 1 Processor -- start 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9679486b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62be804a0 0x55d62c000c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9679486b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0011d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9679486b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62c005c10 0x55d62bffc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9679486b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96641adf00 con 0x55d62be804a0 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9679486b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96641ad830 con 0x55d62c005c10 2024-05-09T01:14:16.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9679486b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96641aaa10 con 0x55d62befad00 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966880c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62be804a0 0x55d62c000c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9679486b80 10 client.0 _ll_register_callbacks cb 0x55d62bd916c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966880c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62be804a0 0x55d62c000c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45302/0 (socket says 172.21.15.37:45302) 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966880c700 1 -- 172.21.15.37:0/704524534 learned_addr learned my addr 172.21.15.37:0/704524534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f9663fff700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966900d700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62c005c10 0x55d62bffc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966900d700 1 -- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 msgr2=0x55d62c0011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966900d700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966900d700 1 -- 172.21.15.37:0/704524534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62be804a0 msgr2=0x55d62c000c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.048+0000 7f966900d700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62be804a0 0x55d62c000c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f966900d700 1 -- 172.21.15.37:0/704524534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62bffcb20 con 0x55d62c005c10 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f966880c700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62be804a0 0x55d62c000c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f966900d700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62c005c10 0x55d62bffc3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f965c0df7e0 tx=0x7f965c0a9880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d0bc61aebc87ad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9643fff700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9643fff700 1 -- 172.21.15.37:0/704524534 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c0c3060 con 0x55d62c005c10 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9643fff700 1 -- 172.21.15.37:0/704524534 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f965c0dfdc0 con 0x55d62c005c10 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9650005510 con 0x55d62c005c10 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9643fff700 1 -- 172.21.15.37:0/704524534 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f965c0ca050 con 0x55d62c005c10 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9679486b80 10 client.27278 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55d62c0052e0 con 0x55d62c005c10 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.049+0000 7f9643fff700 1 -- 172.21.15.37:0/704524534 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9650005510 con 0x55d62c005c10 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f9643fff700 1 -- 172.21.15.37:0/704524534 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7f965c0c3ba0 con 0x55d62c005c10 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f9679486b80 10 client.27278 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f9679486b80 10 client.27278 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f9679486b80 20 client.27278 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f9679486b80 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c094c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f9679486b80 4 client.27278 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d62bf2da80 con 0x55d62c01f740 2024-05-09T01:14:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.050+0000 7f966880c700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c094c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9643fff700 10 client.27278 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:14:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f966880c700 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c094c60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7de2e1117cc2ccee server_cookie=b4ffa8672516299f in_seq=0 out_seq=0 2024-05-09T01:14:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9643fff700 1 -- 172.21.15.37:0/704524534 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d62bf2da80 con 0x55d62c01f740 2024-05-09T01:14:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9643fff700 10 client.27278 handle_command_reply: tid=0 2024-05-09T01:14:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 client.27278 shutdown 2024-05-09T01:14:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62c005c10 msgr2=0x55d62bffc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62c005c10 0x55d62bffc3f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f965c0df7e0 tx=0x7f965c0a9880 comp rx=0 tx=0).stop 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 shutdown_connections 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55d62c01f740 0x55d62c094c60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55d62c005c10 0x55d62bffc3f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d62be804a0 0x55d62c000c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 --2- 172.21.15.37:0/704524534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d62befad00 0x55d62c0011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.051+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 >> 172.21.15.37:0/704524534 conn(0x55d62be83f70 msgr2=0x55d62c0093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.052+0000 7f9643fff700 0 client.27278 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.052+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 shutdown_connections 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f9679486b80 1 -- 172.21.15.37:0/704524534 wait complete. 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f9679486b80 20 client.27278 trim_cache size 0 max 16384 2024-05-09T01:14:16.056 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96540b6d10 msgr2=0x7f96540b9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96540b6d10 0x7f96540b9220 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9658009de0 tx=0x7f9658009190 comp rx=0 tx=0).stop 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9664109860 msgr2=0x7f966419f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9664109860 0x7f966419f750 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f965c00ef30 tx=0x7f965c00c3a0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 shutdown_connections 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f96540b6d10 0x7f96540b9220 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9664109860 0x7f966419f750 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641045e0 0x7f966419af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.053+0000 7f966aa70700 1 --2- 172.21.15.37:0/2124461602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9664108f10 0x7f966419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.054+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 >> 172.21.15.37:0/2124461602 conn(0x7f96640ffe70 msgr2=0x7f96641070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.054+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 shutdown_connections 2024-05-09T01:14:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:16.054+0000 7f966aa70700 1 -- 172.21.15.37:0/2124461602 wait complete. 2024-05-09T01:14:16.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:16 smithi037 ceph-mon[30122]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 601 op/s 2024-05-09T01:14:16.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:16 smithi151 ceph-mon[34780]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 601 op/s 2024-05-09T01:14:16.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:16 smithi136 ceph-mon[34110]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 601 op/s 2024-05-09T01:14:16.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:14:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:18.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:18 smithi151 ceph-mon[34780]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-05-09T01:14:18.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:18 smithi037 ceph-mon[30122]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-05-09T01:14:18.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:18 smithi136 ceph-mon[34110]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 682 op/s 2024-05-09T01:14:19.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.369+0000 7ff528a38700 1 -- 172.21.15.37:0/31284574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 msgr2=0x7ff52411d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.369+0000 7ff528a38700 1 --2- 172.21.15.37:0/31284574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 0x7ff52411d3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff51401a9a0 tx=0x7ff51401acb0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.370+0000 7ff528a38700 1 -- 172.21.15.37:0/31284574 shutdown_connections 2024-05-09T01:14:19.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.370+0000 7ff528a38700 1 --2- 172.21.15.37:0/31284574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52411d930 0x7ff52411fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.370+0000 7ff528a38700 1 --2- 172.21.15.37:0/31284574 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff52410a930 0x7ff52410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.370+0000 7ff528a38700 1 --2- 172.21.15.37:0/31284574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 0x7ff52411d3f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.370+0000 7ff528a38700 1 -- 172.21.15.37:0/31284574 >> 172.21.15.37:0/31284574 conn(0x7ff52406f4d0 msgr2=0x7ff52406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.374+0000 7ff528a38700 1 -- 172.21.15.37:0/31284574 shutdown_connections 2024-05-09T01:14:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.374+0000 7ff528a38700 1 -- 172.21.15.37:0/31284574 wait complete. 2024-05-09T01:14:19.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.376+0000 7ff528a38700 1 Processor -- start 2024-05-09T01:14:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.376+0000 7ff528a38700 1 -- start start 2024-05-09T01:14:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.377+0000 7ff528a38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52410a930 0x7ff52411d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.377+0000 7ff528a38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 0x7ff524119490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.377+0000 7ff52259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52410a930 0x7ff52411d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.377+0000 7ff52259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52410a930 0x7ff52411d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45314/0 (socket says 172.21.15.37:45314) 2024-05-09T01:14:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.377+0000 7ff52259c700 1 -- 172.21.15.37:0/1849840357 learned_addr learned my addr 172.21.15.37:0/1849840357 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.378+0000 7ff528a38700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff52411d930 0x7ff524119a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.378+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241153e0 con 0x7ff52410a930 2024-05-09T01:14:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.378+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff524115260 con 0x7ff52411d930 2024-05-09T01:14:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.378+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff524115560 con 0x7ff52410b280 2024-05-09T01:14:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.380+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 0x7ff524119490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.380+0000 7ff52259c700 1 -- 172.21.15.37:0/1849840357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 msgr2=0x7ff524119490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.380+0000 7ff52259c700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 0x7ff524119490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.380+0000 7ff52259c700 1 -- 172.21.15.37:0/1849840357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff52411d930 msgr2=0x7ff524119a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:14:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.380+0000 7ff52259c700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff52411d930 0x7ff524119a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.380+0000 7ff52259c700 1 -- 172.21.15.37:0/1849840357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52411a280 con 0x7ff52410a930 2024-05-09T01:14:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.381+0000 7ff52259c700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52410a930 0x7ff52411d300 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00ba50 tx=0x7ff51c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.381+0000 7ff5137fe700 1 -- 172.21.15.37:0/1849840357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c019070 con 0x7ff52410a930 2024-05-09T01:14:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.382+0000 7ff5137fe700 1 -- 172.21.15.37:0/1849840357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff51c014440 con 0x7ff52410a930 2024-05-09T01:14:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.382+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5241ad9e0 con 0x7ff52410a930 2024-05-09T01:14:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.382+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5241adef0 con 0x7ff52410a930 2024-05-09T01:14:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.383+0000 7ff5137fe700 1 -- 172.21.15.37:0/1849840357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00ce60 con 0x7ff52410a930 2024-05-09T01:14:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.389+0000 7ff5137fe700 1 -- 172.21.15.37:0/1849840357 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff51c01c070 con 0x7ff52410a930 2024-05-09T01:14:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.389+0000 7ff53744eb80 1 Processor -- start 2024-05-09T01:14:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.391+0000 7ff5137fe700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff50c0b2980 0x7ff50c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.391+0000 7ff5137fe700 1 -- 172.21.15.37:0/1849840357 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff51c0e1650 con 0x7ff52410a930 2024-05-09T01:14:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.391+0000 7ff53744eb80 1 -- start start 2024-05-09T01:14:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.391+0000 7ff522d9d700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff50c0b2980 0x7ff50c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.392+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.392+0000 7ff522d9d700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff50c0b2980 0x7ff50c0b4e90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff524112ba0 tx=0x7ff51800b3f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.392+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c6410aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.393+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64104ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.393+0000 7ff53744eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c64026ff0 con 0x556c64071160 2024-05-09T01:14:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.393+0000 7ff53744eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556c63fc57f0 con 0x556c63f874a0 2024-05-09T01:14:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.393+0000 7ff53744eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556c64022fb0 con 0x556c641046a0 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.395+0000 7ff521d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c6410aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.395+0000 7ff521d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c6410aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44300/0 (socket says 172.21.15.37:44300) 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.395+0000 7ff521d9b700 1 -- 172.21.15.37:0/3818597642 learned_addr learned my addr 172.21.15.37:0/3818597642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.395+0000 7ff522d9d700 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64104ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.395+0000 7ff521d9b700 1 -- 172.21.15.37:0/3818597642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 msgr2=0x556c64104ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.396+0000 7ff521d9b700 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64104ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.396+0000 7ff521d9b700 1 -- 172.21.15.37:0/3818597642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 msgr2=0x556c6410a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.396+0000 7ff521d9b700 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.396+0000 7ff521d9b700 1 -- 172.21.15.37:0/3818597642 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c63fbd370 con 0x556c63f874a0 2024-05-09T01:14:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.396+0000 7ff522d9d700 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:14:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.397+0000 7ff521d9b700 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c6410aa30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff51401a9a0 tx=0x7ff514003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe602ec33fbf6613 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.397+0000 7ff510ff9700 1 -- 172.21.15.37:0/3818597642 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51401caf0 con 0x556c63f874a0 2024-05-09T01:14:19.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.398+0000 7ff510ff9700 1 -- 172.21.15.37:0/3818597642 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff514005570 con 0x556c63f874a0 2024-05-09T01:14:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.399+0000 7ff510ff9700 1 -- 172.21.15.37:0/3818597642 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5140283f0 con 0x556c63f874a0 2024-05-09T01:14:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.399+0000 7ff53744eb80 1 -- 172.21.15.37:0/3818597642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 msgr2=0x556c6410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.399+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c6410aa30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff51401a9a0 tx=0x7ff514003680 comp rx=0 tx=0).stop 2024-05-09T01:14:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.400+0000 7ff53744eb80 1 -- 172.21.15.37:0/3818597642 shutdown_connections 2024-05-09T01:14:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.400+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.400+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.400+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3818597642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c6410aa30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.400+0000 7ff53744eb80 1 -- 172.21.15.37:0/3818597642 >> 172.21.15.37:0/3818597642 conn(0x556c63fe76a0 msgr2=0x556c640ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.400+0000 7ff53744eb80 1 -- 172.21.15.37:0/3818597642 shutdown_connections 2024-05-09T01:14:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.400+0000 7ff53744eb80 1 -- 172.21.15.37:0/3818597642 wait complete. 2024-05-09T01:14:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.401+0000 7ff53744eb80 1 -- start start 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.401+0000 7ff53744eb80 1 Processor -- start 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.401+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c63f874a0 0x556c6410e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.401+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c6410ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff53744eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c63ea2ba0 con 0x556c64071160 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45336/0 (socket says 172.21.15.37:45336) 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 -- 172.21.15.37:0/1275997982 learned_addr learned my addr 172.21.15.37:0/1275997982 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556c63fe1150 con 0x556c641046a0 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff52259c700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c63f874a0 0x556c6410e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556c641111d0 con 0x556c63f874a0 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff53744eb80 10 client.0 _ll_register_callbacks cb 0x556c63e986c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff522d9d700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c6410ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 -- 172.21.15.37:0/1275997982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c63f874a0 msgr2=0x556c6410e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c63f874a0 0x556c6410e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 -- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 msgr2=0x556c6410ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c6410ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff521d9b700 1 -- 172.21.15.37:0/1275997982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c63ea2490 con 0x556c64071160 2024-05-09T01:14:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.402+0000 7ff522d9d700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c6410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.403+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410e6f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff51401c5d0 tx=0x7ff51401cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f64608c906d889e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.403+0000 7ff509ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff509ffb700 1 -- 172.21.15.37:0/1275997982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514005320 con 0x556c64071160 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff514005570 con 0x556c64071160 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff509ffb700 1 -- 172.21.15.37:0/1275997982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff514038070 con 0x556c64071160 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff509ffb700 1 -- 172.21.15.37:0/1275997982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ff514003aa0 con 0x556c64071160 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff53744eb80 10 client.17403 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x556c6411b960 con 0x556c64071160 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff509ffb700 1 -- 172.21.15.37:0/1275997982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff514005570 con 0x556c64071160 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.404+0000 7ff509ffb700 1 -- 172.21.15.37:0/1275997982 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7ff514031070 con 0x556c64071160 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.405+0000 7ff53744eb80 10 client.17403 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.405+0000 7ff53744eb80 10 client.17403 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.405+0000 7ff53744eb80 20 client.17403 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.405+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64120250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.405+0000 7ff53744eb80 4 client.17403 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.405+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c640349d0 con 0x556c6411de30 2024-05-09T01:14:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.405+0000 7ff52259c700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64120250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.406+0000 7ff52259c700 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64120250 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7d56887782da61da server_cookie=661770570144af1d in_seq=0 out_seq=0 2024-05-09T01:14:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.406+0000 7ff509ffb700 10 client.17403 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:14:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.406+0000 7ff509ffb700 1 -- 172.21.15.37:0/1275997982 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556c640349d0 con 0x556c6411de30 2024-05-09T01:14:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.406+0000 7ff509ffb700 10 client.17403 handle_command_reply: tid=0 2024-05-09T01:14:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.407+0000 7ff53744eb80 1 client.17403 shutdown 2024-05-09T01:14:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.407+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 msgr2=0x556c6410e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.407+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410e6f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff51401c5d0 tx=0x7ff51401cd20 comp rx=0 tx=0).stop 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 shutdown_connections 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64120250 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff509ffb700 0 client.17403 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c6410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c63f874a0 0x556c6410e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1275997982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c6410e6f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 >> 172.21.15.37:0/1275997982 conn(0x556c63fe76a0 msgr2=0x556c640ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 shutdown_connections 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.408+0000 7ff53744eb80 1 -- 172.21.15.37:0/1275997982 wait complete. 2024-05-09T01:14:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.409+0000 7ff53744eb80 20 client.17403 trim_cache size 0 max 16384 2024-05-09T01:14:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.431+0000 7ff53744eb80 1 Processor -- start 2024-05-09T01:14:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.431+0000 7ff53744eb80 1 -- start start 2024-05-09T01:14:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c63f874a0 0x556c641040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c64071160 0x556c6411a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c64108510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff53744eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241b4ff0 con 0x556c63f874a0 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff53744eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241b6c50 con 0x556c641046a0 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff52259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c63f874a0 0x556c641040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff53744eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241b56c0 con 0x556c64071160 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff52259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c63f874a0 0x556c641040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45342/0 (socket says 172.21.15.37:45342) 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff52259c700 1 -- 172.21.15.37:0/1569483481 learned_addr learned my addr 172.21.15.37:0/1569483481 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c64071160 0x556c6411a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.432+0000 7ff522d9d700 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c64108510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff521d9b700 1 -- 172.21.15.37:0/1569483481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 msgr2=0x556c64108510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c64108510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff521d9b700 1 -- 172.21.15.37:0/1569483481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c63f874a0 msgr2=0x556c641040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c63f874a0 0x556c641040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff521d9b700 1 -- 172.21.15.37:0/1569483481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c6410a070 con 0x556c64071160 2024-05-09T01:14:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff521d9b700 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c64071160 0x556c6411a430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x556c640fa2f0 tx=0x7ff51401acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6321f0d7062311 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff50bfff700 1 -- 172.21.15.37:0/1569483481 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51401a820 con 0x556c64071160 2024-05-09T01:14:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff50bfff700 1 -- 172.21.15.37:0/1569483481 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff51401cd90 con 0x556c64071160 2024-05-09T01:14:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.433+0000 7ff50bfff700 1 -- 172.21.15.37:0/1569483481 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51403c550 con 0x556c64071160 2024-05-09T01:14:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.434+0000 7ff53744eb80 1 -- 172.21.15.37:0/1569483481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c64071160 msgr2=0x556c6411a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.434+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c64071160 0x556c6411a430 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x556c640fa2f0 tx=0x7ff51401acb0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.434+0000 7ff53744eb80 1 -- 172.21.15.37:0/1569483481 shutdown_connections 2024-05-09T01:14:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.434+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c641046a0 0x556c64108510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.435+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c63f874a0 0x556c641040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.435+0000 7ff53744eb80 1 --2- 172.21.15.37:0/1569483481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c64071160 0x556c6411a430 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.435+0000 7ff53744eb80 1 -- 172.21.15.37:0/1569483481 >> 172.21.15.37:0/1569483481 conn(0x556c63fe76a0 msgr2=0x556c64107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.435+0000 7ff53744eb80 1 -- 172.21.15.37:0/1569483481 shutdown_connections 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.435+0000 7ff53744eb80 1 -- 172.21.15.37:0/1569483481 wait complete. 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.435+0000 7ff53744eb80 1 -- start start 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.436+0000 7ff53744eb80 1 Processor -- start 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.436+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c64122000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.436+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c64122540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff53744eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64122a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff53744eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241b64c0 con 0x556c64071160 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff52259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c64122000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff53744eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241b5df0 con 0x556c63f874a0 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff53744eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241b2fd0 con 0x556c641046a0 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff52259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c64122000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:44330/0 (socket says 172.21.15.37:44330) 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff52259c700 1 -- 172.21.15.37:0/3928985986 learned_addr learned my addr 172.21.15.37:0/3928985986 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff522d9d700 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64122a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff53744eb80 10 client.0 _ll_register_callbacks cb 0x556c63e986c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff521d9b700 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c64122540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff522d9d700 1 -- 172.21.15.37:0/3928985986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 msgr2=0x556c64122000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff522d9d700 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c64122000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff522d9d700 1 -- 172.21.15.37:0/3928985986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 msgr2=0x556c64122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff522d9d700 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c64122540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.437+0000 7ff522d9d700 1 -- 172.21.15.37:0/3928985986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c64186500 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff522d9d700 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64122a80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d5c0 tx=0x7ff5180047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e36d1e1294024dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff509ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff509ffb700 1 -- 172.21.15.37:0/3928985986 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51801e600 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff509ffb700 1 -- 172.21.15.37:0/3928985986 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff51801e7a0 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff51401cd90 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff509ffb700 1 -- 172.21.15.37:0/3928985986 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ff51801e9a0 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff53744eb80 10 client.27262 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.438+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x556c64187790 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff509ffb700 1 -- 172.21.15.37:0/3928985986 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff51401cd90 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff509ffb700 1 -- 172.21.15.37:0/3928985986 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7ff518028b50 con 0x556c641046a0 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff53744eb80 10 client.27262 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff53744eb80 10 client.27262 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:14:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff53744eb80 20 client.27262 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff53744eb80 4 client.27262 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:14:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c6402ea70 con 0x556c6411de30 2024-05-09T01:14:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.439+0000 7ff52259c700 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.440+0000 7ff509ffb700 10 client.27262 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:14:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.440+0000 7ff52259c700 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64189f40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4da6622c96567c9c server_cookie=38f7d7e14b1d896b in_seq=0 out_seq=0 2024-05-09T01:14:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff509ffb700 1 -- 172.21.15.37:0/3928985986 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c6402ea70 con 0x556c6411de30 2024-05-09T01:14:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff509ffb700 10 client.27262 handle_command_reply: tid=0 2024-05-09T01:14:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 client.27262 shutdown 2024-05-09T01:14:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 msgr2=0x556c64122a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64122a80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d5c0 tx=0x7ff5180047c0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 shutdown_connections 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556c641046a0 0x556c64122a80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x556c6411de30 0x556c64189f40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff509ffb700 0 client.27262 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556c63f874a0 0x556c64122000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 --2- 172.21.15.37:0/3928985986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c64071160 0x556c64122540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 >> 172.21.15.37:0/3928985986 conn(0x556c63fe76a0 msgr2=0x556c64103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 shutdown_connections 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 1 -- 172.21.15.37:0/3928985986 wait complete. 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.441+0000 7ff53744eb80 20 client.27262 trim_cache size 0 max 16384 2024-05-09T01:14:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:14:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff50c0b2980 msgr2=0x7ff50c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff50c0b2980 0x7ff50c0b4e90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff524112ba0 tx=0x7ff51800b3f0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52410a930 msgr2=0x7ff52411d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52410a930 0x7ff52411d300 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00ba50 tx=0x7ff51c00bd60 comp rx=0 tx=0).stop 2024-05-09T01:14:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 shutdown_connections 2024-05-09T01:14:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff50c0b2980 0x7ff50c0b4e90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff52411d930 0x7ff524119a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52410a930 0x7ff52411d300 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 --2- 172.21.15.37:0/1849840357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff52410b280 0x7ff524119490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.442+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 >> 172.21.15.37:0/1849840357 conn(0x7ff52406f4d0 msgr2=0x7ff52411e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.443+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 shutdown_connections 2024-05-09T01:14:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:19.443+0000 7ff528a38700 1 -- 172.21.15.37:0/1849840357 wait complete. 2024-05-09T01:14:20.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 720.0 s, 1559.2 tps, lat 64.415 ms stddev 70.413 2024-05-09T01:14:20.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:14:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:20 smithi037 ceph-mon[30122]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-05-09T01:14:20.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:20 smithi151 ceph-mon[34780]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-05-09T01:14:20.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:20 smithi136 ceph-mon[34110]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-05-09T01:14:22.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:22 smithi037 ceph-mon[30122]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 651 op/s 2024-05-09T01:14:22.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:22 smithi151 ceph-mon[34780]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 651 op/s 2024-05-09T01:14:22.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:22 smithi136 ceph-mon[34110]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 651 op/s 2024-05-09T01:14:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.976+0000 7ffb8f383700 1 -- 172.21.15.37:0/3232811566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810b280 msgr2=0x7ffb8811d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.976+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3232811566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810b280 0x7ffb8811d3f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009990 tx=0x7ffb7c009ca0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.977+0000 7ffb8f383700 1 -- 172.21.15.37:0/3232811566 shutdown_connections 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.977+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3232811566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb8811d930 0x7ffb8811fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.977+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3232811566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8810a930 0x7ffb8810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.977+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3232811566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810b280 0x7ffb8811d3f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.977+0000 7ffb8f383700 1 -- 172.21.15.37:0/3232811566 >> 172.21.15.37:0/3232811566 conn(0x7ffb8806f4d0 msgr2=0x7ffb8806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.977+0000 7ffb8f383700 1 -- 172.21.15.37:0/3232811566 shutdown_connections 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.977+0000 7ffb8f383700 1 -- 172.21.15.37:0/3232811566 wait complete. 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.978+0000 7ffb8f383700 1 Processor -- start 2024-05-09T01:14:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.979+0000 7ffb8f383700 1 -- start start 2024-05-09T01:14:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.979+0000 7ffb8f383700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810a930 0x7ffb881af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.979+0000 7ffb8f383700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8810b280 0x7ffb881aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.979+0000 7ffb8f383700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb8811d930 0x7ffb881a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.979+0000 7ffb8f383700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881233b0 con 0x7ffb8810b280 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.979+0000 7ffb8f383700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88123230 con 0x7ffb8810a930 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.979+0000 7ffb8f383700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88123530 con 0x7ffb8811d930 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d920700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb8811d930 0x7ffb881a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d920700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb8811d930 0x7ffb881a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33214/0 (socket says 172.21.15.37:33214) 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d920700 1 -- 172.21.15.37:0/3509036968 learned_addr learned my addr 172.21.15.37:0/3509036968 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810a930 0x7ffb881af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d11f700 1 -- 172.21.15.37:0/3509036968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb8811d930 msgr2=0x7ffb881a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb8811d930 0x7ffb881a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d11f700 1 -- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8810b280 msgr2=0x7ffb881aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8810b280 0x7ffb881aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.980+0000 7ffb8d11f700 1 -- 172.21.15.37:0/3509036968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb881aa280 con 0x7ffb8810a930 2024-05-09T01:14:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.981+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810a930 0x7ffb881af9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800bd70 tx=0x7ffb7800bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.981+0000 7ffb867fc700 1 -- 172.21.15.37:0/3509036968 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78019070 con 0x7ffb8810a930 2024-05-09T01:14:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.981+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb881aa570 con 0x7ffb8810a930 2024-05-09T01:14:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.981+0000 7ffb867fc700 1 -- 172.21.15.37:0/3509036968 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb7800cc90 con 0x7ffb8810a930 2024-05-09T01:14:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.981+0000 7ffb867fc700 1 -- 172.21.15.37:0/3509036968 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78012580 con 0x7ffb8810a930 2024-05-09T01:14:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.982+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb88112bd0 con 0x7ffb8810a930 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.987+0000 7ffb9dd99b80 1 Processor -- start 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.987+0000 7ffb9dd99b80 1 -- start start 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.988+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b644f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.988+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b64a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.988+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b5ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.988+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564c70a80ff0 con 0x564c709e14a0 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.988+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c70a1f7f0 con 0x564c70acb160 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.988+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564c70a7cfb0 con 0x564c70b5e6a0 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.989+0000 7ffb8d920700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.989+0000 7ffb8c91e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b5ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.989+0000 7ffb8d920700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40124/0 (socket says 172.21.15.37:40124) 2024-05-09T01:14:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.989+0000 7ffb8d920700 1 -- 172.21.15.37:0/161242739 learned_addr learned my addr 172.21.15.37:0/161242739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.991+0000 7ffb8c91e700 1 -- 172.21.15.37:0/161242739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 msgr2=0x564c70b644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.991+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/161242739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.991+0000 7ffb8c91e700 1 -- 172.21.15.37:0/161242739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 msgr2=0x564c70b64a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:14:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.991+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/161242739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b64a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.991+0000 7ffb8c91e700 1 -- 172.21.15.37:0/161242739 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c70a17370 con 0x564c70b5e6a0 2024-05-09T01:14:22.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.991+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/161242739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b5ead0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffb881ab280 tx=0x7ffb7c0096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ac14f21e7600565 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:22.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.992+0000 7ffb867fc700 1 -- 172.21.15.37:0/3509036968 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ffb7801c070 con 0x7ffb8810a930 2024-05-09T01:14:22.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.993+0000 7ffb867fc700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb700b2ad0 0x7ffb700b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:22.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.993+0000 7ffb6f7fe700 1 -- 172.21.15.37:0/161242739 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c005660 con 0x564c70b5e6a0 2024-05-09T01:14:22.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.993+0000 7ffb6f7fe700 1 -- 172.21.15.37:0/161242739 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb7c00bbd0 con 0x564c70b5e6a0 2024-05-09T01:14:22.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.993+0000 7ffb6f7fe700 1 -- 172.21.15.37:0/161242739 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c003d00 con 0x564c70b5e6a0 2024-05-09T01:14:22.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.994+0000 7ffb8d920700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb700b2ad0 0x7ffb700b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:22.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.995+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/161242739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 msgr2=0x564c70b5ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:22.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.995+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/161242739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b5ead0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffb881ab280 tx=0x7ffb7c0096a0 comp rx=0 tx=0).stop 2024-05-09T01:14:22.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.996+0000 7ffb867fc700 1 -- 172.21.15.37:0/3509036968 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ffb78012340 con 0x7ffb8810a930 2024-05-09T01:14:23.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb8d920700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb700b2ad0 0x7ffb700b4fe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb80034460 tx=0x7ffb80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:23.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/161242739 shutdown_connections 2024-05-09T01:14:23.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/161242739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b5ead0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/161242739 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/161242739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b64a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/161242739 >> 172.21.15.37:0/161242739 conn(0x564c70a416a0 msgr2=0x564c70b59400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:23.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/161242739 shutdown_connections 2024-05-09T01:14:23.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.998+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/161242739 wait complete. 2024-05-09T01:14:23.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.999+0000 7ffb9dd99b80 1 -- start start 2024-05-09T01:14:23.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:22.999+0000 7ffb9dd99b80 1 Processor -- start 2024-05-09T01:14:23.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 0x564c70b68110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b68650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70b5e6a0 0x564c70b68b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564c708fcba0 con 0x564c70b5e6a0 2024-05-09T01:14:23.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564c70a3b150 con 0x564c70acb160 2024-05-09T01:14:23.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564c70b6b1d0 con 0x564c709e14a0 2024-05-09T01:14:23.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb9dd99b80 10 client.0 _ll_register_callbacks cb 0x564c708f26c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb8d920700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70b5e6a0 0x564c70b68b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb8d920700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70b5e6a0 0x564c70b68b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45900/0 (socket says 172.21.15.37:45900) 2024-05-09T01:14:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.000+0000 7ffb8d920700 1 -- 172.21.15.37:0/2172179120 learned_addr learned my addr 172.21.15.37:0/2172179120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b68650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb8d920700 1 -- 172.21.15.37:0/2172179120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 msgr2=0x564c70b68110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:14:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb8d920700 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 0x564c70b68110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb8d920700 1 -- 172.21.15.37:0/2172179120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 msgr2=0x564c70b68650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:23.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb8d920700 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b68650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb8d920700 1 -- 172.21.15.37:0/2172179120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c708fc490 con 0x564c70b5e6a0 2024-05-09T01:14:23.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb8d920700 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70b5e6a0 0x564c70b68b90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffb800409d0 tx=0x7ffb800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34055dcd488dfe90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:23.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.001+0000 7ffb6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:14:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.004+0000 7ffb6cff9700 1 -- 172.21.15.37:0/2172179120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb80034d20 con 0x564c70b5e6a0 2024-05-09T01:14:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.004+0000 7ffb6cff9700 1 -- 172.21.15.37:0/2172179120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ffb8003a030 con 0x564c70b5e6a0 2024-05-09T01:14:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.004+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb7c00bbd0 con 0x564c70b5e6a0 2024-05-09T01:14:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.005+0000 7ffb6cff9700 1 -- 172.21.15.37:0/2172179120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ffb80004830 con 0x564c70b5e6a0 2024-05-09T01:14:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.005+0000 7ffb9dd99b80 10 client.17412 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.005+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x564c70b75b40 con 0x564c70b5e6a0 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb6cff9700 1 -- 172.21.15.37:0/2172179120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb8003ec60 con 0x564c70b5e6a0 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb6cff9700 1 -- 172.21.15.37:0/2172179120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7ffb8004b930 con 0x564c70b5e6a0 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb9dd99b80 10 client.17412 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb9dd99b80 10 client.17412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb9dd99b80 20 client.17412 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70b78180 0x564c70b7a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb9dd99b80 4 client.17412 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.006+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffb7c00bbd0 con 0x564c70b78180 2024-05-09T01:14:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.008+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70b78180 0x564c70b7a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.008+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70b78180 0x564c70b7a5a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4397833591f199e5 server_cookie=51c25b5e16f0ddb in_seq=0 out_seq=0 2024-05-09T01:14:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.008+0000 7ffb6cff9700 10 client.17412 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:14:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.009+0000 7ffb6cff9700 1 -- 172.21.15.37:0/2172179120 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7ffb7c00bbd0 con 0x564c70b78180 2024-05-09T01:14:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.009+0000 7ffb6cff9700 10 client.17412 handle_command_reply: tid=0 2024-05-09T01:14:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.009+0000 7ffb9dd99b80 1 client.17412 shutdown 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70b5e6a0 msgr2=0x564c70b68b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70b5e6a0 0x564c70b68b90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffb800409d0 tx=0x7ffb800047c0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 shutdown_connections 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70b78180 0x564c70b7a5a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70b5e6a0 0x564c70b68b90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 0x564c70b68110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/2172179120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b68650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 >> 172.21.15.37:0/2172179120 conn(0x564c70a416a0 msgr2=0x564c70b591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.010+0000 7ffb6cff9700 0 client.17412 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:14:23.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.011+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 shutdown_connections 2024-05-09T01:14:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.011+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/2172179120 wait complete. 2024-05-09T01:14:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.011+0000 7ffb9dd99b80 20 client.17412 trim_cache size 0 max 16384 2024-05-09T01:14:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.041+0000 7ffb9dd99b80 1 Processor -- start 2024-05-09T01:14:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.041+0000 7ffb9dd99b80 1 -- start start 2024-05-09T01:14:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 0x564c70b689d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70acb160 0x564c70b697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70b5e6a0 0x564c70b69d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88119f70 con 0x564c70acb160 2024-05-09T01:14:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881b6f60 con 0x564c70b5e6a0 2024-05-09T01:14:23.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8811a640 con 0x564c709e14a0 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb8c91e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70acb160 0x564c70b697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.042+0000 7ffb8c91e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70acb160 0x564c70b697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45910/0 (socket says 172.21.15.37:45910) 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8c91e700 1 -- 172.21.15.37:0/1849546802 learned_addr learned my addr 172.21.15.37:0/1849546802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8d920700 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70b5e6a0 0x564c70b69d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 0x564c70b689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8c91e700 1 -- 172.21.15.37:0/1849546802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 msgr2=0x564c70b689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 0x564c70b689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8c91e700 1 -- 172.21.15.37:0/1849546802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70b5e6a0 msgr2=0x564c70b69d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70b5e6a0 0x564c70b69d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8c91e700 1 -- 172.21.15.37:0/1849546802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c70b52f60 con 0x564c70acb160 2024-05-09T01:14:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.043+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70acb160 0x564c70b697c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffb881ab280 tx=0x7ffb7c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc6c34d1d683cc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.044+0000 7ffb6effd700 1 -- 172.21.15.37:0/1849546802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0058e0 con 0x564c70acb160 2024-05-09T01:14:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.044+0000 7ffb6effd700 1 -- 172.21.15.37:0/1849546802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb7c003e00 con 0x564c70acb160 2024-05-09T01:14:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.044+0000 7ffb6effd700 1 -- 172.21.15.37:0/1849546802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00bc60 con 0x564c70acb160 2024-05-09T01:14:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1849546802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70acb160 msgr2=0x564c70b697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70acb160 0x564c70b697c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffb881ab280 tx=0x7ffb7c005b00 comp rx=0 tx=0).stop 2024-05-09T01:14:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1849546802 shutdown_connections 2024-05-09T01:14:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70b5e6a0 0x564c70b69d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c709e14a0 0x564c70b689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1849546802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c70acb160 0x564c70b697c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1849546802 >> 172.21.15.37:0/1849546802 conn(0x564c70a416a0 msgr2=0x564c70b66a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1849546802 shutdown_connections 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1849546802 wait complete. 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 -- start start 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.045+0000 7ffb9dd99b80 1 Processor -- start 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b70840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb9dd99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b7ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb881b67f0 con 0x564c709e14a0 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8811ad70 con 0x564c70acb160 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb9dd99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffb88117f30 con 0x564c70b5e6a0 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8d11f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8d11f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45922/0 (socket says 172.21.15.37:45922) 2024-05-09T01:14:23.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8d11f700 1 -- 172.21.15.37:0/1993605248 learned_addr learned my addr 172.21.15.37:0/1993605248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb9dd99b80 10 client.0 _ll_register_callbacks cb 0x564c708f26c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8d920700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b7ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b70840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8d11f700 1 -- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 msgr2=0x564c70b7ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b7ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.046+0000 7ffb8d11f700 1 -- 172.21.15.37:0/1993605248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 msgr2=0x564c70b70840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b70840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb8d11f700 1 -- 172.21.15.37:0/1993605248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c70b7f600 con 0x564c709e14a0 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b70840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb8d11f700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b702e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffb780a6100 tx=0x7ffb780a3910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62573ec51258a110 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb6cff9700 1 -- 172.21.15.37:0/1993605248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780a5a50 con 0x564c709e14a0 2024-05-09T01:14:23.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb6cff9700 1 -- 172.21.15.37:0/1993605248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ffb780a50c0 con 0x564c709e14a0 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb7c003e00 con 0x564c709e14a0 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb6cff9700 1 -- 172.21.15.37:0/1993605248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7ffb780a5bf0 con 0x564c709e14a0 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb9dd99b80 10 client.17418 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x564c70be2260 con 0x564c709e14a0 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.047+0000 7ffb6cff9700 1 -- 172.21.15.37:0/1993605248 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb78021e50 con 0x564c709e14a0 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb6cff9700 1 -- 172.21.15.37:0/1993605248 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7ffb780a54f0 con 0x564c709e14a0 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb9dd99b80 10 client.17418 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb9dd99b80 10 client.17418 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb9dd99b80 20 client.17418 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70be2990 0x564c70be4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb9dd99b80 4 client.17418 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ffb7c003e00 con 0x564c70be2990 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.048+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70be2990 0x564c70be4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.049+0000 7ffb6cff9700 10 client.17418 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:14:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.049+0000 7ffb8c91e700 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70be2990 0x564c70be4db0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee26d06133dda575 server_cookie=7728b0af442ea3b4 in_seq=0 out_seq=0 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.049+0000 7ffb6cff9700 1 -- 172.21.15.37:0/1993605248 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ffb7c003e00 con 0x564c70be2990 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.049+0000 7ffb6cff9700 10 client.17418 handle_command_reply: tid=0 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.049+0000 7ffb9dd99b80 1 client.17418 shutdown 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.049+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 msgr2=0x564c70b702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.049+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b702e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffb780a6100 tx=0x7ffb780a3910 comp rx=0 tx=0).stop 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.050+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 shutdown_connections 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.050+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x564c70be2990 0x564c70be4db0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.050+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564c70b5e6a0 0x564c70b7ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.050+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564c709e14a0 0x564c70b702e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.050+0000 7ffb9dd99b80 1 --2- 172.21.15.37:0/1993605248 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564c70acb160 0x564c70b70840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.050+0000 7ffb6cff9700 0 client.17418 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:14:23.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.050+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 >> 172.21.15.37:0/1993605248 conn(0x564c70a416a0 msgr2=0x564c70b5d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.051+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 shutdown_connections 2024-05-09T01:14:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.051+0000 7ffb9dd99b80 1 -- 172.21.15.37:0/1993605248 wait complete. 2024-05-09T01:14:23.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.051+0000 7ffb9dd99b80 20 client.17418 trim_cache size 0 max 16384 2024-05-09T01:14:23.057 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:14:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.051+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb700b2ad0 msgr2=0x7ffb700b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.051+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb700b2ad0 0x7ffb700b4fe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ffb80034460 tx=0x7ffb80009260 comp rx=0 tx=0).stop 2024-05-09T01:14:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.051+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810a930 msgr2=0x7ffb881af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.051+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810a930 0x7ffb881af9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800bd70 tx=0x7ffb7800bda0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 shutdown_connections 2024-05-09T01:14:23.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ffb700b2ad0 0x7ffb700b4fe0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb8811d930 0x7ffb881a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb8810a930 0x7ffb881af9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 --2- 172.21.15.37:0/3509036968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8810b280 0x7ffb881aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 >> 172.21.15.37:0/3509036968 conn(0x7ffb8806f4d0 msgr2=0x7ffb8811b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 shutdown_connections 2024-05-09T01:14:23.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:23.052+0000 7ffb8f383700 1 -- 172.21.15.37:0/3509036968 wait complete. 2024-05-09T01:14:23.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:14:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:24 smithi151 ceph-mon[34780]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 622 op/s 2024-05-09T01:14:24.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:24 smithi037 ceph-mon[30122]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 622 op/s 2024-05-09T01:14:24.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:24 smithi136 ceph-mon[34110]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.7 MiB/s wr, 622 op/s 2024-05-09T01:14:25.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 725.0 s, 1613.8 tps, lat 62.045 ms stddev 66.915 2024-05-09T01:14:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.183+0000 7fdc839dd700 1 -- 172.21.15.37:0/1820448657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1038f0 msgr2=0x7fdc7c103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.183+0000 7fdc839dd700 1 --2- 172.21.15.37:0/1820448657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1038f0 0x7fdc7c103d00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009990 tx=0x7fdc78009ca0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.183+0000 7fdc839dd700 1 -- 172.21.15.37:0/1820448657 shutdown_connections 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.183+0000 7fdc839dd700 1 --2- 172.21.15.37:0/1820448657 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c104240 0x7fdc7c110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.183+0000 7fdc839dd700 1 --2- 172.21.15.37:0/1820448657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c108200 0x7fdc7c108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.183+0000 7fdc839dd700 1 --2- 172.21.15.37:0/1820448657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c1038f0 0x7fdc7c103d00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.183+0000 7fdc839dd700 1 -- 172.21.15.37:0/1820448657 >> 172.21.15.37:0/1820448657 conn(0x7fdc7c0fe6f0 msgr2=0x7fdc7c100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.184+0000 7fdc839dd700 1 -- 172.21.15.37:0/1820448657 shutdown_connections 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.184+0000 7fdc839dd700 1 -- 172.21.15.37:0/1820448657 wait complete. 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.184+0000 7fdc839dd700 1 Processor -- start 2024-05-09T01:14:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.184+0000 7fdc839dd700 1 -- start start 2024-05-09T01:14:26.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc839dd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c1038f0 0x7fdc7c19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc839dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c104240 0x7fdc7c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc839dd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c108200 0x7fdc7c19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c104240 0x7fdc7c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc839dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c113380 con 0x7fdc7c104240 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c104240 0x7fdc7c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45944/0 (socket says 172.21.15.37:45944) 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 -- 172.21.15.37:0/3603307271 learned_addr learned my addr 172.21.15.37:0/3603307271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c113200 con 0x7fdc7c1038f0 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c113500 con 0x7fdc7c108200 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc81779700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c1038f0 0x7fdc7c19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c108200 0x7fdc7c19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 -- 172.21.15.37:0/3603307271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c108200 msgr2=0x7fdc7c19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c108200 0x7fdc7c19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 -- 172.21.15.37:0/3603307271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c1038f0 msgr2=0x7fdc7c19bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c1038f0 0x7fdc7c19bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.185+0000 7fdc80f78700 1 -- 172.21.15.37:0/3603307271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1a6fc0 con 0x7fdc7c104240 2024-05-09T01:14:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.186+0000 7fdc80f78700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c104240 0x7fdc7c19c1e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c00 tx=0x7fdc7800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.188+0000 7fdc727fc700 1 -- 172.21.15.37:0/3603307271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78027070 con 0x7fdc7c104240 2024-05-09T01:14:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.188+0000 7fdc727fc700 1 -- 172.21.15.37:0/3603307271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc78022470 con 0x7fdc7c104240 2024-05-09T01:14:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.188+0000 7fdc727fc700 1 -- 172.21.15.37:0/3603307271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78017650 con 0x7fdc7c104240 2024-05-09T01:14:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.189+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c1a7250 con 0x7fdc7c104240 2024-05-09T01:14:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.189+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1a7650 con 0x7fdc7c104240 2024-05-09T01:14:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.193+0000 7fdc727fc700 1 -- 172.21.15.37:0/3603307271 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdc7802a070 con 0x7fdc7c104240 2024-05-09T01:14:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.194+0000 7fdc923f3b80 1 Processor -- start 2024-05-09T01:14:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.194+0000 7fdc923f3b80 1 -- start start 2024-05-09T01:14:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.194+0000 7fdc727fc700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc680b2900 0x7fdc680b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8045dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f8045e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f80462810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f8037bff0 con 0x561f80462400 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561f8031a7f0 con 0x561f802dc4a0 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561f80377fb0 con 0x561f803c6160 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc727fc700 1 -- 172.21.15.37:0/3603307271 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdc780e2e30 con 0x7fdc7c104240 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f8045e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc81779700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8045dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc81779700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8045dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33266/0 (socket says 172.21.15.37:33266) 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f8045e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40194/0 (socket says 172.21.15.37:40194) 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc81779700 1 -- 172.21.15.37:0/4077304747 learned_addr learned my addr 172.21.15.37:0/4077304747 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f80462810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc80f78700 1 -- 172.21.15.37:0/4077304747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 msgr2=0x561f8045dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc80f78700 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8045dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc80f78700 1 -- 172.21.15.37:0/4077304747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 msgr2=0x561f80462810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc80f78700 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f80462810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc80f78700 1 -- 172.21.15.37:0/4077304747 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f80312370 con 0x561f802dc4a0 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc81779700 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8045dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.195+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc680b2900 0x7fdc680b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.196+0000 7fdc80f78700 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f8045e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdc780e0930 tx=0x7fdc780096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f99be7c8f140e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.196+0000 7fdc677fe700 1 -- 172.21.15.37:0/4077304747 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc780a9e30 con 0x561f802dc4a0 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.196+0000 7fdc677fe700 1 -- 172.21.15.37:0/4077304747 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc780920e0 con 0x561f802dc4a0 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.196+0000 7fdc677fe700 1 -- 172.21.15.37:0/4077304747 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78004830 con 0x561f802dc4a0 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4077304747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 msgr2=0x561f8045e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc680b2900 0x7fdc680b4e10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009550 tx=0x7fdc7400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f8045e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdc780e0930 tx=0x7fdc780096c0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4077304747 shutdown_connections 2024-05-09T01:14:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f80462810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8045dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4077304747 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f8045e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4077304747 >> 172.21.15.37:0/4077304747 conn(0x561f8033c6a0 msgr2=0x561f80454400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4077304747 shutdown_connections 2024-05-09T01:14:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4077304747 wait complete. 2024-05-09T01:14:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.197+0000 7fdc923f3b80 1 -- start start 2024-05-09T01:14:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.198+0000 7fdc923f3b80 1 Processor -- start 2024-05-09T01:14:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f802dc4a0 0x561f8046d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8046d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f80467570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f801f7ba0 con 0x561f802dc4a0 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561f80336150 con 0x561f80462400 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561f80463030 con 0x561f803c6160 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc81779700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f802dc4a0 0x561f8046d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc81779700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f802dc4a0 0x561f8046d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45966/0 (socket says 172.21.15.37:45966) 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc81779700 1 -- 172.21.15.37:0/46927136 learned_addr learned my addr 172.21.15.37:0/46927136 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc80f78700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8046d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f80467570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc923f3b80 10 client.0 _ll_register_callbacks cb 0x561f801ed6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc80f78700 1 -- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 msgr2=0x561f80467570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.199+0000 7fdc80f78700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f80467570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc80f78700 1 -- 172.21.15.37:0/46927136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f802dc4a0 msgr2=0x561f8046d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc80f78700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f802dc4a0 0x561f8046d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc80f78700 1 -- 172.21.15.37:0/46927136 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f801f7490 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc81779700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f802dc4a0 0x561f8046d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f80467570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc80f78700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8046d6b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdc780e0930 tx=0x7fdc780aaa20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d5c1984fdbbd2e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc64ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc64ff9700 1 -- 172.21.15.37:0/46927136 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc780c4060 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561f803899d0 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.200+0000 7fdc64ff9700 1 -- 172.21.15.37:0/46927136 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdc780b3030 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc64ff9700 1 -- 172.21.15.37:0/46927136 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdc780cb050 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 10 client.27289 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x561f80474d50 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc64ff9700 1 -- 172.21.15.37:0/46927136 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561f803899d0 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc64ff9700 1 -- 172.21.15.37:0/46927136 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fdc780cb1f0 con 0x561f803c6160 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 10 client.27289 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 10 client.27289 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:14:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 20 client.27289 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f80477220 0x561f80479640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 4 client.27289 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.201+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f80383a70 con 0x561f80477220 2024-05-09T01:14:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.202+0000 7fdc81779700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f80477220 0x561f80479640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.202+0000 7fdc64ff9700 10 client.27289 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:14:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.202+0000 7fdc81779700 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f80477220 0x561f80479640 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b2e23ced7aba125 server_cookie=9d057f41b3b7fbb0 in_seq=0 out_seq=0 2024-05-09T01:14:26.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc64ff9700 1 -- 172.21.15.37:0/46927136 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561f80383a70 con 0x561f80477220 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc64ff9700 10 client.27289 handle_command_reply: tid=0 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 client.27289 shutdown 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 msgr2=0x561f8046d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8046d6b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdc780e0930 tx=0x7fdc780aaa20 comp rx=0 tx=0).stop 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 shutdown_connections 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f80467570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f80477220 0x561f80479640 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f802dc4a0 0x561f8046d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/46927136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f8046d6b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc64ff9700 0 client.27289 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 >> 172.21.15.37:0/46927136 conn(0x561f8033c6a0 msgr2=0x561f804541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 shutdown_connections 2024-05-09T01:14:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.203+0000 7fdc923f3b80 1 -- 172.21.15.37:0/46927136 wait complete. 2024-05-09T01:14:26.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.204+0000 7fdc923f3b80 20 client.27289 trim_cache size 0 max 16384 2024-05-09T01:14:26.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.223+0000 7fdc923f3b80 1 Processor -- start 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.223+0000 7fdc923f3b80 1 -- start start 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f802dc4a0 0x561f804651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f803c6160 0x561f8047ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f8047f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ac820 con 0x561f803c6160 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ae480 con 0x561f80462400 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1acef0 con 0x561f802dc4a0 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f803c6160 0x561f8047ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc81779700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f802dc4a0 0x561f804651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f803c6160 0x561f8047ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45976/0 (socket says 172.21.15.37:45976) 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 -- 172.21.15.37:0/4163849538 learned_addr learned my addr 172.21.15.37:0/4163849538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f8047f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 -- 172.21.15.37:0/4163849538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f802dc4a0 msgr2=0x561f804651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f802dc4a0 0x561f804651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 -- 172.21.15.37:0/4163849538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 msgr2=0x561f8047f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f8047f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 -- 172.21.15.37:0/4163849538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f80465b00 con 0x561f803c6160 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.224+0000 7fdc80f78700 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f803c6160 0x561f8047ed20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdc780aab40 tx=0x7fdc780096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de6c46b1b39e507 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.225+0000 7fdc66ffd700 1 -- 172.21.15.37:0/4163849538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc780c4070 con 0x561f803c6160 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.225+0000 7fdc66ffd700 1 -- 172.21.15.37:0/4163849538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc780aabe0 con 0x561f803c6160 2024-05-09T01:14:26.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.225+0000 7fdc66ffd700 1 -- 172.21.15.37:0/4163849538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc780a9c50 con 0x561f803c6160 2024-05-09T01:14:26.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4163849538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f803c6160 msgr2=0x561f8047ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f803c6160 0x561f8047ed20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdc780aab40 tx=0x7fdc780096c0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4163849538 shutdown_connections 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f80462400 0x561f8047f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f802dc4a0 0x561f804651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/4163849538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f803c6160 0x561f8047ed20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4163849538 >> 172.21.15.37:0/4163849538 conn(0x561f8033c6a0 msgr2=0x561f80465e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4163849538 shutdown_connections 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 -- 172.21.15.37:0/4163849538 wait complete. 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 -- start start 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.226+0000 7fdc923f3b80 1 Processor -- start 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f804734d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f80473a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc923f3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f8046e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1adcf0 con 0x561f80462400 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1ad620 con 0x561f802dc4a0 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc923f3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1aa7e0 con 0x561f803c6160 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc923f3b80 10 client.0 _ll_register_callbacks cb 0x561f801ed6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f80473a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc80f78700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f80473a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33302/0 (socket says 172.21.15.37:33302) 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc80f78700 1 -- 172.21.15.37:0/3050439759 learned_addr learned my addr 172.21.15.37:0/3050439759 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc81779700 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f804734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc81f7a700 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f8046e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc81779700 1 -- 172.21.15.37:0/3050439759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 msgr2=0x561f80473a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc81779700 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f80473a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc81779700 1 -- 172.21.15.37:0/3050439759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 msgr2=0x561f8046e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc81779700 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f8046e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.227+0000 7fdc81779700 1 -- 172.21.15.37:0/3050439759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8046f030 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc81779700 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f804734d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x561f80479c60 tx=0x7fdc6c004600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ca17c88696a452a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc64ff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc64ff9700 1 -- 172.21.15.37:0/3050439759 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c004830 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc64ff9700 1 -- 172.21.15.37:0/3050439759 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdc6c0049d0 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc780aabe0 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc64ff9700 1 -- 172.21.15.37:0/3050439759 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdc6c004bd0 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc923f3b80 10 client.27323 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x561f804e1390 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc64ff9700 1 -- 172.21.15.37:0/3050439759 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc6c020030 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.228+0000 7fdc64ff9700 1 -- 172.21.15.37:0/3050439759 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fdc6c0051c0 con 0x561f802dc4a0 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc923f3b80 10 client.27323 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc923f3b80 10 client.27323 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:14:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc923f3b80 20 client.27323 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f804e1a40 0x561f804e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc923f3b80 4 client.27323 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fdc780aabe0 con 0x561f804e1a40 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc80f78700 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f804e1a40 0x561f804e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc64ff9700 10 client.27323 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc80f78700 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f804e1a40 0x561f804e3e60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f38a3a7221e7702 server_cookie=8c7f853f5e0e5e84 in_seq=0 out_seq=0 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc64ff9700 1 -- 172.21.15.37:0/3050439759 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fdc780aabe0 con 0x561f804e1a40 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc64ff9700 10 client.27323 handle_command_reply: tid=0 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.229+0000 7fdc923f3b80 1 client.27323 shutdown 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 msgr2=0x561f804734d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f804734d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x561f80479c60 tx=0x7fdc6c004600 comp rx=0 tx=0).stop 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 shutdown_connections 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x561f804e1a40 0x561f804e3e60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f80462400 0x561f8046e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc64ff9700 0 client.27323 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561f802dc4a0 0x561f804734d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 --2- 172.21.15.37:0/3050439759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f803c6160 0x561f80473a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 >> 172.21.15.37:0/3050439759 conn(0x561f8033c6a0 msgr2=0x561f804615c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 shutdown_connections 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.230+0000 7fdc923f3b80 1 -- 172.21.15.37:0/3050439759 wait complete. 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.231+0000 7fdc923f3b80 20 client.27323 trim_cache size 0 max 16384 2024-05-09T01:14:26.237 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:14:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc680b2900 msgr2=0x7fdc680b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc680b2900 0x7fdc680b4e10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009550 tx=0x7fdc7400b040 comp rx=0 tx=0).stop 2024-05-09T01:14:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c104240 msgr2=0x7fdc7c19c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c104240 0x7fdc7c19c1e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c00 tx=0x7fdc7800bfd0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 shutdown_connections 2024-05-09T01:14:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdc680b2900 0x7fdc680b4e10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc7c108200 0x7fdc7c19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc7c1038f0 0x7fdc7c19bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 --2- 172.21.15.37:0/3603307271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c104240 0x7fdc7c19c1e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.233+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 >> 172.21.15.37:0/3603307271 conn(0x7fdc7c0fe6f0 msgr2=0x7fdc7c109690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.234+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 shutdown_connections 2024-05-09T01:14:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:26.234+0000 7fdc839dd700 1 -- 172.21.15.37:0/3603307271 wait complete. 2024-05-09T01:14:26.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.530+0000 7fe219a7e640 1 -- 172.21.15.37:0/3559760644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2141037d0 msgr2=0x7fe214103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.530+0000 7fe219a7e640 1 --2- 172.21.15.37:0/3559760644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2141037d0 0x7fe214103be0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009cd0 tx=0x7fe20c02a8e0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.531+0000 7fe219a7e640 1 -- 172.21.15.37:0/3559760644 shutdown_connections 2024-05-09T01:14:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.531+0000 7fe219a7e640 1 --2- 172.21.15.37:0/3559760644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2141037d0 0x7fe214103be0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.531+0000 7fe219a7e640 1 --2- 172.21.15.37:0/3559760644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe214102e80 0x7fe214103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.531+0000 7fe219a7e640 1 --2- 172.21.15.37:0/3559760644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe214102530 0x7fe214102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.531+0000 7fe219a7e640 1 -- 172.21.15.37:0/3559760644 >> 172.21.15.37:0/3559760644 conn(0x7fe2140fdd40 msgr2=0x7fe2141001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.532+0000 7fe219a7e640 1 -- 172.21.15.37:0/3559760644 shutdown_connections 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.532+0000 7fe219a7e640 1 -- 172.21.15.37:0/3559760644 wait complete. 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.533+0000 7fe219a7e640 1 Processor -- start 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.533+0000 7fe219a7e640 1 -- start start 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.533+0000 7fe219a7e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe214102530 0x7fe21419c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.533+0000 7fe219a7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe214102e80 0x7fe21419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.533+0000 7fe219a7e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2141037d0 0x7fe2141a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe219a7e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe214111980 con 0x7fe214102e80 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe219a7e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe214111800 con 0x7fe214102530 2024-05-09T01:14:26.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe219a7e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe214111b00 con 0x7fe2141037d0 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe214102e80 0x7fe21419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe214102e80 0x7fe21419ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45994/0 (socket says 172.21.15.37:45994) 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 -- 172.21.15.37:0/27357103 learned_addr learned my addr 172.21.15.37:0/27357103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe213fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2141037d0 0x7fe2141a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe2137fe640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe214102530 0x7fe21419c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 -- 172.21.15.37:0/27357103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2141037d0 msgr2=0x7fe2141a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2141037d0 0x7fe2141a39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 -- 172.21.15.37:0/27357103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe214102530 msgr2=0x7fe21419c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe214102530 0x7fe21419c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 -- 172.21.15.37:0/27357103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2141a4060 con 0x7fe214102e80 2024-05-09T01:14:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe2137fe640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe214102530 0x7fe21419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:14:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe20bfff640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe214102e80 0x7fe21419ca60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00e9f0 tx=0x7fe1fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.534+0000 7fe2117fa640 1 -- 172.21.15.37:0/27357103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00cd80 con 0x7fe214102e80 2024-05-09T01:14:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.535+0000 7fe2117fa640 1 -- 172.21.15.37:0/27357103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1fc0054d0 con 0x7fe214102e80 2024-05-09T01:14:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.535+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2141a4350 con 0x7fe214102e80 2024-05-09T01:14:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.535+0000 7fe2117fa640 1 -- 172.21.15.37:0/27357103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc010690 con 0x7fe214102e80 2024-05-09T01:14:26.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.535+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2141a4850 con 0x7fe214102e80 2024-05-09T01:14:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.537+0000 7fe220a06740 1 Processor -- start 2024-05-09T01:14:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.537+0000 7fe220a06740 1 -- start start 2024-05-09T01:14:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe220a06740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68d9f7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe220a06740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d62a2f0 0x55e68d9f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe220a06740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d6324d0 0x55e68d9fe980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe220a06740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e68d95b7c0 con 0x55e68d6531b0 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe220a06740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e68d8f70e0 con 0x55e68d62a2f0 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe220a06740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e68d957780 con 0x55e68d6324d0 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe2117fa640 1 -- 172.21.15.37:0/27357103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe1fc010830 con 0x7fe214102e80 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68d9f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68d9f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46008/0 (socket says 172.21.15.37:46008) 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 -- 172.21.15.37:0/1417610944 learned_addr learned my addr 172.21.15.37:0/1417610944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe2137fe640 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d62a2f0 0x55e68d9f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe20bfff640 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d6324d0 0x55e68d9fe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 -- 172.21.15.37:0/1417610944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d6324d0 msgr2=0x55e68d9fe980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d6324d0 0x55e68d9fe980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 -- 172.21.15.37:0/1417610944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d62a2f0 msgr2=0x55e68d9f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d62a2f0 0x55e68d9f7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 -- 172.21.15.37:0/1417610944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68d9207c0 con 0x55e68d6531b0 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe2137fe640 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d62a2f0 0x55e68d9f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.538+0000 7fe213fff640 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68d9f7500 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe21406b5d0 tx=0x7fe20c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b55523d8fc1a927 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.539+0000 7fe209ffb640 1 -- 172.21.15.37:0/1417610944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c048070 con 0x55e68d6531b0 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.539+0000 7fe2117fa640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2000b27e0 0x7fe2000b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.539+0000 7fe209ffb640 1 -- 172.21.15.37:0/1417610944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe20c036070 con 0x55e68d6531b0 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.539+0000 7fe209ffb640 1 -- 172.21.15.37:0/1417610944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c004380 con 0x55e68d6531b0 2024-05-09T01:14:26.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.539+0000 7fe2137fe640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2000b27e0 0x7fe2000b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.539+0000 7fe2117fa640 1 -- 172.21.15.37:0/27357103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe1fc0e2650 con 0x7fe214102e80 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 -- 172.21.15.37:0/1417610944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 msgr2=0x55e68d9f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe2137fe640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2000b27e0 0x7fe2000b4cf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55e68d9f88e0 tx=0x7fe204005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68d9f7500 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe21406b5d0 tx=0x7fe20c009800 comp rx=0 tx=0).stop 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 -- 172.21.15.37:0/1417610944 shutdown_connections 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d6324d0 0x55e68d9fe980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d62a2f0 0x55e68d9f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 --2- 172.21.15.37:0/1417610944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68d9f7500 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 -- 172.21.15.37:0/1417610944 >> 172.21.15.37:0/1417610944 conn(0x55e68d647300 msgr2=0x55e68d9f2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 -- 172.21.15.37:0/1417610944 shutdown_connections 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 -- 172.21.15.37:0/1417610944 wait complete. 2024-05-09T01:14:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 -- start start 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.540+0000 7fe220a06740 1 Processor -- start 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe220a06740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da01300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe220a06740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da01840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe220a06740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68da087a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe220a06740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e68d9ff370 con 0x55e68d6531b0 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe220a06740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e68d8e29c0 con 0x55e68d6324d0 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe220a06740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e68d9ff4f0 con 0x55e68d62a2f0 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe220a06740 10 client.0 _ll_register_callbacks cb 0x55e68d90f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe213fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68da087a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe2137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da01300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe213fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68da087a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46016/0 (socket says 172.21.15.37:46016) 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe213fff640 1 -- 172.21.15.37:0/3338678385 learned_addr learned my addr 172.21.15.37:0/3338678385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe20bfff640 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da01840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe2137fe640 1 -- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 msgr2=0x55e68da01840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe2137fe640 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da01840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe2137fe640 1 -- 172.21.15.37:0/3338678385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 msgr2=0x55e68da087a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe2137fe640 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68da087a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe2137fe640 1 -- 172.21.15.37:0/3338678385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e68d9091f0 con 0x55e68d62a2f0 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe213fff640 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68da087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.541+0000 7fe2137fe640 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da01300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe204009810 tx=0x7fe204004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59992a6ec6fe7397 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe1f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/3338678385 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20402d060 con 0x55e68d62a2f0 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe20c036070 con 0x55e68d62a2f0 2024-05-09T01:14:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/3338678385 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe204018030 con 0x55e68d62a2f0 2024-05-09T01:14:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/3338678385 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fe204009840 con 0x55e68d62a2f0 2024-05-09T01:14:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe220a06740 10 client.27307 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55e68d6be790 con 0x55e68d62a2f0 2024-05-09T01:14:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/3338678385 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe20c036070 con 0x55e68d62a2f0 2024-05-09T01:14:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.542+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/3338678385 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fe204032070 con 0x55e68d62a2f0 2024-05-09T01:14:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.544+0000 7fe220a06740 10 client.27307 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.544+0000 7fe220a06740 10 client.27307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.544+0000 7fe220a06740 20 client.27307 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.544+0000 7fe220a06740 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d611d80 0x55e68da0ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.544+0000 7fe220a06740 4 client.27307 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.544+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e68d9693d0 con 0x55e68d611d80 2024-05-09T01:14:26.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.545+0000 7fe20bfff640 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d611d80 0x55e68da0ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.545+0000 7fe20bfff640 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d611d80 0x55e68da0ed30 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323db53519913727 server_cookie=635a27c45a6a78cf in_seq=0 out_seq=0 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.545+0000 7fe1f2ffd640 10 client.27307 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/3338678385 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e68d9693d0 con 0x55e68d611d80 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe1f2ffd640 10 client.27307 handle_command_reply: tid=0 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 client.27307 shutdown 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 msgr2=0x55e68da01300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da01300 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe204009810 tx=0x7fe204004730 comp rx=0 tx=0).stop 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 shutdown_connections 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d611d80 0x55e68da0ed30 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d6531b0 0x55e68da087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe1f2ffd640 0 client.27307 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da01840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 --2- 172.21.15.37:0/3338678385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da01300 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 >> 172.21.15.37:0/3338678385 conn(0x55e68d647300 msgr2=0x55e68d9f5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 shutdown_connections 2024-05-09T01:14:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.546+0000 7fe220a06740 1 -- 172.21.15.37:0/3338678385 wait complete. 2024-05-09T01:14:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.547+0000 7fe220a06740 20 client.27307 trim_cache size 0 max 16384 2024-05-09T01:14:26.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.572+0000 7fe220a06740 1 Processor -- start 2024-05-09T01:14:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.576+0000 7fe220a06740 1 -- start start 2024-05-09T01:14:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.576+0000 7fe220a06740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d647300 0x55e68da015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.576+0000 7fe220a06740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d62a2f0 0x55e68da08730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.576+0000 7fe220a06740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da13520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.576+0000 7fe220a06740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2141ad410 con 0x55e68d62a2f0 2024-05-09T01:14:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.576+0000 7fe220a06740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe2141af070 con 0x55e68d6324d0 2024-05-09T01:14:26.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.576+0000 7fe220a06740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2141adae0 con 0x55e68d647300 2024-05-09T01:14:26.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.580+0000 7fe20bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d62a2f0 0x55e68da08730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.580+0000 7fe20bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d62a2f0 0x55e68da08730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46018/0 (socket says 172.21.15.37:46018) 2024-05-09T01:14:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.580+0000 7fe20bfff640 1 -- 172.21.15.37:0/3251893554 learned_addr learned my addr 172.21.15.37:0/3251893554 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.581+0000 7fe213fff640 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da13520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.582+0000 7fe2137fe640 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d647300 0x55e68da015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.585+0000 7fe20bfff640 1 -- 172.21.15.37:0/3251893554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d647300 msgr2=0x55e68da015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.585+0000 7fe20bfff640 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d647300 0x55e68da015e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.585+0000 7fe20bfff640 1 -- 172.21.15.37:0/3251893554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 msgr2=0x55e68da13520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.585+0000 7fe20bfff640 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da13520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.585+0000 7fe20bfff640 1 -- 172.21.15.37:0/3251893554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e68d7355f0 con 0x55e68d62a2f0 2024-05-09T01:14:26.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.587+0000 7fe20bfff640 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d62a2f0 0x55e68da08730 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0a9ca0 tx=0x7fe1fc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec9be9662d8deb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.588+0000 7fe2097fa640 1 -- 172.21.15.37:0/3251893554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0a9820 con 0x55e68d62a2f0 2024-05-09T01:14:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.588+0000 7fe2097fa640 1 -- 172.21.15.37:0/3251893554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1fc005680 con 0x55e68d62a2f0 2024-05-09T01:14:26.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.588+0000 7fe2097fa640 1 -- 172.21.15.37:0/3251893554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0046c0 con 0x55e68d62a2f0 2024-05-09T01:14:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.589+0000 7fe220a06740 1 -- 172.21.15.37:0/3251893554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d62a2f0 msgr2=0x55e68da08730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.589+0000 7fe220a06740 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d62a2f0 0x55e68da08730 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0a9ca0 tx=0x7fe1fc009310 comp rx=0 tx=0).stop 2024-05-09T01:14:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.594+0000 7fe220a06740 1 -- 172.21.15.37:0/3251893554 shutdown_connections 2024-05-09T01:14:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.594+0000 7fe220a06740 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da13520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.594+0000 7fe220a06740 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d62a2f0 0x55e68da08730 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.594+0000 7fe220a06740 1 --2- 172.21.15.37:0/3251893554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d647300 0x55e68da015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.594+0000 7fe220a06740 1 -- 172.21.15.37:0/3251893554 >> 172.21.15.37:0/3251893554 conn(0x55e68d9fbf70 msgr2=0x55e68da00ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.594+0000 7fe220a06740 1 -- 172.21.15.37:0/3251893554 shutdown_connections 2024-05-09T01:14:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.594+0000 7fe220a06740 1 -- 172.21.15.37:0/3251893554 wait complete. 2024-05-09T01:14:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.595+0000 7fe220a06740 1 -- start start 2024-05-09T01:14:26.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.596+0000 7fe220a06740 1 Processor -- start 2024-05-09T01:14:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.596+0000 7fe220a06740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da05620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.596+0000 7fe220a06740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da05b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.596+0000 7fe2137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da05620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe2137fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da05620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33368/0 (socket says 172.21.15.37:33368) 2024-05-09T01:14:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe2137fe640 1 -- 172.21.15.37:0/2272184718 learned_addr learned my addr 172.21.15.37:0/2272184718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe20bfff640 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da05b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe220a06740 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d647300 0x55e68da750d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2141ae8e0 con 0x55e68d647300 2024-05-09T01:14:26.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe2141ae210 con 0x55e68d6324d0 2024-05-09T01:14:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2141ab3f0 con 0x55e68d62a2f0 2024-05-09T01:14:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.597+0000 7fe220a06740 10 client.0 _ll_register_callbacks cb 0x7fe204009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.598+0000 7fe2137fe640 1 -- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 msgr2=0x55e68da05b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.598+0000 7fe2137fe640 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da05b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.598+0000 7fe2137fe640 1 -- 172.21.15.37:0/2272184718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d647300 msgr2=0x55e68da750d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:26.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.598+0000 7fe2137fe640 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d647300 0x55e68da750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.598+0000 7fe2137fe640 1 -- 172.21.15.37:0/2272184718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e68d91fed0 con 0x55e68d62a2f0 2024-05-09T01:14:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.598+0000 7fe2137fe640 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da05620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe204004700 tx=0x7fe2040042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c11afe0aa1e5f14 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.598+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1fc005680 con 0x55e68d62a2f0 2024-05-09T01:14:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.599+0000 7fe1f2ffd640 10 client.27313 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.599+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2272184718 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204038030 con 0x55e68d62a2f0 2024-05-09T01:14:26.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.600+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2272184718 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fe20401d600 con 0x55e68d62a2f0 2024-05-09T01:14:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.604+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2272184718 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fe204009840 con 0x55e68d62a2f0 2024-05-09T01:14:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.604+0000 7fe220a06740 10 client.27313 fetch_fsmap learned FSMap version 47 2024-05-09T01:14:26.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.604+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=47}) -- 0x55e68da76400 con 0x55e68d62a2f0 2024-05-09T01:14:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.605+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2272184718 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 47) ==== 8378+0+0 (secure 0 0 0) 0x7fe204032040 con 0x55e68d62a2f0 2024-05-09T01:14:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.605+0000 7fe220a06740 10 client.27313 fetch_fsmap finished waiting for FSMap version 47 2024-05-09T01:14:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.605+0000 7fe220a06740 10 client.27313 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.605+0000 7fe220a06740 20 client.27313 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.605+0000 7fe220a06740 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d6531b0 0x55e68da78e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.605+0000 7fe220a06740 4 client.27313 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:14:26.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.605+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fe1fc005680 con 0x55e68d6531b0 2024-05-09T01:14:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.606+0000 7fe20bfff640 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d6531b0 0x55e68da78e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.606+0000 7fe20bfff640 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d6531b0 0x55e68da78e40 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f103d3ada070c202 server_cookie=f41cc41ec8b05a7f in_seq=0 out_seq=0 2024-05-09T01:14:26.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.606+0000 7fe1f2ffd640 10 client.27313 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.621+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2272184718 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7fe1fc005680 con 0x55e68d6531b0 2024-05-09T01:14:26.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.621+0000 7fe1f2ffd640 10 client.27313 handle_command_reply: tid=0 2024-05-09T01:14:26.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.621+0000 7fe220a06740 1 client.27313 shutdown 2024-05-09T01:14:26.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 msgr2=0x55e68da05620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da05620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe204004700 tx=0x7fe2040042f0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 shutdown_connections 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e68d6531b0 0x55e68da78e40 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e68d647300 0x55e68da750d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe1f2ffd640 0 client.27313 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e68d6324d0 0x55e68da05b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 --2- 172.21.15.37:0/2272184718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e68d62a2f0 0x55e68da05620 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 >> 172.21.15.37:0/2272184718 conn(0x55e68d9fbf70 msgr2=0x55e68d9f5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 shutdown_connections 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.622+0000 7fe220a06740 1 -- 172.21.15.37:0/2272184718 wait complete. 2024-05-09T01:14:26.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.623+0000 7fe220a06740 20 client.27313 trim_cache size 0 max 16384 2024-05-09T01:14:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:14:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:14:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:14:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.623+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2000b27e0 msgr2=0x7fe2000b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.623+0000 7fe219a7e640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2000b27e0 0x7fe2000b4cf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55e68d9f88e0 tx=0x7fe204005f90 comp rx=0 tx=0).stop 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.623+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe214102e80 msgr2=0x7fe21419ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.623+0000 7fe219a7e640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe214102e80 0x7fe21419ca60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00e9f0 tx=0x7fe1fc00edf0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 shutdown_connections 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2141037d0 0x7fe2141a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe214102e80 0x7fe21419ca60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fe2000b27e0 0x7fe2000b4cf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 --2- 172.21.15.37:0/27357103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe214102530 0x7fe21419c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 >> 172.21.15.37:0/27357103 conn(0x7fe2140fdd40 msgr2=0x7fe21410a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 shutdown_connections 2024-05-09T01:14:26.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:26.624+0000 7fe219a7e640 1 -- 172.21.15.37:0/27357103 wait complete. 2024-05-09T01:14:26.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:26 smithi136 ceph-mon[34110]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 585 op/s 2024-05-09T01:14:26.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:26 smithi037 ceph-mon[30122]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 585 op/s 2024-05-09T01:14:26.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:26 smithi151 ceph-mon[34780]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 585 op/s 2024-05-09T01:14:27.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:14:27.529 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:28.838 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:28 smithi037 ceph-mon[30122]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-05-09T01:14:28.838 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:28 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:14:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:28 smithi136 ceph-mon[34110]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-05-09T01:14:28.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:28 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:14:28.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:28 smithi151 ceph-mon[34780]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-05-09T01:14:28.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:28 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:14:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.598+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/2271187350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103270 msgr2=0x7f3b44103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.598+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/2271187350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103270 0x7f3b44103680 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009990 tx=0x7f3b34009ca0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.599+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/2271187350 shutdown_connections 2024-05-09T01:14:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.599+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/2271187350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b441086c0 0x7f3b44108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.599+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/2271187350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103270 0x7f3b44103680 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.599+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/2271187350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b44103bc0 0x7f3b441080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.599+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/2271187350 >> 172.21.15.37:0/2271187350 conn(0x7f3b440fef30 msgr2=0x7f3b44101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.602+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/2271187350 shutdown_connections 2024-05-09T01:14:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.602+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/2271187350 wait complete. 2024-05-09T01:14:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.603+0000 7f3b4c5a5700 1 Processor -- start 2024-05-09T01:14:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.607+0000 7f3b4c5a5700 1 -- start start 2024-05-09T01:14:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4c5a5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b44103270 0x7f3b44111b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4c5a5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103bc0 0x7f3b44112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4c5a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b441086c0 0x7f3b441125c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4c5a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44109fc0 con 0x7f3b441086c0 2024-05-09T01:14:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4c5a5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44109e40 con 0x7f3b44103bc0 2024-05-09T01:14:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4c5a5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4410a140 con 0x7f3b44103270 2024-05-09T01:14:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b49b40700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103bc0 0x7f3b44112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4a341700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b44103270 0x7f3b44111b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4a341700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b44103270 0x7f3b44111b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33380/0 (socket says 172.21.15.37:33380) 2024-05-09T01:14:29.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.608+0000 7f3b4a341700 1 -- 172.21.15.37:0/3830164200 learned_addr learned my addr 172.21.15.37:0/3830164200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:29.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.609+0000 7f3b4a341700 1 -- 172.21.15.37:0/3830164200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103bc0 msgr2=0x7f3b44112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.609+0000 7f3b4a341700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103bc0 0x7f3b44112080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.609+0000 7f3b4a341700 1 -- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b441086c0 msgr2=0x7f3b441125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.609+0000 7f3b4a341700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b441086c0 0x7f3b441125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.609+0000 7f3b4a341700 1 -- 172.21.15.37:0/3830164200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b441b6070 con 0x7f3b44103270 2024-05-09T01:14:29.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.609+0000 7f3b4a341700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b44103270 0x7f3b44111b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b340057c0 tx=0x7f3b340057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:29.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.611+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/3830164200 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34026070 con 0x7f3b44103270 2024-05-09T01:14:29.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.611+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/3830164200 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b34004080 con 0x7f3b44103270 2024-05-09T01:14:29.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.613+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/3830164200 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3400fdc0 con 0x7f3b44103270 2024-05-09T01:14:29.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.613+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b441b6240 con 0x7f3b44103270 2024-05-09T01:14:29.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.613+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b441b6640 con 0x7f3b44103270 2024-05-09T01:14:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.617+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/3830164200 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3b34005290 con 0x7f3b44103270 2024-05-09T01:14:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.619+0000 7f3b3b7fe700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b27e0 0x7f3b300b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.619+0000 7f3b3b7fe700 1 -- 172.21.15.37:0/3830164200 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3b340e2ce0 con 0x7f3b44103270 2024-05-09T01:14:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.620+0000 7f3b49b40700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b27e0 0x7f3b300b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.621+0000 7f3b49b40700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b27e0 0x7f3b300b4cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3b44108bb0 tx=0x7f3b40009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:29.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.627+0000 7f3b5afbbb80 1 Processor -- start 2024-05-09T01:14:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b5afbbb80 1 -- start start 2024-05-09T01:14:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbcff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbcf96a0 0x563dcbcf9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563dcbc1bff0 con 0x563dcbcf96a0 2024-05-09T01:14:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563dcbbba7f0 con 0x563dcbb7c4a0 2024-05-09T01:14:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563dcbc17fb0 con 0x563dcbc66160 2024-05-09T01:14:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b49b40700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b4a341700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbcff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b49b40700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcffa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40254/0 (socket says 172.21.15.37:40254) 2024-05-09T01:14:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.631+0000 7f3b49b40700 1 -- 172.21.15.37:0/4119188761 learned_addr learned my addr 172.21.15.37:0/4119188761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.632+0000 7f3b4ab42700 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbcf96a0 0x563dcbcf9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.632+0000 7f3b49b40700 1 -- 172.21.15.37:0/4119188761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 msgr2=0x563dcbcff4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:29.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.632+0000 7f3b49b40700 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbcff4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.632+0000 7f3b49b40700 1 -- 172.21.15.37:0/4119188761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbcf96a0 msgr2=0x563dcbcf9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.632+0000 7f3b49b40700 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbcf96a0 0x563dcbcf9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.632+0000 7f3b49b40700 1 -- 172.21.15.37:0/4119188761 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dcbbb2370 con 0x563dcbb7c4a0 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.632+0000 7f3b49b40700 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcffa30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000e9f0 tx=0x7f3b40011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a8d293708e5bdd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.633+0000 7f3b38ff9700 1 -- 172.21.15.37:0/4119188761 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4001b040 con 0x563dcbb7c4a0 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.633+0000 7f3b38ff9700 1 -- 172.21.15.37:0/4119188761 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b40024070 con 0x563dcbb7c4a0 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.633+0000 7f3b38ff9700 1 -- 172.21.15.37:0/4119188761 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40013810 con 0x563dcbb7c4a0 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.634+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4119188761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 msgr2=0x563dcbcffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.634+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcffa30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000e9f0 tx=0x7f3b40011000 comp rx=0 tx=0).stop 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.635+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4119188761 shutdown_connections 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.635+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbcf96a0 0x563dcbcf9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.635+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbcff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.635+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4119188761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcffa30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.635+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4119188761 >> 172.21.15.37:0/4119188761 conn(0x563dcbbdc6a0 msgr2=0x563dcbcf4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.635+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4119188761 shutdown_connections 2024-05-09T01:14:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.635+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4119188761 wait complete. 2024-05-09T01:14:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 -- start start 2024-05-09T01:14:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 Processor -- start 2024-05-09T01:14:29.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd03140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd03680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd03bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563dcba97ba0 con 0x563dcbb7c4a0 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x563dcbbd6150 con 0x563dcbcf96a0 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.636+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563dcbd061d0 con 0x563dcbc66160 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b5afbbb80 10 client.0 _ll_register_callbacks cb 0x563dcba8d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd03bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd03bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:40268/0 (socket says 172.21.15.37:40268) 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 -- 172.21.15.37:0/4112739202 learned_addr learned my addr 172.21.15.37:0/4112739202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4a341700 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd03140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 -- 172.21.15.37:0/4112739202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 msgr2=0x563dcbd03680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd03680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 -- 172.21.15.37:0/4112739202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 msgr2=0x563dcbd03140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd03140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 -- 172.21.15.37:0/4112739202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dcba97490 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.637+0000 7f3b4ab42700 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd03bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c540 tx=0x7f3b3c00c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be46f7a3513f1021 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.638+0000 7f3b2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.638+0000 7f3b2dffb700 1 -- 172.21.15.37:0/4112739202 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c037020 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.638+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b40024070 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.638+0000 7f3b2dffb700 1 -- 172.21.15.37:0/4112739202 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3b3c033610 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.639+0000 7f3b2dffb700 1 -- 172.21.15.37:0/4112739202 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c033810 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.639+0000 7f3b5afbbb80 10 client.27353 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.639+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x563dcbd10c90 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.639+0000 7f3b2dffb700 1 -- 172.21.15.37:0/4112739202 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b40024070 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b2dffb700 1 -- 172.21.15.37:0/4112739202 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7f3b3c03ebd0 con 0x563dcbcf96a0 2024-05-09T01:14:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b5afbbb80 10 client.27353 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b5afbbb80 10 client.27353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b5afbbb80 20 client.27353 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd15b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b5afbbb80 4 client.27353 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dcbc299d0 con 0x563dcbd13700 2024-05-09T01:14:29.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.640+0000 7f3b4a341700 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd15b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.641+0000 7f3b4a341700 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd15b90 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7d018ccdedb801e server_cookie=deb626cb1684ce43 in_seq=0 out_seq=0 2024-05-09T01:14:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.641+0000 7f3b2dffb700 10 client.27353 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b2dffb700 1 -- 172.21.15.37:0/4112739202 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563dcbc299d0 con 0x563dcbd13700 2024-05-09T01:14:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b2dffb700 10 client.27353 handle_command_reply: tid=0 2024-05-09T01:14:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 client.27353 shutdown 2024-05-09T01:14:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 msgr2=0x563dcbd03bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd03bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c540 tx=0x7f3b3c00c900 comp rx=0 tx=0).stop 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 shutdown_connections 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd15b90 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd03bc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd03140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b2dffb700 0 client.27353 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/4112739202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd03680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.643+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 >> 172.21.15.37:0/4112739202 conn(0x563dcbbdc6a0 msgr2=0x563dcbcf41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.644+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 shutdown_connections 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.644+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/4112739202 wait complete. 2024-05-09T01:14:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.644+0000 7f3b5afbbb80 20 client.27353 trim_cache size 0 max 16384 2024-05-09T01:14:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 Processor -- start 2024-05-09T01:14:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 -- start start 2024-05-09T01:14:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcfe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbc66160 0x563dcbd0f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbcf96a0 0x563dcbcfce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b441210a0 con 0x563dcbc66160 2024-05-09T01:14:29.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b49b40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbc66160 0x563dcbd0f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44122c70 con 0x563dcbb7c4a0 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44121770 con 0x563dcbcf96a0 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b49b40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbc66160 0x563dcbd0f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46064/0 (socket says 172.21.15.37:46064) 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b49b40700 1 -- 172.21.15.37:0/3359819509 learned_addr learned my addr 172.21.15.37:0/3359819509 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.668+0000 7f3b4a341700 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcfe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4ab42700 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbcf96a0 0x563dcbcfce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4a341700 1 -- 172.21.15.37:0/3359819509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbcf96a0 msgr2=0x563dcbcfce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:29.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4a341700 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbcf96a0 0x563dcbcfce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4a341700 1 -- 172.21.15.37:0/3359819509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbc66160 msgr2=0x563dcbd0f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4a341700 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbc66160 0x563dcbd0f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4a341700 1 -- 172.21.15.37:0/3359819509 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dcbd10aa0 con 0x563dcbb7c4a0 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4ab42700 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbcf96a0 0x563dcbcfce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b4a341700 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcfe940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3b340e08d0 tx=0x7f3b340e0750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4be34c1cbfa7ea2d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b2ffff700 1 -- 172.21.15.37:0/3359819509 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b340b3200 con 0x563dcbb7c4a0 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b2ffff700 1 -- 172.21.15.37:0/3359819509 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b340c3070 con 0x563dcbb7c4a0 2024-05-09T01:14:29.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.669+0000 7f3b2ffff700 1 -- 172.21.15.37:0/3359819509 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b34003bd0 con 0x563dcbb7c4a0 2024-05-09T01:14:29.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.671+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/3359819509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 msgr2=0x563dcbcfe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.671+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcfe940 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3b340e08d0 tx=0x7f3b340e0750 comp rx=0 tx=0).stop 2024-05-09T01:14:29.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/3359819509 shutdown_connections 2024-05-09T01:14:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbcf96a0 0x563dcbcfce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbb7c4a0 0x563dcbcfe940 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/3359819509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbc66160 0x563dcbd0f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/3359819509 >> 172.21.15.37:0/3359819509 conn(0x563dcbbdc6a0 msgr2=0x563dcbcfe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/3359819509 shutdown_connections 2024-05-09T01:14:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/3359819509 wait complete. 2024-05-09T01:14:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 -- start start 2024-05-09T01:14:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.673+0000 7f3b5afbbb80 1 Processor -- start 2024-05-09T01:14:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.674+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd0b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.674+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd0b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.674+0000 7f3b5afbbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd1a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.674+0000 7f3b4a341700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd0b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.674+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44122570 con 0x563dcbb7c4a0 2024-05-09T01:14:29.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.674+0000 7f3b49b40700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd0b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.674+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b44121ea0 con 0x563dcbcf96a0 2024-05-09T01:14:29.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b5afbbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4411f0c0 con 0x563dcbc66160 2024-05-09T01:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd0b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33406/0 (socket says 172.21.15.37:33406) 2024-05-09T01:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 -- 172.21.15.37:0/1272775022 learned_addr learned my addr 172.21.15.37:0/1272775022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b5afbbb80 10 client.0 _ll_register_callbacks cb 0x563dcbd16280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 -- 172.21.15.37:0/1272775022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 msgr2=0x563dcbd1a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd1a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 -- 172.21.15.37:0/1272775022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 msgr2=0x563dcbd0b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd0b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 -- 172.21.15.37:0/1272775022 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dcbd1a8f0 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.675+0000 7f3b49b40700 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd0b960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x563dcbcf5ed0 tx=0x7f3b400045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676b4601c9d6b342 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.676+0000 7f3b2dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.676+0000 7f3b2dffb700 1 -- 172.21.15.37:0/1272775022 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b40003b50 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.676+0000 7f3b2dffb700 1 -- 172.21.15.37:0/1272775022 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3b40003cf0 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.676+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b340c3070 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.676+0000 7f3b2dffb700 1 -- 172.21.15.37:0/1272775022 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f3b40009680 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.676+0000 7f3b5afbbb80 10 client.27322 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.676+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x563dcbd7d650 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b2dffb700 1 -- 172.21.15.37:0/1272775022 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b340c3070 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b2dffb700 1 -- 172.21.15.37:0/1272775022 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7f3b4001e030 con 0x563dcbc66160 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b5afbbb80 10 client.27322 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b5afbbb80 10 client.27322 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b5afbbb80 20 client.27322 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd7fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b5afbbb80 4 client.27322 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563dcbc23a70 con 0x563dcbd13700 2024-05-09T01:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.677+0000 7f3b4a341700 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd7fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.678+0000 7f3b4a341700 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd7fb60 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47ba39d5876e4863 server_cookie=1ceaf03c94da504 in_seq=0 out_seq=0 2024-05-09T01:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.678+0000 7f3b2dffb700 10 client.27322 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.678+0000 7f3b2dffb700 1 -- 172.21.15.37:0/1272775022 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563dcbc23a70 con 0x563dcbd13700 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.678+0000 7f3b2dffb700 10 client.27322 handle_command_reply: tid=0 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.678+0000 7f3b5afbbb80 1 client.27322 shutdown 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.679+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 msgr2=0x563dcbd0b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.679+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd0b960 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x563dcbcf5ed0 tx=0x7f3b400045f0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.679+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 shutdown_connections 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x563dcbd13700 0x563dcbd7fb60 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563dcbcf96a0 0x563dcbd1a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563dcbb7c4a0 0x563dcbd0b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b2dffb700 0 client.27322 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 1 --2- 172.21.15.37:0/1272775022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dcbc66160 0x563dcbd0b960 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 >> 172.21.15.37:0/1272775022 conn(0x563dcbbdc6a0 msgr2=0x563dcbcf8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 shutdown_connections 2024-05-09T01:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 1 -- 172.21.15.37:0/1272775022 wait complete. 2024-05-09T01:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.680+0000 7f3b5afbbb80 20 client.27322 trim_cache size 0 max 16384 2024-05-09T01:14:29.688 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:14:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b27e0 msgr2=0x7f3b300b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b27e0 0x7f3b300b4cf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3b44108bb0 tx=0x7f3b40009190 comp rx=0 tx=0).stop 2024-05-09T01:14:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b44103270 msgr2=0x7f3b44111b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b44103270 0x7f3b44111b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3b340057c0 tx=0x7f3b340057f0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 shutdown_connections 2024-05-09T01:14:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3b300b27e0 0x7f3b300b4cf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b441086c0 0x7f3b441125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b44103270 0x7f3b44111b40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 --2- 172.21.15.37:0/3830164200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44103bc0 0x7f3b44112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.681+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 >> 172.21.15.37:0/3830164200 conn(0x7f3b440fef30 msgr2=0x7f3b441060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.682+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 shutdown_connections 2024-05-09T01:14:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:29.682+0000 7f3b4c5a5700 1 -- 172.21.15.37:0/3830164200 wait complete. 2024-05-09T01:14:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 730.0 s, 2610.6 tps, lat 38.242 ms stddev 48.635 2024-05-09T01:14:30.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:30 smithi136 ceph-mon[34110]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 644 op/s 2024-05-09T01:14:30.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:30 smithi037 ceph-mon[30122]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 644 op/s 2024-05-09T01:14:30.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:30 smithi151 ceph-mon[34780]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.3 MiB/s wr, 644 op/s 2024-05-09T01:14:31.693 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:14:31.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:14:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:32.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:32 smithi037 ceph-mon[30122]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 661 op/s 2024-05-09T01:14:32.776 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:32 smithi151 ceph-mon[34780]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 661 op/s 2024-05-09T01:14:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:32 smithi136 ceph-mon[34110]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 661 op/s 2024-05-09T01:14:34.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.403+0000 7f0afba3c700 1 -- 172.21.15.37:0/2810876842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 msgr2=0x7f0af4103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.403+0000 7f0afba3c700 1 --2- 172.21.15.37:0/2810876842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 0x7f0af4103960 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f0af00099c0 tx=0x7f0af0009cd0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.404+0000 7f0afba3c700 1 -- 172.21.15.37:0/2810876842 shutdown_connections 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.404+0000 7f0afba3c700 1 --2- 172.21.15.37:0/2810876842 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0af4108780 0x7f0af41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.404+0000 7f0afba3c700 1 --2- 172.21.15.37:0/2810876842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 0x7f0af4103960 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.404+0000 7f0afba3c700 1 --2- 172.21.15.37:0/2810876842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af4107e30 0x7f0af4108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.404+0000 7f0afba3c700 1 -- 172.21.15.37:0/2810876842 >> 172.21.15.37:0/2810876842 conn(0x7f0af4078e00 msgr2=0x7f0af4079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.404+0000 7f0afba3c700 1 -- 172.21.15.37:0/2810876842 shutdown_connections 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.404+0000 7f0afba3c700 1 -- 172.21.15.37:0/2810876842 wait complete. 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.405+0000 7f0afba3c700 1 Processor -- start 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.405+0000 7f0afba3c700 1 -- start start 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.405+0000 7f0afba3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 0x7f0af419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.405+0000 7f0afba3c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af4107e30 0x7f0af419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.405+0000 7f0afba3c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0af4108780 0x7f0af419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 0x7f0af419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0afba3c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0af41133b0 con 0x7f0af4103550 2024-05-09T01:14:34.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 0x7f0af419bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39092/0 (socket says 172.21.15.37:39092) 2024-05-09T01:14:34.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af97d8700 1 -- 172.21.15.37:0/1334830848 learned_addr learned my addr 172.21.15.37:0/1334830848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:34.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af9fd9700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0af4108780 0x7f0af419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af4107e30 0x7f0af419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0af4113230 con 0x7f0af4108780 2024-05-09T01:14:34.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0af4113530 con 0x7f0af4107e30 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af9fd9700 1 -- 172.21.15.37:0/1334830848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af4107e30 msgr2=0x7f0af419c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af9fd9700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af4107e30 0x7f0af419c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af9fd9700 1 -- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 msgr2=0x7f0af419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af9fd9700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 0x7f0af419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.406+0000 7f0af9fd9700 1 -- 172.21.15.37:0/1334830848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af41a6fc0 con 0x7f0af4108780 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.407+0000 7f0af9fd9700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0af4108780 0x7f0af419c710 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00efc0 tx=0x7f0aec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.407+0000 7f0aea7fc700 1 -- 172.21.15.37:0/1334830848 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec004bb0 con 0x7f0af4108780 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.407+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af4199ac0 con 0x7f0af4108780 2024-05-09T01:14:34.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.407+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af419a000 con 0x7f0af4108780 2024-05-09T01:14:34.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.407+0000 7f0aea7fc700 1 -- 172.21.15.37:0/1334830848 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aec004d50 con 0x7f0af4108780 2024-05-09T01:14:34.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.407+0000 7f0aea7fc700 1 -- 172.21.15.37:0/1334830848 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec004280 con 0x7f0af4108780 2024-05-09T01:14:34.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 Processor -- start 2024-05-09T01:14:34.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0aea7fc700 1 -- 172.21.15.37:0/1334830848 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0aec0044e0 con 0x7f0af4108780 2024-05-09T01:14:34.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 -- start start 2024-05-09T01:14:34.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a68dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a69300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a63340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55770797d070 con 0x5577078dd520 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55770791b870 con 0x557707a62f30 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.413+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557707979030 con 0x5577079c71e0 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a69300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a69300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39102/0 (socket says 172.21.15.37:39102) 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af97d8700 1 -- 172.21.15.37:0/883742659 learned_addr learned my addr 172.21.15.37:0/883742659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a68dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a63340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af8fd7700 1 -- 172.21.15.37:0/883742659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 msgr2=0x557707a63340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a63340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af8fd7700 1 -- 172.21.15.37:0/883742659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 msgr2=0x557707a69300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a69300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.414+0000 7f0af8fd7700 1 -- 172.21.15.37:0/883742659 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577079133f0 con 0x5577079c71e0 2024-05-09T01:14:34.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.415+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a68dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0af40793a0 tx=0x7f0ae4009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c930e8bb2f3e55ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:34.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.415+0000 7f0aea7fc700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ae00b2900 0x7f0ae00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.415+0000 7f0adf7fe700 1 -- 172.21.15.37:0/883742659 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4011e60 con 0x5577079c71e0 2024-05-09T01:14:34.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.415+0000 7f0adf7fe700 1 -- 172.21.15.37:0/883742659 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ae4004500 con 0x5577079c71e0 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.415+0000 7f0adf7fe700 1 -- 172.21.15.37:0/883742659 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4005280 con 0x5577079c71e0 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.415+0000 7f0aea7fc700 1 -- 172.21.15.37:0/1334830848 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0aec0e5970 con 0x7f0af4108780 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.416+0000 7f0b0a452b80 1 -- 172.21.15.37:0/883742659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 msgr2=0x557707a68dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.416+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a68dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0af40793a0 tx=0x7f0ae4009750 comp rx=0 tx=0).stop 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.416+0000 7f0b0a452b80 1 -- 172.21.15.37:0/883742659 shutdown_connections 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.416+0000 7f0af97d8700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ae00b2900 0x7f0ae00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.416+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a63340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.416+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a68dc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.416+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/883742659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a69300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.417+0000 7f0b0a452b80 1 -- 172.21.15.37:0/883742659 >> 172.21.15.37:0/883742659 conn(0x55770793d720 msgr2=0x557707a55480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.417+0000 7f0b0a452b80 1 -- 172.21.15.37:0/883742659 shutdown_connections 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.417+0000 7f0b0a452b80 1 -- 172.21.15.37:0/883742659 wait complete. 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.417+0000 7f0b0a452b80 1 -- start start 2024-05-09T01:14:34.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.417+0000 7f0b0a452b80 1 Processor -- start 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0af97d8700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ae00b2900 0x7f0ae00b4e10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009990 tx=0x7f0af001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577078dd520 0x557707a6cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577079c71e0 0x557707a6d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5577077f8c20 con 0x5577079c71e0 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5577079371d0 con 0x557707a62f30 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557707a63d00 con 0x5577078dd520 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0b0a452b80 10 client.0 _ll_register_callbacks cb 0x5577077ee740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577078dd520 0x557707a6cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577078dd520 0x557707a6cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46852/0 (socket says 172.21.15.37:46852) 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.418+0000 7f0af97d8700 1 -- 172.21.15.37:0/75456483 learned_addr learned my addr 172.21.15.37:0/75456483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af9fd9700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577079c71e0 0x557707a6d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af97d8700 1 -- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 msgr2=0x557707a6d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af97d8700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af97d8700 1 -- 172.21.15.37:0/75456483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577079c71e0 msgr2=0x557707a6d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af97d8700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577079c71e0 0x557707a6d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af97d8700 1 -- 172.21.15.37:0/75456483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577077f8510 con 0x5577078dd520 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577079c71e0 0x557707a6d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0af97d8700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577078dd520 0x557707a6cb40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005910 tx=0x7f0af0005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cba01b19ca29433a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0adcff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0adcff9700 1 -- 172.21.15.37:0/75456483 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000b9a0 con 0x5577078dd520 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.419+0000 7f0adcff9700 1 -- 172.21.15.37:0/75456483 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0af000bb40 con 0x5577078dd520 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ae4004500 con 0x5577078dd520 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0adcff9700 1 -- 172.21.15.37:0/75456483 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0af000bd40 con 0x5577078dd520 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 10 client.27334 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557707a7a4a0 con 0x5577078dd520 2024-05-09T01:14:34.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0adcff9700 1 -- 172.21.15.37:0/75456483 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ae4004500 con 0x5577078dd520 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0adcff9700 1 -- 172.21.15.37:0/75456483 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7f0af000f460 con 0x5577078dd520 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 10 client.27334 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 10 client.27334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 20 client.27334 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707a7cae0 0x557707a7ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 4 client.27334 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.420+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55770798aa50 con 0x557707a7cae0 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.421+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707a7cae0 0x557707a7ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.421+0000 7f0adcff9700 10 client.27334 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:34.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.421+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707a7cae0 0x557707a7ef00 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e01bace5f17d22da server_cookie=4302a593b97fa278 in_seq=0 out_seq=0 2024-05-09T01:14:34.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.423+0000 7f0adcff9700 1 -- 172.21.15.37:0/75456483 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55770798aa50 con 0x557707a7cae0 2024-05-09T01:14:34.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.423+0000 7f0adcff9700 10 client.27334 handle_command_reply: tid=0 2024-05-09T01:14:34.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.423+0000 7f0b0a452b80 1 client.27334 shutdown 2024-05-09T01:14:34.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577078dd520 msgr2=0x557707a6cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577078dd520 0x557707a6cb40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005910 tx=0x7f0af0005040 comp rx=0 tx=0).stop 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 shutdown_connections 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707a7cae0 0x557707a7ef00 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577078dd520 0x557707a6cb40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/75456483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577079c71e0 0x557707a6d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0adcff9700 0 client.27334 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 >> 172.21.15.37:0/75456483 conn(0x55770793d720 msgr2=0x557707a55240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 shutdown_connections 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.424+0000 7f0b0a452b80 1 -- 172.21.15.37:0/75456483 wait complete. 2024-05-09T01:14:34.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.425+0000 7f0b0a452b80 20 client.27334 trim_cache size 0 max 16384 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.453+0000 7f0b0a452b80 1 Processor -- start 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.453+0000 7f0b0a452b80 1 -- start start 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a67150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a6d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad800d230 con 0x5577078dd520 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad800ee00 con 0x557707a62f30 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0b0a452b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad800d900 con 0x5577079c71e0 2024-05-09T01:14:34.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a67150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a67150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39130/0 (socket says 172.21.15.37:39130) 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0af97d8700 1 -- 172.21.15.37:0/2895819740 learned_addr learned my addr 172.21.15.37:0/2895819740 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a6d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.454+0000 7f0af9fd9700 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.455+0000 7f0af97d8700 1 -- 172.21.15.37:0/2895819740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 msgr2=0x557707a6d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.455+0000 7f0af97d8700 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a6d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.455+0000 7f0af97d8700 1 -- 172.21.15.37:0/2895819740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 msgr2=0x557707a6eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.455+0000 7f0af97d8700 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.455+0000 7f0af97d8700 1 -- 172.21.15.37:0/2895819740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557707a4efe0 con 0x5577078dd520 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.458+0000 7f0af97d8700 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a67150 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c00 tx=0x7f0af000b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517a164c86b4f1c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:34.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.458+0000 7f0adeffd700 1 -- 172.21.15.37:0/2895819740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0005940 con 0x5577078dd520 2024-05-09T01:14:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.458+0000 7f0adeffd700 1 -- 172.21.15.37:0/2895819740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af000b9a0 con 0x5577078dd520 2024-05-09T01:14:34.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.458+0000 7f0adeffd700 1 -- 172.21.15.37:0/2895819740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0032b30 con 0x5577078dd520 2024-05-09T01:14:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.459+0000 7f0b0a452b80 1 -- 172.21.15.37:0/2895819740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 msgr2=0x557707a67150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.459+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a67150 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c00 tx=0x7f0af000b5e0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.460+0000 7f0b0a452b80 1 -- 172.21.15.37:0/2895819740 shutdown_connections 2024-05-09T01:14:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.460+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557707a62f30 0x557707a6eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.460+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5577078dd520 0x557707a67150 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.460+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/2895819740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a6d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.460+0000 7f0b0a452b80 1 -- 172.21.15.37:0/2895819740 >> 172.21.15.37:0/2895819740 conn(0x55770793d720 msgr2=0x557707a59d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.464+0000 7f0b0a452b80 1 -- 172.21.15.37:0/2895819740 shutdown_connections 2024-05-09T01:14:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.464+0000 7f0b0a452b80 1 -- 172.21.15.37:0/2895819740 wait complete. 2024-05-09T01:14:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.464+0000 7f0b0a452b80 1 -- start start 2024-05-09T01:14:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.464+0000 7f0b0a452b80 1 Processor -- start 2024-05-09T01:14:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.465+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577078dd520 0x557707a71bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.465+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a72110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.465+0000 7f0b0a452b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557707a62f30 0x557707a72650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.465+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577078dd520 0x557707a71bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.466+0000 7f0af97d8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577078dd520 0x557707a71bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39640/0 (socket says 172.21.15.37:39640) 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.466+0000 7f0af97d8700 1 -- 172.21.15.37:0/322609406 learned_addr learned my addr 172.21.15.37:0/322609406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.466+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a72110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.466+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad800e700 con 0x557707a62f30 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.466+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad800e030 con 0x5577078dd520 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.466+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad800b1d0 con 0x5577079c71e0 2024-05-09T01:14:34.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.466+0000 7f0b0a452b80 10 client.0 _ll_register_callbacks cb 0x5577077ee740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.467+0000 7f0af97d8700 1 -- 172.21.15.37:0/322609406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 msgr2=0x557707a72110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.467+0000 7f0af97d8700 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a72110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.467+0000 7f0af97d8700 1 -- 172.21.15.37:0/322609406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557707a62f30 msgr2=0x557707a72650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.467+0000 7f0af97d8700 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557707a62f30 0x557707a72650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.467+0000 7f0af97d8700 1 -- 172.21.15.37:0/322609406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557707a75680 con 0x5577078dd520 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.470+0000 7f0af97d8700 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577078dd520 0x557707a71bd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0af000f990 tx=0x7f0af00036a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7336274e044d2a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.470+0000 7f0adcff9700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:14:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.470+0000 7f0adcff9700 1 -- 172.21.15.37:0/322609406 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0067450 con 0x5577078dd520 2024-05-09T01:14:34.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.471+0000 7f0adcff9700 1 -- 172.21.15.37:0/322609406 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0af00675f0 con 0x5577078dd520 2024-05-09T01:14:34.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.471+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af000b9a0 con 0x5577078dd520 2024-05-09T01:14:34.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.471+0000 7f0adcff9700 1 -- 172.21.15.37:0/322609406 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0af0067830 con 0x5577078dd520 2024-05-09T01:14:34.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.472+0000 7f0b0a452b80 10 client.27374 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.472+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557707adf230 con 0x5577078dd520 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.474+0000 7f0adcff9700 1 -- 172.21.15.37:0/322609406 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af0071420 con 0x5577078dd520 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.475+0000 7f0adcff9700 1 -- 172.21.15.37:0/322609406 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7f0af0032420 con 0x5577078dd520 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.475+0000 7f0b0a452b80 10 client.27374 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.475+0000 7f0b0a452b80 10 client.27374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.475+0000 7f0b0a452b80 20 client.27374 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.475+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707adf800 0x557707ae1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.475+0000 7f0b0a452b80 4 client.27374 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:14:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.475+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f0af000b9a0 con 0x557707adf800 2024-05-09T01:14:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.480+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707adf800 0x557707ae1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.481+0000 7f0adcff9700 10 client.27374 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.481+0000 7f0af8fd7700 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707adf800 0x557707ae1c20 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=694ac5f6b2ec1100 server_cookie=f706e3706e641f8b in_seq=0 out_seq=0 2024-05-09T01:14:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.488+0000 7f0adcff9700 1 -- 172.21.15.37:0/322609406 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f0af000b9a0 con 0x557707adf800 2024-05-09T01:14:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.488+0000 7f0adcff9700 10 client.27374 handle_command_reply: tid=0 2024-05-09T01:14:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.488+0000 7f0b0a452b80 1 client.27374 shutdown 2024-05-09T01:14:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.488+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577078dd520 msgr2=0x557707a71bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.488+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577078dd520 0x557707a71bd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0af000f990 tx=0x7f0af00036a0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.492+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 shutdown_connections 2024-05-09T01:14:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.492+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557707adf800 0x557707ae1c20 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.492+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557707a62f30 0x557707a72650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.492+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5577078dd520 0x557707a71bd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.492+0000 7f0b0a452b80 1 --2- 172.21.15.37:0/322609406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577079c71e0 0x557707a72110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.492+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 >> 172.21.15.37:0/322609406 conn(0x55770793d720 msgr2=0x557707a55390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.492+0000 7f0adcff9700 0 client.27374 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.494+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 shutdown_connections 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.494+0000 7f0b0a452b80 1 -- 172.21.15.37:0/322609406 wait complete. 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.495+0000 7f0b0a452b80 20 client.27374 trim_cache size 0 max 16384 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "94f419de-be66-4803-9f1f-420a17ea6a53", 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:14:34.499 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.496+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ae00b2900 msgr2=0x7f0ae00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.497+0000 7f0afba3c700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ae00b2900 0x7f0ae00b4e10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009990 tx=0x7f0af001a040 comp rx=0 tx=0).stop 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.497+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0af4108780 msgr2=0x7f0af419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.497+0000 7f0afba3c700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0af4108780 0x7f0af419c710 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00efc0 tx=0x7f0aec00c3a0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.498+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 shutdown_connections 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.498+0000 7f0afba3c700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f0ae00b2900 0x7f0ae00b4e10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.498+0000 7f0afba3c700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0af4108780 0x7f0af419c710 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.498+0000 7f0afba3c700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af4103550 0x7f0af419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.498+0000 7f0afba3c700 1 --2- 172.21.15.37:0/1334830848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af4107e30 0x7f0af419c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:34.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.498+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 >> 172.21.15.37:0/1334830848 conn(0x7f0af4078e00 msgr2=0x7f0af4101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:34.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.500+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 shutdown_connections 2024-05-09T01:14:34.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:34.500+0000 7f0afba3c700 1 -- 172.21.15.37:0/1334830848 wait complete. 2024-05-09T01:14:34.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:34 smithi037 ceph-mon[30122]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 612 op/s 2024-05-09T01:14:34.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:34 smithi136 ceph-mon[34110]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 612 op/s 2024-05-09T01:14:34.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:34 smithi151 ceph-mon[34780]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 612 op/s 2024-05-09T01:14:35.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:14:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 735.0 s, 2644.8 tps, lat 37.536 ms stddev 49.393 2024-05-09T01:14:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:14:35.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:14:35.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:14:35.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:35 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.945 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.946 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:35 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:14:35.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:14:35.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:14:35.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:14:35.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:14:35.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:14:35.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:35.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:35 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:14:36.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:36 smithi136 ceph-mon[34110]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-05-09T01:14:36.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:36 smithi037 ceph-mon[30122]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-05-09T01:14:36.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:36 smithi151 ceph-mon[34780]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.7 MiB/s wr, 599 op/s 2024-05-09T01:14:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.035+0000 7fd2508d3700 1 -- 172.21.15.37:0/3828225968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c109860 msgr2=0x7fd24c1111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.035+0000 7fd2508d3700 1 --2- 172.21.15.37:0/3828225968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c109860 0x7fd24c1111c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd244009f90 tx=0x7fd24400b330 comp rx=0 tx=0).stop 2024-05-09T01:14:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.039+0000 7fd2508d3700 1 -- 172.21.15.37:0/3828225968 shutdown_connections 2024-05-09T01:14:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.039+0000 7fd2508d3700 1 --2- 172.21.15.37:0/3828225968 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c109860 0x7fd24c1111c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.039+0000 7fd2508d3700 1 --2- 172.21.15.37:0/3828225968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c1045e0 0x7fd24c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.039+0000 7fd2508d3700 1 --2- 172.21.15.37:0/3828225968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c108f10 0x7fd24c109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.039+0000 7fd2508d3700 1 -- 172.21.15.37:0/3828225968 >> 172.21.15.37:0/3828225968 conn(0x7fd24c0ffe70 msgr2=0x7fd24c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:38.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.044+0000 7fd2508d3700 1 -- 172.21.15.37:0/3828225968 shutdown_connections 2024-05-09T01:14:38.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.044+0000 7fd2508d3700 1 -- 172.21.15.37:0/3828225968 wait complete. 2024-05-09T01:14:38.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.045+0000 7fd2508d3700 1 Processor -- start 2024-05-09T01:14:38.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd2508d3700 1 -- start start 2024-05-09T01:14:38.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd2508d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c1045e0 0x7fd24c075c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd2508d3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c108f10 0x7fd24c06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd2508d3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c109860 0x7fd24c070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd2508d3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c06e3b0 con 0x7fd24c1045e0 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd2508d3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c06e230 con 0x7fd24c108f10 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd2508d3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c06e530 con 0x7fd24c109860 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd24ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c109860 0x7fd24c070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.048+0000 7fd24ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c109860 0x7fd24c070330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46888/0 (socket says 172.21.15.37:46888) 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24ad9d700 1 -- 172.21.15.37:0/4120525256 learned_addr learned my addr 172.21.15.37:0/4120525256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd249d9b700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c108f10 0x7fd24c06fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24a59c700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c1045e0 0x7fd24c075c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24ad9d700 1 -- 172.21.15.37:0/4120525256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c108f10 msgr2=0x7fd24c06fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c108f10 0x7fd24c06fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24ad9d700 1 -- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c1045e0 msgr2=0x7fd24c075c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c1045e0 0x7fd24c075c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24ad9d700 1 -- 172.21.15.37:0/4120525256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c0708f0 con 0x7fd24c109860 2024-05-09T01:14:38.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.049+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c109860 0x7fd24c070330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd24400cfa0 tx=0x7fd24400cfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:38.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.050+0000 7fd23b7fe700 1 -- 172.21.15.37:0/4120525256 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244021070 con 0x7fd24c109860 2024-05-09T01:14:38.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.050+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c070b80 con 0x7fd24c109860 2024-05-09T01:14:38.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.050+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c19ccd0 con 0x7fd24c109860 2024-05-09T01:14:38.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.050+0000 7fd23b7fe700 1 -- 172.21.15.37:0/4120525256 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd244007c80 con 0x7fd24c109860 2024-05-09T01:14:38.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.050+0000 7fd23b7fe700 1 -- 172.21.15.37:0/4120525256 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2440052a0 con 0x7fd24c109860 2024-05-09T01:14:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.057+0000 7fd23b7fe700 1 -- 172.21.15.37:0/4120525256 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd244024070 con 0x7fd24c109860 2024-05-09T01:14:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.059+0000 7fd23b7fe700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2340c3aa0 0x7fd2340c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.059+0000 7fd23b7fe700 1 -- 172.21.15.37:0/4120525256 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd2440e3440 con 0x7fd24c109860 2024-05-09T01:14:38.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.063+0000 7fd24a59c700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2340c3aa0 0x7fd2340c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.066+0000 7fd25f2e9b80 1 Processor -- start 2024-05-09T01:14:38.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.067+0000 7fd24a59c700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2340c3aa0 0x7fd2340c5fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd23c005950 tx=0x7fd23c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.068+0000 7fd25f2e9b80 1 -- start start 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.069+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 0x55ad3ce504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.069+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce50a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.069+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce4aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.069+0000 7fd24ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce4aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.069+0000 7fd24ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce4aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46890/0 (socket says 172.21.15.37:46890) 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.069+0000 7fd24ad9d700 1 -- 172.21.15.37:0/1496401162 learned_addr learned my addr 172.21.15.37:0/1496401162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.070+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad3cd6cff0 con 0x55ad3cdb7160 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.070+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ad3cd0b7f0 con 0x55ad3cccd4a0 2024-05-09T01:14:38.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.070+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad3cd68fb0 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.071+0000 7fd249d9b700 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce50a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.071+0000 7fd24a59c700 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 0x55ad3ce504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.072+0000 7fd24ad9d700 1 -- 172.21.15.37:0/1496401162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 msgr2=0x55ad3ce50a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.072+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce50a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.072+0000 7fd24ad9d700 1 -- 172.21.15.37:0/1496401162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 msgr2=0x55ad3ce504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.072+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 0x55ad3ce504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.072+0000 7fd24ad9d700 1 -- 172.21.15.37:0/1496401162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3cd03370 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.073+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce4aad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd244004fd0 tx=0x7fd24400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f32fd68fc6a38136 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:38.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.074+0000 7fd238ff9700 1 -- 172.21.15.37:0/1496401162 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24402b070 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.074+0000 7fd238ff9700 1 -- 172.21.15.37:0/1496401162 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2440aa600 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.074+0000 7fd238ff9700 1 -- 172.21.15.37:0/1496401162 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2440b38c0 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.075+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3ce4a6a0 msgr2=0x55ad3ce4aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.075+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce4aad0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd244004fd0 tx=0x7fd24400b330 comp rx=0 tx=0).stop 2024-05-09T01:14:38.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.076+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 shutdown_connections 2024-05-09T01:14:38.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.076+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce4aad0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.076+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 0x55ad3ce504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.076+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1496401162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce50a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.076+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 >> 172.21.15.37:0/1496401162 conn(0x55ad3cd2d6a0 msgr2=0x55ad3ce45400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:38.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.082+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 shutdown_connections 2024-05-09T01:14:38.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.082+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1496401162 wait complete. 2024-05-09T01:14:38.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.083+0000 7fd25f2e9b80 1 -- start start 2024-05-09T01:14:38.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.083+0000 7fd25f2e9b80 1 Processor -- start 2024-05-09T01:14:38.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.084+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce59cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.084+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.084+0000 7fd24a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce59cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.084+0000 7fd24a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce59cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46898/0 (socket says 172.21.15.37:46898) 2024-05-09T01:14:38.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.084+0000 7fd24a59c700 1 -- 172.21.15.37:0/1839952957 learned_addr learned my addr 172.21.15.37:0/1839952957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:38.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.085+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce540b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.085+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad3cbe8ba0 con 0x55ad3cdb7160 2024-05-09T01:14:38.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.085+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.085+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55ad3cd27150 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.085+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad3ce4b360 con 0x55ad3cccd4a0 2024-05-09T01:14:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.086+0000 7fd25f2e9b80 10 client.0 _ll_register_callbacks cb 0x55ad3cbde6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.086+0000 7fd24a59c700 1 -- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3ce4a6a0 msgr2=0x55ad3ce540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.086+0000 7fd24a59c700 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.086+0000 7fd24a59c700 1 -- 172.21.15.37:0/1839952957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 msgr2=0x55ad3ce5a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.086+0000 7fd24a59c700 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.086+0000 7fd24a59c700 1 -- 172.21.15.37:0/1839952957 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3cbe8490 con 0x55ad3cccd4a0 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.087+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.087+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2440aa600 con 0x55ad3cccd4a0 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.087+0000 7fd24a59c700 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce59cb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00ffd0 tx=0x7fd23c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf3263dc0dad848d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.087+0000 7fd231ffb700 10 client.27352 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.087+0000 7fd231ffb700 1 -- 172.21.15.37:0/1839952957 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c01f630 con 0x55ad3cccd4a0 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.087+0000 7fd231ffb700 1 -- 172.21.15.37:0/1839952957 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd23c01f7d0 con 0x55ad3cccd4a0 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.088+0000 7fd231ffb700 1 -- 172.21.15.37:0/1839952957 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fd23c01fa30 con 0x55ad3cccd4a0 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.088+0000 7fd25f2e9b80 10 client.27352 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.088+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55ad3ce61630 con 0x55ad3cccd4a0 2024-05-09T01:14:38.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.088+0000 7fd231ffb700 1 -- 172.21.15.37:0/1839952957 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7fd23c01fbd0 con 0x55ad3cccd4a0 2024-05-09T01:14:38.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.088+0000 7fd25f2e9b80 10 client.27352 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:38.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.088+0000 7fd25f2e9b80 10 client.27352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.089+0000 7fd25f2e9b80 20 client.27352 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.089+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ce65ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.089+0000 7fd25f2e9b80 4 client.27352 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.089+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad3cd7a9d0 con 0x55ad3ce63b50 2024-05-09T01:14:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.089+0000 7fd249d9b700 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ce65ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.090+0000 7fd231ffb700 10 client.27352 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.090+0000 7fd249d9b700 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ce65ff0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef50430bbf860b6f server_cookie=19abbb0c4c5bd319 in_seq=0 out_seq=0 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.090+0000 7fd231ffb700 1 -- 172.21.15.37:0/1839952957 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ad3cd7a9d0 con 0x55ad3ce63b50 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.090+0000 7fd231ffb700 10 client.27352 handle_command_reply: tid=0 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.090+0000 7fd25f2e9b80 1 client.27352 shutdown 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 msgr2=0x55ad3ce59cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce59cb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00ffd0 tx=0x7fd23c004750 comp rx=0 tx=0).stop 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 shutdown_connections 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ce65ff0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd231ffb700 0 client.27352 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce59cb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1839952957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 >> 172.21.15.37:0/1839952957 conn(0x55ad3cd2d6a0 msgr2=0x55ad3ce451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 shutdown_connections 2024-05-09T01:14:38.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.091+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1839952957 wait complete. 2024-05-09T01:14:38.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.092+0000 7fd25f2e9b80 20 client.27352 trim_cache size 0 max 16384 2024-05-09T01:14:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.122+0000 7fd25f2e9b80 1 Processor -- start 2024-05-09T01:14:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.122+0000 7fd25f2e9b80 1 -- start start 2024-05-09T01:14:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.123+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce4f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.123+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cdb7160 0x55ad3ce6b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.123+0000 7fd24a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce4f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.123+0000 7fd24a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce4f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46914/0 (socket says 172.21.15.37:46914) 2024-05-09T01:14:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.123+0000 7fd24a59c700 1 -- 172.21.15.37:0/3029026677 learned_addr learned my addr 172.21.15.37:0/3029026677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.123+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce6bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.123+0000 7fd249d9b700 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cdb7160 0x55ad3ce6b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.124+0000 7fd24ad9d700 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce6bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.124+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c00d220 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.124+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c00edf0 con 0x55ad3cdb7160 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.124+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c00d8f0 con 0x55ad3cccd4a0 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.125+0000 7fd249d9b700 1 -- 172.21.15.37:0/3029026677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 msgr2=0x55ad3ce4f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.125+0000 7fd249d9b700 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce4f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.125+0000 7fd249d9b700 1 -- 172.21.15.37:0/3029026677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 msgr2=0x55ad3ce6bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.125+0000 7fd249d9b700 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce6bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.125+0000 7fd249d9b700 1 -- 172.21.15.37:0/3029026677 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3ce47150 con 0x55ad3cdb7160 2024-05-09T01:14:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.125+0000 7fd249d9b700 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cdb7160 0x55ad3ce6b7f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55ad3ce4ffb0 tx=0x7fd240024750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c3b553585ef060 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.126+0000 7fd233fff700 1 -- 172.21.15.37:0/3029026677 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240024190 con 0x55ad3cdb7160 2024-05-09T01:14:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.126+0000 7fd233fff700 1 -- 172.21.15.37:0/3029026677 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd240031020 con 0x55ad3cdb7160 2024-05-09T01:14:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.126+0000 7fd233fff700 1 -- 172.21.15.37:0/3029026677 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240024190 con 0x55ad3cdb7160 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.127+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cdb7160 msgr2=0x55ad3ce6b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.127+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cdb7160 0x55ad3ce6b7f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55ad3ce4ffb0 tx=0x7fd240024750 comp rx=0 tx=0).stop 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 shutdown_connections 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce6bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce4f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/3029026677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cdb7160 0x55ad3ce6b7f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 >> 172.21.15.37:0/3029026677 conn(0x55ad3cd2d6a0 msgr2=0x55ad3ce4f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 shutdown_connections 2024-05-09T01:14:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/3029026677 wait complete. 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.128+0000 7fd25f2e9b80 1 -- start start 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 1 Processor -- start 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce60220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce5dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c00e6f0 con 0x55ad3ce4a6a0 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c00e020 con 0x55ad3cccd4a0 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c00b1c0 con 0x55ad3cdb7160 2024-05-09T01:14:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.129+0000 7fd25f2e9b80 10 client.0 _ll_register_callbacks cb 0x55ad3cbde6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.131+0000 7fd249d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd249d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46920/0 (socket says 172.21.15.37:46920) 2024-05-09T01:14:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd249d9b700 1 -- 172.21.15.37:0/1504795912 learned_addr learned my addr 172.21.15.37:0/1504795912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd24a59c700 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce60220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd249d9b700 1 -- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 msgr2=0x55ad3ce60220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd249d9b700 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce60220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd249d9b700 1 -- 172.21.15.37:0/1504795912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 msgr2=0x55ad3ce5dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd249d9b700 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce5dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.132+0000 7fd249d9b700 1 -- 172.21.15.37:0/1504795912 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3ce5e020 con 0x55ad3cdb7160 2024-05-09T01:14:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.133+0000 7fd249d9b700 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5d5a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd2400042e0 tx=0x7fd240004310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=440bf1b54824c9b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.133+0000 7fd231ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.133+0000 7fd231ffb700 1 -- 172.21.15.37:0/1504795912 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240024190 con 0x55ad3cdb7160 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.133+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd240031020 con 0x55ad3cdb7160 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.134+0000 7fd231ffb700 1 -- 172.21.15.37:0/1504795912 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd240019040 con 0x55ad3cdb7160 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.134+0000 7fd231ffb700 1 -- 172.21.15.37:0/1504795912 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fd24002d630 con 0x55ad3cdb7160 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.134+0000 7fd25f2e9b80 10 client.27358 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.134+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ad3cecdfe0 con 0x55ad3cdb7160 2024-05-09T01:14:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.134+0000 7fd231ffb700 1 -- 172.21.15.37:0/1504795912 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd240031020 con 0x55ad3cdb7160 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd231ffb700 1 -- 172.21.15.37:0/1504795912 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7fd24003e020 con 0x55ad3cdb7160 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd25f2e9b80 10 client.27358 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd25f2e9b80 10 client.27358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd25f2e9b80 20 client.27358 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ced06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd25f2e9b80 4 client.27358 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ad3cd74a70 con 0x55ad3ce63b50 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.135+0000 7fd24a59c700 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ced06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd24a59c700 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ced06e0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4856a41e3f081b78 server_cookie=deeec7dca15265e in_seq=0 out_seq=0 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd231ffb700 10 client.27358 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd231ffb700 1 -- 172.21.15.37:0/1504795912 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ad3cd74a70 con 0x55ad3ce63b50 2024-05-09T01:14:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd231ffb700 10 client.27358 handle_command_reply: tid=0 2024-05-09T01:14:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 client.27358 shutdown 2024-05-09T01:14:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cdb7160 msgr2=0x55ad3ce5d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5d5a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd2400042e0 tx=0x7fd240004310 comp rx=0 tx=0).stop 2024-05-09T01:14:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 shutdown_connections 2024-05-09T01:14:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55ad3ce63b50 0x55ad3ced06e0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad3ce4a6a0 0x55ad3ce5dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ad3cccd4a0 0x55ad3ce60220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd231ffb700 0 client.27358 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 --2- 172.21.15.37:0/1504795912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad3cdb7160 0x55ad3ce5d5a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.136+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 >> 172.21.15.37:0/1504795912 conn(0x55ad3cd2d6a0 msgr2=0x55ad3ce53860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.137+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 shutdown_connections 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.137+0000 7fd25f2e9b80 1 -- 172.21.15.37:0/1504795912 wait complete. 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.137+0000 7fd25f2e9b80 20 client.27358 trim_cache size 0 max 16384 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:14:38.139 INFO:teuthology.orchestra.run.smithi037.stdout: "94f419de-be66-4803-9f1f-420a17ea6a53": { 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "94f419de-be66-4803-9f1f-420a17ea6a53", 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2340c3aa0 msgr2=0x7fd2340c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2340c3aa0 0x7fd2340c5fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd23c005950 tx=0x7fd23c0058e0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c109860 msgr2=0x7fd24c070330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c109860 0x7fd24c070330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd24400cfa0 tx=0x7fd24400cfd0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 shutdown_connections 2024-05-09T01:14:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd2340c3aa0 0x7fd2340c5fb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c109860 0x7fd24c070330 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c1045e0 0x7fd24c075c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 --2- 172.21.15.37:0/4120525256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd24c108f10 0x7fd24c06fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 >> 172.21.15.37:0/4120525256 conn(0x7fd24c0ffe70 msgr2=0x7fd24c107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 shutdown_connections 2024-05-09T01:14:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:14:38.140+0000 7fd2508d3700 1 -- 172.21.15.37:0/4120525256 wait complete. 2024-05-09T01:14:38.833 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:38 smithi037 ceph-mon[30122]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.3 MiB/s wr, 783 op/s 2024-05-09T01:14:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:38 smithi136 ceph-mon[34110]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.3 MiB/s wr, 783 op/s 2024-05-09T01:14:38.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:38 smithi151 ceph-mon[34780]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.3 MiB/s wr, 783 op/s 2024-05-09T01:14:39.115 INFO:tasks.cephfs.filesystem:scrub status for tag:94f419de-be66-4803-9f1f-420a17ea6a53 - {'path': '/', 'tag': '94f419de-be66-4803-9f1f-420a17ea6a53', 'options': 'recursive,force'} 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.777+0000 7f93d7340640 1 -- 172.21.15.37:0/1260688860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0107aa0 msgr2=0x7f93d0107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.777+0000 7f93d7340640 1 --2- 172.21.15.37:0/1260688860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0107aa0 0x7f93d0107eb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f93c8009ca0 tx=0x7f93c802a8c0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.778+0000 7f93d7340640 1 -- 172.21.15.37:0/1260688860 shutdown_connections 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.778+0000 7f93d7340640 1 --2- 172.21.15.37:0/1260688860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0107aa0 0x7f93d0107eb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.778+0000 7f93d7340640 1 --2- 172.21.15.37:0/1260688860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d0102930 0x7f93d0102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.778+0000 7f93d7340640 1 --2- 172.21.15.37:0/1260688860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d0101ef0 0x7f93d0102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.778+0000 7f93d7340640 1 -- 172.21.15.37:0/1260688860 >> 172.21.15.37:0/1260688860 conn(0x7f93d00fd4c0 msgr2=0x7f93d00ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.778+0000 7f93d7340640 1 -- 172.21.15.37:0/1260688860 shutdown_connections 2024-05-09T01:14:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.778+0000 7f93d7340640 1 -- 172.21.15.37:0/1260688860 wait complete. 2024-05-09T01:14:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 Processor -- start 2024-05-09T01:14:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 -- start start 2024-05-09T01:14:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0101ef0 0x7f93d01a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d0102930 0x7f93d01a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d0107aa0 0x7f93d01a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0115d70 con 0x7f93d0107aa0 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0115bf0 con 0x7f93d0102930 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d7340640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0115ef0 con 0x7f93d0101ef0 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0101ef0 0x7f93d01a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0101ef0 0x7f93d01a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46940/0 (socket says 172.21.15.37:46940) 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.779+0000 7f93d50dc640 1 -- 172.21.15.37:0/4158238298 learned_addr learned my addr 172.21.15.37:0/4158238298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d58dd640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d0107aa0 0x7f93d01a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d48db640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d0102930 0x7f93d01a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d50dc640 1 -- 172.21.15.37:0/4158238298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d0102930 msgr2=0x7f93d01a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d50dc640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d0102930 0x7f93d01a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d50dc640 1 -- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d0107aa0 msgr2=0x7f93d01a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d50dc640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d0107aa0 0x7f93d01a7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d50dc640 1 -- 172.21.15.37:0/4158238298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d01a8390 con 0x7f93d0101ef0 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d58dd640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d0107aa0 0x7f93d01a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:14:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d50dc640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0101ef0 0x7f93d01a08a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f93c000d950 tx=0x7f93c000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93c67fc640 1 -- 172.21.15.37:0/4158238298 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0017070 con 0x7f93d0101ef0 2024-05-09T01:14:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d01a8680 con 0x7f93d0101ef0 2024-05-09T01:14:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.780+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d01a8c20 con 0x7f93d0101ef0 2024-05-09T01:14:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.781+0000 7f93c67fc640 1 -- 172.21.15.37:0/4158238298 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93c0009c30 con 0x7f93d0101ef0 2024-05-09T01:14:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.781+0000 7f93c67fc640 1 -- 172.21.15.37:0/4158238298 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c000f620 con 0x7f93d0101ef0 2024-05-09T01:14:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 Processor -- start 2024-05-09T01:14:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 -- start start 2024-05-09T01:14:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93c67fc640 1 -- 172.21.15.37:0/4158238298 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f93c000f7c0 con 0x7f93d0101ef0 2024-05-09T01:14:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413d31b0 0x564d41777500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413aa2f0 0x564d41777a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413b24d0 0x564d4177e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d416db7c0 con 0x564d413aa2f0 2024-05-09T01:14:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564d416770e0 con 0x564d413d31b0 2024-05-09T01:14:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93de1f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564d416d7780 con 0x564d413b24d0 2024-05-09T01:14:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413aa2f0 0x564d41777a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413aa2f0 0x564d41777a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39196/0 (socket says 172.21.15.37:39196) 2024-05-09T01:14:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93d50dc640 1 -- 172.21.15.37:0/1026078835 learned_addr learned my addr 172.21.15.37:0/1026078835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93d48db640 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413b24d0 0x564d4177e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.784+0000 7f93d58dd640 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413d31b0 0x564d41777500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93d48db640 1 -- 172.21.15.37:0/1026078835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413d31b0 msgr2=0x564d41777500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93d48db640 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413d31b0 0x564d41777500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93d48db640 1 -- 172.21.15.37:0/1026078835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413aa2f0 msgr2=0x564d41777a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93d48db640 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413aa2f0 0x564d41777a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93d48db640 1 -- 172.21.15.37:0/1026078835 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d416a07c0 con 0x564d413b24d0 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93d50dc640 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413aa2f0 0x564d41777a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93d48db640 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413b24d0 0x564d4177e980 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009bf0 tx=0x7f93cc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9be2c4ee1a8fdbc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93bb7fe640 1 -- 172.21.15.37:0/1026078835 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc004050 con 0x564d413b24d0 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93bb7fe640 1 -- 172.21.15.37:0/1026078835 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93cc0054d0 con 0x564d413b24d0 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93c67fc640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93bc0b2860 0x7f93bc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.785+0000 7f93bb7fe640 1 -- 172.21.15.37:0/1026078835 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc004d10 con 0x564d413b24d0 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.786+0000 7f93d58dd640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93bc0b2860 0x7f93bc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.786+0000 7f93c67fc640 1 -- 172.21.15.37:0/4158238298 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93c00e1d00 con 0x7f93d0101ef0 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.786+0000 7f93de1f0740 1 -- 172.21.15.37:0/1026078835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413b24d0 msgr2=0x564d4177e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.786+0000 7f93d58dd640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93bc0b2860 0x7f93bc0b4d70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x564d417786d0 tx=0x7f93c8004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.786+0000 7f93de1f0740 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413b24d0 0x564d4177e980 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009bf0 tx=0x7f93cc011810 comp rx=0 tx=0).stop 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 -- 172.21.15.37:0/1026078835 shutdown_connections 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413b24d0 0x564d4177e980 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413aa2f0 0x564d41777a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 --2- 172.21.15.37:0/1026078835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413d31b0 0x564d41777500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 -- 172.21.15.37:0/1026078835 >> 172.21.15.37:0/1026078835 conn(0x564d413c7300 msgr2=0x564d41772e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 -- 172.21.15.37:0/1026078835 shutdown_connections 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 -- 172.21.15.37:0/1026078835 wait complete. 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 -- start start 2024-05-09T01:14:39.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.787+0000 7f93de1f0740 1 Processor -- start 2024-05-09T01:14:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d417811d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d41781710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413d31b0 0x564d41788670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93de1f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d4177f3d0 con 0x564d413b24d0 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d417811d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93de1f0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564d416629c0 con 0x564d413aa2f0 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93de1f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564d4177f550 con 0x564d413d31b0 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d417811d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39708/0 (socket says 172.21.15.37:39708) 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 -- 172.21.15.37:0/298940097 learned_addr learned my addr 172.21.15.37:0/298940097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93de1f0740 10 client.0 _ll_register_callbacks cb 0x564d4168f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d48db640 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d41781710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d58dd640 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413d31b0 0x564d41788670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 -- 172.21.15.37:0/298940097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413d31b0 msgr2=0x564d41788670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413d31b0 0x564d41788670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 -- 172.21.15.37:0/298940097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 msgr2=0x564d41781710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d41781710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.788+0000 7f93d50dc640 1 -- 172.21.15.37:0/298940097 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d416891f0 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93d50dc640 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d417811d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f93c00e1fa0 tx=0x7f93c00a51e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a05b080cefb2d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93b8ff9640 1 -- 172.21.15.37:0/298940097 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0020030 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93b8ff9640 1 -- 172.21.15.37:0/298940097 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93c00a8580 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93cc0054d0 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93b8ff9640 1 -- 172.21.15.37:0/298940097 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f93c00a8a90 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 10 client.27404 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564d4143e790 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93b8ff9640 1 -- 172.21.15.37:0/298940097 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93cc0054d0 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93b8ff9640 1 -- 172.21.15.37:0/298940097 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7f93c0010460 con 0x564d413aa2f0 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 10 client.27404 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 10 client.27404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 20 client.27404 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d41391d80 0x564d4178ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 4 client.27404 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.789+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d416e93d0 con 0x564d41391d80 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.790+0000 7f93d48db640 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d41391d80 0x564d4178ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.790+0000 7f93d48db640 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d41391d80 0x564d4178ebf0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=497bb5238b74d8bc server_cookie=9f6024fb44b9d239 in_seq=0 out_seq=0 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.790+0000 7f93b8ff9640 10 client.27404 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93b8ff9640 1 -- 172.21.15.37:0/298940097 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564d416e93d0 con 0x564d41391d80 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93b8ff9640 10 client.27404 handle_command_reply: tid=0 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 client.27404 shutdown 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 msgr2=0x564d417811d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d417811d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f93c00e1fa0 tx=0x7f93c00a51e0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 shutdown_connections 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d41391d80 0x564d4178ebf0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413d31b0 0x564d41788670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93b8ff9640 0 client.27404 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d41781710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 --2- 172.21.15.37:0/298940097 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d417811d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 >> 172.21.15.37:0/298940097 conn(0x564d413c7300 msgr2=0x564d41775da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 shutdown_connections 2024-05-09T01:14:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 1 -- 172.21.15.37:0/298940097 wait complete. 2024-05-09T01:14:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.791+0000 7f93de1f0740 20 client.27404 trim_cache size 0 max 16384 2024-05-09T01:14:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.810+0000 7f93de1f0740 1 Processor -- start 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.810+0000 7f93de1f0740 1 -- start start 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d41391d80 0x564d417814b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413aa2f0 0x564d41788600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413b24d0 0x564d417933e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93de1f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93b400e330 con 0x564d41391d80 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93de1f0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93b400ff00 con 0x564d413b24d0 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93de1f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93b400ea00 con 0x564d413aa2f0 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413aa2f0 0x564d41788600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d41391d80 0x564d417814b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413aa2f0 0x564d41788600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46972/0 (socket says 172.21.15.37:46972) 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d41391d80 0x564d417814b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39220/0 (socket says 172.21.15.37:39220) 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 -- 172.21.15.37:0/3768074165 learned_addr learned my addr 172.21.15.37:0/3768074165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d58dd640 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413b24d0 0x564d417933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 -- 172.21.15.37:0/3768074165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413b24d0 msgr2=0x564d417933e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413b24d0 0x564d417933e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 -- 172.21.15.37:0/3768074165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d41391d80 msgr2=0x564d417814b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d41391d80 0x564d417814b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d48db640 1 -- 172.21.15.37:0/3768074165 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d414b55f0 con 0x564d413aa2f0 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.811+0000 7f93d58dd640 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413b24d0 0x564d417933e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.812+0000 7f93d48db640 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413aa2f0 0x564d41788600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x564d41773c20 tx=0x7f93cc004590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29df7350f29a76aa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.812+0000 7f93baffd640 1 -- 172.21.15.37:0/3768074165 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc02e540 con 0x564d413aa2f0 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.812+0000 7f93baffd640 1 -- 172.21.15.37:0/3768074165 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93cc019430 con 0x564d413aa2f0 2024-05-09T01:14:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.812+0000 7f93baffd640 1 -- 172.21.15.37:0/3768074165 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc024670 con 0x564d413aa2f0 2024-05-09T01:14:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 -- 172.21.15.37:0/3768074165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413aa2f0 msgr2=0x564d41788600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413aa2f0 0x564d41788600 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x564d41773c20 tx=0x7f93cc004590 comp rx=0 tx=0).stop 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 -- 172.21.15.37:0/3768074165 shutdown_connections 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413b24d0 0x564d417933e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d413aa2f0 0x564d41788600 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 --2- 172.21.15.37:0/3768074165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d41391d80 0x564d417814b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 -- 172.21.15.37:0/3768074165 >> 172.21.15.37:0/3768074165 conn(0x564d413c7300 msgr2=0x564d41780da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 -- 172.21.15.37:0/3768074165 shutdown_connections 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 -- 172.21.15.37:0/3768074165 wait complete. 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 -- start start 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.813+0000 7f93de1f0740 1 Processor -- start 2024-05-09T01:14:39.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d41391d80 0x564d41785550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d41785a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93de1f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d417f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93de1f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93b400f800 con 0x564d413b24d0 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93de1f0740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93b400f130 con 0x564d413aa2f0 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93de1f0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93b400c310 con 0x564d41391d80 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93de1f0740 10 client.0 _ll_register_callbacks cb 0x7f93c00df740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d58dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d417f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d41391d80 0x564d41785550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d41391d80 0x564d41785550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46978/0 (socket says 172.21.15.37:46978) 2024-05-09T01:14:39.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 -- 172.21.15.37:0/2599246660 learned_addr learned my addr 172.21.15.37:0/2599246660 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d48db640 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d41785a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 -- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 msgr2=0x564d41785a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d41785a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 -- 172.21.15.37:0/2599246660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 msgr2=0x564d417f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d417f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.814+0000 7f93d50dc640 1 -- 172.21.15.37:0/2599246660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d4169fed0 con 0x564d41391d80 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93d50dc640 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d41391d80 0x564d41785550 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f93c00a9320 tx=0x7f93c0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1c40e10b5faa90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93b8ff9640 1 -- 172.21.15.37:0/2599246660 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0020070 con 0x564d41391d80 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93cc019430 con 0x564d41391d80 2024-05-09T01:14:39.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93b8ff9640 1 -- 172.21.15.37:0/2599246660 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f93c00a8580 con 0x564d41391d80 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93b8ff9640 1 -- 172.21.15.37:0/2599246660 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f93c00a8e30 con 0x564d41391d80 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 10 client.27376 fetch_fsmap learned FSMap version 48 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564d417f6440 con 0x564d41391d80 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93b8ff9640 1 -- 172.21.15.37:0/2599246660 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93cc019430 con 0x564d41391d80 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93b8ff9640 1 -- 172.21.15.37:0/2599246660 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8366+0+0 (secure 0 0 0) 0x7f93c00ca210 con 0x564d41391d80 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 10 client.27376 fetch_fsmap finished waiting for FSMap version 48 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 10 client.27376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 20 client.27376 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d413d31b0 0x564d417f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 4 client.27376 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.815+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d416e3240 con 0x564d413d31b0 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.816+0000 7f93d48db640 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d413d31b0 0x564d417f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.816+0000 7f93b8ff9640 10 client.27376 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:39.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.816+0000 7f93d48db640 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d413d31b0 0x564d417f8e80 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3dd0b4e1ab1fad3 server_cookie=3c107e91cd8a0d1d in_seq=0 out_seq=0 2024-05-09T01:14:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.828+0000 7f93b8ff9640 1 -- 172.21.15.37:0/2599246660 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564d416e3240 con 0x564d413d31b0 2024-05-09T01:14:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.828+0000 7f93b8ff9640 10 client.27376 handle_command_reply: tid=0 2024-05-09T01:14:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.828+0000 7f93de1f0740 1 client.27376 shutdown 2024-05-09T01:14:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d41391d80 msgr2=0x564d41785550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d41391d80 0x564d41785550 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f93c00a9320 tx=0x7f93c0005880 comp rx=0 tx=0).stop 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 shutdown_connections 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564d413d31b0 0x564d417f8e80 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d413b24d0 0x564d417f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d413aa2f0 0x564d41785a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 --2- 172.21.15.37:0/2599246660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d41391d80 0x564d41785550 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93b8ff9640 0 client.27376 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 >> 172.21.15.37:0/2599246660 conn(0x564d413c7300 msgr2=0x564d41775c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 shutdown_connections 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 1 -- 172.21.15.37:0/2599246660 wait complete. 2024-05-09T01:14:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93de1f0740 20 client.27376 trim_cache size 0 max 16384 2024-05-09T01:14:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:14:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:14:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:14:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93bc0b2860 msgr2=0x7f93bc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93d7340640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93bc0b2860 0x7f93bc0b4d70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x564d417786d0 tx=0x7f93c8004a40 comp rx=0 tx=0).stop 2024-05-09T01:14:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0101ef0 msgr2=0x7f93d01a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.829+0000 7f93d7340640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0101ef0 0x7f93d01a08a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f93c000d950 tx=0x7f93c000de10 comp rx=0 tx=0).stop 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 shutdown_connections 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d0107aa0 0x7f93d01a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f93bc0b2860 0x7f93bc0b4d70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d0102930 0x7f93d01a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 --2- 172.21.15.37:0/4158238298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93d0101ef0 0x7f93d01a08a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 >> 172.21.15.37:0/4158238298 conn(0x7f93d00fd4c0 msgr2=0x7f93d0103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 shutdown_connections 2024-05-09T01:14:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:39.830+0000 7f93d7340640 1 -- 172.21.15.37:0/4158238298 wait complete. 2024-05-09T01:14:40.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 740.0 s, 1304.8 tps, lat 77.340 ms stddev 86.006 2024-05-09T01:14:40.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:40 smithi136 ceph-mon[34110]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.8 MiB/s wr, 746 op/s 2024-05-09T01:14:40.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:40 smithi037 ceph-mon[30122]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.8 MiB/s wr, 746 op/s 2024-05-09T01:14:40.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:40 smithi151 ceph-mon[34780]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.8 MiB/s wr, 746 op/s 2024-05-09T01:14:42.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:42 smithi136 ceph-mon[34110]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.1 MiB/s wr, 782 op/s 2024-05-09T01:14:42.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:42 smithi037 ceph-mon[30122]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.1 MiB/s wr, 782 op/s 2024-05-09T01:14:42.979 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:42 smithi151 ceph-mon[34780]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 7.1 MiB/s wr, 782 op/s 2024-05-09T01:14:44.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:44 smithi136 ceph-mon[34110]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 7.1 MiB/s wr, 756 op/s 2024-05-09T01:14:44.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:44 smithi037 ceph-mon[30122]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 7.1 MiB/s wr, 756 op/s 2024-05-09T01:14:44.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:44 smithi151 ceph-mon[34780]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 7.1 MiB/s wr, 756 op/s 2024-05-09T01:14:45.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 745.0 s, 1809.6 tps, lat 55.359 ms stddev 63.207 2024-05-09T01:14:46.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:46 smithi136 ceph-mon[34110]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.9 MiB/s wr, 765 op/s 2024-05-09T01:14:46.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:46 smithi037 ceph-mon[30122]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.9 MiB/s wr, 765 op/s 2024-05-09T01:14:46.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:46 smithi151 ceph-mon[34780]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.9 MiB/s wr, 765 op/s 2024-05-09T01:14:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:48 smithi136 ceph-mon[34110]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.6 MiB/s wr, 754 op/s 2024-05-09T01:14:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:14:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:14:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:14:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:14:48.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:48 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:14:48.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:48 smithi037 ceph-mon[30122]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.6 MiB/s wr, 754 op/s 2024-05-09T01:14:48.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:14:48.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:14:48.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:14:48.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:14:48.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:48 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:14:48.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:48 smithi151 ceph-mon[34780]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.6 MiB/s wr, 754 op/s 2024-05-09T01:14:48.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:14:48.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:14:48.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:14:48.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:14:48.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:48 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:14:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 750.0 s, 1770.0 tps, lat 55.324 ms stddev 63.308 2024-05-09T01:14:50.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:50 smithi136 ceph-mon[34110]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-05-09T01:14:50.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:50 smithi037 ceph-mon[30122]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-05-09T01:14:50.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:50 smithi151 ceph-mon[34780]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 643 op/s 2024-05-09T01:14:52.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:52 smithi136 ceph-mon[34110]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 705 op/s 2024-05-09T01:14:52.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:52 smithi037 ceph-mon[30122]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 705 op/s 2024-05-09T01:14:52.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:52 smithi151 ceph-mon[34780]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 6.9 MiB/s wr, 705 op/s 2024-05-09T01:14:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.974+0000 7f49ef1dc640 1 -- 172.21.15.37:0/407005955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8103d80 msgr2=0x7f49e8104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.974+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/407005955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8103d80 0x7f49e8104190 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009900 tx=0x7f49d402a410 comp rx=0 tx=0).stop 2024-05-09T01:14:52.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.974+0000 7f49ef1dc640 1 -- 172.21.15.37:0/407005955 shutdown_connections 2024-05-09T01:14:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.974+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/407005955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8108a80 0x7f49e810aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.974+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/407005955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8103d80 0x7f49e8104190 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.974+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/407005955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8102b40 0x7f49e8103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.974+0000 7f49ef1dc640 1 -- 172.21.15.37:0/407005955 >> 172.21.15.37:0/407005955 conn(0x7f49e80fdd30 msgr2=0x7f49e81001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.975+0000 7f49ef1dc640 1 -- 172.21.15.37:0/407005955 shutdown_connections 2024-05-09T01:14:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.975+0000 7f49ef1dc640 1 -- 172.21.15.37:0/407005955 wait complete. 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.975+0000 7f49ef1dc640 1 Processor -- start 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.975+0000 7f49ef1dc640 1 -- start start 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ef1dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102b40 0x7f49e819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ef1dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8103d80 0x7f49e819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ef1dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8108a80 0x7f49e81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ef1dc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49e810f7c0 con 0x7f49e8102b40 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ef1dc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49e810f640 con 0x7f49e8108a80 2024-05-09T01:14:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ef1dc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f49e810f940 con 0x7f49e8103d80 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8103d80 0x7f49e819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ed779640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8108a80 0x7f49e81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ed779640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8108a80 0x7f49e81a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60704/0 (socket says 172.21.15.37:60704) 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8103d80 0x7f49e819a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59140/0 (socket says 172.21.15.37:59140) 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ed779640 1 -- 172.21.15.37:0/2592053517 learned_addr learned my addr 172.21.15.37:0/2592053517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.976+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102b40 0x7f49e819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49ed779640 1 -- 172.21.15.37:0/2592053517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8103d80 msgr2=0x7f49e819a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49ed779640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8103d80 0x7f49e819a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49ed779640 1 -- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102b40 msgr2=0x7f49e819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49ed779640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102b40 0x7f49e819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49ed779640 1 -- 172.21.15.37:0/2592053517 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e81a1ea0 con 0x7f49e8108a80 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49ed779640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8108a80 0x7f49e81a1830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f49e000eb10 tx=0x7f49e000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49e5ffb640 1 -- 172.21.15.37:0/2592053517 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0004b20 con 0x7f49e8108a80 2024-05-09T01:14:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e81a2190 con 0x7f49e8108a80 2024-05-09T01:14:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49e5ffb640 1 -- 172.21.15.37:0/2592053517 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49e0004cc0 con 0x7f49e8108a80 2024-05-09T01:14:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.977+0000 7f49e5ffb640 1 -- 172.21.15.37:0/2592053517 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e0010690 con 0x7f49e8108a80 2024-05-09T01:14:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.978+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e81a26e0 con 0x7f49e8108a80 2024-05-09T01:14:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.980+0000 7f49f616a740 1 Processor -- start 2024-05-09T01:14:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.981+0000 7f49e5ffb640 1 -- 172.21.15.37:0/2592053517 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f49e0005020 con 0x7f49e8108a80 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.982+0000 7f49f616a740 1 -- start start 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.982+0000 7f49f616a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b4a1b0 0x562911ef18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.982+0000 7f49f616a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.982+0000 7f49f616a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911eee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.982+0000 7f49f616a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562911e527c0 con 0x562911b4a1b0 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.982+0000 7f49f616a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562911dee0e0 con 0x562911b212f0 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.982+0000 7f49f616a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562911e4e780 con 0x562911b294d0 2024-05-09T01:14:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.983+0000 7f49e5ffb640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49d80b27e0 0x7f49d80b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.983+0000 7f49e5ffb640 1 -- 172.21.15.37:0/2592053517 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f49e00e27a0 con 0x7f49e8108a80 2024-05-09T01:14:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.983+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911eee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.983+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b4a1b0 0x562911ef18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.983+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b4a1b0 0x562911ef18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58990/0 (socket says 172.21.15.37:58990) 2024-05-09T01:14:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49e7fff640 1 -- 172.21.15.37:0/991154764 learned_addr learned my addr 172.21.15.37:0/991154764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49ecf78640 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49ed779640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49d80b27e0 0x7f49d80b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49ecf78640 1 -- 172.21.15.37:0/991154764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 msgr2=0x562911eee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49ecf78640 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911eee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49ecf78640 1 -- 172.21.15.37:0/991154764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b4a1b0 msgr2=0x562911ef18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49ecf78640 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b4a1b0 0x562911ef18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.984+0000 7f49ecf78640 1 -- 172.21.15.37:0/991154764 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562911e177c0 con 0x562911b212f0 2024-05-09T01:14:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.985+0000 7f49e7fff640 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911eee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.985+0000 7f49ecf78640 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef1e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f49e8102410 tx=0x7f49dc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7662685e93dc487e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.985+0000 7f49d2ffd640 1 -- 172.21.15.37:0/991154764 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc01e070 con 0x562911b212f0 2024-05-09T01:14:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.985+0000 7f49d2ffd640 1 -- 172.21.15.37:0/991154764 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49dc009d70 con 0x562911b212f0 2024-05-09T01:14:52.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.985+0000 7f49d2ffd640 1 -- 172.21.15.37:0/991154764 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc019450 con 0x562911b212f0 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 -- 172.21.15.37:0/991154764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 msgr2=0x562911ef1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49ed779640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49d80b27e0 0x7f49d80b4cf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49e00a9b60 tx=0x7f49e0000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef1e60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f49e8102410 tx=0x7f49dc011810 comp rx=0 tx=0).stop 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 -- 172.21.15.37:0/991154764 shutdown_connections 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911eee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef1e60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 --2- 172.21.15.37:0/991154764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b4a1b0 0x562911ef18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 -- 172.21.15.37:0/991154764 >> 172.21.15.37:0/991154764 conn(0x562911b3e300 msgr2=0x562911ee9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 -- 172.21.15.37:0/991154764 shutdown_connections 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 -- 172.21.15.37:0/991154764 wait complete. 2024-05-09T01:14:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 -- start start 2024-05-09T01:14:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.987+0000 7f49f616a740 1 Processor -- start 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49f616a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49f616a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b294d0 0x562911ef8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49f616a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b4a1b0 0x562911efd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60722/0 (socket says 172.21.15.37:60722) 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49e7fff640 1 -- 172.21.15.37:0/3238673501 learned_addr learned my addr 172.21.15.37:0/3238673501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562911dd99c0 con 0x562911b294d0 2024-05-09T01:14:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562911ef2560 con 0x562911b212f0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562911efdaa0 con 0x562911b4a1b0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49ecf78640 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b294d0 0x562911ef8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49e7fff640 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b4a1b0 0x562911efd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49e7fff640 1 -- 172.21.15.37:0/3238673501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b4a1b0 msgr2=0x562911efd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.988+0000 7f49e7fff640 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b4a1b0 0x562911efd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49e7fff640 1 -- 172.21.15.37:0/3238673501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b294d0 msgr2=0x562911ef8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49e7fff640 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b294d0 0x562911ef8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49e7fff640 1 -- 172.21.15.37:0/3238673501 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562911e001f0 con 0x562911b212f0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49f616a740 10 client.0 _ll_register_callbacks cb 0x562911e06020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49e7fff640 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef8140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49d4006010 tx=0x7f49d4031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a37ae3bf259fbc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49dc009d70 con 0x562911b212f0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49c7fff640 1 -- 172.21.15.37:0/3238673501 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4035040 con 0x562911b212f0 2024-05-09T01:14:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49c7fff640 1 -- 172.21.15.37:0/3238673501 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f49d4003c30 con 0x562911b212f0 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49c7fff640 1 -- 172.21.15.37:0/3238673501 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f49d4003e30 con 0x562911b212f0 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49f616a740 10 client.27422 fetch_fsmap learned FSMap version 49 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.989+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=49}) -- 0x562911bb5790 con 0x562911b212f0 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49c7fff640 1 -- 172.21.15.37:0/3238673501 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f49d4005020 con 0x562911b212f0 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49f616a740 10 client.27422 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49f616a740 10 client.27422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49f616a740 20 client.27422 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49f616a740 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b08d80 0x562911f16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49f616a740 4 client.27422 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562911e603d0 con 0x562911b08d80 2024-05-09T01:14:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.990+0000 7f49ecf78640 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b08d80 0x562911f16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.991+0000 7f49ecf78640 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b08d80 0x562911f16a40 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7071eca8cd0a9f70 server_cookie=477d9e37f247b41e in_seq=0 out_seq=0 2024-05-09T01:14:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.991+0000 7f49c7fff640 10 client.27422 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49c7fff640 1 -- 172.21.15.37:0/3238673501 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562911e603d0 con 0x562911b08d80 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49c7fff640 10 client.27422 handle_command_reply: tid=0 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 client.27422 shutdown 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 msgr2=0x562911ef8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef8140 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49d4006010 tx=0x7f49d4031400 comp rx=0 tx=0).stop 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 shutdown_connections 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b08d80 0x562911f16a40 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b4a1b0 0x562911efd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b294d0 0x562911ef8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 --2- 172.21.15.37:0/3238673501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911ef8140 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49c7fff640 0 client.27422 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 >> 172.21.15.37:0/3238673501 conn(0x562911b3e300 msgr2=0x562911ef18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 shutdown_connections 2024-05-09T01:14:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 1 -- 172.21.15.37:0/3238673501 wait complete. 2024-05-09T01:14:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:52.992+0000 7f49f616a740 20 client.27422 trim_cache size 0 max 16384 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 Processor -- start 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 -- start start 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911ef3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b212f0 0x562911ef3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b294d0 0x562911ef6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81a90a0 con 0x562911b08d80 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81aac40 con 0x562911b294d0 2024-05-09T01:14:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49f616a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81a9770 con 0x562911b212f0 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911ef3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911ef3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59004/0 (socket says 172.21.15.37:59004) 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49e7fff640 1 -- 172.21.15.37:0/2400749521 learned_addr learned my addr 172.21.15.37:0/2400749521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b212f0 0x562911ef3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.017+0000 7f49e7fff640 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b294d0 0x562911ef6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49ecf78640 1 -- 172.21.15.37:0/2400749521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b294d0 msgr2=0x562911ef6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b294d0 0x562911ef6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49ecf78640 1 -- 172.21.15.37:0/2400749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 msgr2=0x562911ef3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911ef3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49ecf78640 1 -- 172.21.15.37:0/2400749521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562911c2c5f0 con 0x562911b212f0 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b212f0 0x562911ef3540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49dc000c00 tx=0x7f49dc005290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=832ee24669598c56 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49d27fc640 1 -- 172.21.15.37:0/2400749521 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc02f070 con 0x562911b212f0 2024-05-09T01:14:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49d27fc640 1 -- 172.21.15.37:0/2400749521 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49dc01f040 con 0x562911b212f0 2024-05-09T01:14:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.018+0000 7f49d27fc640 1 -- 172.21.15.37:0/2400749521 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc01e040 con 0x562911b212f0 2024-05-09T01:14:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.019+0000 7f49f616a740 1 -- 172.21.15.37:0/2400749521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b212f0 msgr2=0x562911ef3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.019+0000 7f49f616a740 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b212f0 0x562911ef3540 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49dc000c00 tx=0x7f49dc005290 comp rx=0 tx=0).stop 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.020+0000 7f49f616a740 1 -- 172.21.15.37:0/2400749521 shutdown_connections 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.020+0000 7f49f616a740 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b294d0 0x562911ef6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.020+0000 7f49f616a740 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b212f0 0x562911ef3540 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.020+0000 7f49f616a740 1 --2- 172.21.15.37:0/2400749521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911ef3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.020+0000 7f49f616a740 1 -- 172.21.15.37:0/2400749521 >> 172.21.15.37:0/2400749521 conn(0x562911b3e300 msgr2=0x562911eecc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.020+0000 7f49f616a740 1 -- 172.21.15.37:0/2400749521 shutdown_connections 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.020+0000 7f49f616a740 1 -- 172.21.15.37:0/2400749521 wait complete. 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 -- start start 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 Processor -- start 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911f254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911f259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911f26920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81aa570 con 0x562911b08d80 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81a9ea0 con 0x562911b212f0 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f49e81a7080 con 0x562911b294d0 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.021+0000 7f49f616a740 10 client.0 _ll_register_callbacks cb 0x7f49e00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49ecf78640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911f259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911f254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911f254b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59018/0 (socket says 172.21.15.37:59018) 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 -- 172.21.15.37:0/2271953360 learned_addr learned my addr 172.21.15.37:0/2271953360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49ecf78640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911f259f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:60726/0 (socket says 172.21.15.37:60726) 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911f26920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 -- 172.21.15.37:0/2271953360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 msgr2=0x562911f26920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911f26920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 -- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 msgr2=0x562911f259f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911f259f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 -- 172.21.15.37:0/2271953360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562911e16ed0 con 0x562911b08d80 2024-05-09T01:14:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911f259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49e7fff640 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911f254b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f49d4031500 tx=0x7f49d403a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c3af896f6523ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49c7fff640 1 -- 172.21.15.37:0/2271953360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4050040 con 0x562911b08d80 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49c7fff640 1 -- 172.21.15.37:0/2271953360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f49d403d480 con 0x562911b08d80 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.022+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49dc01f040 con 0x562911b08d80 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49c7fff640 1 -- 172.21.15.37:0/2271953360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f49d4035040 con 0x562911b08d80 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 10 client.17523 fetch_fsmap learned FSMap version 49 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x562911f27fa0 con 0x562911b08d80 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49c7fff640 1 -- 172.21.15.37:0/2271953360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49dc01f040 con 0x562911b08d80 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49c7fff640 1 -- 172.21.15.37:0/2271953360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f49d404c400 con 0x562911b08d80 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 10 client.17523 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 10 client.17523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 20 client.17523 populate_metadata read hostname 'smithi037' 2024-05-09T01:14:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b4a1b0 0x562911f80ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:14:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 4 client.17523 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:14:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562911e5a240 con 0x562911b4a1b0 2024-05-09T01:14:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.023+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b4a1b0 0x562911f80ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:14:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.024+0000 7f49c7fff640 10 client.17523 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.024+0000 7f49ecf78640 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b4a1b0 0x562911f80ba0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8446d690fc488c24 server_cookie=d144e3f13e91df75 in_seq=0 out_seq=0 2024-05-09T01:14:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.032+0000 7f49c7fff640 1 -- 172.21.15.37:0/2271953360 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562911e5a240 con 0x562911b4a1b0 2024-05-09T01:14:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.032+0000 7f49c7fff640 10 client.17523 handle_command_reply: tid=0 2024-05-09T01:14:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.032+0000 7f49f616a740 1 client.17523 shutdown 2024-05-09T01:14:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 msgr2=0x562911f254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:53.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911f254b0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f49d4031500 tx=0x7f49d403a000 comp rx=0 tx=0).stop 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 shutdown_connections 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x562911b4a1b0 0x562911f80ba0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49c7fff640 0 client.17523 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562911b294d0 0x562911f26920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562911b212f0 0x562911f259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 --2- 172.21.15.37:0/2271953360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562911b08d80 0x562911f254b0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.033+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 >> 172.21.15.37:0/2271953360 conn(0x562911b3e300 msgr2=0x562911eecc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.034+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 shutdown_connections 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.034+0000 7f49f616a740 1 -- 172.21.15.37:0/2271953360 wait complete. 2024-05-09T01:14:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.034+0000 7f49f616a740 20 client.17523 trim_cache size 0 max 16384 2024-05-09T01:14:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:14:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:14:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:14:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49d80b27e0 msgr2=0x7f49d80b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49d80b27e0 0x7f49d80b4cf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f49e00a9b60 tx=0x7f49e0000f40 comp rx=0 tx=0).stop 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8108a80 msgr2=0x7f49e81a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8108a80 0x7f49e81a1830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f49e000eb10 tx=0x7f49e000c2d0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 shutdown_connections 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49d80b27e0 0x7f49d80b4cf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49e8108a80 0x7f49e81a1830 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8103d80 0x7f49e819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 --2- 172.21.15.37:0/2592053517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102b40 0x7f49e819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 >> 172.21.15.37:0/2592053517 conn(0x7f49e80fdd30 msgr2=0x7f49e8104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 shutdown_connections 2024-05-09T01:14:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:14:53.035+0000 7f49ef1dc640 1 -- 172.21.15.37:0/2592053517 wait complete. 2024-05-09T01:14:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:53 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:14:53.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:53 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:14:53.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:53 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:14:54.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:54 smithi136 ceph-mon[34110]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.4 MiB/s wr, 588 op/s 2024-05-09T01:14:54.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:54 smithi037 ceph-mon[30122]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.4 MiB/s wr, 588 op/s 2024-05-09T01:14:54.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:54 smithi151 ceph-mon[34780]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.4 MiB/s wr, 588 op/s 2024-05-09T01:14:55.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 755.0 s, 1559.8 tps, lat 65.214 ms stddev 70.612 2024-05-09T01:14:55.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:55 smithi037 ceph-mon[30122]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.4 MiB/s wr, 590 op/s 2024-05-09T01:14:55.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:55 smithi151 ceph-mon[34780]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.4 MiB/s wr, 590 op/s 2024-05-09T01:14:56.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:55 smithi136 ceph-mon[34110]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.4 MiB/s wr, 590 op/s 2024-05-09T01:14:58.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:14:58 smithi136 ceph-mon[34110]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 659 op/s 2024-05-09T01:14:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:14:58 smithi037 ceph-mon[30122]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 659 op/s 2024-05-09T01:14:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:14:58 smithi151 ceph-mon[34780]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 659 op/s 2024-05-09T01:15:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 760.0 s, 1689.2 tps, lat 59.370 ms stddev 62.742 2024-05-09T01:15:00.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:00 smithi136 ceph-mon[34110]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-05-09T01:15:00.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:00 smithi037 ceph-mon[30122]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-05-09T01:15:00.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:00 smithi151 ceph-mon[34780]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.6 MiB/s wr, 603 op/s 2024-05-09T01:15:01.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:15:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:15:01.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:01 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:15:01.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:15:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:15:01.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:01 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:15:01.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:15:01.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:15:01.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:01 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:15:02.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:02 smithi151 ceph-mon[34780]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 625 op/s 2024-05-09T01:15:02.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:02 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:15:02.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:02 smithi136 ceph-mon[34110]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 625 op/s 2024-05-09T01:15:02.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:02 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:15:02.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:02 smithi037 ceph-mon[30122]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 625 op/s 2024-05-09T01:15:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:02 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:15:04.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:04 smithi136 ceph-mon[34110]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 MiB/s wr, 541 op/s 2024-05-09T01:15:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:04 smithi037 ceph-mon[30122]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 MiB/s wr, 541 op/s 2024-05-09T01:15:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:04 smithi151 ceph-mon[34780]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.7 MiB/s wr, 541 op/s 2024-05-09T01:15:05.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 765.0 s, 1436.2 tps, lat 68.904 ms stddev 77.778 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 -- 172.21.15.37:0/3651113897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 msgr2=0x7f9594103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 --2- 172.21.15.37:0/3651113897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f9594103f40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9584009900 tx=0x7f958402a410 comp rx=0 tx=0).stop 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 -- 172.21.15.37:0/3651113897 shutdown_connections 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 --2- 172.21.15.37:0/3651113897 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95941045d0 0x7f959410ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 --2- 172.21.15.37:0/3651113897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f9594103f40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 --2- 172.21.15.37:0/3651113897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95941030b0 0x7f95941034c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 -- 172.21.15.37:0/3651113897 >> 172.21.15.37:0/3651113897 conn(0x7f95940fd4d0 msgr2=0x7f95940ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 -- 172.21.15.37:0/3651113897 shutdown_connections 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.156+0000 7f959b6e0640 1 -- 172.21.15.37:0/3651113897 wait complete. 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 Processor -- start 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 -- start start 2024-05-09T01:15:06.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95941030b0 0x7f959419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f959419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95941045d0 0x7f95941a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f959410e6a0 con 0x7f9594103a90 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f959410e520 con 0x7f95941045d0 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959b6e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f959410e820 con 0x7f95941030b0 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f959419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f959419a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55144/0 (socket says 172.21.15.37:55144) 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 -- 172.21.15.37:0/2532674641 learned_addr learned my addr 172.21.15.37:0/2532674641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f959947c640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95941030b0 0x7f959419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 -- 172.21.15.37:0/2532674641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95941030b0 msgr2=0x7f959419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95941030b0 0x7f959419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 -- 172.21.15.37:0/2532674641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95941045d0 msgr2=0x7f95941a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95941045d0 0x7f95941a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.157+0000 7f9598c7b640 1 -- 172.21.15.37:0/2532674641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95941a1f70 con 0x7f9594103a90 2024-05-09T01:15:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.158+0000 7f9598c7b640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f959419a970 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9584006010 tx=0x7f9584004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.158+0000 7f958a7fc640 1 -- 172.21.15.37:0/2532674641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958403f030 con 0x7f9594103a90 2024-05-09T01:15:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.158+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95941a2200 con 0x7f9594103a90 2024-05-09T01:15:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.158+0000 7f958a7fc640 1 -- 172.21.15.37:0/2532674641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9584003cb0 con 0x7f9594103a90 2024-05-09T01:15:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.158+0000 7f958a7fc640 1 -- 172.21.15.37:0/2532674641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584035070 con 0x7f9594103a90 2024-05-09T01:15:06.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.158+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95941a2740 con 0x7f9594103a90 2024-05-09T01:15:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 Processor -- start 2024-05-09T01:15:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 -- start start 2024-05-09T01:15:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f958a7fc640 1 -- 172.21.15.37:0/2532674641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9584042030 con 0x7f9594103a90 2024-05-09T01:15:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077813500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x556077813a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5560777777c0 con 0x55607744e4d0 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5560777130e0 con 0x55607746f1b0 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f95a2599740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556077773780 con 0x5560774462f0 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f9598c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f9598c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55160/0 (socket says 172.21.15.37:55160) 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f9598c7b640 1 -- 172.21.15.37:0/4190550199 learned_addr learned my addr 172.21.15.37:0/4190550199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f9599c7d640 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077813500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.161+0000 7f959947c640 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x556077813a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f9599c7d640 1 -- 172.21.15.37:0/4190550199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 msgr2=0x556077813a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f9599c7d640 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x556077813a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f9599c7d640 1 -- 172.21.15.37:0/4190550199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 msgr2=0x55607781a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:06.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f9599c7d640 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f9599c7d640 1 -- 172.21.15.37:0/4190550199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607773c7c0 con 0x55607746f1b0 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f959947c640 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x556077813a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f958a7fc640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95800b27e0 0x7f95800b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f9599c7d640 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077813500 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f958c009c40 tx=0x7f958c00e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60bf4c13db68c5c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f959947c640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95800b27e0 0x7f95800b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f958a7fc640 1 -- 172.21.15.37:0/2532674641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9584102820 con 0x7f9594103a90 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f957f7fe640 1 -- 172.21.15.37:0/4190550199 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c016070 con 0x55607746f1b0 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f957f7fe640 1 -- 172.21.15.37:0/4190550199 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f958c005020 con 0x55607746f1b0 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.162+0000 7f957f7fe640 1 -- 172.21.15.37:0/4190550199 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c011690 con 0x55607746f1b0 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 -- 172.21.15.37:0/4190550199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 msgr2=0x556077813500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077813500 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f958c009c40 tx=0x7f958c00e6c0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f959947c640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95800b27e0 0x7f95800b4cf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5560778148e0 tx=0x7f959000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 -- 172.21.15.37:0/4190550199 shutdown_connections 2024-05-09T01:15:06.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x556077813a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 --2- 172.21.15.37:0/4190550199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077813500 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 -- 172.21.15.37:0/4190550199 >> 172.21.15.37:0/4190550199 conn(0x556077463300 msgr2=0x55607780ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 -- 172.21.15.37:0/4190550199 shutdown_connections 2024-05-09T01:15:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 -- 172.21.15.37:0/4190550199 wait complete. 2024-05-09T01:15:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.163+0000 7f95a2599740 1 -- start start 2024-05-09T01:15:06.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 1 Processor -- start 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x55607781d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077824780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55607781b3d0 con 0x55607744e4d0 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5560776fe9c0 con 0x55607746f1b0 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55607781b550 con 0x5560774462f0 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f95a2599740 10 client.0 _ll_register_callbacks cb 0x55607772b020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55174/0 (socket says 172.21.15.37:55174) 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 -- 172.21.15.37:0/49477257 learned_addr learned my addr 172.21.15.37:0/49477257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:06.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f959947c640 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x55607781d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9599c7d640 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077824780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 -- 172.21.15.37:0/49477257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 msgr2=0x55607781d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x55607781d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 -- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 msgr2=0x556077824780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077824780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.164+0000 7f9598c7b640 1 -- 172.21.15.37:0/49477257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560777251f0 con 0x55607744e4d0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f9598c7b640 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781d890 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f958402a450 tx=0x7f9584032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9379a827e263c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f957cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f957cff9640 1 -- 172.21.15.37:0/49477257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584049070 con 0x55607744e4d0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f957cff9640 1 -- 172.21.15.37:0/49477257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f958403bc20 con 0x55607744e4d0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958c005020 con 0x55607744e4d0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f957cff9640 1 -- 172.21.15.37:0/49477257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f95840c9cb0 con 0x55607744e4d0 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 10 client.17535 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:06.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5560774da790 con 0x55607744e4d0 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f957cff9640 1 -- 172.21.15.37:0/49477257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f958c005020 con 0x55607744e4d0 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f957cff9640 1 -- 172.21.15.37:0/49477257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f95840ca140 con 0x55607744e4d0 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 10 client.17535 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 10 client.17535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 20 client.17535 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55607742dd80 0x55607782ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 4 client.17535 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.165+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560777853d0 con 0x55607742dd80 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.166+0000 7f959947c640 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55607742dd80 0x55607782ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.166+0000 7f957cff9640 10 client.17535 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.166+0000 7f959947c640 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55607742dd80 0x55607782ace0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ded77210a9cafaa server_cookie=efe44ffaacf0161d in_seq=0 out_seq=0 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f957cff9640 1 -- 172.21.15.37:0/49477257 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5560777853d0 con 0x55607742dd80 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f957cff9640 10 client.17535 handle_command_reply: tid=0 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 client.17535 shutdown 2024-05-09T01:15:06.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 msgr2=0x55607781d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781d890 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f958402a450 tx=0x7f9584032f60 comp rx=0 tx=0).stop 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 shutdown_connections 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55607742dd80 0x55607782ace0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55607746f1b0 0x556077824780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x55607781d890 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 --2- 172.21.15.37:0/49477257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560774462f0 0x55607781d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f957cff9640 0 client.17535 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 >> 172.21.15.37:0/49477257 conn(0x556077463300 msgr2=0x556077811da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 shutdown_connections 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 1 -- 172.21.15.37:0/49477257 wait complete. 2024-05-09T01:15:06.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.167+0000 7f95a2599740 20 client.17535 trim_cache size 0 max 16384 2024-05-09T01:15:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.190+0000 7f95a2599740 1 Processor -- start 2024-05-09T01:15:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.191+0000 7f95a2599740 1 -- start start 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.191+0000 7f95a2599740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077817df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.191+0000 7f95a2599740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x5560778123a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.191+0000 7f95a2599740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778128e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.191+0000 7f95a2599740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ab320 con 0x55607744e4d0 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.191+0000 7f95a2599740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95941acec0 con 0x5560774462f0 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.191+0000 7f95a2599740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ab9f0 con 0x55607746f1b0 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.192+0000 7f9599c7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.192+0000 7f9599c7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778128e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37292/0 (socket says 172.21.15.37:37292) 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.192+0000 7f9599c7d640 1 -- 172.21.15.37:0/2540858702 learned_addr learned my addr 172.21.15.37:0/2540858702 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.194+0000 7f9599c7d640 1 -- 172.21.15.37:0/2540858702 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 msgr2=0x556077817df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.194+0000 7f9599c7d640 1 --2- 172.21.15.37:0/2540858702 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077817df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.194+0000 7f9599c7d640 1 -- 172.21.15.37:0/2540858702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 msgr2=0x5560778123a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:15:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.194+0000 7f9599c7d640 1 --2- 172.21.15.37:0/2540858702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x5560778123a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.194+0000 7f9599c7d640 1 -- 172.21.15.37:0/2540858702 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560775515f0 con 0x55607746f1b0 2024-05-09T01:15:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.196+0000 7f9599c7d640 1 --2- 172.21.15.37:0/2540858702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778128e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f958c005c40 tx=0x7f958c009910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4333b88e64654e93 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.196+0000 7f957effd640 1 -- 172.21.15.37:0/2540858702 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c028020 con 0x55607746f1b0 2024-05-09T01:15:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.196+0000 7f957effd640 1 -- 172.21.15.37:0/2540858702 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f958c005000 con 0x55607746f1b0 2024-05-09T01:15:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.197+0000 7f95a2599740 1 -- 172.21.15.37:0/2540858702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 msgr2=0x5560778128e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.197+0000 7f95a2599740 1 --2- 172.21.15.37:0/2540858702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778128e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f958c005c40 tx=0x7f958c009910 comp rx=0 tx=0).stop 2024-05-09T01:15:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.202+0000 7f95a2599740 1 -- 172.21.15.37:0/2540858702 shutdown_connections 2024-05-09T01:15:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.202+0000 7f95a2599740 1 --2- 172.21.15.37:0/2540858702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778128e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.202+0000 7f95a2599740 1 --2- 172.21.15.37:0/2540858702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x5560778123a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.202+0000 7f95a2599740 1 --2- 172.21.15.37:0/2540858702 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077817df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.202+0000 7f95a2599740 1 -- 172.21.15.37:0/2540858702 >> 172.21.15.37:0/2540858702 conn(0x556077463300 msgr2=0x556077811c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.209+0000 7f95a2599740 1 -- 172.21.15.37:0/2540858702 shutdown_connections 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.213+0000 7f95a2599740 1 -- 172.21.15.37:0/2540858702 wait complete. 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.214+0000 7f95a2599740 1 -- start start 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.214+0000 7f95a2599740 1 Processor -- start 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.214+0000 7f95a2599740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077822380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.214+0000 7f95a2599740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x5560778228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f95a2599740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778237f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f95a2599740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ac7f0 con 0x55607744e4d0 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f95a2599740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95941ac120 con 0x5560774462f0 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f95a2599740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95941a9300 con 0x55607746f1b0 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f95a2599740 10 client.0 _ll_register_callbacks cb 0x7f9584005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f959947c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077822380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f9599c7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f9599c7d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778237f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:37298/0 (socket says 172.21.15.37:37298) 2024-05-09T01:15:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.215+0000 7f9599c7d640 1 -- 172.21.15.37:0/1332966068 learned_addr learned my addr 172.21.15.37:0/1332966068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f959947c640 1 -- 172.21.15.37:0/1332966068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 msgr2=0x5560778237f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f959947c640 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778237f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f959947c640 1 -- 172.21.15.37:0/1332966068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 msgr2=0x5560778228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f959947c640 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x5560778228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f959947c640 1 -- 172.21.15.37:0/1332966068 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607773bed0 con 0x5560774462f0 2024-05-09T01:15:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f959947c640 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077822380 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55607782b480 tx=0x7f95900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e8b547d80a4cf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f957cff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.216+0000 7f957cff9640 1 -- 172.21.15.37:0/1332966068 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959001e9b0 con 0x5560774462f0 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.217+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f958c005000 con 0x5560774462f0 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.217+0000 7f957cff9640 1 -- 172.21.15.37:0/1332966068 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9590017030 con 0x5560774462f0 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.217+0000 7f957cff9640 1 -- 172.21.15.37:0/1332966068 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f959001eb50 con 0x5560774462f0 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.217+0000 7f95a2599740 10 client.27440 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.217+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x556077824f40 con 0x5560774462f0 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f957cff9640 1 -- 172.21.15.37:0/1332966068 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f958c005000 con 0x5560774462f0 2024-05-09T01:15:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f957cff9640 1 -- 172.21.15.37:0/1332966068 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f9590033020 con 0x5560774462f0 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f95a2599740 10 client.27440 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f95a2599740 10 client.27440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f95a2599740 20 client.27440 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f95a2599740 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5560774031c0 0x556077895530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f95a2599740 4 client.27440 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55607777f240 con 0x5560774031c0 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.218+0000 7f9598c7b640 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5560774031c0 0x556077895530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.219+0000 7f9598c7b640 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5560774031c0 0x556077895530 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0d557f629d529c server_cookie=638b485a0c4aa65e in_seq=0 out_seq=0 2024-05-09T01:15:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.219+0000 7f957cff9640 10 client.27440 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:06.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f957cff9640 1 -- 172.21.15.37:0/1332966068 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55607777f240 con 0x5560774031c0 2024-05-09T01:15:06.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f957cff9640 10 client.27440 handle_command_reply: tid=0 2024-05-09T01:15:06.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 client.27440 shutdown 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 msgr2=0x556077822380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077822380 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55607782b480 tx=0x7f95900046c0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 shutdown_connections 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5560774031c0 0x556077895530 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55607746f1b0 0x5560778237f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55607744e4d0 0x5560778228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 --2- 172.21.15.37:0/1332966068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5560774462f0 0x556077822380 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f957cff9640 0 client.27440 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.240+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 >> 172.21.15.37:0/1332966068 conn(0x556077463300 msgr2=0x5560778126c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.241+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 shutdown_connections 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.241+0000 7f95a2599740 1 -- 172.21.15.37:0/1332966068 wait complete. 2024-05-09T01:15:06.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.241+0000 7f95a2599740 20 client.27440 trim_cache size 0 max 16384 2024-05-09T01:15:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:15:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:15:06.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.242+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95800b27e0 msgr2=0x7f95800b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.242+0000 7f959b6e0640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95800b27e0 0x7f95800b4cf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x5560778148e0 tx=0x7f959000b390 comp rx=0 tx=0).stop 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.242+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 msgr2=0x7f959419a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.242+0000 7f959b6e0640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f959419a970 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9584006010 tx=0x7f9584004340 comp rx=0 tx=0).stop 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 shutdown_connections 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f95800b27e0 0x7f95800b4cf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95941045d0 0x7f95941a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9594103a90 0x7f959419a970 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 --2- 172.21.15.37:0/2532674641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95941030b0 0x7f959419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 >> 172.21.15.37:0/2532674641 conn(0x7f95940fd4d0 msgr2=0x7f9594109eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 shutdown_connections 2024-05-09T01:15:06.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:06.243+0000 7f959b6e0640 1 -- 172.21.15.37:0/2532674641 wait complete. 2024-05-09T01:15:06.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:06 smithi136 ceph-mon[34110]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 600 op/s 2024-05-09T01:15:06.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:06 smithi037 ceph-mon[30122]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 600 op/s 2024-05-09T01:15:06.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:06 smithi151 ceph-mon[34780]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 600 op/s 2024-05-09T01:15:08.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:08 smithi136 ceph-mon[34110]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 631 op/s 2024-05-09T01:15:08.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:08 smithi037 ceph-mon[30122]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 631 op/s 2024-05-09T01:15:08.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:08 smithi151 ceph-mon[34780]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 631 op/s 2024-05-09T01:15:09.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:15:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 770.0 s, 1648.6 tps, lat 61.397 ms stddev 82.435 2024-05-09T01:15:10.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:10 smithi136 ceph-mon[34110]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.9 MiB/s wr, 602 op/s 2024-05-09T01:15:10.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:10 smithi037 ceph-mon[30122]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.9 MiB/s wr, 602 op/s 2024-05-09T01:15:10.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:10 smithi151 ceph-mon[34780]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.9 MiB/s wr, 602 op/s 2024-05-09T01:15:11.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.638+0000 7f320edbd700 1 -- 172.21.15.37:0/1199210523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32081045e0 msgr2=0x7f32081049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.638+0000 7f320edbd700 1 --2- 172.21.15.37:0/1199210523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32081045e0 0x7f32081049f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0099c0 tx=0x7f31fc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.638+0000 7f320edbd700 1 -- 172.21.15.37:0/1199210523 shutdown_connections 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.638+0000 7f320edbd700 1 --2- 172.21.15.37:0/1199210523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3208109860 0x7f32081111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.638+0000 7f320edbd700 1 --2- 172.21.15.37:0/1199210523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32081045e0 0x7f32081049f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.638+0000 7f320edbd700 1 --2- 172.21.15.37:0/1199210523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3208108f10 0x7f3208109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.638+0000 7f320edbd700 1 -- 172.21.15.37:0/1199210523 >> 172.21.15.37:0/1199210523 conn(0x7f32080ffe70 msgr2=0x7f32081022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.639+0000 7f320edbd700 1 -- 172.21.15.37:0/1199210523 shutdown_connections 2024-05-09T01:15:11.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.639+0000 7f320edbd700 1 -- 172.21.15.37:0/1199210523 wait complete. 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.640+0000 7f320edbd700 1 Processor -- start 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.640+0000 7f320edbd700 1 -- start start 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.640+0000 7f320edbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32081045e0 0x7f320819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.640+0000 7f320edbd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3208108f10 0x7f320819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.640+0000 7f320edbd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3208109860 0x7f320819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320edbd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3208114490 con 0x7f32081045e0 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320edbd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3208114310 con 0x7f3208108f10 2024-05-09T01:15:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320edbd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3208114610 con 0x7f3208109860 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320cb59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32081045e0 0x7f320819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f3207fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3208108f10 0x7f320819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320cb59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32081045e0 0x7f320819ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44076/0 (socket says 172.21.15.37:44076) 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320cb59700 1 -- 172.21.15.37:0/3196182671 learned_addr learned my addr 172.21.15.37:0/3196182671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320d35a700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3208109860 0x7f320819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f3207fff700 1 -- 172.21.15.37:0/3196182671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3208109860 msgr2=0x7f320819f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f3207fff700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3208109860 0x7f320819f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f3207fff700 1 -- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32081045e0 msgr2=0x7f320819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f3207fff700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32081045e0 0x7f320819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f3207fff700 1 -- 172.21.15.37:0/3196182671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320819fc20 con 0x7f3208108f10 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320d35a700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3208109860 0x7f320819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f320cb59700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32081045e0 0x7f320819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.641+0000 7f3207fff700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3208108f10 0x7f320819b3a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009c20 tx=0x7f31f4009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:11.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.642+0000 7f3205ffb700 1 -- 172.21.15.37:0/3196182671 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f401e070 con 0x7f3208108f10 2024-05-09T01:15:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.642+0000 7f3205ffb700 1 -- 172.21.15.37:0/3196182671 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31f4019410 con 0x7f3208108f10 2024-05-09T01:15:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.642+0000 7f3205ffb700 1 -- 172.21.15.37:0/3196182671 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4018610 con 0x7f3208108f10 2024-05-09T01:15:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.642+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320819ff10 con 0x7f3208108f10 2024-05-09T01:15:11.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.642+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32081a0450 con 0x7f3208108f10 2024-05-09T01:15:11.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.646+0000 7f3205ffb700 1 -- 172.21.15.37:0/3196182671 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f31f4021070 con 0x7f3208108f10 2024-05-09T01:15:11.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.647+0000 7f3205ffb700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f31f80b2880 0x7f31f80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.648+0000 7f3205ffb700 1 -- 172.21.15.37:0/3196182671 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f31f40e5760 con 0x7f3208108f10 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.648+0000 7f320cb59700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f31f80b2880 0x7f31f80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.648+0000 7f321d7d3b80 1 Processor -- start 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.648+0000 7f321d7d3b80 1 -- start start 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.648+0000 7f320cb59700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f31f80b2880 0x7f31f80b4d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009990 tx=0x7f31fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.648+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffd5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56386fef80a0 con 0x56386fe584a0 2024-05-09T01:15:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56386fe9d9a0 con 0x56386ffd5400 2024-05-09T01:15:11.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56386fef4060 con 0x56386fed2d00 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320cb59700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320d35a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffd5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320cb59700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:56538/0 (socket says 172.21.15.37:56538) 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320cb59700 1 -- 172.21.15.37:0/1789091218 learned_addr learned my addr 172.21.15.37:0/1789091218 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f3207fff700 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320d35a700 1 -- 172.21.15.37:0/1789091218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 msgr2=0x56386ffdb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320d35a700 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320d35a700 1 -- 172.21.15.37:0/1789091218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 msgr2=0x56386ffdb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.649+0000 7f320d35a700 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.650+0000 7f320d35a700 1 -- 172.21.15.37:0/1789091218 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56386fe8e500 con 0x56386ffd5400 2024-05-09T01:15:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.650+0000 7f3207fff700 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:15:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.650+0000 7f320d35a700 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffd5810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f320000d1d0 tx=0x7f320000d4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99904b4cba409452 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.650+0000 7f31f2ffd700 1 -- 172.21.15.37:0/1789091218 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200016020 con 0x56386ffd5400 2024-05-09T01:15:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.650+0000 7f31f2ffd700 1 -- 172.21.15.37:0/1789091218 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32000128a0 con 0x56386ffd5400 2024-05-09T01:15:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.650+0000 7f31f2ffd700 1 -- 172.21.15.37:0/1789091218 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200011830 con 0x56386ffd5400 2024-05-09T01:15:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1789091218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 msgr2=0x56386ffd5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffd5810 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f320000d1d0 tx=0x7f320000d4e0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1789091218 shutdown_connections 2024-05-09T01:15:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffd5810 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1789091218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1789091218 >> 172.21.15.37:0/1789091218 conn(0x56386fe5bf70 msgr2=0x56386ffd0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1789091218 shutdown_connections 2024-05-09T01:15:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.651+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1789091218 wait complete. 2024-05-09T01:15:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 -- start start 2024-05-09T01:15:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 Processor -- start 2024-05-09T01:15:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffdf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56386ffd6160 con 0x56386fe584a0 2024-05-09T01:15:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56386fe92b20 con 0x56386ffd5400 2024-05-09T01:15:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56386ffe2020 con 0x56386fed2d00 2024-05-09T01:15:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.652+0000 7f321d7d3b80 10 client.0 _ll_register_callbacks cb 0x56386fd696c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.653+0000 7f320cb59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.653+0000 7f320d35a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffdf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.653+0000 7f320cb59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44092/0 (socket says 172.21.15.37:44092) 2024-05-09T01:15:11.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.653+0000 7f320cb59700 1 -- 172.21.15.37:0/3081999424 learned_addr learned my addr 172.21.15.37:0/3081999424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:11.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.653+0000 7f320d35a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffdf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39768/0 (socket says 172.21.15.37:39768) 2024-05-09T01:15:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.654+0000 7f3207fff700 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.654+0000 7f320cb59700 1 -- 172.21.15.37:0/3081999424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 msgr2=0x56386ffdf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.654+0000 7f320cb59700 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.654+0000 7f320cb59700 1 -- 172.21.15.37:0/3081999424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 msgr2=0x56386ffdf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.654+0000 7f320cb59700 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffdf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.654+0000 7f320cb59700 1 -- 172.21.15.37:0/3081999424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56386fd73490 con 0x56386fe584a0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.655+0000 7f320cb59700 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdef40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00b580 tx=0x7f31fc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a987911962b689 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.655+0000 7f31e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f31e7fff700 1 -- 172.21.15.37:0/3081999424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc035060 con 0x56386fe584a0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f31e7fff700 1 -- 172.21.15.37:0/3081999424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f31fc00f660 con 0x56386fe584a0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32000128a0 con 0x56386fe584a0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f31e7fff700 1 -- 172.21.15.37:0/3081999424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f31fc00f8a0 con 0x56386fe584a0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f321d7d3b80 10 client.17541 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56386ffec880 con 0x56386fe584a0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f31e7fff700 1 -- 172.21.15.37:0/3081999424 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32000128a0 con 0x56386fe584a0 2024-05-09T01:15:11.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.656+0000 7f31e7fff700 1 -- 172.21.15.37:0/3081999424 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f31fc03ba60 con 0x56386fe584a0 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f321d7d3b80 10 client.17541 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f321d7d3b80 10 client.17541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f321d7d3b80 20 client.17541 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x56386fff1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f321d7d3b80 4 client.17541 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56386ff05a80 con 0x56386ffeee10 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f3207fff700 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x56386fff1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f31e7fff700 10 client.17541 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:11.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.657+0000 7f3207fff700 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x56386fff1270 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef8ea0003b1e07dc server_cookie=6b054a38a48413da in_seq=0 out_seq=0 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f31e7fff700 1 -- 172.21.15.37:0/3081999424 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56386ff05a80 con 0x56386ffeee10 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f31e7fff700 10 client.17541 handle_command_reply: tid=0 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 client.17541 shutdown 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 msgr2=0x56386ffdef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdef40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00b580 tx=0x7f31fc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 shutdown_connections 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x56386fff1270 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f31e7fff700 0 client.17541 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386ffdf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fe584a0 0x56386ffdef40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/3081999424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fed2d00 0x56386ffdf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.659+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 >> 172.21.15.37:0/3081999424 conn(0x56386fe5bf70 msgr2=0x56386ffc9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.660+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 shutdown_connections 2024-05-09T01:15:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.660+0000 7f321d7d3b80 1 -- 172.21.15.37:0/3081999424 wait complete. 2024-05-09T01:15:11.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.660+0000 7f321d7d3b80 20 client.17541 trim_cache size 0 max 16384 2024-05-09T01:15:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.686+0000 7f321d7d3b80 1 Processor -- start 2024-05-09T01:15:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.686+0000 7f321d7d3b80 1 -- start start 2024-05-09T01:15:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386fe584a0 0x56386ffca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386ffeae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386ffd5400 0x56386ffdef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32081ac890 con 0x56386fed2d00 2024-05-09T01:15:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f32081ae430 con 0x56386fe584a0 2024-05-09T01:15:11.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32081acf60 con 0x56386ffd5400 2024-05-09T01:15:11.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f320d35a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386ffd5400 0x56386ffdef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.687+0000 7f320d35a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386ffd5400 0x56386ffdef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:56544/0 (socket says 172.21.15.37:56544) 2024-05-09T01:15:11.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.688+0000 7f320d35a700 1 -- 172.21.15.37:0/569547405 learned_addr learned my addr 172.21.15.37:0/569547405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:11.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.688+0000 7f320cb59700 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386fe584a0 0x56386ffca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.688+0000 7f3207fff700 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386ffeae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.689+0000 7f320cb59700 1 -- 172.21.15.37:0/569547405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386ffd5400 msgr2=0x56386ffdef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.689+0000 7f320cb59700 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386ffd5400 0x56386ffdef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.689+0000 7f320cb59700 1 -- 172.21.15.37:0/569547405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 msgr2=0x56386ffeae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.689+0000 7f320cb59700 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386ffeae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.689+0000 7f320cb59700 1 -- 172.21.15.37:0/569547405 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56386ffd0f40 con 0x56386fe584a0 2024-05-09T01:15:11.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.689+0000 7f320cb59700 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386fe584a0 0x56386ffca700 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c010 tx=0x7f31fc009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bbdb36137a12d34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.690+0000 7f31f27fc700 1 -- 172.21.15.37:0/569547405 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00fc40 con 0x56386fe584a0 2024-05-09T01:15:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.690+0000 7f31f27fc700 1 -- 172.21.15.37:0/569547405 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31fc00fde0 con 0x56386fe584a0 2024-05-09T01:15:11.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.690+0000 7f31f27fc700 1 -- 172.21.15.37:0/569547405 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc03b6c0 con 0x56386fe584a0 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 -- 172.21.15.37:0/569547405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386fe584a0 msgr2=0x56386ffca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386fe584a0 0x56386ffca700 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c010 tx=0x7f31fc009310 comp rx=0 tx=0).stop 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 -- 172.21.15.37:0/569547405 shutdown_connections 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386ffd5400 0x56386ffdef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386fe584a0 0x56386ffca700 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/569547405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386ffeae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 -- 172.21.15.37:0/569547405 >> 172.21.15.37:0/569547405 conn(0x56386fe5bf70 msgr2=0x56386ffc9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:11.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 -- 172.21.15.37:0/569547405 shutdown_connections 2024-05-09T01:15:11.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 -- 172.21.15.37:0/569547405 wait complete. 2024-05-09T01:15:11.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.691+0000 7f321d7d3b80 1 -- start start 2024-05-09T01:15:11.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.692+0000 7f321d7d3b80 1 Processor -- start 2024-05-09T01:15:11.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fe584a0 0x56386fff65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386fff6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f321d7d3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386fff7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32081add60 con 0x56386fed2d00 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f3207fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386fff6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f321d7d3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f32081ad690 con 0x56386ffd5400 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f3207fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386fff6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44108/0 (socket says 172.21.15.37:44108) 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f3207fff700 1 -- 172.21.15.37:0/1513470792 learned_addr learned my addr 172.21.15.37:0/1513470792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f320cb59700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fe584a0 0x56386fff65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32081aa870 con 0x56386fe584a0 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f320d35a700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386fff7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f321d7d3b80 10 client.0 _ll_register_callbacks cb 0x56386fd696c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f320cb59700 1 -- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 msgr2=0x56386fff7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.693+0000 7f320cb59700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386fff7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f320cb59700 1 -- 172.21.15.37:0/1513470792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 msgr2=0x56386fff6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f320cb59700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386fff6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f320cb59700 1 -- 172.21.15.37:0/1513470792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563870061030 con 0x56386fe584a0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f3207fff700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386fff6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31fc00fde0 con 0x56386fe584a0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f320cb59700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fe584a0 0x56386fff65e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x56386ffe01e0 tx=0x7f31fc009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cd56f742dbb44d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f31e7fff700 10 client.27424 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f31e7fff700 1 -- 172.21.15.37:0/1513470792 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc048070 con 0x56386fe584a0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f31e7fff700 1 -- 172.21.15.37:0/1513470792 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f31fc0269f0 con 0x56386fe584a0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f31e7fff700 1 -- 172.21.15.37:0/1513470792 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f31fc026c30 con 0x56386fe584a0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f321d7d3b80 10 client.27424 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.694+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=49}) -- 0x5638700621a0 con 0x56386fe584a0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f31e7fff700 1 -- 172.21.15.37:0/1513470792 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f31fc03b460 con 0x56386fe584a0 2024-05-09T01:15:11.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f321d7d3b80 10 client.27424 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:11.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f321d7d3b80 10 client.27424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:11.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f321d7d3b80 20 client.27424 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:11.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x5638700646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:11.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f321d7d3b80 4 client.27424 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:15:11.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56386feffb20 con 0x56386ffeee10 2024-05-09T01:15:11.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.695+0000 7f3207fff700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x5638700646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:11.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.696+0000 7f31e7fff700 10 client.27424 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:11.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.696+0000 7f3207fff700 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x5638700646a0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea46ba6ae9da6660 server_cookie=7b0f3fd6e0153f9f in_seq=0 out_seq=0 2024-05-09T01:15:11.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.697+0000 7f31e7fff700 1 -- 172.21.15.37:0/1513470792 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56386feffb20 con 0x56386ffeee10 2024-05-09T01:15:11.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.697+0000 7f31e7fff700 10 client.27424 handle_command_reply: tid=0 2024-05-09T01:15:11.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.697+0000 7f321d7d3b80 1 client.27424 shutdown 2024-05-09T01:15:11.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.698+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fe584a0 msgr2=0x56386fff65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.698+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fe584a0 0x56386fff65e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x56386ffe01e0 tx=0x7f31fc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 shutdown_connections 2024-05-09T01:15:11.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56386ffeee10 0x5638700646a0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56386ffd5400 0x56386fff7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386fe584a0 0x56386fff65e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f31e7fff700 0 client.27424 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:11.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 --2- 172.21.15.37:0/1513470792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56386fed2d00 0x56386fff6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 >> 172.21.15.37:0/1513470792 conn(0x56386fe5bf70 msgr2=0x56386ffd9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 shutdown_connections 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 1 -- 172.21.15.37:0/1513470792 wait complete. 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.699+0000 7f321d7d3b80 20 client.27424 trim_cache size 0 max 16384 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:15:11.701 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:15:11.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f31f80b2880 msgr2=0x7f31f80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f31f80b2880 0x7f31f80b4d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009990 tx=0x7f31fc01a040 comp rx=0 tx=0).stop 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3208108f10 msgr2=0x7f320819b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3208108f10 0x7f320819b3a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009c20 tx=0x7f31f4009f30 comp rx=0 tx=0).stop 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 shutdown_connections 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f31f80b2880 0x7f31f80b4d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3208109860 0x7f320819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32081045e0 0x7f320819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 --2- 172.21.15.37:0/3196182671 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3208108f10 0x7f320819b3a0 secure :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009c20 tx=0x7f31f4009f30 comp rx=0 tx=0).stop 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.700+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 >> 172.21.15.37:0/3196182671 conn(0x7f32080ffe70 msgr2=0x7f32081081c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.701+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 shutdown_connections 2024-05-09T01:15:11.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:11.701+0000 7f320edbd700 1 -- 172.21.15.37:0/3196182671 wait complete. 2024-05-09T01:15:12.474 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:12 smithi037 ceph-mon[30122]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-05-09T01:15:12.584 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:15:12.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:15:12.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:12 smithi136 ceph-mon[34110]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-05-09T01:15:12.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:12 smithi151 ceph-mon[34780]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-05-09T01:15:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:14.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:14 smithi037 ceph-mon[30122]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.3 MiB/s wr, 623 op/s 2024-05-09T01:15:14.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:14 smithi136 ceph-mon[34110]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.3 MiB/s wr, 623 op/s 2024-05-09T01:15:14.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:14 smithi151 ceph-mon[34780]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 6.3 MiB/s wr, 623 op/s 2024-05-09T01:15:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 775.0 s, 1895.8 tps, lat 52.261 ms stddev 60.420 2024-05-09T01:15:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.369+0000 7f6afd09e700 1 -- 172.21.15.37:0/2170056050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 msgr2=0x7f6af81038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.369+0000 7f6afd09e700 1 --2- 172.21.15.37:0/2170056050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 0x7f6af81038f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6af000b0a0 tx=0x7f6af000b3b0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.369+0000 7f6afd09e700 1 -- 172.21.15.37:0/2170056050 shutdown_connections 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.369+0000 7f6afd09e700 1 --2- 172.21.15.37:0/2170056050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108760 0x7f6af81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.369+0000 7f6afd09e700 1 --2- 172.21.15.37:0/2170056050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 0x7f6af81038f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.369+0000 7f6afd09e700 1 --2- 172.21.15.37:0/2170056050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8107e10 0x7f6af8108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.369+0000 7f6afd09e700 1 -- 172.21.15.37:0/2170056050 >> 172.21.15.37:0/2170056050 conn(0x7f6af80fef30 msgr2=0x7f6af8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.370+0000 7f6afd09e700 1 -- 172.21.15.37:0/2170056050 shutdown_connections 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.370+0000 7f6afd09e700 1 -- 172.21.15.37:0/2170056050 wait complete. 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.371+0000 7f6afd09e700 1 Processor -- start 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.371+0000 7f6afd09e700 1 -- start start 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.372+0000 7f6afd09e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 0x7f6af8118c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.372+0000 7f6afd09e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8107e10 0x7f6af8119170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.372+0000 7f6afd09e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8108760 0x7f6af8113e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.372+0000 7f6afd09e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81123e0 con 0x7f6af8107e10 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.372+0000 7f6afd09e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6af8112260 con 0x7f6af81034e0 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.372+0000 7f6afd09e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6af8112560 con 0x7f6af8108760 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8108760 0x7f6af8113e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8108760 0x7f6af8113e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:56566/0 (socket says 172.21.15.37:56566) 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af759e700 1 -- 172.21.15.37:0/1186042088 learned_addr learned my addr 172.21.15.37:0/1186042088 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af6d9d700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 0x7f6af8118c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af759e700 1 -- 172.21.15.37:0/1186042088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 msgr2=0x7f6af8118c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af759e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 0x7f6af8118c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af759e700 1 -- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8107e10 msgr2=0x7f6af8119170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.373+0000 7f6af759e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8107e10 0x7f6af8119170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.374+0000 7f6af759e700 1 -- 172.21.15.37:0/1186042088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af81146a0 con 0x7f6af8108760 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.374+0000 7f6af759e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8108760 0x7f6af8113e70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b550 tx=0x7f6aec00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.374+0000 7f6adffff700 1 -- 172.21.15.37:0/1186042088 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec015020 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.374+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af8114990 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.374+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af811e930 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.375+0000 7f6adffff700 1 -- 172.21.15.37:0/1186042088 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aec011ce0 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.375+0000 7f6adffff700 1 -- 172.21.15.37:0/1186042088 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec010d40 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.380+0000 7f6adffff700 1 -- 172.21.15.37:0/1186042088 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6aec018020 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.382+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae4005330 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.386+0000 7f6adffff700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6ae00b29c0 0x7f6ae00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.386+0000 7f6adffff700 1 -- 172.21.15.37:0/1186042088 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f6aec0e18a0 con 0x7f6af8108760 2024-05-09T01:15:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.388+0000 7f6af6d9d700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6ae00b29c0 0x7f6ae00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:15.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.393+0000 7f6adffff700 1 -- 172.21.15.37:0/1186042088 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6aec01f020 con 0x7f6af8108760 2024-05-09T01:15:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.396+0000 7f6af6d9d700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6ae00b29c0 0x7f6ae00b4ed0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6af000b070 tx=0x7f6af000b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:15.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.816+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ae4005620 con 0x7f6af8108760 2024-05-09T01:15:15.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.818+0000 7f6adffff700 1 -- 172.21.15.37:0/1186042088 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11939 (secure 0 0 0) 0x7f6aec0a95c0 con 0x7f6af8108760 2024-05-09T01:15:15.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:15:15.819 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:14:52.462307+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24491,24454,24445,24467,24446]},"id":1}]} 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6ae00b29c0 msgr2=0x7f6ae00b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6ae00b29c0 0x7f6ae00b4ed0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6af000b070 tx=0x7f6af000b700 comp rx=0 tx=0).stop 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8108760 msgr2=0x7f6af8113e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8108760 0x7f6af8113e70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00b550 tx=0x7f6aec00b910 comp rx=0 tx=0).stop 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 shutdown_connections 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6ae00b29c0 0x7f6ae00b4ed0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6af8108760 0x7f6af8113e70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6af81034e0 0x7f6af8118c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 --2- 172.21.15.37:0/1186042088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8107e10 0x7f6af8119170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:15.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.822+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 >> 172.21.15.37:0/1186042088 conn(0x7f6af80fef30 msgr2=0x7f6af81096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:15.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.823+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 shutdown_connections 2024-05-09T01:15:15.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:15.823+0000 7f6afd09e700 1 -- 172.21.15.37:0/1186042088 wait complete. 2024-05-09T01:15:15.826 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 49 2024-05-09T01:15:16.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:16 smithi037 ceph-mon[30122]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 668 op/s 2024-05-09T01:15:16.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:16 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1186042088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:15:16.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:15:16.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:16 smithi151 ceph-mon[34780]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 668 op/s 2024-05-09T01:15:16.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:16 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1186042088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:15:16.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:16 smithi136 ceph-mon[34110]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 668 op/s 2024-05-09T01:15:16.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:16 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1186042088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:15:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:18.616 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:18 smithi037 ceph-mon[30122]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 685 op/s 2024-05-09T01:15:18.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:18 smithi151 ceph-mon[34780]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 685 op/s 2024-05-09T01:15:18.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:18 smithi136 ceph-mon[34110]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 685 op/s 2024-05-09T01:15:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.399+0000 7f98ae986640 1 -- 172.21.15.37:0/4043168388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98a81101a0 msgr2=0x7f98a81105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.399+0000 7f98ae986640 1 --2- 172.21.15.37:0/4043168388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98a81101a0 0x7f98a81105b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f989c009900 tx=0x7f989c02a410 comp rx=0 tx=0).stop 2024-05-09T01:15:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.400+0000 7f98ae986640 1 -- 172.21.15.37:0/4043168388 shutdown_connections 2024-05-09T01:15:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.400+0000 7f98ae986640 1 --2- 172.21.15.37:0/4043168388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98a81101a0 0x7f98a81105b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.400+0000 7f98ae986640 1 --2- 172.21.15.37:0/4043168388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a810b480 0x7f98a810b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.400+0000 7f98ae986640 1 --2- 172.21.15.37:0/4043168388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98a810a550 0x7f98a810af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.400+0000 7f98ae986640 1 -- 172.21.15.37:0/4043168388 >> 172.21.15.37:0/4043168388 conn(0x7f98a8070670 msgr2=0x7f98a8072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.403+0000 7f98ae986640 1 -- 172.21.15.37:0/4043168388 shutdown_connections 2024-05-09T01:15:19.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.403+0000 7f98ae986640 1 -- 172.21.15.37:0/4043168388 wait complete. 2024-05-09T01:15:19.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.404+0000 7f98ae986640 1 Processor -- start 2024-05-09T01:15:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.405+0000 7f98ae986640 1 -- start start 2024-05-09T01:15:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.405+0000 7f98ae986640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98a810a550 0x7f98a81170a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.405+0000 7f98ae986640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98a810b480 0x7f98a81175e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.405+0000 7f98ae986640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a81101a0 0x7f98a8118540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.405+0000 7f98ae986640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98a811e750 con 0x7f98a810b480 2024-05-09T01:15:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.405+0000 7f98ae986640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f98a811e5d0 con 0x7f98a81101a0 2024-05-09T01:15:19.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.405+0000 7f98ae986640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f98a811e8d0 con 0x7f98a810a550 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.406+0000 7f98acf23640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a81101a0 0x7f98a8118540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.406+0000 7f98acf23640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a81101a0 0x7f98a8118540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39846/0 (socket says 172.21.15.37:39846) 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.406+0000 7f98acf23640 1 -- 172.21.15.37:0/508303265 learned_addr learned my addr 172.21.15.37:0/508303265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.406+0000 7f98acf23640 1 -- 172.21.15.37:0/508303265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98a810a550 msgr2=0x7f98a81170a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.406+0000 7f98acf23640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98a810a550 0x7f98a81170a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.407+0000 7f98acf23640 1 -- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98a810b480 msgr2=0x7f98a81175e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.407+0000 7f98acf23640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98a810b480 0x7f98a81175e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.407+0000 7f98acf23640 1 -- 172.21.15.37:0/508303265 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a8118bb0 con 0x7f98a81101a0 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.407+0000 7f98acf23640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a81101a0 0x7f98a8118540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f989c030bc0 tx=0x7f989c030bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.407+0000 7f98a57fa640 1 -- 172.21.15.37:0/508303265 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c040070 con 0x7f98a81101a0 2024-05-09T01:15:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.408+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a8118e40 con 0x7f98a81101a0 2024-05-09T01:15:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.408+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a8119400 con 0x7f98a81101a0 2024-05-09T01:15:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.408+0000 7f98a57fa640 1 -- 172.21.15.37:0/508303265 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f989c03cb20 con 0x7f98a81101a0 2024-05-09T01:15:19.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.408+0000 7f98a57fa640 1 -- 172.21.15.37:0/508303265 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c035030 con 0x7f98a81101a0 2024-05-09T01:15:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.411+0000 7f98b583f740 1 Processor -- start 2024-05-09T01:15:19.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.412+0000 7f98a57fa640 1 -- 172.21.15.37:0/508303265 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f989c031640 con 0x7f98a81101a0 2024-05-09T01:15:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98b583f740 1 -- start start 2024-05-09T01:15:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98b583f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa98f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98b583f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa98fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98b583f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa996980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98b583f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5600aa8f37c0 con 0x5600aa5ca4d0 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98b583f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5600aa88f0e0 con 0x5600aa5c22f0 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98b583f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5600aa8ef780 con 0x5600aa5eb1b0 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98a7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa98fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98a7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa98fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39850/0 (socket says 172.21.15.37:39850) 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f98a7fff640 1 -- 172.21.15.37:0/2361148998 learned_addr learned my addr 172.21.15.37:0/2361148998 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f98a7fff640 1 -- 172.21.15.37:0/2361148998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 msgr2=0x5600aa98f500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f98a7fff640 1 --2- 172.21.15.37:0/2361148998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa98f500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f98a7fff640 1 -- 172.21.15.37:0/2361148998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 msgr2=0x5600aa996980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f98a7fff640 1 --2- 172.21.15.37:0/2361148998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa996980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f98a7fff640 1 -- 172.21.15.37:0/2361148998 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600aa8b87c0 con 0x5600aa5c22f0 2024-05-09T01:15:19.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f98a7fff640 1 --2- 172.21.15.37:0/2361148998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa98fa80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009d50 tx=0x7f98a000b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=823438b2dc1e0c32 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f988e7fc640 1 -- 172.21.15.37:0/2361148998 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a000bd40 con 0x5600aa5c22f0 2024-05-09T01:15:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.415+0000 7f988e7fc640 1 -- 172.21.15.37:0/2361148998 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98a0017070 con 0x5600aa5c22f0 2024-05-09T01:15:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.416+0000 7f98b583f740 1 -- 172.21.15.37:0/2361148998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 msgr2=0x5600aa98fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.416+0000 7f98b583f740 1 --2- 172.21.15.37:0/2361148998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa98fa80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009d50 tx=0x7f98a000b420 comp rx=0 tx=0).stop 2024-05-09T01:15:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.416+0000 7f98a57fa640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98900b2920 0x7f98900b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.417+0000 7f98a57fa640 1 -- 172.21.15.37:0/508303265 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f989c102e10 con 0x7f98a81101a0 2024-05-09T01:15:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.417+0000 7f98a77fe640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98900b2920 0x7f98900b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.418+0000 7f98b583f740 1 -- 172.21.15.37:0/2361148998 shutdown_connections 2024-05-09T01:15:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.418+0000 7f98b583f740 1 --2- 172.21.15.37:0/2361148998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa996980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.418+0000 7f98b583f740 1 --2- 172.21.15.37:0/2361148998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa98fa80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.418+0000 7f98b583f740 1 --2- 172.21.15.37:0/2361148998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa98f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.418+0000 7f98b583f740 1 -- 172.21.15.37:0/2361148998 >> 172.21.15.37:0/2361148998 conn(0x5600aa5df300 msgr2=0x5600aa98ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.418+0000 7f98b583f740 1 -- 172.21.15.37:0/2361148998 shutdown_connections 2024-05-09T01:15:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.418+0000 7f98b583f740 1 -- 172.21.15.37:0/2361148998 wait complete. 2024-05-09T01:15:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.419+0000 7f98a77fe640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98900b2920 0x7f98900b4e30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9898006fd0 tx=0x7f9898006c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.419+0000 7f98b583f740 1 -- start start 2024-05-09T01:15:19.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.419+0000 7f98b583f740 1 Processor -- start 2024-05-09T01:15:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98b583f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa999220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98b583f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5ca4d0 0x5600aa999760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98b583f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa9a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98b583f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5600aa997420 con 0x5600aa5c22f0 2024-05-09T01:15:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98b583f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5600aa87a9c0 con 0x5600aa5ca4d0 2024-05-09T01:15:19.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98b583f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5600aa9975a0 con 0x5600aa5eb1b0 2024-05-09T01:15:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98b583f740 10 client.0 _ll_register_callbacks cb 0x5600aa8a7020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:19.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98acf23640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa9a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98acf23640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa9a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:56648/0 (socket says 172.21.15.37:56648) 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f98acf23640 1 -- 172.21.15.37:0/2828248852 learned_addr learned my addr 172.21.15.37:0/2828248852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98a77fe640 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5ca4d0 0x5600aa999760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98acf23640 1 -- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5ca4d0 msgr2=0x5600aa999760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98acf23640 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5ca4d0 0x5600aa999760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98acf23640 1 -- 172.21.15.37:0/2828248852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 msgr2=0x5600aa999220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98acf23640 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa999220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98acf23640 1 -- 172.21.15.37:0/2828248852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600aa8a11f0 con 0x5600aa5eb1b0 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98a77fe640 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5ca4d0 0x5600aa999760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:15:19.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f98acf23640 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa9a06c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f989c031a10 tx=0x7f989c0c9ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a7930b4eaf57299 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.422+0000 7f98877fe640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:15:19.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.422+0000 7f98877fe640 1 -- 172.21.15.37:0/2828248852 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c049040 con 0x5600aa5eb1b0 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.422+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98a0017070 con 0x5600aa5eb1b0 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.422+0000 7f98877fe640 1 -- 172.21.15.37:0/2828248852 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f989c0ca690 con 0x5600aa5eb1b0 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.422+0000 7f98877fe640 1 -- 172.21.15.37:0/2828248852 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f989c0b30d0 con 0x5600aa5eb1b0 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.422+0000 7f98b583f740 10 client.27451 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.422+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5600aa656790 con 0x5600aa5eb1b0 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98877fe640 1 -- 172.21.15.37:0/2828248852 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98a0017070 con 0x5600aa5eb1b0 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98877fe640 1 -- 172.21.15.37:0/2828248852 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f989c03a040 con 0x5600aa5eb1b0 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98b583f740 10 client.27451 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98b583f740 10 client.27451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98b583f740 20 client.27451 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98b583f740 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa5a9d80 0x5600aa9a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98b583f740 4 client.27451 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:19.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600aa9013d0 con 0x5600aa5a9d80 2024-05-09T01:15:19.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.424+0000 7f98a7fff640 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa5a9d80 0x5600aa9a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.426+0000 7f98a7fff640 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa5a9d80 0x5600aa9a6ea0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20da5b4a3bd5e663 server_cookie=6049c73896472ad8 in_seq=0 out_seq=0 2024-05-09T01:15:19.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.426+0000 7f98877fe640 10 client.27451 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.427+0000 7f98877fe640 1 -- 172.21.15.37:0/2828248852 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5600aa9013d0 con 0x5600aa5a9d80 2024-05-09T01:15:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.427+0000 7f98877fe640 10 client.27451 handle_command_reply: tid=0 2024-05-09T01:15:19.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.427+0000 7f98b583f740 1 client.27451 shutdown 2024-05-09T01:15:19.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 msgr2=0x5600aa9a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa9a06c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f989c031a10 tx=0x7f989c0c9ba0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 shutdown_connections 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa5a9d80 0x5600aa9a6ea0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa9a06c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5ca4d0 0x5600aa999760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 --2- 172.21.15.37:0/2828248852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa999220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 >> 172.21.15.37:0/2828248852 conn(0x5600aa5df300 msgr2=0x5600aa989700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.428+0000 7f98877fe640 0 client.27451 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.429+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 shutdown_connections 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.429+0000 7f98b583f740 1 -- 172.21.15.37:0/2828248852 wait complete. 2024-05-09T01:15:19.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.429+0000 7f98b583f740 20 client.27451 trim_cache size 0 max 16384 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.456+0000 7f98b583f740 1 Processor -- start 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.456+0000 7f98b583f740 1 -- start start 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.456+0000 7f98b583f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa9a6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.456+0000 7f98b583f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5ca4d0 0x5600aa993540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.456+0000 7f98b583f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5eb1b0 0x5600aa993a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa9a6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98b583f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f989400e440 con 0x5600aa5c22f0 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98b583f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f989400ffe0 con 0x5600aa5eb1b0 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98b583f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f989400eb10 con 0x5600aa5ca4d0 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa9a6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44208/0 (socket says 172.21.15.37:44208) 2024-05-09T01:15:19.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 -- 172.21.15.37:0/3809540630 learned_addr learned my addr 172.21.15.37:0/3809540630 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a77fe640 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5ca4d0 0x5600aa993540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98acf23640 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5eb1b0 0x5600aa993a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 -- 172.21.15.37:0/3809540630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5ca4d0 msgr2=0x5600aa993540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5ca4d0 0x5600aa993540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 -- 172.21.15.37:0/3809540630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5eb1b0 msgr2=0x5600aa993a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5eb1b0 0x5600aa993a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98a7fff640 1 -- 172.21.15.37:0/3809540630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600aa6cd5f0 con 0x5600aa5c22f0 2024-05-09T01:15:19.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.457+0000 7f98acf23640 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5eb1b0 0x5600aa993a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.458+0000 7f98a7fff640 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa9a6fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f98a0004a80 tx=0x7f98a0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b840b5f2dfd2bb6e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.458+0000 7f988dffb640 1 -- 172.21.15.37:0/3809540630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00119f0 con 0x5600aa5c22f0 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.458+0000 7f988dffb640 1 -- 172.21.15.37:0/3809540630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98a0020070 con 0x5600aa5c22f0 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.458+0000 7f988dffb640 1 -- 172.21.15.37:0/3809540630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0025a60 con 0x5600aa5c22f0 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.459+0000 7f98b583f740 1 -- 172.21.15.37:0/3809540630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 msgr2=0x5600aa9a6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.459+0000 7f98b583f740 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa9a6fe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f98a0004a80 tx=0x7f98a0009f60 comp rx=0 tx=0).stop 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.459+0000 7f98b583f740 1 -- 172.21.15.37:0/3809540630 shutdown_connections 2024-05-09T01:15:19.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.459+0000 7f98b583f740 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5eb1b0 0x5600aa993a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.459+0000 7f98b583f740 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5ca4d0 0x5600aa993540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.459+0000 7f98b583f740 1 --2- 172.21.15.37:0/3809540630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5c22f0 0x5600aa9a6fe0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.459+0000 7f98b583f740 1 -- 172.21.15.37:0/3809540630 >> 172.21.15.37:0/3809540630 conn(0x5600aa5df300 msgr2=0x5600aa997a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.460+0000 7f98b583f740 1 -- 172.21.15.37:0/3809540630 shutdown_connections 2024-05-09T01:15:19.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.460+0000 7f98b583f740 1 -- 172.21.15.37:0/3809540630 wait complete. 2024-05-09T01:15:19.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.460+0000 7f98b583f740 1 -- start start 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.460+0000 7f98b583f740 1 Processor -- start 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98b583f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa9a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98b583f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa99d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98b583f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa99dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98a77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa99d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98a77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa99d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44214/0 (socket says 172.21.15.37:44214) 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98a7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa9a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98a7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa9a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39900/0 (socket says 172.21.15.37:39900) 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98a77fe640 1 -- 172.21.15.37:0/3939690444 learned_addr learned my addr 172.21.15.37:0/3939690444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f989400f910 con 0x5600aa5ca4d0 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f989400f240 con 0x5600aa5c22f0 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f989400c420 con 0x5600aa5eb1b0 2024-05-09T01:15:19.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.461+0000 7f98acf23640 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa99dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98a7fff640 1 -- 172.21.15.37:0/3939690444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 msgr2=0x5600aa99dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98a7fff640 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa99dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98a7fff640 1 -- 172.21.15.37:0/3939690444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 msgr2=0x5600aa99d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98a7fff640 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa99d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98a7fff640 1 -- 172.21.15.37:0/3939690444 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600aa8b7ed0 con 0x5600aa5c22f0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98acf23640 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa99dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98b583f740 10 client.0 _ll_register_callbacks cb 0x7f989c030f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98a0020070 con 0x5600aa5c22f0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98a7fff640 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa9a0e00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98a0004b90 tx=0x7f98a00253c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda484b7817b1342 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98877fe640 10 client.27488 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98877fe640 1 -- 172.21.15.37:0/3939690444 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0011840 con 0x5600aa5c22f0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.462+0000 7f98877fe640 1 -- 172.21.15.37:0/3939690444 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f98a0022040 con 0x5600aa5c22f0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.463+0000 7f98877fe640 1 -- 172.21.15.37:0/3939690444 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f98a00119e0 con 0x5600aa5c22f0 2024-05-09T01:15:19.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.463+0000 7f98b583f740 10 client.27488 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.463+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({fsmap=49}) -- 0x5600aaa0e150 con 0x5600aa5c22f0 2024-05-09T01:15:19.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.464+0000 7f98877fe640 1 -- 172.21.15.37:0/3939690444 <== mon.2 v2:172.21.15.136:3300/0 4 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f98a0011070 con 0x5600aa5c22f0 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.465+0000 7f98b583f740 10 client.27488 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.465+0000 7f98b583f740 10 client.27488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.465+0000 7f98b583f740 20 client.27488 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.465+0000 7f98b583f740 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa57f1c0 0x5600aaa10810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.465+0000 7f98b583f740 4 client.27488 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.465+0000 7f98a77fe640 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa57f1c0 0x5600aaa10810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.465+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600aa8fb240 con 0x5600aa57f1c0 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.466+0000 7f98a77fe640 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa57f1c0 0x5600aaa10810 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e75707d2e82cfb6d server_cookie=845405ecbf540f24 in_seq=0 out_seq=0 2024-05-09T01:15:19.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.466+0000 7f98877fe640 10 client.27488 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.475+0000 7f98877fe640 1 -- 172.21.15.37:0/3939690444 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5600aa8fb240 con 0x5600aa57f1c0 2024-05-09T01:15:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.475+0000 7f98877fe640 10 client.27488 handle_command_reply: tid=0 2024-05-09T01:15:19.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.475+0000 7f98b583f740 1 client.27488 shutdown 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 msgr2=0x5600aa9a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa9a0e00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98a0004b90 tx=0x7f98a00253c0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 shutdown_connections 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5600aa57f1c0 0x5600aaa10810 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600aa5eb1b0 0x5600aa99dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5600aa5ca4d0 0x5600aa99d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98877fe640 0 client.27488 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 --2- 172.21.15.37:0/3939690444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5600aa5c22f0 0x5600aa9a0e00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 >> 172.21.15.37:0/3939690444 conn(0x5600aa5df300 msgr2=0x5600aa999180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 shutdown_connections 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 1 -- 172.21.15.37:0/3939690444 wait complete. 2024-05-09T01:15:19.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.477+0000 7f98b583f740 20 client.27488 trim_cache size 0 max 16384 2024-05-09T01:15:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:15:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:15:19.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98900b2920 msgr2=0x7f98900b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98900b2920 0x7f98900b4e30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9898006fd0 tx=0x7f9898006c40 comp rx=0 tx=0).stop 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a81101a0 msgr2=0x7f98a8118540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a81101a0 0x7f98a8118540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f989c030bc0 tx=0x7f989c030bf0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 shutdown_connections 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98900b2920 0x7f98900b4e30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a81101a0 0x7f98a8118540 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98a810b480 0x7f98a81175e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 --2- 172.21.15.37:0/508303265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98a810a550 0x7f98a81170a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 >> 172.21.15.37:0/508303265 conn(0x7f98a8070670 msgr2=0x7f98a810c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 shutdown_connections 2024-05-09T01:15:19.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:19.478+0000 7f98ae986640 1 -- 172.21.15.37:0/508303265 wait complete. 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 -- 172.21.15.37:0/3588520062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 msgr2=0x7f8de41038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 --2- 172.21.15.37:0/3588520062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de41038d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009920 tx=0x7f8dd4009c30 comp rx=0 tx=0).stop 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 -- 172.21.15.37:0/3588520062 shutdown_connections 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 --2- 172.21.15.37:0/3588520062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de4108740 0x7f8de41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 --2- 172.21.15.37:0/3588520062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de41038d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 --2- 172.21.15.37:0/3588520062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de4107df0 0x7f8de4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 -- 172.21.15.37:0/3588520062 >> 172.21.15.37:0/3588520062 conn(0x7f8de40fedc0 msgr2=0x7f8de41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 -- 172.21.15.37:0/3588520062 shutdown_connections 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.341+0000 7f8de8861700 1 -- 172.21.15.37:0/3588520062 wait complete. 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.342+0000 7f8de8861700 1 Processor -- start 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.345+0000 7f8de8861700 1 -- start start 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.345+0000 7f8de8861700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.345+0000 7f8de8861700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de4107df0 0x7f8de4199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.345+0000 7f8de8861700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de4108740 0x7f8de4199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.345+0000 7f8de8861700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41122d0 con 0x7f8de41034c0 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.345+0000 7f8de8861700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4112150 con 0x7f8de4108740 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.345+0000 7f8de8861700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4112450 con 0x7f8de4107df0 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de4107df0 0x7f8de4199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de4198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44142/0 (socket says 172.21.15.37:44142) 2024-05-09T01:15:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de259c700 1 -- 172.21.15.37:0/3352577306 learned_addr learned my addr 172.21.15.37:0/3352577306 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de2d9d700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de4108740 0x7f8de4199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de1d9b700 1 -- 172.21.15.37:0/3352577306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de4108740 msgr2=0x7f8de4199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de4108740 0x7f8de4199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de1d9b700 1 -- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 msgr2=0x7f8de4198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de4198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de1d9b700 1 -- 172.21.15.37:0/3352577306 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de41ad6b0 con 0x7f8de4107df0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de259c700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de4107df0 0x7f8de4199050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005fd0 tx=0x7f8dd800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.346+0000 7f8dd37fe700 1 -- 172.21.15.37:0/3352577306 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800cbd0 con 0x7f8de4107df0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.347+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de41ad940 con 0x7f8de4107df0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.347+0000 7f8dd37fe700 1 -- 172.21.15.37:0/3352577306 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd80044d0 con 0x7f8de4107df0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.347+0000 7f8dd37fe700 1 -- 172.21.15.37:0/3352577306 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8010430 con 0x7f8de4107df0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.347+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de41ade80 con 0x7f8de4107df0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.350+0000 7f8dd37fe700 1 -- 172.21.15.37:0/3352577306 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8dd8004020 con 0x7f8de4107df0 2024-05-09T01:15:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.351+0000 7f8dd37fe700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8dcc0b2860 0x7f8dcc0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.352+0000 7f8dd37fe700 1 -- 172.21.15.37:0/3352577306 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8dd80e2360 con 0x7f8de4107df0 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.352+0000 7f8de259c700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8dcc0b2860 0x7f8dcc0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.352+0000 7f8df7277b80 1 Processor -- start 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.352+0000 7f8df7277b80 1 -- start start 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8dcc0b2860 0x7f8dcc0b4d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009680 tx=0x7f8dd4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x557505978780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 0x557505972810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8df7277b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5575058950a0 con 0x5575057f54a0 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8df7277b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55750583a9a0 con 0x557505972400 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8df7277b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557505891060 con 0x55750586fd00 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x557505978780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:56586/0 (socket says 172.21.15.37:56586) 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 -- 172.21.15.37:0/1425311849 learned_addr learned my addr 172.21.15.37:0/1425311849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de2d9d700 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 0x557505972810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 -- 172.21.15.37:0/1425311849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 msgr2=0x557505972810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 0x557505972810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 -- 172.21.15.37:0/1425311849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 msgr2=0x557505978780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x557505978780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.353+0000 7f8de259c700 1 -- 172.21.15.37:0/1425311849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55750582b500 con 0x55750586fd00 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.354+0000 7f8de259c700 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505978240 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400f990 tx=0x7f8dd401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=127a476369e0e1de server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.354+0000 7f8dd0ff9700 1 -- 172.21.15.37:0/1425311849 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4033070 con 0x55750586fd00 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.354+0000 7f8dd0ff9700 1 -- 172.21.15.37:0/1425311849 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd40056d0 con 0x55750586fd00 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.356+0000 7f8df7277b80 1 -- 172.21.15.37:0/1425311849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 msgr2=0x557505978240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.356+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505978240 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400f990 tx=0x7f8dd401f000 comp rx=0 tx=0).stop 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.356+0000 7f8df7277b80 1 -- 172.21.15.37:0/1425311849 shutdown_connections 2024-05-09T01:15:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.356+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 0x557505972810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.357+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.357+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1425311849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x557505978780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.357+0000 7f8df7277b80 1 -- 172.21.15.37:0/1425311849 >> 172.21.15.37:0/1425311849 conn(0x5575057f8f70 msgr2=0x55750596d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.357+0000 7f8df7277b80 1 -- 172.21.15.37:0/1425311849 shutdown_connections 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.357+0000 7f8df7277b80 1 -- 172.21.15.37:0/1425311849 wait complete. 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.358+0000 7f8df7277b80 1 -- start start 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.358+0000 7f8df7277b80 1 Processor -- start 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5575057f54a0 0x55750597bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x55750597c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557505972400 0x55750597c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8df7277b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5575059731a0 con 0x557505972400 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8df7277b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55750582fb20 con 0x5575057f54a0 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8df7277b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55750597f020 con 0x55750586fd00 2024-05-09T01:15:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8df7277b80 10 client.0 _ll_register_callbacks cb 0x5575057066c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5575057f54a0 0x55750597bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:15:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5575057f54a0 0x55750597bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39826/0 (socket says 172.21.15.37:39826) 2024-05-09T01:15:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 -- 172.21.15.37:0/1198217955 learned_addr learned my addr 172.21.15.37:0/1198217955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de2d9d700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557505972400 0x55750597c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x55750597c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 -- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 msgr2=0x55750597c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x55750597c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 -- 172.21.15.37:0/1198217955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557505972400 msgr2=0x55750597c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557505972400 0x55750597c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de259c700 1 -- 172.21.15.37:0/1198217955 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557505710490 con 0x5575057f54a0 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de2d9d700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557505972400 0x55750597c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.359+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x55750597c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.360+0000 7f8de259c700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5575057f54a0 0x55750597bf70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4011040 tx=0x7f8dd4003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b6ab0b0e55ce0a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.360+0000 7f8dc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.360+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/1198217955 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd403c060 con 0x5575057f54a0 2024-05-09T01:15:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.360+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd40056d0 con 0x5575057f54a0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.360+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/1198217955 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8dd4003c00 con 0x5575057f54a0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.361+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/1198217955 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f8dd4033040 con 0x5575057f54a0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.361+0000 7f8df7277b80 10 client.27473 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.361+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5575059899d0 con 0x5575057f54a0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/1198217955 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd400f9c0 con 0x5575057f54a0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/1198217955 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f8dd4041070 con 0x5575057f54a0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8df7277b80 10 client.27473 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8df7277b80 10 client.27473 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8df7277b80 20 client.27473 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x55750598e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8df7277b80 4 client.27473 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.364+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8dd40056d0 con 0x55750598bea0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.372+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x55750598e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.373+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x55750598e310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5601bb90bf7cc9bc server_cookie=bf1e1eeba88a8573 in_seq=0 out_seq=0 2024-05-09T01:15:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.373+0000 7f8dc9ffb700 10 client.27473 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.375+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/1198217955 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f8dd40056d0 con 0x55750598bea0 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.375+0000 7f8dc9ffb700 10 client.27473 handle_command_reply: tid=0 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.375+0000 7f8df7277b80 1 client.27473 shutdown 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5575057f54a0 msgr2=0x55750597bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5575057f54a0 0x55750597bf70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4011040 tx=0x7f8dd4003960 comp rx=0 tx=0).stop 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 shutdown_connections 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x55750598e310 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557505972400 0x55750597c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8dc9ffb700 0 client.27473 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5575057f54a0 0x55750597bf70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 --2- 172.21.15.37:0/1198217955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x55750597c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.376+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 >> 172.21.15.37:0/1198217955 conn(0x5575057f8f70 msgr2=0x557505966ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.377+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 shutdown_connections 2024-05-09T01:15:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.377+0000 7f8df7277b80 1 -- 172.21.15.37:0/1198217955 wait complete. 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.379+0000 7f8df7277b80 20 client.27473 trim_cache size 0 max 16384 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.412+0000 7f8df7277b80 1 Processor -- start 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.412+0000 7f8df7277b80 1 -- start start 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x55750597e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505967700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f8de259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x55750597e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.413+0000 7f8de259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x55750597e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44180/0 (socket says 172.21.15.37:44180) 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f8de259c700 1 -- 172.21.15.37:0/937243861 learned_addr learned my addr 172.21.15.37:0/937243861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505967700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f8df7277b80 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 0x557505987ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b5240 con 0x5575057f54a0 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.414+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b6de0 con 0x557505972400 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.415+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b5910 con 0x55750586fd00 2024-05-09T01:15:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.415+0000 7f8de259c700 1 -- 172.21.15.37:0/937243861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 msgr2=0x557505967700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.415+0000 7f8de259c700 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505967700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.415+0000 7f8de259c700 1 -- 172.21.15.37:0/937243861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 msgr2=0x557505987ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.415+0000 7f8de259c700 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 0x557505987ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.415+0000 7f8de259c700 1 -- 172.21.15.37:0/937243861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55750597bd40 con 0x5575057f54a0 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.419+0000 7f8de259c700 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x55750597e410 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8dd403a040 tx=0x7f8dd4005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15e2028efad09fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f8dcbfff700 1 -- 172.21.15.37:0/937243861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4047020 con 0x5575057f54a0 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.420+0000 7f8dcbfff700 1 -- 172.21.15.37:0/937243861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dd4003d80 con 0x5575057f54a0 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 msgr2=0x55750597e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.421+0000 7f8df7277b80 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x55750597e410 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8dd403a040 tx=0x7f8dd4005dc0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 shutdown_connections 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f8df7277b80 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557505972400 0x557505987ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f8df7277b80 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x55750597e410 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f8df7277b80 1 --2- 172.21.15.37:0/937243861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55750586fd00 0x557505967700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 >> 172.21.15.37:0/937243861 conn(0x5575057f8f70 msgr2=0x557505966ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 shutdown_connections 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.423+0000 7f8df7277b80 1 -- 172.21.15.37:0/937243861 wait complete. 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.424+0000 7f8df7277b80 1 -- start start 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.424+0000 7f8df7277b80 1 Processor -- start 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.425+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x5575059844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.425+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.425+0000 7f8df7277b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557505972400 0x557505978780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.426+0000 7f8df7277b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b6710 con 0x5575057f54a0 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.426+0000 7f8df7277b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b6040 con 0x55750586fd00 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.426+0000 7f8df7277b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8de41b3200 con 0x557505972400 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.426+0000 7f8df7277b80 10 client.0 _ll_register_callbacks cb 0x5575057066c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.427+0000 7f8de1d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.427+0000 7f8de1d9b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39874/0 (socket says 172.21.15.37:39874) 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.427+0000 7f8de1d9b700 1 -- 172.21.15.37:0/69986502 learned_addr learned my addr 172.21.15.37:0/69986502 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.427+0000 7f8de2d9d700 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557505972400 0x557505978780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.430+0000 7f8de259c700 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x5575059844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.431+0000 7f8de1d9b700 1 -- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557505972400 msgr2=0x557505978780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.431+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557505972400 0x557505978780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.431+0000 7f8de1d9b700 1 -- 172.21.15.37:0/69986502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 msgr2=0x5575059844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.431+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x5575059844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.431+0000 7f8de1d9b700 1 -- 172.21.15.37:0/69986502 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557505978cc0 con 0x55750586fd00 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.431+0000 7f8de1d9b700 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750586fd00 0x557505978240 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd808ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd9a58a76a07b40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.431+0000 7f8dc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.433+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/69986502 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd808e070 con 0x55750586fd00 2024-05-09T01:15:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.433+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5575058a2a80 con 0x55750586fd00 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.433+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/69986502 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8dd8003680 con 0x55750586fd00 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.433+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/69986502 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f8dd80b21c0 con 0x55750586fd00 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.434+0000 7f8df7277b80 10 client.27482 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.434+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5575059f56d0 con 0x55750586fd00 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/69986502 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5575058a2a80 con 0x55750586fd00 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/69986502 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f8dd806f260 con 0x55750586fd00 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8df7277b80 10 client.27482 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8df7277b80 10 client.27482 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8df7277b80 20 client.27482 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8df7277b80 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x5575059f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8df7277b80 4 client.27482 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.435+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55750589cb20 con 0x55750598bea0 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.436+0000 7f8de259c700 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x5575059f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8de259c700 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x5575059f7b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bc979e5719dd5a6f server_cookie=a72b81d21604b55e in_seq=0 out_seq=0 2024-05-09T01:15:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8dc9ffb700 10 client.27482 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8dc9ffb700 1 -- 172.21.15.37:0/69986502 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55750589cb20 con 0x55750598bea0 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8dc9ffb700 10 client.27482 handle_command_reply: tid=0 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 client.27482 shutdown 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750586fd00 msgr2=0x557505978240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750586fd00 0x557505978240 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd808ff90 comp rx=0 tx=0).stop 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 shutdown_connections 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55750598bea0 0x5575059f7b90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557505972400 0x557505978780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575057f54a0 0x5575059844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 --2- 172.21.15.37:0/69986502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55750586fd00 0x557505978240 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.437+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 >> 172.21.15.37:0/69986502 conn(0x5575057f8f70 msgr2=0x5575059777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8dc9ffb700 0 client.27482 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:15:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 shutdown_connections 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8df7277b80 1 -- 172.21.15.37:0/69986502 wait complete. 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8df7277b80 20 client.27482 trim_cache size 0 max 16384 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8dcc0b2860 msgr2=0x7f8dcc0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8dcc0b2860 0x7f8dcc0b4d70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009680 tx=0x7f8dd4019040 comp rx=0 tx=0).stop 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de4107df0 msgr2=0x7f8de4199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de4107df0 0x7f8de4199050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8005fd0 tx=0x7f8dd800ee70 comp rx=0 tx=0).stop 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 shutdown_connections 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8dcc0b2860 0x7f8dcc0b4d70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de4108740 0x7f8de4199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8de41034c0 0x7f8de4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 --2- 172.21.15.37:0/3352577306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de4107df0 0x7f8de4199050 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.438+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 >> 172.21.15.37:0/3352577306 conn(0x7f8de40fedc0 msgr2=0x7f8de4101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.439+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 shutdown_connections 2024-05-09T01:15:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:19.439+0000 7f8de8861700 1 -- 172.21.15.37:0/3352577306 wait complete. 2024-05-09T01:15:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 780.0 s, 1657.4 tps, lat 60.548 ms stddev 73.760 2024-05-09T01:15:20.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:20 smithi037 ceph-mon[30122]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 619 op/s 2024-05-09T01:15:20.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:15:20.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:20 smithi151 ceph-mon[34780]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 619 op/s 2024-05-09T01:15:20.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:20 smithi136 ceph-mon[34110]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 619 op/s 2024-05-09T01:15:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:22.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:22 smithi037 ceph-mon[30122]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 686 op/s 2024-05-09T01:15:22.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:22 smithi151 ceph-mon[34780]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 686 op/s 2024-05-09T01:15:22.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:22 smithi136 ceph-mon[34110]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 686 op/s 2024-05-09T01:15:23.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.088+0000 7f109c38d700 1 -- 172.21.15.37:0/2082186223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 msgr2=0x7f1094108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.088+0000 7f109c38d700 1 --2- 172.21.15.37:0/2082186223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f1094108200 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f10840099c0 tx=0x7f1084009cd0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.089+0000 7f109c38d700 1 -- 172.21.15.37:0/2082186223 shutdown_connections 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.089+0000 7f109c38d700 1 --2- 172.21.15.37:0/2082186223 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094108740 0x7f10941100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.089+0000 7f109c38d700 1 --2- 172.21.15.37:0/2082186223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10941034c0 0x7f10941038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.089+0000 7f109c38d700 1 --2- 172.21.15.37:0/2082186223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f1094108200 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.089+0000 7f109c38d700 1 -- 172.21.15.37:0/2082186223 >> 172.21.15.37:0/2082186223 conn(0x7f10940fedc0 msgr2=0x7f10941011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.089+0000 7f109c38d700 1 -- 172.21.15.37:0/2082186223 shutdown_connections 2024-05-09T01:15:23.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.089+0000 7f109c38d700 1 -- 172.21.15.37:0/2082186223 wait complete. 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.090+0000 7f109c38d700 1 Processor -- start 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.090+0000 7f109c38d700 1 -- start start 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.090+0000 7f109c38d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10941034c0 0x7f109419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.090+0000 7f109c38d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f109419d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.090+0000 7f109c38d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094108740 0x7f10941a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.090+0000 7f109c38d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10941122d0 con 0x7f1094107df0 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.090+0000 7f109c38d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1094112150 con 0x7f1094108740 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f109c38d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1094112450 con 0x7f10941034c0 2024-05-09T01:15:23.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f109419d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f109419d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50806/0 (socket says 172.21.15.37:50806) 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 -- 172.21.15.37:0/2886048550 learned_addr learned my addr 172.21.15.37:0/2886048550 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f109a92a700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094108740 0x7f10941a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f109a129700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10941034c0 0x7f109419cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 -- 172.21.15.37:0/2886048550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10941034c0 msgr2=0x7f109419cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10941034c0 0x7f109419cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 -- 172.21.15.37:0/2886048550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094108740 msgr2=0x7f10941a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094108740 0x7f10941a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 -- 172.21.15.37:0/2886048550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10941a1ea0 con 0x7f1094107df0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.091+0000 7f1099928700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f109419d570 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f10840045e0 tx=0x7f1084004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.092+0000 7f108b7fe700 1 -- 172.21.15.37:0/2886048550 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084026070 con 0x7f1094107df0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.092+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10941a2130 con 0x7f1094107df0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.092+0000 7f108b7fe700 1 -- 172.21.15.37:0/2886048550 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f108400f460 con 0x7f1094107df0 2024-05-09T01:15:23.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.092+0000 7f108b7fe700 1 -- 172.21.15.37:0/2886048550 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084009e60 con 0x7f1094107df0 2024-05-09T01:15:23.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.092+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10941a9ab0 con 0x7f1094107df0 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.096+0000 7f108b7fe700 1 -- 172.21.15.37:0/2886048550 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1084029070 con 0x7f1094107df0 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.097+0000 7f10aada3b80 1 Processor -- start 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.097+0000 7f10aada3b80 1 -- start start 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d8090fd00 0x564d80a236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d808954a0 0x564d80a23c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f109a92a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d8090fd00 0x564d80a236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f109a92a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d8090fd00 0x564d80a236d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50812/0 (socket says 172.21.15.37:50812) 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d80a27de0 0x564d80a281f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f109a129700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d808954a0 0x564d80a23c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f109a129700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d808954a0 0x564d80a23c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42302/0 (socket says 172.21.15.37:42302) 2024-05-09T01:15:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f108b7fe700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10800b28e0 0x7f10800b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f109a92a700 1 -- 172.21.15.37:0/915484835 learned_addr learned my addr 172.21.15.37:0/915484835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d809350a0 con 0x564d8090fd00 2024-05-09T01:15:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564d808da9a0 con 0x564d80a27de0 2024-05-09T01:15:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.098+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564d80931060 con 0x564d808954a0 2024-05-09T01:15:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f1099928700 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d80a27de0 0x564d80a281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f109a92a700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10800b28e0 0x7f10800b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f109a129700 1 -- 172.21.15.37:0/915484835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d80a27de0 msgr2=0x564d80a281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f108b7fe700 1 -- 172.21.15.37:0/2886048550 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f10840e2920 con 0x7f1094107df0 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f109a129700 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d80a27de0 0x564d80a281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f109a129700 1 -- 172.21.15.37:0/915484835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d8090fd00 msgr2=0x564d80a236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f109a129700 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d8090fd00 0x564d80a236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f109a129700 1 -- 172.21.15.37:0/915484835 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d808cb500 con 0x564d808954a0 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.099+0000 7f109a129700 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d808954a0 0x564d80a23c30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f109000bc80 tx=0x7f109000bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255f1f857aa116b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.100+0000 7f1088d47700 1 -- 172.21.15.37:0/915484835 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090010ca0 con 0x564d808954a0 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.100+0000 7f109a92a700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10800b28e0 0x7f10800b4df0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x564d80a24740 tx=0x7f108c004b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.100+0000 7f1088d47700 1 -- 172.21.15.37:0/915484835 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1090010e40 con 0x564d808954a0 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.100+0000 7f1088d47700 1 -- 172.21.15.37:0/915484835 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090005280 con 0x564d808954a0 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d808954a0 msgr2=0x564d80a23c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d808954a0 0x564d80a23c30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f109000bc80 tx=0x7f109000bf90 comp rx=0 tx=0).stop 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 shutdown_connections 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d80a27de0 0x564d80a281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d8090fd00 0x564d80a236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 --2- 172.21.15.37:0/915484835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d808954a0 0x564d80a23c30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 >> 172.21.15.37:0/915484835 conn(0x564d80898f70 msgr2=0x564d80a0d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 shutdown_connections 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.101+0000 7f10aada3b80 1 -- 172.21.15.37:0/915484835 wait complete. 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 -- start start 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 Processor -- start 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d808954a0 0x564d80a2cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d8090fd00 0x564d80a2d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d80a27de0 0x564d80a2da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d80a28b00 con 0x564d80a27de0 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564d808cfb20 con 0x564d808954a0 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f10aada3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564d80a30070 con 0x564d8090fd00 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.102+0000 7f109a129700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d808954a0 0x564d80a2cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d808954a0 0x564d80a2cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37896/0 (socket says 172.21.15.37:37896) 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 -- 172.21.15.37:0/794893429 learned_addr learned my addr 172.21.15.37:0/794893429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f10aada3b80 10 client.0 _ll_register_callbacks cb 0x564d807a66c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f1099928700 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d8090fd00 0x564d80a2d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a92a700 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d80a27de0 0x564d80a2da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 -- 172.21.15.37:0/794893429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d8090fd00 msgr2=0x564d80a2d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d8090fd00 0x564d80a2d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 -- 172.21.15.37:0/794893429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d80a27de0 msgr2=0x564d80a2da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d80a27de0 0x564d80a2da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 -- 172.21.15.37:0/794893429 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d807b0490 con 0x564d808954a0 2024-05-09T01:15:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f109a129700 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d808954a0 0x564d80a2cfe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1090000c00 tx=0x7f1090010cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e7ef94bea47ad8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.103+0000 7f107dffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.104+0000 7f107dffb700 1 -- 172.21.15.37:0/794893429 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10900050b0 con 0x564d808954a0 2024-05-09T01:15:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.104+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1090010e40 con 0x564d808954a0 2024-05-09T01:15:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.104+0000 7f107dffb700 1 -- 172.21.15.37:0/794893429 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1090005250 con 0x564d808954a0 2024-05-09T01:15:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.104+0000 7f107dffb700 1 -- 172.21.15.37:0/794893429 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1090005450 con 0x564d808954a0 2024-05-09T01:15:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.104+0000 7f10aada3b80 10 client.27500 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.104+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564d80a3a740 con 0x564d808954a0 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.104+0000 7f107dffb700 1 -- 172.21.15.37:0/794893429 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1090010e40 con 0x564d808954a0 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.105+0000 7f107dffb700 1 -- 172.21.15.37:0/794893429 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f1090026420 con 0x564d808954a0 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.105+0000 7f10aada3b80 10 client.27500 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.105+0000 7f10aada3b80 10 client.27500 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.105+0000 7f10aada3b80 20 client.27500 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.105+0000 7f10aada3b80 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80a3f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.105+0000 7f10aada3b80 4 client.27500 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.105+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d80942a80 con 0x564d80a3cc70 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.106+0000 7f1099928700 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80a3f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.106+0000 7f107dffb700 10 client.27500 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.106+0000 7f1099928700 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80a3f090 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d22d405ce90799f6 server_cookie=fd174e2515bd9d16 in_seq=0 out_seq=0 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.107+0000 7f107dffb700 1 -- 172.21.15.37:0/794893429 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564d80942a80 con 0x564d80a3cc70 2024-05-09T01:15:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.107+0000 7f107dffb700 10 client.27500 handle_command_reply: tid=0 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.107+0000 7f10aada3b80 1 client.27500 shutdown 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d808954a0 msgr2=0x564d80a2cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d808954a0 0x564d80a2cfe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1090000c00 tx=0x7f1090010cd0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 shutdown_connections 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d80a27de0 0x564d80a2da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80a3f090 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f107dffb700 0 client.27500 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d808954a0 0x564d80a2cfe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 --2- 172.21.15.37:0/794893429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d8090fd00 0x564d80a2d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 >> 172.21.15.37:0/794893429 conn(0x564d80898f70 msgr2=0x564d80a06ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 shutdown_connections 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 1 -- 172.21.15.37:0/794893429 wait complete. 2024-05-09T01:15:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.108+0000 7f10aada3b80 20 client.27500 trim_cache size 0 max 16384 2024-05-09T01:15:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.126+0000 7f10aada3b80 1 Processor -- start 2024-05-09T01:15:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.127+0000 7f10aada3b80 1 -- start start 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a07a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a2d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a11b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f10aada3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10940741a0 con 0x564d808954a0 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f10aada3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f10941a9fd0 con 0x564d8090fd00 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f10aada3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1094074870 con 0x564d80a27de0 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f109a129700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a07a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f109a129700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a07a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50836/0 (socket says 172.21.15.37:50836) 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f109a129700 1 -- 172.21.15.37:0/4191426938 learned_addr learned my addr 172.21.15.37:0/4191426938 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f109a92a700 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a11b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.128+0000 7f1099928700 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a2d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f109a92a700 1 -- 172.21.15.37:0/4191426938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 msgr2=0x564d80a2d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f109a92a700 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a2d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f109a92a700 1 -- 172.21.15.37:0/4191426938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 msgr2=0x564d80a07a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f109a92a700 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a07a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f109a92a700 1 -- 172.21.15.37:0/4191426938 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d80a099d0 con 0x564d80a27de0 2024-05-09T01:15:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f109a92a700 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a11b00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f108c0092c0 tx=0x7f108c009070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab2bcc18e45783 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f107ffff700 1 -- 172.21.15.37:0/4191426938 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c02c070 con 0x564d80a27de0 2024-05-09T01:15:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f107ffff700 1 -- 172.21.15.37:0/4191426938 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f108c004050 con 0x564d80a27de0 2024-05-09T01:15:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.129+0000 7f107ffff700 1 -- 172.21.15.37:0/4191426938 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c018ea0 con 0x564d80a27de0 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.130+0000 7f10aada3b80 1 -- 172.21.15.37:0/4191426938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 msgr2=0x564d80a11b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.130+0000 7f10aada3b80 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a11b00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f108c0092c0 tx=0x7f108c009070 comp rx=0 tx=0).stop 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.130+0000 7f10aada3b80 1 -- 172.21.15.37:0/4191426938 shutdown_connections 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.130+0000 7f10aada3b80 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a11b00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.130+0000 7f10aada3b80 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a07a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.130+0000 7f10aada3b80 1 --2- 172.21.15.37:0/4191426938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a2d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.130+0000 7f10aada3b80 1 -- 172.21.15.37:0/4191426938 >> 172.21.15.37:0/4191426938 conn(0x564d80898f70 msgr2=0x564d80a113f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.131+0000 7f10aada3b80 1 -- 172.21.15.37:0/4191426938 shutdown_connections 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.131+0000 7f10aada3b80 1 -- 172.21.15.37:0/4191426938 wait complete. 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.131+0000 7f10aada3b80 1 -- start start 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.131+0000 7f10aada3b80 1 Processor -- start 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a24d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a252a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f10aada3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a257e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f10aada3b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1094075670 con 0x564d808954a0 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f10aada3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1094074fa0 con 0x564d8090fd00 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f10aada3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f10940721c0 con 0x564d80a27de0 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a252a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37916/0 (socket says 172.21.15.37:37916) 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 -- 172.21.15.37:0/785886786 learned_addr learned my addr 172.21.15.37:0/785886786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f10aada3b80 10 client.0 _ll_register_callbacks cb 0x564d807a66c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f109a129700 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a24d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f109a92a700 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 -- 172.21.15.37:0/785886786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 msgr2=0x564d80a257e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a257e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 -- 172.21.15.37:0/785886786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 msgr2=0x564d80a24d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a24d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.132+0000 7f1099928700 1 -- 172.21.15.37:0/785886786 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d80a34370 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f1099928700 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a252a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10840a9f60 tx=0x7f108400c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8758e64d9dc5721 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f107dffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f107dffb700 1 -- 172.21.15.37:0/785886786 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840aa6d0 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f107dffb700 1 -- 172.21.15.37:0/785886786 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f108400f910 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f108c004050 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f107dffb700 1 -- 172.21.15.37:0/785886786 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f10840a9fd0 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f10aada3b80 10 client.27506 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.133+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x564d80a35630 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f107dffb700 1 -- 172.21.15.37:0/785886786 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f108c004050 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f107dffb700 1 -- 172.21.15.37:0/785886786 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f10840aa2c0 con 0x564d8090fd00 2024-05-09T01:15:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f10aada3b80 10 client.27506 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f10aada3b80 10 client.27506 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f10aada3b80 20 client.27506 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f10aada3b80 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80aa9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f10aada3b80 4 client.27506 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d80a27bf0 con 0x564d80a3cc70 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.134+0000 7f109a129700 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80aa9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f109a129700 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80aa9280 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f9884fa6622d0bb9 server_cookie=57c81e1f4744343f in_seq=0 out_seq=0 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f107dffb700 10 client.27506 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f107dffb700 1 -- 172.21.15.37:0/785886786 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d80a27bf0 con 0x564d80a3cc70 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f107dffb700 10 client.27506 handle_command_reply: tid=0 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f10aada3b80 1 client.27506 shutdown 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 msgr2=0x564d80a252a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f10aada3b80 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a252a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f10840a9f60 tx=0x7f108400c4c0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.135+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 shutdown_connections 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d80a27de0 0x564d80a257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d808954a0 0x564d80a24d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x564d80a3cc70 0x564d80aa9280 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f107dffb700 0 client.27506 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 1 --2- 172.21.15.37:0/785886786 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564d8090fd00 0x564d80a252a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 >> 172.21.15.37:0/785886786 conn(0x564d80898f70 msgr2=0x564d80a07780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 shutdown_connections 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 1 -- 172.21.15.37:0/785886786 wait complete. 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.136+0000 7f10aada3b80 20 client.27506 trim_cache size 0 max 16384 2024-05-09T01:15:23.141 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:15:23.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.138+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10800b28e0 msgr2=0x7f10800b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.138+0000 7f109c38d700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10800b28e0 0x7f10800b4df0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x564d80a24740 tx=0x7f108c004b40 comp rx=0 tx=0).stop 2024-05-09T01:15:23.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.138+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 msgr2=0x7f109419d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:23.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.138+0000 7f109c38d700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f109419d570 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f10840045e0 tx=0x7f1084004610 comp rx=0 tx=0).stop 2024-05-09T01:15:23.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.138+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 shutdown_connections 2024-05-09T01:15:23.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.139+0000 7f109c38d700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f10800b28e0 0x7f10800b4df0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.139+0000 7f109c38d700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094108740 0x7f10941a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.139+0000 7f109c38d700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10941034c0 0x7f109419cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.139+0000 7f109c38d700 1 --2- 172.21.15.37:0/2886048550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094107df0 0x7f109419d570 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.139+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 >> 172.21.15.37:0/2886048550 conn(0x7f10940fedc0 msgr2=0x7f1094107060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.139+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 shutdown_connections 2024-05-09T01:15:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:23.139+0000 7f109c38d700 1 -- 172.21.15.37:0/2886048550 wait complete. 2024-05-09T01:15:23.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:15:24.271 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:24.671 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:24 smithi037 ceph-mon[30122]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 594 op/s 2024-05-09T01:15:24.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:24 smithi151 ceph-mon[34780]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 594 op/s 2024-05-09T01:15:24.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:24 smithi136 ceph-mon[34110]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 594 op/s 2024-05-09T01:15:25.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 785.0 s, 1168.8 tps, lat 84.847 ms stddev 108.089 2024-05-09T01:15:26.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 -- 172.21.15.37:0/4247000731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e81034c0 msgr2=0x7fc2e81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 --2- 172.21.15.37:0/4247000731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e81034c0 0x7fc2e81038d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009a40 tx=0x7fc2d8009d50 comp rx=0 tx=0).stop 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 -- 172.21.15.37:0/4247000731 shutdown_connections 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 --2- 172.21.15.37:0/4247000731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8108740 0x7fc2e81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 --2- 172.21.15.37:0/4247000731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e81034c0 0x7fc2e81038d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 --2- 172.21.15.37:0/4247000731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e8107df0 0x7fc2e8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 -- 172.21.15.37:0/4247000731 >> 172.21.15.37:0/4247000731 conn(0x7fc2e80fedc0 msgr2=0x7fc2e81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.178+0000 7fc2ee329700 1 -- 172.21.15.37:0/4247000731 shutdown_connections 2024-05-09T01:15:26.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.179+0000 7fc2ee329700 1 -- 172.21.15.37:0/4247000731 wait complete. 2024-05-09T01:15:26.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.180+0000 7fc2ee329700 1 Processor -- start 2024-05-09T01:15:26.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.180+0000 7fc2ee329700 1 -- start start 2024-05-09T01:15:26.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.180+0000 7fc2ee329700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e81034c0 0x7fc2e81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2ee329700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8107df0 0x7fc2e8198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2ee329700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e8108740 0x7fc2e8199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2ee329700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81122d0 con 0x7fc2e8108740 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2ee329700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e8112150 con 0x7fc2e81034c0 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2ee329700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e8112450 con 0x7fc2e8107df0 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8107df0 0x7fc2e8198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8107df0 0x7fc2e8198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42338/0 (socket says 172.21.15.37:42338) 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.181+0000 7fc2e77fe700 1 -- 172.21.15.37:0/668733242 learned_addr learned my addr 172.21.15.37:0/668733242 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e77fe700 1 -- 172.21.15.37:0/668733242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e81034c0 msgr2=0x7fc2e81989f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e81034c0 0x7fc2e81989f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e77fe700 1 -- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e8108740 msgr2=0x7fc2e8199470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e8108740 0x7fc2e8199470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e77fe700 1 -- 172.21.15.37:0/668733242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e81ad590 con 0x7fc2e8107df0 2024-05-09T01:15:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8107df0 0x7fc2e8198f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e970 tx=0x7fc2dc00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e57fa700 1 -- 172.21.15.37:0/668733242 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00cbd0 con 0x7fc2e8107df0 2024-05-09T01:15:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e57fa700 1 -- 172.21.15.37:0/668733242 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2dc00cd70 con 0x7fc2e8107df0 2024-05-09T01:15:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e81ad820 con 0x7fc2e8107df0 2024-05-09T01:15:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2e57fa700 1 -- 172.21.15.37:0/668733242 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc010430 con 0x7fc2e8107df0 2024-05-09T01:15:26.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.182+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e81addb0 con 0x7fc2e8107df0 2024-05-09T01:15:26.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.186+0000 7fc2e57fa700 1 -- 172.21.15.37:0/668733242 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc2dc0105d0 con 0x7fc2e8107df0 2024-05-09T01:15:26.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.187+0000 7fc2e57fa700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2d00b2980 0x7fc2d00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.187+0000 7fc2e57fa700 1 -- 172.21.15.37:0/668733242 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc2dc0e24a0 con 0x7fc2e8107df0 2024-05-09T01:15:26.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.188+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2d00b2980 0x7fc2d00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.189+0000 7fc2fcd3fb80 1 Processor -- start 2024-05-09T01:15:26.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.189+0000 7fc2fcd3fb80 1 -- start start 2024-05-09T01:15:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2d00b2980 0x7fc2d00b4e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8018040 tx=0x7fc2d8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560bbdfec0a0 con 0x560bbdf4c4a0 2024-05-09T01:15:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560bbdf919a0 con 0x560bbdfc6d00 2024-05-09T01:15:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560bbdfe8060 con 0x560bbe0c9400 2024-05-09T01:15:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37922/0 (socket says 172.21.15.37:37922) 2024-05-09T01:15:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.190+0000 7fc2e7fff700 1 -- 172.21.15.37:0/2796581041 learned_addr learned my addr 172.21.15.37:0/2796581041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2ec8c6700 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2e7fff700 1 -- 172.21.15.37:0/2796581041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 msgr2=0x560bbe0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2e7fff700 1 -- 172.21.15.37:0/2796581041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 msgr2=0x560bbe0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2e7fff700 1 -- 172.21.15.37:0/2796581041 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bbdf82500 con 0x560bbdfc6d00 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.191+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0cf240 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8017000 tx=0x7fc2d801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad6e26b27fa7462f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.192+0000 7fc2ce7fc700 1 -- 172.21.15.37:0/2796581041 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d800b750 con 0x560bbdfc6d00 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.192+0000 7fc2ce7fc700 1 -- 172.21.15.37:0/2796581041 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2d800bda0 con 0x560bbdfc6d00 2024-05-09T01:15:26.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.192+0000 7fc2ce7fc700 1 -- 172.21.15.37:0/2796581041 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8016d40 con 0x560bbdfc6d00 2024-05-09T01:15:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/2796581041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 msgr2=0x560bbe0cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0cf240 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8017000 tx=0x7fc2d801c000 comp rx=0 tx=0).stop 2024-05-09T01:15:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/2796581041 shutdown_connections 2024-05-09T01:15:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0cf240 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/2796581041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/2796581041 >> 172.21.15.37:0/2796581041 conn(0x560bbdf4ff70 msgr2=0x560bbe0c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/2796581041 shutdown_connections 2024-05-09T01:15:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/2796581041 wait complete. 2024-05-09T01:15:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.193+0000 7fc2fcd3fb80 1 -- start start 2024-05-09T01:15:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.194+0000 7fc2fcd3fb80 1 Processor -- start 2024-05-09T01:15:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.194+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.194+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.194+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0d39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.194+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560bbe0ca010 con 0x560bbe0c9400 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x560bbdf86b20 con 0x560bbdfc6d00 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560bbe0ca190 con 0x560bbdf4c4a0 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42346/0 (socket says 172.21.15.37:42346) 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 -- 172.21.15.37:0/3615176378 learned_addr learned my addr 172.21.15.37:0/3615176378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2fcd3fb80 10 client.0 _ll_register_callbacks cb 0x560bbde5d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2ec8c6700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0d39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 -- 172.21.15.37:0/3615176378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 msgr2=0x560bbe0d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 -- 172.21.15.37:0/3615176378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 msgr2=0x560bbe0d39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0d39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 -- 172.21.15.37:0/3615176378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bbde67490 con 0x560bbdf4c4a0 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:26.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d2f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8016710 tx=0x7fc2d8003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4609a2412e06bd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:15:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2c77fe700 1 -- 172.21.15.37:0/3615176378 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8038060 con 0x560bbdf4c4a0 2024-05-09T01:15:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.195+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d800bda0 con 0x560bbdf4c4a0 2024-05-09T01:15:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.196+0000 7fc2c77fe700 1 -- 172.21.15.37:0/3615176378 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc2d800b950 con 0x560bbdf4c4a0 2024-05-09T01:15:26.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.196+0000 7fc2c77fe700 1 -- 172.21.15.37:0/3615176378 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fc2d8016d50 con 0x560bbdf4c4a0 2024-05-09T01:15:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.197+0000 7fc2fcd3fb80 10 client.27490 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.197+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x560bbe0ca010 con 0x560bbdf4c4a0 2024-05-09T01:15:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.198+0000 7fc2c77fe700 1 -- 172.21.15.37:0/3615176378 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2d800bda0 con 0x560bbdf4c4a0 2024-05-09T01:15:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.198+0000 7fc2c77fe700 1 -- 172.21.15.37:0/3615176378 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7fc2d803d070 con 0x560bbdf4c4a0 2024-05-09T01:15:26.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.198+0000 7fc2fcd3fb80 10 client.27490 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.198+0000 7fc2fcd3fb80 10 client.27490 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:15:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.198+0000 7fc2fcd3fb80 20 client.27490 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.198+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe0e28b0 0x560bbe0e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.199+0000 7fc2fcd3fb80 4 client.27490 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.199+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bbdff9a80 con 0x560bbe0e28b0 2024-05-09T01:15:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.199+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe0e28b0 0x560bbe0e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.199+0000 7fc2c77fe700 10 client.27490 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.200+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe0e28b0 0x560bbe0e4cd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b1b16edaa9069e1e server_cookie=17ce07d54f91e4f in_seq=0 out_seq=0 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.200+0000 7fc2c77fe700 1 -- 172.21.15.37:0/3615176378 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560bbdff9a80 con 0x560bbe0e28b0 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.200+0000 7fc2c77fe700 10 client.27490 handle_command_reply: tid=0 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.200+0000 7fc2fcd3fb80 1 client.27490 shutdown 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 msgr2=0x560bbe0d2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d2f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8016710 tx=0x7fc2d8003c80 comp rx=0 tx=0).stop 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 shutdown_connections 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe0e28b0 0x560bbe0e4cd0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0d39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d2f70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2c77fe700 0 client.27490 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3615176378 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 >> 172.21.15.37:0/3615176378 conn(0x560bbdf4ff70 msgr2=0x560bbe0bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 shutdown_connections 2024-05-09T01:15:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3615176378 wait complete. 2024-05-09T01:15:26.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.201+0000 7fc2fcd3fb80 20 client.27490 trim_cache size 0 max 16384 2024-05-09T01:15:26.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 Processor -- start 2024-05-09T01:15:26.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 -- start start 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81b5020 con 0x560bbdf4c4a0 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81b6bc0 con 0x560bbdfc6d00 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.221+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81b56f0 con 0x560bbe0c9400 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37932/0 (socket says 172.21.15.37:37932) 2024-05-09T01:15:26.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50880/0 (socket says 172.21.15.37:50880) 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 -- 172.21.15.37:0/3963654938 learned_addr learned my addr 172.21.15.37:0/3963654938 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2ec8c6700 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 -- 172.21.15.37:0/3963654938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 msgr2=0x560bbe0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 -- 172.21.15.37:0/3963654938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 msgr2=0x560bbe0d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 -- 172.21.15.37:0/3963654938 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bbe0cfaf0 con 0x560bbdfc6d00 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0c43d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0a9980 tx=0x7fc2dc0dfe70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1276b1d813551dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2cdffb700 1 -- 172.21.15.37:0/3963654938 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0b2260 con 0x560bbdfc6d00 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2cdffb700 1 -- 172.21.15.37:0/3963654938 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2dc0a9790 con 0x560bbdfc6d00 2024-05-09T01:15:26.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.222+0000 7fc2cdffb700 1 -- 172.21.15.37:0/3963654938 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0cc0e0 con 0x560bbdfc6d00 2024-05-09T01:15:26.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.223+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3963654938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 msgr2=0x560bbe0c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:26.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.223+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0c43d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0a9980 tx=0x7fc2dc0dfe70 comp rx=0 tx=0).stop 2024-05-09T01:15:26.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.223+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3963654938 shutdown_connections 2024-05-09T01:15:26.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.223+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbe0c9400 0x560bbe0cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.223+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbdf4c4a0 0x560bbe0d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.223+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/3963654938 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0c43d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.223+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3963654938 >> 172.21.15.37:0/3963654938 conn(0x560bbdf4ff70 msgr2=0x560bbe0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.224+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3963654938 shutdown_connections 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.224+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/3963654938 wait complete. 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.224+0000 7fc2fcd3fb80 1 -- start start 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.224+0000 7fc2fcd3fb80 1 Processor -- start 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.224+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0dac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.224+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0db150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2fcd3fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0ddae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0db150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81b64f0 con 0x560bbe0c9400 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81b5e20 con 0x560bbdfc6d00 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2fcd3fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e81b2fe0 con 0x560bbdf4c4a0 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2ec8c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0ddae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0db150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37942/0 (socket says 172.21.15.37:37942) 2024-05-09T01:15:26.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 -- 172.21.15.37:0/875613478 learned_addr learned my addr 172.21.15.37:0/875613478 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2fcd3fb80 10 client.0 _ll_register_callbacks cb 0x560bbde5d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 -- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 msgr2=0x560bbe0dac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0dac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 -- 172.21.15.37:0/875613478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 msgr2=0x560bbe0ddae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0ddae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 -- 172.21.15.37:0/875613478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bbe0de050 con 0x560bbdfc6d00 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2e77fe700 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0db150 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0a5d00 tx=0x7fc2dc00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7ee2535e80e6d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.225+0000 7fc2c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.226+0000 7fc2c77fe700 1 -- 172.21.15.37:0/875613478 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0a8ee0 con 0x560bbdfc6d00 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.226+0000 7fc2c77fe700 1 -- 172.21.15.37:0/875613478 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc2dc0a9080 con 0x560bbdfc6d00 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.226+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2dc0a9790 con 0x560bbdfc6d00 2024-05-09T01:15:26.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.226+0000 7fc2c77fe700 1 -- 172.21.15.37:0/875613478 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fc2dc0cc0c0 con 0x560bbdfc6d00 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.226+0000 7fc2fcd3fb80 10 client.27521 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.226+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x560bbe14c680 con 0x560bbdfc6d00 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.227+0000 7fc2c77fe700 1 -- 172.21.15.37:0/875613478 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2dc0a9790 con 0x560bbdfc6d00 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.227+0000 7fc2c77fe700 1 -- 172.21.15.37:0/875613478 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7fc2dc0a8950 con 0x560bbdfc6d00 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.227+0000 7fc2fcd3fb80 10 client.27521 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.227+0000 7fc2fcd3fb80 10 client.27521 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.227+0000 7fc2fcd3fb80 20 client.27521 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.228+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe14ccb0 0x560bbe14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.228+0000 7fc2fcd3fb80 4 client.27521 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.228+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560bbdff3b20 con 0x560bbe14ccb0 2024-05-09T01:15:26.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.228+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe14ccb0 0x560bbe14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.228+0000 7fc2c77fe700 10 client.27521 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.228+0000 7fc2e7fff700 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe14ccb0 0x560bbe14f0d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e20c0fed83ca40b server_cookie=f484e74330c630f7 in_seq=0 out_seq=0 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2c77fe700 1 -- 172.21.15.37:0/875613478 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560bbdff3b20 con 0x560bbe14ccb0 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2c77fe700 10 client.27521 handle_command_reply: tid=0 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 client.27521 shutdown 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 msgr2=0x560bbe0db150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0db150 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0a5d00 tx=0x7fc2dc00cf90 comp rx=0 tx=0).stop 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 shutdown_connections 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x560bbe14ccb0 0x560bbe14f0d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bbe0c9400 0x560bbe0ddae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2c77fe700 0 client.27521 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:15:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bbdf4c4a0 0x560bbe0dac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 --2- 172.21.15.37:0/875613478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x560bbdfc6d00 0x560bbe0db150 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 >> 172.21.15.37:0/875613478 conn(0x560bbdf4ff70 msgr2=0x560bbe0bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 shutdown_connections 2024-05-09T01:15:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 1 -- 172.21.15.37:0/875613478 wait complete. 2024-05-09T01:15:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.229+0000 7fc2fcd3fb80 20 client.27521 trim_cache size 0 max 16384 2024-05-09T01:15:26.234 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:15:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2d00b2980 msgr2=0x7fc2d00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2d00b2980 0x7fc2d00b4e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8018040 tx=0x7fc2d8000bc0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8107df0 msgr2=0x7fc2e8198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8107df0 0x7fc2e8198f30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e970 tx=0x7fc2dc00ed30 comp rx=0 tx=0).stop 2024-05-09T01:15:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 shutdown_connections 2024-05-09T01:15:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc2d00b2980 0x7fc2d00b4e90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e8108740 0x7fc2e8199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e81034c0 0x7fc2e81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 --2- 172.21.15.37:0/668733242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2e8107df0 0x7fc2e8198f30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 >> 172.21.15.37:0/668733242 conn(0x7fc2e80fedc0 msgr2=0x7fc2e81075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 shutdown_connections 2024-05-09T01:15:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:26.230+0000 7fc2ee329700 1 -- 172.21.15.37:0/668733242 wait complete. 2024-05-09T01:15:26.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:26 smithi037 ceph-mon[30122]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-05-09T01:15:26.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:26 smithi151 ceph-mon[34780]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-05-09T01:15:26.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:26 smithi136 ceph-mon[34110]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-05-09T01:15:27.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:15:27.556 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:28.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:28 smithi037 ceph-mon[30122]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 MiB/s wr, 641 op/s 2024-05-09T01:15:28.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:28 smithi151 ceph-mon[34780]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 MiB/s wr, 641 op/s 2024-05-09T01:15:28.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:28 smithi136 ceph-mon[34110]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.7 MiB/s wr, 641 op/s 2024-05-09T01:15:29.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 -- 172.21.15.37:0/2857551339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 msgr2=0x7f1e24109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e28ba3700 1 -- 172.21.15.37:0/2857551339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e14009e60 con 0x7f1e24108f20 2024-05-09T01:15:29.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 --2- 172.21.15.37:0/2857551339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 0x7f1e24109330 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f1e140099c0 tx=0x7f1e14009cd0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 -- 172.21.15.37:0/2857551339 shutdown_connections 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 --2- 172.21.15.37:0/2857551339 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e24109870 0x7f1e241111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 --2- 172.21.15.37:0/2857551339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e241045f0 0x7f1e24104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 --2- 172.21.15.37:0/2857551339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 0x7f1e24109330 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 -- 172.21.15.37:0/2857551339 >> 172.21.15.37:0/2857551339 conn(0x7f1e24100040 msgr2=0x7f1e24102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 -- 172.21.15.37:0/2857551339 shutdown_connections 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.629+0000 7f1e2be09700 1 -- 172.21.15.37:0/2857551339 wait complete. 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.630+0000 7f1e2be09700 1 Processor -- start 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.630+0000 7f1e2be09700 1 -- start start 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.630+0000 7f1e2be09700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e241045f0 0x7f1e241110f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.630+0000 7f1e2be09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 0x7f1e2410e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e2be09700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e24109870 0x7f1e2410e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e2be09700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e240770c0 con 0x7f1e24108f20 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e241045f0 0x7f1e241110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e2be09700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24076f40 con 0x7f1e241045f0 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e2be09700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24077240 con 0x7f1e24109870 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e241045f0 0x7f1e241110f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37952/0 (socket says 172.21.15.37:37952) 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 -- 172.21.15.37:0/1679408321 learned_addr learned my addr 172.21.15.37:0/1679408321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e293a4700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 0x7f1e2410e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e2a3a6700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e24109870 0x7f1e2410e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 -- 172.21.15.37:0/1679408321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e24109870 msgr2=0x7f1e2410e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e24109870 0x7f1e2410e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 -- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 msgr2=0x7f1e2410e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 0x7f1e2410e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 -- 172.21.15.37:0/1679408321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2410f080 con 0x7f1e241045f0 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e241045f0 0x7f1e241110f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000d980 tx=0x7f1e2000dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:29.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e1affd700 1 -- 172.21.15.37:0/1679408321 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20016070 con 0x7f1e241045f0 2024-05-09T01:15:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e1affd700 1 -- 172.21.15.37:0/1679408321 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e200044d0 con 0x7f1e241045f0 2024-05-09T01:15:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.631+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e241ad900 con 0x7f1e241045f0 2024-05-09T01:15:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.632+0000 7f1e1affd700 1 -- 172.21.15.37:0/1679408321 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20004d00 con 0x7f1e241045f0 2024-05-09T01:15:29.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.632+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e241ade10 con 0x7f1e241045f0 2024-05-09T01:15:29.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.635+0000 7f1e1affd700 1 -- 172.21.15.37:0/1679408321 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1e20005020 con 0x7f1e241045f0 2024-05-09T01:15:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.636+0000 7f1e1affd700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1e100b29b0 0x7f1e100b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.637+0000 7f1e3a81fb80 1 Processor -- start 2024-05-09T01:15:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.637+0000 7f1e1affd700 1 -- 172.21.15.37:0/1679408321 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1e200e20e0 con 0x7f1e241045f0 2024-05-09T01:15:29.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.637+0000 7f1e293a4700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1e100b29b0 0x7f1e100b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.637+0000 7f1e3a81fb80 1 -- start start 2024-05-09T01:15:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.637+0000 7f1e293a4700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1e100b29b0 0x7f1e100b4ec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e1401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431e35160 0x55a431ece4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ecea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 0x55a431ec8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a431deaff0 con 0x55a431ec86a0 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a431d897f0 con 0x55a431d4b4a0 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a431de6fb0 con 0x55a431e35160 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ecea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ecea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37956/0 (socket says 172.21.15.37:37956) 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 -- 172.21.15.37:0/2489562301 learned_addr learned my addr 172.21.15.37:0/2489562301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:29.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 -- 172.21.15.37:0/2489562301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431e35160 msgr2=0x55a431ece4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 --2- 172.21.15.37:0/2489562301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431e35160 0x55a431ece4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 -- 172.21.15.37:0/2489562301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 msgr2=0x55a431ec8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 --2- 172.21.15.37:0/2489562301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 0x55a431ec8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.638+0000 7f1e293a4700 1 -- 172.21.15.37:0/2489562301 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a431d81370 con 0x55a431d4b4a0 2024-05-09T01:15:29.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.640+0000 7f1e293a4700 1 --2- 172.21.15.37:0/2489562301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ecea30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009750 tx=0x7f1e1401e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8526946d3b1d02a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.640+0000 7f1e0ffff700 1 -- 172.21.15.37:0/2489562301 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e14033070 con 0x55a431d4b4a0 2024-05-09T01:15:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.640+0000 7f1e0ffff700 1 -- 172.21.15.37:0/2489562301 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e1400bc40 con 0x55a431d4b4a0 2024-05-09T01:15:29.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.640+0000 7f1e0ffff700 1 -- 172.21.15.37:0/2489562301 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1402e6d0 con 0x55a431d4b4a0 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2489562301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 msgr2=0x55a431ecea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2489562301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ecea30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009750 tx=0x7f1e1401e000 comp rx=0 tx=0).stop 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2489562301 shutdown_connections 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2489562301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 0x55a431ec8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2489562301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431e35160 0x55a431ece4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2489562301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ecea30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2489562301 >> 172.21.15.37:0/2489562301 conn(0x55a431dab6a0 msgr2=0x55a431ec3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2489562301 shutdown_connections 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.641+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2489562301 wait complete. 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.642+0000 7f1e3a81fb80 1 -- start start 2024-05-09T01:15:29.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.642+0000 7f1e3a81fb80 1 Processor -- start 2024-05-09T01:15:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.642+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ed2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431ec86a0 0x55a431ed2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ed2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a431c66ba0 con 0x55a431e35160 2024-05-09T01:15:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ed2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37972/0 (socket says 172.21.15.37:37972) 2024-05-09T01:15:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a431da5150 con 0x55a431d4b4a0 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 -- 172.21.15.37:0/2705946975 learned_addr learned my addr 172.21.15.37:0/2705946975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a431ed51d0 con 0x55a431ec86a0 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e3a81fb80 10 client.0 _ll_register_callbacks cb 0x55a431c5c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e2a3a6700 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431ec86a0 0x55a431ed2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 -- 172.21.15.37:0/2705946975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431ec86a0 msgr2=0x55a431ed2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431ec86a0 0x55a431ed2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 -- 172.21.15.37:0/2705946975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 msgr2=0x55a431ed27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 -- 172.21.15.37:0/2705946975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a431c66490 con 0x55a431d4b4a0 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e2a3a6700 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431ec86a0 0x55a431ed2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ed2280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1e200a9400 tx=0x7f1e200a8f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f9becc46d3c66f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e0d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/2705946975 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e200a9700 con 0x55a431d4b4a0 2024-05-09T01:15:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.643+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/2705946975 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1e200910c0 con 0x55a431d4b4a0 2024-05-09T01:15:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.644+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e1400bc40 con 0x55a431d4b4a0 2024-05-09T01:15:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.644+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/2705946975 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1e200adab0 con 0x55a431d4b4a0 2024-05-09T01:15:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.644+0000 7f1e3a81fb80 10 client.27533 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.644+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55a431edfc40 con 0x55a431d4b4a0 2024-05-09T01:15:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/2705946975 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e1400bc40 con 0x55a431d4b4a0 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/2705946975 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f1e200b20d0 con 0x55a431d4b4a0 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e3a81fb80 10 client.27533 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e3a81fb80 10 client.27533 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e3a81fb80 20 client.27533 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431ee2280 0x55a431ee4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e3a81fb80 4 client.27533 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a431df89d0 con 0x55a431ee2280 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e293a4700 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431ee2280 0x55a431ee4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.646+0000 7f1e0d7fa700 10 client.27533 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.647+0000 7f1e293a4700 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431ee2280 0x55a431ee4700 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a76e9a5bff03b41 server_cookie=52af39c591381f00 in_seq=0 out_seq=0 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.647+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/2705946975 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a431df89d0 con 0x55a431ee2280 2024-05-09T01:15:29.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.647+0000 7f1e0d7fa700 10 client.27533 handle_command_reply: tid=0 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.647+0000 7f1e3a81fb80 1 client.27533 shutdown 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 msgr2=0x55a431ed2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ed2280 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1e200a9400 tx=0x7f1e200a8f20 comp rx=0 tx=0).stop 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 shutdown_connections 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431ec86a0 0x55a431ed2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431d4b4a0 0x55a431ed2280 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431ee2280 0x55a431ee4700 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/2705946975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e0d7fa700 0 client.27533 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 >> 172.21.15.37:0/2705946975 conn(0x55a431dab6a0 msgr2=0x55a431ec31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 shutdown_connections 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/2705946975 wait complete. 2024-05-09T01:15:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.648+0000 7f1e3a81fb80 20 client.27533 trim_cache size 0 max 16384 2024-05-09T01:15:29.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.674+0000 7f1e3a81fb80 1 Processor -- start 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.674+0000 7f1e3a81fb80 1 -- start start 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431ed2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431ec86a0 0x55a431ed2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241b5280 con 0x55a431e35160 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241b6e20 con 0x55a431ec86a0 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241b5950 con 0x55a431d4b4a0 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e29ba5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431ed2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e2a3a6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431ec86a0 0x55a431ed2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e293a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e29ba5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431ed2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42400/0 (socket says 172.21.15.37:42400) 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e29ba5700 1 -- 172.21.15.37:0/711885039 learned_addr learned my addr 172.21.15.37:0/711885039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:29.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e2a3a6700 1 -- 172.21.15.37:0/711885039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 msgr2=0x55a431ed2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e2a3a6700 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431ed2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e2a3a6700 1 -- 172.21.15.37:0/711885039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 msgr2=0x55a431ed2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e2a3a6700 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e2a3a6700 1 -- 172.21.15.37:0/711885039 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a431ec4ce0 con 0x55a431ec86a0 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431ed2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.675+0000 7f1e293a4700 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.676+0000 7f1e2a3a6700 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431ec86a0 0x55a431ed2cc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0093d0 tx=0x7f1e1c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adefb699f1be561f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.676+0000 7f1e0f7fe700 1 -- 172.21.15.37:0/711885039 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c019070 con 0x55a431ec86a0 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.676+0000 7f1e0f7fe700 1 -- 172.21.15.37:0/711885039 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e1c004020 con 0x55a431ec86a0 2024-05-09T01:15:29.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.676+0000 7f1e0f7fe700 1 -- 172.21.15.37:0/711885039 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c007e60 con 0x55a431ec86a0 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/711885039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431ec86a0 msgr2=0x55a431ed2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431ec86a0 0x55a431ed2cc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0093d0 tx=0x7f1e1c009920 comp rx=0 tx=0).stop 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/711885039 shutdown_connections 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431ec86a0 0x55a431ed2cc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431ed2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/711885039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431e35160 0x55a431ed2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/711885039 >> 172.21.15.37:0/711885039 conn(0x55a431dab6a0 msgr2=0x55a431ed0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/711885039 shutdown_connections 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.677+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/711885039 wait complete. 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.678+0000 7f1e3a81fb80 1 -- start start 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.678+0000 7f1e3a81fb80 1 Processor -- start 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.678+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431eda4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.678+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431e35160 0x55a431edaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.678+0000 7f1e3a81fb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 0x55a431ed35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241b6750 con 0x55a431ec86a0 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e293a4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431e35160 0x55a431edaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241b6080 con 0x55a431e35160 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e3a81fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241b3260 con 0x55a431d4b4a0 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e293a4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431e35160 0x55a431edaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:37986/0 (socket says 172.21.15.37:37986) 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e293a4700 1 -- 172.21.15.37:0/1510466072 learned_addr learned my addr 172.21.15.37:0/1510466072 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e2a3a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 0x55a431ed35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431eda4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.679+0000 7f1e3a81fb80 10 client.0 _ll_register_callbacks cb 0x55a431c5c6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.680+0000 7f1e293a4700 1 -- 172.21.15.37:0/1510466072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 msgr2=0x55a431eda4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.680+0000 7f1e293a4700 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431eda4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.680+0000 7f1e293a4700 1 -- 172.21.15.37:0/1510466072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 msgr2=0x55a431ed35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.680+0000 7f1e293a4700 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 0x55a431ed35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.680+0000 7f1e293a4700 1 -- 172.21.15.37:0/1510466072 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a431ed3d20 con 0x55a431e35160 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e293a4700 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431e35160 0x55a431edaa10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1e14006010 tx=0x7f1e140056f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db581ac57d51e44 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e0d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/1510466072 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1403e070 con 0x55a431e35160 2024-05-09T01:15:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/1510466072 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f1e1402e470 con 0x55a431e35160 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e1c004020 con 0x55a431e35160 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/1510466072 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1e14049050 con 0x55a431e35160 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e3a81fb80 10 client.27539 fetch_fsmap learned FSMap version 49 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.681+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55a431f4c3f0 con 0x55a431e35160 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/1510466072 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e1c004020 con 0x55a431e35160 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/1510466072 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 49) ==== 8362+0+0 (secure 0 0 0) 0x7f1e14022070 con 0x55a431e35160 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e3a81fb80 10 client.27539 fetch_fsmap finished waiting for FSMap version 49 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e3a81fb80 10 client.27539 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e3a81fb80 20 client.27539 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431f4c5c0 0x55a431f4e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e3a81fb80 4 client.27539 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a431df2a70 con 0x55a431f4c5c0 2024-05-09T01:15:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431f4c5c0 0x55a431f4e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.682+0000 7f1e0d7fa700 10 client.27539 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e29ba5700 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431f4c5c0 0x55a431f4e9e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=447a96c50697b0c9 server_cookie=ad709598bf1b06ad in_seq=0 out_seq=0 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e0d7fa700 1 -- 172.21.15.37:0/1510466072 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a431df2a70 con 0x55a431f4c5c0 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e0d7fa700 10 client.27539 handle_command_reply: tid=0 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 client.27539 shutdown 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431e35160 msgr2=0x55a431edaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431e35160 0x55a431edaa10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1e14006010 tx=0x7f1e140056f0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 shutdown_connections 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x55a431f4c5c0 0x55a431f4e9e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a431ec86a0 0x55a431ed35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a431d4b4a0 0x55a431eda4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e0d7fa700 0 client.27539 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 --2- 172.21.15.37:0/1510466072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a431e35160 0x55a431edaa10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 >> 172.21.15.37:0/1510466072 conn(0x55a431dab6a0 msgr2=0x55a431ed0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 shutdown_connections 2024-05-09T01:15:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 1 -- 172.21.15.37:0/1510466072 wait complete. 2024-05-09T01:15:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.683+0000 7f1e3a81fb80 20 client.27539 trim_cache size 0 max 16384 2024-05-09T01:15:29.687 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:15:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1e100b29b0 msgr2=0x7f1e100b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1e100b29b0 0x7f1e100b4ec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e1401a040 comp rx=0 tx=0).stop 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e241045f0 msgr2=0x7f1e241110f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e241045f0 0x7f1e241110f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000d980 tx=0x7f1e2000dd40 comp rx=0 tx=0).stop 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 shutdown_connections 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f1e100b29b0 0x7f1e100b4ec0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e24109870 0x7f1e2410e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1e241045f0 0x7f1e241110f0 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000d980 tx=0x7f1e2000dd40 comp rx=0 tx=0).stop 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 --2- 172.21.15.37:0/1679408321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e24108f20 0x7f1e2410e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.684+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 >> 172.21.15.37:0/1679408321 conn(0x7f1e24100040 msgr2=0x7f1e24106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.685+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 shutdown_connections 2024-05-09T01:15:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:29.685+0000 7f1e2be09700 1 -- 172.21.15.37:0/1679408321 wait complete. 2024-05-09T01:15:30.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 790.0 s, 2465.6 tps, lat 40.315 ms stddev 58.523 2024-05-09T01:15:30.679 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:30 smithi136 ceph-mon[34110]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 561 op/s 2024-05-09T01:15:30.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:30 smithi037 ceph-mon[30122]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 561 op/s 2024-05-09T01:15:30.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:30 smithi151 ceph-mon[34780]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 561 op/s 2024-05-09T01:15:30.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:15:31.227 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.617+0000 7f8149db7640 1 -- 172.21.15.37:0/5092923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144102b50 msgr2=0x7f8144103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.617+0000 7f8149db7640 1 --2- 172.21.15.37:0/5092923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144102b50 0x7f8144103850 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8134009860 tx=0x7f813402a340 comp rx=0 tx=0).stop 2024-05-09T01:15:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.618+0000 7f8149db7640 1 -- 172.21.15.37:0/5092923 shutdown_connections 2024-05-09T01:15:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.618+0000 7f8149db7640 1 --2- 172.21.15.37:0/5092923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8144108a90 0x7f814410aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.618+0000 7f8149db7640 1 --2- 172.21.15.37:0/5092923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144103d90 0x7f81441041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.618+0000 7f8149db7640 1 --2- 172.21.15.37:0/5092923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144102b50 0x7f8144103850 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.618+0000 7f8149db7640 1 -- 172.21.15.37:0/5092923 >> 172.21.15.37:0/5092923 conn(0x7f81440fdd40 msgr2=0x7f81441001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.618+0000 7f8149db7640 1 -- 172.21.15.37:0/5092923 shutdown_connections 2024-05-09T01:15:32.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.618+0000 7f8149db7640 1 -- 172.21.15.37:0/5092923 wait complete. 2024-05-09T01:15:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.619+0000 7f8149db7640 1 Processor -- start 2024-05-09T01:15:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.619+0000 7f8149db7640 1 -- start start 2024-05-09T01:15:32.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.619+0000 7f8149db7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144102b50 0x7f8144198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.619+0000 7f8149db7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144103d90 0x7f8144198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f8149db7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8144108a90 0x7f814419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f8149db7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f814410d530 con 0x7f8144108a90 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f8149db7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f814410d3b0 con 0x7f8144103d90 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f8149db7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f814410d6b0 con 0x7f8144102b50 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144102b50 0x7f8144198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144102b50 0x7f8144198140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43310/0 (socket says 172.21.15.37:43310) 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 -- 172.21.15.37:0/361370552 learned_addr learned my addr 172.21.15.37:0/361370552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f813bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144103d90 0x7f8144198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f8143fff640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8144108a90 0x7f814419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 -- 172.21.15.37:0/361370552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144103d90 msgr2=0x7f8144198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144103d90 0x7f8144198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 -- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8144108a90 msgr2=0x7f814419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8144108a90 0x7f814419f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 -- 172.21.15.37:0/361370552 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81441a4090 con 0x7f8144102b50 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f8143fff640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8144108a90 0x7f814419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f813bfff640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144103d90 0x7f8144198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.620+0000 7f81437fe640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144102b50 0x7f8144198140 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81340304b0 tx=0x7f8134032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.621+0000 7f81417fa640 1 -- 172.21.15.37:0/361370552 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134037040 con 0x7f8144102b50 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.621+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81441a4320 con 0x7f8144102b50 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.621+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81441a4800 con 0x7f8144102b50 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.621+0000 7f81417fa640 1 -- 172.21.15.37:0/361370552 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8134030c10 con 0x7f8144102b50 2024-05-09T01:15:32.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.621+0000 7f81417fa640 1 -- 172.21.15.37:0/361370552 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134003850 con 0x7f8144102b50 2024-05-09T01:15:32.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.625+0000 7f81417fa640 1 -- 172.21.15.37:0/361370552 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8134043020 con 0x7f8144102b50 2024-05-09T01:15:32.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.625+0000 7f8150c6b740 1 Processor -- start 2024-05-09T01:15:32.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.625+0000 7f8150c6b740 1 -- start start 2024-05-09T01:15:32.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba120d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba121290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba128190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8143fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8143fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43326/0 (socket says 172.21.15.37:43326) 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8143fff640 1 -- 172.21.15.37:0/985347918 learned_addr learned my addr 172.21.15.37:0/985347918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55acba07c7c0 con 0x55acb9d534d0 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55acba0180e0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55acba078780 con 0x55acb9d741b0 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.626+0000 7f81437fe640 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba121290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f813bfff640 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba128190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f81437fe640 1 -- 172.21.15.37:0/985347918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 msgr2=0x55acba120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f81437fe640 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f81437fe640 1 -- 172.21.15.37:0/985347918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 msgr2=0x55acba128190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f81437fe640 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba128190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f81437fe640 1 -- 172.21.15.37:0/985347918 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acba0417c0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f813bfff640 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba128190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f81437fe640 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba121290 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f81340ff0c0 tx=0x7f8134107620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78ec5e17e87b3f38 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.627+0000 7f81417fa640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81300b2850 0x7f81300b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.628+0000 7f8139ffb640 1 -- 172.21.15.37:0/985347918 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340c5290 con 0x55acb9d4b2f0 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.628+0000 7f8139ffb640 1 -- 172.21.15.37:0/985347918 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f813410e030 con 0x55acb9d4b2f0 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.628+0000 7f8143fff640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81300b2850 0x7f81300b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.628+0000 7f8139ffb640 1 -- 172.21.15.37:0/985347918 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340c83b0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.628+0000 7f81417fa640 1 -- 172.21.15.37:0/361370552 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8134101620 con 0x7f8144102b50 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 msgr2=0x55acba121290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba121290 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f81340ff0c0 tx=0x7f8134107620 comp rx=0 tx=0).stop 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8143fff640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81300b2850 0x7f81300b4d60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55acba121ee0 tx=0x7f813c010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 shutdown_connections 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba128190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba121290 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 --2- 172.21.15.37:0/985347918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba120d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 >> 172.21.15.37:0/985347918 conn(0x55acb9d68300 msgr2=0x55acba113e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 shutdown_connections 2024-05-09T01:15:32.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.629+0000 7f8150c6b740 1 -- 172.21.15.37:0/985347918 wait complete. 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.630+0000 7f8150c6b740 1 -- start start 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.630+0000 7f8150c6b740 1 Processor -- start 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.630+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba12acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba131c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8150c6b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55acba1289a0 con 0x55acb9d534d0 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8150c6b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55acba0039c0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8150c6b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55acba128b20 con 0x55acb9d741b0 2024-05-09T01:15:32.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f813bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba12acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8150c6b740 10 client.0 _ll_register_callbacks cb 0x55acba030020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f813bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba12acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50046/0 (socket says 172.21.15.37:50046) 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8143fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba131c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f813bfff640 1 -- 172.21.15.37:0/1547294927 learned_addr learned my addr 172.21.15.37:0/1547294927 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f81437fe640 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8143fff640 1 -- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 msgr2=0x55acba12a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8143fff640 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8143fff640 1 -- 172.21.15.37:0/1547294927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 msgr2=0x55acba12acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8143fff640 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba12acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8143fff640 1 -- 172.21.15.37:0/1547294927 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acba02a1f0 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8143fff640 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba131c30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f813c00d7b0 tx=0x7f813c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c50a36852edd2c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.631+0000 7f8122ffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8122ffd640 1 -- 172.21.15.37:0/1547294927 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c004d20 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8122ffd640 1 -- 172.21.15.37:0/1547294927 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f813c01a660 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f813410e030 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8122ffd640 1 -- 172.21.15.37:0/1547294927 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f813c003e40 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8150c6b740 10 client.27520 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55acb9ddf790 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8122ffd640 1 -- 172.21.15.37:0/1547294927 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f813410e030 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.632+0000 7f8122ffd640 1 -- 172.21.15.37:0/1547294927 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f813c00b040 con 0x55acb9d741b0 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f8150c6b740 10 client.27520 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f8150c6b740 10 client.27520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:32.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f8150c6b740 20 client.27520 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f8150c6b740 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d32d80 0x55acba138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f8150c6b740 4 client.27520 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acba08a3d0 con 0x55acb9d32d80 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f81437fe640 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d32d80 0x55acba138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f8122ffd640 10 client.27520 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.633+0000 7f81437fe640 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d32d80 0x55acba138270 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5e544066618cbbe server_cookie=81c32fb263d63019 in_seq=0 out_seq=0 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.634+0000 7f8122ffd640 1 -- 172.21.15.37:0/1547294927 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55acba08a3d0 con 0x55acb9d32d80 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.634+0000 7f8122ffd640 10 client.27520 handle_command_reply: tid=0 2024-05-09T01:15:32.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.635+0000 7f8150c6b740 1 client.27520 shutdown 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.636+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 msgr2=0x55acba131c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.636+0000 7f8150c6b740 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba131c30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f813c00d7b0 tx=0x7f813c004ab0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.636+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 shutdown_connections 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.636+0000 7f8150c6b740 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d32d80 0x55acba138270 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.636+0000 7f8122ffd640 0 client.27520 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.636+0000 7f8150c6b740 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d741b0 0x55acba131c30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.637+0000 7f8150c6b740 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba12acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.637+0000 7f8150c6b740 1 --2- 172.21.15.37:0/1547294927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.637+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 >> 172.21.15.37:0/1547294927 conn(0x55acb9d68300 msgr2=0x55acba112700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.637+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 shutdown_connections 2024-05-09T01:15:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.637+0000 7f8150c6b740 1 -- 172.21.15.37:0/1547294927 wait complete. 2024-05-09T01:15:32.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.637+0000 7f8150c6b740 20 client.27520 trim_cache size 0 max 16384 2024-05-09T01:15:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.660+0000 7f8150c6b740 1 Processor -- start 2024-05-09T01:15:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.664+0000 7f8150c6b740 1 -- start start 2024-05-09T01:15:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.664+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba1173a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.664+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba1178e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.664+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba13da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.664+0000 7f8150c6b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81441a8fe0 con 0x55acb9d534d0 2024-05-09T01:15:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.664+0000 7f8150c6b740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81441aab50 con 0x55acb9d4b2f0 2024-05-09T01:15:32.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.664+0000 7f8150c6b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f81441a96b0 con 0x55acb9d32d80 2024-05-09T01:15:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.672+0000 7f8143fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba13da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.672+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba1173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.672+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba1173a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43342/0 (socket says 172.21.15.37:43342) 2024-05-09T01:15:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.672+0000 7f8143fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba13da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50058/0 (socket says 172.21.15.37:50058) 2024-05-09T01:15:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.672+0000 7f81437fe640 1 -- 172.21.15.37:0/195356797 learned_addr learned my addr 172.21.15.37:0/195356797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.672+0000 7f813bfff640 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba1178e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.679+0000 7f81437fe640 1 -- 172.21.15.37:0/195356797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 msgr2=0x55acba1178e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.679+0000 7f81437fe640 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba1178e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.679+0000 7f81437fe640 1 -- 172.21.15.37:0/195356797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 msgr2=0x55acba13da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.679+0000 7f81437fe640 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba13da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.679+0000 7f81437fe640 1 -- 172.21.15.37:0/195356797 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acb9e565f0 con 0x55acb9d32d80 2024-05-09T01:15:32.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:32 smithi037 ceph-mon[30122]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 650 op/s 2024-05-09T01:15:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.682+0000 7f81437fe640 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba1173a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8134035040 tx=0x7f8134005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5687f8fc97b88dd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.690+0000 7f81397fa640 1 -- 172.21.15.37:0/195356797 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340c8590 con 0x55acb9d32d80 2024-05-09T01:15:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.690+0000 7f81397fa640 1 -- 172.21.15.37:0/195356797 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f813410e040 con 0x55acb9d32d80 2024-05-09T01:15:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.690+0000 7f81397fa640 1 -- 172.21.15.37:0/195356797 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340c8780 con 0x55acb9d32d80 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 -- 172.21.15.37:0/195356797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 msgr2=0x55acba1173a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba1173a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8134035040 tx=0x7f8134005f90 comp rx=0 tx=0).stop 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 -- 172.21.15.37:0/195356797 shutdown_connections 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba13da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba1178e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 --2- 172.21.15.37:0/195356797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba1173a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 -- 172.21.15.37:0/195356797 >> 172.21.15.37:0/195356797 conn(0x55acb9d68300 msgr2=0x55acba116c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 -- 172.21.15.37:0/195356797 shutdown_connections 2024-05-09T01:15:32.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.692+0000 7f8150c6b740 1 -- 172.21.15.37:0/195356797 wait complete. 2024-05-09T01:15:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.693+0000 7f8150c6b740 1 -- start start 2024-05-09T01:15:32.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.694+0000 7f8150c6b740 1 Processor -- start 2024-05-09T01:15:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.695+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba12f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.695+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.695+0000 7f8150c6b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba130ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.695+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba12f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.695+0000 7f81437fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba12f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43348/0 (socket says 172.21.15.37:43348) 2024-05-09T01:15:32.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.695+0000 7f813bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.695+0000 7f813bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57416/0 (socket says 172.21.15.37:57416) 2024-05-09T01:15:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.696+0000 7f81437fe640 1 -- 172.21.15.37:0/3974512333 learned_addr learned my addr 172.21.15.37:0/3974512333 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.696+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81441aa480 con 0x55acb9d534d0 2024-05-09T01:15:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.696+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81441a9db0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.696+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f81441a6fe0 con 0x55acb9d32d80 2024-05-09T01:15:32.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.696+0000 7f8150c6b740 10 client.0 _ll_register_callbacks cb 0x7f813c00e7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.702+0000 7f813bfff640 1 -- 172.21.15.37:0/3974512333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 msgr2=0x55acba12f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.702+0000 7f813bfff640 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba12f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.702+0000 7f813bfff640 1 -- 172.21.15.37:0/3974512333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 msgr2=0x55acba130ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.702+0000 7f813bfff640 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba130ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.702+0000 7f813bfff640 1 -- 172.21.15.37:0/3974512333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acba040ed0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.703+0000 7f813bfff640 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12fba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f812c005b90 tx=0x7f812c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d919f6f50afedc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.703+0000 7f8122ffd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:32.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.704+0000 7f8122ffd640 1 -- 172.21.15.37:0/3974512333 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c023060 con 0x55acb9d4b2f0 2024-05-09T01:15:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.704+0000 7f8122ffd640 1 -- 172.21.15.37:0/3974512333 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f812c004250 con 0x55acb9d4b2f0 2024-05-09T01:15:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.704+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f813410e040 con 0x55acb9d4b2f0 2024-05-09T01:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.711+0000 7f8122ffd640 1 -- 172.21.15.37:0/3974512333 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f812c004450 con 0x55acb9d4b2f0 2024-05-09T01:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.711+0000 7f8150c6b740 10 client.27557 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.711+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55acba1321e0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8122ffd640 1 -- 172.21.15.37:0/3974512333 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f812c003aa0 con 0x55acb9d4b2f0 2024-05-09T01:15:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8122ffd640 1 -- 172.21.15.37:0/3974512333 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f812c01e720 con 0x55acb9d4b2f0 2024-05-09T01:15:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8150c6b740 10 client.27557 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8150c6b740 10 client.27557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8150c6b740 20 client.27557 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8150c6b740 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d741b0 0x55acba1b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8150c6b740 4 client.27557 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.712+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f813410e040 con 0x55acb9d741b0 2024-05-09T01:15:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.713+0000 7f81437fe640 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d741b0 0x55acba1b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:32.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:32 smithi151 ceph-mon[34780]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 650 op/s 2024-05-09T01:15:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.726+0000 7f81437fe640 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d741b0 0x55acba1b3880 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=632ca08f0111444f server_cookie=ef4c7ae34f01b7dc in_seq=0 out_seq=0 2024-05-09T01:15:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.726+0000 7f8122ffd640 10 client.27557 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.758+0000 7f8122ffd640 1 -- 172.21.15.37:0/3974512333 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f813410e040 con 0x55acb9d741b0 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.758+0000 7f8122ffd640 10 client.27557 handle_command_reply: tid=0 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.758+0000 7f8150c6b740 1 client.27557 shutdown 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 msgr2=0x55acba12fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12fba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f812c005b90 tx=0x7f812c00f790 comp rx=0 tx=0).stop 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 shutdown_connections 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55acb9d741b0 0x55acba1b3880 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8122ffd640 0 client.27557 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acb9d534d0 0x55acba130ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55acb9d4b2f0 0x55acba12fba0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 --2- 172.21.15.37:0/3974512333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55acb9d32d80 0x55acba12f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 >> 172.21.15.37:0/3974512333 conn(0x55acb9d68300 msgr2=0x55acba1176c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 shutdown_connections 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 1 -- 172.21.15.37:0/3974512333 wait complete. 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.759+0000 7f8150c6b740 20 client.27557 trim_cache size 0 max 16384 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:15:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:15:32.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.760+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81300b2850 msgr2=0x7f81300b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.760+0000 7f8149db7640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81300b2850 0x7f81300b4d60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55acba121ee0 tx=0x7f813c010040 comp rx=0 tx=0).stop 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.760+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144102b50 msgr2=0x7f8144198140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.760+0000 7f8149db7640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144102b50 0x7f8144198140 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81340304b0 tx=0x7f8134032d20 comp rx=0 tx=0).stop 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.761+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 shutdown_connections 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.761+0000 7f8149db7640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8144108a90 0x7f814419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.761+0000 7f8149db7640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f81300b2850 0x7f81300b4d60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.761+0000 7f8149db7640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8144103d90 0x7f8144198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.761+0000 7f8149db7640 1 --2- 172.21.15.37:0/361370552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8144102b50 0x7f8144198140 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.761+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 >> 172.21.15.37:0/361370552 conn(0x7f81440fdd40 msgr2=0x7f8144104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.764+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 shutdown_connections 2024-05-09T01:15:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:32.764+0000 7f8149db7640 1 -- 172.21.15.37:0/361370552 wait complete. 2024-05-09T01:15:32.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:32 smithi136 ceph-mon[34110]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 650 op/s 2024-05-09T01:15:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.128+0000 7f5fa1844700 1 -- 172.21.15.37:0/170248934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 msgr2=0x7f5f9c110500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.128+0000 7f5fa1844700 1 --2- 172.21.15.37:0/170248934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 0x7f5f9c110500 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5f8401a9a0 tx=0x7f5f8401acb0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.131+0000 7f5fa1844700 1 -- 172.21.15.37:0/170248934 shutdown_connections 2024-05-09T01:15:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.131+0000 7f5fa1844700 1 --2- 172.21.15.37:0/170248934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c110fc0 0x7f5f9c10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.131+0000 7f5fa1844700 1 --2- 172.21.15.37:0/170248934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 0x7f5f9c110500 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.131+0000 7f5fa1844700 1 --2- 172.21.15.37:0/170248934 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 0x7f5f9c10a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.131+0000 7f5fa1844700 1 -- 172.21.15.37:0/170248934 >> 172.21.15.37:0/170248934 conn(0x7f5f9c06f260 msgr2=0x7f5f9c06f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:33.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.141+0000 7f5fa1844700 1 -- 172.21.15.37:0/170248934 shutdown_connections 2024-05-09T01:15:33.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.142+0000 7f5fa1844700 1 -- 172.21.15.37:0/170248934 wait complete. 2024-05-09T01:15:33.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.143+0000 7f5fa1844700 1 Processor -- start 2024-05-09T01:15:33.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.143+0000 7f5fa1844700 1 -- start start 2024-05-09T01:15:33.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa1844700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 0x7f5f9c1a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa1844700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c110fc0 0x7f5f9c1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa1844700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 0x7f5f9c1a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa1844700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1149a0 con 0x7f5f9c110fc0 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa0842700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 0x7f5f9c1a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa0842700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 0x7f5f9c1a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57436/0 (socket says 172.21.15.37:57436) 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa0842700 1 -- 172.21.15.37:0/107280639 learned_addr learned my addr 172.21.15.37:0/107280639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.144+0000 7f5fa1043700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 0x7f5f9c1a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.145+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c114820 con 0x7f5f9c110ad0 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.145+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c114b20 con 0x7f5f9c112740 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.145+0000 7f5fa1043700 1 -- 172.21.15.37:0/107280639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 msgr2=0x7f5f9c1a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.145+0000 7f5fa1043700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 0x7f5f9c1a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.145+0000 7f5fa1043700 1 -- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c110fc0 msgr2=0x7f5f9c1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.145+0000 7f5fa1043700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c110fc0 0x7f5f9c1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.145+0000 7f5fa1043700 1 -- 172.21.15.37:0/107280639 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c1a6190 con 0x7f5f9c112740 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.146+0000 7f5fa0842700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 0x7f5f9c1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.146+0000 7f5fa1043700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 0x7f5f9c1a5af0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00b3f0 tx=0x7f5f8c00b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.154+0000 7f5f99ffb700 1 -- 172.21.15.37:0/107280639 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c015020 con 0x7f5f9c112740 2024-05-09T01:15:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.154+0000 7f5f99ffb700 1 -- 172.21.15.37:0/107280639 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f8c011ce0 con 0x7f5f9c112740 2024-05-09T01:15:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.154+0000 7f5f99ffb700 1 -- 172.21.15.37:0/107280639 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c010b80 con 0x7f5f9c112740 2024-05-09T01:15:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.154+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c1a6480 con 0x7f5f9c112740 2024-05-09T01:15:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.155+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c1adda0 con 0x7f5f9c112740 2024-05-09T01:15:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.161+0000 7f5fb14bcb80 1 Processor -- start 2024-05-09T01:15:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.161+0000 7f5f99ffb700 1 -- 172.21.15.37:0/107280639 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5f8c018020 con 0x7f5f9c112740 2024-05-09T01:15:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.161+0000 7f5fb14bcb80 1 -- start start 2024-05-09T01:15:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65ef5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65eefc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aa65e11ff0 con 0x55aa65e5c160 2024-05-09T01:15:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55aa65db07f0 con 0x55aa65eef800 2024-05-09T01:15:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5f99ffb700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f880b2a00 0x7f5f880b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55aa65e0dfb0 con 0x55aa65d724a0 2024-05-09T01:15:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65eefc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65eefc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57444/0 (socket says 172.21.15.37:57444) 2024-05-09T01:15:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5f9bfff700 1 -- 172.21.15.37:0/4153747304 learned_addr learned my addr 172.21.15.37:0/4153747304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.162+0000 7f5f99ffb700 1 -- 172.21.15.37:0/107280639 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5f8c0e1720 con 0x7f5f9c112740 2024-05-09T01:15:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5fa1043700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f880b2a00 0x7f5f880b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5fa0842700 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65ef5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5fa1043700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f880b2a00 0x7f5f880b4f10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0a6050 tx=0x7f5f8c004860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5f9bfff700 1 -- 172.21.15.37:0/4153747304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 msgr2=0x55aa65ef5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65ef5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5f9bfff700 1 -- 172.21.15.37:0/4153747304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 msgr2=0x55aa65ef5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.163+0000 7f5f9bfff700 1 -- 172.21.15.37:0/4153747304 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa65da8370 con 0x55aa65eef800 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.164+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65eefc10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5f94011b40 tx=0x7f5f94009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31372e78f6bc0fc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.164+0000 7f5f92ffd700 1 -- 172.21.15.37:0/4153747304 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94012040 con 0x55aa65eef800 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.164+0000 7f5f92ffd700 1 -- 172.21.15.37:0/4153747304 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f94011e50 con 0x55aa65eef800 2024-05-09T01:15:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.164+0000 7f5f92ffd700 1 -- 172.21.15.37:0/4153747304 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94013c90 con 0x55aa65eef800 2024-05-09T01:15:33.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.165+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/4153747304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 msgr2=0x55aa65eefc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.165+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65eefc10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5f94011b40 tx=0x7f5f94009950 comp rx=0 tx=0).stop 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.165+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/4153747304 shutdown_connections 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.165+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65eefc10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.165+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.165+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/4153747304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65ef5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.165+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/4153747304 >> 172.21.15.37:0/4153747304 conn(0x55aa65dd26a0 msgr2=0x55aa65eea620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.166+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/4153747304 shutdown_connections 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.166+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/4153747304 wait complete. 2024-05-09T01:15:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.166+0000 7f5fb14bcb80 1 -- start start 2024-05-09T01:15:33.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.166+0000 7f5fb14bcb80 1 Processor -- start 2024-05-09T01:15:33.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65d724a0 0x55aa65ef93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65e5c160 0x55aa65ef9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65ef9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55aa65c8dba0 con 0x55aa65d724a0 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55aa65dcc150 con 0x55aa65eef800 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55aa65ef0590 con 0x55aa65e5c160 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fb14bcb80 10 client.0 _ll_register_callbacks cb 0x55aa65c836c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65d724a0 0x55aa65ef93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65d724a0 0x55aa65ef93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50100/0 (socket says 172.21.15.37:50100) 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5f9bfff700 1 -- 172.21.15.37:0/1859689656 learned_addr learned my addr 172.21.15.37:0/1859689656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5fa0842700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65e5c160 0x55aa65ef9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.167+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65ef9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f9bfff700 1 -- 172.21.15.37:0/1859689656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65e5c160 msgr2=0x55aa65ef9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65e5c160 0x55aa65ef9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f9bfff700 1 -- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 msgr2=0x55aa65ef9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65ef9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f9bfff700 1 -- 172.21.15.37:0/1859689656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa65c8d490 con 0x55aa65d724a0 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65d724a0 0x55aa65ef93f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5f94004b10 tx=0x7f5f9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b7d85f8edf1cbd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.168+0000 7f5f7bfff700 1 -- 172.21.15.37:0/1859689656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9402d060 con 0x55aa65d724a0 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.169+0000 7f5f7bfff700 1 -- 172.21.15.37:0/1859689656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5f94009460 con 0x55aa65d724a0 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.169+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f94011e50 con 0x55aa65d724a0 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.169+0000 7f5f7bfff700 1 -- 172.21.15.37:0/1859689656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5f94013890 con 0x55aa65d724a0 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.169+0000 7f5fb14bcb80 10 client.17634 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.169+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55aa65f06c80 con 0x55aa65d724a0 2024-05-09T01:15:33.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5f7bfff700 1 -- 172.21.15.37:0/1859689656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f94011e50 con 0x55aa65d724a0 2024-05-09T01:15:33.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5f7bfff700 1 -- 172.21.15.37:0/1859689656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f5f94032050 con 0x55aa65d724a0 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5fb14bcb80 10 client.17634 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5fb14bcb80 10 client.17634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5fb14bcb80 20 client.17634 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65f092c0 0x55aa65f0b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5fb14bcb80 4 client.17634 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa65e1f9d0 con 0x55aa65f092c0 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.170+0000 7f5fa0842700 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65f092c0 0x55aa65f0b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.171+0000 7f5f7bfff700 10 client.17634 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.171+0000 7f5fa0842700 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65f092c0 0x55aa65f0b6e0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f934f138234396 server_cookie=2bc87a2c3e7884ed in_seq=0 out_seq=0 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5f7bfff700 1 -- 172.21.15.37:0/1859689656 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa65e1f9d0 con 0x55aa65f092c0 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5f7bfff700 10 client.17634 handle_command_reply: tid=0 2024-05-09T01:15:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 client.17634 shutdown 2024-05-09T01:15:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65d724a0 msgr2=0x55aa65ef93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65d724a0 0x55aa65ef93f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5f94004b10 tx=0x7f5f9400b040 comp rx=0 tx=0).stop 2024-05-09T01:15:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 shutdown_connections 2024-05-09T01:15:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65f092c0 0x55aa65f0b6e0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5f7bfff700 0 client.17634 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65eef800 0x55aa65ef9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65d724a0 0x55aa65ef93f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/1859689656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65e5c160 0x55aa65ef9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.172+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 >> 172.21.15.37:0/1859689656 conn(0x55aa65dd26a0 msgr2=0x55aa65eea380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.173+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 shutdown_connections 2024-05-09T01:15:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.173+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/1859689656 wait complete. 2024-05-09T01:15:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.173+0000 7f5fb14bcb80 20 client.17634 trim_cache size 0 max 16384 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 Processor -- start 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 -- start start 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65dd26a0 0x55aa65ef3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65efb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1b4f50 con 0x55aa65e5c160 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1b6ac0 con 0x55aa65dd26a0 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1b5620 con 0x55aa65d724a0 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65dd26a0 0x55aa65ef3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65dd26a0 0x55aa65ef3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57462/0 (socket says 172.21.15.37:57462) 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5f9bfff700 1 -- 172.21.15.37:0/843943824 learned_addr learned my addr 172.21.15.37:0/843943824 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.194+0000 7f5fa0842700 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65efb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f9bfff700 1 -- 172.21.15.37:0/843943824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 msgr2=0x55aa65efb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65efb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f9bfff700 1 -- 172.21.15.37:0/843943824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 msgr2=0x55aa65ef4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f9bfff700 1 -- 172.21.15.37:0/843943824 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa65ef7960 con 0x55aa65dd26a0 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5fa0842700 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65efb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65dd26a0 0x55aa65ef3b00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006080 tx=0x7f5f940049e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd52325349861606 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f927fc700 1 -- 172.21.15.37:0/843943824 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94038040 con 0x55aa65dd26a0 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f927fc700 1 -- 172.21.15.37:0/843943824 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f94011e50 con 0x55aa65dd26a0 2024-05-09T01:15:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.195+0000 7f5f927fc700 1 -- 172.21.15.37:0/843943824 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94003f30 con 0x55aa65dd26a0 2024-05-09T01:15:33.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/843943824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65dd26a0 msgr2=0x55aa65ef3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65dd26a0 0x55aa65ef3b00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5f94006080 tx=0x7f5f940049e0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/843943824 shutdown_connections 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65e5c160 0x55aa65ef4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65dd26a0 0x55aa65ef3b00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/843943824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65efb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/843943824 >> 172.21.15.37:0/843943824 conn(0x55aa65eefee0 msgr2=0x55aa65ef7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/843943824 shutdown_connections 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.196+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/843943824 wait complete. 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.197+0000 7f5fb14bcb80 1 -- start start 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.197+0000 7f5fb14bcb80 1 Processor -- start 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.197+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65f01510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.197+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65dd26a0 0x55aa65f01a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5fb14bcb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65e5c160 0x55aa65f101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1b63f0 con 0x55aa65dd26a0 2024-05-09T01:15:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1b5d20 con 0x55aa65e5c160 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5fb14bcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c1b2f50 con 0x55aa65d724a0 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5fb14bcb80 10 client.0 _ll_register_callbacks cb 0x55aa65c836c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65f01510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5fa0842700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65dd26a0 0x55aa65f01a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65f01510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43406/0 (socket says 172.21.15.37:43406) 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 -- 172.21.15.37:0/3203992341 learned_addr learned my addr 172.21.15.37:0/3203992341 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65e5c160 0x55aa65f101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 -- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65e5c160 msgr2=0x55aa65f101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65e5c160 0x55aa65f101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 -- 172.21.15.37:0/3203992341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65dd26a0 msgr2=0x55aa65f01a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65dd26a0 0x55aa65f01a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 -- 172.21.15.37:0/3203992341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa65f10980 con 0x55aa65d724a0 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5fa0842700 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65dd26a0 0x55aa65f01a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f9bfff700 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65f01510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f94034000 tx=0x7f5f94004970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5251bb0a9e57cb92 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.198+0000 7f5f7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5f7bfff700 1 -- 172.21.15.37:0/3203992341 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9402d070 con 0x55aa65d724a0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f94011e50 con 0x55aa65d724a0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5f7bfff700 1 -- 172.21.15.37:0/3203992341 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5f94009260 con 0x55aa65d724a0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5f7bfff700 1 -- 172.21.15.37:0/3203992341 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5f94004380 con 0x55aa65d724a0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 10 client.27544 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55aa65f73370 con 0x55aa65d724a0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5f7bfff700 1 -- 172.21.15.37:0/3203992341 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f94011e50 con 0x55aa65d724a0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5f7bfff700 1 -- 172.21.15.37:0/3203992341 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f5f94032070 con 0x55aa65d724a0 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 10 client.27544 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 10 client.27544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 20 client.27544 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65eef800 0x55aa65f759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 4 client.27544 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:15:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.199+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa65e19a70 con 0x55aa65eef800 2024-05-09T01:15:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.200+0000 7f5fa0842700 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65eef800 0x55aa65f759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.202+0000 7f5fa0842700 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65eef800 0x55aa65f759e0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b7e562bb89ddafc server_cookie=a645fb805fefeabe in_seq=0 out_seq=0 2024-05-09T01:15:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.202+0000 7f5f7bfff700 10 client.27544 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5f7bfff700 1 -- 172.21.15.37:0/3203992341 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa65e19a70 con 0x55aa65eef800 2024-05-09T01:15:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5f7bfff700 10 client.27544 handle_command_reply: tid=0 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 client.27544 shutdown 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 msgr2=0x55aa65f01510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65f01510 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f5f94034000 tx=0x7f5f94004970 comp rx=0 tx=0).stop 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 shutdown_connections 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55aa65eef800 0x55aa65f759e0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa65e5c160 0x55aa65f101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa65d724a0 0x55aa65f01510 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 --2- 172.21.15.37:0/3203992341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55aa65dd26a0 0x55aa65f01a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5f7bfff700 0 client.27544 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.203+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 >> 172.21.15.37:0/3203992341 conn(0x55aa65eefee0 msgr2=0x55aa65ef3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.204+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 shutdown_connections 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.204+0000 7f5fb14bcb80 1 -- 172.21.15.37:0/3203992341 wait complete. 2024-05-09T01:15:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.204+0000 7f5fb14bcb80 20 client.27544 trim_cache size 0 max 16384 2024-05-09T01:15:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f880b2a00 msgr2=0x7f5f880b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f880b2a00 0x7f5f880b4f10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0a6050 tx=0x7f5f8c004860 comp rx=0 tx=0).stop 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 msgr2=0x7f5f9c1a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 0x7f5f9c1a5af0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00b3f0 tx=0x7f5f8c00b700 comp rx=0 tx=0).stop 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 shutdown_connections 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5f880b2a00 0x7f5f880b4f10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f9c112740 0x7f5f9c1a5af0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f9c110ad0 0x7f5f9c1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 --2- 172.21.15.37:0/107280639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c110fc0 0x7f5f9c1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:33.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 >> 172.21.15.37:0/107280639 conn(0x7f5f9c06f260 msgr2=0x7f5f9c10c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:33.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 shutdown_connections 2024-05-09T01:15:33.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:33.205+0000 7f5fa1844700 1 -- 172.21.15.37:0/107280639 wait complete. 2024-05-09T01:15:33.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:33 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:15:33.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:33 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:15:33.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:33 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:15:34.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:34 smithi037 ceph-mon[30122]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-05-09T01:15:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:34 smithi151 ceph-mon[34780]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-05-09T01:15:34.869 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:15:34.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:15:34.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:34 smithi136 ceph-mon[34110]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 578 op/s 2024-05-09T01:15:35.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 795.0 s, 1674.5 tps, lat 60.444 ms stddev 103.468 2024-05-09T01:15:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:36.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:36 smithi037 ceph-mon[30122]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.3 MiB/s wr, 588 op/s 2024-05-09T01:15:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:36 smithi151 ceph-mon[34780]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.3 MiB/s wr, 588 op/s 2024-05-09T01:15:36.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:36 smithi136 ceph-mon[34110]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 5.3 MiB/s wr, 588 op/s 2024-05-09T01:15:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.773+0000 7f91e84b7700 1 -- 172.21.15.37:0/1520403423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 msgr2=0x7f91e0117830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.773+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1520403423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 0x7f91e0117830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f91d800b0a0 tx=0x7f91d800b3b0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.773+0000 7f91e84b7700 1 -- 172.21.15.37:0/1520403423 shutdown_connections 2024-05-09T01:15:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.773+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1520403423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 0x7f91e0117830 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.773+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1520403423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91e0110990 0x7f91e0110da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.773+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1520403423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91e010a960 0x7f91e010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.773+0000 7f91e84b7700 1 -- 172.21.15.37:0/1520403423 >> 172.21.15.37:0/1520403423 conn(0x7f91e0076d30 msgr2=0x7f91e0077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.774+0000 7f91e84b7700 1 -- 172.21.15.37:0/1520403423 shutdown_connections 2024-05-09T01:15:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.774+0000 7f91e84b7700 1 -- 172.21.15.37:0/1520403423 wait complete. 2024-05-09T01:15:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 Processor -- start 2024-05-09T01:15:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 -- start start 2024-05-09T01:15:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91e010a960 0x7f91e00753a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 0x7f91e006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91e0110990 0x7f91e006ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91e011aab0 con 0x7f91e010b2b0 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f91e011a930 con 0x7f91e010a960 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.775+0000 7f91e84b7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f91e011ac30 con 0x7f91e0110990 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.776+0000 7f91e5a52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 0x7f91e006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.776+0000 7f91e6253700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91e010a960 0x7f91e00753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.776+0000 7f91e6253700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91e010a960 0x7f91e00753a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57476/0 (socket says 172.21.15.37:57476) 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.776+0000 7f91e6253700 1 -- 172.21.15.37:0/1650801733 learned_addr learned my addr 172.21.15.37:0/1650801733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.776+0000 7f91e6a54700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91e0110990 0x7f91e006ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.776+0000 7f91e5a52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 0x7f91e006e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50138/0 (socket says 172.21.15.37:50138) 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.776+0000 7f91e6a54700 1 -- 172.21.15.37:0/1650801733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91e010a960 msgr2=0x7f91e00753a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91e6a54700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91e010a960 0x7f91e00753a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91e6a54700 1 -- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 msgr2=0x7f91e006e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91e6a54700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 0x7f91e006e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91e6a54700 1 -- 172.21.15.37:0/1650801733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e0072f40 con 0x7f91e0110990 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91e6a54700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91e0110990 0x7f91e006ebe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d010 tx=0x7f91d8004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91d77fe700 1 -- 172.21.15.37:0/1650801733 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d8021070 con 0x7f91e0110990 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91d77fe700 1 -- 172.21.15.37:0/1650801733 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d8007e30 con 0x7f91e0110990 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.777+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e00731d0 con 0x7f91e0110990 2024-05-09T01:15:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.778+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e0073710 con 0x7f91e0110990 2024-05-09T01:15:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.778+0000 7f91d77fe700 1 -- 172.21.15.37:0/1650801733 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80046a0 con 0x7f91e0110990 2024-05-09T01:15:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.783+0000 7f91f6ecdb80 1 Processor -- start 2024-05-09T01:15:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.783+0000 7f91d77fe700 1 -- 172.21.15.37:0/1650801733 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f91d804da60 con 0x7f91e0110990 2024-05-09T01:15:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.784+0000 7f91f6ecdb80 1 -- start start 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91d77fe700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f91cc0b2880 0x7f91cc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710ed890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e71010120 con 0x559e70fead80 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559e70fb5a20 con 0x559e70f70520 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559e7100c0e0 con 0x559e710ed480 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91d77fe700 1 -- 172.21.15.37:0/1650801733 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f91d800f020 con 0x7f91e0110990 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91e6a54700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91e6253700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91e6253700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50152/0 (socket says 172.21.15.37:50152) 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91e6253700 1 -- 172.21.15.37:0/3546112776 learned_addr learned my addr 172.21.15.37:0/3546112776 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.785+0000 7f91e5a52700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f91cc0b2880 0x7f91cc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91e6253700 1 -- 172.21.15.37:0/3546112776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 msgr2=0x559e710ed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91e6253700 1 --2- 172.21.15.37:0/3546112776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710ed890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91e6253700 1 -- 172.21.15.37:0/3546112776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 msgr2=0x559e710f3800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91e6253700 1 --2- 172.21.15.37:0/3546112776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f3800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91e6253700 1 -- 172.21.15.37:0/3546112776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e70fa6580 con 0x559e70fead80 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91e6253700 1 --2- 172.21.15.37:0/3546112776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f32c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f91d000bdd0 tx=0x7f91d00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8f6dc932a4460e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91d4d47700 1 -- 172.21.15.37:0/3546112776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d0010e10 con 0x559e70fead80 2024-05-09T01:15:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.786+0000 7f91d4d47700 1 -- 172.21.15.37:0/3546112776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d001c930 con 0x559e70fead80 2024-05-09T01:15:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3546112776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 msgr2=0x559e710f32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3546112776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f32c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f91d000bdd0 tx=0x7f91d00106b0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91e5a52700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f91cc0b2880 0x7f91cc0b4d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x559e710e9a80 tx=0x7f91dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3546112776 shutdown_connections 2024-05-09T01:15:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3546112776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710ed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3546112776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f32c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3546112776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3546112776 >> 172.21.15.37:0/3546112776 conn(0x559e70f73ff0 msgr2=0x559e710e82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3546112776 shutdown_connections 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.787+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3546112776 wait complete. 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 -- start start 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 Processor -- start 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e710ee280 con 0x559e70fead80 2024-05-09T01:15:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559e70faaba0 con 0x559e70f70520 2024-05-09T01:15:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559e710fa0a0 con 0x559e710ed480 2024-05-09T01:15:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91e5a52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91e5a52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50156/0 (socket says 172.21.15.37:50156) 2024-05-09T01:15:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.788+0000 7f91e5a52700 1 -- 172.21.15.37:0/1338347769 learned_addr learned my addr 172.21.15.37:0/1338347769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.789+0000 7f91f6ecdb80 10 client.0 _ll_register_callbacks cb 0x559e70e81740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.789+0000 7f91e6253700 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.789+0000 7f91e6253700 1 -- 172.21.15.37:0/1338347769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 msgr2=0x559e710f7a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.789+0000 7f91e6253700 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710f7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.789+0000 7f91e6253700 1 -- 172.21.15.37:0/1338347769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 msgr2=0x559e710f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.789+0000 7f91e6253700 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.789+0000 7f91e6253700 1 -- 172.21.15.37:0/1338347769 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e70e8b510 con 0x559e70f70520 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.790+0000 7f91e6253700 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f6ff0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f91d000bda0 tx=0x7f91d0010f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3c18e1781abdede server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.790+0000 7f91c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.790+0000 7f91c9ffb700 1 -- 172.21.15.37:0/1338347769 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d001c680 con 0x559e70f70520 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.790+0000 7f91c9ffb700 1 -- 172.21.15.37:0/1338347769 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f91d001cae0 con 0x559e70f70520 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.791+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d001c930 con 0x559e70f70520 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.791+0000 7f91c9ffb700 1 -- 172.21.15.37:0/1338347769 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f91d001cce0 con 0x559e70f70520 2024-05-09T01:15:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.791+0000 7f91f6ecdb80 10 client.27581 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.791+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559e71104b20 con 0x559e70f70520 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91c9ffb700 1 -- 172.21.15.37:0/1338347769 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91d0005570 con 0x559e70f70520 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91c9ffb700 1 -- 172.21.15.37:0/1338347769 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f91d0003b80 con 0x559e70f70520 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91f6ecdb80 10 client.27581 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91f6ecdb80 10 client.27581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91f6ecdb80 20 client.27581 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71107100 0x559e71109520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91f6ecdb80 4 client.27581 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f91d001c930 con 0x559e71107100 2024-05-09T01:15:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.792+0000 7f91e5a52700 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71107100 0x559e71109520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.793+0000 7f91c9ffb700 10 client.27581 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.793+0000 7f91e5a52700 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71107100 0x559e71109520 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da64db2b3d520d95 server_cookie=432ed7cfe3fadbfd in_seq=0 out_seq=0 2024-05-09T01:15:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91c9ffb700 1 -- 172.21.15.37:0/1338347769 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f91d001c930 con 0x559e71107100 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91c9ffb700 10 client.27581 handle_command_reply: tid=0 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 client.27581 shutdown 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 msgr2=0x559e710f6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f6ff0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f91d000bda0 tx=0x7f91d0010f60 comp rx=0 tx=0).stop 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 shutdown_connections 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71107100 0x559e71109520 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70f70520 0x559e710f6ff0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/1338347769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e710f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 >> 172.21.15.37:0/1338347769 conn(0x559e70f73ff0 msgr2=0x559e710e2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91c9ffb700 0 client.27581 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 shutdown_connections 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/1338347769 wait complete. 2024-05-09T01:15:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.794+0000 7f91f6ecdb80 20 client.27581 trim_cache size 0 max 16384 2024-05-09T01:15:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 Processor -- start 2024-05-09T01:15:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 -- start start 2024-05-09T01:15:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70f70520 0x559e710e2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70fead80 0x559e71103390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01bd860 con 0x559e70f70520 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01bf3d0 con 0x559e70fead80 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01bdf30 con 0x559e710ed480 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91e6253700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70f70520 0x559e710e2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91e5a52700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70fead80 0x559e71103390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91e6a54700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91e6253700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70f70520 0x559e710e2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50162/0 (socket says 172.21.15.37:50162) 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91e6253700 1 -- 172.21.15.37:0/3491323931 learned_addr learned my addr 172.21.15.37:0/3491323931 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.822+0000 7f91e5a52700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70fead80 0x559e71103390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57494/0 (socket says 172.21.15.37:57494) 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91e5a52700 1 -- 172.21.15.37:0/3491323931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 msgr2=0x559e710f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91e5a52700 1 --2- 172.21.15.37:0/3491323931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91e5a52700 1 -- 172.21.15.37:0/3491323931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70f70520 msgr2=0x559e710e2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91e5a52700 1 --2- 172.21.15.37:0/3491323931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70f70520 0x559e710e2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91e5a52700 1 -- 172.21.15.37:0/3491323931 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e710f2d00 con 0x559e70fead80 2024-05-09T01:15:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91e5a52700 1 --2- 172.21.15.37:0/3491323931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70fead80 0x559e71103390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x559e710ee3b0 tx=0x7f91dc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22674cd94e2fe850 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91cbfff700 1 -- 172.21.15.37:0/3491323931 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc02f070 con 0x559e70fead80 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91cbfff700 1 -- 172.21.15.37:0/3491323931 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc012d90 con 0x559e70fead80 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.823+0000 7f91cbfff700 1 -- 172.21.15.37:0/3491323931 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91dc020870 con 0x559e70fead80 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.824+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3491323931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70fead80 msgr2=0x559e71103390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.824+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3491323931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70fead80 0x559e71103390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x559e710ee3b0 tx=0x7f91dc014000 comp rx=0 tx=0).stop 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3491323931 shutdown_connections 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3491323931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e710ed480 0x559e710f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3491323931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70f70520 0x559e710e2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3491323931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e70fead80 0x559e71103390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3491323931 >> 172.21.15.37:0/3491323931 conn(0x559e70f73ff0 msgr2=0x559e710f5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3491323931 shutdown_connections 2024-05-09T01:15:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3491323931 wait complete. 2024-05-09T01:15:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 -- start start 2024-05-09T01:15:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.825+0000 7f91f6ecdb80 1 Processor -- start 2024-05-09T01:15:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e70f70520 0x559e7110c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e71109890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91f6ecdb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e710ed480 0x559e71109dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01bed00 con 0x559e70fead80 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01be630 con 0x559e710ed480 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91f6ecdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f91e01bb840 con 0x559e70f70520 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91f6ecdb80 10 client.0 _ll_register_callbacks cb 0x559e70e81740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6253700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e70f70520 0x559e7110c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6253700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e70f70520 0x559e7110c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43464/0 (socket says 172.21.15.37:43464) 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6253700 1 -- 172.21.15.37:0/3799811898 learned_addr learned my addr 172.21.15.37:0/3799811898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6a54700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e710ed480 0x559e71109dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e5a52700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e71109890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6a54700 1 -- 172.21.15.37:0/3799811898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e70f70520 msgr2=0x559e7110c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6a54700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e70f70520 0x559e7110c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6a54700 1 -- 172.21.15.37:0/3799811898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 msgr2=0x559e71109890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6a54700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e71109890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6a54700 1 -- 172.21.15.37:0/3799811898 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e7110a3c0 con 0x559e710ed480 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6253700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e70f70520 0x559e7110c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91e6a54700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e710ed480 0x559e71109dd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91d80e05e0 tx=0x7f91d80aa000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b40abf3b0af93dec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.826+0000 7f91c9ffb700 1 -- 172.21.15.37:0/3799811898 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d80940e0 con 0x559e710ed480 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91dc012d90 con 0x559e710ed480 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91c9ffb700 1 -- 172.21.15.37:0/3799811898 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f91d80b2a80 con 0x559e710ed480 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91c9ffb700 1 -- 172.21.15.37:0/3799811898 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f91d80aa140 con 0x559e710ed480 2024-05-09T01:15:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 10 client.27587 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559e71171460 con 0x559e710ed480 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91c9ffb700 1 -- 172.21.15.37:0/3799811898 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91dc012d90 con 0x559e710ed480 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91c9ffb700 1 -- 172.21.15.37:0/3799811898 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f91d8011070 con 0x559e710ed480 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 10 client.27587 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 10 client.27587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 20 client.27587 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71171b40 0x559e71173f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 4 client.27587 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559e7101db00 con 0x559e71171b40 2024-05-09T01:15:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.827+0000 7f91e6253700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71171b40 0x559e71173f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.828+0000 7f91c9ffb700 10 client.27587 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.828+0000 7f91e6253700 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71171b40 0x559e71173f60 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66198847941fac24 server_cookie=b53bbc1ef48b050d in_seq=0 out_seq=0 2024-05-09T01:15:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.829+0000 7f91c9ffb700 1 -- 172.21.15.37:0/3799811898 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559e7101db00 con 0x559e71171b40 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.829+0000 7f91c9ffb700 10 client.27587 handle_command_reply: tid=0 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.829+0000 7f91f6ecdb80 1 client.27587 shutdown 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e710ed480 msgr2=0x559e71109dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e710ed480 0x559e71109dd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91d80e05e0 tx=0x7f91d80aa000 comp rx=0 tx=0).stop 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 shutdown_connections 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x559e71171b40 0x559e71173f60 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559e710ed480 0x559e71109dd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91c9ffb700 0 client.27587 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559e70f70520 0x559e7110c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 --2- 172.21.15.37:0/3799811898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e70fead80 0x559e71109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 >> 172.21.15.37:0/3799811898 conn(0x559e70f73ff0 msgr2=0x559e710e2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 shutdown_connections 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.830+0000 7f91f6ecdb80 1 -- 172.21.15.37:0/3799811898 wait complete. 2024-05-09T01:15:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91f6ecdb80 20 client.27587 trim_cache size 0 max 16384 2024-05-09T01:15:37.832 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:15:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:15:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "e9f2ae63-2c45-4d83-a227-89f6fc09b14a", 2024-05-09T01:15:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:15:37.832 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f91cc0b2880 msgr2=0x7f91cc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f91cc0b2880 0x7f91cc0b4d90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x559e710e9a80 tx=0x7f91dc009260 comp rx=0 tx=0).stop 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91e0110990 msgr2=0x7f91e006ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91e0110990 0x7f91e006ebe0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f91d800d010 tx=0x7f91d8004d00 comp rx=0 tx=0).stop 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 shutdown_connections 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f91cc0b2880 0x7f91cc0b4d90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91e0110990 0x7f91e006ebe0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f91e010a960 0x7f91e00753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 --2- 172.21.15.37:0/1650801733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91e010b2b0 0x7f91e006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 >> 172.21.15.37:0/1650801733 conn(0x7f91e0076d30 msgr2=0x7f91e0108860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 shutdown_connections 2024-05-09T01:15:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:37.831+0000 7f91e84b7700 1 -- 172.21.15.37:0/1650801733 wait complete. 2024-05-09T01:15:38.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:15:38.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:38 smithi037 ceph-mon[30122]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.9 MiB/s wr, 699 op/s 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:38 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:38 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:38 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:38 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:38 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:38 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:38 smithi151 ceph-mon[34780]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.9 MiB/s wr, 699 op/s 2024-05-09T01:15:38.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:38 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:15:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:38 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:15:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:38 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:15:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:38 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:38 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:38 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:38 smithi136 ceph-mon[34110]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.9 MiB/s wr, 699 op/s 2024-05-09T01:15:38.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:38 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:15:38.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:38 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:15:38.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:38 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:15:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:38 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:38 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:38 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:15:39.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:39 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:39 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:39 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:39 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:39 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:39 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:39 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:39 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:39 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:15:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:39 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:15:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:39 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:39 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:39 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:15:39.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:39 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:39 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:15:39.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:39 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:15:39.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:39 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:39.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:39 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:15:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 800.0 s, 2115.0 tps, lat 47.678 ms stddev 62.846 2024-05-09T01:15:40.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:40 smithi037 ceph-mon[30122]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 615 op/s 2024-05-09T01:15:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:40 smithi151 ceph-mon[34780]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 615 op/s 2024-05-09T01:15:40.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:40 smithi136 ceph-mon[34110]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.4 MiB/s wr, 615 op/s 2024-05-09T01:15:41.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.021+0000 7ff6e1736700 1 -- 172.21.15.37:0/3992360683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 msgr2=0x7ff6dc1038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.021+0000 7ff6e1736700 1 --2- 172.21.15.37:0/3992360683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc1038f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009990 tx=0x7ff6cc009ca0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.026+0000 7ff6e1736700 1 -- 172.21.15.37:0/3992360683 shutdown_connections 2024-05-09T01:15:41.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.026+0000 7ff6e1736700 1 --2- 172.21.15.37:0/3992360683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6dc108760 0x7ff6dc06c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.026+0000 7ff6e1736700 1 --2- 172.21.15.37:0/3992360683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc1038f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.026+0000 7ff6e1736700 1 --2- 172.21.15.37:0/3992360683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc107e10 0x7ff6dc108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.026+0000 7ff6e1736700 1 -- 172.21.15.37:0/3992360683 >> 172.21.15.37:0/3992360683 conn(0x7ff6dc0fef30 msgr2=0x7ff6dc101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.027+0000 7ff6e1736700 1 -- 172.21.15.37:0/3992360683 shutdown_connections 2024-05-09T01:15:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.027+0000 7ff6e1736700 1 -- 172.21.15.37:0/3992360683 wait complete. 2024-05-09T01:15:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.028+0000 7ff6e1736700 1 Processor -- start 2024-05-09T01:15:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.028+0000 7ff6e1736700 1 -- start start 2024-05-09T01:15:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.029+0000 7ff6e1736700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc111920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.029+0000 7ff6e1736700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc107e10 0x7ff6dc10fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.029+0000 7ff6e1736700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6dc108760 0x7ff6dc110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.029+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc111920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.029+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc111920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43476/0 (socket says 172.21.15.37:43476) 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6daffd700 1 -- 172.21.15.37:0/1949401181 learned_addr learned my addr 172.21.15.37:0/1949401181 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc112450 con 0x7ff6dc107e10 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1122d0 con 0x7ff6dc108760 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1125d0 con 0x7ff6dc1034e0 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6db7fe700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6dc108760 0x7ff6dc110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc107e10 0x7ff6dc10fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6daffd700 1 -- 172.21.15.37:0/1949401181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6dc108760 msgr2=0x7ff6dc110010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6daffd700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6dc108760 0x7ff6dc110010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6daffd700 1 -- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc107e10 msgr2=0x7ff6dc10fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.030+0000 7ff6daffd700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc107e10 0x7ff6dc10fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.031+0000 7ff6daffd700 1 -- 172.21.15.37:0/1949401181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc110600 con 0x7ff6dc1034e0 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.031+0000 7ff6db7fe700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6dc108760 0x7ff6dc110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.031+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc107e10 0x7ff6dc10fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.032+0000 7ff6daffd700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc111920 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0057c0 tx=0x7ff6cc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:41.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.032+0000 7ff6c3fff700 1 -- 172.21.15.37:0/1949401181 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc026070 con 0x7ff6dc1034e0 2024-05-09T01:15:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.032+0000 7ff6c3fff700 1 -- 172.21.15.37:0/1949401181 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6cc004080 con 0x7ff6dc1034e0 2024-05-09T01:15:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.032+0000 7ff6c3fff700 1 -- 172.21.15.37:0/1949401181 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc00fe00 con 0x7ff6dc1034e0 2024-05-09T01:15:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.035+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc110890 con 0x7ff6dc1034e0 2024-05-09T01:15:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.035+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc1adea0 con 0x7ff6dc1034e0 2024-05-09T01:15:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.040+0000 7ff6c3fff700 1 -- 172.21.15.37:0/1949401181 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff6cc003bd0 con 0x7ff6dc1034e0 2024-05-09T01:15:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.041+0000 7ff6c3fff700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6c40b2a90 0x7ff6c40b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.041+0000 7ff6c3fff700 1 -- 172.21.15.37:0/1949401181 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff6cc0e31d0 con 0x7ff6dc1034e0 2024-05-09T01:15:41.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.043+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6c40b2a90 0x7ff6c40b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.046+0000 7ff6f014cb80 1 Processor -- start 2024-05-09T01:15:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.046+0000 7ff6f014cb80 1 -- start start 2024-05-09T01:15:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.047+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e056834f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.047+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.047+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.047+0000 7ff6da7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.047+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e0559fff0 con 0x557e055004a0 2024-05-09T01:15:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.047+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557e0553e7f0 con 0x557e055ea160 2024-05-09T01:15:41.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.047+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e0559bfb0 con 0x557e0567d6a0 2024-05-09T01:15:41.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.048+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.048+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e056834f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.048+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:43488/0 (socket says 172.21.15.37:43488) 2024-05-09T01:15:41.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.048+0000 7ff6db7fe700 1 -- 172.21.15.37:0/2226990200 learned_addr learned my addr 172.21.15.37:0/2226990200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:41.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.049+0000 7ff6da7fc700 1 -- 172.21.15.37:0/2226990200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 msgr2=0x557e0567dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:41.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.049+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/2226990200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.049+0000 7ff6da7fc700 1 -- 172.21.15.37:0/2226990200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 msgr2=0x557e056834f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.049+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/2226990200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e056834f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.049+0000 7ff6da7fc700 1 -- 172.21.15.37:0/2226990200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e05536370 con 0x557e055004a0 2024-05-09T01:15:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.050+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/2226990200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683a30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc1029b0 tx=0x7ff6d00135e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f189821932f745 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.050+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6c40b2a90 0x7ff6c40b4fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000e000 tx=0x7ff6d0011000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.051+0000 7ff6c17fa700 1 -- 172.21.15.37:0/2226990200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000f040 con 0x557e055004a0 2024-05-09T01:15:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.051+0000 7ff6c17fa700 1 -- 172.21.15.37:0/2226990200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d0013e30 con 0x557e055004a0 2024-05-09T01:15:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.051+0000 7ff6c17fa700 1 -- 172.21.15.37:0/2226990200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0003b40 con 0x557e055004a0 2024-05-09T01:15:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.052+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2226990200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 msgr2=0x557e05683a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.052+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2226990200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683a30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc1029b0 tx=0x7ff6d00135e0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.052+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2226990200 shutdown_connections 2024-05-09T01:15:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.052+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2226990200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.052+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2226990200 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e056834f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.052+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2226990200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683a30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.052+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2226990200 >> 172.21.15.37:0/2226990200 conn(0x557e055606a0 msgr2=0x557e05678400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.053+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2226990200 shutdown_connections 2024-05-09T01:15:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.053+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2226990200 wait complete. 2024-05-09T01:15:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.053+0000 7ff6f014cb80 1 -- start start 2024-05-09T01:15:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.053+0000 7ff6f014cb80 1 Processor -- start 2024-05-09T01:15:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.054+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e056872a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.054+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e056877e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.054+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e05687d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.054+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e0541bba0 con 0x557e055004a0 2024-05-09T01:15:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.054+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557e0555a150 con 0x557e055ea160 2024-05-09T01:15:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.054+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e0568a1d0 con 0x557e0567d6a0 2024-05-09T01:15:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.054+0000 7ff6f014cb80 10 client.0 _ll_register_callbacks cb 0x557e054116c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.055+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e056872a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.055+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e056872a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50196/0 (socket says 172.21.15.37:50196) 2024-05-09T01:15:41.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.055+0000 7ff6daffd700 1 -- 172.21.15.37:0/2185509096 learned_addr learned my addr 172.21.15.37:0/2185509096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:41.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.056+0000 7ff6daffd700 1 -- 172.21.15.37:0/2185509096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 msgr2=0x557e05687d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:15:41.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.056+0000 7ff6daffd700 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e05687d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.056+0000 7ff6daffd700 1 -- 172.21.15.37:0/2185509096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 msgr2=0x557e056877e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:15:41.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.056+0000 7ff6daffd700 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e056877e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.056+0000 7ff6daffd700 1 -- 172.21.15.37:0/2185509096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e0541b490 con 0x557e055004a0 2024-05-09T01:15:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.057+0000 7ff6daffd700 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e056872a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b5c0 tx=0x7ff6cc00f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa29450e4e804e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.057+0000 7ff6beff5700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:15:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.058+0000 7ff6beff5700 1 -- 172.21.15.37:0/2185509096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0c4060 con 0x557e055004a0 2024-05-09T01:15:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.058+0000 7ff6beff5700 1 -- 172.21.15.37:0/2185509096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff6cc0b10b0 con 0x557e055004a0 2024-05-09T01:15:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.059+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d0013e30 con 0x557e055004a0 2024-05-09T01:15:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.060+0000 7ff6beff5700 1 -- 172.21.15.37:0/2185509096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff6cc0aaf80 con 0x557e055004a0 2024-05-09T01:15:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.060+0000 7ff6f014cb80 10 client.17664 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.060+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557e05694c30 con 0x557e055004a0 2024-05-09T01:15:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6beff5700 1 -- 172.21.15.37:0/2185509096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d0013e30 con 0x557e055004a0 2024-05-09T01:15:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6beff5700 1 -- 172.21.15.37:0/2185509096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7ff6cc0b31c0 con 0x557e055004a0 2024-05-09T01:15:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6f014cb80 10 client.17664 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6f014cb80 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6f014cb80 20 client.17664 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05697150 0x557e056995b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6f014cb80 4 client.17664 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e055ad9d0 con 0x557e05697150 2024-05-09T01:15:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.061+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05697150 0x557e056995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.062+0000 7ff6beff5700 10 client.17664 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.063+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05697150 0x557e056995b0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caaf029ca4f03721 server_cookie=e7ffdae17cfa69cb in_seq=0 out_seq=0 2024-05-09T01:15:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6beff5700 1 -- 172.21.15.37:0/2185509096 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e055ad9d0 con 0x557e05697150 2024-05-09T01:15:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6beff5700 10 client.17664 handle_command_reply: tid=0 2024-05-09T01:15:41.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 client.17664 shutdown 2024-05-09T01:15:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 msgr2=0x557e056872a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e056872a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b5c0 tx=0x7ff6cc00f6d0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 shutdown_connections 2024-05-09T01:15:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05697150 0x557e056995b0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e05687d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e056872a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2185509096 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e056877e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 >> 172.21.15.37:0/2185509096 conn(0x557e055606a0 msgr2=0x557e056781c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6beff5700 0 client.17664 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 shutdown_connections 2024-05-09T01:15:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2185509096 wait complete. 2024-05-09T01:15:41.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.064+0000 7ff6f014cb80 20 client.17664 trim_cache size 0 max 16384 2024-05-09T01:15:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 Processor -- start 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 -- start start 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e05681950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1b50f0 con 0x557e055004a0 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1b6c60 con 0x557e055ea160 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1b57c0 con 0x557e0567d6a0 2024-05-09T01:15:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50204/0 (socket says 172.21.15.37:50204) 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6daffd700 1 -- 172.21.15.37:0/2542926346 learned_addr learned my addr 172.21.15.37:0/2542926346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e05681950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.091+0000 7ff6db7fe700 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.092+0000 7ff6db7fe700 1 -- 172.21.15.37:0/2542926346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 msgr2=0x557e05681950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.092+0000 7ff6db7fe700 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e05681950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.092+0000 7ff6db7fe700 1 -- 172.21.15.37:0/2542926346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 msgr2=0x557e05683860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.092+0000 7ff6db7fe700 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.092+0000 7ff6db7fe700 1 -- 172.21.15.37:0/2542926346 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e05671f60 con 0x557e0567d6a0 2024-05-09T01:15:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.092+0000 7ff6db7fe700 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567cda0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009fd0 tx=0x7ff6d4009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=403d2def6031dc93 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.093+0000 7ff6c0ff9700 1 -- 172.21.15.37:0/2542926346 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d401a020 con 0x557e0567d6a0 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.093+0000 7ff6c0ff9700 1 -- 172.21.15.37:0/2542926346 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d4016df0 con 0x557e0567d6a0 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.093+0000 7ff6c0ff9700 1 -- 172.21.15.37:0/2542926346 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4014330 con 0x557e0567d6a0 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.094+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2542926346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 msgr2=0x557e0567cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.094+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567cda0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009fd0 tx=0x7ff6d4009650 comp rx=0 tx=0).stop 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.094+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2542926346 shutdown_connections 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.094+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e0567d6a0 0x557e0567cda0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.094+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e055004a0 0x557e05683860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/2542926346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055ea160 0x557e05681950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2542926346 >> 172.21.15.37:0/2542926346 conn(0x557e055606a0 msgr2=0x557e0567c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2542926346 shutdown_connections 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 -- 172.21.15.37:0/2542926346 wait complete. 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 -- start start 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 Processor -- start 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055004a0 0x557e0568f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e055ea160 0x557e0568f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0567d6a0 0x557e0568a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1b6590 con 0x557e0567d6a0 2024-05-09T01:15:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1b5ec0 con 0x557e055004a0 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1b30b0 con 0x557e055ea160 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.095+0000 7ff6f014cb80 10 client.0 _ll_register_callbacks cb 0x557e054116c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0567d6a0 0x557e0568a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055004a0 0x557e0568f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055004a0 0x557e0568f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:57576/0 (socket says 172.21.15.37:57576) 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 -- 172.21.15.37:0/1499655033 learned_addr learned my addr 172.21.15.37:0/1499655033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e055ea160 0x557e0568f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 -- 172.21.15.37:0/1499655033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e055ea160 msgr2=0x557e0568f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e055ea160 0x557e0568f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 -- 172.21.15.37:0/1499655033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0567d6a0 msgr2=0x557e0568a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0567d6a0 0x557e0568a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 -- 172.21.15.37:0/1499655033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e0568a860 con 0x557e055004a0 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6daffd700 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055004a0 0x557e0568f270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0a6e20 tx=0x7ff6cc009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e9db21c0bba72cc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6beff5700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6beff5700 1 -- 172.21.15.37:0/1499655033 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0c4040 con 0x557e055004a0 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6beff5700 1 -- 172.21.15.37:0/1499655033 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7ff6cc0a6e70 con 0x557e055004a0 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.096+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4016df0 con 0x557e055004a0 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.097+0000 7ff6beff5700 1 -- 172.21.15.37:0/1499655033 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff6cc0aa650 con 0x557e055004a0 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.097+0000 7ff6f014cb80 10 client.27599 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:41.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.097+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557e057021b0 con 0x557e055004a0 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6beff5700 1 -- 172.21.15.37:0/1499655033 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6cc0aa880 con 0x557e055004a0 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6beff5700 1 -- 172.21.15.37:0/1499655033 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7ff6cc0cbaa0 con 0x557e055004a0 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6f014cb80 10 client.27599 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6f014cb80 10 client.27599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6f014cb80 20 client.27599 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05702700 0x557e05704b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6f014cb80 4 client.27599 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.098+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff6d4016df0 con 0x557e05702700 2024-05-09T01:15:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05702700 0x557e05704b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6da7fc700 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05702700 0x557e05704b20 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7447f9a071b79b1 server_cookie=d9618f0ac26969a6 in_seq=0 out_seq=0 2024-05-09T01:15:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6beff5700 10 client.27599 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6beff5700 1 -- 172.21.15.37:0/1499655033 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7ff6d4016df0 con 0x557e05702700 2024-05-09T01:15:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6beff5700 10 client.27599 handle_command_reply: tid=0 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 client.27599 shutdown 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055004a0 msgr2=0x557e0568f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055004a0 0x557e0568f270 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0a6e20 tx=0x7ff6cc009380 comp rx=0 tx=0).stop 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 shutdown_connections 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e05702700 0x557e05704b20 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e0567d6a0 0x557e0568a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e055004a0 0x557e0568f270 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6beff5700 0 client.27599 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 --2- 172.21.15.37:0/1499655033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e055ea160 0x557e0568f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 >> 172.21.15.37:0/1499655033 conn(0x557e055606a0 msgr2=0x557e0567ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 shutdown_connections 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.099+0000 7ff6f014cb80 1 -- 172.21.15.37:0/1499655033 wait complete. 2024-05-09T01:15:41.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6f014cb80 20 client.27599 trim_cache size 0 max 16384 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "e9f2ae63-2c45-4d83-a227-89f6fc09b14a": { 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "e9f2ae63-2c45-4d83-a227-89f6fc09b14a", 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:15:41.106 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:15:41.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6c40b2a90 msgr2=0x7ff6c40b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6c40b2a90 0x7ff6c40b4fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000e000 tx=0x7ff6d0011000 comp rx=0 tx=0).stop 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 msgr2=0x7ff6dc111920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc111920 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0057c0 tx=0x7ff6cc0057f0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 shutdown_connections 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7ff6c40b2a90 0x7ff6c40b4fa0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6dc108760 0x7ff6dc110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6dc1034e0 0x7ff6dc111920 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 --2- 172.21.15.37:0/1949401181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc107e10 0x7ff6dc10fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.100+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 >> 172.21.15.37:0/1949401181 conn(0x7ff6dc0fef30 msgr2=0x7ff6dc105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.101+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 shutdown_connections 2024-05-09T01:15:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:15:41.101+0000 7ff6e1736700 1 -- 172.21.15.37:0/1949401181 wait complete. 2024-05-09T01:15:41.933 INFO:tasks.cephfs.filesystem:scrub status for tag:e9f2ae63-2c45-4d83-a227-89f6fc09b14a - {'path': '/', 'tag': 'e9f2ae63-2c45-4d83-a227-89f6fc09b14a', 'options': 'recursive,force'} 2024-05-09T01:15:42.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:42 smithi037 ceph-mon[30122]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.6 MiB/s wr, 756 op/s 2024-05-09T01:15:42.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:42 smithi136 ceph-mon[34110]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.6 MiB/s wr, 756 op/s 2024-05-09T01:15:42.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:42 smithi151 ceph-mon[34780]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.6 MiB/s wr, 756 op/s 2024-05-09T01:15:44.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:44 smithi136 ceph-mon[34110]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.6 MiB/s wr, 755 op/s 2024-05-09T01:15:44.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:44 smithi037 ceph-mon[30122]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.6 MiB/s wr, 755 op/s 2024-05-09T01:15:44.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:44 smithi151 ceph-mon[34780]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.6 MiB/s wr, 755 op/s 2024-05-09T01:15:45.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 805.0 s, 2140.0 tps, lat 46.340 ms stddev 52.073 2024-05-09T01:15:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 -- 172.21.15.37:0/1636492726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 msgr2=0x7f8ee41129d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/1636492726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41129d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8edc005fd0 tx=0x7f8edc02b400 comp rx=0 tx=0).stop 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 -- 172.21.15.37:0/1636492726 shutdown_connections 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/1636492726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41129d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/1636492726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ee410b8b0 0x7f8ee410bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/1636492726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee410a670 0x7f8ee410b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 -- 172.21.15.37:0/1636492726 >> 172.21.15.37:0/1636492726 conn(0x7f8ee4070a90 msgr2=0x7f8ee4072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 -- 172.21.15.37:0/1636492726 shutdown_connections 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.926+0000 7f8eec4a7640 1 -- 172.21.15.37:0/1636492726 wait complete. 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.927+0000 7f8eec4a7640 1 Processor -- start 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.927+0000 7f8eec4a7640 1 -- start start 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eec4a7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ee410a670 0x7f8ee41a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eec4a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee410b8b0 0x7f8ee41a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eec4a7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41b9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eec4a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee4115e00 con 0x7f8ee410b8b0 2024-05-09T01:15:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eec4a7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee4115c80 con 0x7f8ee41105b0 2024-05-09T01:15:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eec4a7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee4115f80 con 0x7f8ee410a670 2024-05-09T01:15:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eeaa44640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eeaa44640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41b9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51924/0 (socket says 172.21.15.37:51924) 2024-05-09T01:15:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.928+0000 7f8eeaa44640 1 -- 172.21.15.37:0/2314618614 learned_addr learned my addr 172.21.15.37:0/2314618614 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.929+0000 7f8eeaa44640 1 -- 172.21.15.37:0/2314618614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ee410a670 msgr2=0x7f8ee41a0950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.929+0000 7f8eeaa44640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ee410a670 0x7f8ee41a0950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.929+0000 7f8eeaa44640 1 -- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee410b8b0 msgr2=0x7f8ee41a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.929+0000 7f8eeaa44640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee410b8b0 0x7f8ee41a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.929+0000 7f8eeaa44640 1 -- 172.21.15.37:0/2314618614 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee41b9650 con 0x7f8ee41105b0 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.930+0000 7f8eeaa44640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41b9110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8edc007780 tx=0x7f8edc007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.930+0000 7f8edb7fe640 1 -- 172.21.15.37:0/2314618614 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc042070 con 0x7f8ee41105b0 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.930+0000 7f8edb7fe640 1 -- 172.21.15.37:0/2314618614 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8edc003e20 con 0x7f8ee41105b0 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.930+0000 7f8edb7fe640 1 -- 172.21.15.37:0/2314618614 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc037040 con 0x7f8ee41105b0 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.931+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee41b9820 con 0x7f8ee41105b0 2024-05-09T01:15:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.931+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee41b9c30 con 0x7f8ee41105b0 2024-05-09T01:15:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.937+0000 7f8edb7fe640 1 -- 172.21.15.37:0/2314618614 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8edc045070 con 0x7f8ee41105b0 2024-05-09T01:15:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.938+0000 7f8ef3434740 1 Processor -- start 2024-05-09T01:15:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.939+0000 7f8edb7fe640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8ed00b2920 0x7f8ed00b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.939+0000 7f8edb7fe640 1 -- 172.21.15.37:0/2314618614 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8edc1030b0 con 0x7f8ee41105b0 2024-05-09T01:15:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.939+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8ed00b2920 0x7f8ed00b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.942+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8ed00b2920 0x7f8ed00b4e30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00058c0 tx=0x7f8ee0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.945+0000 7f8ef3434740 1 -- start start 2024-05-09T01:15:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.945+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d0b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.945+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d0ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.945+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d12980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.945+0000 7f8ef3434740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558992c6f7c0 con 0x5589929464d0 2024-05-09T01:15:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.945+0000 7f8ef3434740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558992c0b0e0 con 0x5589929671b0 2024-05-09T01:15:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.945+0000 7f8ef3434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558992c6b780 con 0x55899293e2f0 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d0ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d0ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42442/0 (socket says 172.21.15.37:42442) 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1999259158 learned_addr learned my addr 172.21.15.37:0/1999259158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8eea243640 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d0b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8eeaa44640 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d12980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1999259158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 msgr2=0x558992d0b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d0b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1999259158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 msgr2=0x558992d12980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d12980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.946+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1999259158 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558992c347c0 con 0x55899293e2f0 2024-05-09T01:15:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.947+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d0ba80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000ed30 tx=0x7f8ee0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49fcd48143d4c2c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.947+0000 7f8ed8bfe640 1 -- 172.21.15.37:0/1999259158 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0020070 con 0x55899293e2f0 2024-05-09T01:15:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.947+0000 7f8ed8bfe640 1 -- 172.21.15.37:0/1999259158 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ee0025910 con 0x55899293e2f0 2024-05-09T01:15:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.947+0000 7f8ed8bfe640 1 -- 172.21.15.37:0/1999259158 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee001c960 con 0x55899293e2f0 2024-05-09T01:15:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 -- 172.21.15.37:0/1999259158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 msgr2=0x558992d0ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d0ba80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000ed30 tx=0x7f8ee0009f90 comp rx=0 tx=0).stop 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 -- 172.21.15.37:0/1999259158 shutdown_connections 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d12980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d0ba80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1999259158 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d0b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 -- 172.21.15.37:0/1999259158 >> 172.21.15.37:0/1999259158 conn(0x55899295b300 msgr2=0x558992d06e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 -- 172.21.15.37:0/1999259158 shutdown_connections 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.948+0000 7f8ef3434740 1 -- 172.21.15.37:0/1999259158 wait complete. 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.949+0000 7f8ef3434740 1 -- start start 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.949+0000 7f8ef3434740 1 Processor -- start 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.949+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55899293e2f0 0x558992d152f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.949+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929464d0 0x558992d15830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8ef3434740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558992d133d0 con 0x55899293e2f0 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55899293e2f0 0x558992d152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55899293e2f0 0x558992d152f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47424/0 (socket says 172.21.15.37:47424) 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 -- 172.21.15.37:0/1327574236 learned_addr learned my addr 172.21.15.37:0/1327574236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558992bf69c0 con 0x5589929671b0 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558992d13550 con 0x5589929464d0 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8ef3434740 10 client.0 _ll_register_callbacks cb 0x558992c23020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929464d0 0x558992d15830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eeaa44640 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 -- 172.21.15.37:0/1327574236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929464d0 msgr2=0x558992d15830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929464d0 0x558992d15830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 -- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 msgr2=0x558992d1c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.950+0000 7f8eea243640 1 -- 172.21.15.37:0/1327574236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558992c1d1f0 con 0x55899293e2f0 2024-05-09T01:15:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.954+0000 7f8eea243640 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55899293e2f0 0x558992d152f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400e1d0 tx=0x7f8ed400e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c549bf83c455015e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.954+0000 7f8ecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:15:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ecdffb640 1 -- 172.21.15.37:0/1327574236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4017070 con 0x55899293e2f0 2024-05-09T01:15:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ecdffb640 1 -- 172.21.15.37:0/1327574236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8ed4013680 con 0x55899293e2f0 2024-05-09T01:15:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ee0025910 con 0x55899293e2f0 2024-05-09T01:15:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ecdffb640 1 -- 172.21.15.37:0/1327574236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f8ed4023050 con 0x55899293e2f0 2024-05-09T01:15:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ef3434740 10 client.17676 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5589929d2790 con 0x55899293e2f0 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ecdffb640 1 -- 172.21.15.37:0/1327574236 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed4013d30 con 0x55899293e2f0 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.955+0000 7f8ecdffb640 1 -- 172.21.15.37:0/1327574236 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f8ed4012a40 con 0x55899293e2f0 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.956+0000 7f8ef3434740 10 client.17676 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.956+0000 7f8ef3434740 10 client.17676 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.956+0000 7f8ef3434740 20 client.17676 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.956+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558992925d80 0x558992d22d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.956+0000 7f8ef3434740 4 client.17676 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.956+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8ee0025910 con 0x558992925d80 2024-05-09T01:15:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.956+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558992925d80 0x558992d22d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.957+0000 7f8ecdffb640 10 client.17676 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.957+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558992925d80 0x558992d22d60 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9c2d91d6770ad5b server_cookie=f6af5919094b5b66 in_seq=0 out_seq=0 2024-05-09T01:15:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.958+0000 7f8ecdffb640 1 -- 172.21.15.37:0/1327574236 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f8ee0025910 con 0x558992925d80 2024-05-09T01:15:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.958+0000 7f8ecdffb640 10 client.17676 handle_command_reply: tid=0 2024-05-09T01:15:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.958+0000 7f8ef3434740 1 client.17676 shutdown 2024-05-09T01:15:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.958+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55899293e2f0 msgr2=0x558992d152f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.958+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55899293e2f0 0x558992d152f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400e1d0 tx=0x7f8ed400e690 comp rx=0 tx=0).stop 2024-05-09T01:15:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.958+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 shutdown_connections 2024-05-09T01:15:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.958+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558992925d80 0x558992d22d60 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ecdffb640 0 client.17676 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929464d0 0x558992d15830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1327574236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55899293e2f0 0x558992d152f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 >> 172.21.15.37:0/1327574236 conn(0x55899295b300 msgr2=0x558992d05700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 shutdown_connections 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ef3434740 1 -- 172.21.15.37:0/1327574236 wait complete. 2024-05-09T01:15:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.959+0000 7f8ef3434740 20 client.17676 trim_cache size 0 max 16384 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 Processor -- start 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 -- start start 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d155d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec800e300 con 0x5589929464d0 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec800fe70 con 0x5589929671b0 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ef3434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec800e9d0 con 0x55899293e2f0 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ee9a42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8eea243640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ee9a42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47438/0 (socket says 172.21.15.37:47438) 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8eea243640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d155d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:42458/0 (socket says 172.21.15.37:42458) 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1663337458 learned_addr learned my addr 172.21.15.37:0/1663337458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.978+0000 7f8eeaa44640 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1663337458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 msgr2=0x558992d155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d155d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1663337458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 msgr2=0x558992d1cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ee9a42640 1 -- 172.21.15.37:0/1663337458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558992a495f0 con 0x5589929464d0 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1c6b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x558992d0c8e0 tx=0x7f8ee0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d27fb014335f90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ecffff640 1 -- 172.21.15.37:0/1663337458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0039030 con 0x5589929464d0 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ecffff640 1 -- 172.21.15.37:0/1663337458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ee0035620 con 0x5589929464d0 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.979+0000 7f8ecffff640 1 -- 172.21.15.37:0/1663337458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee0014040 con 0x5589929464d0 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 -- 172.21.15.37:0/1663337458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 msgr2=0x558992d1c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1c6b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x558992d0c8e0 tx=0x7f8ee0009810 comp rx=0 tx=0).stop 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 -- 172.21.15.37:0/1663337458 shutdown_connections 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5589929671b0 0x558992d1cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1c6b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 --2- 172.21.15.37:0/1663337458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55899293e2f0 0x558992d155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 -- 172.21.15.37:0/1663337458 >> 172.21.15.37:0/1663337458 conn(0x55899295b300 msgr2=0x558992d14ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 -- 172.21.15.37:0/1663337458 shutdown_connections 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.980+0000 7f8ef3434740 1 -- 172.21.15.37:0/1663337458 wait complete. 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.981+0000 7f8ef3434740 1 -- start start 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.981+0000 7f8ef3434740 1 Processor -- start 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.981+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55899293e2f0 0x558992d1a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.981+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ef3434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929671b0 0x558992d1b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55899293e2f0 0x558992d1a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ee9a42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55899293e2f0 0x558992d1a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:51968/0 (socket says 172.21.15.37:51968) 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ee9a42640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47452/0 (socket says 172.21.15.37:47452) 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 -- 172.21.15.37:0/676681393 learned_addr learned my addr 172.21.15.37:0/676681393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec800f7a0 con 0x5589929464d0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec800f0d0 con 0x55899293e2f0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec800c2e0 con 0x5589929671b0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ef3434740 10 client.0 _ll_register_callbacks cb 0x7f8ed40092f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eeaa44640 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929671b0 0x558992d1b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 -- 172.21.15.37:0/676681393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929671b0 msgr2=0x558992d1b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929671b0 0x558992d1b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 -- 172.21.15.37:0/676681393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 msgr2=0x558992d1a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 -- 172.21.15.37:0/676681393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558992c33ed0 con 0x55899293e2f0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8eea243640 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55899293e2f0 0x558992d1a350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4013040 tx=0x7f8ed40138b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f66d4391254e21d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.982+0000 7f8ecdffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ecdffb640 1 -- 172.21.15.37:0/676681393 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4017040 con 0x55899293e2f0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ecdffb640 1 -- 172.21.15.37:0/676681393 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8ed40123d0 con 0x55899293e2f0 2024-05-09T01:15:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ee0035620 con 0x55899293e2f0 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ecdffb640 1 -- 172.21.15.37:0/676681393 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f8ed400eb90 con 0x55899293e2f0 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 10 client.27617 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558992d1cea0 con 0x55899293e2f0 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ecdffb640 1 -- 172.21.15.37:0/676681393 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed402c070 con 0x55899293e2f0 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ecdffb640 1 -- 172.21.15.37:0/676681393 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7f8ed401c8d0 con 0x55899293e2f0 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 10 client.27617 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 10 client.27617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 20 client.27617 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589928fb1c0 0x558992d8d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 4 client.27617 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.983+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8ee0035620 con 0x5589928fb1c0 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.984+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589928fb1c0 0x558992d8d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.984+0000 7f8ecdffb640 10 client.27617 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.984+0000 7f8ee9a42640 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589928fb1c0 0x558992d8d5e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f7284e0111b676f server_cookie=4a03871d332a37e6 in_seq=0 out_seq=0 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ecdffb640 1 -- 172.21.15.37:0/676681393 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f8ee0035620 con 0x5589928fb1c0 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ecdffb640 10 client.27617 handle_command_reply: tid=0 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 client.27617 shutdown 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55899293e2f0 msgr2=0x558992d1a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55899293e2f0 0x558992d1a350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4013040 tx=0x7f8ed40138b0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 shutdown_connections 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5589928fb1c0 0x558992d8d5e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ecdffb640 0 client.27617 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5589929671b0 0x558992d1b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589929464d0 0x558992d1a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 --2- 172.21.15.37:0/676681393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55899293e2f0 0x558992d1a350 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 >> 172.21.15.37:0/676681393 conn(0x55899295b300 msgr2=0x558992d09c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.992+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 shutdown_connections 2024-05-09T01:15:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8ef3434740 1 -- 172.21.15.37:0/676681393 wait complete. 2024-05-09T01:15:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8ef3434740 20 client.27617 trim_cache size 0 max 16384 2024-05-09T01:15:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:15:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:15:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:15:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8ed00b2920 msgr2=0x7f8ed00b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8ed00b2920 0x7f8ed00b4e30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8ee00058c0 tx=0x7f8ee0005850 comp rx=0 tx=0).stop 2024-05-09T01:15:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 msgr2=0x7f8ee41b9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41b9110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8edc007780 tx=0x7f8edc007c80 comp rx=0 tx=0).stop 2024-05-09T01:15:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 shutdown_connections 2024-05-09T01:15:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8ed00b2920 0x7f8ed00b4e30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ee41105b0 0x7f8ee41b9110 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ee410b8b0 0x7f8ee41a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 --2- 172.21.15.37:0/2314618614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ee410a670 0x7f8ee41a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 >> 172.21.15.37:0/2314618614 conn(0x7f8ee4070a90 msgr2=0x7f8ee410c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 shutdown_connections 2024-05-09T01:15:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:45.993+0000 7f8eec4a7640 1 -- 172.21.15.37:0/2314618614 wait complete. 2024-05-09T01:15:46.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:46 smithi136 ceph-mon[34110]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 8.1 MiB/s wr, 705 op/s 2024-05-09T01:15:46.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:46 smithi037 ceph-mon[30122]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 8.1 MiB/s wr, 705 op/s 2024-05-09T01:15:46.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:46 smithi151 ceph-mon[34780]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 8.1 MiB/s wr, 705 op/s 2024-05-09T01:15:48.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:48 smithi136 ceph-mon[34110]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.8 MiB/s wr, 796 op/s 2024-05-09T01:15:48.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:48 smithi037 ceph-mon[30122]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.8 MiB/s wr, 796 op/s 2024-05-09T01:15:48.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:48 smithi151 ceph-mon[34780]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.8 MiB/s wr, 796 op/s 2024-05-09T01:15:50.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 810.0 s, 1357.8 tps, lat 73.967 ms stddev 80.300 2024-05-09T01:15:50.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:50 smithi136 ceph-mon[34110]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.6 MiB/s wr, 696 op/s 2024-05-09T01:15:50.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:50 smithi037 ceph-mon[30122]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.6 MiB/s wr, 696 op/s 2024-05-09T01:15:50.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:50 smithi151 ceph-mon[34780]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.6 MiB/s wr, 696 op/s 2024-05-09T01:15:52.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:52 smithi136 ceph-mon[34110]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.1 MiB/s wr, 779 op/s 2024-05-09T01:15:52.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:52 smithi037 ceph-mon[30122]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.1 MiB/s wr, 779 op/s 2024-05-09T01:15:52.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:52 smithi151 ceph-mon[34780]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.1 MiB/s wr, 779 op/s 2024-05-09T01:15:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:53 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:15:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:53 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:15:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:53 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:15:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:53 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:15:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:53 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:15:53.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:53 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:53 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:53 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:53 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:53 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:53 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:53 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:53 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:53 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:15:53.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:53 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:15:54.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:54 smithi136 ceph-mon[34110]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-05-09T01:15:54.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:54 smithi037 ceph-mon[30122]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-05-09T01:15:54.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:54 smithi151 ceph-mon[34780]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 654 op/s 2024-05-09T01:15:55.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 815.0 s, 1110.4 tps, lat 89.522 ms stddev 95.548 2024-05-09T01:15:56.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:56 smithi136 ceph-mon[34110]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 559 op/s 2024-05-09T01:15:56.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:56 smithi037 ceph-mon[30122]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 559 op/s 2024-05-09T01:15:56.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:56 smithi151 ceph-mon[34780]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.6 MiB/s wr, 559 op/s 2024-05-09T01:15:58.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:15:58 smithi136 ceph-mon[34110]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 742 op/s 2024-05-09T01:15:58.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:15:58 smithi037 ceph-mon[30122]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 742 op/s 2024-05-09T01:15:58.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:15:58 smithi151 ceph-mon[34780]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 742 op/s 2024-05-09T01:15:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.139+0000 7fdb66427640 1 -- 172.21.15.37:0/665459889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 msgr2=0x7fdb601041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.139+0000 7fdb66427640 1 --2- 172.21.15.37:0/665459889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 0x7fdb601041a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009900 tx=0x7fdb5002a3f0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.140+0000 7fdb66427640 1 -- 172.21.15.37:0/665459889 shutdown_connections 2024-05-09T01:15:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.140+0000 7fdb66427640 1 --2- 172.21.15.37:0/665459889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb60108a90 0x7fdb6010aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.140+0000 7fdb66427640 1 --2- 172.21.15.37:0/665459889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 0x7fdb601041a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.140+0000 7fdb66427640 1 --2- 172.21.15.37:0/665459889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 0x7fdb60103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.140+0000 7fdb66427640 1 -- 172.21.15.37:0/665459889 >> 172.21.15.37:0/665459889 conn(0x7fdb600fdd40 msgr2=0x7fdb601001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.141+0000 7fdb66427640 1 -- 172.21.15.37:0/665459889 shutdown_connections 2024-05-09T01:15:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.141+0000 7fdb66427640 1 -- 172.21.15.37:0/665459889 wait complete. 2024-05-09T01:15:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.143+0000 7fdb66427640 1 Processor -- start 2024-05-09T01:15:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.143+0000 7fdb66427640 1 -- start start 2024-05-09T01:15:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb66427640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 0x7fdb6019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb66427640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 0x7fdb6019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb66427640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb60108a90 0x7fdb601a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb66427640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6010e650 con 0x7fdb60108a90 2024-05-09T01:15:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 0x7fdb6019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 0x7fdb6019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53498/0 (socket says 172.21.15.37:53498) 2024-05-09T01:15:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1077255581 learned_addr learned my addr 172.21.15.37:0/1077255581 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 0x7fdb6019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb649c4640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb60108a90 0x7fdb601a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6010e4d0 con 0x7fdb60103d90 2024-05-09T01:15:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.144+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb6010e7d0 con 0x7fdb60102b50 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1077255581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 msgr2=0x7fdb6019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 0x7fdb6019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb60108a90 msgr2=0x7fdb601a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb60108a90 0x7fdb601a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1077255581 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb601a1cb0 con 0x7fdb60102b50 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb649c4640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb60108a90 0x7fdb601a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 0x7fdb6019a170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400e9f0 tx=0x7fdb5400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5d7fa640 1 -- 172.21.15.37:0/1077255581 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400ccc0 con 0x7fdb60102b50 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5d7fa640 1 -- 172.21.15.37:0/1077255581 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb540035f0 con 0x7fdb60102b50 2024-05-09T01:15:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb601a1fa0 con 0x7fdb60102b50 2024-05-09T01:15:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb5d7fa640 1 -- 172.21.15.37:0/1077255581 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400ce60 con 0x7fdb60102b50 2024-05-09T01:15:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.145+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb601a2400 con 0x7fdb60102b50 2024-05-09T01:15:59.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.149+0000 7fdb6d3b8740 1 Processor -- start 2024-05-09T01:15:59.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.149+0000 7fdb6d3b8740 1 -- start start 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d183e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d183b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5592d179f7c0 con 0x5592d14971b0 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5592d173b0e0 con 0x5592d14764d0 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5592d179b780 con 0x5592d146e2f0 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5d7fa640 1 -- 172.21.15.37:0/1077255581 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdb54003aa0 con 0x7fdb60102b50 2024-05-09T01:15:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d183b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d183b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:52930/0 (socket says 172.21.15.37:52930) 2024-05-09T01:15:59.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 -- 172.21.15.37:0/830586110 learned_addr learned my addr 172.21.15.37:0/830586110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:59.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb649c4640 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d183e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 -- 172.21.15.37:0/830586110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 msgr2=0x5592d183ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 -- 172.21.15.37:0/830586110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 msgr2=0x5592d183e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d183e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.150+0000 7fdb5f7fe640 1 -- 172.21.15.37:0/830586110 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d17647c0 con 0x5592d14764d0 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.151+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d183b590 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009900 tx=0x7fdb50031b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d500dfb404bd3102 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.151+0000 7fdb5d7fa640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdb480b27e0 0x7fdb480b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.151+0000 7fdb467fc640 1 -- 172.21.15.37:0/830586110 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50040070 con 0x5592d14764d0 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.151+0000 7fdb467fc640 1 -- 172.21.15.37:0/830586110 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb500316a0 con 0x5592d14764d0 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.151+0000 7fdb5d7fa640 1 -- 172.21.15.37:0/1077255581 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdb540e24a0 con 0x7fdb60102b50 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.151+0000 7fdb649c4640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdb480b27e0 0x7fdb480b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/830586110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 msgr2=0x5592d183b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb649c4640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdb480b27e0 0x7fdb480b4cf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x5592d183c650 tx=0x7fdb58009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d183b590 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009900 tx=0x7fdb50031b10 comp rx=0 tx=0).stop 2024-05-09T01:15:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/830586110 shutdown_connections 2024-05-09T01:15:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d183b590 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/830586110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d183e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/830586110 >> 172.21.15.37:0/830586110 conn(0x5592d148b300 msgr2=0x5592d1836e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/830586110 shutdown_connections 2024-05-09T01:15:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.152+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/830586110 wait complete. 2024-05-09T01:15:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 -- start start 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 Processor -- start 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d184d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d184dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d1854e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5592d183c080 con 0x5592d14971b0 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5592d17269c0 con 0x5592d14764d0 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5592d184bd90 con 0x5592d146e2f0 2024-05-09T01:15:59.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb6d3b8740 10 client.0 _ll_register_callbacks cb 0x5592d1753020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb649c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d1854e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d184d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d184dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb649c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d1854e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37866/0 (socket says 172.21.15.37:37866) 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d184d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53520/0 (socket says 172.21.15.37:53520) 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.153+0000 7fdb649c4640 1 -- 172.21.15.37:0/3224798867 learned_addr learned my addr 172.21.15.37:0/3224798867 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb5f7fe640 1 -- 172.21.15.37:0/3224798867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 msgr2=0x5592d184d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d184d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb5f7fe640 1 -- 172.21.15.37:0/3224798867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 msgr2=0x5592d1854e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d1854e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb5f7fe640 1 -- 172.21.15.37:0/3224798867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d174d1f0 con 0x5592d14764d0 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb649c4640 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d1854e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:59.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d184dee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdb5002a910 tx=0x7fdb50031a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02beb8f263faa5b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3224798867 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50040030 con 0x5592d14764d0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3224798867 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdb500314a0 con 0x5592d14764d0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.154+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb500316a0 con 0x5592d14764d0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.155+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3224798867 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fdb50004260 con 0x5592d14764d0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.155+0000 7fdb6d3b8740 10 client.27629 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.155+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5592d1502790 con 0x5592d14764d0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.155+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3224798867 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb500316a0 con 0x5592d14764d0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3224798867 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7fdb500048f0 con 0x5592d14764d0 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb6d3b8740 10 client.27629 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb6d3b8740 10 client.27629 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb6d3b8740 20 client.27629 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d1455d80 0x5592d185af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb6d3b8740 4 client.27629 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:15:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592d17ad3d0 con 0x5592d1455d80 2024-05-09T01:15:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.156+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d1455d80 0x5592d185af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.157+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d1455d80 0x5592d185af00 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78df11bb168f9548 server_cookie=cadc3795d41cf249 in_seq=0 out_seq=0 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.157+0000 7fdb3f7fe640 10 client.27629 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3224798867 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5592d17ad3d0 con 0x5592d1455d80 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb3f7fe640 10 client.27629 handle_command_reply: tid=0 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 client.27629 shutdown 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 msgr2=0x5592d184dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d184dee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdb5002a910 tx=0x7fdb50031a80 comp rx=0 tx=0).stop 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 shutdown_connections 2024-05-09T01:15:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d1455d80 0x5592d185af00 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb3f7fe640 0 client.27629 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14971b0 0x5592d1854e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d184dee0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3224798867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d184d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 >> 172.21.15.37:0/3224798867 conn(0x5592d148b300 msgr2=0x5592d1837d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 shutdown_connections 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3224798867 wait complete. 2024-05-09T01:15:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.158+0000 7fdb6d3b8740 20 client.27629 trim_cache size 0 max 16384 2024-05-09T01:15:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 Processor -- start 2024-05-09T01:15:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 -- start start 2024-05-09T01:15:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d1455d80 0x5592d183a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d1860620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601a8dc0 con 0x5592d1455d80 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601aa930 con 0x5592d14764d0 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601a9490 con 0x5592d146e2f0 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d1455d80 0x5592d183a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb649c4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d1860620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d1455d80 0x5592d183a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37872/0 (socket says 172.21.15.37:37872) 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1179900346 learned_addr learned my addr 172.21.15.37:0/1179900346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.177+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:53530/0 (socket says 172.21.15.37:53530) 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1179900346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 msgr2=0x5592d183a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1179900346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 msgr2=0x5592d1860620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d1860620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb5ffff640 1 -- 172.21.15.37:0/1179900346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d15795f0 con 0x5592d1455d80 2024-05-09T01:15:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb649c4640 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d1860620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d1455d80 0x5592d183a3a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdb54000c00 tx=0x7fdb540e48f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62497ff805bc92c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb45ffb640 1 -- 172.21.15.37:0/1179900346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540b2270 con 0x5592d1455d80 2024-05-09T01:15:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb45ffb640 1 -- 172.21.15.37:0/1179900346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb540a95d0 con 0x5592d1455d80 2024-05-09T01:15:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.178+0000 7fdb45ffb640 1 -- 172.21.15.37:0/1179900346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb540037a0 con 0x5592d1455d80 2024-05-09T01:15:59.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/1179900346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d1455d80 msgr2=0x5592d183a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d1455d80 0x5592d183a3a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdb54000c00 tx=0x7fdb540e48f0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/1179900346 shutdown_connections 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d14764d0 0x5592d1860620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d183a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/1179900346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d1455d80 0x5592d183a3a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/1179900346 >> 172.21.15.37:0/1179900346 conn(0x5592d148b300 msgr2=0x5592d1839c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/1179900346 shutdown_connections 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/1179900346 wait complete. 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.179+0000 7fdb6d3b8740 1 -- start start 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 1 Processor -- start 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d1455d80 0x5592d1852750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d1852c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14764d0 0x5592d18c11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601aa260 con 0x5592d14764d0 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601a9b90 con 0x5592d1455d80 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601a6e10 con 0x5592d146e2f0 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb6d3b8740 10 client.0 _ll_register_callbacks cb 0x7fdb58009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb649c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14764d0 0x5592d18c11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d1852c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb649c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14764d0 0x5592d18c11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37880/0 (socket says 172.21.15.37:37880) 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb649c4640 1 -- 172.21.15.37:0/3309933648 learned_addr learned my addr 172.21.15.37:0/3309933648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.180+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d1455d80 0x5592d1852750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb649c4640 1 -- 172.21.15.37:0/3309933648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 msgr2=0x5592d1852c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb649c4640 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d1852c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb649c4640 1 -- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d1455d80 msgr2=0x5592d1852750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb649c4640 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d1455d80 0x5592d1852750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb649c4640 1 -- 172.21.15.37:0/3309933648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d1763ed0 con 0x5592d14764d0 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb5f7fe640 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d1852c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:15:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb649c4640 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14764d0 0x5592d18c11c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdb580127c0 tx=0x7fdb58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e795a09c8298294 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3309933648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5802f060 con 0x5592d14764d0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3309933648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fdb5801f420 con 0x5592d14764d0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.181+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb540a95d0 con 0x5592d14764d0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3309933648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fdb58011e30 con 0x5592d14764d0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 10 client.17700 fetch_fsmap learned FSMap version 50 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5592d18c2800 con 0x5592d14764d0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3309933648 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb540a95d0 con 0x5592d14764d0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3309933648 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8358+0+0 (secure 0 0 0) 0x7fdb58034070 con 0x5592d14764d0 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 10 client.17700 fetch_fsmap finished waiting for FSMap version 50 2024-05-09T01:15:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 10 client.17700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:15:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 20 client.17700 populate_metadata read hostname 'smithi037' 2024-05-09T01:15:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d14971b0 0x5592d18c5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:15:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 4 client.17700 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:15:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592d17a7240 con 0x5592d14971b0 2024-05-09T01:15:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.182+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d14971b0 0x5592d18c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:15:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.183+0000 7fdb5ffff640 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d14971b0 0x5592d18c5200 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a89f731c5601543f server_cookie=b2c0b26d470460b3 in_seq=0 out_seq=0 2024-05-09T01:15:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.184+0000 7fdb3f7fe640 10 client.17700 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:59.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.192+0000 7fdb3f7fe640 1 -- 172.21.15.37:0/3309933648 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5592d17a7240 con 0x5592d14971b0 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.192+0000 7fdb3f7fe640 10 client.17700 handle_command_reply: tid=0 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.192+0000 7fdb6d3b8740 1 client.17700 shutdown 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14764d0 msgr2=0x5592d18c11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14764d0 0x5592d18c11c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdb580127c0 tx=0x7fdb58004a40 comp rx=0 tx=0).stop 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 shutdown_connections 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5592d14971b0 0x5592d18c5200 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592d14764d0 0x5592d18c11c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592d146e2f0 0x5592d1852c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb3f7fe640 0 client.17700 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 --2- 172.21.15.37:0/3309933648 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5592d1455d80 0x5592d1852750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 >> 172.21.15.37:0/3309933648 conn(0x5592d148b300 msgr2=0x5592d183a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 shutdown_connections 2024-05-09T01:15:59.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 1 -- 172.21.15.37:0/3309933648 wait complete. 2024-05-09T01:15:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.193+0000 7fdb6d3b8740 20 client.17700 trim_cache size 0 max 16384 2024-05-09T01:15:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:15:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:15:59.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdb480b27e0 msgr2=0x7fdb480b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdb480b27e0 0x7fdb480b4cf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x5592d183c650 tx=0x7fdb58009500 comp rx=0 tx=0).stop 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 msgr2=0x7fdb6019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 0x7fdb6019a170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400e9f0 tx=0x7fdb5400eeb0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 shutdown_connections 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb60108a90 0x7fdb601a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fdb480b27e0 0x7fdb480b4cf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdb60103d90 0x7fdb6019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 --2- 172.21.15.37:0/1077255581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb60102b50 0x7fdb6019a170 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:15:59.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 >> 172.21.15.37:0/1077255581 conn(0x7fdb600fdd40 msgr2=0x7fdb600ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:15:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 shutdown_connections 2024-05-09T01:15:59.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:15:59.194+0000 7fdb66427640 1 -- 172.21.15.37:0/1077255581 wait complete. 2024-05-09T01:16:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 820.0 s, 1179.0 tps, lat 84.215 ms stddev 100.626 2024-05-09T01:16:00.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:00 smithi136 ceph-mon[34110]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 658 op/s 2024-05-09T01:16:00.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:00 smithi037 ceph-mon[30122]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 658 op/s 2024-05-09T01:16:00.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:00 smithi151 ceph-mon[34780]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 658 op/s 2024-05-09T01:16:02.776 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:02 smithi151 ceph-mon[34780]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 733 op/s 2024-05-09T01:16:02.776 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:02 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:16:02.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:02 smithi136 ceph-mon[34110]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 733 op/s 2024-05-09T01:16:02.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:02 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:16:02.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:02 smithi037 ceph-mon[30122]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 733 op/s 2024-05-09T01:16:02.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:02 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:16:03.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:16:03.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:16:03.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:16:03.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:16:03.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:16:03.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:16:03.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:16:03.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:16:03.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:16:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:04 smithi136 ceph-mon[34110]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 661 op/s 2024-05-09T01:16:04.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:04 smithi037 ceph-mon[30122]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 661 op/s 2024-05-09T01:16:04.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:04 smithi151 ceph-mon[34780]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 661 op/s 2024-05-09T01:16:05.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 825.0 s, 1507.6 tps, lat 67.018 ms stddev 71.946 2024-05-09T01:16:06.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:06 smithi136 ceph-mon[34110]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 628 op/s 2024-05-09T01:16:06.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:06 smithi037 ceph-mon[30122]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 628 op/s 2024-05-09T01:16:06.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:06 smithi151 ceph-mon[34780]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 628 op/s 2024-05-09T01:16:08.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:08 smithi136 ceph-mon[34110]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 745 op/s 2024-05-09T01:16:08.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:08 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:16:08.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:08 smithi037 ceph-mon[30122]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 745 op/s 2024-05-09T01:16:08.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:08 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:16:08.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:08 smithi151 ceph-mon[34780]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 745 op/s 2024-05-09T01:16:08.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:08 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:16:10.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 830.0 s, 1079.1 tps, lat 78.379 ms stddev 86.273 2024-05-09T01:16:10.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:10 smithi136 ceph-mon[34110]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 MiB/s wr, 605 op/s 2024-05-09T01:16:10.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:10 smithi037 ceph-mon[30122]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 MiB/s wr, 605 op/s 2024-05-09T01:16:10.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:10 smithi151 ceph-mon[34780]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 13 MiB/s wr, 605 op/s 2024-05-09T01:16:11.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:16:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.375+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2540706681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc102970 msgr2=0x7fd6cc103670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.375+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2540706681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc102970 0x7fd6cc103670 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009860 tx=0x7fd6c802a340 comp rx=0 tx=0).stop 2024-05-09T01:16:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.375+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2540706681 shutdown_connections 2024-05-09T01:16:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.375+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2540706681 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 0x7fd6cc10acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.375+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2540706681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc103bb0 0x7fd6cc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.375+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2540706681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc102970 0x7fd6cc103670 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.375+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2540706681 >> 172.21.15.37:0/2540706681 conn(0x7fd6cc0fdb60 msgr2=0x7fd6cc100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:12.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.376+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2540706681 shutdown_connections 2024-05-09T01:16:12.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.376+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2540706681 wait complete. 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 Processor -- start 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 -- start start 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc102970 0x7fd6cc1a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc103bb0 0x7fd6cc1a11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 0x7fd6cc1a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc10d380 con 0x7fd6cc102970 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc10d200 con 0x7fd6cc1088b0 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.377+0000 7fd6d27ce640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc10d500 con 0x7fd6cc103bb0 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 0x7fd6cc1a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d17cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc102970 0x7fd6cc1a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 0x7fd6cc1a7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46204/0 (socket says 172.21.15.37:46204) 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 -- 172.21.15.37:0/2218914416 learned_addr learned my addr 172.21.15.37:0/2218914416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc103bb0 0x7fd6cc1a11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 -- 172.21.15.37:0/2218914416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc103bb0 msgr2=0x7fd6cc1a11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc103bb0 0x7fd6cc1a11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 -- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc102970 msgr2=0x7fd6cc1a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc102970 0x7fd6cc1a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.378+0000 7fd6d1fcd640 1 -- 172.21.15.37:0/2218914416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc1a82c0 con 0x7fd6cc1088b0 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.379+0000 7fd6d1fcd640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 0x7fd6cc1a7c50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400efd0 tx=0x7fd6c400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.379+0000 7fd6c27fc640 1 -- 172.21.15.37:0/2218914416 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4003b70 con 0x7fd6cc1088b0 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.379+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc1a85b0 con 0x7fd6cc1088b0 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.379+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc1a8ad0 con 0x7fd6cc1088b0 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.379+0000 7fd6c27fc640 1 -- 172.21.15.37:0/2218914416 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6c4003d10 con 0x7fd6cc1088b0 2024-05-09T01:16:12.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.379+0000 7fd6c27fc640 1 -- 172.21.15.37:0/2218914416 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c40108a0 con 0x7fd6cc1088b0 2024-05-09T01:16:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.382+0000 7fd6da9bd740 1 Processor -- start 2024-05-09T01:16:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6c27fc640 1 -- 172.21.15.37:0/2218914416 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd6c4010b40 con 0x7fd6cc1088b0 2024-05-09T01:16:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6da9bd740 1 -- start start 2024-05-09T01:16:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebdc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebdcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f2eb407c0 con 0x564f2e8174d0 2024-05-09T01:16:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564f2eadc0e0 con 0x564f2e80f2f0 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f2eb3c780 con 0x564f2e8381b0 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.383+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d17cc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebdcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebdc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebdc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47428/0 (socket says 172.21.15.37:47428) 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d17cc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebdcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46214/0 (socket says 172.21.15.37:46214) 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2179819072 learned_addr learned my addr 172.21.15.37:0/2179819072 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2179819072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 msgr2=0x564f2ebdcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/2179819072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebdcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2179819072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 msgr2=0x564f2ebe3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/2179819072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.384+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2179819072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2eb057c0 con 0x564f2e8381b0 2024-05-09T01:16:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.385+0000 7fd6c27fc640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6b80b2890 0x7fd6b80b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.385+0000 7fd6d17cc640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6b80b2890 0x7fd6b80b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.386+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/2179819072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebdc6c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0148a0 tx=0x7fd6bc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f4591e083c3644e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.386+0000 7fd6c27fc640 1 -- 172.21.15.37:0/2218914416 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd6c40e2680 con 0x7fd6cc1088b0 2024-05-09T01:16:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.386+0000 7fd6b77fe640 1 -- 172.21.15.37:0/2179819072 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0142f0 con 0x564f2e8381b0 2024-05-09T01:16:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.386+0000 7fd6b77fe640 1 -- 172.21.15.37:0/2179819072 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6bc004c50 con 0x564f2e8381b0 2024-05-09T01:16:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.386+0000 7fd6b77fe640 1 -- 172.21.15.37:0/2179819072 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc011e40 con 0x564f2e8381b0 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.387+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2179819072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 msgr2=0x564f2ebdc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.387+0000 7fd6d17cc640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6b80b2890 0x7fd6b80b4da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8035040 tx=0x7fd6c802c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.387+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2179819072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebdc6c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0148a0 tx=0x7fd6bc009f90 comp rx=0 tx=0).stop 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.387+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2179819072 shutdown_connections 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.387+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2179819072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.387+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2179819072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebdcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.387+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2179819072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebdc6c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.388+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2179819072 >> 172.21.15.37:0/2179819072 conn(0x564f2e82c300 msgr2=0x564f2ebd8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.388+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2179819072 shutdown_connections 2024-05-09T01:16:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.388+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2179819072 wait complete. 2024-05-09T01:16:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.388+0000 7fd6da9bd740 1 -- start start 2024-05-09T01:16:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.388+0000 7fd6da9bd740 1 Processor -- start 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.388+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e80f2f0 0x564f2ebe6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e8174d0 0x564f2ebe6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f2ebe4590 con 0x564f2e80f2f0 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564f2eac79c0 con 0x564f2e8174d0 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f2ebe4710 con 0x564f2e8381b0 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6da9bd740 10 client.0 _ll_register_callbacks cb 0x564f2eaf4020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e8174d0 0x564f2ebe6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d17cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e80f2f0 0x564f2ebe6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e8174d0 0x564f2ebe6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46218/0 (socket says 172.21.15.37:46218) 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/4206109516 learned_addr learned my addr 172.21.15.37:0/4206109516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d1fcd640 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/4206109516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 msgr2=0x564f2ebed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/4206109516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e80f2f0 msgr2=0x564f2ebe6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e80f2f0 0x564f2ebe6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/4206109516 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f2eaee1f0 con 0x564f2e8174d0 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e8174d0 0x564f2ebe6a50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc011df0 tx=0x7fd6bc011e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a594cbe1815a0ab8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.389+0000 7fd6b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/4206109516 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc014530 con 0x564f2e8174d0 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/4206109516 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd6bc004e00 con 0x564f2e8174d0 2024-05-09T01:16:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6bc004c50 con 0x564f2e8174d0 2024-05-09T01:16:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/4206109516 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd6bc004870 con 0x564f2e8174d0 2024-05-09T01:16:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6da9bd740 10 client.27647 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564f2e8a3790 con 0x564f2e8174d0 2024-05-09T01:16:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/4206109516 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6bc004c50 con 0x564f2e8174d0 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.390+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/4206109516 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fd6bc012450 con 0x564f2e8174d0 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.391+0000 7fd6da9bd740 10 client.27647 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.391+0000 7fd6da9bd740 10 client.27647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.391+0000 7fd6da9bd740 20 client.27647 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.391+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e7f6d80 0x564f2ebf3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.391+0000 7fd6da9bd740 4 client.27647 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.391+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f2eb4e3d0 con 0x564f2e7f6d80 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.392+0000 7fd6d17cc640 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e7f6d80 0x564f2ebf3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.392+0000 7fd6b4ff9640 10 client.27647 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.392+0000 7fd6d17cc640 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e7f6d80 0x564f2ebf3be0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6d302e1537b0268 server_cookie=236f0aeb90b05238 in_seq=0 out_seq=0 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.393+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/4206109516 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f2eb4e3d0 con 0x564f2e7f6d80 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.393+0000 7fd6b4ff9640 10 client.27647 handle_command_reply: tid=0 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.393+0000 7fd6da9bd740 1 client.27647 shutdown 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.393+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e8174d0 msgr2=0x564f2ebe6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.393+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e8174d0 0x564f2ebe6a50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc011df0 tx=0x7fd6bc011e20 comp rx=0 tx=0).stop 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.393+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 shutdown_connections 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.393+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e7f6d80 0x564f2ebf3be0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e8381b0 0x564f2ebed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6b4ff9640 0 client.27647 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e8174d0 0x564f2ebe6a50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/4206109516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e80f2f0 0x564f2ebe6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 >> 172.21.15.37:0/4206109516 conn(0x564f2e82c300 msgr2=0x564f2ebd6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 shutdown_connections 2024-05-09T01:16:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6da9bd740 1 -- 172.21.15.37:0/4206109516 wait complete. 2024-05-09T01:16:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.394+0000 7fd6da9bd740 20 client.27647 trim_cache size 0 max 16384 2024-05-09T01:16:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 Processor -- start 2024-05-09T01:16:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 -- start start 2024-05-09T01:16:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e7f6d80 0x564f2ebe09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebe0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc1b1610 con 0x564f2e8174d0 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc1b3150 con 0x564f2e80f2f0 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc1b1ce0 con 0x564f2e7f6d80 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6d17cc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e7f6d80 0x564f2ebe09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6d1fcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebe0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebe0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46234/0 (socket says 172.21.15.37:46234) 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6d17cc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e7f6d80 0x564f2ebe09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47432/0 (socket says 172.21.15.37:47432) 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.413+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2364052250 learned_addr learned my addr 172.21.15.37:0/2364052250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2364052250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e7f6d80 msgr2=0x564f2ebe09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/2364052250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e7f6d80 0x564f2ebe09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2364052250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 msgr2=0x564f2ebe4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/2364052250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/2364052250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2e91a5f0 con 0x564f2e80f2f0 2024-05-09T01:16:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/2364052250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebe0ee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc006010 tx=0x7fd6bc0093f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2812150ad62970f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6b6ffd640 1 -- 172.21.15.37:0/2364052250 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc012e60 con 0x564f2e80f2f0 2024-05-09T01:16:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6b6ffd640 1 -- 172.21.15.37:0/2364052250 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6bc009960 con 0x564f2e80f2f0 2024-05-09T01:16:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.414+0000 7fd6b6ffd640 1 -- 172.21.15.37:0/2364052250 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc011a10 con 0x564f2e80f2f0 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2364052250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 msgr2=0x564f2ebe0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2364052250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebe0ee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc006010 tx=0x7fd6bc0093f0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2364052250 shutdown_connections 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2364052250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ebe4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2364052250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e80f2f0 0x564f2ebe0ee0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/2364052250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e7f6d80 0x564f2ebe09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2364052250 >> 172.21.15.37:0/2364052250 conn(0x564f2e82c300 msgr2=0x564f2ebdc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2364052250 shutdown_connections 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.415+0000 7fd6da9bd740 1 -- 172.21.15.37:0/2364052250 wait complete. 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.416+0000 7fd6da9bd740 1 -- start start 2024-05-09T01:16:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.416+0000 7fd6da9bd740 1 Processor -- start 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e7f6d80 0x564f2ebe9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e80f2f0 0x564f2ebea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6da9bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ec59ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc1b2a80 con 0x564f2e8174d0 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc1b23b0 con 0x564f2e7f6d80 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6da9bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc1af5f0 con 0x564f2e80f2f0 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6da9bd740 10 client.0 _ll_register_callbacks cb 0x7fd6bc009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e80f2f0 0x564f2ebea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6d17cc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e7f6d80 0x564f2ebe9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6d1fcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ec59ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6d0fcb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e80f2f0 0x564f2ebea1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47448/0 (socket says 172.21.15.37:47448) 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.417+0000 7fd6d0fcb640 1 -- 172.21.15.37:0/287589733 learned_addr learned my addr 172.21.15.37:0/287589733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d17cc640 1 -- 172.21.15.37:0/287589733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e80f2f0 msgr2=0x564f2ebea1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d17cc640 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e80f2f0 0x564f2ebea1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d17cc640 1 -- 172.21.15.37:0/287589733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 msgr2=0x564f2ec59ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d17cc640 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ec59ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d17cc640 1 -- 172.21.15.37:0/287589733 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f2eb04ed0 con 0x564f2e7f6d80 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d1fcd640 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ec59ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e80f2f0 0x564f2ebea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6d17cc640 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e7f6d80 0x564f2ebe9c60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009780 tx=0x7fd6c80303b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bde4e6b1863a53c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/287589733 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8037040 con 0x564f2e7f6d80 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/287589733 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd6c80035f0 con 0x564f2e7f6d80 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6bc009960 con 0x564f2e7f6d80 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/287589733 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd6c80308f0 con 0x564f2e7f6d80 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6da9bd740 10 client.27653 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.418+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564f2ec5b130 con 0x564f2e7f6d80 2024-05-09T01:16:12.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/287589733 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6bc009960 con 0x564f2e7f6d80 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/287589733 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fd6c804e4d0 con 0x564f2e7f6d80 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6da9bd740 10 client.27653 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6da9bd740 10 client.27653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6da9bd740 20 client.27653 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e8381b0 0x564f2ec5db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6da9bd740 4 client.27653 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f2eb48240 con 0x564f2e8381b0 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.419+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e8381b0 0x564f2ec5db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.420+0000 7fd6b4ff9640 10 client.27653 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:12.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.420+0000 7fd6d0fcb640 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e8381b0 0x564f2ec5db50 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d854cd706da76269 server_cookie=fe4cc93d4d307b43 in_seq=0 out_seq=0 2024-05-09T01:16:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6b4ff9640 1 -- 172.21.15.37:0/287589733 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x564f2eb48240 con 0x564f2e8381b0 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6b4ff9640 10 client.27653 handle_command_reply: tid=0 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 client.27653 shutdown 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e7f6d80 msgr2=0x564f2ebe9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e7f6d80 0x564f2ebe9c60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009780 tx=0x7fd6c80303b0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 shutdown_connections 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564f2e8381b0 0x564f2ec5db50 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2e8174d0 0x564f2ec59ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2e80f2f0 0x564f2ebea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 --2- 172.21.15.37:0/287589733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2e7f6d80 0x564f2ebe9c60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 >> 172.21.15.37:0/287589733 conn(0x564f2e82c300 msgr2=0x564f2ebdc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6b4ff9640 0 client.27653 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.428+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 shutdown_connections 2024-05-09T01:16:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.429+0000 7fd6da9bd740 1 -- 172.21.15.37:0/287589733 wait complete. 2024-05-09T01:16:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.429+0000 7fd6da9bd740 20 client.27653 trim_cache size 0 max 16384 2024-05-09T01:16:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:16:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:16:12.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:16:12.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6b80b2890 msgr2=0x7fd6b80b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6b80b2890 0x7fd6b80b4da0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8035040 tx=0x7fd6c802c040 comp rx=0 tx=0).stop 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 msgr2=0x7fd6cc1a7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 0x7fd6cc1a7c50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400efd0 tx=0x7fd6c400c6a0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 shutdown_connections 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd6b80b2890 0x7fd6b80b4da0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6cc1088b0 0x7fd6cc1a7c50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6cc103bb0 0x7fd6cc1a11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 --2- 172.21.15.37:0/2218914416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc102970 0x7fd6cc1a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.430+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 >> 172.21.15.37:0/2218914416 conn(0x7fd6cc0fdb60 msgr2=0x7fd6cc104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.431+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 shutdown_connections 2024-05-09T01:16:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:12.431+0000 7fd6d27ce640 1 -- 172.21.15.37:0/2218914416 wait complete. 2024-05-09T01:16:12.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:12 smithi037 ceph-mon[30122]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 660 op/s 2024-05-09T01:16:12.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:12 smithi136 ceph-mon[34110]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 660 op/s 2024-05-09T01:16:12.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:12 smithi151 ceph-mon[34780]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 660 op/s 2024-05-09T01:16:14.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 -- 172.21.15.37:0/4086786144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc108740 msgr2=0x7fc3fc1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 --2- 172.21.15.37:0/4086786144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc108740 0x7fc3fc1100a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400b0d0 tx=0x7fc3f400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 -- 172.21.15.37:0/4086786144 shutdown_connections 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 --2- 172.21.15.37:0/4086786144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc108740 0x7fc3fc1100a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 --2- 172.21.15.37:0/4086786144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3fc1034c0 0x7fc3fc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 --2- 172.21.15.37:0/4086786144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3fc107df0 0x7fc3fc108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 -- 172.21.15.37:0/4086786144 >> 172.21.15.37:0/4086786144 conn(0x7fc3fc0fedc0 msgr2=0x7fc3fc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 -- 172.21.15.37:0/4086786144 shutdown_connections 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.437+0000 7fc401ec0700 1 -- 172.21.15.37:0/4086786144 wait complete. 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.438+0000 7fc401ec0700 1 Processor -- start 2024-05-09T01:16:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.438+0000 7fc401ec0700 1 -- start start 2024-05-09T01:16:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc401ec0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3fc1034c0 0x7fc3fc19bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc401ec0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc107df0 0x7fc3fc19c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc107df0 0x7fc3fc19c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc107df0 0x7fc3fc19c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44586/0 (socket says 172.21.15.37:44586) 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc401ec0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3fc108740 0x7fc3fc19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc3faffd700 1 -- 172.21.15.37:0/1648534971 learned_addr learned my addr 172.21.15.37:0/1648534971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1133c0 con 0x7fc3fc107df0 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc113240 con 0x7fc3fc1034c0 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc113540 con 0x7fc3fc108740 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3fc1034c0 0x7fc3fc19bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.439+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3fc108740 0x7fc3fc19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/1648534971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3fc108740 msgr2=0x7fc3fc19c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3fc108740 0x7fc3fc19c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc107df0 msgr2=0x7fc3fc19c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc107df0 0x7fc3fc19c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/1648534971 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc1a6fd0 con 0x7fc3fc1034c0 2024-05-09T01:16:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3fc1034c0 0x7fc3fc19bc60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00d750 tx=0x7fc3ec00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3f8ff9700 1 -- 172.21.15.37:0/1648534971 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec014030 con 0x7fc3fc1034c0 2024-05-09T01:16:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc1a72c0 con 0x7fc3fc1034c0 2024-05-09T01:16:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.440+0000 7fc3f8ff9700 1 -- 172.21.15.37:0/1648534971 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3ec004ce0 con 0x7fc3fc1034c0 2024-05-09T01:16:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.441+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1a7850 con 0x7fc3fc1034c0 2024-05-09T01:16:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.441+0000 7fc3f8ff9700 1 -- 172.21.15.37:0/1648534971 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00f8f0 con 0x7fc3fc1034c0 2024-05-09T01:16:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.444+0000 7fc3f8ff9700 1 -- 172.21.15.37:0/1648534971 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc3ec005140 con 0x7fc3fc1034c0 2024-05-09T01:16:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.445+0000 7fc3f8ff9700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc3e40b2900 0x7fc3e40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.445+0000 7fc3faffd700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc3e40b2900 0x7fc3e40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc3faffd700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc3e40b2900 0x7fc3e40b4e10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc106750 tx=0x7fc3f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc3f8ff9700 1 -- 172.21.15.37:0/1648534971 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc3ec0e1950 con 0x7fc3fc1034c0 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc4108d6b80 1 Processor -- start 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc4108d6b80 1 -- start start 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4ec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d4eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c19d408ff0 con 0x55c19d4e66a0 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.446+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c19d3a77f0 con 0x55c19d453160 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c19d404fb0 con 0x55c19d3694a0 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d4eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d4eca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47458/0 (socket says 172.21.15.37:47458) 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 -- 172.21.15.37:0/3955464487 learned_addr learned my addr 172.21.15.37:0/3955464487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4ec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 -- 172.21.15.37:0/3955464487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 msgr2=0x55c19d4ec4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4ec4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 -- 172.21.15.37:0/3955464487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 msgr2=0x55c19d4e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 -- 172.21.15.37:0/3955464487 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c19d39f370 con 0x55c19d3694a0 2024-05-09T01:16:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4ec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:16:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3faffd700 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d4eca30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00041f0 tx=0x7fc3f0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fe76d55c5d9514c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.447+0000 7fc3e1ffb700 1 -- 172.21.15.37:0/3955464487 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0009e60 con 0x55c19d3694a0 2024-05-09T01:16:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.448+0000 7fc3e1ffb700 1 -- 172.21.15.37:0/3955464487 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f001e3f0 con 0x55c19d3694a0 2024-05-09T01:16:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.448+0000 7fc3e1ffb700 1 -- 172.21.15.37:0/3955464487 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000e5b0 con 0x55c19d3694a0 2024-05-09T01:16:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.449+0000 7fc4108d6b80 1 -- 172.21.15.37:0/3955464487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 msgr2=0x55c19d4eca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.449+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d4eca30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00041f0 tx=0x7fc3f0014000 comp rx=0 tx=0).stop 2024-05-09T01:16:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.450+0000 7fc4108d6b80 1 -- 172.21.15.37:0/3955464487 shutdown_connections 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.450+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.450+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4ec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.450+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/3955464487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d4eca30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.450+0000 7fc4108d6b80 1 -- 172.21.15.37:0/3955464487 >> 172.21.15.37:0/3955464487 conn(0x55c19d3c96a0 msgr2=0x55c19d4e1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.450+0000 7fc4108d6b80 1 -- 172.21.15.37:0/3955464487 shutdown_connections 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.450+0000 7fc4108d6b80 1 -- 172.21.15.37:0/3955464487 wait complete. 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.451+0000 7fc4108d6b80 1 -- start start 2024-05-09T01:16:14.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.451+0000 7fc4108d6b80 1 Processor -- start 2024-05-09T01:16:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.452+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.452+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d453160 0x55c19d4f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.452+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.452+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4f01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44604/0 (socket says 172.21.15.37:44604) 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/1710614577 learned_addr learned my addr 172.21.15.37:0/1710614577 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d4e66a0 0x55c19d4f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c19d284ba0 con 0x55c19d3694a0 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c19d3c3150 con 0x55c19d4e66a0 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c19d4f31d0 con 0x55c19d453160 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc4108d6b80 10 client.0 _ll_register_callbacks cb 0x55c19d27a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3faffd700 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d453160 0x55c19d4f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d4e66a0 0x55c19d4f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/1710614577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d453160 msgr2=0x55c19d4f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d453160 0x55c19d4f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d4e66a0 msgr2=0x55c19d4f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d4e66a0 0x55c19d4f0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.453+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/1710614577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c19d284490 con 0x55c19d3694a0 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4f01a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0050f0 tx=0x7fc3ec0a5520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed418f47215bc0b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc3daffd700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc3daffd700 1 -- 172.21.15.37:0/1710614577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0c2070 con 0x55c19d3694a0 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc3daffd700 1 -- 172.21.15.37:0/1710614577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc3ec0b1bf0 con 0x55c19d3694a0 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3f001e3f0 con 0x55c19d3694a0 2024-05-09T01:16:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc3daffd700 1 -- 172.21.15.37:0/1710614577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc3ec0a9010 con 0x55c19d3694a0 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc4108d6b80 10 client.17730 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.454+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55c19d5064b0 con 0x55c19d3694a0 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc3daffd700 1 -- 172.21.15.37:0/1710614577 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f001e3f0 con 0x55c19d3694a0 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc3daffd700 1 -- 172.21.15.37:0/1710614577 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fc3ec0a4980 con 0x55c19d3694a0 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc4108d6b80 10 client.17730 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc4108d6b80 10 client.17730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc4108d6b80 20 client.17730 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d50af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc4108d6b80 4 client.17730 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.455+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c19d4169d0 con 0x55c19d508af0 2024-05-09T01:16:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.456+0000 7fc3faffd700 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d50af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.456+0000 7fc3faffd700 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d50af10 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e70b29877fa17a5 server_cookie=a55b1de76ca6d239 in_seq=0 out_seq=0 2024-05-09T01:16:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.456+0000 7fc3daffd700 10 client.17730 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc3daffd700 1 -- 172.21.15.37:0/1710614577 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c19d4169d0 con 0x55c19d508af0 2024-05-09T01:16:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc3daffd700 10 client.17730 handle_command_reply: tid=0 2024-05-09T01:16:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 client.17730 shutdown 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 msgr2=0x55c19d4f01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4f01a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0050f0 tx=0x7fc3ec0a5520 comp rx=0 tx=0).stop 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 shutdown_connections 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d50af10 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d4e66a0 0x55c19d4f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc3daffd700 0 client.17730 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4f01a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/1710614577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d453160 0x55c19d4f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 >> 172.21.15.37:0/1710614577 conn(0x55c19d3c96a0 msgr2=0x55c19d4e11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 shutdown_connections 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.457+0000 7fc4108d6b80 1 -- 172.21.15.37:0/1710614577 wait complete. 2024-05-09T01:16:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.458+0000 7fc4108d6b80 20 client.17730 trim_cache size 0 max 16384 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.484+0000 7fc4108d6b80 1 Processor -- start 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.484+0000 7fc4108d6b80 1 -- start start 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d4e66a0 0x55c19d504930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1aca10 con 0x55c19d3694a0 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1ae550 con 0x55c19d453160 2024-05-09T01:16:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1ad0e0 con 0x55c19d4e66a0 2024-05-09T01:16:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4e60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44606/0 (socket says 172.21.15.37:44606) 2024-05-09T01:16:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/2415353628 learned_addr learned my addr 172.21.15.37:0/2415353628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d4e66a0 0x55c19d504930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.485+0000 7fc3faffd700 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3fbfff700 1 -- 172.21.15.37:0/2415353628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 msgr2=0x55c19d4f0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4f0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3fbfff700 1 -- 172.21.15.37:0/2415353628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 msgr2=0x55c19d4e60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4e60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3fbfff700 1 -- 172.21.15.37:0/2415353628 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c19d4e6fd0 con 0x55c19d4e66a0 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4e60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3fbfff700 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d4e66a0 0x55c19d504930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc06c6f0 tx=0x7fc3f400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b102314349da8ac5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3e17fa700 1 -- 172.21.15.37:0/2415353628 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400baa0 con 0x55c19d4e66a0 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3e17fa700 1 -- 172.21.15.37:0/2415353628 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f400bc40 con 0x55c19d4e66a0 2024-05-09T01:16:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.486+0000 7fc3e17fa700 1 -- 172.21.15.37:0/2415353628 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4007cf0 con 0x55c19d4e66a0 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.487+0000 7fc4108d6b80 1 -- 172.21.15.37:0/2415353628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d4e66a0 msgr2=0x55c19d504930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.487+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d4e66a0 0x55c19d504930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc06c6f0 tx=0x7fc3f400b040 comp rx=0 tx=0).stop 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 -- 172.21.15.37:0/2415353628 shutdown_connections 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d4e66a0 0x55c19d504930 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d3694a0 0x55c19d4e60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/2415353628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4f0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 -- 172.21.15.37:0/2415353628 >> 172.21.15.37:0/2415353628 conn(0x55c19d3c96a0 msgr2=0x55c19d4ef100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 -- 172.21.15.37:0/2415353628 shutdown_connections 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 -- 172.21.15.37:0/2415353628 wait complete. 2024-05-09T01:16:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.488+0000 7fc4108d6b80 1 -- start start 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.489+0000 7fc4108d6b80 1 Processor -- start 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.489+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d501030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.489+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4fc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc4108d6b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4fc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1ade80 con 0x55c19d4e66a0 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1ad7b0 con 0x55c19d453160 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc4108d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1aa9f0 con 0x55c19d3694a0 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc4108d6b80 10 client.0 _ll_register_callbacks cb 0x55c19d27a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d501030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3faffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4fc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d501030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47474/0 (socket says 172.21.15.37:47474) 2024-05-09T01:16:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4fc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/72261960 learned_addr learned my addr 172.21.15.37:0/72261960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 msgr2=0x55c19d4fc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4fc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/72261960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 msgr2=0x55c19d4fc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4fc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 -- 172.21.15.37:0/72261960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c19d4fcec0 con 0x55c19d3694a0 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3faffd700 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3fb7fe700 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d501030 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0a55b0 tx=0x7fc3ec0a9850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ce1d69bca2781b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.490+0000 7fc3daffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc3daffd700 1 -- 172.21.15.37:0/72261960 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0c2040 con 0x55c19d3694a0 2024-05-09T01:16:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc3daffd700 1 -- 172.21.15.37:0/72261960 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc3ec0a7ce0 con 0x55c19d3694a0 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3f400bc40 con 0x55c19d3694a0 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc3daffd700 1 -- 172.21.15.37:0/72261960 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc3ec0ad3c0 con 0x55c19d3694a0 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 10 client.27640 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55c19d572f80 con 0x55c19d3694a0 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc3daffd700 1 -- 172.21.15.37:0/72261960 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f400bc40 con 0x55c19d3694a0 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc3daffd700 1 -- 172.21.15.37:0/72261960 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fc3ec08a020 con 0x55c19d3694a0 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 10 client.27640 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 10 client.27640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 20 client.27640 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d575690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 4 client.27640 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:16:14.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.491+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c19d410a70 con 0x55c19d508af0 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.492+0000 7fc3faffd700 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d575690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.492+0000 7fc3faffd700 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d575690 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef21c93969c05e8c server_cookie=92a0b49c1ee26b0a in_seq=0 out_seq=0 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.492+0000 7fc3daffd700 10 client.27640 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.492+0000 7fc3daffd700 1 -- 172.21.15.37:0/72261960 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c19d410a70 con 0x55c19d508af0 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.492+0000 7fc3daffd700 10 client.27640 handle_command_reply: tid=0 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.492+0000 7fc4108d6b80 1 client.27640 shutdown 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 msgr2=0x55c19d501030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d501030 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0a55b0 tx=0x7fc3ec0a9850 comp rx=0 tx=0).stop 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 shutdown_connections 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c19d508af0 0x55c19d575690 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc3daffd700 0 client.27640 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c19d4e66a0 0x55c19d4fc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c19d3694a0 0x55c19d501030 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 --2- 172.21.15.37:0/72261960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c19d453160 0x55c19d4fc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 >> 172.21.15.37:0/72261960 conn(0x55c19d3c96a0 msgr2=0x55c19d4e5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 shutdown_connections 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 1 -- 172.21.15.37:0/72261960 wait complete. 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.493+0000 7fc4108d6b80 20 client.27640 trim_cache size 0 max 16384 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:16:14.499 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:16:14.500 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:16:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc3e40b2900 msgr2=0x7fc3e40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc3e40b2900 0x7fc3e40b4e10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc106750 tx=0x7fc3f0009260 comp rx=0 tx=0).stop 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3fc1034c0 msgr2=0x7fc3fc19bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3fc1034c0 0x7fc3fc19bc60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00d750 tx=0x7fc3ec00da60 comp rx=0 tx=0).stop 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 shutdown_connections 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc3e40b2900 0x7fc3e40b4e10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3fc108740 0x7fc3fc19c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3fc1034c0 0x7fc3fc19bc60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 --2- 172.21.15.37:0/1648534971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3fc107df0 0x7fc3fc19c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 >> 172.21.15.37:0/1648534971 conn(0x7fc3fc0fedc0 msgr2=0x7fc3fc107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 shutdown_connections 2024-05-09T01:16:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:14.494+0000 7fc401ec0700 1 -- 172.21.15.37:0/1648534971 wait complete. 2024-05-09T01:16:14.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:14 smithi136 ceph-mon[34110]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 14 MiB/s wr, 602 op/s 2024-05-09T01:16:14.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:14 smithi037 ceph-mon[30122]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 14 MiB/s wr, 602 op/s 2024-05-09T01:16:14.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:14 smithi151 ceph-mon[34780]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 14 MiB/s wr, 602 op/s 2024-05-09T01:16:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 835.0 s, 1380.2 tps, lat 82.403 ms stddev 180.022 2024-05-09T01:16:15.327 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:16:15.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:16:15.761 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:16.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:16 smithi136 ceph-mon[34110]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 568 op/s 2024-05-09T01:16:16.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:16 smithi037 ceph-mon[30122]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 568 op/s 2024-05-09T01:16:16.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:16 smithi151 ceph-mon[34780]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 13 MiB/s wr, 568 op/s 2024-05-09T01:16:17.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.813+0000 7f4ac18c5700 1 -- 172.21.15.37:0/3780897697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab409b520 msgr2=0x7f4ab409b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:17.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.813+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/3780897697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab409b520 0x7f4ab409b930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009990 tx=0x7f4aa8009ca0 comp rx=0 tx=0).stop 2024-05-09T01:16:17.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.814+0000 7f4ac18c5700 1 -- 172.21.15.37:0/3780897697 shutdown_connections 2024-05-09T01:16:17.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.814+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/3780897697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab4095e30 0x7f4ab40a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:17.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.814+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/3780897697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab409b520 0x7f4ab409b930 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.814+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/3780897697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ab40954e0 0x7f4ab40958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.814+0000 7f4ac18c5700 1 -- 172.21.15.37:0/3780897697 >> 172.21.15.37:0/3780897697 conn(0x7f4ab400b020 msgr2=0x7f4ab400b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.815+0000 7f4ac18c5700 1 -- 172.21.15.37:0/3780897697 shutdown_connections 2024-05-09T01:16:17.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.815+0000 7f4ac18c5700 1 -- 172.21.15.37:0/3780897697 wait complete. 2024-05-09T01:16:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 Processor -- start 2024-05-09T01:16:17.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 -- start start 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab40954e0 0x7f4ab412df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab4095e30 0x7f4ab412e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ab409b520 0x7f4ab4138f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab40a5630 con 0x7f4ab40954e0 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab40a54b0 con 0x7f4ab409b520 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac18c5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab40a57b0 con 0x7f4ab4095e30 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac08c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab40954e0 0x7f4ab412df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac08c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab40954e0 0x7f4ab412df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44648/0 (socket says 172.21.15.37:44648) 2024-05-09T01:16:17.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4ac08c3700 1 -- 172.21.15.37:0/1037882147 learned_addr learned my addr 172.21.15.37:0/1037882147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.816+0000 7f4abbfff700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab4095e30 0x7f4ab412e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac10c4700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ab409b520 0x7f4ab4138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac08c3700 1 -- 172.21.15.37:0/1037882147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab4095e30 msgr2=0x7f4ab412e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac08c3700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab4095e30 0x7f4ab412e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac08c3700 1 -- 172.21.15.37:0/1037882147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ab409b520 msgr2=0x7f4ab4138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac08c3700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ab409b520 0x7f4ab4138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac08c3700 1 -- 172.21.15.37:0/1037882147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab412ed00 con 0x7f4ab40954e0 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4abbfff700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab4095e30 0x7f4ab412e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac08c3700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab40954e0 0x7f4ab412df10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ab9ffb700 1 -- 172.21.15.37:0/1037882147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8027070 con 0x7f4ab40954e0 2024-05-09T01:16:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab412bd00 con 0x7f4ab40954e0 2024-05-09T01:16:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ab9ffb700 1 -- 172.21.15.37:0/1037882147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa8003f20 con 0x7f4ab40954e0 2024-05-09T01:16:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.817+0000 7f4ab9ffb700 1 -- 172.21.15.37:0/1037882147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8022c70 con 0x7f4ab40954e0 2024-05-09T01:16:17.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.818+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab412c190 con 0x7f4ab40954e0 2024-05-09T01:16:17.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.820+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab40048e0 con 0x7f4ab40954e0 2024-05-09T01:16:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.822+0000 7f4ab9ffb700 1 -- 172.21.15.37:0/1037882147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4aa802a070 con 0x7f4ab40954e0 2024-05-09T01:16:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.823+0000 7f4ab9ffb700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4aac0b2880 0x7f4aac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:17.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.823+0000 7f4ab9ffb700 1 -- 172.21.15.37:0/1037882147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f4aa80e3370 con 0x7f4ab40954e0 2024-05-09T01:16:17.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.823+0000 7f4abbfff700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4aac0b2880 0x7f4aac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:17.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.825+0000 7f4abbfff700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4aac0b2880 0x7f4aac0b4d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000ffd0 tx=0x7f4ab000f820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:17.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:17.829+0000 7f4ab9ffb700 1 -- 172.21.15.37:0/1037882147 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4aa8031080 con 0x7f4ab40954e0 2024-05-09T01:16:18.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.221+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ab412dc30 con 0x7f4ab40954e0 2024-05-09T01:16:18.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.222+0000 7f4ab9ffb700 1 -- 172.21.15.37:0/1037882147 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11936 (secure 0 0 0) 0x7f4aa8013070 con 0x7f4ab40954e0 2024-05-09T01:16:18.222 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:16:18.222 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:16:06.675640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24454,24491,24445,24446,24467]},"id":1}]} 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.225+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4aac0b2880 msgr2=0x7f4aac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.225+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4aac0b2880 0x7f4aac0b4d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000ffd0 tx=0x7f4ab000f820 comp rx=0 tx=0).stop 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.225+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab40954e0 msgr2=0x7f4ab412df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.225+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab40954e0 0x7f4ab412df10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8000c00 tx=0x7f4aa80047b0 comp rx=0 tx=0).stop 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.225+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 shutdown_connections 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.226+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f4aac0b2880 0x7f4aac0b4d90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.226+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4ab409b520 0x7f4ab4138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.226+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ab40954e0 0x7f4ab412df10 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:18.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.226+0000 7f4ac18c5700 1 --2- 172.21.15.37:0/1037882147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab4095e30 0x7f4ab412e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:18.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.226+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 >> 172.21.15.37:0/1037882147 conn(0x7f4ab400b020 msgr2=0x7f4ab4093ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:18.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.226+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 shutdown_connections 2024-05-09T01:16:18.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:18.226+0000 7f4ac18c5700 1 -- 172.21.15.37:0/1037882147 wait complete. 2024-05-09T01:16:18.227 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 51 2024-05-09T01:16:18.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:18 smithi136 ceph-mon[34110]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 687 op/s 2024-05-09T01:16:18.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:18 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1037882147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:16:18.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:18 smithi037 ceph-mon[30122]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 687 op/s 2024-05-09T01:16:18.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:18 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1037882147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:16:18.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:18 smithi151 ceph-mon[34780]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 15 MiB/s wr, 687 op/s 2024-05-09T01:16:18.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:18 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1037882147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:16:19.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:16:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 840.0 s, 1577.0 tps, lat 64.751 ms stddev 79.475 2024-05-09T01:16:20.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:20 smithi136 ceph-mon[34110]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 603 op/s 2024-05-09T01:16:20.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:20 smithi151 ceph-mon[34780]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 603 op/s 2024-05-09T01:16:20.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:20 smithi037 ceph-mon[30122]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 13 MiB/s wr, 603 op/s 2024-05-09T01:16:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.470+0000 7fd149b6b700 1 -- 172.21.15.37:0/1308306308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd14410e8f0 msgr2=0x7fd144110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.470+0000 7fd149b6b700 1 --2- 172.21.15.37:0/1308306308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd14410e8f0 0x7fd144110dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009f90 tx=0x7fd13c00b330 comp rx=0 tx=0).stop 2024-05-09T01:16:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.471+0000 7fd149b6b700 1 -- 172.21.15.37:0/1308306308 shutdown_connections 2024-05-09T01:16:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.471+0000 7fd149b6b700 1 --2- 172.21.15.37:0/1308306308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd14410e8f0 0x7fd144110dd0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.471+0000 7fd149b6b700 1 --2- 172.21.15.37:0/1308306308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd144105480 0x7fd144105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.471+0000 7fd149b6b700 1 --2- 172.21.15.37:0/1308306308 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 0x7fd14410e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.471+0000 7fd149b6b700 1 -- 172.21.15.37:0/1308306308 >> 172.21.15.37:0/1308306308 conn(0x7fd1440fef30 msgr2=0x7fd144101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.471+0000 7fd149b6b700 1 -- 172.21.15.37:0/1308306308 shutdown_connections 2024-05-09T01:16:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.471+0000 7fd149b6b700 1 -- 172.21.15.37:0/1308306308 wait complete. 2024-05-09T01:16:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.472+0000 7fd149b6b700 1 Processor -- start 2024-05-09T01:16:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.472+0000 7fd149b6b700 1 -- start start 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.472+0000 7fd149b6b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd144105480 0x7fd14419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.472+0000 7fd149b6b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 0x7fd14419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd149b6b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410e8f0 0x7fd14419f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd149b6b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441144d0 con 0x7fd14410e8f0 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd149b6b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd144114350 con 0x7fd144105dd0 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd149b6b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd144114650 con 0x7fd144105480 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 0x7fd14419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd1437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd144105480 0x7fd14419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 0x7fd14419b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46332/0 (socket says 172.21.15.37:46332) 2024-05-09T01:16:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 -- 172.21.15.37:0/2307261198 learned_addr learned my addr 172.21.15.37:0/2307261198 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 -- 172.21.15.37:0/2307261198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd144105480 msgr2=0x7fd14419ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd143fff700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410e8f0 0x7fd14419f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd144105480 0x7fd14419ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 -- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410e8f0 msgr2=0x7fd14419f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410e8f0 0x7fd14419f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd142ffd700 1 -- 172.21.15.37:0/2307261198 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14419fcf0 con 0x7fd144105dd0 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.473+0000 7fd143fff700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410e8f0 0x7fd14419f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.474+0000 7fd142ffd700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 0x7fd14419b3c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e9c0 tx=0x7fd13800ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.474+0000 7fd140ff9700 1 -- 172.21.15.37:0/2307261198 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13800cbd0 con 0x7fd144105dd0 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.474+0000 7fd140ff9700 1 -- 172.21.15.37:0/2307261198 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd13800cd70 con 0x7fd144105dd0 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.474+0000 7fd140ff9700 1 -- 172.21.15.37:0/2307261198 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138005680 con 0x7fd144105dd0 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.474+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14419ffe0 con 0x7fd144105dd0 2024-05-09T01:16:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.474+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1441a7900 con 0x7fd144105dd0 2024-05-09T01:16:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.478+0000 7fd140ff9700 1 -- 172.21.15.37:0/2307261198 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd138004750 con 0x7fd144105dd0 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.479+0000 7fd158581b80 1 Processor -- start 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.479+0000 7fd140ff9700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd12c0b2a10 0x7fd12c0b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.479+0000 7fd158581b80 1 -- start start 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.479+0000 7fd143fff700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd12c0b2a10 0x7fd12c0b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.479+0000 7fd140ff9700 1 -- 172.21.15.37:0/2307261198 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd1380e2340 con 0x7fd144105dd0 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd158581b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4f2160 0x55625d589d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd158581b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d58a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd158581b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d58e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd158581b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55625d4a7ff0 con 0x55625d58e400 2024-05-09T01:16:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd158581b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55625d4467f0 con 0x55625d4f2160 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd158581b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55625d4a3fb0 con 0x55625d4084a0 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd1437fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4f2160 0x55625d589d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d58a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d58a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47500/0 (socket says 172.21.15.37:47500) 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 -- 172.21.15.37:0/509999391 learned_addr learned my addr 172.21.15.37:0/509999391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd143fff700 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d58e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd143fff700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd12c0b2a10 0x7fd12c0b4f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009840 tx=0x7fd13c006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 -- 172.21.15.37:0/509999391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4f2160 msgr2=0x55625d589d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4f2160 0x55625d589d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 -- 172.21.15.37:0/509999391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 msgr2=0x55625d58e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d58e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 -- 172.21.15.37:0/509999391 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625d43e370 con 0x55625d4084a0 2024-05-09T01:16:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd143fff700 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d58e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.480+0000 7fd142ffd700 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d58a2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd1380a9660 tx=0x7fd1380a9850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67d0951fbed1434 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.481+0000 7fd129ffb700 1 -- 172.21.15.37:0/509999391 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380a50f0 con 0x55625d4084a0 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.481+0000 7fd129ffb700 1 -- 172.21.15.37:0/509999391 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1380b2110 con 0x55625d4084a0 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.481+0000 7fd129ffb700 1 -- 172.21.15.37:0/509999391 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380cc0e0 con 0x55625d4084a0 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 -- 172.21.15.37:0/509999391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 msgr2=0x55625d58a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d58a2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd1380a9660 tx=0x7fd1380a9850 comp rx=0 tx=0).stop 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 -- 172.21.15.37:0/509999391 shutdown_connections 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d58e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4f2160 0x55625d589d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 --2- 172.21.15.37:0/509999391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d58a2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 -- 172.21.15.37:0/509999391 >> 172.21.15.37:0/509999391 conn(0x55625d4686a0 msgr2=0x55625d580400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 -- 172.21.15.37:0/509999391 shutdown_connections 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 -- 172.21.15.37:0/509999391 wait complete. 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.482+0000 7fd158581b80 1 -- start start 2024-05-09T01:16:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 1 Processor -- start 2024-05-09T01:16:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d593670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4f2160 0x55625d593bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d5940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55625d323ba0 con 0x55625d4f2160 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55625d462150 con 0x55625d58e400 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55625d58f150 con 0x55625d4084a0 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd158581b80 10 client.0 _ll_register_callbacks cb 0x55625d3196c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd143fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d5940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd1437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d593670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd142ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4f2160 0x55625d593bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd143fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d5940f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46348/0 (socket says 172.21.15.37:46348) 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd143fff700 1 -- 172.21.15.37:0/3531784011 learned_addr learned my addr 172.21.15.37:0/3531784011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd143fff700 1 -- 172.21.15.37:0/3531784011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 msgr2=0x55625d593670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.483+0000 7fd143fff700 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d593670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd143fff700 1 -- 172.21.15.37:0/3531784011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4f2160 msgr2=0x55625d593bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd143fff700 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4f2160 0x55625d593bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd143fff700 1 -- 172.21.15.37:0/3531784011 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55625d323490 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd143fff700 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d5940f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00bd20 tx=0x7fd13c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3a4aa4530bd4c67 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd122ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd122ffd700 1 -- 172.21.15.37:0/3531784011 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c02c030 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd122ffd700 1 -- 172.21.15.37:0/3531784011 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd13c007990 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.484+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1380b2110 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.485+0000 7fd122ffd700 1 -- 172.21.15.37:0/3531784011 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd13c009ac0 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.485+0000 7fd158581b80 10 client.27689 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.485+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55625d5a0ec0 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.485+0000 7fd122ffd700 1 -- 172.21.15.37:0/3531784011 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd13c022070 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.485+0000 7fd122ffd700 1 -- 172.21.15.37:0/3531784011 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fd13c027040 con 0x55625d58e400 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.486+0000 7fd158581b80 10 client.27689 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.486+0000 7fd158581b80 10 client.27689 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.486+0000 7fd158581b80 20 client.27689 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.486+0000 7fd158581b80 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d5a3450 0x55625d5a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.486+0000 7fd158581b80 4 client.27689 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.486+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd1380b2110 con 0x55625d5a3450 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.486+0000 7fd1437fe700 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d5a3450 0x55625d5a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.487+0000 7fd122ffd700 10 client.27689 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.487+0000 7fd1437fe700 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d5a3450 0x55625d5a58c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=13d78f718ab6e150 server_cookie=8edf3f7d8a076da in_seq=0 out_seq=0 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd122ffd700 1 -- 172.21.15.37:0/3531784011 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fd1380b2110 con 0x55625d5a3450 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd122ffd700 10 client.27689 handle_command_reply: tid=0 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 client.27689 shutdown 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 msgr2=0x55625d5940f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d5940f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00bd20 tx=0x7fd13c009920 comp rx=0 tx=0).stop 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 shutdown_connections 2024-05-09T01:16:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d5a3450 0x55625d5a58c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d5940f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4084a0 0x55625d593670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 --2- 172.21.15.37:0/3531784011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4f2160 0x55625d593bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd122ffd700 0 client.27689 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 >> 172.21.15.37:0/3531784011 conn(0x55625d4686a0 msgr2=0x55625d5801c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 shutdown_connections 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 1 -- 172.21.15.37:0/3531784011 wait complete. 2024-05-09T01:16:21.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.488+0000 7fd158581b80 20 client.27689 trim_cache size 0 max 16384 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 Processor -- start 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 -- start start 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4084a0 0x55625d58fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d593f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d592540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441ac930 con 0x55625d4084a0 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441ae470 con 0x55625d58e400 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd158581b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441ad000 con 0x55625d4f2160 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd1437fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4084a0 0x55625d58fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd1437fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4084a0 0x55625d58fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44690/0 (socket says 172.21.15.37:44690) 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.507+0000 7fd1437fe700 1 -- 172.21.15.37:0/522403825 learned_addr learned my addr 172.21.15.37:0/522403825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd143fff700 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d592540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd142ffd700 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d593f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1437fe700 1 -- 172.21.15.37:0/522403825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 msgr2=0x55625d593f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1437fe700 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d593f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1437fe700 1 -- 172.21.15.37:0/522403825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 msgr2=0x55625d592540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1437fe700 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d592540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1437fe700 1 -- 172.21.15.37:0/522403825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625d591be0 con 0x55625d4084a0 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd142ffd700 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d593f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1437fe700 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4084a0 0x55625d58fdd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55625d5a5ff0 tx=0x7fd134009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9935c6e6ce9052b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1297fa700 1 -- 172.21.15.37:0/522403825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134004830 con 0x55625d4084a0 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1297fa700 1 -- 172.21.15.37:0/522403825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd134024030 con 0x55625d4084a0 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.508+0000 7fd1297fa700 1 -- 172.21.15.37:0/522403825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134020330 con 0x55625d4084a0 2024-05-09T01:16:21.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 -- 172.21.15.37:0/522403825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4084a0 msgr2=0x55625d58fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4084a0 0x55625d58fdd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x55625d5a5ff0 tx=0x7fd134009310 comp rx=0 tx=0).stop 2024-05-09T01:16:21.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 -- 172.21.15.37:0/522403825 shutdown_connections 2024-05-09T01:16:21.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d58e400 0x55625d592540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d4084a0 0x55625d58fdd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 --2- 172.21.15.37:0/522403825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d593f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 -- 172.21.15.37:0/522403825 >> 172.21.15.37:0/522403825 conn(0x55625d4686a0 msgr2=0x55625d591e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 -- 172.21.15.37:0/522403825 shutdown_connections 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 -- 172.21.15.37:0/522403825 wait complete. 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.510+0000 7fd158581b80 1 -- start start 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 1 Processor -- start 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4084a0 0x55625d589150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d59b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d59b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441adda0 con 0x55625d58e400 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441ad6d0 con 0x55625d4084a0 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441aa910 con 0x55625d4f2160 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd158581b80 10 client.0 _ll_register_callbacks cb 0x55625d3196c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd1437fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4084a0 0x55625d589150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd143fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d59b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd1437fe700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4084a0 0x55625d589150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:46372/0 (socket says 172.21.15.37:46372) 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd1437fe700 1 -- 172.21.15.37:0/4137273804 learned_addr learned my addr 172.21.15.37:0/4137273804 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd142ffd700 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d59b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.511+0000 7fd1437fe700 1 -- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 msgr2=0x55625d59b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd1437fe700 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d59b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd1437fe700 1 -- 172.21.15.37:0/4137273804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 msgr2=0x55625d59b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd1437fe700 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d59b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd1437fe700 1 -- 172.21.15.37:0/4137273804 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55625d59bdb0 con 0x55625d4084a0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd1437fe700 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4084a0 0x55625d589150 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd134023040 tx=0x7fd134005860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5b7c0f7aedfc957 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd122ffd700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd122ffd700 1 -- 172.21.15.37:0/4137273804 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13402d020 con 0x55625d4084a0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd134024030 con 0x55625d4084a0 2024-05-09T01:16:21.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd122ffd700 1 -- 172.21.15.37:0/4137273804 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fd134004050 con 0x55625d4084a0 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd122ffd700 1 -- 172.21.15.37:0/4137273804 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fd134004250 con 0x55625d4084a0 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd158581b80 10 client.27695 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55625d5872f0 con 0x55625d4084a0 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.512+0000 7fd122ffd700 1 -- 172.21.15.37:0/4137273804 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd134024030 con 0x55625d4084a0 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd122ffd700 1 -- 172.21.15.37:0/4137273804 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fd134003950 con 0x55625d4084a0 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd158581b80 10 client.27695 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd158581b80 10 client.27695 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd158581b80 20 client.27695 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd158581b80 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d6127a0 0x55625d614bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd158581b80 4 client.27695 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55625d4b59d0 con 0x55625d6127a0 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.513+0000 7fd142ffd700 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d6127a0 0x55625d614bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.514+0000 7fd142ffd700 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d6127a0 0x55625d614bc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=80b8ed9a570ccc18 server_cookie=1ea5b472a73d6355 in_seq=0 out_seq=0 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.514+0000 7fd122ffd700 10 client.27695 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.514+0000 7fd122ffd700 1 -- 172.21.15.37:0/4137273804 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55625d4b59d0 con 0x55625d6127a0 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.514+0000 7fd122ffd700 10 client.27695 handle_command_reply: tid=0 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.514+0000 7fd158581b80 1 client.27695 shutdown 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4084a0 msgr2=0x55625d589150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4084a0 0x55625d589150 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd134023040 tx=0x7fd134005860 comp rx=0 tx=0).stop 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 shutdown_connections 2024-05-09T01:16:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x55625d6127a0 0x55625d614bc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55625d58e400 0x55625d59b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55625d4084a0 0x55625d589150 secure :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd134023040 tx=0x7fd134005860 comp rx=0 tx=0).stop 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 --2- 172.21.15.37:0/4137273804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55625d4f2160 0x55625d59b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 >> 172.21.15.37:0/4137273804 conn(0x55625d4686a0 msgr2=0x55625d58fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd122ffd700 0 client.27695 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.515+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 shutdown_connections 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.516+0000 7fd158581b80 1 -- 172.21.15.37:0/4137273804 wait complete. 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.516+0000 7fd158581b80 20 client.27695 trim_cache size 0 max 16384 2024-05-09T01:16:21.522 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.517+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd12c0b2a10 msgr2=0x7fd12c0b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.517+0000 7fd149b6b700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd12c0b2a10 0x7fd12c0b4f20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009840 tx=0x7fd13c006000 comp rx=0 tx=0).stop 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.517+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 msgr2=0x7fd14419b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.517+0000 7fd149b6b700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 0x7fd14419b3c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e9c0 tx=0x7fd13800ed80 comp rx=0 tx=0).stop 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 shutdown_connections 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fd12c0b2a10 0x7fd12c0b4f20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410e8f0 0x7fd14419f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd144105480 0x7fd14419ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 --2- 172.21.15.37:0/2307261198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd144105dd0 0x7fd14419b3c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:21.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 >> 172.21.15.37:0/2307261198 conn(0x7fd1440fef30 msgr2=0x7fd1440ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:21.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 shutdown_connections 2024-05-09T01:16:21.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:21.518+0000 7fd149b6b700 1 -- 172.21.15.37:0/2307261198 wait complete. 2024-05-09T01:16:22.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:16:22.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:22 smithi136 ceph-mon[34110]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 664 op/s 2024-05-09T01:16:22.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:22 smithi037 ceph-mon[30122]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 664 op/s 2024-05-09T01:16:22.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:22 smithi151 ceph-mon[34780]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 664 op/s 2024-05-09T01:16:23.113 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:24.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:24 smithi136 ceph-mon[34110]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 599 op/s 2024-05-09T01:16:24.911 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:24 smithi037 ceph-mon[30122]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 599 op/s 2024-05-09T01:16:24.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:24 smithi151 ceph-mon[34780]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 12 MiB/s wr, 599 op/s 2024-05-09T01:16:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 -- 172.21.15.37:0/756379409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718108780 msgr2=0x7f07181100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 --2- 172.21.15.37:0/756379409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718108780 0x7f07181100e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f071000b0d0 tx=0x7f071000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 -- 172.21.15.37:0/756379409 shutdown_connections 2024-05-09T01:16:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 --2- 172.21.15.37:0/756379409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718108780 0x7f07181100e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 --2- 172.21.15.37:0/756379409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0718103550 0x7f0718103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 --2- 172.21.15.37:0/756379409 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718107e30 0x7f0718108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 -- 172.21.15.37:0/756379409 >> 172.21.15.37:0/756379409 conn(0x7f0718078e00 msgr2=0x7f0718079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 -- 172.21.15.37:0/756379409 shutdown_connections 2024-05-09T01:16:25.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 -- 172.21.15.37:0/756379409 wait complete. 2024-05-09T01:16:25.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.068+0000 7f071f307700 1 Processor -- start 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071f307700 1 -- start start 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071f307700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718103550 0x7f0718199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071f307700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718107e30 0x7f071819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071f307700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0718108780 0x7f071819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071f307700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07181133b0 con 0x7f0718107e30 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071f307700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0718113230 con 0x7f0718103550 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071f307700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0718113530 con 0x7f0718108780 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071c8a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718107e30 0x7f071819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071c8a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718107e30 0x7f071819a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36748/0 (socket says 172.21.15.37:36748) 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071d0a3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718103550 0x7f0718199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071d0a3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718103550 0x7f0718199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43880/0 (socket says 172.21.15.37:43880) 2024-05-09T01:16:25.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.069+0000 7f071d0a3700 1 -- 172.21.15.37:0/3757874252 learned_addr learned my addr 172.21.15.37:0/3757874252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.070+0000 7f071d0a3700 1 -- 172.21.15.37:0/3757874252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0718108780 msgr2=0x7f071819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.070+0000 7f071d0a3700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0718108780 0x7f071819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.070+0000 7f071d0a3700 1 -- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718107e30 msgr2=0x7f071819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.070+0000 7f071d0a3700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718107e30 0x7f071819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.070+0000 7f071d0a3700 1 -- 172.21.15.37:0/3757874252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071819ebf0 con 0x7f0718103550 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.070+0000 7f071d0a3700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718103550 0x7f0718199d20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f071400e9a0 tx=0x7f071400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.071+0000 7f070e7fc700 1 -- 172.21.15.37:0/3757874252 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714020070 con 0x7f0718103550 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.071+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071819eee0 con 0x7f0718103550 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.071+0000 7f070e7fc700 1 -- 172.21.15.37:0/3757874252 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f071400cc70 con 0x7f0718103550 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.071+0000 7f070e7fc700 1 -- 172.21.15.37:0/3757874252 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071401b8e0 con 0x7f0718103550 2024-05-09T01:16:25.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.071+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07180759f0 con 0x7f0718103550 2024-05-09T01:16:25.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.073+0000 7f070e7fc700 1 -- 172.21.15.37:0/3757874252 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0714023070 con 0x7f0718103550 2024-05-09T01:16:25.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.074+0000 7f070e7fc700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07040b2900 0x7f07040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.074+0000 7f071c8a2700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07040b2900 0x7f07040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.074+0000 7f070e7fc700 1 -- 172.21.15.37:0/3757874252 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f07140e6260 con 0x7f0718103550 2024-05-09T01:16:25.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.075+0000 7f072dd1db80 1 Processor -- start 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f072dd1db80 1 -- start start 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460eb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f072dd1db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561445ffeff0 con 0x5614460e4eb0 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f072dd1db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561445f9d7f0 con 0x561445f5f4a0 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f072dd1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561445ffafb0 con 0x561446049160 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f071c8a2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f071d8a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f071c8a2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460eb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43896/0 (socket says 172.21.15.37:43896) 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.076+0000 7f071c8a2700 1 -- 172.21.15.37:0/3876437155 learned_addr learned my addr 172.21.15.37:0/3876437155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071d0a3700 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071c8a2700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07040b2900 0x7f07040b4e10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0718108680 tx=0x7f0708011440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071c8a2700 1 -- 172.21.15.37:0/3876437155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 msgr2=0x5614460ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071c8a2700 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ead00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071c8a2700 1 -- 172.21.15.37:0/3876437155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 msgr2=0x5614460e52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071c8a2700 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460e52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071c8a2700 1 -- 172.21.15.37:0/3876437155 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561445f95370 con 0x561445f5f4a0 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.077+0000 7f071d0a3700 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.078+0000 7f071c8a2700 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460eb240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0708005c50 tx=0x7f070801e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=912e3a651f40f0a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.078+0000 7f07037fe700 1 -- 172.21.15.37:0/3876437155 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708017040 con 0x561445f5f4a0 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.078+0000 7f07037fe700 1 -- 172.21.15.37:0/3876437155 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0708019050 con 0x561445f5f4a0 2024-05-09T01:16:25.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.078+0000 7f07037fe700 1 -- 172.21.15.37:0/3876437155 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070800e610 con 0x561445f5f4a0 2024-05-09T01:16:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 -- 172.21.15.37:0/3876437155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 msgr2=0x5614460eb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460eb240 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0708005c50 tx=0x7f070801e000 comp rx=0 tx=0).stop 2024-05-09T01:16:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 -- 172.21.15.37:0/3876437155 shutdown_connections 2024-05-09T01:16:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460e52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 --2- 172.21.15.37:0/3876437155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460eb240 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 -- 172.21.15.37:0/3876437155 >> 172.21.15.37:0/3876437155 conn(0x561445fbf6a0 msgr2=0x5614460d7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 -- 172.21.15.37:0/3876437155 shutdown_connections 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 -- 172.21.15.37:0/3876437155 wait complete. 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 -- start start 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.079+0000 7f072dd1db80 1 Processor -- start 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561445f5f4a0 0x5614460eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614460e4eb0 0x5614460ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f072dd1db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561445e7aba0 con 0x561445f5f4a0 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f072dd1db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561445fb9150 con 0x5614460e4eb0 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f072dd1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5614461029f0 con 0x561446049160 2024-05-09T01:16:25.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f072dd1db80 10 client.0 _ll_register_callbacks cb 0x561445e706c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f071d0a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561445f5f4a0 0x5614460eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f071c8a2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f071d0a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561445f5f4a0 0x5614460eea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36764/0 (socket says 172.21.15.37:36764) 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f071d0a3700 1 -- 172.21.15.37:0/345561086 learned_addr learned my addr 172.21.15.37:0/345561086 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.080+0000 7f071d8a4700 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614460e4eb0 0x5614460ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f071d0a3700 1 -- 172.21.15.37:0/345561086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 msgr2=0x5614460eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f071d0a3700 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f071d0a3700 1 -- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614460e4eb0 msgr2=0x5614460ef4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f071d0a3700 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614460e4eb0 0x5614460ef4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f071d0a3700 1 -- 172.21.15.37:0/345561086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561445e7a490 con 0x561445f5f4a0 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f071d0a3700 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561445f5f4a0 0x5614460eea40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f07140ad890 tx=0x7f0714009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38e51a97af0c0fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f0700ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:16:25.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f0700ff9700 1 -- 172.21.15.37:0/345561086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140ad410 con 0x561445f5f4a0 2024-05-09T01:16:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f0700ff9700 1 -- 172.21.15.37:0/345561086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f07140cebb0 con 0x561445f5f4a0 2024-05-09T01:16:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0708019050 con 0x561445f5f4a0 2024-05-09T01:16:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.081+0000 7f0700ff9700 1 -- 172.21.15.37:0/345561086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f071400ce20 con 0x561445f5f4a0 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.082+0000 7f072dd1db80 10 client.17769 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.082+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56144610d3a0 con 0x561445f5f4a0 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f0700ff9700 1 -- 172.21.15.37:0/345561086 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0708019050 con 0x561445f5f4a0 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f0700ff9700 1 -- 172.21.15.37:0/345561086 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f071400c760 con 0x561445f5f4a0 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f072dd1db80 10 client.17769 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f072dd1db80 10 client.17769 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f072dd1db80 20 client.17769 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f072dd1db80 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144610f930 0x561446111d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f072dd1db80 4 client.17769 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56144600c9d0 con 0x56144610f930 2024-05-09T01:16:25.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.083+0000 7f071c8a2700 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144610f930 0x561446111d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.084+0000 7f0700ff9700 10 client.17769 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.084+0000 7f071c8a2700 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144610f930 0x561446111d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=361781b9aa2e688d server_cookie=792699a045c74e69 in_seq=0 out_seq=0 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.084+0000 7f0700ff9700 1 -- 172.21.15.37:0/345561086 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56144600c9d0 con 0x56144610f930 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.084+0000 7f0700ff9700 10 client.17769 handle_command_reply: tid=0 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 client.17769 shutdown 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561445f5f4a0 msgr2=0x5614460eea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561445f5f4a0 0x5614460eea40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f07140ad890 tx=0x7f0714009620 comp rx=0 tx=0).stop 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 shutdown_connections 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144610f930 0x561446111d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5614460e4eb0 0x5614460ef4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f0700ff9700 0 client.17769 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:16:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561445f5f4a0 0x5614460eea40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 --2- 172.21.15.37:0/345561086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 >> 172.21.15.37:0/345561086 conn(0x561445fbf6a0 msgr2=0x5614460d71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 shutdown_connections 2024-05-09T01:16:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 1 -- 172.21.15.37:0/345561086 wait complete. 2024-05-09T01:16:25.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.085+0000 7f072dd1db80 20 client.17769 trim_cache size 0 max 16384 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 Processor -- start 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 -- start start 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460e48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460ef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07180732e0 con 0x5614460e4eb0 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0718074e20 con 0x561445f5f4a0 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.103+0000 7f072dd1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f07180739b0 con 0x561446049160 2024-05-09T01:16:25.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d8a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d8a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36778/0 (socket says 172.21.15.37:36778) 2024-05-09T01:16:25.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d8a4700 1 -- 172.21.15.37:0/4085000085 learned_addr learned my addr 172.21.15.37:0/4085000085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071c8a2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d0a3700 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460e48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d8a4700 1 -- 172.21.15.37:0/4085000085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 msgr2=0x5614460ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d8a4700 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d8a4700 1 -- 172.21.15.37:0/4085000085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 msgr2=0x5614460e48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.104+0000 7f071d8a4700 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460e48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.105+0000 7f071d8a4700 1 -- 172.21.15.37:0/4085000085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614460d8d00 con 0x5614460e4eb0 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.105+0000 7f071d8a4700 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460ef300 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0710005bb0 tx=0x7f0710009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29676dd7e51bf635 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.105+0000 7f0702ffd700 1 -- 172.21.15.37:0/4085000085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071000baa0 con 0x5614460e4eb0 2024-05-09T01:16:25.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f0702ffd700 1 -- 172.21.15.37:0/4085000085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f071000bc40 con 0x5614460e4eb0 2024-05-09T01:16:25.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f0702ffd700 1 -- 172.21.15.37:0/4085000085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710005610 con 0x5614460e4eb0 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f072dd1db80 1 -- 172.21.15.37:0/4085000085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 msgr2=0x5614460ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f072dd1db80 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460ef300 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0710005bb0 tx=0x7f0710009b80 comp rx=0 tx=0).stop 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f072dd1db80 1 -- 172.21.15.37:0/4085000085 shutdown_connections 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f072dd1db80 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x5614460ef300 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f072dd1db80 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561445f5f4a0 0x5614460e48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f072dd1db80 1 --2- 172.21.15.37:0/4085000085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561446049160 0x5614460ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.106+0000 7f072dd1db80 1 -- 172.21.15.37:0/4085000085 >> 172.21.15.37:0/4085000085 conn(0x561445fbf6a0 msgr2=0x5614460e8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.107+0000 7f072dd1db80 1 -- 172.21.15.37:0/4085000085 shutdown_connections 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.107+0000 7f072dd1db80 1 -- 172.21.15.37:0/4085000085 wait complete. 2024-05-09T01:16:25.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.107+0000 7f072dd1db80 1 -- start start 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.107+0000 7f072dd1db80 1 Processor -- start 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561445f5f4a0 0x561446107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561446049160 0x561446116990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f072dd1db80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x561446116ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f072dd1db80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0718074750 con 0x5614460e4eb0 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f072dd1db80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0718074080 con 0x561446049160 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f072dd1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f07180712a0 con 0x561445f5f4a0 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f072dd1db80 10 client.0 _ll_register_callbacks cb 0x56144610c120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x561446116ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d0a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561445f5f4a0 0x561446107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x561446116ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36780/0 (socket says 172.21.15.37:36780) 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d0a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561445f5f4a0 0x561446107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60418/0 (socket says 172.21.15.37:60418) 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 -- 172.21.15.37:0/2110670403 learned_addr learned my addr 172.21.15.37:0/2110670403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071c8a2700 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561446049160 0x561446116990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 -- 172.21.15.37:0/2110670403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561445f5f4a0 msgr2=0x561446107ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561445f5f4a0 0x561446107ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 -- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561446049160 msgr2=0x561446116990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561446049160 0x561446116990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071d8a4700 1 -- 172.21.15.37:0/2110670403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561446117410 con 0x5614460e4eb0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.108+0000 7f071c8a2700 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561446049160 0x561446116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f071d8a4700 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x561446116ed0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f071000b770 tx=0x7f0710003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb4326041deb2f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f0700ff9700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f0700ff9700 1 -- 172.21.15.37:0/2110670403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07100092e0 con 0x5614460e4eb0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f071000bc40 con 0x5614460e4eb0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f0700ff9700 1 -- 172.21.15.37:0/2110670403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f0710005250 con 0x5614460e4eb0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f0700ff9700 1 -- 172.21.15.37:0/2110670403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f0710005450 con 0x5614460e4eb0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f072dd1db80 10 client.17775 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x561446179d10 con 0x5614460e4eb0 2024-05-09T01:16:25.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f0700ff9700 1 -- 172.21.15.37:0/2110670403 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f071000bc40 con 0x5614460e4eb0 2024-05-09T01:16:25.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.109+0000 7f0700ff9700 1 -- 172.21.15.37:0/2110670403 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f0710011070 con 0x5614460e4eb0 2024-05-09T01:16:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.110+0000 7f072dd1db80 10 client.17775 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.110+0000 7f072dd1db80 10 client.17775 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:16:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.110+0000 7f072dd1db80 20 client.17775 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.110+0000 7f072dd1db80 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144617a2c0 0x56144617c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.110+0000 7f072dd1db80 4 client.17775 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:16:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.111+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561446006a70 con 0x56144617a2c0 2024-05-09T01:16:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.111+0000 7f071d0a3700 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144617a2c0 0x56144617c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.111+0000 7f071d0a3700 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144617a2c0 0x56144617c6e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f697775249db846d server_cookie=79ac1d6d3ed14f34 in_seq=0 out_seq=0 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.111+0000 7f0700ff9700 10 client.17775 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f0700ff9700 1 -- 172.21.15.37:0/2110670403 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561446006a70 con 0x56144617a2c0 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f0700ff9700 10 client.17775 handle_command_reply: tid=0 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 client.17775 shutdown 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 msgr2=0x561446116ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x561446116ed0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f071000b770 tx=0x7f0710003de0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 shutdown_connections 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614460e4eb0 0x561446116ed0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561445f5f4a0 0x561446107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x56144617a2c0 0x56144617c6e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 --2- 172.21.15.37:0/2110670403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561446049160 0x561446116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 >> 172.21.15.37:0/2110670403 conn(0x561445fbf6a0 msgr2=0x5614460e4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f0700ff9700 0 client.17775 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:16:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 shutdown_connections 2024-05-09T01:16:25.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 1 -- 172.21.15.37:0/2110670403 wait complete. 2024-05-09T01:16:25.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.112+0000 7f072dd1db80 20 client.17775 trim_cache size 0 max 16384 2024-05-09T01:16:25.117 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07040b2900 msgr2=0x7f07040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07040b2900 0x7f07040b4e10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0718108680 tx=0x7f0708011440 comp rx=0 tx=0).stop 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718103550 msgr2=0x7f0718199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718103550 0x7f0718199d20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f071400e9a0 tx=0x7f071400ecb0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 shutdown_connections 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f07040b2900 0x7f07040b4e10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0718108780 0x7f071819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0718103550 0x7f0718199d20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 --2- 172.21.15.37:0/3757874252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0718107e30 0x7f071819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 >> 172.21.15.37:0/3757874252 conn(0x7f0718078e00 msgr2=0x7f0718100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 shutdown_connections 2024-05-09T01:16:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:25.113+0000 7f071f307700 1 -- 172.21.15.37:0/3757874252 wait complete. 2024-05-09T01:16:25.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 845.0 s, 1310.0 tps, lat 75.367 ms stddev 84.619 2024-05-09T01:16:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.572+0000 7fc428372640 1 -- 172.21.15.37:0/1483316719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 msgr2=0x7fc42010b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.572+0000 7fc428372640 1 --2- 172.21.15.37:0/1483316719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 0x7fc42010b370 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc41400b9f0 tx=0x7fc41402c0f0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.574+0000 7fc428372640 1 -- 172.21.15.37:0/1483316719 shutdown_connections 2024-05-09T01:16:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.574+0000 7fc428372640 1 --2- 172.21.15.37:0/1483316719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 0x7fc4201129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.574+0000 7fc428372640 1 --2- 172.21.15.37:0/1483316719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42010b8b0 0x7fc42010bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.574+0000 7fc428372640 1 --2- 172.21.15.37:0/1483316719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 0x7fc42010b370 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.574+0000 7fc428372640 1 -- 172.21.15.37:0/1483316719 >> 172.21.15.37:0/1483316719 conn(0x7fc420070a90 msgr2=0x7fc420072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.574+0000 7fc428372640 1 -- 172.21.15.37:0/1483316719 shutdown_connections 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.575+0000 7fc428372640 1 -- 172.21.15.37:0/1483316719 wait complete. 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 Processor -- start 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 -- start start 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 0x7fc4201a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42010b8b0 0x7fc4201a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 0x7fc42007af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc420115de0 con 0x7fc42010b8b0 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc420115c60 con 0x7fc42010a670 2024-05-09T01:16:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.576+0000 7fc428372640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc420115f60 con 0x7fc4201105b0 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.577+0000 7fc42690f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 0x7fc42007af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.577+0000 7fc42690f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 0x7fc42007af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60440/0 (socket says 172.21.15.37:60440) 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.577+0000 7fc42690f640 1 -- 172.21.15.37:0/3911043066 learned_addr learned my addr 172.21.15.37:0/3911043066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.577+0000 7fc42610e640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 0x7fc4201a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.578+0000 7fc42690f640 1 -- 172.21.15.37:0/3911043066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 msgr2=0x7fc4201a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.578+0000 7fc42690f640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 0x7fc4201a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.578+0000 7fc42690f640 1 -- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42010b8b0 msgr2=0x7fc4201a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.578+0000 7fc42690f640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42010b8b0 0x7fc4201a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.578+0000 7fc42690f640 1 -- 172.21.15.37:0/3911043066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42007b5a0 con 0x7fc4201105b0 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.579+0000 7fc42690f640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 0x7fc42007af30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc41800fe00 tx=0x7fc41800fef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.579+0000 7fc4137fe640 1 -- 172.21.15.37:0/3911043066 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41801d070 con 0x7fc4201105b0 2024-05-09T01:16:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.579+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42007b890 con 0x7fc4201105b0 2024-05-09T01:16:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.579+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42007bdb0 con 0x7fc4201105b0 2024-05-09T01:16:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.579+0000 7fc4137fe640 1 -- 172.21.15.37:0/3911043066 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4180188f0 con 0x7fc4201105b0 2024-05-09T01:16:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.584+0000 7fc42f222740 1 Processor -- start 2024-05-09T01:16:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.584+0000 7fc4137fe640 1 -- 172.21.15.37:0/3911043066 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418018640 con 0x7fc4201105b0 2024-05-09T01:16:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.585+0000 7fc42f222740 1 -- start start 2024-05-09T01:16:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.585+0000 7fc42f222740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dba2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.588+0000 7fc4137fe640 1 -- 172.21.15.37:0/3911043066 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc418020070 con 0x7fc4201105b0 2024-05-09T01:16:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.589+0000 7fc4137fe640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc40c0b28d0 0x7fc40c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.589+0000 7fc4137fe640 1 -- 172.21.15.37:0/3911043066 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc4180e5cb0 con 0x7fc4201105b0 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42f222740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dba2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42590d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dba2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42590d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dba2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43936/0 (socket says 172.21.15.37:43936) 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42590d640 1 -- 172.21.15.37:0/1603882823 learned_addr learned my addr 172.21.15.37:0/1603882823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42f222740 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dba9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e8db067c0 con 0x557e8d7d52f0 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557e8daa20e0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.590+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e8db02780 con 0x557e8d7dd4d0 2024-05-09T01:16:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.591+0000 7fc42610e640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc40c0b28d0 0x7fc40c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.591+0000 7fc42590d640 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dba2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.591+0000 7fc42690f640 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dba9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.592+0000 7fc42590d640 1 -- 172.21.15.37:0/1603882823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 msgr2=0x557e8dba9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.592+0000 7fc42590d640 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dba9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.592+0000 7fc42590d640 1 -- 172.21.15.37:0/1603882823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 msgr2=0x557e8dba2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.592+0000 7fc42590d640 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dba2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.592+0000 7fc42590d640 1 -- 172.21.15.37:0/1603882823 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e8dacb7c0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.593+0000 7fc42590d640 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dba2500 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc41c015330 tx=0x7fc41c00a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c14711eb3cd056c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.593+0000 7fc42610e640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc40c0b28d0 0x7fc40c0b4de0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc414000c00 tx=0x7fc414009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.597+0000 7fc410bfe640 1 -- 172.21.15.37:0/1603882823 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c005020 con 0x557e8d7fe1b0 2024-05-09T01:16:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.597+0000 7fc410bfe640 1 -- 172.21.15.37:0/1603882823 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc41c0047a0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.598+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 msgr2=0x557e8dba2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.598+0000 7fc42f222740 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dba2500 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc41c015330 tx=0x7fc41c00a300 comp rx=0 tx=0).stop 2024-05-09T01:16:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.599+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 shutdown_connections 2024-05-09T01:16:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.599+0000 7fc42f222740 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dba9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.599+0000 7fc42f222740 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dba2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.599+0000 7fc42f222740 1 --2- 172.21.15.37:0/1603882823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dba2500 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.599+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 >> 172.21.15.37:0/1603882823 conn(0x557e8d7f2300 msgr2=0x557e8db9de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.599+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 shutdown_connections 2024-05-09T01:16:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.599+0000 7fc42f222740 1 -- 172.21.15.37:0/1603882823 wait complete. 2024-05-09T01:16:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.600+0000 7fc42f222740 1 -- start start 2024-05-09T01:16:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.600+0000 7fc42f222740 1 Processor -- start 2024-05-09T01:16:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42f222740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7d52f0 0x557e8dbac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42f222740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42f222740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42f222740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e8dbaa420 con 0x557e8d7fe1b0 2024-05-09T01:16:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42f222740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557e8da8d9c0 con 0x557e8d7d52f0 2024-05-09T01:16:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42f222740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e8dbaa5a0 con 0x557e8d7dd4d0 2024-05-09T01:16:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42f222740 10 client.0 _ll_register_callbacks cb 0x557e8daba020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.601+0000 7fc42610e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7d52f0 0x557e8dbac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42610e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7d52f0 0x557e8dbac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43948/0 (socket says 172.21.15.37:43948) 2024-05-09T01:16:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42610e640 1 -- 172.21.15.37:0/1984996250 learned_addr learned my addr 172.21.15.37:0/1984996250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42590d640 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42690f640 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42610e640 1 -- 172.21.15.37:0/1984996250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 msgr2=0x557e8dbac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42610e640 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42610e640 1 -- 172.21.15.37:0/1984996250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7fe1b0 msgr2=0x557e8dbb37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42610e640 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.602+0000 7fc42610e640 1 -- 172.21.15.37:0/1984996250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e8dab41f0 con 0x557e8d7d52f0 2024-05-09T01:16:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.603+0000 7fc42610e640 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7d52f0 0x557e8dbac300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc41400b9f0 tx=0x7fc41402c0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f32f1f6b6b1fe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.603+0000 7fc409ffb640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.604+0000 7fc409ffb640 1 -- 172.21.15.37:0/1984996250 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc414039040 con 0x557e8d7d52f0 2024-05-09T01:16:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.604+0000 7fc409ffb640 1 -- 172.21.15.37:0/1984996250 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc414009d60 con 0x557e8d7d52f0 2024-05-09T01:16:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.604+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc41c0047a0 con 0x557e8d7d52f0 2024-05-09T01:16:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.604+0000 7fc409ffb640 1 -- 172.21.15.37:0/1984996250 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc41400b640 con 0x557e8d7d52f0 2024-05-09T01:16:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.604+0000 7fc42f222740 10 client.27725 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.604+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557e8d869790 con 0x557e8d7d52f0 2024-05-09T01:16:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc409ffb640 1 -- 172.21.15.37:0/1984996250 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc41c0047a0 con 0x557e8d7d52f0 2024-05-09T01:16:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc409ffb640 1 -- 172.21.15.37:0/1984996250 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fc41403c030 con 0x557e8d7d52f0 2024-05-09T01:16:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc42f222740 10 client.27725 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc42f222740 10 client.27725 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc42f222740 20 client.27725 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc42f222740 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7bcd80 0x557e8dbb9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc42f222740 4 client.27725 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.605+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e8db143d0 con 0x557e8d7bcd80 2024-05-09T01:16:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.606+0000 7fc42590d640 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7bcd80 0x557e8dbb9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.606+0000 7fc409ffb640 10 client.27725 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.608+0000 7fc42590d640 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7bcd80 0x557e8dbb9ad0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2bebe32c679d848 server_cookie=d55f912994eb9dda in_seq=0 out_seq=0 2024-05-09T01:16:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc409ffb640 1 -- 172.21.15.37:0/1984996250 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e8db143d0 con 0x557e8d7bcd80 2024-05-09T01:16:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc409ffb640 10 client.27725 handle_command_reply: tid=0 2024-05-09T01:16:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 client.27725 shutdown 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7d52f0 msgr2=0x557e8dbac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7d52f0 0x557e8dbac300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc41400b9f0 tx=0x7fc41402c0f0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 shutdown_connections 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7bcd80 0x557e8dbb9ad0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 --2- 172.21.15.37:0/1984996250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7d52f0 0x557e8dbac300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 >> 172.21.15.37:0/1984996250 conn(0x557e8d7f2300 msgr2=0x557e8dba0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc409ffb640 0 client.27725 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 shutdown_connections 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.612+0000 7fc42f222740 1 -- 172.21.15.37:0/1984996250 wait complete. 2024-05-09T01:16:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.613+0000 7fc42f222740 20 client.27725 trim_cache size 0 max 16384 2024-05-09T01:16:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.646+0000 7fc42f222740 1 Processor -- start 2024-05-09T01:16:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.647+0000 7fc42f222740 1 -- start start 2024-05-09T01:16:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.648+0000 7fc42f222740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbbf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.648+0000 7fc42f222740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbb3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.648+0000 7fc42f222740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dbbf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.648+0000 7fc42610e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbbf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.648+0000 7fc42610e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbbf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36826/0 (socket says 172.21.15.37:36826) 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.648+0000 7fc42610e640 1 -- 172.21.15.37:0/2272774796 learned_addr learned my addr 172.21.15.37:0/2272774796 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.648+0000 7fc42690f640 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dbbf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc40400e440 con 0x557e8d7d52f0 2024-05-09T01:16:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42590d640 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbb3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc40400ff80 con 0x557e8d7fe1b0 2024-05-09T01:16:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc40400eb10 con 0x557e8d7dd4d0 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42690f640 1 -- 172.21.15.37:0/2272774796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 msgr2=0x557e8dbb3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42690f640 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbb3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42690f640 1 -- 172.21.15.37:0/2272774796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 msgr2=0x557e8dbbf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42690f640 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbbf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.649+0000 7fc42690f640 1 -- 172.21.15.37:0/2272774796 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e8d8e05f0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.650+0000 7fc42690f640 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dbbf7d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc4180e37b0 tx=0x7fc418004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d14fa82f441a536c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.650+0000 7fc40bfff640 1 -- 172.21.15.37:0/2272774796 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4180b1680 con 0x557e8d7fe1b0 2024-05-09T01:16:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.650+0000 7fc40bfff640 1 -- 172.21.15.37:0/2272774796 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4180b6130 con 0x557e8d7fe1b0 2024-05-09T01:16:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.651+0000 7fc40bfff640 1 -- 172.21.15.37:0/2272774796 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4180e3e30 con 0x557e8d7fe1b0 2024-05-09T01:16:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 msgr2=0x557e8dbbf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dbbf7d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc4180e37b0 tx=0x7fc418004a40 comp rx=0 tx=0).stop 2024-05-09T01:16:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 shutdown_connections 2024-05-09T01:16:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7fe1b0 0x557e8dbbf7d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7dd4d0 0x557e8dbb3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 --2- 172.21.15.37:0/2272774796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbbf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 >> 172.21.15.37:0/2272774796 conn(0x557e8d7f2300 msgr2=0x557e8dba6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 shutdown_connections 2024-05-09T01:16:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 -- 172.21.15.37:0/2272774796 wait complete. 2024-05-09T01:16:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.652+0000 7fc42f222740 1 -- start start 2024-05-09T01:16:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 1 Processor -- start 2024-05-09T01:16:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbb1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7dd4d0 0x557e8dbb15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc40400f8b0 con 0x557e8d7d52f0 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc40400f1e0 con 0x557e8d7dd4d0 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc40400c420 con 0x557e8d7fe1b0 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.653+0000 7fc42f222740 10 client.0 _ll_register_callbacks cb 0x7fc414037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60476/0 (socket says 172.21.15.37:60476) 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 -- 172.21.15.37:0/971258952 learned_addr learned my addr 172.21.15.37:0/971258952 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42610e640 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbb1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 -- 172.21.15.37:0/971258952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7dd4d0 msgr2=0x557e8dbb15d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:16:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7dd4d0 0x557e8dbb15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 -- 172.21.15.37:0/971258952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 msgr2=0x557e8dbb1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbb1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 -- 172.21.15.37:0/971258952 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e8dacaed0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc42690f640 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb2500 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4180acf80 tx=0x7fc418010f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7887c04acea5ba8f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.654+0000 7fc409ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.655+0000 7fc409ffb640 1 -- 172.21.15.37:0/971258952 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4180a96b0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.655+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4180b6130 con 0x557e8d7fe1b0 2024-05-09T01:16:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.655+0000 7fc409ffb640 1 -- 172.21.15.37:0/971258952 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc4180a98c0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.655+0000 7fc409ffb640 1 -- 172.21.15.37:0/971258952 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc4180ce050 con 0x557e8d7fe1b0 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.655+0000 7fc42f222740 10 client.27688 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.655+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557e8dc1be10 con 0x557e8d7fe1b0 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.656+0000 7fc409ffb640 1 -- 172.21.15.37:0/971258952 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4180b6130 con 0x557e8d7fe1b0 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc409ffb640 1 -- 172.21.15.37:0/971258952 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fc4180c7bc0 con 0x557e8d7fe1b0 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc42f222740 10 client.27688 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc42f222740 10 client.27688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc42f222740 20 client.27688 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc42f222740 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7921c0 0x557e8dc1e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc42f222740 4 client.27688 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e8db0e240 con 0x557e8d7921c0 2024-05-09T01:16:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.657+0000 7fc42610e640 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7921c0 0x557e8dc1e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.658+0000 7fc409ffb640 10 client.27688 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.658+0000 7fc42610e640 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7921c0 0x557e8dc1e690 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731fb2367f5d2596 server_cookie=ed04aa0ae6608d70 in_seq=0 out_seq=0 2024-05-09T01:16:25.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.669+0000 7fc409ffb640 1 -- 172.21.15.37:0/971258952 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x557e8db0e240 con 0x557e8d7921c0 2024-05-09T01:16:25.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.669+0000 7fc409ffb640 10 client.27688 handle_command_reply: tid=0 2024-05-09T01:16:25.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.669+0000 7fc42f222740 1 client.27688 shutdown 2024-05-09T01:16:25.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7fe1b0 msgr2=0x557e8dbb2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb2500 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc4180acf80 tx=0x7fc418010f50 comp rx=0 tx=0).stop 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 shutdown_connections 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x557e8d7921c0 0x557e8dc1e690 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e8d7fe1b0 0x557e8dbb2500 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557e8d7dd4d0 0x557e8dbb15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc409ffb640 0 client.27688 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 --2- 172.21.15.37:0/971258952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e8d7d52f0 0x557e8dbb1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 >> 172.21.15.37:0/971258952 conn(0x557e8d7f2300 msgr2=0x557e8dba0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 shutdown_connections 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 1 -- 172.21.15.37:0/971258952 wait complete. 2024-05-09T01:16:25.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.670+0000 7fc42f222740 20 client.27688 trim_cache size 0 max 16384 2024-05-09T01:16:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:16:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:16:25.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc40c0b28d0 msgr2=0x7fc40c0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc40c0b28d0 0x7fc40c0b4de0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc414000c00 tx=0x7fc414009470 comp rx=0 tx=0).stop 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 msgr2=0x7fc42007af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 0x7fc42007af30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc41800fe00 tx=0x7fc41800fef0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 shutdown_connections 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4201105b0 0x7fc42007af30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42010b8b0 0x7fc4201a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc40c0b28d0 0x7fc40c0b4de0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 --2- 172.21.15.37:0/3911043066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc42010a670 0x7fc4201a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 >> 172.21.15.37:0/3911043066 conn(0x7fc420070a90 msgr2=0x7fc42010c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:25.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 shutdown_connections 2024-05-09T01:16:25.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:25.671+0000 7fc428372640 1 -- 172.21.15.37:0/3911043066 wait complete. 2024-05-09T01:16:25.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:16:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:26.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:26 smithi037 ceph-mon[30122]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 545 op/s 2024-05-09T01:16:26.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:26 smithi136 ceph-mon[34110]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 545 op/s 2024-05-09T01:16:26.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:26 smithi151 ceph-mon[34780]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 11 MiB/s wr, 545 op/s 2024-05-09T01:16:28.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 -- 172.21.15.37:0/1993206142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 msgr2=0x7fa478110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 --2- 172.21.15.37:0/1993206142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa478110df0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa47000b0a0 tx=0x7fa47000b3b0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 -- 172.21.15.37:0/1993206142 shutdown_connections 2024-05-09T01:16:28.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 --2- 172.21.15.37:0/1993206142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa478110df0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 --2- 172.21.15.37:0/1993206142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4781054e0 0x7fa4781058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 --2- 172.21.15.37:0/1993206142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 0x7fa47810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 -- 172.21.15.37:0/1993206142 >> 172.21.15.37:0/1993206142 conn(0x7fa4780fedc0 msgr2=0x7fa4781011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 -- 172.21.15.37:0/1993206142 shutdown_connections 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.469+0000 7fa47fd21700 1 -- 172.21.15.37:0/1993206142 wait complete. 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.471+0000 7fa47fd21700 1 Processor -- start 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.471+0000 7fa47fd21700 1 -- start start 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47fd21700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4781054e0 0x7fa47819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47fd21700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 0x7fa47819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47fd21700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa47819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47fd21700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa478114440 con 0x7fa47810e910 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47fd21700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781142c0 con 0x7fa478105e30 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47fd21700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781145c0 con 0x7fa4781054e0 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47e2be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa47819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47d2bc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 0x7fa47819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47d2bc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 0x7fa47819b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43976/0 (socket says 172.21.15.37:43976) 2024-05-09T01:16:28.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47e2be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa47819f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36848/0 (socket says 172.21.15.37:36848) 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47d2bc700 1 -- 172.21.15.37:0/3898478697 learned_addr learned my addr 172.21.15.37:0/3898478697 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47dabd700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4781054e0 0x7fa47819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47e2be700 1 -- 172.21.15.37:0/3898478697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4781054e0 msgr2=0x7fa47819ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47e2be700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4781054e0 0x7fa47819ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47e2be700 1 -- 172.21.15.37:0/3898478697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 msgr2=0x7fa47819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47e2be700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 0x7fa47819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47e2be700 1 -- 172.21.15.37:0/3898478697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47819fc40 con 0x7fa47810e910 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.472+0000 7fa47d2bc700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 0x7fa47819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.473+0000 7fa47e2be700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa47819f5a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d010 tx=0x7fa470004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.473+0000 7fa46effd700 1 -- 172.21.15.37:0/3898478697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470021070 con 0x7fa47810e910 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.473+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47819fed0 con 0x7fa47810e910 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.473+0000 7fa46effd700 1 -- 172.21.15.37:0/3898478697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa470007e30 con 0x7fa47810e910 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.473+0000 7fa46effd700 1 -- 172.21.15.37:0/3898478697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700045a0 con 0x7fa47810e910 2024-05-09T01:16:28.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.473+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4781a7850 con 0x7fa47810e910 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.476+0000 7fa46effd700 1 -- 172.21.15.37:0/3898478697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa470004740 con 0x7fa47810e910 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.476+0000 7fa46effd700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa4640b2880 0x7fa4640b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.477+0000 7fa47dabd700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa4640b2880 0x7fa4640b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.477+0000 7fa46effd700 1 -- 172.21.15.37:0/3898478697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa47000f020 con 0x7fa47810e910 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.477+0000 7fa48e737b80 1 Processor -- start 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.477+0000 7fa47dabd700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa4640b2880 0x7fa4640b4d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa474007be0 tx=0x7fa4740073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.477+0000 7fa48e737b80 1 -- start start 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.477+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecbed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecbf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa48e737b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55978ebdcff0 con 0x55978ecc3400 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa48e737b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55978eb7b7f0 con 0x55978eb3d4a0 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa48e737b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55978ebd8fb0 con 0x55978ec27160 2024-05-09T01:16:28.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36856/0 (socket says 172.21.15.37:36856) 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 -- 172.21.15.37:0/2514199951 learned_addr learned my addr 172.21.15.37:0/2514199951 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47dabd700 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecbed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47d2bc700 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecbf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 -- 172.21.15.37:0/2514199951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 msgr2=0x55978ecbed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecbed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 -- 172.21.15.37:0/2514199951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 msgr2=0x55978ecbf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecbf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 -- 172.21.15.37:0/2514199951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978eb73370 con 0x55978ecc3400 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa47e2be700 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc3810 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa4700a6cb0 tx=0x7fa47000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d631106e859ab7a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa463fff700 1 -- 172.21.15.37:0/2514199951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700b1040 con 0x55978ecc3400 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa463fff700 1 -- 172.21.15.37:0/2514199951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4700cbe50 con 0x55978ecc3400 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.478+0000 7fa463fff700 1 -- 172.21.15.37:0/2514199951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470009cf0 con 0x55978ecc3400 2024-05-09T01:16:28.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.479+0000 7fa48e737b80 1 -- 172.21.15.37:0/2514199951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 msgr2=0x55978ecc3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.479+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc3810 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa4700a6cb0 tx=0x7fa47000b3b0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.479+0000 7fa48e737b80 1 -- 172.21.15.37:0/2514199951 shutdown_connections 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.479+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc3810 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.479+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecbed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.479+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2514199951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecbf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.479+0000 7fa48e737b80 1 -- 172.21.15.37:0/2514199951 >> 172.21.15.37:0/2514199951 conn(0x55978eb9d6a0 msgr2=0x55978ecb5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.480+0000 7fa48e737b80 1 -- 172.21.15.37:0/2514199951 shutdown_connections 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.480+0000 7fa48e737b80 1 -- 172.21.15.37:0/2514199951 wait complete. 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.480+0000 7fa48e737b80 1 -- start start 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.480+0000 7fa48e737b80 1 Processor -- start 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa48e737b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55978ea58ba0 con 0x55978ecc3400 2024-05-09T01:16:28.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa48e737b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55978eb97150 con 0x55978eb3d4a0 2024-05-09T01:16:28.564 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa48e737b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55978ecc3f70 con 0x55978ec27160 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa48e737b80 10 client.0 _ll_register_callbacks cb 0x55978ea4e6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:43996/0 (socket says 172.21.15.37:43996) 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 -- 172.21.15.37:0/1511854086 learned_addr learned my addr 172.21.15.37:0/1511854086 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47e2be700 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47d2bc700 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 -- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 msgr2=0x55978ecce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 -- 172.21.15.37:0/1511854086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 msgr2=0x55978ecc8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.481+0000 7fa47dabd700 1 -- 172.21.15.37:0/1511854086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978ea58490 con 0x55978eb3d4a0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.482+0000 7fa47dabd700 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecce080 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa4740042e0 tx=0x7fa4740047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d203e850b50d308 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.482+0000 7fa4617fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.482+0000 7fa4617fa700 1 -- 172.21.15.37:0/1511854086 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474024070 con 0x55978eb3d4a0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.483+0000 7fa4617fa700 1 -- 172.21.15.37:0/1511854086 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa474003b10 con 0x55978eb3d4a0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.483+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4700cbe50 con 0x55978eb3d4a0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.483+0000 7fa4617fa700 1 -- 172.21.15.37:0/1511854086 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa47402e050 con 0x55978eb3d4a0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.483+0000 7fa48e737b80 10 client.27740 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.483+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55978ecd5d00 con 0x55978eb3d4a0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.484+0000 7fa4617fa700 1 -- 172.21.15.37:0/1511854086 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa474015070 con 0x55978eb3d4a0 2024-05-09T01:16:28.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.484+0000 7fa4617fa700 1 -- 172.21.15.37:0/1511854086 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fa474011440 con 0x55978eb3d4a0 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.484+0000 7fa48e737b80 10 client.27740 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.484+0000 7fa48e737b80 10 client.27740 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.484+0000 7fa48e737b80 20 client.27740 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.484+0000 7fa48e737b80 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ecda7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.485+0000 7fa48e737b80 4 client.27740 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.485+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa4700cbe50 con 0x55978ecd8390 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.485+0000 7fa47d2bc700 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ecda7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.485+0000 7fa47d2bc700 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ecda7f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3bfe4663f58645be server_cookie=7dfea6893ad649bb in_seq=0 out_seq=0 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.485+0000 7fa4617fa700 10 client.27740 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa4617fa700 1 -- 172.21.15.37:0/1511854086 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fa4700cbe50 con 0x55978ecd8390 2024-05-09T01:16:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa4617fa700 10 client.27740 handle_command_reply: tid=0 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 client.27740 shutdown 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 msgr2=0x55978ecce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecce080 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa4740042e0 tx=0x7fa4740047c0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 shutdown_connections 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ecda7f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ecc3400 0x55978ecc8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa4617fa700 0 client.27740 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecce080 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 --2- 172.21.15.37:0/1511854086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ec27160 0x55978ecce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.486+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 >> 172.21.15.37:0/1511854086 conn(0x55978eb9d6a0 msgr2=0x55978ecb51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.487+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 shutdown_connections 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.487+0000 7fa48e737b80 1 -- 172.21.15.37:0/1511854086 wait complete. 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.487+0000 7fa48e737b80 20 client.27740 trim_cache size 0 max 16384 2024-05-09T01:16:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.508+0000 7fa48e737b80 1 Processor -- start 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.512+0000 7fa48e737b80 1 -- start start 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.512+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecc2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.512+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ec27160 0x55978ecdffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.512+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ece04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.513+0000 7fa48e737b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ac990 con 0x55978ec27160 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.513+0000 7fa48e737b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ae4d0 con 0x55978eb3d4a0 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.513+0000 7fa48e737b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ad060 con 0x55978ecc3400 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.516+0000 7fa47d2bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ec27160 0x55978ecdffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.516+0000 7fa47e2be700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ece04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.516+0000 7fa47e2be700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ece04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:60518/0 (socket says 172.21.15.37:60518) 2024-05-09T01:16:28.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.516+0000 7fa47e2be700 1 -- 172.21.15.37:0/2690145957 learned_addr learned my addr 172.21.15.37:0/2690145957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.516+0000 7fa47dabd700 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecc2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.521+0000 7fa47e2be700 1 -- 172.21.15.37:0/2690145957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 msgr2=0x55978ecc2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.521+0000 7fa47e2be700 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecc2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.521+0000 7fa47e2be700 1 -- 172.21.15.37:0/2690145957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ec27160 msgr2=0x55978ecdffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.521+0000 7fa47e2be700 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ec27160 0x55978ecdffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.521+0000 7fa47e2be700 1 -- 172.21.15.37:0/2690145957 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978ecaef60 con 0x55978ecc3400 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.522+0000 7fa47e2be700 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ece04f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bfa0 tx=0x7fa4700b3b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cfeea0233700027 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.524+0000 7fa4637fe700 1 -- 172.21.15.37:0/2690145957 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700b1040 con 0x55978ecc3400 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.524+0000 7fa4637fe700 1 -- 172.21.15.37:0/2690145957 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa470070070 con 0x55978ecc3400 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.524+0000 7fa4637fe700 1 -- 172.21.15.37:0/2690145957 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470009c60 con 0x55978ecc3400 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.525+0000 7fa48e737b80 1 -- 172.21.15.37:0/2690145957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 msgr2=0x55978ece04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ece04f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa47000bfa0 tx=0x7fa4700b3b80 comp rx=0 tx=0).stop 2024-05-09T01:16:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 -- 172.21.15.37:0/2690145957 shutdown_connections 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ece04f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978eb3d4a0 0x55978ecc2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 --2- 172.21.15.37:0/2690145957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978ec27160 0x55978ecdffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 -- 172.21.15.37:0/2690145957 >> 172.21.15.37:0/2690145957 conn(0x55978eb9d6a0 msgr2=0x55978ecc2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 -- 172.21.15.37:0/2690145957 shutdown_connections 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.526+0000 7fa48e737b80 1 -- 172.21.15.37:0/2690145957 wait complete. 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.527+0000 7fa48e737b80 1 -- start start 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.527+0000 7fa48e737b80 1 Processor -- start 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.528+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978eb3d4a0 0x55978eccf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978ec27160 0x55978eccfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa48e737b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ed40b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa48e737b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ade00 con 0x55978eb3d4a0 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa48e737b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781ad730 con 0x55978ec27160 2024-05-09T01:16:28.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa48e737b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781aa9b0 con 0x55978ecc3400 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa47dabd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978eb3d4a0 0x55978eccf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa47dabd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978eb3d4a0 0x55978eccf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36886/0 (socket says 172.21.15.37:36886) 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.529+0000 7fa47dabd700 1 -- 172.21.15.37:0/170596881 learned_addr learned my addr 172.21.15.37:0/170596881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.530+0000 7fa48e737b80 10 client.0 _ll_register_callbacks cb 0x55978ea4e6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.530+0000 7fa47dabd700 1 -- 172.21.15.37:0/170596881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 msgr2=0x55978ed40b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.530+0000 7fa47dabd700 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ed40b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.530+0000 7fa47dabd700 1 -- 172.21.15.37:0/170596881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978ec27160 msgr2=0x55978eccfd60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.530+0000 7fa47dabd700 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978ec27160 0x55978eccfd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.530+0000 7fa47dabd700 1 -- 172.21.15.37:0/170596881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978ed410c0 con 0x55978eb3d4a0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.530+0000 7fa47dabd700 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978eb3d4a0 0x55978eccf820 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa4740042e0 tx=0x7fa474003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4716fed3d10d3327 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.532+0000 7fa4617fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.532+0000 7fa4617fa700 1 -- 172.21.15.37:0/170596881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474024040 con 0x55978eb3d4a0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.532+0000 7fa4617fa700 1 -- 172.21.15.37:0/170596881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa474033850 con 0x55978eb3d4a0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.532+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa470070070 con 0x55978eb3d4a0 2024-05-09T01:16:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.536+0000 7fa4617fa700 1 -- 172.21.15.37:0/170596881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa4740045f0 con 0x55978eb3d4a0 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa48e737b80 10 client.17808 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55978ed42300 con 0x55978eb3d4a0 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa4617fa700 1 -- 172.21.15.37:0/170596881 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa470070070 con 0x55978eb3d4a0 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa4617fa700 1 -- 172.21.15.37:0/170596881 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fa474029710 con 0x55978eb3d4a0 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa48e737b80 10 client.17808 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa48e737b80 10 client.17808 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa48e737b80 20 client.17808 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.537+0000 7fa48e737b80 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ed44a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.538+0000 7fa48e737b80 4 client.17808 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.538+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55978ebea9d0 con 0x55978ecd8390 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.539+0000 7fa47d2bc700 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ed44a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.543+0000 7fa47d2bc700 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ed44a90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e619d6bd3c5e87cb server_cookie=520905c8d492e1d9 in_seq=0 out_seq=0 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.543+0000 7fa4617fa700 10 client.17808 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:16:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.546+0000 7fa4617fa700 1 -- 172.21.15.37:0/170596881 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55978ebea9d0 con 0x55978ecd8390 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.547+0000 7fa4617fa700 10 client.17808 handle_command_reply: tid=0 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.547+0000 7fa48e737b80 1 client.17808 shutdown 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.549+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978eb3d4a0 msgr2=0x55978eccf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.549+0000 7fa48e737b80 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978eb3d4a0 0x55978eccf820 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa4740042e0 tx=0x7fa474003c70 comp rx=0 tx=0).stop 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 shutdown_connections 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x55978ecd8390 0x55978ed44a90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55978ecc3400 0x55978ed40b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55978eb3d4a0 0x55978eccf820 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 --2- 172.21.15.37:0/170596881 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55978ec27160 0x55978eccfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 >> 172.21.15.37:0/170596881 conn(0x55978eb9d6a0 msgr2=0x55978ecc61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa4617fa700 0 client.17808 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:16:28.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 shutdown_connections 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.550+0000 7fa48e737b80 1 -- 172.21.15.37:0/170596881 wait complete. 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.551+0000 7fa48e737b80 20 client.17808 trim_cache size 0 max 16384 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa4640b2880 msgr2=0x7fa4640b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa4640b2880 0x7fa4640b4d90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa474007be0 tx=0x7fa4740073d0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 msgr2=0x7fa47819f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa47819f5a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d010 tx=0x7fa470004d00 comp rx=0 tx=0).stop 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 shutdown_connections 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa4640b2880 0x7fa4640b4d90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa47810e910 0x7fa47819f5a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4781054e0 0x7fa47819ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 --2- 172.21.15.37:0/3898478697 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa478105e30 0x7fa47819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.557+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 >> 172.21.15.37:0/3898478697 conn(0x7fa4780fedc0 msgr2=0x7fa4780ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.558+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 shutdown_connections 2024-05-09T01:16:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:28.558+0000 7fa47fd21700 1 -- 172.21.15.37:0/3898478697 wait complete. 2024-05-09T01:16:28.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:28 smithi037 ceph-mon[30122]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 656 op/s 2024-05-09T01:16:28.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:28 smithi136 ceph-mon[34110]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 656 op/s 2024-05-09T01:16:28.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:28 smithi151 ceph-mon[34780]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 656 op/s 2024-05-09T01:16:29.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:16:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:30.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 850.0 s, 1496.6 tps, lat 66.739 ms stddev 79.928 2024-05-09T01:16:30.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:30 smithi037 ceph-mon[30122]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-05-09T01:16:30.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:30 smithi136 ceph-mon[34110]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-05-09T01:16:30.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:30 smithi151 ceph-mon[34780]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-05-09T01:16:31.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.968+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3094568702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78811d930 msgr2=0x7fc78811fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:31.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.968+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3094568702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78811d930 0x7fc78811fd50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc78001c0d0 tx=0x7fc78001c3e0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.969+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3094568702 shutdown_connections 2024-05-09T01:16:31.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.969+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3094568702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78811d930 0x7fc78811fd50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.969+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3094568702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc78810a930 0x7fc78810ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.969+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3094568702 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78810b280 0x7fc78811d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.969+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3094568702 >> 172.21.15.37:0/3094568702 conn(0x7fc78806f4d0 msgr2=0x7fc78806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:31.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.971+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3094568702 shutdown_connections 2024-05-09T01:16:31.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.973+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3094568702 wait complete. 2024-05-09T01:16:31.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.974+0000 7fc78fb2e700 1 Processor -- start 2024-05-09T01:16:31.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.974+0000 7fc78fb2e700 1 -- start start 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.974+0000 7fc78fb2e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78810a930 0x7fc78811d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.974+0000 7fc78fb2e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc78810b280 0x7fc788119190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.974+0000 7fc78fb2e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78811d930 0x7fc7881196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.975+0000 7fc78fb2e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881153c0 con 0x7fc78810a930 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.975+0000 7fc78fb2e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc788115240 con 0x7fc78811d930 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.975+0000 7fc78fb2e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc788115540 con 0x7fc78810b280 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.975+0000 7fc78e0cb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78811d930 0x7fc7881196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.975+0000 7fc78e0cb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78811d930 0x7fc7881196d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42172/0 (socket says 172.21.15.37:42172) 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.975+0000 7fc78e0cb700 1 -- 172.21.15.37:0/3903518008 learned_addr learned my addr 172.21.15.37:0/3903518008 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:31.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.975+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78810a930 0x7fc78811d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.976+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc78810b280 0x7fc788119190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.976+0000 7fc78d8ca700 1 -- 172.21.15.37:0/3903518008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc78810b280 msgr2=0x7fc788119190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:31.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.976+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc78810b280 0x7fc788119190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.976+0000 7fc78d8ca700 1 -- 172.21.15.37:0/3903518008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78811d930 msgr2=0x7fc7881196d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:31.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.976+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78811d930 0x7fc7881196d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.976+0000 7fc78d8ca700 1 -- 172.21.15.37:0/3903518008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc788119cc0 con 0x7fc78810a930 2024-05-09T01:16:31.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.976+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78811d930 0x7fc7881196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:31.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.977+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78810a930 0x7fc78811d050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc778006fd0 tx=0x7fc77800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:31.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.977+0000 7fc77effd700 1 -- 172.21.15.37:0/3903518008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778015020 con 0x7fc78810a930 2024-05-09T01:16:31.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.977+0000 7fc77effd700 1 -- 172.21.15.37:0/3903518008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc778011ce0 con 0x7fc78810a930 2024-05-09T01:16:31.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.977+0000 7fc77effd700 1 -- 172.21.15.37:0/3903518008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778010ce0 con 0x7fc78810a930 2024-05-09T01:16:31.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.977+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc788119fb0 con 0x7fc78810a930 2024-05-09T01:16:31.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.977+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7881adbe0 con 0x7fc78810a930 2024-05-09T01:16:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.983+0000 7fc79e544b80 1 Processor -- start 2024-05-09T01:16:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.983+0000 7fc79e544b80 1 -- start start 2024-05-09T01:16:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.983+0000 7fc77effd700 1 -- 172.21.15.37:0/3903518008 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc778018020 con 0x7fc78810a930 2024-05-09T01:16:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82750d00 0x556d82859240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d82859780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82853810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc78e0cb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82750d00 0x556d82859240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc78e0cb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82750d00 0x556d82859240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39936/0 (socket says 172.21.15.37:39936) 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc78e0cb700 1 -- 172.21.15.37:0/3332705213 learned_addr learned my addr 172.21.15.37:0/3332705213 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556d827760a0 con 0x556d82750d00 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556d8271b9a0 con 0x556d826d64a0 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.984+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556d82772060 con 0x556d82853400 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82853810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d82859780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc77effd700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7740b2a90 0x7fc7740b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78e0cb700 1 -- 172.21.15.37:0/3332705213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 msgr2=0x556d82853810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:31.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82853810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78e0cb700 1 -- 172.21.15.37:0/3332705213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 msgr2=0x556d82859780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:31.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d82859780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78e0cb700 1 -- 172.21.15.37:0/3332705213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d8270c500 con 0x556d82750d00 2024-05-09T01:16:31.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.985+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82853810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:31.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.986+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7740b2a90 0x7fc7740b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.987+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7740b2a90 0x7fc7740b4fa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc78001a910 tx=0x7fc78001c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.987+0000 7fc77effd700 1 -- 172.21.15.37:0/3903518008 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc7780e18d0 con 0x7fc78810a930 2024-05-09T01:16:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.988+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82750d00 0x556d82859240 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc780003ab0 tx=0x7fc780003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544cffc04522cc37 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.988+0000 7fc773fff700 1 -- 172.21.15.37:0/3332705213 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780018ce0 con 0x556d82750d00 2024-05-09T01:16:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.988+0000 7fc773fff700 1 -- 172.21.15.37:0/3332705213 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc780005590 con 0x556d82750d00 2024-05-09T01:16:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.988+0000 7fc773fff700 1 -- 172.21.15.37:0/3332705213 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc780038820 con 0x556d82750d00 2024-05-09T01:16:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.989+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82750d00 msgr2=0x556d82859240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.989+0000 7fc79e544b80 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82750d00 0x556d82859240 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc780003ab0 tx=0x7fc780003ae0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.989+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 shutdown_connections 2024-05-09T01:16:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.989+0000 7fc79e544b80 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82853810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.989+0000 7fc79e544b80 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82750d00 0x556d82859240 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.989+0000 7fc79e544b80 1 --2- 172.21.15.37:0/3332705213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d82859780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.989+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 >> 172.21.15.37:0/3332705213 conn(0x556d826d9f70 msgr2=0x556d8284e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.990+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 shutdown_connections 2024-05-09T01:16:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.990+0000 7fc79e544b80 1 -- 172.21.15.37:0/3332705213 wait complete. 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.990+0000 7fc79e544b80 1 -- start start 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.990+0000 7fc79e544b80 1 Processor -- start 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d8285d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d8285d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d8285db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc79e544b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556d82854150 con 0x556d826d64a0 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc79e544b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556d82710b20 con 0x556d82750d00 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc79e544b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556d82860020 con 0x556d82853400 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc79e544b80 10 client.0 _ll_register_callbacks cb 0x556d825e76c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc78d8ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d8285d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc78d8ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d8285d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39946/0 (socket says 172.21.15.37:39946) 2024-05-09T01:16:31.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.991+0000 7fc78d8ca700 1 -- 172.21.15.37:0/2636058847 learned_addr learned my addr 172.21.15.37:0/2636058847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d8285db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d8285d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78d8ca700 1 -- 172.21.15.37:0/2636058847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 msgr2=0x556d8285db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d8285db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78d8ca700 1 -- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 msgr2=0x556d8285d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d8285d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78d8ca700 1 -- 172.21.15.37:0/2636058847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d825f1490 con 0x556d826d64a0 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d8285d080 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc778009fd0 tx=0x7fc7780a8970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fac1b7a39d2103d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.993+0000 7fc7717fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:16:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.996+0000 7fc7717fa700 1 -- 172.21.15.37:0/2636058847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780a8660 con 0x556d826d64a0 2024-05-09T01:16:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.996+0000 7fc7717fa700 1 -- 172.21.15.37:0/2636058847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc7780a8150 con 0x556d826d64a0 2024-05-09T01:16:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.996+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc780005590 con 0x556d826d64a0 2024-05-09T01:16:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.996+0000 7fc7717fa700 1 -- 172.21.15.37:0/2636058847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc778010380 con 0x556d826d64a0 2024-05-09T01:16:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.996+0000 7fc79e544b80 10 client.17820 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.996+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x556d8286aac0 con 0x556d826d64a0 2024-05-09T01:16:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.996+0000 7fc7717fa700 1 -- 172.21.15.37:0/2636058847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc780005590 con 0x556d826d64a0 2024-05-09T01:16:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.997+0000 7fc7717fa700 1 -- 172.21.15.37:0/2636058847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fc7780a7bc0 con 0x556d826d64a0 2024-05-09T01:16:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.997+0000 7fc79e544b80 10 client.17820 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:31.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.997+0000 7fc79e544b80 10 client.17820 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:16:31.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.997+0000 7fc79e544b80 20 client.17820 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:31.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.997+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d8286d100 0x556d8286f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:31.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.997+0000 7fc79e544b80 4 client.17820 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:31.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.997+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d82783a80 con 0x556d8286d100 2024-05-09T01:16:31.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.998+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d8286d100 0x556d8286f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:31.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.999+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d8286d100 0x556d8286f520 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d36d826ba7681eef server_cookie=1f7a86344c180a9e in_seq=0 out_seq=0 2024-05-09T01:16:31.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:31.999+0000 7fc7717fa700 10 client.17820 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:16:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.000+0000 7fc7717fa700 1 -- 172.21.15.37:0/2636058847 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556d82783a80 con 0x556d8286d100 2024-05-09T01:16:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.000+0000 7fc7717fa700 10 client.17820 handle_command_reply: tid=0 2024-05-09T01:16:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.001+0000 7fc79e544b80 1 client.17820 shutdown 2024-05-09T01:16:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.001+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 msgr2=0x556d8285d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.001+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d8285d080 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc778009fd0 tx=0x7fc7780a8970 comp rx=0 tx=0).stop 2024-05-09T01:16:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 shutdown_connections 2024-05-09T01:16:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d8285db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d8286d100 0x556d8286f520 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d8285d080 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2636058847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d8285d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 >> 172.21.15.37:0/2636058847 conn(0x556d826d9f70 msgr2=0x556d82847ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:32.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc7717fa700 0 client.17820 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:16:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 shutdown_connections 2024-05-09T01:16:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 1 -- 172.21.15.37:0/2636058847 wait complete. 2024-05-09T01:16:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.003+0000 7fc79e544b80 20 client.17820 trim_cache size 0 max 16384 2024-05-09T01:16:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.028+0000 7fc79e544b80 1 Processor -- start 2024-05-09T01:16:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.028+0000 7fc79e544b80 1 -- start start 2024-05-09T01:16:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d8285c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82750d00 0x556d82874b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82853400 0x556d828750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc79e544b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b4fb0 con 0x556d82853400 2024-05-09T01:16:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc79e544b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b6af0 con 0x556d826d64a0 2024-05-09T01:16:32.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d8285c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:32.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc79e544b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b5680 con 0x556d82750d00 2024-05-09T01:16:32.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d8285c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42196/0 (socket says 172.21.15.37:42196) 2024-05-09T01:16:32.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 -- 172.21.15.37:0/1791062118 learned_addr learned my addr 172.21.15.37:0/1791062118 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:32.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82853400 0x556d828750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:32.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82750d00 0x556d82874b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 -- 172.21.15.37:0/1791062118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82750d00 msgr2=0x556d82874b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82750d00 0x556d82874b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 -- 172.21.15.37:0/1791062118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82853400 msgr2=0x556d828750c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82853400 0x556d828750c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.029+0000 7fc78d8ca700 1 -- 172.21.15.37:0/1791062118 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d8285ce50 con 0x556d826d64a0 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.030+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d8285c080 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc77800bb30 tx=0x7fc77800bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48223b975e64cf3c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.030+0000 7fc7737fe700 1 -- 172.21.15.37:0/1791062118 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780a8ef0 con 0x556d826d64a0 2024-05-09T01:16:32.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.030+0000 7fc7737fe700 1 -- 172.21.15.37:0/1791062118 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7780c7070 con 0x556d826d64a0 2024-05-09T01:16:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.030+0000 7fc7737fe700 1 -- 172.21.15.37:0/1791062118 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780a4860 con 0x556d826d64a0 2024-05-09T01:16:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.031+0000 7fc79e544b80 1 -- 172.21.15.37:0/1791062118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 msgr2=0x556d8285c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.032+0000 7fc79e544b80 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d8285c080 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc77800bb30 tx=0x7fc77800bf70 comp rx=0 tx=0).stop 2024-05-09T01:16:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.033+0000 7fc79e544b80 1 -- 172.21.15.37:0/1791062118 shutdown_connections 2024-05-09T01:16:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.033+0000 7fc79e544b80 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d82853400 0x556d828750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.034+0000 7fc79e544b80 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d826d64a0 0x556d8285c080 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.034+0000 7fc79e544b80 1 --2- 172.21.15.37:0/1791062118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82750d00 0x556d82874b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.034+0000 7fc79e544b80 1 -- 172.21.15.37:0/1791062118 >> 172.21.15.37:0/1791062118 conn(0x556d826d9f70 msgr2=0x556d8285b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.034+0000 7fc79e544b80 1 -- 172.21.15.37:0/1791062118 shutdown_connections 2024-05-09T01:16:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.034+0000 7fc79e544b80 1 -- 172.21.15.37:0/1791062118 wait complete. 2024-05-09T01:16:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.034+0000 7fc79e544b80 1 -- start start 2024-05-09T01:16:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 1 Processor -- start 2024-05-09T01:16:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d82864ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d828653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82873b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b6420 con 0x556d826d64a0 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b5d50 con 0x556d82750d00 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc7881b2f70 con 0x556d82853400 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc79e544b80 10 client.0 _ll_register_callbacks cb 0x556d825e76c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc78d0c9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d828653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc78d8ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d82864ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc78e0cb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82873b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc78d0c9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d828653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42210/0 (socket says 172.21.15.37:42210) 2024-05-09T01:16:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.035+0000 7fc78d0c9700 1 -- 172.21.15.37:0/2548323066 learned_addr learned my addr 172.21.15.37:0/2548323066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78d0c9700 1 -- 172.21.15.37:0/2548323066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 msgr2=0x556d82873b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82873b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78d0c9700 1 -- 172.21.15.37:0/2548323066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 msgr2=0x556d82864ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d82864ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78d0c9700 1 -- 172.21.15.37:0/2548323066 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d82865920 con 0x556d82750d00 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d82864ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78e0cb700 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82873b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc78d0c9700 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d828653e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc78806feb0 tx=0x7fc78400d9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc048e85ee4336e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc7717fa700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc7717fa700 1 -- 172.21.15.37:0/2548323066 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784003a90 con 0x556d82750d00 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc7717fa700 1 -- 172.21.15.37:0/2548323066 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fc784003c30 con 0x556d82750d00 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.036+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7780c7070 con 0x556d82750d00 2024-05-09T01:16:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc7717fa700 1 -- 172.21.15.37:0/2548323066 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fc784003e30 con 0x556d82750d00 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 10 client.27758 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x556d828d6b30 con 0x556d82750d00 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc7717fa700 1 -- 172.21.15.37:0/2548323066 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7780c7070 con 0x556d82750d00 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc7717fa700 1 -- 172.21.15.37:0/2548323066 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fc784022020 con 0x556d82750d00 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 10 client.27758 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 10 client.27758 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 20 client.27758 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d828d72a0 0x556d828d96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 4 client.27758 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d8277db20 con 0x556d828d72a0 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.037+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d828d72a0 0x556d828d96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.038+0000 7fc7717fa700 10 client.27758 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.038+0000 7fc78d8ca700 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d828d72a0 0x556d828d96c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32e03375ef24f998 server_cookie=e8b36f3b95cd5a87 in_seq=0 out_seq=0 2024-05-09T01:16:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.038+0000 7fc7717fa700 1 -- 172.21.15.37:0/2548323066 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d8277db20 con 0x556d828d72a0 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.038+0000 7fc7717fa700 10 client.27758 handle_command_reply: tid=0 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.038+0000 7fc79e544b80 1 client.27758 shutdown 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 msgr2=0x556d828653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d828653e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc78806feb0 tx=0x7fc78400d9a0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 shutdown_connections 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d82853400 0x556d82873b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x556d828d72a0 0x556d828d96c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556d826d64a0 0x556d82864ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 --2- 172.21.15.37:0/2548323066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556d82750d00 0x556d828653e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 >> 172.21.15.37:0/2548323066 conn(0x556d826d9f70 msgr2=0x556d8285b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc7717fa700 0 client.27758 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 shutdown_connections 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 1 -- 172.21.15.37:0/2548323066 wait complete. 2024-05-09T01:16:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.039+0000 7fc79e544b80 20 client.27758 trim_cache size 0 max 16384 2024-05-09T01:16:32.043 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7740b2a90 msgr2=0x7fc7740b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7740b2a90 0x7fc7740b4fa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc78001a910 tx=0x7fc78001c040 comp rx=0 tx=0).stop 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78810a930 msgr2=0x7fc78811d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78810a930 0x7fc78811d050 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc778006fd0 tx=0x7fc77800b730 comp rx=0 tx=0).stop 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 shutdown_connections 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fc7740b2a90 0x7fc7740b4fa0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc78811d930 0x7fc7881196d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc78810a930 0x7fc78811d050 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 --2- 172.21.15.37:0/3903518008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc78810b280 0x7fc788119190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 >> 172.21.15.37:0/3903518008 conn(0x7fc78806f4d0 msgr2=0x7fc78811dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 shutdown_connections 2024-05-09T01:16:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:32.040+0000 7fc78fb2e700 1 -- 172.21.15.37:0/3903518008 wait complete. 2024-05-09T01:16:32.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:32 smithi037 ceph-mon[30122]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 651 op/s 2024-05-09T01:16:32.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:32 smithi136 ceph-mon[34110]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 651 op/s 2024-05-09T01:16:32.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:32 smithi151 ceph-mon[34780]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 651 op/s 2024-05-09T01:16:33.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:16:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:34.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:34 smithi136 ceph-mon[34110]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 586 op/s 2024-05-09T01:16:34.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:34 smithi037 ceph-mon[30122]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 586 op/s 2024-05-09T01:16:34.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:34 smithi151 ceph-mon[34780]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 MiB/s wr, 586 op/s 2024-05-09T01:16:35.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 855.0 s, 1477.8 tps, lat 68.487 ms stddev 74.058 2024-05-09T01:16:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.474+0000 7f3d40a03700 1 -- 172.21.15.37:0/1690939629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d3c11d930 msgr2=0x7f3d3c11fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.474+0000 7f3d40a03700 1 --2- 172.21.15.37:0/1690939629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d3c11d930 0x7f3d3c11fd50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400b0a0 tx=0x7f3d3400b3b0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.474+0000 7f3d40a03700 1 -- 172.21.15.37:0/1690939629 shutdown_connections 2024-05-09T01:16:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.474+0000 7f3d40a03700 1 --2- 172.21.15.37:0/1690939629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d3c11d930 0x7f3d3c11fd50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.474+0000 7f3d40a03700 1 --2- 172.21.15.37:0/1690939629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c10a7c0 0x7f3d3c10abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.474+0000 7f3d40a03700 1 --2- 172.21.15.37:0/1690939629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10b110 0x7f3d3c11d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.474+0000 7f3d40a03700 1 -- 172.21.15.37:0/1690939629 >> 172.21.15.37:0/1690939629 conn(0x7f3d3c06f290 msgr2=0x7f3d3c06f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.478+0000 7f3d40a03700 1 -- 172.21.15.37:0/1690939629 shutdown_connections 2024-05-09T01:16:35.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.479+0000 7f3d40a03700 1 -- 172.21.15.37:0/1690939629 wait complete. 2024-05-09T01:16:35.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.481+0000 7f3d40a03700 1 Processor -- start 2024-05-09T01:16:35.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.481+0000 7f3d40a03700 1 -- start start 2024-05-09T01:16:35.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.481+0000 7f3d40a03700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10a7c0 0x7f3d3c1af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.481+0000 7f3d40a03700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d3c10b110 0x7f3d3c1afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.481+0000 7f3d40a03700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c11d930 0x7f3d3c1a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.481+0000 7f3d40a03700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c123150 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.482+0000 7f3d40a03700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c122fd0 con 0x7f3d3c11d930 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.482+0000 7f3d40a03700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1232d0 con 0x7f3d3c10b110 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.482+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10a7c0 0x7f3d3c1af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10a7c0 0x7f3d3c1af6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39986/0 (socket says 172.21.15.37:39986) 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/3493616013 learned_addr learned my addr 172.21.15.37:0/3493616013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3b59e700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c11d930 0x7f3d3c1a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/3493616013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d3c10b110 msgr2=0x7f3d3c1afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d3c10b110 0x7f3d3c1afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/3493616013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c11d930 msgr2=0x7f3d3c1a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c11d930 0x7f3d3c1a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.483+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/3493616013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c1a9fe0 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.484+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10a7c0 0x7f3d3c1af6f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000b530 tx=0x7f3d3000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.484+0000 7f3d23fff700 1 -- 172.21.15.37:0/3493616013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30015020 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.484+0000 7f3d23fff700 1 -- 172.21.15.37:0/3493616013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d30011ce0 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.484+0000 7f3d23fff700 1 -- 172.21.15.37:0/3493616013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30010dd0 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.484+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c1aa2d0 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.484+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c112bd0 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 Processor -- start 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 -- start start 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471fc160 0x564647295640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647295b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x56464728fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5646471b1ff0 con 0x5646471124a0 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5646471507f0 con 0x5646471fc160 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5646471adfb0 con 0x56464728f800 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d3b59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471fc160 0x564647295640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.491+0000 7f3d3b59e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471fc160 0x564647295640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42232/0 (socket says 172.21.15.37:42232) 2024-05-09T01:16:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3b59e700 1 -- 172.21.15.37:0/2193201665 learned_addr learned my addr 172.21.15.37:0/2193201665 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:35.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x56464728fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3a59c700 1 -- 172.21.15.37:0/2193201665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471fc160 msgr2=0x564647295640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471fc160 0x564647295640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3a59c700 1 -- 172.21.15.37:0/2193201665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 msgr2=0x564647295b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:16:35.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647295b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3a59c700 1 -- 172.21.15.37:0/2193201665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564647148370 con 0x56464728f800 2024-05-09T01:16:35.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.492+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x56464728fc10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c11ce90 tx=0x7f3d2c009aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=266f4da410e80821 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:35.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.493+0000 7f3d217fa700 1 -- 172.21.15.37:0/2193201665 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c015020 con 0x56464728f800 2024-05-09T01:16:35.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.493+0000 7f3d217fa700 1 -- 172.21.15.37:0/2193201665 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d2c011ce0 con 0x56464728f800 2024-05-09T01:16:35.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.493+0000 7f3d217fa700 1 -- 172.21.15.37:0/2193201665 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c015020 con 0x56464728f800 2024-05-09T01:16:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.494+0000 7f3d23fff700 1 -- 172.21.15.37:0/3493616013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3d30018020 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.494+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2193201665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 msgr2=0x56464728fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.494+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x56464728fc10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c11ce90 tx=0x7f3d2c009aa0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2193201665 shutdown_connections 2024-05-09T01:16:35.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x56464728fc10 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471fc160 0x564647295640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2193201665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647295b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2193201665 >> 172.21.15.37:0/2193201665 conn(0x5646471726a0 msgr2=0x56464728a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2193201665 shutdown_connections 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2193201665 wait complete. 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.495+0000 7f3d4fc1ab80 1 -- start start 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d4fc1ab80 1 Processor -- start 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d23fff700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d240b28f0 0x7f3d240b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d23fff700 1 -- 172.21.15.37:0/3493616013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3d300e18e0 con 0x7f3d3c10a7c0 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647299480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471fc160 0x5646472999c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 0x564647299f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647299480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56464702dba0 con 0x5646471124a0 2024-05-09T01:16:35.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56464716c150 con 0x56464728f800 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647299480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39992/0 (socket says 172.21.15.37:39992) 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5646472905f0 con 0x5646471fc160 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.496+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/339970858 learned_addr learned my addr 172.21.15.37:0/339970858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471fc160 0x5646472999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d4fc1ab80 10 client.0 _ll_register_callbacks cb 0x5646470236c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3a59c700 1 -- 172.21.15.37:0/339970858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 msgr2=0x564647299f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3b59e700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d240b28f0 0x7f3d240b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 0x564647299f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3a59c700 1 -- 172.21.15.37:0/339970858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 msgr2=0x564647299480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647299480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3a59c700 1 -- 172.21.15.37:0/339970858 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464702d490 con 0x5646471fc160 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647299480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471fc160 0x5646472999c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c11ce90 tx=0x7f3d2c0105b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b55b92c7c8978d08 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:35.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.497+0000 7f3d1eff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d1eff5700 1 -- 172.21.15.37:0/339970858 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c027060 con 0x5646471fc160 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d1eff5700 1 -- 172.21.15.37:0/339970858 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3d2c011630 con 0x5646471fc160 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d2c011ce0 con 0x5646471fc160 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d3b59e700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d240b28f0 0x7f3d240b4e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400b0a0 tx=0x7f3d34009780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d1eff5700 1 -- 172.21.15.37:0/339970858 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3d2c015020 con 0x5646471fc160 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d4fc1ab80 10 client.27724 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5646472a6d70 con 0x5646471fc160 2024-05-09T01:16:35.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.498+0000 7f3d1eff5700 1 -- 172.21.15.37:0/339970858 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d2c011ce0 con 0x5646471fc160 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d1eff5700 1 -- 172.21.15.37:0/339970858 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f3d2c02c070 con 0x5646471fc160 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d4fc1ab80 10 client.27724 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d4fc1ab80 10 client.27724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d4fc1ab80 20 client.27724 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5646472a9240 0x5646472ab660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d4fc1ab80 4 client.27724 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646471bf9d0 con 0x5646472a9240 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.499+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5646472a9240 0x5646472ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.500+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5646472a9240 0x5646472ab660 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de0ff76f5c3f0900 server_cookie=1a5a4503cfa8b4 in_seq=0 out_seq=0 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.500+0000 7f3d1eff5700 10 client.27724 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.500+0000 7f3d1eff5700 1 -- 172.21.15.37:0/339970858 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5646471bf9d0 con 0x5646472a9240 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.500+0000 7f3d1eff5700 10 client.27724 handle_command_reply: tid=0 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 client.27724 shutdown 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471fc160 msgr2=0x5646472999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471fc160 0x5646472999c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c11ce90 tx=0x7f3d2c0105b0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 shutdown_connections 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5646472a9240 0x5646472ab660 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 0x564647299f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5646471124a0 0x564647299480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/339970858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471fc160 0x5646472999c0 secure :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c11ce90 tx=0x7f3d2c0105b0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 >> 172.21.15.37:0/339970858 conn(0x5646471726a0 msgr2=0x56464728a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.501+0000 7f3d1eff5700 0 client.27724 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.504+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 shutdown_connections 2024-05-09T01:16:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.504+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/339970858 wait complete. 2024-05-09T01:16:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.504+0000 7f3d4fc1ab80 20 client.27724 trim_cache size 0 max 16384 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.526+0000 7f3d4fc1ab80 1 Processor -- start 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.526+0000 7f3d4fc1ab80 1 -- start start 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471124a0 0x564647299d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 0x5646472a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c119e00 con 0x564647298480 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1c7af0 con 0x56464728f800 2024-05-09T01:16:35.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c11a4d0 con 0x5646471124a0 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471124a0 0x564647299d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471124a0 0x564647299d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40474/0 (socket says 172.21.15.37:40474) 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2496191960 learned_addr learned my addr 172.21.15.37:0/2496191960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.527+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 0x5646472a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d3b59e700 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2496191960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 msgr2=0x5646472a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 0x5646472a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2496191960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 msgr2=0x5646472a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2496191960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464729bd20 con 0x5646471124a0 2024-05-09T01:16:35.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471124a0 0x564647299d40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3d300df4d0 tx=0x7f3d300df350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7881323d720fc221 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.528+0000 7f3d20ff9700 1 -- 172.21.15.37:0/2496191960 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d300ad350 con 0x5646471124a0 2024-05-09T01:16:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.529+0000 7f3d20ff9700 1 -- 172.21.15.37:0/2496191960 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d300b1e00 con 0x5646471124a0 2024-05-09T01:16:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.529+0000 7f3d20ff9700 1 -- 172.21.15.37:0/2496191960 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d300b1bd0 con 0x5646471124a0 2024-05-09T01:16:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.529+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2496191960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471124a0 msgr2=0x564647299d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.529+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471124a0 0x564647299d40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3d300df4d0 tx=0x7f3d300df350 comp rx=0 tx=0).stop 2024-05-09T01:16:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2496191960 shutdown_connections 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646471124a0 0x564647299d40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2496191960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56464728f800 0x5646472a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2496191960 >> 172.21.15.37:0/2496191960 conn(0x5646471726a0 msgr2=0x564647297d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2496191960 shutdown_connections 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2496191960 wait complete. 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.530+0000 7f3d4fc1ab80 1 -- start start 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 1 Processor -- start 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471124a0 0x5646472a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x5646472b0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c1c7590 con 0x564647298480 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c11aba0 con 0x5646471124a0 2024-05-09T01:16:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c117e20 con 0x56464728f800 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d4fc1ab80 10 client.0 _ll_register_callbacks cb 0x56464728a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471124a0 0x5646472a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d3ad9d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471124a0 0x5646472a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42252/0 (socket says 172.21.15.37:42252) 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2424911970 learned_addr learned my addr 172.21.15.37:0/2424911970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x5646472b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.531+0000 7f3d3b59e700 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2424911970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 msgr2=0x5646472b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x5646472b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2424911970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 msgr2=0x5646472b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d3ad9d700 1 -- 172.21.15.37:0/2424911970 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646472b0bc0 con 0x5646471124a0 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d3ad9d700 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471124a0 0x5646472a1850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000b500 tx=0x7f3d300106d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19c78fd69287bbf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d1eff5700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d1eff5700 1 -- 172.21.15.37:0/2424911970 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d300c7070 con 0x5646471124a0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d1eff5700 1 -- 172.21.15.37:0/2424911970 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f3d300b1b70 con 0x5646471124a0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.532+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d300b1e00 con 0x5646471124a0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d1eff5700 1 -- 172.21.15.37:0/2424911970 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3d300be0a0 con 0x5646471124a0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 10 client.27767 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564647313500 con 0x5646471124a0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d1eff5700 1 -- 172.21.15.37:0/2424911970 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d300b1e00 con 0x5646471124a0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d1eff5700 1 -- 172.21.15.37:0/2424911970 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f3d300a4a30 con 0x5646471124a0 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 10 client.27767 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 10 client.27767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 20 client.27767 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564647313b00 0x564647315f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 4 client.27767 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.533+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646471b9a70 con 0x564647313b00 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.534+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564647313b00 0x564647315f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.535+0000 7f3d3a59c700 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564647313b00 0x564647315f20 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9eacaf963dc607 server_cookie=a2bfa0691a7ccd7b in_seq=0 out_seq=0 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.535+0000 7f3d1eff5700 10 client.27767 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.535+0000 7f3d1eff5700 1 -- 172.21.15.37:0/2424911970 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646471b9a70 con 0x564647313b00 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.535+0000 7f3d1eff5700 10 client.27767 handle_command_reply: tid=0 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.535+0000 7f3d4fc1ab80 1 client.27767 shutdown 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471124a0 msgr2=0x5646472a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471124a0 0x5646472a1850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000b500 tx=0x7f3d300106d0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 shutdown_connections 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x564647313b00 0x564647315f20 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564647298480 0x5646472b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5646471124a0 0x5646472a1850 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 --2- 172.21.15.37:0/2424911970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56464728f800 0x5646472b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 >> 172.21.15.37:0/2424911970 conn(0x5646471726a0 msgr2=0x564647294570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d1eff5700 0 client.27767 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 shutdown_connections 2024-05-09T01:16:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 1 -- 172.21.15.37:0/2424911970 wait complete. 2024-05-09T01:16:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.536+0000 7f3d4fc1ab80 20 client.27767 trim_cache size 0 max 16384 2024-05-09T01:16:35.539 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:16:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d240b28f0 msgr2=0x7f3d240b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d240b28f0 0x7f3d240b4e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400b0a0 tx=0x7f3d34009780 comp rx=0 tx=0).stop 2024-05-09T01:16:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10a7c0 msgr2=0x7f3d3c1af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10a7c0 0x7f3d3c1af6f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000b530 tx=0x7f3d3000b8f0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 shutdown_connections 2024-05-09T01:16:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f3d240b28f0 0x7f3d240b4e00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c11d930 0x7f3d3c1a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d3c10a7c0 0x7f3d3c1af6f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 --2- 172.21.15.37:0/3493616013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d3c10b110 0x7f3d3c1afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:35.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.537+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 >> 172.21.15.37:0/3493616013 conn(0x7f3d3c06f290 msgr2=0x7f3d3c11b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:35.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.538+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 shutdown_connections 2024-05-09T01:16:35.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:35.538+0000 7f3d40a03700 1 -- 172.21.15.37:0/3493616013 wait complete. 2024-05-09T01:16:36.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:36 smithi136 ceph-mon[34110]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.8 MiB/s wr, 565 op/s 2024-05-09T01:16:36.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:36 smithi037 ceph-mon[30122]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.8 MiB/s wr, 565 op/s 2024-05-09T01:16:36.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:36 smithi151 ceph-mon[34780]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 9.8 MiB/s wr, 565 op/s 2024-05-09T01:16:37.269 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T01:16:37.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T01:16:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:38.780 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:38 smithi037 ceph-mon[30122]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 MiB/s wr, 680 op/s 2024-05-09T01:16:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 -- 172.21.15.37:0/2403219841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0103d90 msgr2=0x7f44f01041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 --2- 172.21.15.37:0/2403219841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0103d90 0x7f44f01041a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009900 tx=0x7f44e402a410 comp rx=0 tx=0).stop 2024-05-09T01:16:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 -- 172.21.15.37:0/2403219841 shutdown_connections 2024-05-09T01:16:38.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 --2- 172.21.15.37:0/2403219841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44f0108a90 0x7f44f010aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 --2- 172.21.15.37:0/2403219841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0103d90 0x7f44f01041a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 --2- 172.21.15.37:0/2403219841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f0102b50 0x7f44f0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 -- 172.21.15.37:0/2403219841 >> 172.21.15.37:0/2403219841 conn(0x7f44f00fdd40 msgr2=0x7f44f01001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 -- 172.21.15.37:0/2403219841 shutdown_connections 2024-05-09T01:16:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.810+0000 7f44f607e640 1 -- 172.21.15.37:0/2403219841 wait complete. 2024-05-09T01:16:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.811+0000 7f44f607e640 1 Processor -- start 2024-05-09T01:16:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.811+0000 7f44f607e640 1 -- start start 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44f607e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102b50 0x7f44f019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44f607e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44f0103d90 0x7f44f019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44f607e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f0108a90 0x7f44f01a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44f607e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44f010e670 con 0x7f44f0102b50 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44f607e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f44f010e4f0 con 0x7f44f0103d90 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44f607e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44f010e7f0 con 0x7f44f0108a90 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102b50 0x7f44f019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102b50 0x7f44f019a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40036/0 (socket says 172.21.15.37:40036) 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44ef7fe640 1 -- 172.21.15.37:0/4145119519 learned_addr learned my addr 172.21.15.37:0/4145119519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44eeffd640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44f0103d90 0x7f44f019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44effff640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f0108a90 0x7f44f01a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44eeffd640 1 -- 172.21.15.37:0/4145119519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f0108a90 msgr2=0x7f44f01a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44eeffd640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f0108a90 0x7f44f01a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44eeffd640 1 -- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102b50 msgr2=0x7f44f019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44eeffd640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102b50 0x7f44f019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44eeffd640 1 -- 172.21.15.37:0/4145119519 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f01a1ed0 con 0x7f44f0103d90 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102b50 0x7f44f019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.812+0000 7f44eeffd640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44f0103d90 0x7f44f019a8d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006010 tx=0x7f44e4031a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.813+0000 7f44ecff9640 1 -- 172.21.15.37:0/4145119519 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e403f070 con 0x7f44f0103d90 2024-05-09T01:16:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.813+0000 7f44ecff9640 1 -- 172.21.15.37:0/4145119519 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44e4003ca0 con 0x7f44f0103d90 2024-05-09T01:16:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.813+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f01a2160 con 0x7f44f0103d90 2024-05-09T01:16:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.813+0000 7f44ecff9640 1 -- 172.21.15.37:0/4145119519 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e4035070 con 0x7f44f0103d90 2024-05-09T01:16:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.813+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f01a25e0 con 0x7f44f0103d90 2024-05-09T01:16:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.815+0000 7f44ecff9640 1 -- 172.21.15.37:0/4145119519 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f44e4043400 con 0x7f44f0103d90 2024-05-09T01:16:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 Processor -- start 2024-05-09T01:16:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 -- start start 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0eb0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eb0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eb7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e0c0e147c0 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e0c0db00e0 con 0x55e0c0aeb4d0 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44fd008740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e0c0e10780 con 0x55e0c0ae32f0 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0eb0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0eb0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40038/0 (socket says 172.21.15.37:40038) 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44effff640 1 -- 172.21.15.37:0/3317359149 learned_addr learned my addr 172.21.15.37:0/3317359149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eb0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44eeffd640 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eb7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.816+0000 7f44ecff9640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f44d80b2860 0x7f44d80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44effff640 1 -- 172.21.15.37:0/3317359149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 msgr2=0x55e0c0eb0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44effff640 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eb0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44effff640 1 -- 172.21.15.37:0/3317359149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 msgr2=0x55e0c0eb7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44effff640 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eb7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44effff640 1 -- 172.21.15.37:0/3317359149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0c0dd97c0 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eb0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44effff640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f44d80b2860 0x7f44d80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44ecff9640 1 -- 172.21.15.37:0/4145119519 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f44e41026a0 con 0x7f44f0103d90 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44effff640 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0eb0500 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f44e8010510 tx=0x7f44e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699729415fd025fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44d5ffb640 1 -- 172.21.15.37:0/3317359149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e801d910 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44d5ffb640 1 -- 172.21.15.37:0/3317359149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44e801c440 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.817+0000 7f44d5ffb640 1 -- 172.21.15.37:0/3317359149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e801b5d0 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 -- 172.21.15.37:0/3317359149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 msgr2=0x55e0c0eb0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0eb0500 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f44e8010510 tx=0x7f44e8009f90 comp rx=0 tx=0).stop 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44effff640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f44d80b2860 0x7f44d80b4d70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f44e8021000 tx=0x7f44e801e000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 -- 172.21.15.37:0/3317359149 shutdown_connections 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eb7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eb0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 --2- 172.21.15.37:0/3317359149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0eb0500 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 -- 172.21.15.37:0/3317359149 >> 172.21.15.37:0/3317359149 conn(0x55e0c0b00300 msgr2=0x55e0c0eabe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.818+0000 7f44fd008740 1 -- 172.21.15.37:0/3317359149 shutdown_connections 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.819+0000 7f44fd008740 1 -- 172.21.15.37:0/3317359149 wait complete. 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.819+0000 7f44fd008740 1 -- start start 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.819+0000 7f44fd008740 1 Processor -- start 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44fd008740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44fd008740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eba770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44fd008740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44fd008740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e0c0eb83d0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44fd008740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e0c0d9b9c0 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44fd008740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e0c0eb8550 con 0x55e0c0aeb4d0 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44fd008740 10 client.0 _ll_register_callbacks cb 0x55e0c0dc8020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40050/0 (socket says 172.21.15.37:40050) 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1360099175 learned_addr learned my addr 172.21.15.37:0/1360099175 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44effff640 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1360099175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0aeb4d0 msgr2=0x55e0c0eba770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eba770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0b0c1b0 msgr2=0x55e0c0ec16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1360099175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0c0dc21f0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f44e0011830 tx=0x7f44e0011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5279de7334108170 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.820+0000 7f44ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44ceffd640 1 -- 172.21.15.37:0/1360099175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e001f060 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44ceffd640 1 -- 172.21.15.37:0/1360099175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f44e0010b20 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44e801c440 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44ceffd640 1 -- 172.21.15.37:0/1360099175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f44e0010d20 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 10 client.17850 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55e0c0b77790 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44ceffd640 1 -- 172.21.15.37:0/1360099175 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44e801c440 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44ceffd640 1 -- 172.21.15.37:0/1360099175 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f44e000f3c0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 10 client.17850 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 10 client.17850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 20 client.17850 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0acad80 0x55e0c0ecc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 4 client.17850 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.821+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0c0e223d0 con 0x55e0c0acad80 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.822+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0acad80 0x55e0c0ecc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.822+0000 7f44ceffd640 10 client.17850 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.822+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0acad80 0x55e0c0ecc010 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37dd90b1071722c4 server_cookie=bd1c7a6ebce50042 in_seq=0 out_seq=0 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44ceffd640 1 -- 172.21.15.37:0/1360099175 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e0c0e223d0 con 0x55e0c0acad80 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44ceffd640 10 client.17850 handle_command_reply: tid=0 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 client.17850 shutdown 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 msgr2=0x55e0c0eba230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba230 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f44e0011830 tx=0x7f44e0011cf0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 shutdown_connections 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0acad80 0x55e0c0ecc010 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0eba770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44ceffd640 0 client.17850 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 --2- 172.21.15.37:0/1360099175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba230 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 >> 172.21.15.37:0/1360099175 conn(0x55e0c0b00300 msgr2=0x55e0c0eaa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 shutdown_connections 2024-05-09T01:16:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 1 -- 172.21.15.37:0/1360099175 wait complete. 2024-05-09T01:16:38.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.823+0000 7f44fd008740 20 client.17850 trim_cache size 0 max 16384 2024-05-09T01:16:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.839+0000 7f44fd008740 1 Processor -- start 2024-05-09T01:16:38.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.839+0000 7f44fd008740 1 -- start start 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44fd008740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44fd008740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ec15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44fd008740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44fd008740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01a90d0 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44fd008740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01aac10 con 0x55e0c0aeb4d0 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44fd008740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01a97a0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44eeffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ec15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40510/0 (socket says 172.21.15.37:40510) 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40064/0 (socket says 172.21.15.37:40064) 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1690114007 learned_addr learned my addr 172.21.15.37:0/1690114007 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1690114007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 msgr2=0x55e0c0ec15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ec15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1690114007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 msgr2=0x55e0c0ec1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1690114007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0c0bee5f0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.840+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ec15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:38.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.841+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f44e0001eb0 tx=0x7f44e0010cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b7280bde6fbc4e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.841+0000 7f44d57fa640 1 -- 172.21.15.37:0/1690114007 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0029070 con 0x55e0c0ae32f0 2024-05-09T01:16:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.841+0000 7f44d57fa640 1 -- 172.21.15.37:0/1690114007 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44e000fdf0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.841+0000 7f44d57fa640 1 -- 172.21.15.37:0/1690114007 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e000fc10 con 0x55e0c0ae32f0 2024-05-09T01:16:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 -- 172.21.15.37:0/1690114007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 msgr2=0x55e0c0eba510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:38.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba510 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f44e0001eb0 tx=0x7f44e0010cb0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 -- 172.21.15.37:0/1690114007 shutdown_connections 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ec15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 --2- 172.21.15.37:0/1690114007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0ae32f0 0x55e0c0eba510 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 -- 172.21.15.37:0/1690114007 >> 172.21.15.37:0/1690114007 conn(0x55e0c0b00300 msgr2=0x55e0c0eb9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 -- 172.21.15.37:0/1690114007 shutdown_connections 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 -- 172.21.15.37:0/1690114007 wait complete. 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.842+0000 7f44fd008740 1 -- start start 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 1 Processor -- start 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0ebf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ebfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01aa540 con 0x55e0c0ae32f0 2024-05-09T01:16:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01a9e70 con 0x55e0c0aeb4d0 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44f01a70b0 con 0x55e0c0b0c1b0 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44fd008740 10 client.0 _ll_register_callbacks cb 0x7f44e000bce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0ebf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44effff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0ebf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40068/0 (socket says 172.21.15.37:40068) 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1060674609 learned_addr learned my addr 172.21.15.37:0/1060674609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.843+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ebfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1060674609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0b0c1b0 msgr2=0x55e0c0ec0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 msgr2=0x55e0c0ebfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ebfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ef7fe640 1 -- 172.21.15.37:0/1060674609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0c0dd8ed0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44effff640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ebfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ef7fe640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0ebf4d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f44e0000c00 tx=0x7f44e000fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf8daa977d7c71e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ceffd640 1 -- 172.21.15.37:0/1060674609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0029040 con 0x55e0c0ae32f0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ceffd640 1 -- 172.21.15.37:0/1060674609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f44e0032040 con 0x55e0c0ae32f0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44e000fdf0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44ceffd640 1 -- 172.21.15.37:0/1060674609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f44e000f3c0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44fd008740 10 client.17856 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.844+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55e0c0ec1fc0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.845+0000 7f44ceffd640 1 -- 172.21.15.37:0/1060674609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44e000fdf0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.845+0000 7f44ceffd640 1 -- 172.21.15.37:0/1060674609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f44e0025be0 con 0x55e0c0ae32f0 2024-05-09T01:16:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.846+0000 7f44fd008740 10 client.17856 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.846+0000 7f44fd008740 10 client.17856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.846+0000 7f44fd008740 20 client.17856 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.846+0000 7f44fd008740 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0aa01c0 0x55e0c0ec4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.846+0000 7f44fd008740 4 client.17856 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:16:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.846+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e0c0e1c240 con 0x55e0c0aa01c0 2024-05-09T01:16:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.855+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0aa01c0 0x55e0c0ec4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:38.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.860+0000 7f44eeffd640 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0aa01c0 0x55e0c0ec4da0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57768d0c72738b6d server_cookie=a682c9630ede979b in_seq=0 out_seq=0 2024-05-09T01:16:38.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:38.860+0000 7f44ceffd640 10 client.17856 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:38.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:38 smithi151 ceph-mon[34780]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 MiB/s wr, 680 op/s 2024-05-09T01:16:39.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:38 smithi136 ceph-mon[34110]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 11 MiB/s wr, 680 op/s 2024-05-09T01:16:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.228+0000 7f44ceffd640 1 -- 172.21.15.37:0/1060674609 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55e0c0e1c240 con 0x55e0c0aa01c0 2024-05-09T01:16:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.228+0000 7f44ceffd640 10 client.17856 handle_command_reply: tid=0 2024-05-09T01:16:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.228+0000 7f44fd008740 1 client.17856 shutdown 2024-05-09T01:16:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 msgr2=0x55e0c0ebf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0ebf4d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f44e0000c00 tx=0x7f44e000fd80 comp rx=0 tx=0).stop 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 shutdown_connections 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55e0c0aa01c0 0x55e0c0ec4da0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0c0b0c1b0 0x55e0c0ec0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e0c0aeb4d0 0x55e0c0ebfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44ceffd640 0 client.17856 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 --2- 172.21.15.37:0/1060674609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e0c0ae32f0 0x55e0c0ebf4d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 >> 172.21.15.37:0/1060674609 conn(0x55e0c0b00300 msgr2=0x55e0c0eaf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 shutdown_connections 2024-05-09T01:16:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 1 -- 172.21.15.37:0/1060674609 wait complete. 2024-05-09T01:16:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.229+0000 7f44fd008740 20 client.17856 trim_cache size 0 max 16384 2024-05-09T01:16:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:16:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:16:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:16:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.233+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f44d80b2860 msgr2=0x7f44d80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.233+0000 7f44f607e640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f44d80b2860 0x7f44d80b4d70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f44e8021000 tx=0x7f44e801e000 comp rx=0 tx=0).stop 2024-05-09T01:16:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.233+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44f0103d90 msgr2=0x7f44f019a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.233+0000 7f44f607e640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44f0103d90 0x7f44f019a8d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006010 tx=0x7f44e4031a50 comp rx=0 tx=0).stop 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 shutdown_connections 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f0108a90 0x7f44f01a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f44d80b2860 0x7f44d80b4d70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44f0103d90 0x7f44f019a8d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 --2- 172.21.15.37:0/4145119519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44f0102b50 0x7f44f019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 >> 172.21.15.37:0/4145119519 conn(0x7f44f00fdd40 msgr2=0x7f44f010a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 shutdown_connections 2024-05-09T01:16:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:39.234+0000 7f44f607e640 1 -- 172.21.15.37:0/4145119519 wait complete. 2024-05-09T01:16:39.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.805+0000 7f1918726700 1 -- 172.21.15.37:0/3978545878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910108760 msgr2=0x7f19101100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.805+0000 7f1918726700 1 --2- 172.21.15.37:0/3978545878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910108760 0x7f19101100c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f190801c100 tx=0x7f190801c410 comp rx=0 tx=0).stop 2024-05-09T01:16:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.814+0000 7f1918726700 1 -- 172.21.15.37:0/3978545878 shutdown_connections 2024-05-09T01:16:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.814+0000 7f1918726700 1 --2- 172.21.15.37:0/3978545878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910108760 0x7f19101100c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.814+0000 7f1918726700 1 --2- 172.21.15.37:0/3978545878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19101034e0 0x7f19101038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.814+0000 7f1918726700 1 --2- 172.21.15.37:0/3978545878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910107e10 0x7f1910108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.814+0000 7f1918726700 1 -- 172.21.15.37:0/3978545878 >> 172.21.15.37:0/3978545878 conn(0x7f19100fef30 msgr2=0x7f1910101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.818+0000 7f1918726700 1 -- 172.21.15.37:0/3978545878 shutdown_connections 2024-05-09T01:16:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.820+0000 7f1918726700 1 -- 172.21.15.37:0/3978545878 wait complete. 2024-05-09T01:16:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.824+0000 7f1918726700 1 Processor -- start 2024-05-09T01:16:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.828+0000 7f1918726700 1 -- start start 2024-05-09T01:16:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.828+0000 7f1918726700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19101034e0 0x7f191010fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.828+0000 7f1918726700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910107e10 0x7f191010ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.828+0000 7f1918726700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910108760 0x7f191010b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.828+0000 7f1918726700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f191006f910 con 0x7f1910108760 2024-05-09T01:16:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.828+0000 7f1918726700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f191006f790 con 0x7f19101034e0 2024-05-09T01:16:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.828+0000 7f1918726700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f191006fa90 con 0x7f1910107e10 2024-05-09T01:16:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.833+0000 7f1916cc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910108760 0x7f191010b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.833+0000 7f19164c2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19101034e0 0x7f191010fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.833+0000 7f1915cc1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910107e10 0x7f191010ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.833+0000 7f1916cc3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910108760 0x7f191010b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40086/0 (socket says 172.21.15.37:40086) 2024-05-09T01:16:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.833+0000 7f1916cc3700 1 -- 172.21.15.37:0/3703709439 learned_addr learned my addr 172.21.15.37:0/3703709439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.837+0000 7f1916cc3700 1 -- 172.21.15.37:0/3703709439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910107e10 msgr2=0x7f191010ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.837+0000 7f1916cc3700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910107e10 0x7f191010ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.837+0000 7f1916cc3700 1 -- 172.21.15.37:0/3703709439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19101034e0 msgr2=0x7f191010fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.837+0000 7f1916cc3700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19101034e0 0x7f191010fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.837+0000 7f1916cc3700 1 -- 172.21.15.37:0/3703709439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191010b890 con 0x7f1910108760 2024-05-09T01:16:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.837+0000 7f1915cc1700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910107e10 0x7f191010ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:16:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.838+0000 7f1916cc3700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910108760 0x7f191010b250 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1908003cb0 tx=0x7f1908003d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.840+0000 7f19077fe700 1 -- 172.21.15.37:0/3703709439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908018b90 con 0x7f1910108760 2024-05-09T01:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.840+0000 7f19077fe700 1 -- 172.21.15.37:0/3703709439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1908018d30 con 0x7f1910108760 2024-05-09T01:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.840+0000 7f19077fe700 1 -- 172.21.15.37:0/3703709439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080077d0 con 0x7f1910108760 2024-05-09T01:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.840+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191010bb20 con 0x7f1910108760 2024-05-09T01:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.844+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191019cc40 con 0x7f1910108760 2024-05-09T01:16:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.847+0000 7f19077fe700 1 -- 172.21.15.37:0/3703709439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1908007970 con 0x7f1910108760 2024-05-09T01:16:39.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.856+0000 7f19077fe700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18fc0d49e0 0x7f18fc0d6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.857+0000 7f19077fe700 1 -- 172.21.15.37:0/3703709439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f19080e8060 con 0x7f1910108760 2024-05-09T01:16:39.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.858+0000 7f192713cb80 1 Processor -- start 2024-05-09T01:16:39.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.859+0000 7f192713cb80 1 -- start start 2024-05-09T01:16:39.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f192713cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f192713cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d26800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f192713cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d20890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f192713cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558b70c43120 con 0x558b70c1dd80 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f192713cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558b70be8a20 con 0x558b70d20480 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f192713cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b70c3f0e0 con 0x558b70ba3520 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f19164c2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f19164c2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d262c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40090/0 (socket says 172.21.15.37:40090) 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.860+0000 7f19164c2700 1 -- 172.21.15.37:0/2506419882 learned_addr learned my addr 172.21.15.37:0/2506419882 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.862+0000 7f1916cc3700 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d20890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.863+0000 7f1916cc3700 1 -- 172.21.15.37:0/2506419882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 msgr2=0x558b70d26800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:16:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.863+0000 7f1916cc3700 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d26800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.863+0000 7f1916cc3700 1 -- 172.21.15.37:0/2506419882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 msgr2=0x558b70d262c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.863+0000 7f1916cc3700 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d262c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.863+0000 7f1916cc3700 1 -- 172.21.15.37:0/2506419882 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b70bd9580 con 0x558b70d20480 2024-05-09T01:16:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.864+0000 7f1916cc3700 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d20890 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1910103ff0 tx=0x7f19080059c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b36a5df44ad60b67 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.864+0000 7f19164c2700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18fc0d49e0 0x7f18fc0d6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.865+0000 7f1904ff9700 1 -- 172.21.15.37:0/2506419882 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080aa000 con 0x558b70d20480 2024-05-09T01:16:39.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.865+0000 7f1904ff9700 1 -- 172.21.15.37:0/2506419882 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19080e7020 con 0x558b70d20480 2024-05-09T01:16:39.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.866+0000 7f192713cb80 1 -- 172.21.15.37:0/2506419882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 msgr2=0x558b70d20890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.866+0000 7f192713cb80 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d20890 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1910103ff0 tx=0x7f19080059c0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.866+0000 7f192713cb80 1 -- 172.21.15.37:0/2506419882 shutdown_connections 2024-05-09T01:16:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.866+0000 7f192713cb80 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d20890 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.866+0000 7f192713cb80 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d262c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.866+0000 7f192713cb80 1 --2- 172.21.15.37:0/2506419882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d26800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.866+0000 7f192713cb80 1 -- 172.21.15.37:0/2506419882 >> 172.21.15.37:0/2506419882 conn(0x558b70ba6ff0 msgr2=0x558b70d1b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:39.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.873+0000 7f19164c2700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18fc0d49e0 0x7f18fc0d6ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f190c012750 tx=0x7f190c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.888+0000 7f192713cb80 1 -- 172.21.15.37:0/2506419882 shutdown_connections 2024-05-09T01:16:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.893+0000 7f192713cb80 1 -- 172.21.15.37:0/2506419882 wait complete. 2024-05-09T01:16:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.894+0000 7f192713cb80 1 -- start start 2024-05-09T01:16:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.894+0000 7f192713cb80 1 Processor -- start 2024-05-09T01:16:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.894+0000 7f192713cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d2f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.894+0000 7f192713cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d2fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.894+0000 7f192713cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d29d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.895+0000 7f192713cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558b70be8a20 con 0x558b70c1dd80 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.895+0000 7f192713cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x558b70bddba0 con 0x558b70d20480 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.895+0000 7f192713cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b70d21030 con 0x558b70ba3520 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.895+0000 7f192713cb80 10 client.0 _ll_register_callbacks cb 0x558b70ab4740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.895+0000 7f19164c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d2f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.895+0000 7f19164c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d2f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:40548/0 (socket says 172.21.15.37:40548) 2024-05-09T01:16:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.895+0000 7f19164c2700 1 -- 172.21.15.37:0/2540448726 learned_addr learned my addr 172.21.15.37:0/2540448726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.896+0000 7f19164c2700 1 -- 172.21.15.37:0/2540448726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 msgr2=0x558b70d29d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.896+0000 7f19164c2700 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d29d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.896+0000 7f19164c2700 1 -- 172.21.15.37:0/2540448726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 msgr2=0x558b70d2fea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:16:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.896+0000 7f19164c2700 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d2fea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.896+0000 7f19164c2700 1 -- 172.21.15.37:0/2540448726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b70abe510 con 0x558b70ba3520 2024-05-09T01:16:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.909+0000 7f19164c2700 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d2f960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f190c00fb80 tx=0x7f190c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97f97fba9a7dc2d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.909+0000 7f18f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.909+0000 7f18f9ffb700 1 -- 172.21.15.37:0/2540448726 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c01fcf0 con 0x558b70ba3520 2024-05-09T01:16:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.910+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19080e7020 con 0x558b70ba3520 2024-05-09T01:16:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.910+0000 7f18f9ffb700 1 -- 172.21.15.37:0/2540448726 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f190c020400 con 0x558b70ba3520 2024-05-09T01:16:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.910+0000 7f18f9ffb700 1 -- 172.21.15.37:0/2540448726 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f190c020600 con 0x558b70ba3520 2024-05-09T01:16:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.910+0000 7f192713cb80 10 client.27754 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.910+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558b70d37630 con 0x558b70ba3520 2024-05-09T01:16:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f18f9ffb700 1 -- 172.21.15.37:0/2540448726 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19080e7020 con 0x558b70ba3520 2024-05-09T01:16:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f18f9ffb700 1 -- 172.21.15.37:0/2540448726 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f190c01c030 con 0x558b70ba3520 2024-05-09T01:16:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f192713cb80 10 client.27754 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f192713cb80 10 client.27754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f192713cb80 20 client.27754 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f192713cb80 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70d3a0f0 0x558b70d3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f192713cb80 4 client.27754 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.911+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b70c50b00 con 0x558b70d3a0f0 2024-05-09T01:16:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.913+0000 7f1915cc1700 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70d3a0f0 0x558b70d3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.926+0000 7f1915cc1700 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70d3a0f0 0x558b70d3c600 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b77174f815a9810b server_cookie=1a9ff3328baf810f in_seq=0 out_seq=0 2024-05-09T01:16:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.927+0000 7f18f9ffb700 10 client.27754 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.931+0000 7f18f9ffb700 1 -- 172.21.15.37:0/2540448726 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558b70c50b00 con 0x558b70d3a0f0 2024-05-09T01:16:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.931+0000 7f18f9ffb700 10 client.27754 handle_command_reply: tid=0 2024-05-09T01:16:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.931+0000 7f192713cb80 1 client.27754 shutdown 2024-05-09T01:16:39.932 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:39 smithi037 ceph-mon[30122]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 646 op/s 2024-05-09T01:16:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.932+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 msgr2=0x558b70d2f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.932+0000 7f192713cb80 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d2f960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f190c00fb80 tx=0x7f190c0047c0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 shutdown_connections 2024-05-09T01:16:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70d3a0f0 0x558b70d3c600 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d29d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d2f960 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 --2- 172.21.15.37:0/2540448726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d2fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 >> 172.21.15.37:0/2540448726 conn(0x558b70ba6ff0 msgr2=0x558b70d15070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f18f9ffb700 0 client.27754 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 shutdown_connections 2024-05-09T01:16:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.933+0000 7f192713cb80 1 -- 172.21.15.37:0/2540448726 wait complete. 2024-05-09T01:16:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.934+0000 7f192713cb80 20 client.27754 trim_cache size 0 max 16384 2024-05-09T01:16:39.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:39 smithi151 ceph-mon[34780]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 646 op/s 2024-05-09T01:16:39.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.975+0000 7f192713cb80 1 Processor -- start 2024-05-09T01:16:39.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.975+0000 7f192713cb80 1 -- start start 2024-05-09T01:16:39.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.976+0000 7f192713cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d41e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.976+0000 7f192713cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d42340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.977+0000 7f19164c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d41e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.977+0000 7f192713cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d24e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.978+0000 7f1915cc1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d42340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.978+0000 7f1915cc1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d42340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40106/0 (socket says 172.21.15.37:40106) 2024-05-09T01:16:39.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.978+0000 7f1915cc1700 1 -- 172.21.15.37:0/3883590317 learned_addr learned my addr 172.21.15.37:0/3883590317 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:39.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.978+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19101b50c0 con 0x558b70c1dd80 2024-05-09T01:16:39.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.979+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f19101b6c00 con 0x558b70d20480 2024-05-09T01:16:39.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.979+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f19101b5790 con 0x558b70ba3520 2024-05-09T01:16:39.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.980+0000 7f1915cc1700 1 -- 172.21.15.37:0/3883590317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 msgr2=0x558b70d41e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.980+0000 7f1915cc1700 1 --2- 172.21.15.37:0/3883590317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d41e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.980+0000 7f1915cc1700 1 -- 172.21.15.37:0/3883590317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 msgr2=0x558b70d24e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.980+0000 7f1915cc1700 1 --2- 172.21.15.37:0/3883590317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d24e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.980+0000 7f1915cc1700 1 -- 172.21.15.37:0/3883590317 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b70d17a50 con 0x558b70c1dd80 2024-05-09T01:16:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.981+0000 7f1915cc1700 1 --2- 172.21.15.37:0/3883590317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d42340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1910107d70 tx=0x7f1900009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a367e8e76ba3ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.982+0000 7f18fbfff700 1 -- 172.21.15.37:0/3883590317 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190001d070 con 0x558b70c1dd80 2024-05-09T01:16:39.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.982+0000 7f18fbfff700 1 -- 172.21.15.37:0/3883590317 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1900011d30 con 0x558b70c1dd80 2024-05-09T01:16:39.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.983+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 msgr2=0x558b70d42340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:39.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.983+0000 7f192713cb80 1 --2- 172.21.15.37:0/3883590317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d42340 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1910107d70 tx=0x7f1900009260 comp rx=0 tx=0).stop 2024-05-09T01:16:39.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.994+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 shutdown_connections 2024-05-09T01:16:39.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.994+0000 7f192713cb80 1 --2- 172.21.15.37:0/3883590317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70d20480 0x558b70d24e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.994+0000 7f192713cb80 1 --2- 172.21.15.37:0/3883590317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70ba3520 0x558b70d41e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.994+0000 7f192713cb80 1 --2- 172.21.15.37:0/3883590317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70c1dd80 0x558b70d42340 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:39.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.994+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 >> 172.21.15.37:0/3883590317 conn(0x558b70ba6ff0 msgr2=0x558b70d1b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:39.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.994+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 shutdown_connections 2024-05-09T01:16:39.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.994+0000 7f192713cb80 1 -- 172.21.15.37:0/3883590317 wait complete. 2024-05-09T01:16:39.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.995+0000 7f192713cb80 1 -- start start 2024-05-09T01:16:39.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.995+0000 7f192713cb80 1 Processor -- start 2024-05-09T01:16:39.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.996+0000 7f192713cb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70ba3520 0x558b70d35f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.996+0000 7f192713cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70c1dd80 0x558b70d364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.996+0000 7f192713cb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70d20480 0x558b70d34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:39.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.996+0000 7f192713cb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19101b6530 con 0x558b70d20480 2024-05-09T01:16:39.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.996+0000 7f192713cb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f19101b5e60 con 0x558b70ba3520 2024-05-09T01:16:39.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.996+0000 7f192713cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f19101b30a0 con 0x558b70c1dd80 2024-05-09T01:16:39.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.996+0000 7f192713cb80 10 client.0 _ll_register_callbacks cb 0x558b70ab4740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:39.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.997+0000 7f19164c2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70ba3520 0x558b70d35f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:39.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.997+0000 7f19164c2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70ba3520 0x558b70d35f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:42370/0 (socket says 172.21.15.37:42370) 2024-05-09T01:16:39.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:39.997+0000 7f19164c2700 1 -- 172.21.15.37:0/1942323207 learned_addr learned my addr 172.21.15.37:0/1942323207 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.002+0000 7f19164c2700 1 -- 172.21.15.37:0/1942323207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70c1dd80 msgr2=0x558b70d364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.002+0000 7f19164c2700 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70c1dd80 0x558b70d364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.002+0000 7f19164c2700 1 -- 172.21.15.37:0/1942323207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70d20480 msgr2=0x558b70d34430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.002+0000 7f19164c2700 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70d20480 0x558b70d34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.002+0000 7f19164c2700 1 -- 172.21.15.37:0/1942323207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b70d14d40 con 0x558b70ba3520 2024-05-09T01:16:40.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.008+0000 7f19164c2700 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70ba3520 0x558b70d35f40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f190c028870 tx=0x7f190c01f720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=196e4fd54cbdaff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.008+0000 7f18f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:16:40.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.009+0000 7f18f9ffb700 1 -- 172.21.15.37:0/1942323207 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c037070 con 0x558b70ba3520 2024-05-09T01:16:40.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.009+0000 7f18f9ffb700 1 -- 172.21.15.37:0/1942323207 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f190c0207a0 con 0x558b70ba3520 2024-05-09T01:16:40.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.009+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558b70c4aba0 con 0x558b70ba3520 2024-05-09T01:16:40.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.011+0000 7f18f9ffb700 1 -- 172.21.15.37:0/1942323207 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f190c0058e0 con 0x558b70ba3520 2024-05-09T01:16:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.011+0000 7f192713cb80 10 client.27797 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.011+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558b70da5420 con 0x558b70ba3520 2024-05-09T01:16:40.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.012+0000 7f18f9ffb700 1 -- 172.21.15.37:0/1942323207 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558b70c4aba0 con 0x558b70ba3520 2024-05-09T01:16:40.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.013+0000 7f18f9ffb700 1 -- 172.21.15.37:0/1942323207 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f190c01c040 con 0x558b70ba3520 2024-05-09T01:16:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.014+0000 7f192713cb80 10 client.27797 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.014+0000 7f192713cb80 10 client.27797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.014+0000 7f192713cb80 20 client.27797 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.014+0000 7f192713cb80 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70da5b60 0x558b70da7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.014+0000 7f192713cb80 4 client.27797 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T01:16:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.014+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558b70abe9f0 con 0x558b70da5b60 2024-05-09T01:16:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.015+0000 7f1915cc1700 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70da5b60 0x558b70da7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.018+0000 7f1915cc1700 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70da5b60 0x558b70da7f80 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4109b3b2c4ab23 server_cookie=568e95407b988587 in_seq=0 out_seq=0 2024-05-09T01:16:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.019+0000 7f18f9ffb700 10 client.27797 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f18f9ffb700 1 -- 172.21.15.37:0/1942323207 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558b70abe9f0 con 0x558b70da5b60 2024-05-09T01:16:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f18f9ffb700 10 client.27797 handle_command_reply: tid=0 2024-05-09T01:16:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 client.27797 shutdown 2024-05-09T01:16:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70ba3520 msgr2=0x558b70d35f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70ba3520 0x558b70d35f40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f190c028870 tx=0x7f190c01f720 comp rx=0 tx=0).stop 2024-05-09T01:16:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 shutdown_connections 2024-05-09T01:16:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x558b70da5b60 0x558b70da7f80 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b70d20480 0x558b70d34430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x558b70ba3520 0x558b70d35f40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 --2- 172.21.15.37:0/1942323207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b70c1dd80 0x558b70d364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.020+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 >> 172.21.15.37:0/1942323207 conn(0x558b70ba6ff0 msgr2=0x558b70d1b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:40.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.022+0000 7f18f9ffb700 0 client.27797 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:40.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.022+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 shutdown_connections 2024-05-09T01:16:40.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.022+0000 7f192713cb80 1 -- 172.21.15.37:0/1942323207 wait complete. 2024-05-09T01:16:40.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.022+0000 7f192713cb80 20 client.27797 trim_cache size 0 max 16384 2024-05-09T01:16:40.023 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:16:40.023 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-05-09T01:16:40.023 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "89a3f898-dde6-4969-bc0b-c08eb5e26098", 2024-05-09T01:16:40.023 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-05-09T01:16:40.024 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.024+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18fc0d49e0 msgr2=0x7f18fc0d6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.024+0000 7f1918726700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18fc0d49e0 0x7f18fc0d6ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f190c012750 tx=0x7f190c009260 comp rx=0 tx=0).stop 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.024+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910108760 msgr2=0x7f191010b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.024+0000 7f1918726700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910108760 0x7f191010b250 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1908003cb0 tx=0x7f1908003d90 comp rx=0 tx=0).stop 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 shutdown_connections 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f18fc0d49e0 0x7f18fc0d6ef0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1910108760 0x7f191010b250 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19101034e0 0x7f191010fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 --2- 172.21.15.37:0/3703709439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1910107e10 0x7f191010ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:40.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 >> 172.21.15.37:0/3703709439 conn(0x7f19100fef30 msgr2=0x7f1910105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:40.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 shutdown_connections 2024-05-09T01:16:40.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:40.025+0000 7f1918726700 1 -- 172.21.15.37:0/3703709439 wait complete. 2024-05-09T01:16:40.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:39 smithi136 ceph-mon[34110]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 646 op/s 2024-05-09T01:16:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 860.0 s, 1242.6 tps, lat 58.947 ms stddev 96.714 2024-05-09T01:16:40.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:16:40.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:40 smithi037 ceph-mon[30122]: scrub queued for path: / 2024-05-09T01:16:40.973 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:40 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:40 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:40 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:40 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:40 smithi151 ceph-mon[34780]: scrub queued for path: / 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:40 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:40 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:40 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:16:40.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:40 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:16:41.088 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:16:41.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:40 smithi136 ceph-mon[34110]: scrub queued for path: / 2024-05-09T01:16:41.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:40 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:41.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:40 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:16:41.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:40 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:16:41.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:40 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:16:41.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:41 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:16:41.904 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:41 smithi037 ceph-mon[30122]: scrub summary: active paths [/] 2024-05-09T01:16:41.904 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:41 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:41.904 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:41 smithi037 ceph-mon[30122]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 1.33k op/s 2024-05-09T01:16:41.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:41 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:16:41.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:41 smithi151 ceph-mon[34780]: scrub summary: active paths [/] 2024-05-09T01:16:41.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:41 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:41.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:41 smithi151 ceph-mon[34780]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 1.33k op/s 2024-05-09T01:16:42.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:41 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:16:42.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:41 smithi136 ceph-mon[34110]: scrub summary: active paths [/] 2024-05-09T01:16:42.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:41 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:42.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:41 smithi136 ceph-mon[34110]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 MiB/s wr, 1.33k op/s 2024-05-09T01:16:42.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 -- 172.21.15.37:0/715665792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554108740 msgr2=0x7f05541100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 --2- 172.21.15.37:0/715665792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554108740 0x7f05541100a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f054c00b0d0 tx=0x7f054c00b3e0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 -- 172.21.15.37:0/715665792 shutdown_connections 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 --2- 172.21.15.37:0/715665792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554108740 0x7f05541100a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 --2- 172.21.15.37:0/715665792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05541034c0 0x7f05541038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 --2- 172.21.15.37:0/715665792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0554107df0 0x7f0554108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 -- 172.21.15.37:0/715665792 >> 172.21.15.37:0/715665792 conn(0x7f05540fedc0 msgr2=0x7f05541011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 -- 172.21.15.37:0/715665792 shutdown_connections 2024-05-09T01:16:42.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.726+0000 7f0559084700 1 -- 172.21.15.37:0/715665792 wait complete. 2024-05-09T01:16:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.727+0000 7f0559084700 1 Processor -- start 2024-05-09T01:16:42.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.727+0000 7f0559084700 1 -- start start 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0559084700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05541034c0 0x7f055419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0559084700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0554107df0 0x7f055419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0559084700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0554108740 0x7f055419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0559084700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0554113370 con 0x7f05541034c0 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0559084700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f05541131f0 con 0x7f0554107df0 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0559084700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f05541134f0 con 0x7f0554108740 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05541034c0 0x7f055419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05541034c0 0x7f055419ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57960/0 (socket says 172.21.15.37:57960) 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 -- 172.21.15.37:0/3800292557 learned_addr learned my addr 172.21.15.37:0/3800292557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f055259c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0554107df0 0x7f055419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f055359e700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0554108740 0x7f055419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 -- 172.21.15.37:0/3800292557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0554108740 msgr2=0x7f055419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0554108740 0x7f055419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 -- 172.21.15.37:0/3800292557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0554107df0 msgr2=0x7f055419b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0554107df0 0x7f055419b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f0552d9d700 1 -- 172.21.15.37:0/3800292557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055419fd00 con 0x7f05541034c0 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.728+0000 7f055259c700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0554107df0 0x7f055419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.729+0000 7f0552d9d700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05541034c0 0x7f055419ae30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f054400e9a0 tx=0x7f054400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.729+0000 7f053bfff700 1 -- 172.21.15.37:0/3800292557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054400ca10 con 0x7f05541034c0 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.729+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055419fff0 con 0x7f05541034c0 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.729+0000 7f053bfff700 1 -- 172.21.15.37:0/3800292557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f054400cbb0 con 0x7f05541034c0 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.729+0000 7f053bfff700 1 -- 172.21.15.37:0/3800292557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544018680 con 0x7f05541034c0 2024-05-09T01:16:42.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.729+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05541a7910 con 0x7f05541034c0 2024-05-09T01:16:42.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.732+0000 7f053bfff700 1 -- 172.21.15.37:0/3800292557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0544018820 con 0x7f05541034c0 2024-05-09T01:16:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 Processor -- start 2024-05-09T01:16:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f053bfff700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f053c0b2880 0x7f053c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 -- start start 2024-05-09T01:16:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f055359e700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f053c0b2880 0x7f053c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f053bfff700 1 -- 172.21.15.37:0/3800292557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f05440e2390 con 0x7f05541034c0 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb18b160 0x555bbb2244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb224a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb21ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bbb140ff0 con 0x555bbb0a14a0 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555bbb0df7f0 con 0x555bbb18b160 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555bbb13cfb0 con 0x555bbb21e6a0 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f055259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb224a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f055259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb224a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57972/0 (socket says 172.21.15.37:57972) 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.733+0000 7f055259c700 1 -- 172.21.15.37:0/1435115091 learned_addr learned my addr 172.21.15.37:0/1435115091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055359e700 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb21ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f0552d9d700 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb18b160 0x555bbb2244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055259c700 1 -- 172.21.15.37:0/1435115091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 msgr2=0x555bbb21ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055359e700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f053c0b2880 0x7f053c0b4d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f054c009fd0 tx=0x7f054c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055259c700 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb21ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055259c700 1 -- 172.21.15.37:0/1435115091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb18b160 msgr2=0x555bbb2244f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055259c700 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb18b160 0x555bbb2244f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055259c700 1 -- 172.21.15.37:0/1435115091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbb0d7370 con 0x555bbb0a14a0 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f055259c700 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb224a30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f05480114f0 tx=0x7f0548011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627a62c917ef165c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f05397fa700 1 -- 172.21.15.37:0/1435115091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548004a30 con 0x555bbb0a14a0 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f05397fa700 1 -- 172.21.15.37:0/1435115091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05480054d0 con 0x555bbb0a14a0 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.734+0000 7f05397fa700 1 -- 172.21.15.37:0/1435115091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054800e970 con 0x555bbb0a14a0 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1435115091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 msgr2=0x555bbb224a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb224a30 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f05480114f0 tx=0x7f0548011800 comp rx=0 tx=0).stop 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1435115091 shutdown_connections 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb21ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb18b160 0x555bbb2244f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1435115091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb224a30 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1435115091 >> 172.21.15.37:0/1435115091 conn(0x555bbb1016a0 msgr2=0x555bbb219400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1435115091 shutdown_connections 2024-05-09T01:16:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.735+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1435115091 wait complete. 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 -- start start 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 Processor -- start 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb2282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb18b160 0x555bbb228800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb228d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bbafbcba0 con 0x555bbb0a14a0 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x555bbb0fb150 con 0x555bbb21e6a0 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555bbb22b1d0 con 0x555bbb18b160 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0567a9ab80 10 client.0 _ll_register_callbacks cb 0x555bbafb26c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0552d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb2282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f055259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb18b160 0x555bbb228800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.736+0000 7f0552d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb2282c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57976/0 (socket says 172.21.15.37:57976) 2024-05-09T01:16:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f0552d9d700 1 -- 172.21.15.37:0/356388251 learned_addr learned my addr 172.21.15.37:0/356388251 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:42.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f055359e700 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb228d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f055259c700 1 -- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 msgr2=0x555bbb228d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f055259c700 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb228d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f055259c700 1 -- 172.21.15.37:0/356388251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 msgr2=0x555bbb2282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f055259c700 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb2282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f055259c700 1 -- 172.21.15.37:0/356388251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bbafbc490 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f0552d9d700 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb2282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f055259c700 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb18b160 0x555bbb228800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f054801b040 tx=0x7f054800ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01385a123096976 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f0536ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f0536ff5700 1 -- 172.21.15.37:0/356388251 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548029030 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f0536ff5700 1 -- 172.21.15.37:0/356388251 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f054800ee10 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.737+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05480054d0 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0536ff5700 1 -- 172.21.15.37:0/356388251 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f0548005680 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 10 client.27766 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x555bbb235c40 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0536ff5700 1 -- 172.21.15.37:0/356388251 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05480054d0 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0536ff5700 1 -- 172.21.15.37:0/356388251 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f054802e6c0 con 0x555bbb18b160 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 10 client.27766 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:42.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 10 client.27766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 20 client.27766 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb238170 0x555bbb23a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 4 client.27766 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bbb14e9d0 con 0x555bbb238170 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.738+0000 7f0552d9d700 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb238170 0x555bbb23a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.739+0000 7f0552d9d700 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb238170 0x555bbb23a590 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958c8c72268153e5 server_cookie=f15d80c09dee898 in_seq=0 out_seq=0 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.739+0000 7f0536ff5700 10 client.27766 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0536ff5700 1 -- 172.21.15.37:0/356388251 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555bbb14e9d0 con 0x555bbb238170 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0536ff5700 10 client.27766 handle_command_reply: tid=0 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 client.27766 shutdown 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb18b160 msgr2=0x555bbb228800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb18b160 0x555bbb228800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f054801b040 tx=0x7f054800ebf0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 shutdown_connections 2024-05-09T01:16:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb238170 0x555bbb23a590 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb228d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0536ff5700 0 client.27766 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb0a14a0 0x555bbb2282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/356388251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb18b160 0x555bbb228800 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 >> 172.21.15.37:0/356388251 conn(0x555bbb1016a0 msgr2=0x555bbb2191c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 shutdown_connections 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 1 -- 172.21.15.37:0/356388251 wait complete. 2024-05-09T01:16:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.740+0000 7f0567a9ab80 20 client.27766 trim_cache size 0 max 16384 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 Processor -- start 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 -- start start 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb0a14a0 0x555bbb2272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb23daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05541aebc0 con 0x555bbb18b160 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f05541b0700 con 0x555bbb0a14a0 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.761+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f05541af290 con 0x555bbb21e6a0 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57986/0 (socket says 172.21.15.37:57986) 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 -- 172.21.15.37:0/908238423 learned_addr learned my addr 172.21.15.37:0/908238423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f0552d9d700 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb0a14a0 0x555bbb2272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055359e700 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb23daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 -- 172.21.15.37:0/908238423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 msgr2=0x555bbb23daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb23daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 -- 172.21.15.37:0/908238423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb0a14a0 msgr2=0x555bbb2272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb0a14a0 0x555bbb2272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 -- 172.21.15.37:0/908238423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbb212f60 con 0x555bbb18b160 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f055259c700 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23d5b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0548000c00 tx=0x7f0548005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d0e1a5e9dc41a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f0538ff9700 1 -- 172.21.15.37:0/908238423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548029070 con 0x555bbb18b160 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f0538ff9700 1 -- 172.21.15.37:0/908238423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f054800ed10 con 0x555bbb18b160 2024-05-09T01:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.762+0000 7f0538ff9700 1 -- 172.21.15.37:0/908238423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480258e0 con 0x555bbb18b160 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 -- 172.21.15.37:0/908238423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 msgr2=0x555bbb23d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23d5b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0548000c00 tx=0x7f0548005fa0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 -- 172.21.15.37:0/908238423 shutdown_connections 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb21e6a0 0x555bbb23daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb0a14a0 0x555bbb2272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/908238423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23d5b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 -- 172.21.15.37:0/908238423 >> 172.21.15.37:0/908238423 conn(0x555bbb1016a0 msgr2=0x555bbb226bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 -- 172.21.15.37:0/908238423 shutdown_connections 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.763+0000 7f0567a9ab80 1 -- 172.21.15.37:0/908238423 wait complete. 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 -- start start 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 Processor -- start 2024-05-09T01:16:42.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb0a14a0 0x555bbb23bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb2a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05541b0030 con 0x555bbb18b160 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f05541af960 con 0x555bbb21e6a0 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f05541acb80 con 0x555bbb0a14a0 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0567a9ab80 10 client.0 _ll_register_callbacks cb 0x555bbafb26c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f055259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f0552d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb0a14a0 0x555bbb23bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f055259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57994/0 (socket says 172.21.15.37:57994) 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f055259c700 1 -- 172.21.15.37:0/1041998918 learned_addr learned my addr 172.21.15.37:0/1041998918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.764+0000 7f055359e700 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb2a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0552d9d700 1 -- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 msgr2=0x555bbb2a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0552d9d700 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb2a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0552d9d700 1 -- 172.21.15.37:0/1041998918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 msgr2=0x555bbb23c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0552d9d700 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0552d9d700 1 -- 172.21.15.37:0/1041998918 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bbb23c880 con 0x555bbb0a14a0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f055259c700 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0552d9d700 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb0a14a0 0x555bbb23bb70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f05440dff30 tx=0x7f05440cc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47cc5df7d52a2049 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0536ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0536ff5700 1 -- 172.21.15.37:0/1041998918 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05440a5040 con 0x555bbb0a14a0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0536ff5700 1 -- 172.21.15.37:0/1041998918 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f05440a6040 con 0x555bbb0a14a0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f054800ed10 con 0x555bbb0a14a0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0536ff5700 1 -- 172.21.15.37:0/1041998918 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f05440ade00 con 0x555bbb0a14a0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0567a9ab80 10 client.27772 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x555bbb2a2bf0 con 0x555bbb0a14a0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.765+0000 7f0536ff5700 1 -- 172.21.15.37:0/1041998918 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f054800ed10 con 0x555bbb0a14a0 2024-05-09T01:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0536ff5700 1 -- 172.21.15.37:0/1041998918 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f054406f2b0 con 0x555bbb0a14a0 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0567a9ab80 10 client.27772 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0567a9ab80 10 client.27772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0567a9ab80 20 client.27772 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb2a32b0 0x555bbb2a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0567a9ab80 4 client.27772 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555bbb148a70 con 0x555bbb2a32b0 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f055259c700 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb2a32b0 0x555bbb2a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f055259c700 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb2a32b0 0x555bbb2a56d0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5ca909d94911d47 server_cookie=2302103aace7479e in_seq=0 out_seq=0 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.766+0000 7f0536ff5700 10 client.27772 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0536ff5700 1 -- 172.21.15.37:0/1041998918 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x555bbb148a70 con 0x555bbb2a32b0 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0536ff5700 10 client.27772 handle_command_reply: tid=0 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 client.27772 shutdown 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb0a14a0 msgr2=0x555bbb23bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb0a14a0 0x555bbb23bb70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f05440dff30 tx=0x7f05440cc040 comp rx=0 tx=0).stop 2024-05-09T01:16:42.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 shutdown_connections 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x555bbb2a32b0 0x555bbb2a56d0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x555bbb21e6a0 0x555bbb2a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555bbb0a14a0 0x555bbb23bb70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0536ff5700 0 client.27772 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 --2- 172.21.15.37:0/1041998918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbb18b160 0x555bbb23c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 >> 172.21.15.37:0/1041998918 conn(0x555bbb1016a0 msgr2=0x555bbb21d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 shutdown_connections 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 1 -- 172.21.15.37:0/1041998918 wait complete. 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.767+0000 7f0567a9ab80 20 client.27772 trim_cache size 0 max 16384 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:16:42.773 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "scrub active (0 inodes in the stack)", 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: "89a3f898-dde6-4969-bc0b-c08eb5e26098": { 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "89a3f898-dde6-4969-bc0b-c08eb5e26098", 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:16:42.774 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f053c0b2880 msgr2=0x7f053c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f053c0b2880 0x7f053c0b4d90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f054c009fd0 tx=0x7f054c00b040 comp rx=0 tx=0).stop 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05541034c0 msgr2=0x7f055419ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05541034c0 0x7f055419ae30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f054400e9a0 tx=0x7f054400ecb0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 shutdown_connections 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f053c0b2880 0x7f053c0b4d90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0554108740 0x7f055419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05541034c0 0x7f055419ae30 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 --2- 172.21.15.37:0/3800292557 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0554107df0 0x7f055419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 >> 172.21.15.37:0/3800292557 conn(0x7f05540fedc0 msgr2=0x7f0554107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 shutdown_connections 2024-05-09T01:16:42.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:16:42.768+0000 7f0559084700 1 -- 172.21.15.37:0/3800292557 wait complete. 2024-05-09T01:16:43.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:42 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:43.444 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:42 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:43.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:42 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:43.787 INFO:tasks.cephfs.filesystem:scrub status for tag:89a3f898-dde6-4969-bc0b-c08eb5e26098 - {'path': '/', 'tag': '89a3f898-dde6-4969-bc0b-c08eb5e26098', 'options': 'recursive,force'} 2024-05-09T01:16:44.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:43 smithi037 ceph-mon[30122]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 29 MiB/s wr, 1.58k op/s 2024-05-09T01:16:44.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:43 smithi136 ceph-mon[34110]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 29 MiB/s wr, 1.58k op/s 2024-05-09T01:16:44.474 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:43 smithi151 ceph-mon[34780]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 29 MiB/s wr, 1.58k op/s 2024-05-09T01:16:45.233 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-05-09T01:16:46.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:46 smithi136 ceph-mon[34110]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 31 MiB/s wr, 1.69k op/s 2024-05-09T01:16:46.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:46 smithi037 ceph-mon[30122]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 31 MiB/s wr, 1.69k op/s 2024-05-09T01:16:46.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:46 smithi151 ceph-mon[34780]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 31 MiB/s wr, 1.69k op/s 2024-05-09T01:16:48.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:48 smithi136 ceph-mon[34110]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 30 MiB/s wr, 1.65k op/s 2024-05-09T01:16:48.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:48 smithi037 ceph-mon[30122]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 30 MiB/s wr, 1.65k op/s 2024-05-09T01:16:48.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:48 smithi151 ceph-mon[34780]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 30 MiB/s wr, 1.65k op/s 2024-05-09T01:16:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 870.0 s, 3.2 tps, lat 10354.741 ms stddev 454.004 2024-05-09T01:16:50.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:50 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:50.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:50 smithi037 ceph-mon[30122]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 28 MiB/s wr, 1.50k op/s 2024-05-09T01:16:50.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:50 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:50.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:50 smithi136 ceph-mon[34110]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 28 MiB/s wr, 1.50k op/s 2024-05-09T01:16:50.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:50 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:50.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:50 smithi151 ceph-mon[34780]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 28 MiB/s wr, 1.50k op/s 2024-05-09T01:16:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.408+0000 7f8d81b00640 1 -- 172.21.15.37:0/1477796956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7c10a550 msgr2=0x7f8d7c10af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.408+0000 7f8d81b00640 1 --2- 172.21.15.37:0/1477796956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7c10a550 0x7f8d7c10af40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009900 tx=0x7f8d6c02a440 comp rx=0 tx=0).stop 2024-05-09T01:16:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.409+0000 7f8d81b00640 1 -- 172.21.15.37:0/1477796956 shutdown_connections 2024-05-09T01:16:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.409+0000 7f8d81b00640 1 --2- 172.21.15.37:0/1477796956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d7c1101a0 0x7f8d7c1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.409+0000 7f8d81b00640 1 --2- 172.21.15.37:0/1477796956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7c10b480 0x7f8d7c10b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.409+0000 7f8d81b00640 1 --2- 172.21.15.37:0/1477796956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7c10a550 0x7f8d7c10af40 secure :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009900 tx=0x7f8d6c02a440 comp rx=0 tx=0).stop 2024-05-09T01:16:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.409+0000 7f8d81b00640 1 -- 172.21.15.37:0/1477796956 >> 172.21.15.37:0/1477796956 conn(0x7f8d7c070670 msgr2=0x7f8d7c072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.412+0000 7f8d81b00640 1 -- 172.21.15.37:0/1477796956 shutdown_connections 2024-05-09T01:16:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.412+0000 7f8d81b00640 1 -- 172.21.15.37:0/1477796956 wait complete. 2024-05-09T01:16:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.413+0000 7f8d81b00640 1 Processor -- start 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.413+0000 7f8d81b00640 1 -- start start 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.413+0000 7f8d81b00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d7c10b480 0x7f8d7c1a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d81b00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7c1101a0 0x7f8d7c1a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d81b00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7c078f20 0x7f8d7c07b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d81b00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c11e6b0 con 0x7f8d7c1101a0 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d81b00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c11e530 con 0x7f8d7c10b480 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d81b00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c11e830 con 0x7f8d7c078f20 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7c078f20 0x7f8d7c07b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7c078f20 0x7f8d7c07b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45956/0 (socket says 172.21.15.37:45956) 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d7bfff640 1 -- 172.21.15.37:0/4240984570 learned_addr learned my addr 172.21.15.37:0/4240984570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.414+0000 7f8d7b7fe640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d7c10b480 0x7f8d7c1a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.415+0000 7f8d7b7fe640 1 -- 172.21.15.37:0/4240984570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7c078f20 msgr2=0x7f8d7c07b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.415+0000 7f8d7b7fe640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7c078f20 0x7f8d7c07b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.415+0000 7f8d7b7fe640 1 -- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7c1101a0 msgr2=0x7f8d7c1a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.415+0000 7f8d7b7fe640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7c1101a0 0x7f8d7c1a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.415+0000 7f8d7b7fe640 1 -- 172.21.15.37:0/4240984570 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c07ba70 con 0x7f8d7c10b480 2024-05-09T01:16:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.416+0000 7f8d7b7fe640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d7c10b480 0x7f8d7c1a93b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c074a90 tx=0x7f8d6c003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.416+0000 7f8d78ff9640 1 -- 172.21.15.37:0/4240984570 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c03f020 con 0x7f8d7c10b480 2024-05-09T01:16:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.416+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c07bd00 con 0x7f8d7c10b480 2024-05-09T01:16:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.416+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c07c210 con 0x7f8d7c10b480 2024-05-09T01:16:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.417+0000 7f8d78ff9640 1 -- 172.21.15.37:0/4240984570 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d6c031bc0 con 0x7f8d7c10b480 2024-05-09T01:16:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.418+0000 7f8d78ff9640 1 -- 172.21.15.37:0/4240984570 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c035070 con 0x7f8d7c10b480 2024-05-09T01:16:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.422+0000 7f8d889b5740 1 Processor -- start 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d889b5740 1 -- start start 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b8c1b0 0x561267f30500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f30a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f37980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d889b5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561267e947c0 con 0x561267b632f0 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d889b5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561267e300e0 con 0x561267b6b4d0 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d889b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561267e90780 con 0x561267b8c1b0 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d78ff9640 1 -- 172.21.15.37:0/4240984570 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8d6c042020 con 0x7f8d7c10b480 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b8c1b0 0x561267f30500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b8c1b0 0x561267f30500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45962/0 (socket says 172.21.15.37:45962) 2024-05-09T01:16:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.424+0000 7f8d7bfff640 1 -- 172.21.15.37:0/2487762703 learned_addr learned my addr 172.21.15.37:0/2487762703 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d7bfff640 1 -- 172.21.15.37:0/2487762703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 msgr2=0x561267f37980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:16:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/2487762703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f37980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d7bfff640 1 -- 172.21.15.37:0/2487762703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 msgr2=0x561267f30a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/2487762703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f30a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d7bfff640 1 -- 172.21.15.37:0/2487762703 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561267e597c0 con 0x561267b8c1b0 2024-05-09T01:16:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/2487762703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b8c1b0 0x561267f30500 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8d74011460 tx=0x7f8d74011920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b938b3a40e53a496 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d61ffb640 1 -- 172.21.15.37:0/2487762703 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74012770 con 0x561267b8c1b0 2024-05-09T01:16:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d61ffb640 1 -- 172.21.15.37:0/2487762703 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d74012dc0 con 0x561267b8c1b0 2024-05-09T01:16:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.425+0000 7f8d61ffb640 1 -- 172.21.15.37:0/2487762703 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7401ae60 con 0x561267b8c1b0 2024-05-09T01:16:52.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.426+0000 7f8d78ff9640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d640b2930 0x7f8d640b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.427+0000 7f8d78ff9640 1 -- 172.21.15.37:0/4240984570 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8d6c1025b0 con 0x7f8d7c10b480 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.427+0000 7f8d889b5740 1 -- 172.21.15.37:0/2487762703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b8c1b0 msgr2=0x561267f30500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.427+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2487762703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b8c1b0 0x561267f30500 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8d74011460 tx=0x7f8d74011920 comp rx=0 tx=0).stop 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d7b7fe640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d640b2930 0x7f8d640b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d889b5740 1 -- 172.21.15.37:0/2487762703 shutdown_connections 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2487762703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f37980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2487762703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f30a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2487762703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b8c1b0 0x561267f30500 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d889b5740 1 -- 172.21.15.37:0/2487762703 >> 172.21.15.37:0/2487762703 conn(0x561267b80300 msgr2=0x561267f2be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:52.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d889b5740 1 -- 172.21.15.37:0/2487762703 shutdown_connections 2024-05-09T01:16:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.428+0000 7f8d889b5740 1 -- 172.21.15.37:0/2487762703 wait complete. 2024-05-09T01:16:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.429+0000 7f8d889b5740 1 -- start start 2024-05-09T01:16:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.429+0000 7f8d7b7fe640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d640b2930 0x7f8d640b4e40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0c9b40 tx=0x7f8d6c02a990 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:52.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.429+0000 7f8d889b5740 1 Processor -- start 2024-05-09T01:16:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.430+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f4b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.430+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b6b4d0 0x561267f4b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.430+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b8c1b0 0x561267f52710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b6b4d0 0x561267f4b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b6b4d0 0x561267f4b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:45972/0 (socket says 172.21.15.37:45972) 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d7affd640 1 -- 172.21.15.37:0/930812219 learned_addr learned my addr 172.21.15.37:0/930812219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561267f493e0 con 0x561267b632f0 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x561267e1b9c0 con 0x561267b8c1b0 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561267f49560 con 0x561267b6b4d0 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d889b5740 10 client.0 _ll_register_callbacks cb 0x561267e48020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.431+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f4b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.432+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b8c1b0 0x561267f52710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.432+0000 7f8d7affd640 1 -- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b8c1b0 msgr2=0x561267f52710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.432+0000 7f8d7affd640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b8c1b0 0x561267f52710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.432+0000 7f8d7affd640 1 -- 172.21.15.37:0/930812219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 msgr2=0x561267f4b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.432+0000 7f8d7affd640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f4b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.432+0000 7f8d7affd640 1 -- 172.21.15.37:0/930812219 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561267e421f0 con 0x561267b6b4d0 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.432+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f4b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.433+0000 7f8d7affd640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b6b4d0 0x561267f4b7b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009e40 tx=0x7f8d7000b4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e3e5716e496b4cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:52.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.433+0000 7f8d5affd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.433+0000 7f8d5affd640 1 -- 172.21.15.37:0/930812219 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d70015020 con 0x561267b6b4d0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.433+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d74012dc0 con 0x561267b6b4d0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.433+0000 7f8d5affd640 1 -- 172.21.15.37:0/930812219 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8d70011620 con 0x561267b6b4d0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.433+0000 7f8d5affd640 1 -- 172.21.15.37:0/930812219 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8d700118a0 con 0x561267b6b4d0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.433+0000 7f8d889b5740 10 client.27781 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.434+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x561267bf7790 con 0x561267b6b4d0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.434+0000 7f8d5affd640 1 -- 172.21.15.37:0/930812219 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d74012dc0 con 0x561267b6b4d0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.434+0000 7f8d5affd640 1 -- 172.21.15.37:0/930812219 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f8d70010a40 con 0x561267b6b4d0 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.434+0000 7f8d889b5740 10 client.27781 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.434+0000 7f8d889b5740 10 client.27781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.435+0000 7f8d889b5740 20 client.27781 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.435+0000 7f8d889b5740 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b4ad80 0x561267f58f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.435+0000 7f8d889b5740 4 client.27781 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:16:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.435+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561267ea23d0 con 0x561267b4ad80 2024-05-09T01:16:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.435+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b4ad80 0x561267f58f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.436+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b4ad80 0x561267f58f40 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8409a56d1b3eca server_cookie=bcb0f84b9a3978b6 in_seq=0 out_seq=0 2024-05-09T01:16:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.436+0000 7f8d5affd640 10 client.27781 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.437+0000 7f8d5affd640 1 -- 172.21.15.37:0/930812219 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561267ea23d0 con 0x561267b4ad80 2024-05-09T01:16:52.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.437+0000 7f8d5affd640 10 client.27781 handle_command_reply: tid=0 2024-05-09T01:16:52.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.438+0000 7f8d889b5740 1 client.27781 shutdown 2024-05-09T01:16:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.438+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b6b4d0 msgr2=0x561267f4b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.438+0000 7f8d889b5740 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b6b4d0 0x561267f4b7b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009e40 tx=0x7f8d7000b4b0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.438+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 shutdown_connections 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b4ad80 0x561267f58f40 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b8c1b0 0x561267f52710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d5affd640 0 client.27781 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b6b4d0 0x561267f4b7b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 1 --2- 172.21.15.37:0/930812219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f4b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 >> 172.21.15.37:0/930812219 conn(0x561267b80300 msgr2=0x561267f2eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 shutdown_connections 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 1 -- 172.21.15.37:0/930812219 wait complete. 2024-05-09T01:16:52.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.439+0000 7f8d889b5740 20 client.27781 trim_cache size 0 max 16384 2024-05-09T01:16:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.472+0000 7f8d889b5740 1 Processor -- start 2024-05-09T01:16:52.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.472+0000 7f8d889b5740 1 -- start start 2024-05-09T01:16:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b4ad80 0x561267f33d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b632f0 0x561267f34720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f34c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d889b5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c07c550 con 0x561267b4ad80 2024-05-09T01:16:52.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d889b5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c07e090 con 0x561267b6b4d0 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d889b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c07cc20 con 0x561267b632f0 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b4ad80 0x561267f33d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b4ad80 0x561267f33d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55286/0 (socket says 172.21.15.37:55286) 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d7bfff640 1 -- 172.21.15.37:0/1755996621 learned_addr learned my addr 172.21.15.37:0/1755996621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d7affd640 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b632f0 0x561267f34720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.473+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f34c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.474+0000 7f8d7bfff640 1 -- 172.21.15.37:0/1755996621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b632f0 msgr2=0x561267f34720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:52.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.474+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b632f0 0x561267f34720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.474+0000 7f8d7bfff640 1 -- 172.21.15.37:0/1755996621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 msgr2=0x561267f34c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.474+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f34c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.474+0000 7f8d7bfff640 1 -- 172.21.15.37:0/1755996621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561267c6e5f0 con 0x561267b4ad80 2024-05-09T01:16:52.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.475+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b4ad80 0x561267f33d80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8d74015020 tx=0x7f8d74005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c27032e39e825e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:52.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.476+0000 7f8d617fa640 1 -- 172.21.15.37:0/1755996621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74032070 con 0x561267b4ad80 2024-05-09T01:16:52.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.476+0000 7f8d617fa640 1 -- 172.21.15.37:0/1755996621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d74034040 con 0x561267b4ad80 2024-05-09T01:16:52.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.476+0000 7f8d617fa640 1 -- 172.21.15.37:0/1755996621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74012c90 con 0x561267b4ad80 2024-05-09T01:16:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.478+0000 7f8d889b5740 1 -- 172.21.15.37:0/1755996621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b4ad80 msgr2=0x561267f33d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.479+0000 7f8d889b5740 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b4ad80 0x561267f33d80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8d74015020 tx=0x7f8d74005bd0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.480+0000 7f8d889b5740 1 -- 172.21.15.37:0/1755996621 shutdown_connections 2024-05-09T01:16:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.480+0000 7f8d889b5740 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f34c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.480+0000 7f8d889b5740 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b632f0 0x561267f34720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.480+0000 7f8d889b5740 1 --2- 172.21.15.37:0/1755996621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b4ad80 0x561267f33d80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.480+0000 7f8d889b5740 1 -- 172.21.15.37:0/1755996621 >> 172.21.15.37:0/1755996621 conn(0x561267b80300 msgr2=0x561267f2ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.480+0000 7f8d889b5740 1 -- 172.21.15.37:0/1755996621 shutdown_connections 2024-05-09T01:16:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.480+0000 7f8d889b5740 1 -- 172.21.15.37:0/1755996621 wait complete. 2024-05-09T01:16:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.481+0000 7f8d889b5740 1 -- start start 2024-05-09T01:16:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.481+0000 7f8d889b5740 1 Processor -- start 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.481+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b4ad80 0x561267f51650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.481+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f51b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d889b5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d889b5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c07d9c0 con 0x561267b632f0 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d889b5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c07d2f0 con 0x561267b6b4d0 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d889b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c1183d0 con 0x561267b4ad80 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d889b5740 10 client.0 _ll_register_callbacks cb 0x7f8d70006ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f51b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b4ad80 0x561267f51650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f51b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55288/0 (socket says 172.21.15.37:55288) 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7affd640 1 -- 172.21.15.37:0/2684386394 learned_addr learned my addr 172.21.15.37:0/2684386394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7bfff640 1 -- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 msgr2=0x561267f520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7bfff640 1 -- 172.21.15.37:0/2684386394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 msgr2=0x561267f51b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:16:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f51b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7bfff640 1 -- 172.21.15.37:0/2684386394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561267e58ed0 con 0x561267b4ad80 2024-05-09T01:16:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.482+0000 7f8d7affd640 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f51b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:16:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.483+0000 7f8d7bfff640 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b4ad80 0x561267f51650 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x561267f313a0 tx=0x7f8d74011fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f706866fbeb1fbe6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:16:52.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.483+0000 7f8d5affd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:16:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.483+0000 7f8d5affd640 1 -- 172.21.15.37:0/2684386394 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74032070 con 0x561267b4ad80 2024-05-09T01:16:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.483+0000 7f8d5affd640 1 -- 172.21.15.37:0/2684386394 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8d74004a00 con 0x561267b4ad80 2024-05-09T01:16:52.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.483+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d74034040 con 0x561267b4ad80 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.484+0000 7f8d5affd640 1 -- 172.21.15.37:0/2684386394 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8d74045050 con 0x561267b4ad80 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.484+0000 7f8d889b5740 10 client.27787 fetch_fsmap learned FSMap version 51 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.484+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x561267fc0140 con 0x561267b4ad80 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.484+0000 7f8d5affd640 1 -- 172.21.15.37:0/2684386394 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d740125e0 con 0x561267b4ad80 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.484+0000 7f8d5affd640 1 -- 172.21.15.37:0/2684386394 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f8d74038040 con 0x561267b4ad80 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.485+0000 7f8d889b5740 10 client.27787 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.485+0000 7f8d889b5740 10 client.27787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.485+0000 7f8d889b5740 20 client.27787 populate_metadata read hostname 'smithi037' 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.485+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b8c1b0 0x561267fc27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.485+0000 7f8d889b5740 4 client.27787 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.485+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8d74034040 con 0x561267b8c1b0 2024-05-09T01:16:52.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.485+0000 7f8d7affd640 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b8c1b0 0x561267fc27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:16:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.486+0000 7f8d5affd640 10 client.27787 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:52.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.486+0000 7f8d7affd640 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b8c1b0 0x561267fc27c0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=625e571e35db35d1 server_cookie=e89bb9d66d203c3d in_seq=0 out_seq=0 2024-05-09T01:16:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.496+0000 7f8d5affd640 1 -- 172.21.15.37:0/2684386394 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x7f8d74034040 con 0x561267b8c1b0 2024-05-09T01:16:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.496+0000 7f8d5affd640 10 client.27787 handle_command_reply: tid=0 2024-05-09T01:16:52.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.496+0000 7f8d889b5740 1 client.27787 shutdown 2024-05-09T01:16:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b4ad80 msgr2=0x561267f51650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b4ad80 0x561267f51650 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x561267f313a0 tx=0x7f8d74011fd0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 shutdown_connections 2024-05-09T01:16:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x561267b8c1b0 0x561267fc27c0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x561267b6b4d0 0x561267f520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561267b632f0 0x561267f51b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d5affd640 0 client.27787 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 --2- 172.21.15.37:0/2684386394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561267b4ad80 0x561267f51650 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 >> 172.21.15.37:0/2684386394 conn(0x561267b80300 msgr2=0x561267f2ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 shutdown_connections 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 1 -- 172.21.15.37:0/2684386394 wait complete. 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.497+0000 7f8d889b5740 20 client.27787 trim_cache size 0 max 16384 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:16:52.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.499+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d640b2930 msgr2=0x7f8d640b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.499+0000 7f8d81b00640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d640b2930 0x7f8d640b4e40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0c9b40 tx=0x7f8d6c02a990 comp rx=0 tx=0).stop 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.499+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d7c10b480 msgr2=0x7f8d7c1a93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.499+0000 7f8d81b00640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d7c10b480 0x7f8d7c1a93b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c074a90 tx=0x7f8d6c003c00 comp rx=0 tx=0).stop 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 shutdown_connections 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7c078f20 0x7f8d7c07b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7c1101a0 0x7f8d7c1a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d640b2930 0x7f8d640b4e40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 --2- 172.21.15.37:0/4240984570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d7c10b480 0x7f8d7c1a93b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 >> 172.21.15.37:0/4240984570 conn(0x7f8d7c070670 msgr2=0x7f8d7c10c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 shutdown_connections 2024-05-09T01:16:52.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:16:52.500+0000 7f8d81b00640 1 -- 172.21.15.37:0/4240984570 wait complete. 2024-05-09T01:16:52.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:52 smithi037 ceph-mon[30122]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 1.38k op/s 2024-05-09T01:16:52.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:52 smithi151 ceph-mon[34780]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 1.38k op/s 2024-05-09T01:16:52.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:52 smithi136 ceph-mon[34110]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 26 MiB/s wr, 1.38k op/s 2024-05-09T01:16:53.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:53 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:53.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:53 smithi037 ceph-mon[30122]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:53.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:53 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:53.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:53 smithi151 ceph-mon[34780]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:53 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:53.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:53 smithi136 ceph-mon[34110]: scrub summary: idle+waiting paths [/] 2024-05-09T01:16:54.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:54 smithi037 ceph-mon[30122]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 613 op/s 2024-05-09T01:16:54.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:54 smithi151 ceph-mon[34780]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 613 op/s 2024-05-09T01:16:54.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:54 smithi136 ceph-mon[34110]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 613 op/s 2024-05-09T01:16:55.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 875.0 s, 1585.9 tps, lat 184.289 ms stddev 1306.526 2024-05-09T01:16:56.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:56 smithi037 ceph-mon[30122]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.2 MiB/s wr, 269 op/s 2024-05-09T01:16:56.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:56 smithi151 ceph-mon[34780]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.2 MiB/s wr, 269 op/s 2024-05-09T01:16:56.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:56 smithi136 ceph-mon[34110]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.2 MiB/s wr, 269 op/s 2024-05-09T01:16:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:58 smithi037 ceph-mon[30122]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.4 MiB/s wr, 221 op/s 2024-05-09T01:16:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:58 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:16:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:58 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:16:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:58 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:16:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:58 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:16:58.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:16:58 smithi037 ceph-mon[30122]: scrub summary: idle 2024-05-09T01:16:58.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:58 smithi151 ceph-mon[34780]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.4 MiB/s wr, 221 op/s 2024-05-09T01:16:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:58 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:16:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:58 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:16:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:58 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:16:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:58 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:16:58.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:16:58 smithi151 ceph-mon[34780]: scrub summary: idle 2024-05-09T01:16:58.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:58 smithi136 ceph-mon[34110]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.4 MiB/s wr, 221 op/s 2024-05-09T01:16:58.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:58 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:16:58.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:58 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:16:58.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:58 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:16:58.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:58 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:16:58.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:16:58 smithi136 ceph-mon[34110]: scrub summary: idle 2024-05-09T01:17:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 880.0 s, 1602.0 tps, lat 62.875 ms stddev 71.819 2024-05-09T01:17:00.678 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:00 smithi136 ceph-mon[34110]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-05-09T01:17:00.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:00 smithi037 ceph-mon[30122]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-05-09T01:17:00.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:00 smithi151 ceph-mon[34780]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.7 MiB/s wr, 296 op/s 2024-05-09T01:17:02.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:02 smithi037 ceph-mon[30122]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.4 MiB/s wr, 428 op/s 2024-05-09T01:17:02.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:02 smithi151 ceph-mon[34780]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.4 MiB/s wr, 428 op/s 2024-05-09T01:17:02.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:02 smithi136 ceph-mon[34110]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.4 MiB/s wr, 428 op/s 2024-05-09T01:17:03.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:03 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:17:03.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:03 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:17:03.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:03 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 504 op/s 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:17:04.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 504 op/s 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:17:04.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 7.3 MiB/s wr, 504 op/s 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:17:04.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:17:05.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 885.0 s, 1994.2 tps, lat 50.697 ms stddev 67.719 2024-05-09T01:17:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 -- 172.21.15.37:0/3922221732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 msgr2=0x7f982c1067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 --2- 172.21.15.37:0/3922221732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 0x7f982c1067a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f981c009900 tx=0x7f981c02a410 comp rx=0 tx=0).stop 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 -- 172.21.15.37:0/3922221732 shutdown_connections 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 --2- 172.21.15.37:0/3922221732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f982c1098e0 0x7f982c10bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 --2- 172.21.15.37:0/3922221732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c106d70 0x7f982c109250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 --2- 172.21.15.37:0/3922221732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 0x7f982c1067a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 -- 172.21.15.37:0/3922221732 >> 172.21.15.37:0/3922221732 conn(0x7f982c0fdd40 msgr2=0x7f982c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 -- 172.21.15.37:0/3922221732 shutdown_connections 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.658+0000 7f9831e15640 1 -- 172.21.15.37:0/3922221732 wait complete. 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 Processor -- start 2024-05-09T01:17:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 -- start start 2024-05-09T01:17:05.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 0x7f982c19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c106d70 0x7f982c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f982c1098e0 0x7f982c1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f982c10f770 con 0x7f982c104380 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f982c10f5f0 con 0x7f982c1098e0 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f9831e15640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f982c10f8f0 con 0x7f982c106d70 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 0x7f982c19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 0x7f982c19a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37820/0 (socket says 172.21.15.37:37820) 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.659+0000 7f982b7fe640 1 -- 172.21.15.37:0/3233680838 learned_addr learned my addr 172.21.15.37:0/3233680838 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982affd640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c106d70 0x7f982c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982bfff640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f982c1098e0 0x7f982c1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982bfff640 1 -- 172.21.15.37:0/3233680838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c106d70 msgr2=0x7f982c19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982bfff640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c106d70 0x7f982c19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982bfff640 1 -- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 msgr2=0x7f982c19a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982bfff640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 0x7f982c19a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982bfff640 1 -- 172.21.15.37:0/3233680838 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c1a1e30 con 0x7f982c1098e0 2024-05-09T01:17:05.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982affd640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c106d70 0x7f982c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f982bfff640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f982c1098e0 0x7f982c1a1870 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9824009fd0 tx=0x7f982400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.660+0000 7f9828ff9640 1 -- 172.21.15.37:0/3233680838 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982400ce20 con 0x7f982c1098e0 2024-05-09T01:17:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.661+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1021d0 con 0x7f982c1098e0 2024-05-09T01:17:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.661+0000 7f9828ff9640 1 -- 172.21.15.37:0/3233680838 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9824005020 con 0x7f982c1098e0 2024-05-09T01:17:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.661+0000 7f9828ff9640 1 -- 172.21.15.37:0/3233680838 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824010690 con 0x7f982c1098e0 2024-05-09T01:17:05.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.661+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c102720 con 0x7f982c1098e0 2024-05-09T01:17:05.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 Processor -- start 2024-05-09T01:17:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9828ff9640 1 -- 172.21.15.37:0/3233680838 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9824010830 con 0x7f982c1098e0 2024-05-09T01:17:05.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 -- start start 2024-05-09T01:17:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c8bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c8c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588be4d0 0x562958c93190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562958be77c0 con 0x5629588be4d0 2024-05-09T01:17:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562958b830e0 con 0x5629588b62f0 2024-05-09T01:17:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f9838da5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562958be3780 con 0x5629588df1b0 2024-05-09T01:17:05.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c8c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f982affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588be4d0 0x562958c93190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.666+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c8c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34758/0 (socket says 172.21.15.37:34758) 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982b7fe640 1 -- 172.21.15.37:0/2411212863 learned_addr learned my addr 172.21.15.37:0/2411212863 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982affd640 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c8bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f9828ff9640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98140b2860 0x7f98140b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982bfff640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98140b2860 0x7f98140b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982b7fe640 1 -- 172.21.15.37:0/2411212863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 msgr2=0x562958c8bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982b7fe640 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c8bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982b7fe640 1 -- 172.21.15.37:0/2411212863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588be4d0 msgr2=0x562958c93190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982b7fe640 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588be4d0 0x562958c93190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982b7fe640 1 -- 172.21.15.37:0/2411212863 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562958bac7c0 con 0x5629588b62f0 2024-05-09T01:17:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982affd640 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c8bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f9828ff9640 1 -- 172.21.15.37:0/3233680838 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f98240e2870 con 0x7f982c1098e0 2024-05-09T01:17:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982b7fe640 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c8c290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f981c02a930 tx=0x7f981c004200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb752fa2a7440230 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f982bfff640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98140b2860 0x7f98140b4d70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f982401a040 tx=0x7f982409e800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.667+0000 7f9811ffb640 1 -- 172.21.15.37:0/2411212863 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c035030 con 0x5629588b62f0 2024-05-09T01:17:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.668+0000 7f9811ffb640 1 -- 172.21.15.37:0/2411212863 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f981c040070 con 0x5629588b62f0 2024-05-09T01:17:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.668+0000 7f9811ffb640 1 -- 172.21.15.37:0/2411212863 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c031b30 con 0x5629588b62f0 2024-05-09T01:17:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 -- 172.21.15.37:0/2411212863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 msgr2=0x562958c8c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c8c290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f981c02a930 tx=0x7f981c004200 comp rx=0 tx=0).stop 2024-05-09T01:17:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 -- 172.21.15.37:0/2411212863 shutdown_connections 2024-05-09T01:17:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588be4d0 0x562958c93190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c8c290 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 --2- 172.21.15.37:0/2411212863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c8bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 -- 172.21.15.37:0/2411212863 >> 172.21.15.37:0/2411212863 conn(0x5629588d3300 msgr2=0x562958c876a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.669+0000 7f9838da5740 1 -- 172.21.15.37:0/2411212863 shutdown_connections 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.670+0000 7f9838da5740 1 -- 172.21.15.37:0/2411212863 wait complete. 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.670+0000 7f9838da5740 1 -- start start 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.671+0000 7f9838da5740 1 Processor -- start 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.671+0000 7f9838da5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c959f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.671+0000 7f9838da5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588be4d0 0x562958c95f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.671+0000 7f982affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.671+0000 7f982affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37844/0 (socket says 172.21.15.37:37844) 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.671+0000 7f9838da5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c9ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588be4d0 0x562958c95f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588be4d0 0x562958c95f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34774/0 (socket says 172.21.15.37:34774) 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982affd640 1 -- 172.21.15.37:0/4115147685 learned_addr learned my addr 172.21.15.37:0/4115147685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562958c93b80 con 0x5629588b62f0 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x562958b6e9c0 con 0x5629588be4d0 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562958c93d00 con 0x5629588df1b0 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f9838da5740 10 client.0 _ll_register_callbacks cb 0x562958b9b020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982affd640 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c9ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982b7fe640 1 -- 172.21.15.37:0/4115147685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 msgr2=0x562958c9ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982b7fe640 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c9ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982b7fe640 1 -- 172.21.15.37:0/4115147685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 msgr2=0x562958c959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982b7fe640 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c959f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982b7fe640 1 -- 172.21.15.37:0/4115147685 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562958b951f0 con 0x5629588be4d0 2024-05-09T01:17:05.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.672+0000 7f982affd640 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c9ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f982b7fe640 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588be4d0 0x562958c95f30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f981c006010 tx=0x7f981c02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8124d257ac49e3ce server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f980affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f980affd640 1 -- 172.21.15.37:0/4115147685 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c035070 con 0x5629588be4d0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f981c040070 con 0x5629588be4d0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f980affd640 1 -- 172.21.15.37:0/4115147685 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f981c0037f0 con 0x5629588be4d0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f980affd640 1 -- 172.21.15.37:0/4115147685 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f981c009520 con 0x5629588be4d0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f9838da5740 10 client.27842 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56295894a790 con 0x5629588be4d0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.673+0000 7f980affd640 1 -- 172.21.15.37:0/4115147685 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f981c040070 con 0x5629588be4d0 2024-05-09T01:17:05.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f980affd640 1 -- 172.21.15.37:0/4115147685 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f981c045960 con 0x5629588be4d0 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f9838da5740 10 client.27842 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f9838da5740 10 client.27842 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f9838da5740 20 client.27842 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f9838da5740 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56295889dd80 0x562958ca2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f9838da5740 4 client.27842 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562958bf53d0 con 0x56295889dd80 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f982affd640 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56295889dd80 0x562958ca2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f980affd640 10 client.27842 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:05.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.674+0000 7f982affd640 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56295889dd80 0x562958ca2f30 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f8e4d18d0c0f78 server_cookie=aff9b988a8233ca7 in_seq=0 out_seq=0 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.677+0000 7f980affd640 1 -- 172.21.15.37:0/4115147685 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562958bf53d0 con 0x56295889dd80 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.677+0000 7f980affd640 10 client.27842 handle_command_reply: tid=0 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.677+0000 7f9838da5740 1 client.27842 shutdown 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588be4d0 msgr2=0x562958c95f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588be4d0 0x562958c95f30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f981c006010 tx=0x7f981c02a410 comp rx=0 tx=0).stop 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 shutdown_connections 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x56295889dd80 0x562958ca2f30 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588df1b0 0x562958c9ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588be4d0 0x562958c95f30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 --2- 172.21.15.37:0/4115147685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f980affd640 0 client.27842 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 >> 172.21.15.37:0/4115147685 conn(0x5629588d3300 msgr2=0x562958c7d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 shutdown_connections 2024-05-09T01:17:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 1 -- 172.21.15.37:0/4115147685 wait complete. 2024-05-09T01:17:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.678+0000 7f9838da5740 20 client.27842 trim_cache size 0 max 16384 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 Processor -- start 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 -- start start 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c8eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588df1b0 0x562958c8f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1a8f40 con 0x5629588b62f0 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f982affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c8eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1aaa80 con 0x5629588df1b0 2024-05-09T01:17:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f9838da5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1a9610 con 0x5629588be4d0 2024-05-09T01:17:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f982affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c8eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37850/0 (socket says 172.21.15.37:37850) 2024-05-09T01:17:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f982affd640 1 -- 172.21.15.37:0/2443308405 learned_addr learned my addr 172.21.15.37:0/2443308405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.704+0000 7f982b7fe640 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f982affd640 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588df1b0 0x562958c8f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f982affd640 1 -- 172.21.15.37:0/2443308405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 msgr2=0x562958c9cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f982affd640 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f982affd640 1 -- 172.21.15.37:0/2443308405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588df1b0 msgr2=0x562958c8f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f982affd640 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588df1b0 0x562958c8f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f982affd640 1 -- 172.21.15.37:0/2443308405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629589c15f0 con 0x5629588b62f0 2024-05-09T01:17:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f982affd640 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c8eea0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9820000c00 tx=0x7f9820004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3070dd7dc1f83569 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f98117fa640 1 -- 172.21.15.37:0/2443308405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820004110 con 0x5629588b62f0 2024-05-09T01:17:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f98117fa640 1 -- 172.21.15.37:0/2443308405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98200054d0 con 0x5629588b62f0 2024-05-09T01:17:05.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.705+0000 7f98117fa640 1 -- 172.21.15.37:0/2443308405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98200207e0 con 0x5629588b62f0 2024-05-09T01:17:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 -- 172.21.15.37:0/2443308405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 msgr2=0x562958c8eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c8eea0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9820000c00 tx=0x7f9820004730 comp rx=0 tx=0).stop 2024-05-09T01:17:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 -- 172.21.15.37:0/2443308405 shutdown_connections 2024-05-09T01:17:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588df1b0 0x562958c8f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 --2- 172.21.15.37:0/2443308405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588b62f0 0x562958c8eea0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 -- 172.21.15.37:0/2443308405 >> 172.21.15.37:0/2443308405 conn(0x5629588d3300 msgr2=0x562958c8feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 -- 172.21.15.37:0/2443308405 shutdown_connections 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.707+0000 7f9838da5740 1 -- 172.21.15.37:0/2443308405 wait complete. 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.708+0000 7f9838da5740 1 -- start start 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.708+0000 7f9838da5740 1 Processor -- start 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.708+0000 7f9838da5740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c99b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.708+0000 7f9838da5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c99b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f9838da5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588df1b0 0x562958d09130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c99b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:34784/0 (socket says 172.21.15.37:34784) 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 -- 172.21.15.37:0/2173788251 learned_addr learned my addr 172.21.15.37:0/2173788251 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1aa3b0 con 0x5629588df1b0 2024-05-09T01:17:05.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1a9ce0 con 0x5629588b62f0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1a6f90 con 0x5629588be4d0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982b7fe640 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588df1b0 0x562958d09130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f9838da5740 10 client.0 _ll_register_callbacks cb 0x7f982000ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 -- 172.21.15.37:0/2173788251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 msgr2=0x562958c9a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 -- 172.21.15.37:0/2173788251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588df1b0 msgr2=0x562958d09130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588df1b0 0x562958d09130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 -- 172.21.15.37:0/2173788251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562958babed0 con 0x5629588b62f0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f982affd640 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c99b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9820016010 tx=0x7f982000bba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=146079c142318cfd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.709+0000 7f980affd640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f980affd640 1 -- 172.21.15.37:0/2173788251 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820020760 con 0x5629588b62f0 2024-05-09T01:17:05.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f980affd640 1 -- 172.21.15.37:0/2173788251 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9820020900 con 0x5629588b62f0 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98200054d0 con 0x5629588b62f0 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f980affd640 1 -- 172.21.15.37:0/2173788251 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f98200043a0 con 0x5629588b62f0 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 10 client.27848 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x562958d0a460 con 0x5629588b62f0 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f980affd640 1 -- 172.21.15.37:0/2173788251 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98200054d0 con 0x5629588b62f0 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f980affd640 1 -- 172.21.15.37:0/2173788251 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f9820010630 con 0x5629588b62f0 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 10 client.27848 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 10 client.27848 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 20 client.27848 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5629588731c0 0x562958d0ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 4 client.27848 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:17:05.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562958bef240 con 0x5629588731c0 2024-05-09T01:17:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.710+0000 7f982b7fe640 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5629588731c0 0x562958d0ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.711+0000 7f980affd640 10 client.27848 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:05.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.711+0000 7f982b7fe640 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5629588731c0 0x562958d0ce30 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255cdbbc514961f7 server_cookie=d4192d4831769a82 in_seq=0 out_seq=0 2024-05-09T01:17:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.719+0000 7f980affd640 1 -- 172.21.15.37:0/2173788251 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x562958bef240 con 0x5629588731c0 2024-05-09T01:17:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f980affd640 10 client.27848 handle_command_reply: tid=0 2024-05-09T01:17:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 client.27848 shutdown 2024-05-09T01:17:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 msgr2=0x562958c99b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c99b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9820016010 tx=0x7f982000bba0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 shutdown_connections 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5629588731c0 0x562958d0ce30 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f980affd640 0 client.27848 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629588df1b0 0x562958d09130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5629588be4d0 0x562958c9a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 --2- 172.21.15.37:0/2173788251 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5629588b62f0 0x562958c99b60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 >> 172.21.15.37:0/2173788251 conn(0x5629588d3300 msgr2=0x562958c8eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.720+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 shutdown_connections 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9838da5740 1 -- 172.21.15.37:0/2173788251 wait complete. 2024-05-09T01:17:05.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9838da5740 20 client.27848 trim_cache size 0 max 16384 2024-05-09T01:17:05.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:17:05.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:17:05.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98140b2860 msgr2=0x7f98140b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98140b2860 0x7f98140b4d70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f982401a040 tx=0x7f982409e800 comp rx=0 tx=0).stop 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f982c1098e0 msgr2=0x7f982c1a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f982c1098e0 0x7f982c1a1870 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9824009fd0 tx=0x7f982400ef10 comp rx=0 tx=0).stop 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 shutdown_connections 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f98140b2860 0x7f98140b4d70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f982c1098e0 0x7f982c1a1870 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c106d70 0x7f982c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 --2- 172.21.15.37:0/3233680838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f982c104380 0x7f982c19a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:05.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 >> 172.21.15.37:0/3233680838 conn(0x7f982c0fdd40 msgr2=0x7f982c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:05.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 shutdown_connections 2024-05-09T01:17:05.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:05.721+0000 7f9831e15640 1 -- 172.21.15.37:0/3233680838 wait complete. 2024-05-09T01:17:05.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:05 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi037 to 177.2M 2024-05-09T01:17:05.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:05 smithi037 ceph-mon[30122]: Unable to set osd_memory_target on smithi037 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-09T01:17:05.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:05 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi037 to 177.2M 2024-05-09T01:17:05.726 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:05 smithi151 ceph-mon[34780]: Unable to set osd_memory_target on smithi037 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-09T01:17:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:05 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi037 to 177.2M 2024-05-09T01:17:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:05 smithi136 ceph-mon[34110]: Unable to set osd_memory_target on smithi037 to 185879142: error parsing value: Value '185879142' is below minimum 939524096 2024-05-09T01:17:06.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:06 smithi037 ceph-mon[30122]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.1 MiB/s wr, 545 op/s 2024-05-09T01:17:06.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:06 smithi151 ceph-mon[34780]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.1 MiB/s wr, 545 op/s 2024-05-09T01:17:06.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:06 smithi136 ceph-mon[34110]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.1 MiB/s wr, 545 op/s 2024-05-09T01:17:08.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:08 smithi037 ceph-mon[30122]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.1 MiB/s wr, 660 op/s 2024-05-09T01:17:08.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:08 smithi151 ceph-mon[34780]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.1 MiB/s wr, 660 op/s 2024-05-09T01:17:08.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:08 smithi136 ceph-mon[34110]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.1 MiB/s wr, 660 op/s 2024-05-09T01:17:10.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 890.0 s, 1726.6 tps, lat 57.184 ms stddev 62.016 2024-05-09T01:17:10.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:10 smithi037 ceph-mon[30122]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 628 op/s 2024-05-09T01:17:10.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:10 smithi151 ceph-mon[34780]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 628 op/s 2024-05-09T01:17:10.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:10 smithi136 ceph-mon[34110]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 628 op/s 2024-05-09T01:17:12.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:12 smithi037 ceph-mon[30122]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 681 op/s 2024-05-09T01:17:12.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:12 smithi151 ceph-mon[34780]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 681 op/s 2024-05-09T01:17:12.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:12 smithi136 ceph-mon[34110]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 MiB/s wr, 681 op/s 2024-05-09T01:17:13.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-09T01:17:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:14.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:14 smithi037 ceph-mon[30122]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.9 MiB/s wr, 661 op/s 2024-05-09T01:17:14.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:14 smithi151 ceph-mon[34780]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.9 MiB/s wr, 661 op/s 2024-05-09T01:17:14.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:14 smithi136 ceph-mon[34110]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.9 MiB/s wr, 661 op/s 2024-05-09T01:17:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 895.0 s, 1314.8 tps, lat 76.832 ms stddev 115.545 2024-05-09T01:17:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 -- 172.21.15.37:0/989873776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f01045c0 msgr2=0x7f69f01049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 --2- 172.21.15.37:0/989873776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f01045c0 0x7f69f01049d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099c0 tx=0x7f69e0009cd0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 -- 172.21.15.37:0/989873776 shutdown_connections 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 --2- 172.21.15.37:0/989873776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f0109840 0x7f69f01111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 --2- 172.21.15.37:0/989873776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f01045c0 0x7f69f01049d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 --2- 172.21.15.37:0/989873776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 0x7f69f0109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 -- 172.21.15.37:0/989873776 >> 172.21.15.37:0/989873776 conn(0x7f69f00ffe50 msgr2=0x7f69f01022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 -- 172.21.15.37:0/989873776 shutdown_connections 2024-05-09T01:17:16.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.367+0000 7f69f5884700 1 -- 172.21.15.37:0/989873776 wait complete. 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.368+0000 7f69f5884700 1 Processor -- start 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.368+0000 7f69f5884700 1 -- start start 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69f5884700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f01045c0 0x7f69f01a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69f5884700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 0x7f69f01a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69f5884700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f0109840 0x7f69f01ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69f5884700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0114490 con 0x7f69f0109840 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69f5884700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0114310 con 0x7f69f01045c0 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69f5884700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f69f0114610 con 0x7f69f0108ef0 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 0x7f69f01a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 0x7f69f01a26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39440/0 (socket says 172.21.15.37:39440) 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1484531464 learned_addr learned my addr 172.21.15.37:0/1484531464 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:16.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69eeffd700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f01045c0 0x7f69f01a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f0109840 0x7f69f01ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1484531464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f01045c0 msgr2=0x7f69f01a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f01045c0 0x7f69f01a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f0109840 msgr2=0x7f69f01ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f0109840 0x7f69f01ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 -- 172.21.15.37:0/1484531464 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f01ad730 con 0x7f69f0108ef0 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69eeffd700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f01045c0 0x7f69f01a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:16.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f0109840 0x7f69f01ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.369+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 0x7f69f01a26b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9f0 tx=0x7f69e400edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.370+0000 7f69f4882700 1 -- 172.21.15.37:0/1484531464 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e400cbd0 con 0x7f69f0108ef0 2024-05-09T01:17:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.370+0000 7f69f4882700 1 -- 172.21.15.37:0/1484531464 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e400cd70 con 0x7f69f0108ef0 2024-05-09T01:17:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.370+0000 7f69f4882700 1 -- 172.21.15.37:0/1484531464 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4010430 con 0x7f69f0108ef0 2024-05-09T01:17:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.371+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f01ad900 con 0x7f69f0108ef0 2024-05-09T01:17:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.371+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f01add60 con 0x7f69f0108ef0 2024-05-09T01:17:16.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.375+0000 7f69f4882700 1 -- 172.21.15.37:0/1484531464 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f69e4004750 con 0x7f69f0108ef0 2024-05-09T01:17:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.376+0000 7f69f4882700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69d80b2a50 0x7f69d80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.376+0000 7f6a0429ab80 1 Processor -- start 2024-05-09T01:17:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.376+0000 7f69eeffd700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69d80b2a50 0x7f69d80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.376+0000 7f69f4882700 1 -- 172.21.15.37:0/1484531464 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f69e40e2410 con 0x7f69f0108ef0 2024-05-09T01:17:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.376+0000 7f6a0429ab80 1 -- start start 2024-05-09T01:17:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f69eeffd700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69d80b2a50 0x7f69d80b4f60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69e0003760 tx=0x7f69e001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c96249d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c96249da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c962497ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c9623b9ff0 con 0x55c96231a4a0 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c9623587f0 con 0x55c9624976a0 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c9623b5fb0 con 0x55c962404160 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f69eeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c96249d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f69eeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c96249d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39442/0 (socket says 172.21.15.37:39442) 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.377+0000 7f69eeffd700 1 -- 172.21.15.37:0/2814498530 learned_addr learned my addr 172.21.15.37:0/2814498530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69eeffd700 1 -- 172.21.15.37:0/2814498530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 msgr2=0x55c962497ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69eeffd700 1 --2- 172.21.15.37:0/2814498530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c962497ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69eeffd700 1 -- 172.21.15.37:0/2814498530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 msgr2=0x55c96249da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69eeffd700 1 --2- 172.21.15.37:0/2814498530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c96249da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69eeffd700 1 -- 172.21.15.37:0/2814498530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c962350370 con 0x55c962404160 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69eeffd700 1 --2- 172.21.15.37:0/2814498530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c96249d4f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099c0 tx=0x7f69e001e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2adb34570f265568 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69d5ffb700 1 -- 172.21.15.37:0/2814498530 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e000b790 con 0x55c962404160 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.378+0000 7f69d5ffb700 1 -- 172.21.15.37:0/2814498530 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e000bde0 con 0x55c962404160 2024-05-09T01:17:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.379+0000 7f69d5ffb700 1 -- 172.21.15.37:0/2814498530 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e002fd80 con 0x55c962404160 2024-05-09T01:17:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.379+0000 7f6a0429ab80 1 -- 172.21.15.37:0/2814498530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 msgr2=0x55c96249d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/2814498530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c96249d4f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099c0 tx=0x7f69e001e000 comp rx=0 tx=0).stop 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 -- 172.21.15.37:0/2814498530 shutdown_connections 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/2814498530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c962497ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/2814498530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c96249d4f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/2814498530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c96249da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 -- 172.21.15.37:0/2814498530 >> 172.21.15.37:0/2814498530 conn(0x55c96237a6a0 msgr2=0x55c962492400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 -- 172.21.15.37:0/2814498530 shutdown_connections 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.380+0000 7f6a0429ab80 1 -- 172.21.15.37:0/2814498530 wait complete. 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.381+0000 7f6a0429ab80 1 -- start start 2024-05-09T01:17:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.381+0000 7f6a0429ab80 1 Processor -- start 2024-05-09T01:17:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c9624a1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9624976a0 0x55c9624a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c962235ba0 con 0x55c9624976a0 2024-05-09T01:17:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c962374150 con 0x55c96231a4a0 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c9624a41d0 con 0x55c962404160 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9624976a0 0x55c9624a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f6a0429ab80 10 client.0 _ll_register_callbacks cb 0x55c96222b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39448/0 (socket says 172.21.15.37:39448) 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 -- 172.21.15.37:0/524023725 learned_addr learned my addr 172.21.15.37:0/524023725 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69eeffd700 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c9624a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 -- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 msgr2=0x55c9624a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c9624a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 -- 172.21.15.37:0/524023725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9624976a0 msgr2=0x55c9624a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9624976a0 0x55c9624a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.382+0000 7f69ee7fc700 1 -- 172.21.15.37:0/524023725 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c962235490 con 0x55c962404160 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a1770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f69e40a9730 tx=0x7f69e40a5240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49c616d1b0f11f54 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f69ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f69ceffd700 1 -- 172.21.15.37:0/524023725 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e40c2020 con 0x55c962404160 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f69ceffd700 1 -- 172.21.15.37:0/524023725 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f69e4016330 con 0x55c962404160 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e000bde0 con 0x55c962404160 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f69ceffd700 1 -- 172.21.15.37:0/524023725 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f69e4016550 con 0x55c962404160 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f6a0429ab80 10 client.27811 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.383+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55c9624aeb80 con 0x55c962404160 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f69ceffd700 1 -- 172.21.15.37:0/524023725 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e000bde0 con 0x55c962404160 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f69ceffd700 1 -- 172.21.15.37:0/524023725 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f69e40cace0 con 0x55c962404160 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f6a0429ab80 10 client.27811 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f6a0429ab80 10 client.27811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f6a0429ab80 20 client.27811 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c9624b10a0 0x55c9624b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f6a0429ab80 4 client.27811 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.384+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9623c79d0 con 0x55c9624b10a0 2024-05-09T01:17:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.385+0000 7f69eeffd700 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c9624b10a0 0x55c9624b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.386+0000 7f69eeffd700 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c9624b10a0 0x55c9624b34c0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c94613b38a59eb55 server_cookie=c671350ecae31dbb in_seq=0 out_seq=0 2024-05-09T01:17:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.386+0000 7f69ceffd700 10 client.27811 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f69ceffd700 1 -- 172.21.15.37:0/524023725 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c9623c79d0 con 0x55c9624b10a0 2024-05-09T01:17:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f69ceffd700 10 client.27811 handle_command_reply: tid=0 2024-05-09T01:17:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 client.27811 shutdown 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 msgr2=0x55c9624a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a1770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f69e40a9730 tx=0x7f69e40a5240 comp rx=0 tx=0).stop 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 shutdown_connections 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c9624b10a0 0x55c9624b34c0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9624976a0 0x55c9624a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c9624a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/524023725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a1770 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f69ceffd700 0 client.27811 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 >> 172.21.15.37:0/524023725 conn(0x55c96237a6a0 msgr2=0x55c9624921c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 shutdown_connections 2024-05-09T01:17:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.387+0000 7f6a0429ab80 1 -- 172.21.15.37:0/524023725 wait complete. 2024-05-09T01:17:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.388+0000 7f6a0429ab80 20 client.27811 trim_cache size 0 max 16384 2024-05-09T01:17:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.414+0000 7f6a0429ab80 1 Processor -- start 2024-05-09T01:17:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.414+0000 7f6a0429ab80 1 -- start start 2024-05-09T01:17:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c96249b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c962404160 0x55c9624acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c9624976a0 0x55c9624a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01b5100 con 0x55c962404160 2024-05-09T01:17:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c962404160 0x55c9624acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c962404160 0x55c9624acf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37680/0 (socket says 172.21.15.37:37680) 2024-05-09T01:17:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f69ee7fc700 1 -- 172.21.15.37:0/3792496050 learned_addr learned my addr 172.21.15.37:0/3792496050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3792496050 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01b6c40 con 0x55c96231a4a0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3792496050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01b57d0 con 0x55c9624976a0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.415+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c9624976a0 0x55c9624a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69eeffd700 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c96249b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69ef7fe700 1 -- 172.21.15.37:0/3792496050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 msgr2=0x55c96249b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c96249b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69ef7fe700 1 -- 172.21.15.37:0/3792496050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c962404160 msgr2=0x55c9624acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c962404160 0x55c9624acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69ef7fe700 1 -- 172.21.15.37:0/3792496050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9624a1000 con 0x55c9624976a0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c9624976a0 0x55c9624a11f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009c60 tx=0x7f69e8009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b2df5f1c03ea4e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.416+0000 7f69d57fa700 1 -- 172.21.15.37:0/3792496050 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8007cc0 con 0x55c9624976a0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.417+0000 7f69d57fa700 1 -- 172.21.15.37:0/3792496050 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e8004bb0 con 0x55c9624976a0 2024-05-09T01:17:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.417+0000 7f69d57fa700 1 -- 172.21.15.37:0/3792496050 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8004670 con 0x55c9624976a0 2024-05-09T01:17:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3792496050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c9624976a0 msgr2=0x55c9624a11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c9624976a0 0x55c9624a11f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009c60 tx=0x7f69e8009f70 comp rx=0 tx=0).stop 2024-05-09T01:17:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3792496050 shutdown_connections 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c9624976a0 0x55c9624a11f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c96231a4a0 0x55c96249b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3792496050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c962404160 0x55c9624acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3792496050 >> 172.21.15.37:0/3792496050 conn(0x55c96237a6a0 msgr2=0x55c96249ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3792496050 shutdown_connections 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3792496050 wait complete. 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.418+0000 7f6a0429ab80 1 -- start start 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 1 Processor -- start 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c9624a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c9624b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01b6570 con 0x55c96231a4a0 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01b5ea0 con 0x55c9624976a0 2024-05-09T01:17:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f69f01b30c0 con 0x55c962404160 2024-05-09T01:17:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f6a0429ab80 10 client.0 _ll_register_callbacks cb 0x55c96222b6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.419+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69ee7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39466/0 (socket says 172.21.15.37:39466) 2024-05-09T01:17:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69ee7fc700 1 -- 172.21.15.37:0/3161057920 learned_addr learned my addr 172.21.15.37:0/3161057920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69eeffd700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c9624a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c9624b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69ee7fc700 1 -- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 msgr2=0x55c9624b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c9624b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69ee7fc700 1 -- 172.21.15.37:0/3161057920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 msgr2=0x55c9624a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.420+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c9624a92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.421+0000 7f69ee7fc700 1 -- 172.21.15.37:0/3161057920 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9624b8390 con 0x55c962404160 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.421+0000 7f69ef7fe700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c9624b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.421+0000 7f69eeffd700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c9624a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f69ee7fc700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a9850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f69e40a9730 tx=0x7f69e4005190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e88e7b2023804c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f69ceffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f69ceffd700 1 -- 172.21.15.37:0/3161057920 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e40ca070 con 0x55c962404160 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f69ceffd700 1 -- 172.21.15.37:0/3161057920 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f69e40cc2c0 con 0x55c962404160 2024-05-09T01:17:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e8004bb0 con 0x55c962404160 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f69ceffd700 1 -- 172.21.15.37:0/3161057920 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f69e40a9a30 con 0x55c962404160 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f6a0429ab80 10 client.27817 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.423+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55c96251b1e0 con 0x55c962404160 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f69ceffd700 1 -- 172.21.15.37:0/3161057920 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e40adde0 con 0x55c962404160 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f69ceffd700 1 -- 172.21.15.37:0/3161057920 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f69e40ba070 con 0x55c962404160 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f6a0429ab80 10 client.27817 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f6a0429ab80 10 client.27817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f6a0429ab80 20 client.27817 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c96251b920 0x55c96251dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f6a0429ab80 4 client.27817 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f69e8004bb0 con 0x55c96251b920 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.424+0000 7f69eeffd700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c96251b920 0x55c96251dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.425+0000 7f69ceffd700 10 client.27817 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.425+0000 7f69eeffd700 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c96251b920 0x55c96251dd40 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1e6c9dec606df42 server_cookie=dc814122e1b52fca in_seq=0 out_seq=0 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.425+0000 7f69ceffd700 1 -- 172.21.15.37:0/3161057920 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f69e8004bb0 con 0x55c96251b920 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.425+0000 7f69ceffd700 10 client.27817 handle_command_reply: tid=0 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.425+0000 7f6a0429ab80 1 client.27817 shutdown 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.425+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 msgr2=0x55c9624a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.425+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a9850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f69e40a9730 tx=0x7f69e4005190 comp rx=0 tx=0).stop 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 shutdown_connections 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55c96251b920 0x55c96251dd40 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f69ceffd700 0 client.27817 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c9624976a0 0x55c9624b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c96231a4a0 0x55c9624a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 --2- 172.21.15.37:0/3161057920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c962404160 0x55c9624a9850 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 >> 172.21.15.37:0/3161057920 conn(0x55c96237a6a0 msgr2=0x55c96249b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 shutdown_connections 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 1 -- 172.21.15.37:0/3161057920 wait complete. 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.426+0000 7f6a0429ab80 20 client.27817 trim_cache size 0 max 16384 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-05-09T01:17:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:17:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69d80b2a50 msgr2=0x7f69d80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69d80b2a50 0x7f69d80b4f60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f69e0003760 tx=0x7f69e001a040 comp rx=0 tx=0).stop 2024-05-09T01:17:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 msgr2=0x7f69f01a26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 0x7f69f01a26b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f69e400e9f0 tx=0x7f69e400edb0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 shutdown_connections 2024-05-09T01:17:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f69d80b2a50 0x7f69d80b4f60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f0109840 0x7f69f01ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f69f01045c0 0x7f69f01a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 --2- 172.21.15.37:0/1484531464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f0108ef0 0x7f69f01a26b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 >> 172.21.15.37:0/1484531464 conn(0x7f69f00ffe50 msgr2=0x7f69f0102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 shutdown_connections 2024-05-09T01:17:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:16.427+0000 7f69f5884700 1 -- 172.21.15.37:0/1484531464 wait complete. 2024-05-09T01:17:16.478 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:16 smithi037 ceph-mon[30122]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.3 MiB/s wr, 635 op/s 2024-05-09T01:17:16.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:16 smithi151 ceph-mon[34780]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.3 MiB/s wr, 635 op/s 2024-05-09T01:17:16.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:16 smithi136 ceph-mon[34110]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.3 MiB/s wr, 635 op/s 2024-05-09T01:17:17.305 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T01:17:17.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:17:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:18.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:18 smithi037 ceph-mon[30122]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 787 op/s 2024-05-09T01:17:18.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:18 smithi151 ceph-mon[34780]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 787 op/s 2024-05-09T01:17:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.858+0000 7fb5bb429640 1 -- 172.21.15.37:0/2563540860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b41070d0 msgr2=0x7fb5b41094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.858+0000 7fb5bb429640 1 --2- 172.21.15.37:0/2563540860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b41070d0 0x7fb5b41094f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009900 tx=0x7fb5a402a410 comp rx=0 tx=0).stop 2024-05-09T01:17:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.859+0000 7fb5bb429640 1 -- 172.21.15.37:0/2563540860 shutdown_connections 2024-05-09T01:17:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.860+0000 7fb5bb429640 1 --2- 172.21.15.37:0/2563540860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4109a30 0x7fb5b410be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.860+0000 7fb5bb429640 1 --2- 172.21.15.37:0/2563540860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b41070d0 0x7fb5b41094f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.860+0000 7fb5bb429640 1 --2- 172.21.15.37:0/2563540860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5b4104770 0x7fb5b4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.860+0000 7fb5bb429640 1 -- 172.21.15.37:0/2563540860 >> 172.21.15.37:0/2563540860 conn(0x7fb5b40fdd90 msgr2=0x7fb5b4100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.860+0000 7fb5bb429640 1 -- 172.21.15.37:0/2563540860 shutdown_connections 2024-05-09T01:17:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.860+0000 7fb5bb429640 1 -- 172.21.15.37:0/2563540860 wait complete. 2024-05-09T01:17:18.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 Processor -- start 2024-05-09T01:17:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 -- start start 2024-05-09T01:17:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4104770 0x7fb5b419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5b41070d0 0x7fb5b419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b4109a30 0x7fb5b41a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b410f7b0 con 0x7fb5b4109a30 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b410f630 con 0x7fb5b41070d0 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5bb429640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b410f930 con 0x7fb5b4104770 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5b99c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b4109a30 0x7fb5b41a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4104770 0x7fb5b419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5b99c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b4109a30 0x7fb5b41a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37710/0 (socket says 172.21.15.37:37710) 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5b89c4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5b41070d0 0x7fb5b419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5b99c6640 1 -- 172.21.15.37:0/3257035052 learned_addr learned my addr 172.21.15.37:0/3257035052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.861+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4104770 0x7fb5b419a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39474/0 (socket says 172.21.15.37:39474) 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5b99c6640 1 -- 172.21.15.37:0/3257035052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4104770 msgr2=0x7fb5b419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5b99c6640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4104770 0x7fb5b419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5b99c6640 1 -- 172.21.15.37:0/3257035052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5b41070d0 msgr2=0x7fb5b419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5b99c6640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5b41070d0 0x7fb5b419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5b99c6640 1 -- 172.21.15.37:0/3257035052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b41a1ec0 con 0x7fb5b4109a30 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4104770 0x7fb5b419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5b99c6640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b4109a30 0x7fb5b41a1850 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00e970 tx=0x7fb5ac00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5aa7fc640 1 -- 172.21.15.37:0/3257035052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00ccc0 con 0x7fb5b4109a30 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b41a21b0 con 0x7fb5b4109a30 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5aa7fc640 1 -- 172.21.15.37:0/3257035052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5ac0054d0 con 0x7fb5b4109a30 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5aa7fc640 1 -- 172.21.15.37:0/3257035052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac010430 con 0x7fb5b4109a30 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.862+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b41a2700 con 0x7fb5b4109a30 2024-05-09T01:17:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.866+0000 7fb5c23b1740 1 Processor -- start 2024-05-09T01:17:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.866+0000 7fb5aa7fc640 1 -- 172.21.15.37:0/3257035052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb5ac0105d0 con 0x7fb5b4109a30 2024-05-09T01:17:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5c23b1740 1 -- start start 2024-05-09T01:17:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e82f2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f252f0 0x5579e82f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f2d4d0 0x5579e82f9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5579e82567c0 con 0x5579e7f2d4d0 2024-05-09T01:17:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5579e81f20e0 con 0x5579e7f4e1b0 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5579e8252780 con 0x5579e7f252f0 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f252f0 0x5579e82f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f252f0 0x5579e82f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39478/0 (socket says 172.21.15.37:39478) 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3758625199 learned_addr learned my addr 172.21.15.37:0/3758625199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f2d4d0 0x5579e82f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e82f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3758625199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 msgr2=0x5579e82f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e82f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3758625199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f2d4d0 msgr2=0x5579e82f9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.867+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f2d4d0 0x5579e82f9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3758625199 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e821b7c0 con 0x5579e7f252f0 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e82f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb5aa7fc640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb5a00b27e0 0x7fb5a00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f252f0 0x5579e82f2a80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00107b0 tx=0x7fb5b0010c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d52a6c0c53b63b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb5a00b27e0 0x7fb5a00b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb59f7fe640 1 -- 172.21.15.37:0/3758625199 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0016070 con 0x5579e7f252f0 2024-05-09T01:17:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb5aa7fc640 1 -- 172.21.15.37:0/3257035052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb5ac0e24d0 con 0x7fb5b4109a30 2024-05-09T01:17:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb59f7fe640 1 -- 172.21.15.37:0/3758625199 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5b001b460 con 0x5579e7f252f0 2024-05-09T01:17:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.868+0000 7fb59f7fe640 1 -- 172.21.15.37:0/3758625199 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0012650 con 0x5579e7f252f0 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3758625199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f252f0 msgr2=0x5579e82f2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb5a00b27e0 0x7fb5a00b4cf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009230 tx=0x7fb5a403f040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f252f0 0x5579e82f2a80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb5b00107b0 tx=0x7fb5b0010c70 comp rx=0 tx=0).stop 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3758625199 shutdown_connections 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f2d4d0 0x5579e82f9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f252f0 0x5579e82f2a80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3758625199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e82f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3758625199 >> 172.21.15.37:0/3758625199 conn(0x5579e7f42300 msgr2=0x5579e82ede90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3758625199 shutdown_connections 2024-05-09T01:17:18.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3758625199 wait complete. 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.870+0000 7fb5c23b1740 1 -- start start 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 1 Processor -- start 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82fc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e82fc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e83036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5579e82fa3d0 con 0x5579e7f252f0 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5579e81dd9c0 con 0x5579e7f4e1b0 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5579e82fa550 con 0x5579e7f2d4d0 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82fc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82fc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37726/0 (socket says 172.21.15.37:37726) 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3078422144 learned_addr learned my addr 172.21.15.37:0/3078422144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5c23b1740 10 client.0 _ll_register_callbacks cb 0x5579e820a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e82fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.871+0000 7fb5b99c6640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e83036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3078422144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 msgr2=0x5579e82fc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e82fc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 msgr2=0x5579e83036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e83036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3078422144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e82041f0 con 0x5579e7f252f0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb5b99c6640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e83036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82fc200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0006010 tx=0x7fb5b001b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a31fbf266953c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb59cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb59cff9640 1 -- 172.21.15.37:0/3078422144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0016070 con 0x5579e7f252f0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.872+0000 7fb59cff9640 1 -- 172.21.15.37:0/3078422144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb5b0003970 con 0x5579e7f252f0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.873+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5b001b460 con 0x5579e7f252f0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.873+0000 7fb59cff9640 1 -- 172.21.15.37:0/3078422144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb5b0003b70 con 0x5579e7f252f0 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.873+0000 7fb5c23b1740 10 client.17943 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.873+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5579e7fb9790 con 0x5579e7f252f0 2024-05-09T01:17:18.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb59cff9640 1 -- 172.21.15.37:0/3078422144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5b001b460 con 0x5579e7f252f0 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb59cff9640 1 -- 172.21.15.37:0/3078422144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fb5b000f040 con 0x5579e7f252f0 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb5c23b1740 10 client.17943 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb5c23b1740 10 client.17943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb5c23b1740 20 client.17943 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7f0cd80 0x5579e83097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb5c23b1740 4 client.17943 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579e82643d0 con 0x5579e7f0cd80 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.874+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7f0cd80 0x5579e83097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.875+0000 7fb59cff9640 10 client.17943 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.875+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7f0cd80 0x5579e83097c0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ccaeeb14acf4a00 server_cookie=fb8c764e1728325b in_seq=0 out_seq=0 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb59cff9640 1 -- 172.21.15.37:0/3078422144 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5579e82643d0 con 0x5579e7f0cd80 2024-05-09T01:17:18.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb59cff9640 10 client.17943 handle_command_reply: tid=0 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 client.17943 shutdown 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 msgr2=0x5579e82fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82fc200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0006010 tx=0x7fb5b001b840 comp rx=0 tx=0).stop 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 shutdown_connections 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7f0cd80 0x5579e83097c0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f4e1b0 0x5579e83036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb59cff9640 0 client.17943 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e82fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3078422144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82fc200 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 >> 172.21.15.37:0/3078422144 conn(0x5579e7f42300 msgr2=0x5579e82ec700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 shutdown_connections 2024-05-09T01:17:18.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3078422144 wait complete. 2024-05-09T01:17:18.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.876+0000 7fb5c23b1740 20 client.17943 trim_cache size 0 max 16384 2024-05-09T01:17:18.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:18 smithi136 ceph-mon[34110]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 787 op/s 2024-05-09T01:17:18.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 Processor -- start 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 -- start start 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82edf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f2d4d0 0x5579e83035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f4e1b0 0x5579e8303b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41ab3f0 con 0x5579e7f252f0 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41acf30 con 0x5579e7f2d4d0 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41abac0 con 0x5579e7f4e1b0 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82edf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37738/0 (socket says 172.21.15.37:37738) 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5b99c6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f4e1b0 0x5579e8303b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3560069263 learned_addr learned my addr 172.21.15.37:0/3560069263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.895+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f2d4d0 0x5579e83035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3560069263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f4e1b0 msgr2=0x5579e8303b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f4e1b0 0x5579e8303b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3560069263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f2d4d0 msgr2=0x5579e83035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f2d4d0 0x5579e83035c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b91c5640 1 -- 172.21.15.37:0/3560069263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579e80305f0 con 0x5579e7f252f0 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b99c6640 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f4e1b0 0x5579e8303b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f2d4d0 0x5579e83035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82edf60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0010700 tx=0x7fb5b0010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6cbd6e2661c10f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb59effd640 1 -- 172.21.15.37:0/3560069263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0033030 con 0x5579e7f252f0 2024-05-09T01:17:18.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb59effd640 1 -- 172.21.15.37:0/3560069263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5b0003970 con 0x5579e7f252f0 2024-05-09T01:17:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.896+0000 7fb59effd640 1 -- 172.21.15.37:0/3560069263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0016040 con 0x5579e7f252f0 2024-05-09T01:17:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.897+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3560069263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 msgr2=0x5579e82edf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.897+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82edf60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0010700 tx=0x7fb5b0010c70 comp rx=0 tx=0).stop 2024-05-09T01:17:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.897+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3560069263 shutdown_connections 2024-05-09T01:17:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.897+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f4e1b0 0x5579e8303b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.897+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f2d4d0 0x5579e83035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.897+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3560069263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f252f0 0x5579e82edf60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.897+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3560069263 >> 172.21.15.37:0/3560069263 conn(0x5579e7f42300 msgr2=0x5579e82ed850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.898+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3560069263 shutdown_connections 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.898+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3560069263 wait complete. 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.898+0000 7fb5c23b1740 1 -- start start 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.898+0000 7fb5c23b1740 1 Processor -- start 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f252f0 0x5579e83011b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e83016f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5c23b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f4e1b0 0x5579e8302620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e83016f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f252f0 0x5579e83011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41ac860 con 0x5579e7f4e1b0 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41ac190 con 0x5579e7f252f0 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5c23b1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b41a93f0 con 0x5579e7f2d4d0 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e83016f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39518/0 (socket says 172.21.15.37:39518) 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b91c5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f252f0 0x5579e83011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39048/0 (socket says 172.21.15.37:39048) 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 -- 172.21.15.37:0/3040974991 learned_addr learned my addr 172.21.15.37:0/3040974991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5c23b1740 10 client.0 _ll_register_callbacks cb 0x7fb5b0010630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 -- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f252f0 msgr2=0x5579e83011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f252f0 0x5579e83011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 -- 172.21.15.37:0/3040974991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f4e1b0 msgr2=0x5579e8302620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f4e1b0 0x5579e8302620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.899+0000 7fb5b89c4640 1 -- 172.21.15.37:0/3040974991 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579e821aed0 con 0x5579e7f2d4d0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f252f0 0x5579e83011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb5b89c4640 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e83016f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009900 tx=0x7fb5a4031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=685fd209342f04e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb59cff9640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb59cff9640 1 -- 172.21.15.37:0/3040974991 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4035040 con 0x5579e7f2d4d0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb59cff9640 1 -- 172.21.15.37:0/3040974991 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fb5a4044070 con 0x5579e7f2d4d0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5b0003970 con 0x5579e7f2d4d0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb59cff9640 1 -- 172.21.15.37:0/3040974991 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fb5a4066050 con 0x5579e7f2d4d0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb5c23b1740 10 client.27835 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.900+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5579e8303d50 con 0x5579e7f2d4d0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb59cff9640 1 -- 172.21.15.37:0/3040974991 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5b0003970 con 0x5579e7f2d4d0 2024-05-09T01:17:18.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb59cff9640 1 -- 172.21.15.37:0/3040974991 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fb5a40533e0 con 0x5579e7f2d4d0 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5c23b1740 10 client.27835 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5c23b1740 10 client.27835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5c23b1740 20 client.27835 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7ee21c0 0x5579e8373d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5c23b1740 4 client.27835 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5579e825e240 con 0x5579e7ee21c0 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7ee21c0 0x5579e8373d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb59cff9640 10 client.27835 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.901+0000 7fb5b91c5640 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7ee21c0 0x5579e8373d80 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2555fb76ca88fd59 server_cookie=edaf0c6dc7f96617 in_seq=0 out_seq=0 2024-05-09T01:17:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.911+0000 7fb59cff9640 1 -- 172.21.15.37:0/3040974991 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5579e825e240 con 0x5579e7ee21c0 2024-05-09T01:17:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.911+0000 7fb59cff9640 10 client.27835 handle_command_reply: tid=0 2024-05-09T01:17:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.911+0000 7fb5c23b1740 1 client.27835 shutdown 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 msgr2=0x5579e83016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e83016f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009900 tx=0x7fb5a4031400 comp rx=0 tx=0).stop 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 shutdown_connections 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5579e7ee21c0 0x5579e8373d80 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579e7f4e1b0 0x5579e8302620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579e7f2d4d0 0x5579e83016f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 --2- 172.21.15.37:0/3040974991 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5579e7f252f0 0x5579e83011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb59cff9640 0 client.27835 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.912+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 >> 172.21.15.37:0/3040974991 conn(0x5579e7f42300 msgr2=0x5579e82fbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.913+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 shutdown_connections 2024-05-09T01:17:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.917+0000 7fb5c23b1740 1 -- 172.21.15.37:0/3040974991 wait complete. 2024-05-09T01:17:18.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.921+0000 7fb5c23b1740 20 client.27835 trim_cache size 0 max 16384 2024-05-09T01:17:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:17:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:17:18.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:17:18.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.931+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb5a00b27e0 msgr2=0x7fb5a00b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.931+0000 7fb5bb429640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb5a00b27e0 0x7fb5a00b4cf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009230 tx=0x7fb5a403f040 comp rx=0 tx=0).stop 2024-05-09T01:17:18.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.932+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b4109a30 msgr2=0x7fb5b41a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:18.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.932+0000 7fb5bb429640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b4109a30 0x7fb5b41a1850 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00e970 tx=0x7fb5ac00ee30 comp rx=0 tx=0).stop 2024-05-09T01:17:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.937+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 shutdown_connections 2024-05-09T01:17:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.937+0000 7fb5bb429640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5b4109a30 0x7fb5b41a1850 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.937+0000 7fb5bb429640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fb5a00b27e0 0x7fb5a00b4cf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.937+0000 7fb5bb429640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5b41070d0 0x7fb5b419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.937+0000 7fb5bb429640 1 --2- 172.21.15.37:0/3257035052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4104770 0x7fb5b419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.937+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 >> 172.21.15.37:0/3257035052 conn(0x7fb5b40fdd90 msgr2=0x7fb5b4105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:18.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.942+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 shutdown_connections 2024-05-09T01:17:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:18.943+0000 7fb5bb429640 1 -- 172.21.15.37:0/3257035052 wait complete. 2024-05-09T01:17:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.803+0000 7f92ef106700 1 -- 172.21.15.37:0/412405254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 msgr2=0x7f92e81177e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.804+0000 7f92ef106700 1 --2- 172.21.15.37:0/412405254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e81177e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f92d801a9a0 tx=0x7f92d801acb0 comp rx=0 tx=0).stop 2024-05-09T01:17:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.807+0000 7f92ef106700 1 -- 172.21.15.37:0/412405254 shutdown_connections 2024-05-09T01:17:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.807+0000 7f92ef106700 1 --2- 172.21.15.37:0/412405254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e81177e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.807+0000 7f92ef106700 1 --2- 172.21.15.37:0/412405254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e810b8a0 0x7f92e810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.807+0000 7f92ef106700 1 --2- 172.21.15.37:0/412405254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8110660 0x7f92e8110a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.807+0000 7f92ef106700 1 -- 172.21.15.37:0/412405254 >> 172.21.15.37:0/412405254 conn(0x7f92e807a020 msgr2=0x7f92e807c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.807+0000 7f92ef106700 1 -- 172.21.15.37:0/412405254 shutdown_connections 2024-05-09T01:17:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.807+0000 7f92ef106700 1 -- 172.21.15.37:0/412405254 wait complete. 2024-05-09T01:17:19.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.808+0000 7f92ef106700 1 Processor -- start 2024-05-09T01:17:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ef106700 1 -- start start 2024-05-09T01:17:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ef106700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e810b8a0 0x7f92e8117660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ef106700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8110660 0x7f92e81137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ef106700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e8113ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ef106700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92e806f9f0 con 0x7f92e810b8a0 2024-05-09T01:17:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ef106700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92e806f870 con 0x7f92e8110fb0 2024-05-09T01:17:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ef106700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92e806fb70 con 0x7f92e8110660 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ed6a3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e8113ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ed6a3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e8113ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:39056/0 (socket says 172.21.15.37:39056) 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.809+0000 7f92ed6a3700 1 -- 172.21.15.37:0/2722024206 learned_addr learned my addr 172.21.15.37:0/2722024206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.810+0000 7f92e7fff700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8110660 0x7f92e81137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.810+0000 7f92ed6a3700 1 -- 172.21.15.37:0/2722024206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8110660 msgr2=0x7f92e81137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.810+0000 7f92ed6a3700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8110660 0x7f92e81137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.810+0000 7f92ed6a3700 1 -- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e810b8a0 msgr2=0x7f92e8117660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.810+0000 7f92ed6a3700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e810b8a0 0x7f92e8117660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.810+0000 7f92ed6a3700 1 -- 172.21.15.37:0/2722024206 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e81144f0 con 0x7f92e8110fb0 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.811+0000 7f92ed6a3700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e8113ce0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f92d801a8f0 tx=0x7f92d8003bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.811+0000 7f92e5ffb700 1 -- 172.21.15.37:0/2722024206 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8004030 con 0x7f92e8110fb0 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.811+0000 7f92e5ffb700 1 -- 172.21.15.37:0/2722024206 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92d80041d0 con 0x7f92e8110fb0 2024-05-09T01:17:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.811+0000 7f92e5ffb700 1 -- 172.21.15.37:0/2722024206 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92d8004d60 con 0x7f92e8110fb0 2024-05-09T01:17:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.812+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e81a50e0 con 0x7f92e8110fb0 2024-05-09T01:17:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.813+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e81a54e0 con 0x7f92e8110fb0 2024-05-09T01:17:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.814+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e807ead0 con 0x7f92e8110fb0 2024-05-09T01:17:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.816+0000 7f92e5ffb700 1 -- 172.21.15.37:0/2722024206 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f92d80044e0 con 0x7f92e8110fb0 2024-05-09T01:17:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.818+0000 7f92e5ffb700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d00b2a90 0x7f92d00b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:19.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.818+0000 7f92e5ffb700 1 -- 172.21.15.37:0/2722024206 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f92d80f3f00 con 0x7f92e8110fb0 2024-05-09T01:17:19.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.818+0000 7f92ecea2700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d00b2a90 0x7f92d00b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:19.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.819+0000 7f92ecea2700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d00b2a90 0x7f92d00b4fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f92dc005950 tx=0x7f92dc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:19.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:19.822+0000 7f92e5ffb700 1 -- 172.21.15.37:0/2722024206 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f92d803e060 con 0x7f92e8110fb0 2024-05-09T01:17:20.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.223+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92e802e5f0 con 0x7f92e8110fb0 2024-05-09T01:17:20.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.224+0000 7f92e5ffb700 1 -- 172.21.15.37:0/2722024206 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11936 (secure 0 0 0) 0x7f92d8024070 con 0x7f92e8110fb0 2024-05-09T01:17:20.224 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:20.224 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:16:06.675640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24454,24491,24445,24446,24467]},"id":1}]} 2024-05-09T01:17:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d00b2a90 msgr2=0x7f92d00b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d00b2a90 0x7f92d00b4fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f92dc005950 tx=0x7f92dc0058e0 comp rx=0 tx=0).stop 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 msgr2=0x7f92e8113ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e8113ce0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f92d801a8f0 tx=0x7f92d8003bd0 comp rx=0 tx=0).stop 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 shutdown_connections 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92d00b2a90 0x7f92d00b4fa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92e8110fb0 0x7f92e8113ce0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92e810b8a0 0x7f92e8117660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 --2- 172.21.15.37:0/2722024206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92e8110660 0x7f92e81137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.227+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 >> 172.21.15.37:0/2722024206 conn(0x7f92e807a020 msgr2=0x7f92e807c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.228+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 shutdown_connections 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:20.228+0000 7f92ef106700 1 -- 172.21.15.37:0/2722024206 wait complete. 2024-05-09T01:17:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 51 2024-05-09T01:17:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 900.0 s, 1380.6 tps, lat 71.517 ms stddev 83.317 2024-05-09T01:17:20.457 INFO:teuthology.orchestra.run.smithi037.stdout:transaction type: 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:scaling factor: 32 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:query mode: simple 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:number of clients: 100 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:number of threads: 4 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:duration: 900 s 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:number of transactions actually processed: 2177265 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:latency average = 41.331 ms 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:latency stddev = 165.283 ms 2024-05-09T01:17:20.458 INFO:teuthology.orchestra.run.smithi037.stdout:tps = 2418.573536 (including connections establishing) 2024-05-09T01:17:20.459 INFO:teuthology.orchestra.run.smithi037.stdout:tps = 2418.581753 (excluding connections establishing) 2024-05-09T01:17:20.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-05-09T01:17:20.527 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:20 smithi037 ceph-mon[30122]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.9 MiB/s wr, 711 op/s 2024-05-09T01:17:20.527 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:20 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2722024206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:17:20.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:20 smithi151 ceph-mon[34780]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.9 MiB/s wr, 711 op/s 2024-05-09T01:17:20.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:20 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2722024206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:17:20.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:20 smithi136 ceph-mon[34110]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.9 MiB/s wr, 711 op/s 2024-05-09T01:17:20.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:20 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2722024206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:17:21.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-09T01:17:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:22.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:22 smithi136 ceph-mon[34110]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.2 MiB/s wr, 650 op/s 2024-05-09T01:17:22.886 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:22 smithi037 ceph-mon[30122]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.2 MiB/s wr, 650 op/s 2024-05-09T01:17:22.974 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:22 smithi151 ceph-mon[34780]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.2 MiB/s wr, 650 op/s 2024-05-09T01:17:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.953+0000 7f921ae8a700 1 -- 172.21.15.37:0/2749466823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f921410a930 msgr2=0x7f921410ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.953+0000 7f921ae8a700 1 --2- 172.21.15.37:0/2749466823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f921410a930 0x7f921410ad40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9208009990 tx=0x7f9208009ca0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.954+0000 7f921ae8a700 1 -- 172.21.15.37:0/2749466823 shutdown_connections 2024-05-09T01:17:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.954+0000 7f921ae8a700 1 --2- 172.21.15.37:0/2749466823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f921411d930 0x7f921411fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.954+0000 7f921ae8a700 1 --2- 172.21.15.37:0/2749466823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f921410a930 0x7f921410ad40 secure :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9208009990 tx=0x7f9208009ca0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.954+0000 7f921ae8a700 1 --2- 172.21.15.37:0/2749466823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 0x7f921411d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.954+0000 7f921ae8a700 1 -- 172.21.15.37:0/2749466823 >> 172.21.15.37:0/2749466823 conn(0x7f921406f4d0 msgr2=0x7f921406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.955+0000 7f921ae8a700 1 -- 172.21.15.37:0/2749466823 shutdown_connections 2024-05-09T01:17:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.956+0000 7f921ae8a700 1 -- 172.21.15.37:0/2749466823 wait complete. 2024-05-09T01:17:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.957+0000 7f921ae8a700 1 Processor -- start 2024-05-09T01:17:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.957+0000 7f921ae8a700 1 -- start start 2024-05-09T01:17:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.957+0000 7f921ae8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 0x7f92141afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f921ae8a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f921411d930 0x7f92141affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f921ae8a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92141a9b50 0x7f92141a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f921ae8a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9214123330 con 0x7f921410b280 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f921ae8a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92141231b0 con 0x7f921411d930 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f921ae8a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92141234b0 con 0x7f92141a9b50 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 0x7f92141afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 0x7f92141afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47846/0 (socket says 172.21.15.37:47846) 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 -- 172.21.15.37:0/3112820985 learned_addr learned my addr 172.21.15.37:0/3112820985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 -- 172.21.15.37:0/3112820985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92141a9b50 msgr2=0x7f92141a9f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:17:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92141a9b50 0x7f92141a9f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 -- 172.21.15.37:0/3112820985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f921411d930 msgr2=0x7f92141affc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T01:17:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f921411d930 0x7f92141affc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.958+0000 7f9218c26700 1 -- 172.21.15.37:0/3112820985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92141aa770 con 0x7f921410b280 2024-05-09T01:17:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.960+0000 7f9218c26700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 0x7f92141afa80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9208005950 tx=0x7f920800ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.961+0000 7f9211ffb700 1 -- 172.21.15.37:0/3112820985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208028070 con 0x7f921410b280 2024-05-09T01:17:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.961+0000 7f9211ffb700 1 -- 172.21.15.37:0/3112820985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9208004580 con 0x7f921410b280 2024-05-09T01:17:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.961+0000 7f9211ffb700 1 -- 172.21.15.37:0/3112820985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208023680 con 0x7f921410b280 2024-05-09T01:17:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.961+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9214112bd0 con 0x7f921410b280 2024-05-09T01:17:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.961+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9214113060 con 0x7f921410b280 2024-05-09T01:17:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.972+0000 7f92298a0b80 1 Processor -- start 2024-05-09T01:17:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.972+0000 7f9211ffb700 1 -- 172.21.15.37:0/3112820985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9208009d10 con 0x7f921410b280 2024-05-09T01:17:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.977+0000 7f9211ffb700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92040b2a80 0x7f92040b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f92298a0b80 1 -- start start 2024-05-09T01:17:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f9211ffb700 1 -- 172.21.15.37:0/3112820985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f92080e3dc0 con 0x7f921410b280 2024-05-09T01:17:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 0x56518ff71a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518ff6b6a0 0x56518ff6bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f92298a0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56518fe8dff0 con 0x56518ff6b6a0 2024-05-09T01:17:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f92298a0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56518fe2c7f0 con 0x56518fed8160 2024-05-09T01:17:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.978+0000 7f92298a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56518fe89fb0 con 0x56518fdee4a0 2024-05-09T01:17:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55114/0 (socket says 172.21.15.37:55114) 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 -- 172.21.15.37:0/609628356 learned_addr learned my addr 172.21.15.37:0/609628356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 -- 172.21.15.37:0/609628356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 msgr2=0x56518ff71a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 --2- 172.21.15.37:0/609628356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 0x56518ff71a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 -- 172.21.15.37:0/609628356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518ff6b6a0 msgr2=0x56518ff6bad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 --2- 172.21.15.37:0/609628356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518ff6b6a0 0x56518ff6bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 -- 172.21.15.37:0/609628356 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56518fe24370 con 0x56518fed8160 2024-05-09T01:17:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.979+0000 7f9218c26700 1 --2- 172.21.15.37:0/609628356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff714f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f92080a74f0 tx=0x7f9208009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f56f90d90e0a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:23.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.980+0000 7f91feffd700 1 -- 172.21.15.37:0/609628356 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080abb70 con 0x56518fed8160 2024-05-09T01:17:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.980+0000 7f91feffd700 1 -- 172.21.15.37:0/609628356 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92080ab470 con 0x56518fed8160 2024-05-09T01:17:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.980+0000 7f91feffd700 1 -- 172.21.15.37:0/609628356 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080b3db0 con 0x56518fed8160 2024-05-09T01:17:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.981+0000 7f92298a0b80 1 -- 172.21.15.37:0/609628356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 msgr2=0x56518ff714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.981+0000 7f92298a0b80 1 --2- 172.21.15.37:0/609628356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff714f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f92080a74f0 tx=0x7f9208009ca0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.983+0000 7f9219427700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92040b2a80 0x7f92040b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:23.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.984+0000 7f9219427700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92040b2a80 0x7f92040b4f90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f920c0060b0 tx=0x7f920c006040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:23.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.986+0000 7f92298a0b80 1 -- 172.21.15.37:0/609628356 shutdown_connections 2024-05-09T01:17:23.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.986+0000 7f92298a0b80 1 --2- 172.21.15.37:0/609628356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518ff6b6a0 0x56518ff6bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.986+0000 7f92298a0b80 1 --2- 172.21.15.37:0/609628356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff714f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.986+0000 7f92298a0b80 1 --2- 172.21.15.37:0/609628356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 0x56518ff71a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.986+0000 7f92298a0b80 1 -- 172.21.15.37:0/609628356 >> 172.21.15.37:0/609628356 conn(0x56518fe4e6a0 msgr2=0x56518ff66400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.987+0000 7f92298a0b80 1 -- 172.21.15.37:0/609628356 shutdown_connections 2024-05-09T01:17:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.992+0000 7f92298a0b80 1 -- 172.21.15.37:0/609628356 wait complete. 2024-05-09T01:17:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.992+0000 7f92298a0b80 1 -- start start 2024-05-09T01:17:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.992+0000 7f92298a0b80 1 Processor -- start 2024-05-09T01:17:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.993+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.993+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff7b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.993+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518ff6b6a0 0x56518ff75140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.993+0000 7f9218c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.993+0000 7f9218c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47860/0 (socket says 172.21.15.37:47860) 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.993+0000 7f9218c26700 1 -- 172.21.15.37:0/1714884239 learned_addr learned my addr 172.21.15.37:0/1714884239 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56518fd09ba0 con 0x56518fdee4a0 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x56518fe48150 con 0x56518fed8160 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56518ff6c360 con 0x56518ff6b6a0 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f92298a0b80 10 client.0 _ll_register_callbacks cb 0x56518fcff6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f9218c26700 1 -- 172.21.15.37:0/1714884239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518ff6b6a0 msgr2=0x56518ff75140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:17:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f9218c26700 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518ff6b6a0 0x56518ff75140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f9218c26700 1 -- 172.21.15.37:0/1714884239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 msgr2=0x56518ff7b280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:17:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f9218c26700 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff7b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f9218c26700 1 -- 172.21.15.37:0/1714884239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56518fd09490 con 0x56518fdee4a0 2024-05-09T01:17:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:23.994+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92080ab470 con 0x56518fdee4a0 2024-05-09T01:17:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.002+0000 7f9218c26700 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7ad40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f920800ffd0 tx=0x7f92080aaa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd11b1ccb526e0a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.002+0000 7f91f3fff700 10 client.17958 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:17:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.003+0000 7f91f3fff700 1 -- 172.21.15.37:0/1714884239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080abb70 con 0x56518fdee4a0 2024-05-09T01:17:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.003+0000 7f91f3fff700 1 -- 172.21.15.37:0/1714884239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f92080a7a60 con 0x56518fdee4a0 2024-05-09T01:17:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.003+0000 7f91f3fff700 1 -- 172.21.15.37:0/1714884239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f92080af820 con 0x56518fdee4a0 2024-05-09T01:17:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.003+0000 7f92298a0b80 10 client.17958 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.003+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=51}) -- 0x56518ff82670 con 0x56518fdee4a0 2024-05-09T01:17:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.004+0000 7f91f3fff700 1 -- 172.21.15.37:0/1714884239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f92080e1ce0 con 0x56518fdee4a0 2024-05-09T01:17:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.004+0000 7f92298a0b80 10 client.17958 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.004+0000 7f92298a0b80 10 client.17958 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:17:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.004+0000 7f92298a0b80 20 client.17958 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.004+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ff84a10 0x56518ff86e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.004+0000 7f92298a0b80 4 client.17958 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.004+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56518fe9b9d0 con 0x56518ff84a10 2024-05-09T01:17:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.006+0000 7f9213fff700 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ff84a10 0x56518ff86e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.016+0000 7f9213fff700 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ff84a10 0x56518ff86e90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a30c0a284ad402d server_cookie=8c93a25f2ec5e833 in_seq=0 out_seq=0 2024-05-09T01:17:24.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.016+0000 7f91f3fff700 10 client.17958 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:17:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.017+0000 7f91f3fff700 1 -- 172.21.15.37:0/1714884239 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56518fe9b9d0 con 0x56518ff84a10 2024-05-09T01:17:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.017+0000 7f91f3fff700 10 client.17958 handle_command_reply: tid=0 2024-05-09T01:17:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.017+0000 7f92298a0b80 1 client.17958 shutdown 2024-05-09T01:17:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.018+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 msgr2=0x56518ff7ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.018+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7ad40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f920800ffd0 tx=0x7f92080aaa30 comp rx=0 tx=0).stop 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 shutdown_connections 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ff84a10 0x56518ff86e90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518ff6b6a0 0x56518ff75140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7ad40 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1714884239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518fed8160 0x56518ff7b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 >> 172.21.15.37:0/1714884239 conn(0x56518fe4e6a0 msgr2=0x56518ff661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f91f3fff700 0 client.17958 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 shutdown_connections 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 1 -- 172.21.15.37:0/1714884239 wait complete. 2024-05-09T01:17:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.021+0000 7f92298a0b80 20 client.17958 trim_cache size 0 max 16384 2024-05-09T01:17:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.055+0000 7f92298a0b80 1 Processor -- start 2024-05-09T01:17:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.056+0000 7f92298a0b80 1 -- start start 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.056+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 0x56518ff6f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.056+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fed8160 0x56518ff70950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.057+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ff6de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.057+0000 7f92298a0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91f800d320 con 0x56518fed8160 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.057+0000 7f92298a0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f91f800ee60 con 0x56518ff6b6a0 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.057+0000 7f9219427700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ff6de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.057+0000 7f9219427700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ff6de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55120/0 (socket says 172.21.15.37:55120) 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.057+0000 7f9219427700 1 -- 172.21.15.37:0/1294287393 learned_addr learned my addr 172.21.15.37:0/1294287393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.057+0000 7f92298a0b80 1 -- 172.21.15.37:0/1294287393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f91f800d9f0 con 0x56518fdee4a0 2024-05-09T01:17:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.059+0000 7f9213fff700 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fed8160 0x56518ff70950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.059+0000 7f9213fff700 1 -- 172.21.15.37:0/1294287393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 msgr2=0x56518ff6f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.059+0000 7f9213fff700 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 0x56518ff6f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.059+0000 7f9213fff700 1 -- 172.21.15.37:0/1294287393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 msgr2=0x56518ff6de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.060+0000 7f9213fff700 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ff6de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.060+0000 7f9213fff700 1 -- 172.21.15.37:0/1294287393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56518ff672e0 con 0x56518fed8160 2024-05-09T01:17:24.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.060+0000 7f9213fff700 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fed8160 0x56518ff70950 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x56518ff67060 tx=0x7f9200009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cac9a305d00f8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.065+0000 7f91fe7fc700 1 -- 172.21.15.37:0/1294287393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200010a70 con 0x56518fed8160 2024-05-09T01:17:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.065+0000 7f91fe7fc700 1 -- 172.21.15.37:0/1294287393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9200004500 con 0x56518fed8160 2024-05-09T01:17:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.065+0000 7f91fe7fc700 1 -- 172.21.15.37:0/1294287393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200005030 con 0x56518fed8160 2024-05-09T01:17:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.067+0000 7f92298a0b80 1 -- 172.21.15.37:0/1294287393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fed8160 msgr2=0x56518ff70950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.067+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fed8160 0x56518ff70950 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x56518ff67060 tx=0x7f9200009260 comp rx=0 tx=0).stop 2024-05-09T01:17:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.069+0000 7f92298a0b80 1 -- 172.21.15.37:0/1294287393 shutdown_connections 2024-05-09T01:17:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.069+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ff6de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.069+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fdee4a0 0x56518ff6f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.069+0000 7f92298a0b80 1 --2- 172.21.15.37:0/1294287393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fed8160 0x56518ff70950 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.069+0000 7f92298a0b80 1 -- 172.21.15.37:0/1294287393 >> 172.21.15.37:0/1294287393 conn(0x56518fe4e6a0 msgr2=0x56518ff70240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.073+0000 7f92298a0b80 1 -- 172.21.15.37:0/1294287393 shutdown_connections 2024-05-09T01:17:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.073+0000 7f92298a0b80 1 -- 172.21.15.37:0/1294287393 wait complete. 2024-05-09T01:17:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.073+0000 7f92298a0b80 1 -- start start 2024-05-09T01:17:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.074+0000 7f92298a0b80 1 Processor -- start 2024-05-09T01:17:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.075+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.075+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fed8160 0x56518ff7ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.075+0000 7f92298a0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ffe7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.076+0000 7f9213fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fed8160 0x56518ff7ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.076+0000 7f9213fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fed8160 0x56518ff7ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38736/0 (socket says 172.21.15.37:38736) 2024-05-09T01:17:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.076+0000 7f9213fff700 1 -- 172.21.15.37:0/717084795 learned_addr learned my addr 172.21.15.37:0/717084795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.076+0000 7f9219427700 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ffe7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.076+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91f800e790 con 0x56518fdee4a0 2024-05-09T01:17:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.076+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f91f800e0c0 con 0x56518ff6b6a0 2024-05-09T01:17:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.077+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f91f800b2c0 con 0x56518fed8160 2024-05-09T01:17:24.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.077+0000 7f92298a0b80 10 client.0 _ll_register_callbacks cb 0x56518fcff6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:24.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.077+0000 7f9213fff700 1 -- 172.21.15.37:0/717084795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 msgr2=0x56518ffe7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:24.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.078+0000 7f9213fff700 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ffe7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.078+0000 7f9213fff700 1 -- 172.21.15.37:0/717084795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 msgr2=0x56518ff7c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:24.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.078+0000 7f9213fff700 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.078+0000 7f9213fff700 1 -- 172.21.15.37:0/717084795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56518ffe7770 con 0x56518fed8160 2024-05-09T01:17:24.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.078+0000 7f9219427700 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ffe7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.086+0000 7f9213fff700 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fed8160 0x56518ff7ca80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f92000046e0 tx=0x7f9200004050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c583d1860c557dd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.086+0000 7f91f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.088+0000 7f91f3fff700 1 -- 172.21.15.37:0/717084795 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200028030 con 0x56518fed8160 2024-05-09T01:17:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.088+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9200004500 con 0x56518fed8160 2024-05-09T01:17:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.088+0000 7f91f3fff700 1 -- 172.21.15.37:0/717084795 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f9200016030 con 0x56518fed8160 2024-05-09T01:17:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.088+0000 7f91f3fff700 1 -- 172.21.15.37:0/717084795 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f92000109f0 con 0x56518fed8160 2024-05-09T01:17:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.088+0000 7f92298a0b80 10 client.27841 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:24.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.088+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x56518ffeea10 con 0x56518fed8160 2024-05-09T01:17:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f91f3fff700 1 -- 172.21.15.37:0/717084795 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9200004500 con 0x56518fed8160 2024-05-09T01:17:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f91f3fff700 1 -- 172.21.15.37:0/717084795 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f9200017ce0 con 0x56518fed8160 2024-05-09T01:17:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f92298a0b80 10 client.27841 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f92298a0b80 10 client.27841 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.c 2024-05-09T01:17:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f92298a0b80 20 client.27841 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f92298a0b80 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ffef0d0 0x56518fff14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f92298a0b80 4 client.27841 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:17:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.090+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 --> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56518fe95a70 con 0x56518ffef0d0 2024-05-09T01:17:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.091+0000 7f9218c26700 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ffef0d0 0x56518fff14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.091+0000 7f91f3fff700 10 client.27841 ms_handle_connect on v2:172.21.15.151:6836/980204664 2024-05-09T01:17:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.092+0000 7f9218c26700 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ffef0d0 0x56518fff14f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=21cce7fd9ff332c server_cookie=8e0c62f9663e2fd in_seq=0 out_seq=0 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.092+0000 7f91f3fff700 1 -- 172.21.15.37:0/717084795 <== mds.4 v2:172.21.15.151:6836/980204664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56518fe95a70 con 0x56518ffef0d0 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.092+0000 7f91f3fff700 10 client.27841 handle_command_reply: tid=0 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.092+0000 7f92298a0b80 1 client.27841 shutdown 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.092+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fed8160 msgr2=0x56518ff7ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fed8160 0x56518ff7ca80 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f92000046e0 tx=0x7f9200004050 comp rx=0 tx=0).stop 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 shutdown_connections 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:6836/980204664,v1:172.21.15.151:6837/980204664] conn(0x56518ffef0d0 0x56518fff14f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56518ff6b6a0 0x56518ffe7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f91f3fff700 0 client.27841 ms_handle_reset on v2:172.21.15.151:6836/980204664 2024-05-09T01:17:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56518fdee4a0 0x56518ff7c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 --2- 172.21.15.37:0/717084795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518fed8160 0x56518ff7ca80 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 >> 172.21.15.37:0/717084795 conn(0x56518fe4e6a0 msgr2=0x56518ff6ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 shutdown_connections 2024-05-09T01:17:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.093+0000 7f92298a0b80 1 -- 172.21.15.37:0/717084795 wait complete. 2024-05-09T01:17:24.095 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:17:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.095+0000 7f92298a0b80 20 client.27841 trim_cache size 0 max 16384 2024-05-09T01:17:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92040b2a80 msgr2=0x7f92040b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92040b2a80 0x7f92040b4f90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f920c0060b0 tx=0x7f920c006040 comp rx=0 tx=0).stop 2024-05-09T01:17:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 msgr2=0x7f92141afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 0x7f92141afa80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f9208005950 tx=0x7f920800ff60 comp rx=0 tx=0).stop 2024-05-09T01:17:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 shutdown_connections 2024-05-09T01:17:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f92040b2a80 0x7f92040b4f90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92141a9b50 0x7f92141a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f921410b280 0x7f92141afa80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 --2- 172.21.15.37:0/3112820985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f921411d930 0x7f92141affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 >> 172.21.15.37:0/3112820985 conn(0x7f921406f4d0 msgr2=0x7f921411b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.097+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 shutdown_connections 2024-05-09T01:17:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:24.098+0000 7f921ae8a700 1 -- 172.21.15.37:0/3112820985 wait complete. 2024-05-09T01:17:24.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:24 smithi037 ceph-mon[30122]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 MiB/s wr, 714 op/s 2024-05-09T01:17:24.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:24 smithi136 ceph-mon[34110]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 MiB/s wr, 714 op/s 2024-05-09T01:17:24.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-09T01:17:24.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:24 smithi151 ceph-mon[34780]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.7 MiB/s wr, 714 op/s 2024-05-09T01:17:25.490 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:26.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:26 smithi037 ceph-mon[30122]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.5 MiB/s wr, 683 op/s 2024-05-09T01:17:26.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:26 smithi136 ceph-mon[34110]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.5 MiB/s wr, 683 op/s 2024-05-09T01:17:26.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:26 smithi151 ceph-mon[34780]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.5 MiB/s wr, 683 op/s 2024-05-09T01:17:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.047+0000 7f717b254700 1 -- 172.21.15.37:0/591625164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174108530 msgr2=0x7f717410fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.047+0000 7f717b254700 1 --2- 172.21.15.37:0/591625164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174108530 0x7f717410fe90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f716c00b0d0 tx=0x7f716c00b3e0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.047+0000 7f717b254700 1 -- 172.21.15.37:0/591625164 shutdown_connections 2024-05-09T01:17:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.047+0000 7f717b254700 1 --2- 172.21.15.37:0/591625164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174108530 0x7f717410fe90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.047+0000 7f717b254700 1 --2- 172.21.15.37:0/591625164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71741032b0 0x7f71741036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.047+0000 7f717b254700 1 --2- 172.21.15.37:0/591625164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7174107be0 0x7f7174107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.047+0000 7f717b254700 1 -- 172.21.15.37:0/591625164 >> 172.21.15.37:0/591625164 conn(0x7f7174078b80 msgr2=0x7f7174078fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.049+0000 7f717b254700 1 -- 172.21.15.37:0/591625164 shutdown_connections 2024-05-09T01:17:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.049+0000 7f717b254700 1 -- 172.21.15.37:0/591625164 wait complete. 2024-05-09T01:17:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.050+0000 7f717b254700 1 Processor -- start 2024-05-09T01:17:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.051+0000 7f717b254700 1 -- start start 2024-05-09T01:17:28.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.051+0000 7f717b254700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71741032b0 0x7f717419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.051+0000 7f717b254700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7174107be0 0x7f717419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717a252700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71741032b0 0x7f717419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717a252700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71741032b0 0x7f717419f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38756/0 (socket says 172.21.15.37:38756) 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717a252700 1 -- 172.21.15.37:0/2949938415 learned_addr learned my addr 172.21.15.37:0/2949938415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f7179a51700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7174107be0 0x7f717419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717b254700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7174108530 0x7f7174199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7174113250 con 0x7f7174107be0 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f71741130d0 con 0x7f7174108530 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71741133d0 con 0x7f71741032b0 2024-05-09T01:17:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717aa53700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7174108530 0x7f7174199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717aa53700 1 -- 172.21.15.37:0/2949938415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71741032b0 msgr2=0x7f717419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.052+0000 7f717aa53700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71741032b0 0x7f717419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.053+0000 7f717aa53700 1 -- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7174107be0 msgr2=0x7f717419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.053+0000 7f717aa53700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7174107be0 0x7f717419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.053+0000 7f717aa53700 1 -- 172.21.15.37:0/2949938415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7174199f70 con 0x7f7174108530 2024-05-09T01:17:28.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.053+0000 7f717a252700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71741032b0 0x7f717419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:28.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.053+0000 7f717aa53700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7174108530 0x7f7174199840 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fd0 tx=0x7f716c009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:28.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.055+0000 7f716b7fe700 1 -- 172.21.15.37:0/2949938415 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c003c00 con 0x7f7174108530 2024-05-09T01:17:28.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.055+0000 7f716b7fe700 1 -- 172.21.15.37:0/2949938415 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f716c003da0 con 0x7f7174108530 2024-05-09T01:17:28.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.055+0000 7f716b7fe700 1 -- 172.21.15.37:0/2949938415 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716c01a990 con 0x7f7174108530 2024-05-09T01:17:28.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.055+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717419a200 con 0x7f7174108530 2024-05-09T01:17:28.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.055+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717419a630 con 0x7f7174108530 2024-05-09T01:17:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.060+0000 7f718aeccb80 1 Processor -- start 2024-05-09T01:17:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.060+0000 7f718aeccb80 1 -- start start 2024-05-09T01:17:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.061+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.061+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c16a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.062+0000 7f7179a51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.062+0000 7f7179a51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c169ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47906/0 (socket says 172.21.15.37:47906) 2024-05-09T01:17:28.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.063+0000 7f7179a51700 1 -- 172.21.15.37:0/2153178683 learned_addr learned my addr 172.21.15.37:0/2153178683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:28.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.063+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c16e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.063+0000 7f717a252700 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c16a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.064+0000 7f716b7fe700 1 -- 172.21.15.37:0/2949938415 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f716c01ab30 con 0x7f7174108530 2024-05-09T01:17:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.064+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e50c07aff0 con 0x55e50c0c5160 2024-05-09T01:17:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.064+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e50c0197f0 con 0x55e50bfdb4a0 2024-05-09T01:17:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.064+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e50c076fb0 con 0x55e50c16e1e0 2024-05-09T01:17:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.065+0000 7f716b7fe700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71600b2a50 0x7f71600b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.065+0000 7f716b7fe700 1 -- 172.21.15.37:0/2949938415 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f716c0e4d30 con 0x7f7174108530 2024-05-09T01:17:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f717aa53700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71600b2a50 0x7f71600b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f717a252700 1 -- 172.21.15.37:0/2153178683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 msgr2=0x55e50c16e5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T01:17:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f717a252700 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c16e5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f717a252700 1 -- 172.21.15.37:0/2153178683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 msgr2=0x55e50c169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f717a252700 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f717a252700 1 -- 172.21.15.37:0/2153178683 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e50c011370 con 0x55e50bfdb4a0 2024-05-09T01:17:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f717a252700 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c16a030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7164009a60 tx=0x7f7164009d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b93d4823e7baa2b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f7179a51700 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f7168d47700 1 -- 172.21.15.37:0/2153178683 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164017020 con 0x55e50bfdb4a0 2024-05-09T01:17:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.066+0000 7f7168d47700 1 -- 172.21.15.37:0/2153178683 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f716400ed10 con 0x55e50bfdb4a0 2024-05-09T01:17:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.067+0000 7f7168d47700 1 -- 172.21.15.37:0/2153178683 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716400f040 con 0x55e50bfdb4a0 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.067+0000 7f717aa53700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71600b2a50 0x7f71600b4f60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ac0e0 tx=0x7f716c01c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.068+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 msgr2=0x55e50c16a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.068+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c16a030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7164009a60 tx=0x7f7164009d70 comp rx=0 tx=0).stop 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.069+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 shutdown_connections 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.069+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c16e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.069+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.069+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2153178683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c16a030 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.069+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 >> 172.21.15.37:0/2153178683 conn(0x55e50c03b6a0 msgr2=0x55e50c153620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.071+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 shutdown_connections 2024-05-09T01:17:28.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.071+0000 7f718aeccb80 1 -- 172.21.15.37:0/2153178683 wait complete. 2024-05-09T01:17:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.072+0000 7f718aeccb80 1 -- start start 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.072+0000 7f718aeccb80 1 Processor -- start 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.072+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c1734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c1739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f7179a51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c1734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f7179a51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c1734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55158/0 (socket says 172.21.15.37:55158) 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f7179a51700 1 -- 172.21.15.37:0/2443710831 learned_addr learned my addr 172.21.15.37:0/2443710831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c173f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e50bef6ba0 con 0x55e50c0c5160 2024-05-09T01:17:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55e50c035150 con 0x55e50bfdb4a0 2024-05-09T01:17:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e50c16ef90 con 0x55e50c16e1e0 2024-05-09T01:17:28.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.073+0000 7f718aeccb80 10 client.0 _ll_register_callbacks cb 0x55e50beec6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:28.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.081+0000 7f7179a51700 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c173f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.081+0000 7f7179a51700 1 -- 172.21.15.37:0/2443710831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 msgr2=0x55e50c173f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.081+0000 7f7179a51700 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c173f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.081+0000 7f7179a51700 1 -- 172.21.15.37:0/2443710831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 msgr2=0x55e50c1739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.081+0000 7f7179a51700 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c1739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.081+0000 7f7179a51700 1 -- 172.21.15.37:0/2443710831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e50bef6490 con 0x55e50bfdb4a0 2024-05-09T01:17:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.082+0000 7f7179a51700 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c1734b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7170009fa0 tx=0x7f7170009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec975200d2b7fc1c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.082+0000 7f715dffb700 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-05-09T01:17:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.082+0000 7f715dffb700 1 -- 172.21.15.37:0/2443710831 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170020020 con 0x55e50bfdb4a0 2024-05-09T01:17:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.083+0000 7f715dffb700 1 -- 172.21.15.37:0/2443710831 <== mon.2 v2:172.21.15.136:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f7170010860 con 0x55e50bfdb4a0 2024-05-09T01:17:28.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.083+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f716400ed10 con 0x55e50bfdb4a0 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.083+0000 7f715dffb700 1 -- 172.21.15.37:0/2443710831 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f717000f040 con 0x55e50bfdb4a0 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.083+0000 7f718aeccb80 10 client.27905 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.083+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55e50c180c00 con 0x55e50bfdb4a0 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f715dffb700 1 -- 172.21.15.37:0/2443710831 <== mon.2 v2:172.21.15.136:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f717001c7a0 con 0x55e50bfdb4a0 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f715dffb700 1 -- 172.21.15.37:0/2443710831 <== mon.2 v2:172.21.15.136:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f7170027520 con 0x55e50bfdb4a0 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f718aeccb80 10 client.27905 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f718aeccb80 10 client.27905 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f718aeccb80 20 client.27905 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c183240 0x55e50c1856a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f718aeccb80 4 client.27905 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:28.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.084+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f716400ed10 con 0x55e50c183240 2024-05-09T01:17:28.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.087+0000 7f717a252700 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c183240 0x55e50c1856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.088+0000 7f717a252700 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c183240 0x55e50c1856a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2f18e851dc15d150 server_cookie=f5b4b4cf7ec640a6 in_seq=0 out_seq=0 2024-05-09T01:17:28.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.088+0000 7f715dffb700 10 client.27905 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:17:28.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.089+0000 7f715dffb700 1 -- 172.21.15.37:0/2443710831 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f716400ed10 con 0x55e50c183240 2024-05-09T01:17:28.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.089+0000 7f715dffb700 10 client.27905 handle_command_reply: tid=0 2024-05-09T01:17:28.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.090+0000 7f718aeccb80 1 client.27905 shutdown 2024-05-09T01:17:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 msgr2=0x55e50c1734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c1734b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7170009fa0 tx=0x7f7170009190 comp rx=0 tx=0).stop 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 shutdown_connections 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c173f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c183240 0x55e50c1856a0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50bfdb4a0 0x55e50c1734b0 secure :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7170009fa0 tx=0x7f7170009190 comp rx=0 tx=0).stop 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 --2- 172.21.15.37:0/2443710831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c1739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 >> 172.21.15.37:0/2443710831 conn(0x55e50c03b6a0 msgr2=0x55e50c153380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.093+0000 7f715dffb700 0 client.27905 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.094+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 shutdown_connections 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.094+0000 7f718aeccb80 1 -- 172.21.15.37:0/2443710831 wait complete. 2024-05-09T01:17:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.094+0000 7f718aeccb80 20 client.27905 trim_cache size 0 max 16384 2024-05-09T01:17:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.124+0000 7f718aeccb80 1 Processor -- start 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.125+0000 7f718aeccb80 1 -- start start 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.125+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c0c5160 0x55e50c173da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.125+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c17f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.125+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c1538b0 0x55e50c17f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c0c5160 0x55e50c173da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c0c5160 0x55e50c173da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55170/0 (socket says 172.21.15.37:55170) 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 -- 172.21.15.37:0/3216047575 learned_addr learned my addr 172.21.15.37:0/3216047575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f717a252700 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c17f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f715800d350 con 0x55e50c1538b0 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f715800ee90 con 0x55e50c0c5160 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f715800da20 con 0x55e50c16e1e0 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c1538b0 0x55e50c17f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 -- 172.21.15.37:0/3216047575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 msgr2=0x55e50c17f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c17f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 -- 172.21.15.37:0/3216047575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c1538b0 msgr2=0x55e50c17f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c1538b0 0x55e50c17f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.126+0000 7f7179a51700 1 -- 172.21.15.37:0/3216047575 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e50c175d50 con 0x55e50c0c5160 2024-05-09T01:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.128+0000 7f7179a51700 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c0c5160 0x55e50c173da0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f71700177a0 tx=0x7f7170004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf73213bc14c20ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.131+0000 7f715ffff700 1 -- 172.21.15.37:0/3216047575 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170027430 con 0x55e50c0c5160 2024-05-09T01:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.131+0000 7f715ffff700 1 -- 172.21.15.37:0/3216047575 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71700275d0 con 0x55e50c0c5160 2024-05-09T01:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.131+0000 7f715ffff700 1 -- 172.21.15.37:0/3216047575 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71700198c0 con 0x55e50c0c5160 2024-05-09T01:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.132+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c0c5160 msgr2=0x55e50c173da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.132+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c0c5160 0x55e50c173da0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f71700177a0 tx=0x7f7170004860 comp rx=0 tx=0).stop 2024-05-09T01:17:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.132+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 shutdown_connections 2024-05-09T01:17:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.132+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c1538b0 0x55e50c17f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.132+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c0c5160 0x55e50c173da0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.132+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3216047575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c16e1e0 0x55e50c17f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.132+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 >> 172.21.15.37:0/3216047575 conn(0x55e50c03b6a0 msgr2=0x55e50c171dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.133+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 shutdown_connections 2024-05-09T01:17:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.133+0000 7f718aeccb80 1 -- 172.21.15.37:0/3216047575 wait complete. 2024-05-09T01:17:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.133+0000 7f718aeccb80 1 -- start start 2024-05-09T01:17:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.133+0000 7f718aeccb80 1 Processor -- start 2024-05-09T01:17:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.134+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c17bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.134+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c1538b0 0x55e50c179ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.134+0000 7f718aeccb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c16e1e0 0x55e50c17a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f718aeccb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f715800e7c0 con 0x55e50c0c5160 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f718aeccb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f715800e0f0 con 0x55e50c16e1e0 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f718aeccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f715800b2f0 con 0x55e50c1538b0 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f7179a51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c16e1e0 0x55e50c17a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f7179a51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c16e1e0 0x55e50c17a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:55174/0 (socket says 172.21.15.37:55174) 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f7179a51700 1 -- 172.21.15.37:0/3797503694 learned_addr learned my addr 172.21.15.37:0/3797503694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f717a252700 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c1538b0 0x55e50c179ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f717a252700 1 -- 172.21.15.37:0/3797503694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c16e1e0 msgr2=0x55e50c17a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f717a252700 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c16e1e0 0x55e50c17a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f717a252700 1 -- 172.21.15.37:0/3797503694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 msgr2=0x55e50c17bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f717a252700 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c17bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.135+0000 7f717a252700 1 -- 172.21.15.37:0/3797503694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e50c17ac70 con 0x55e50c1538b0 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.136+0000 7f718aeccb80 10 client.0 _ll_register_callbacks cb 0x55e50beec6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.136+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71700275d0 con 0x55e50c1538b0 2024-05-09T01:17:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.136+0000 7f717a252700 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c1538b0 0x55e50c179ed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55e50c153210 tx=0x7f7164013a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef341768cd456fe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.136+0000 7f715dffb700 10 client.27856 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.136+0000 7f715dffb700 1 -- 172.21.15.37:0/3797503694 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164017040 con 0x55e50c1538b0 2024-05-09T01:17:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.136+0000 7f715dffb700 1 -- 172.21.15.37:0/3797503694 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f716400e660 con 0x55e50c1538b0 2024-05-09T01:17:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f715dffb700 1 -- 172.21.15.37:0/3797503694 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f716400e8c0 con 0x55e50c1538b0 2024-05-09T01:17:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 10 client.27856 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55e50c1626b0 con 0x55e50c1538b0 2024-05-09T01:17:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f715dffb700 1 -- 172.21.15.37:0/3797503694 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f7164012050 con 0x55e50c1538b0 2024-05-09T01:17:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 10 client.27856 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 10 client.27856 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.e 2024-05-09T01:17:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 20 client.27856 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c162980 0x55e50c164da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 4 client.27856 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.137+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 --> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e50c0889d0 con 0x55e50c162980 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.138+0000 7f7179a51700 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c162980 0x55e50c164da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.138+0000 7f715dffb700 10 client.27856 ms_handle_connect on v2:172.21.15.136:6834/3966539810 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.138+0000 7f7179a51700 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c162980 0x55e50c164da0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=409e2ac11d9a67ab server_cookie=8d97804f74762243 in_seq=0 out_seq=0 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f715dffb700 1 -- 172.21.15.37:0/3797503694 <== mds.3 v2:172.21.15.136:6834/3966539810 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e50c0889d0 con 0x55e50c162980 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f715dffb700 10 client.27856 handle_command_reply: tid=0 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 client.27856 shutdown 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c1538b0 msgr2=0x55e50c179ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c1538b0 0x55e50c179ed0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55e50c153210 tx=0x7f7164013a10 comp rx=0 tx=0).stop 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 shutdown_connections 2024-05-09T01:17:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.136:6834/3966539810,v1:172.21.15.136:6835/3966539810] conn(0x55e50c162980 0x55e50c164da0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55e50c16e1e0 0x55e50c17a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e50c0c5160 0x55e50c17bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 --2- 172.21.15.37:0/3797503694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e50c1538b0 0x55e50c179ed0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 >> 172.21.15.37:0/3797503694 conn(0x55e50c03b6a0 msgr2=0x55e50c16d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f715dffb700 0 client.27856 ms_handle_reset on v2:172.21.15.136:6834/3966539810 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 shutdown_connections 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.139+0000 7f718aeccb80 1 -- 172.21.15.37:0/3797503694 wait complete. 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.140+0000 7f718aeccb80 20 client.27856 trim_cache size 0 max 16384 2024-05-09T01:17:28.142 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71600b2a50 msgr2=0x7f71600b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71600b2a50 0x7f71600b4f60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ac0e0 tx=0x7f716c01c040 comp rx=0 tx=0).stop 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7174108530 msgr2=0x7f7174199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7174108530 0x7f7174199840 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fd0 tx=0x7f716c009500 comp rx=0 tx=0).stop 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 shutdown_connections 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f71600b2a50 0x7f71600b4f60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7174108530 0x7f7174199840 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71741032b0 0x7f717419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 --2- 172.21.15.37:0/2949938415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7174107be0 0x7f717419fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 >> 172.21.15.37:0/2949938415 conn(0x7f7174078b80 msgr2=0x7f7174100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.142+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 shutdown_connections 2024-05-09T01:17:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:28.143+0000 7f717b254700 1 -- 172.21.15.37:0/2949938415 wait complete. 2024-05-09T01:17:28.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:28 smithi037 ceph-mon[30122]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 960 op/s 2024-05-09T01:17:28.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:28 smithi136 ceph-mon[34110]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 960 op/s 2024-05-09T01:17:28.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-09T01:17:28.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:28 smithi151 ceph-mon[34780]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 960 op/s 2024-05-09T01:17:29.425 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:29.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:29 smithi037 ceph-mon[30122]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.4 MiB/s wr, 906 op/s 2024-05-09T01:17:30.126 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:29 smithi136 ceph-mon[34110]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.4 MiB/s wr, 906 op/s 2024-05-09T01:17:30.223 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:29 smithi151 ceph-mon[34780]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.4 MiB/s wr, 906 op/s 2024-05-09T01:17:31.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 -- 172.21.15.37:0/3799093828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a14108740 msgr2=0x7f8a141100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3799093828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a14108740 0x7f8a141100a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00b0d0 tx=0x7f8a0c00b3e0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 -- 172.21.15.37:0/3799093828 shutdown_connections 2024-05-09T01:17:31.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3799093828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a14108740 0x7f8a141100a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3799093828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a141034c0 0x7f8a141038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3799093828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a14107df0 0x7f8a14108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 -- 172.21.15.37:0/3799093828 >> 172.21.15.37:0/3799093828 conn(0x7f8a140fedc0 msgr2=0x7f8a141011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:31.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 -- 172.21.15.37:0/3799093828 shutdown_connections 2024-05-09T01:17:31.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.292+0000 7f8a19b68700 1 -- 172.21.15.37:0/3799093828 wait complete. 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 Processor -- start 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 -- start start 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a141034c0 0x7f8a1419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a14107df0 0x7f8a1419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a14108740 0x7f8a1419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a14113370 con 0x7f8a141034c0 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141131f0 con 0x7f8a14107df0 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a19b68700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141134f0 con 0x7f8a14108740 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.293+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a141034c0 0x7f8a1419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a141034c0 0x7f8a1419add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47960/0 (socket says 172.21.15.37:47960) 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a137fe700 1 -- 172.21.15.37:0/3529268270 learned_addr learned my addr 172.21.15.37:0/3529268270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:31.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a13fff700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a14108740 0x7f8a1419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a14107df0 0x7f8a1419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a13fff700 1 -- 172.21.15.37:0/3529268270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a14107df0 msgr2=0x7f8a1419b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a13fff700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a14107df0 0x7f8a1419b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a13fff700 1 -- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a141034c0 msgr2=0x7f8a1419add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a13fff700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a141034c0 0x7f8a1419add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a13fff700 1 -- 172.21.15.37:0/3529268270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1419fbf0 con 0x7f8a14108740 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a13fff700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a14108740 0x7f8a1419f600 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00b0d0 tx=0x7f8a0c007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a10ff9700 1 -- 172.21.15.37:0/3529268270 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c01f070 con 0x7f8a14108740 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1419fe80 con 0x7f8a14108740 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a10ff9700 1 -- 172.21.15.37:0/3529268270 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a0c004c50 con 0x7f8a14108740 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a10ff9700 1 -- 172.21.15.37:0/3529268270 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c01b690 con 0x7f8a14108740 2024-05-09T01:17:31.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.294+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a141a03b0 con 0x7f8a14108740 2024-05-09T01:17:31.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.297+0000 7f8a10ff9700 1 -- 172.21.15.37:0/3529268270 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8a0c022070 con 0x7f8a14108740 2024-05-09T01:17:31.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.298+0000 7f8a10ff9700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89fc0b2880 0x7f89fc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.298+0000 7f8a137fe700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89fc0b2880 0x7f89fc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a10ff9700 1 -- 172.21.15.37:0/3529268270 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8a0c00f020 con 0x7f8a14108740 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 Processor -- start 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 -- start start 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee3a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a137fe700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89fc0b2880 0x7f89fc0b4d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009680 tx=0x7f8a04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee34810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b5ed570a0 con 0x556b5ee34400 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556b5ecfc9a0 con 0x556b5ecb74a0 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556b5ed53060 con 0x556b5ed31d00 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee34810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee34810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47976/0 (socket says 172.21.15.37:47976) 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a13fff700 1 -- 172.21.15.37:0/3202170002 learned_addr learned my addr 172.21.15.37:0/3202170002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a137fe700 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee3a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.299+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f8a13fff700 1 -- 172.21.15.37:0/3202170002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 msgr2=0x556b5ee3a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f8a13fff700 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee3a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f8a13fff700 1 -- 172.21.15.37:0/3202170002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 msgr2=0x556b5ee3a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f8a13fff700 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f8a13fff700 1 -- 172.21.15.37:0/3202170002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b5eced500 con 0x556b5ee34400 2024-05-09T01:17:31.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f8a13fff700 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee34810 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0a6ab0 tx=0x7f8a0c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6466a7da8d9303e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:31.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f89f9ffb700 1 -- 172.21.15.37:0/3202170002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0a61c0 con 0x556b5ee34400 2024-05-09T01:17:31.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f89f9ffb700 1 -- 172.21.15.37:0/3202170002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a0c004e00 con 0x556b5ee34400 2024-05-09T01:17:31.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.300+0000 7f89f9ffb700 1 -- 172.21.15.37:0/3202170002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c0cd0a0 con 0x556b5ee34400 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3202170002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 msgr2=0x556b5ee34810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee34810 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c0a6ab0 tx=0x7f8a0c00b3e0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3202170002 shutdown_connections 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee34810 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee3a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3202170002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3202170002 >> 172.21.15.37:0/3202170002 conn(0x556b5ecbaf70 msgr2=0x556b5ee2f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3202170002 shutdown_connections 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3202170002 wait complete. 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.301+0000 7f8a2857eb80 1 -- start start 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 1 Processor -- start 2024-05-09T01:17:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee439a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee43ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee3dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556b5ed570a0 con 0x556b5ee34400 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556b5ecf1b20 con 0x556b5ecb74a0 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556b5ee34fb0 con 0x556b5ed31d00 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a2857eb80 10 client.0 _ll_register_callbacks cb 0x556b5ebc86c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee43ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee3dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee43ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38822/0 (socket says 172.21.15.37:38822) 2024-05-09T01:17:31.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee3dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47980/0 (socket says 172.21.15.37:47980) 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 -- 172.21.15.37:0/1231086996 learned_addr learned my addr 172.21.15.37:0/1231086996 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a137fe700 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 -- 172.21.15.37:0/1231086996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 msgr2=0x556b5ee439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 -- 172.21.15.37:0/1231086996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 msgr2=0x556b5ee3dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee3dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.302+0000 7f8a12ffd700 1 -- 172.21.15.37:0/1231086996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b5ebd2490 con 0x556b5ed31d00 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee43ee0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a08010820 tx=0x7f8a08010b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a63648ebd30fd87 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f89f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1231086996 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08004320 con 0x556b5ed31d00 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1231086996 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8a080044c0 con 0x556b5ed31d00 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b5ed64a80 con 0x556b5ed31d00 2024-05-09T01:17:31.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1231086996 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8a08003680 con 0x556b5ed31d00 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f8a2857eb80 10 client.27868 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x556b5ee4b670 con 0x556b5ed31d00 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.303+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1231086996 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556b5ed64a80 con 0x556b5ed31d00 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1231086996 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f8a0800fb40 con 0x556b5ed31d00 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a2857eb80 10 client.27868 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a2857eb80 10 client.27868 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a2857eb80 20 client.27868 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5ee4dc50 0x556b5ee500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a2857eb80 4 client.27868 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b5ed5eb20 con 0x556b5ee4dc50 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a137fe700 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5ee4dc50 0x556b5ee500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f8a137fe700 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5ee4dc50 0x556b5ee500a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6ae045e3a8d1bed server_cookie=5ba3c9164d40089a in_seq=0 out_seq=0 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.304+0000 7f89f2ffd700 10 client.27868 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1231086996 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556b5ed5eb20 con 0x556b5ee4dc50 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f89f2ffd700 10 client.27868 handle_command_reply: tid=0 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 client.27868 shutdown 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 msgr2=0x556b5ee43ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee43ee0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a08010820 tx=0x7f8a08010b30 comp rx=0 tx=0).stop 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 shutdown_connections 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5ee4dc50 0x556b5ee500a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee3dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1231086996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ed31d00 0x556b5ee43ee0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 >> 172.21.15.37:0/1231086996 conn(0x556b5ecbaf70 msgr2=0x556b5ee28ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.305+0000 7f89f2ffd700 0 client.27868 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.306+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 shutdown_connections 2024-05-09T01:17:31.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.306+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1231086996 wait complete. 2024-05-09T01:17:31.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.306+0000 7f8a2857eb80 20 client.27868 trim_cache size 0 max 16384 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 Processor -- start 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 -- start start 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ed31d00 0x556b5ee383e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ee34400 0x556b5ee55820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141ae970 con 0x556b5ed31d00 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141b04b0 con 0x556b5ecb74a0 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141af040 con 0x556b5ee34400 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.321+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ed31d00 0x556b5ee383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ed31d00 0x556b5ee383e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47988/0 (socket says 172.21.15.37:47988) 2024-05-09T01:17:31.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 -- 172.21.15.37:0/3616837215 learned_addr learned my addr 172.21.15.37:0/3616837215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ee34400 0x556b5ee55820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a137fe700 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 -- 172.21.15.37:0/3616837215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ee34400 msgr2=0x556b5ee55820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ee34400 0x556b5ee55820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 -- 172.21.15.37:0/3616837215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 msgr2=0x556b5ee3e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 -- 172.21.15.37:0/3616837215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b5ee2b9d0 con 0x556b5ed31d00 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ed31d00 0x556b5ee383e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8a08000c00 tx=0x7f8a0801a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69720ef1d89f9ab6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f89f97fa700 1 -- 172.21.15.37:0/3616837215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a080053c0 con 0x556b5ed31d00 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f89f97fa700 1 -- 172.21.15.37:0/3616837215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a08005560 con 0x556b5ed31d00 2024-05-09T01:17:31.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.322+0000 7f89f97fa700 1 -- 172.21.15.37:0/3616837215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800f5a0 con 0x556b5ed31d00 2024-05-09T01:17:31.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3616837215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ed31d00 msgr2=0x556b5ee383e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ed31d00 0x556b5ee383e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8a08000c00 tx=0x7f8a0801a510 comp rx=0 tx=0).stop 2024-05-09T01:17:31.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3616837215 shutdown_connections 2024-05-09T01:17:31.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ee34400 0x556b5ee55820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ecb74a0 0x556b5ee3e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/3616837215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ed31d00 0x556b5ee383e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3616837215 >> 172.21.15.37:0/3616837215 conn(0x556b5ecbaf70 msgr2=0x556b5ee37cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3616837215 shutdown_connections 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.323+0000 7f8a2857eb80 1 -- 172.21.15.37:0/3616837215 wait complete. 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 -- start start 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 Processor -- start 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ecb74a0 0x556b5ee46b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ed31d00 0x556b5ee47070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee475b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141afde0 con 0x556b5ee34400 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141af710 con 0x556b5ed31d00 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8a141ac930 con 0x556b5ecb74a0 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.324+0000 7f8a2857eb80 10 client.0 _ll_register_callbacks cb 0x556b5ebc86c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ecb74a0 0x556b5ee46b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ecb74a0 0x556b5ee46b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38836/0 (socket says 172.21.15.37:38836) 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 -- 172.21.15.37:0/1885113565 learned_addr learned my addr 172.21.15.37:0/1885113565 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:31.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a13fff700 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ed31d00 0x556b5ee47070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 -- 172.21.15.37:0/1885113565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ed31d00 msgr2=0x556b5ee47070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ed31d00 0x556b5ee47070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 -- 172.21.15.37:0/1885113565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 msgr2=0x556b5ee475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 -- 172.21.15.37:0/1885113565 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b5eeb63d0 con 0x556b5ecb74a0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a137fe700 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ecb74a0 0x556b5ee46b30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009af0 tx=0x7f8a040047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7205ab85dcb68b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f89f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1885113565 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0401d920 con 0x556b5ecb74a0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1885113565 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f8a0401dac0 con 0x556b5ecb74a0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.325+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a08005560 con 0x556b5ecb74a0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1885113565 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8a0401dcc0 con 0x556b5ecb74a0 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 10 client.27874 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:31.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x556b5eeb7670 con 0x556b5ecb74a0 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1885113565 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a08005560 con 0x556b5ecb74a0 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1885113565 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f8a04036450 con 0x556b5ecb74a0 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 10 client.27874 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 10 client.27874 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 20 client.27874 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5eeb7d30 0x556b5eeba150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 4 client.27874 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 --> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b5ebd2970 con 0x556b5eeb7d30 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.326+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5eeb7d30 0x556b5eeba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f89f2ffd700 10 client.27874 ms_handle_connect on v2:172.21.15.151:6838/1727507509 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a12ffd700 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5eeb7d30 0x556b5eeba150 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18aba6e6f807107 server_cookie=6eb3c27cfc7de8ee in_seq=0 out_seq=0 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f89f2ffd700 1 -- 172.21.15.37:0/1885113565 <== mds.2 v2:172.21.15.151:6838/1727507509 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b5ebd2970 con 0x556b5eeb7d30 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f89f2ffd700 10 client.27874 handle_command_reply: tid=0 2024-05-09T01:17:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 client.27874 shutdown 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ecb74a0 msgr2=0x556b5ee46b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ecb74a0 0x556b5ee46b30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009af0 tx=0x7f8a040047c0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 shutdown_connections 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:6838/1727507509,v1:172.21.15.151:6839/1727507509] conn(0x556b5eeb7d30 0x556b5eeba150 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556b5ee34400 0x556b5ee475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b5ecb74a0 0x556b5ee46b30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f89f2ffd700 0 client.27874 ms_handle_reset on v2:172.21.15.151:6838/1727507509 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 --2- 172.21.15.37:0/1885113565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x556b5ed31d00 0x556b5ee47070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 >> 172.21.15.37:0/1885113565 conn(0x556b5ecbaf70 msgr2=0x556b5ee2eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 shutdown_connections 2024-05-09T01:17:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 1 -- 172.21.15.37:0/1885113565 wait complete. 2024-05-09T01:17:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.327+0000 7f8a2857eb80 20 client.27874 trim_cache size 0 max 16384 2024-05-09T01:17:31.335 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:17:31.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89fc0b2880 msgr2=0x7f89fc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89fc0b2880 0x7f89fc0b4d90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009680 tx=0x7f8a04009260 comp rx=0 tx=0).stop 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a14108740 msgr2=0x7f8a1419f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a14108740 0x7f8a1419f600 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00b0d0 tx=0x7f8a0c007a00 comp rx=0 tx=0).stop 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 shutdown_connections 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f89fc0b2880 0x7f89fc0b4d90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a14108740 0x7f8a1419f600 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a141034c0 0x7f8a1419add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 --2- 172.21.15.37:0/3529268270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a14107df0 0x7f8a1419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 >> 172.21.15.37:0/3529268270 conn(0x7f8a140fedc0 msgr2=0x7f8a1406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 shutdown_connections 2024-05-09T01:17:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:31.328+0000 7f8a19b68700 1 -- 172.21.15.37:0/3529268270 wait complete. 2024-05-09T01:17:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 -- 172.21.15.37:0/3225966667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20102b50 msgr2=0x7f5a20103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3225966667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20102b50 0x7f5a20103850 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5a10009900 tx=0x7f5a1002a410 comp rx=0 tx=0).stop 2024-05-09T01:17:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 -- 172.21.15.37:0/3225966667 shutdown_connections 2024-05-09T01:17:32.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3225966667 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a20108a90 0x7f5a2010aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3225966667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a20103d90 0x7f5a201041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3225966667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20102b50 0x7f5a20103850 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 -- 172.21.15.37:0/3225966667 >> 172.21.15.37:0/3225966667 conn(0x7f5a200fdd40 msgr2=0x7f5a201001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:32.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 -- 172.21.15.37:0/3225966667 shutdown_connections 2024-05-09T01:17:32.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.062+0000 7f5a25e96640 1 -- 172.21.15.37:0/3225966667 wait complete. 2024-05-09T01:17:32.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 Processor -- start 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 -- start start 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a20102b50 0x7f5a2019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20103d90 0x7f5a2019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a20108a90 0x7f5a201a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2010e630 con 0x7f5a20103d90 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2010e4b0 con 0x7f5a20108a90 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a25e96640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2010e7b0 con 0x7f5a20102b50 2024-05-09T01:17:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20103d90 0x7f5a2019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20103d90 0x7f5a2019a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37006/0 (socket says 172.21.15.37:37006) 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a1effd640 1 -- 172.21.15.37:0/3215457161 learned_addr learned my addr 172.21.15.37:0/3215457161 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a20102b50 0x7f5a2019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.063+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a20108a90 0x7f5a201a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1f7fe640 1 -- 172.21.15.37:0/3215457161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a20108a90 msgr2=0x7f5a201a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a20108a90 0x7f5a201a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1f7fe640 1 -- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20103d90 msgr2=0x7f5a2019a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20103d90 0x7f5a2019a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1f7fe640 1 -- 172.21.15.37:0/3215457161 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a201a1ed0 con 0x7f5a20102b50 2024-05-09T01:17:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1effd640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20103d90 0x7f5a2019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a20108a90 0x7f5a201a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a20102b50 0x7f5a2019a390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5a1002a930 tx=0x7f5a10004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1cff9640 1 -- 172.21.15.37:0/3215457161 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1003f070 con 0x7f5a20102b50 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a201a2160 con 0x7f5a20102b50 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1cff9640 1 -- 172.21.15.37:0/3215457161 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a10003ca0 con 0x7f5a20102b50 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a1cff9640 1 -- 172.21.15.37:0/3215457161 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10035070 con 0x7f5a20102b50 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.064+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a201a2620 con 0x7f5a20102b50 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 Processor -- start 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 -- start start 2024-05-09T01:17:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a1cff9640 1 -- 172.21.15.37:0/3215457161 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5a1003b460 con 0x7f5a20102b50 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae044500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae044a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5580adfa87c0 con 0x5580adc7f4d0 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5580adf440e0 con 0x5580adca01b0 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5580adfa4780 con 0x5580adc772f0 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae044a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37022/0 (socket says 172.21.15.37:37022) 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae044a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33584/0 (socket says 172.21.15.37:33584) 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a1effd640 1 -- 172.21.15.37:0/1423866760 learned_addr learned my addr 172.21.15.37:0/1423866760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.067+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae044500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1effd640 1 -- 172.21.15.37:0/1423866760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 msgr2=0x5580ae044a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1effd640 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae044a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1effd640 1 -- 172.21.15.37:0/1423866760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 msgr2=0x5580ae044500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1effd640 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae044500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1effd640 1 -- 172.21.15.37:0/1423866760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580adf6d7c0 con 0x5580adc7f4d0 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae044a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1effd640 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04b980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5a140115f0 tx=0x7f5a14011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d29bdeeca7932d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1cff9640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a080b27e0 0x7f5a080b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a05ffb640 1 -- 172.21.15.37:0/1423866760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1401e070 con 0x5580adc7f4d0 2024-05-09T01:17:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a080b27e0 0x7f5a080b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a05ffb640 1 -- 172.21.15.37:0/1423866760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a1400f660 con 0x5580adc7f4d0 2024-05-09T01:17:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a05ffb640 1 -- 172.21.15.37:0/1423866760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a14003850 con 0x5580adc7f4d0 2024-05-09T01:17:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.068+0000 7f5a1cff9640 1 -- 172.21.15.37:0/3215457161 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5a10102730 con 0x7f5a20102b50 2024-05-09T01:17:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1423866760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 msgr2=0x5580ae04b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04b980 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5a140115f0 tx=0x7f5a14011ab0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a080b27e0 0x7f5a080b4cf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5580ae0456d0 tx=0x7f5a180098a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1423866760 shutdown_connections 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04b980 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae044a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1423866760 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae044500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1423866760 >> 172.21.15.37:0/1423866760 conn(0x5580adc94300 msgr2=0x5580ae03fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1423866760 shutdown_connections 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1423866760 wait complete. 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.069+0000 7f5a2ce28740 1 -- start start 2024-05-09T01:17:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 1 Processor -- start 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc7f4d0 0x5580ae04e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae055740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5580ae04c3d0 con 0x5580adca01b0 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5580adf2f9c0 con 0x5580adc7f4d0 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5580ae04c550 con 0x5580adc772f0 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a2ce28740 10 client.0 _ll_register_callbacks cb 0x5580adf5c020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae055740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33588/0 (socket says 172.21.15.37:33588) 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1f7fe640 1 -- 172.21.15.37:0/947872240 learned_addr learned my addr 172.21.15.37:0/947872240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae055740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37030/0 (socket says 172.21.15.37:37030) 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1effd640 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc7f4d0 0x5580ae04e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1f7fe640 1 -- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc7f4d0 msgr2=0x5580ae04e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.070+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc7f4d0 0x5580ae04e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a1f7fe640 1 -- 172.21.15.37:0/947872240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 msgr2=0x5580ae055740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae055740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a1f7fe640 1 -- 172.21.15.37:0/947872240 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580adf561f0 con 0x5580adc772f0 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae055740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04e2a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5a100c9af0 tx=0x7f5a1002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faa0b15fad3b38f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f59feffd640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f59feffd640 1 -- 172.21.15.37:0/947872240 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a10048070 con 0x5580adc772f0 2024-05-09T01:17:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a1400f660 con 0x5580adc772f0 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f59feffd640 1 -- 172.21.15.37:0/947872240 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5a100ca260 con 0x5580adc772f0 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f59feffd640 1 -- 172.21.15.37:0/947872240 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5a100c9740 con 0x5580adc772f0 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a2ce28740 10 client.27886 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5580add0b790 con 0x5580adc772f0 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.071+0000 7f59feffd640 1 -- 172.21.15.37:0/947872240 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a1400f660 con 0x5580adc772f0 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f59feffd640 1 -- 172.21.15.37:0/947872240 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f5a1004b060 con 0x5580adc772f0 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a2ce28740 10 client.27886 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a2ce28740 10 client.27886 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a2ce28740 20 client.27886 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc5ed80 0x5580ae05bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a2ce28740 4 client.27886 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580adfb63d0 con 0x5580adc5ed80 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a1effd640 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc5ed80 0x5580ae05bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f5a1effd640 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc5ed80 0x5580ae05bc40 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca9340b568b0f53f server_cookie=8f8c2c08390f3119 in_seq=0 out_seq=0 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.072+0000 7f59feffd640 10 client.27886 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f59feffd640 1 -- 172.21.15.37:0/947872240 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5580adfb63d0 con 0x5580adc5ed80 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f59feffd640 10 client.27886 handle_command_reply: tid=0 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 client.27886 shutdown 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 msgr2=0x5580ae04e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04e2a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5a100c9af0 tx=0x7f5a1002a410 comp rx=0 tx=0).stop 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 shutdown_connections 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc5ed80 0x5580ae05bc40 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae055740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc7f4d0 0x5580ae04e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f59feffd640 0 client.27886 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/947872240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04e2a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.073+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 >> 172.21.15.37:0/947872240 conn(0x5580adc94300 msgr2=0x5580ae042da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.074+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 shutdown_connections 2024-05-09T01:17:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.074+0000 7f5a2ce28740 1 -- 172.21.15.37:0/947872240 wait complete. 2024-05-09T01:17:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.074+0000 7f5a2ce28740 20 client.27886 trim_cache size 0 max 16384 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 Processor -- start 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 -- start start 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201ab200 con 0x5580adc7f4d0 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201acd40 con 0x5580adca01b0 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201ab8d0 con 0x5580adc772f0 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37042/0 (socket says 172.21.15.37:37042) 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 -- 172.21.15.37:0/1656345401 learned_addr learned my addr 172.21.15.37:0/1656345401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 -- 172.21.15.37:0/1656345401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 msgr2=0x5580ae04de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 -- 172.21.15.37:0/1656345401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 msgr2=0x5580ae060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1effd640 1 -- 172.21.15.37:0/1656345401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580add825f0 con 0x5580adc7f4d0 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.090+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.091+0000 7f5a1effd640 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04e3b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009230 tx=0x7f5a1400f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bab24b53342f21 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.091+0000 7f5a057fa640 1 -- 172.21.15.37:0/1656345401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1402b070 con 0x5580adc7f4d0 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.091+0000 7f5a057fa640 1 -- 172.21.15.37:0/1656345401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a1400f660 con 0x5580adc7f4d0 2024-05-09T01:17:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.091+0000 7f5a057fa640 1 -- 172.21.15.37:0/1656345401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1401e040 con 0x5580adc7f4d0 2024-05-09T01:17:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1656345401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 msgr2=0x5580ae04e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04e3b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009230 tx=0x7f5a1400f930 comp rx=0 tx=0).stop 2024-05-09T01:17:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1656345401 shutdown_connections 2024-05-09T01:17:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adca01b0 0x5580ae060430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adc7f4d0 0x5580ae04e3b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/1656345401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc772f0 0x5580ae04de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1656345401 >> 172.21.15.37:0/1656345401 conn(0x5580adc94300 msgr2=0x5580ae04c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1656345401 shutdown_connections 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 -- 172.21.15.37:0/1656345401 wait complete. 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.092+0000 7f5a2ce28740 1 -- start start 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 1 Processor -- start 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc772f0 0x5580ae051da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc7f4d0 0x5580ae0522e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae0c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201ac670 con 0x5580adca01b0 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201abfa0 con 0x5580adc772f0 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5a201a91e0 con 0x5580adc7f4d0 2024-05-09T01:17:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a2ce28740 10 client.0 _ll_register_callbacks cb 0x7f5a10005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc7f4d0 0x5580ae0522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae0c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc772f0 0x5580ae051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae0c1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37048/0 (socket says 172.21.15.37:37048) 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a1effd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc7f4d0 0x5580ae0522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:33604/0 (socket says 172.21.15.37:33604) 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.093+0000 7f5a1ffff640 1 -- 172.21.15.37:0/213952204 learned_addr learned my addr 172.21.15.37:0/213952204 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1ffff640 1 -- 172.21.15.37:0/213952204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc7f4d0 msgr2=0x5580ae0522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc7f4d0 0x5580ae0522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1ffff640 1 -- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc772f0 msgr2=0x5580ae051da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc772f0 0x5580ae051da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1ffff640 1 -- 172.21.15.37:0/213952204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580adf6ced0 con 0x5580adca01b0 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1effd640 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc7f4d0 0x5580ae0522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc772f0 0x5580ae051da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a1ffff640 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae0c1fe0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5a18010f60 tx=0x7f5a18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bde3f7728d3fba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f59feffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f59feffd640 1 -- 172.21.15.37:0/213952204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1802d060 con 0x5580adca01b0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f59feffd640 1 -- 172.21.15.37:0/213952204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f5a1801fcb0 con 0x5580adca01b0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a1400f660 con 0x5580adca01b0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f59feffd640 1 -- 172.21.15.37:0/213952204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5a180283f0 con 0x5580adca01b0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a2ce28740 10 client.18003 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5580ae0c3580 con 0x5580adca01b0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.094+0000 7f59feffd640 1 -- 172.21.15.37:0/213952204 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a1400f660 con 0x5580adca01b0 2024-05-09T01:17:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f59feffd640 1 -- 172.21.15.37:0/213952204 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f5a18032070 con 0x5580adca01b0 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a2ce28740 10 client.18003 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a2ce28740 10 client.18003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a2ce28740 20 client.18003 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc341c0 0x5580ae0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a2ce28740 4 client.18003 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5580adfb0240 con 0x5580adc341c0 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc341c0 0x5580ae0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f59feffd640 10 client.18003 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:32.095+0000 7f5a1f7fe640 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc341c0 0x5580ae0c5fa0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f38b0db48e43619 server_cookie=1418ad06efacef4a in_seq=0 out_seq=0 2024-05-09T01:17:32.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:32 smithi136 ceph-mon[34110]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.19k op/s 2024-05-09T01:17:32.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:32 smithi037 ceph-mon[30122]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.19k op/s 2024-05-09T01:17:32.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:32 smithi151 ceph-mon[34780]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 1.19k op/s 2024-05-09T01:17:33.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-09T01:17:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:34 smithi136 ceph-mon[34110]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.72k op/s 2024-05-09T01:17:34.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:34 smithi037 ceph-mon[30122]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.72k op/s 2024-05-09T01:17:34.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:34 smithi151 ceph-mon[34780]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 1.72k op/s 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 -- 172.21.15.37:0/2519776264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 msgr2=0x7fea7c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 --2- 172.21.15.37:0/2519776264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c1100a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fea7400b0d0 tx=0x7fea7400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 -- 172.21.15.37:0/2519776264 shutdown_connections 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 --2- 172.21.15.37:0/2519776264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c1100a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 --2- 172.21.15.37:0/2519776264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c1034c0 0x7fea7c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 --2- 172.21.15.37:0/2519776264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea7c107df0 0x7fea7c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 -- 172.21.15.37:0/2519776264 >> 172.21.15.37:0/2519776264 conn(0x7fea7c0fedf0 msgr2=0x7fea7c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 -- 172.21.15.37:0/2519776264 shutdown_connections 2024-05-09T01:17:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 -- 172.21.15.37:0/2519776264 wait complete. 2024-05-09T01:17:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.403+0000 7fea83b9a700 1 Processor -- start 2024-05-09T01:17:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea83b9a700 1 -- start start 2024-05-09T01:17:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea83b9a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea7c1034c0 0x7fea7c19bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea83b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c107df0 0x7fea7c19c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea83b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea83b9a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c113390 con 0x7fea7c108740 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea83b9a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c113210 con 0x7fea7c1034c0 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea83b9a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c113510 con 0x7fea7c107df0 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37066/0 (socket says 172.21.15.37:37066) 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 -- 172.21.15.37:0/3858374898 learned_addr learned my addr 172.21.15.37:0/3858374898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea81936700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea7c1034c0 0x7fea7c19bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea81135700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c107df0 0x7fea7c19c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 -- 172.21.15.37:0/3858374898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c107df0 msgr2=0x7fea7c19c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c107df0 0x7fea7c19c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 -- 172.21.15.37:0/3858374898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea7c1034c0 msgr2=0x7fea7c19bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea7c1034c0 0x7fea7c19bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 -- 172.21.15.37:0/3858374898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7c1a6ef0 con 0x7fea7c108740 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.404+0000 7fea82137700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c19c6d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fea740095c0 tx=0x7fea74007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.405+0000 7fea72ffd700 1 -- 172.21.15.37:0/3858374898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7401f070 con 0x7fea7c108740 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.405+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7c1a7180 con 0x7fea7c108740 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.405+0000 7fea72ffd700 1 -- 172.21.15.37:0/3858374898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea74003c00 con 0x7fea7c108740 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.405+0000 7fea72ffd700 1 -- 172.21.15.37:0/3858374898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7401b6a0 con 0x7fea7c108740 2024-05-09T01:17:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.405+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea7c1a7630 con 0x7fea7c108740 2024-05-09T01:17:35.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.407+0000 7fea72ffd700 1 -- 172.21.15.37:0/3858374898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fea74022070 con 0x7fea7c108740 2024-05-09T01:17:35.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.408+0000 7fea72ffd700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fea680b2880 0x7fea680b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.408+0000 7fea81936700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fea680b2880 0x7fea680b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.408+0000 7fea72ffd700 1 -- 172.21.15.37:0/3858374898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fea7400f020 con 0x7fea7c108740 2024-05-09T01:17:35.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 Processor -- start 2024-05-09T01:17:35.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea81936700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fea680b2880 0x7fea680b4d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fea78004630 tx=0x7fea7800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 -- start start 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c28dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c28e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2925c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f2c1ac0a0 con 0x564f2c2921b0 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564f2c1519a0 con 0x564f2c10c4a0 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea925b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f2c1a8060 con 0x564f2c186d00 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea82137700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea82137700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2925c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37068/0 (socket says 172.21.15.37:37068) 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea82137700 1 -- 172.21.15.37:0/1320374152 learned_addr learned my addr 172.21.15.37:0/1320374152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea81135700 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c28e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.409+0000 7fea81936700 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c28dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea82137700 1 -- 172.21.15.37:0/1320374152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 msgr2=0x564f2c28dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea82137700 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c28dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea82137700 1 -- 172.21.15.37:0/1320374152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 msgr2=0x564f2c28e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea82137700 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c28e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea82137700 1 -- 172.21.15.37:0/1320374152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2c142500 con 0x564f2c2921b0 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea81936700 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c28dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea82137700 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2925c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fea740e0f50 tx=0x7fea740055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eace155754817322 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea67fff700 1 -- 172.21.15.37:0/1320374152 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740b3280 con 0x564f2c2921b0 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea67fff700 1 -- 172.21.15.37:0/1320374152 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea740aa670 con 0x564f2c2921b0 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.410+0000 7fea67fff700 1 -- 172.21.15.37:0/1320374152 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740aadc0 con 0x564f2c2921b0 2024-05-09T01:17:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 -- 172.21.15.37:0/1320374152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 msgr2=0x564f2c2925c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2925c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fea740e0f50 tx=0x7fea740055d0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 -- 172.21.15.37:0/1320374152 shutdown_connections 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2925c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c28dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1320374152 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c28e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 -- 172.21.15.37:0/1320374152 >> 172.21.15.37:0/1320374152 conn(0x564f2c10ff70 msgr2=0x564f2c284220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 -- 172.21.15.37:0/1320374152 shutdown_connections 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 -- 172.21.15.37:0/1320374152 wait complete. 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.411+0000 7fea925b0b80 1 -- start start 2024-05-09T01:17:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 1 Processor -- start 2024-05-09T01:17:35.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c29cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c29d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2972e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f2c1ac0a0 con 0x564f2c2921b0 2024-05-09T01:17:35.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564f2c146b20 con 0x564f2c10c4a0 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f2c292d20 con 0x564f2c186d00 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea925b0b80 10 client.0 _ll_register_callbacks cb 0x564f2c01d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea82137700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea81936700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c29cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea82137700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37074/0 (socket says 172.21.15.37:37074) 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea82137700 1 -- 172.21.15.37:0/3735560439 learned_addr learned my addr 172.21.15.37:0/3735560439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.412+0000 7fea81135700 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c29d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea82137700 1 -- 172.21.15.37:0/3735560439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 msgr2=0x564f2c29d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea82137700 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c29d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea82137700 1 -- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 msgr2=0x564f2c29cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea82137700 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c29cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea82137700 1 -- 172.21.15.37:0/3735560439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f2c027490 con 0x564f2c2921b0 2024-05-09T01:17:35.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea81936700 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c29cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea82137700 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2972e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fea7400d010 tx=0x7fea740056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455e8fa670d90762 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea657fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea657fa700 1 -- 172.21.15.37:0/3735560439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7406f060 con 0x564f2c2921b0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea657fa700 1 -- 172.21.15.37:0/3735560439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fea740aafd0 con 0x564f2c2921b0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea740aa670 con 0x564f2c2921b0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea657fa700 1 -- 172.21.15.37:0/3735560439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fea740aef10 con 0x564f2c2921b0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea925b0b80 10 client.18015 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564f2c2a4b00 con 0x564f2c2921b0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.413+0000 7fea657fa700 1 -- 172.21.15.37:0/3735560439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea740aa670 con 0x564f2c2921b0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea657fa700 1 -- 172.21.15.37:0/3735560439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fea74011070 con 0x564f2c2921b0 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea925b0b80 10 client.18015 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea925b0b80 10 client.18015 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea925b0b80 20 client.18015 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea925b0b80 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c2a6fd0 0x564f2c2a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea925b0b80 4 client.18015 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f2c1b9a80 con 0x564f2c2a6fd0 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea81936700 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c2a6fd0 0x564f2c2a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea657fa700 10 client.18015 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.414+0000 7fea81936700 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c2a6fd0 0x564f2c2a93f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e91066bc4353a78b server_cookie=e6247848b01b9ca9 in_seq=0 out_seq=0 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.415+0000 7fea657fa700 1 -- 172.21.15.37:0/3735560439 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f2c1b9a80 con 0x564f2c2a6fd0 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.415+0000 7fea657fa700 10 client.18015 handle_command_reply: tid=0 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.415+0000 7fea925b0b80 1 client.18015 shutdown 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.415+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 msgr2=0x564f2c2972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.415+0000 7fea925b0b80 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2972e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fea7400d010 tx=0x7fea740056e0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 shutdown_connections 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c2a6fd0 0x564f2c2a93f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c2921b0 0x564f2c2972e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c29cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 --2- 172.21.15.37:0/3735560439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c186d00 0x564f2c29d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea657fa700 0 client.18015 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:17:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 >> 172.21.15.37:0/3735560439 conn(0x564f2c10ff70 msgr2=0x564f2c2883f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 shutdown_connections 2024-05-09T01:17:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 1 -- 172.21.15.37:0/3735560439 wait complete. 2024-05-09T01:17:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.416+0000 7fea925b0b80 20 client.18015 trim_cache size 0 max 16384 2024-05-09T01:17:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.431+0000 7fea925b0b80 1 Processor -- start 2024-05-09T01:17:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.431+0000 7fea925b0b80 1 -- start start 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c2aea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c186d00 0x564f2c2aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c27dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea925b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1ac7e0 con 0x564f2c186d00 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea925b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1ae320 con 0x564f2c10c4a0 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea925b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1aceb0 con 0x564f2c2921b0 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c186d00 0x564f2c2aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c186d00 0x564f2c2aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37080/0 (socket says 172.21.15.37:37080) 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 -- 172.21.15.37:0/4294816138 learned_addr learned my addr 172.21.15.37:0/4294816138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81936700 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c2aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea82137700 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c27dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 -- 172.21.15.37:0/4294816138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 msgr2=0x564f2c27dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c27dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 -- 172.21.15.37:0/4294816138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 msgr2=0x564f2c2aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c2aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.432+0000 7fea81135700 1 -- 172.21.15.37:0/4294816138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f2c27dcc0 con 0x564f2c186d00 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.433+0000 7fea81135700 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c186d00 0x564f2c2aef90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fea6c008ce0 tx=0x7fea6c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1517ec5d594d26 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.433+0000 7fea677fe700 1 -- 172.21.15.37:0/4294816138 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c004260 con 0x564f2c186d00 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.433+0000 7fea677fe700 1 -- 172.21.15.37:0/4294816138 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea6c011d30 con 0x564f2c186d00 2024-05-09T01:17:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.433+0000 7fea677fe700 1 -- 172.21.15.37:0/4294816138 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c005020 con 0x564f2c186d00 2024-05-09T01:17:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 -- 172.21.15.37:0/4294816138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c186d00 msgr2=0x564f2c2aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c186d00 0x564f2c2aef90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fea6c008ce0 tx=0x7fea6c011440 comp rx=0 tx=0).stop 2024-05-09T01:17:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 -- 172.21.15.37:0/4294816138 shutdown_connections 2024-05-09T01:17:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c27dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c10c4a0 0x564f2c2aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 --2- 172.21.15.37:0/4294816138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c186d00 0x564f2c2aef90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 -- 172.21.15.37:0/4294816138 >> 172.21.15.37:0/4294816138 conn(0x564f2c10ff70 msgr2=0x564f2c2841f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 -- 172.21.15.37:0/4294816138 shutdown_connections 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 -- 172.21.15.37:0/4294816138 wait complete. 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 -- start start 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.434+0000 7fea925b0b80 1 Processor -- start 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c10c4a0 0x564f2c28f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c186d00 0x564f2c28fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea925b0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c2a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea925b0b80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1adc50 con 0x564f2c10c4a0 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea925b0b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1ad580 con 0x564f2c186d00 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea925b0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fea7c1aa7a0 con 0x564f2c2921b0 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea925b0b80 10 client.0 _ll_register_callbacks cb 0x564f2c01d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea81936700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c10c4a0 0x564f2c28f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea81936700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c10c4a0 0x564f2c28f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37088/0 (socket says 172.21.15.37:37088) 2024-05-09T01:17:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea81936700 1 -- 172.21.15.37:0/1502158377 learned_addr learned my addr 172.21.15.37:0/1502158377 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea82137700 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c2a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.435+0000 7fea81135700 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c186d00 0x564f2c28fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea81936700 1 -- 172.21.15.37:0/1502158377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 msgr2=0x564f2c2a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea81936700 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c2a2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea81936700 1 -- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c186d00 msgr2=0x564f2c28fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea81936700 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c186d00 0x564f2c28fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea81936700 1 -- 172.21.15.37:0/1502158377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f2c2a31e0 con 0x564f2c10c4a0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea81936700 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c10c4a0 0x564f2c28f910 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x564f2c296b60 tx=0x7fea78013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912859971b848b16 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea657fa700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea657fa700 1 -- 172.21.15.37:0/1502158377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7802c070 con 0x564f2c10c4a0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea657fa700 1 -- 172.21.15.37:0/1502158377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fea78028240 con 0x564f2c10c4a0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea6c011d30 con 0x564f2c10c4a0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea657fa700 1 -- 172.21.15.37:0/1502158377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fea78028440 con 0x564f2c10c4a0 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea925b0b80 10 client.18021 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:35.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x564f2c311080 con 0x564f2c10c4a0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.436+0000 7fea657fa700 1 -- 172.21.15.37:0/1502158377 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea6c011d30 con 0x564f2c10c4a0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea657fa700 1 -- 172.21.15.37:0/1502158377 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7fea7802f030 con 0x564f2c10c4a0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea925b0b80 10 client.18021 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea925b0b80 10 client.18021 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea925b0b80 20 client.18021 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c3117f0 0x564f2c313c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea925b0b80 4 client.18021 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 --> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f2c1b3b20 con 0x564f2c3117f0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.437+0000 7fea81135700 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c3117f0 0x564f2c313c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea81135700 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c3117f0 0x564f2c313c10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5994c8ed07fc3be server_cookie=aa0f9d692612f6fb in_seq=0 out_seq=0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea657fa700 10 client.18021 ms_handle_connect on v2:172.21.15.136:6836/2054090484 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea657fa700 1 -- 172.21.15.37:0/1502158377 <== mds.1 v2:172.21.15.136:6836/2054090484 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f2c1b3b20 con 0x564f2c3117f0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea657fa700 10 client.18021 handle_command_reply: tid=0 2024-05-09T01:17:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 client.18021 shutdown 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c10c4a0 msgr2=0x564f2c28f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c10c4a0 0x564f2c28f910 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x564f2c296b60 tx=0x7fea78013070 comp rx=0 tx=0).stop 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 shutdown_connections 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f2c2921b0 0x564f2c2a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:6836/2054090484,v1:172.21.15.136:6837/2054090484] conn(0x564f2c3117f0 0x564f2c313c10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f2c10c4a0 0x564f2c28f910 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea657fa700 0 client.18021 ms_handle_reset on v2:172.21.15.136:6836/2054090484 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 --2- 172.21.15.37:0/1502158377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564f2c186d00 0x564f2c28fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 >> 172.21.15.37:0/1502158377 conn(0x564f2c10ff70 msgr2=0x564f2c2841f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 shutdown_connections 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 1 -- 172.21.15.37:0/1502158377 wait complete. 2024-05-09T01:17:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.438+0000 7fea925b0b80 20 client.18021 trim_cache size 0 max 16384 2024-05-09T01:17:35.446 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:17:35.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fea680b2880 msgr2=0x7fea680b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fea680b2880 0x7fea680b4d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fea78004630 tx=0x7fea7800b3c0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 msgr2=0x7fea7c19c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c19c6d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fea740095c0 tx=0x7fea74007a20 comp rx=0 tx=0).stop 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 shutdown_connections 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fea680b2880 0x7fea680b4d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea7c108740 0x7fea7c19c6d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea7c1034c0 0x7fea7c19bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 --2- 172.21.15.37:0/3858374898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea7c107df0 0x7fea7c19c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 >> 172.21.15.37:0/3858374898 conn(0x7fea7c0fedf0 msgr2=0x7fea7c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 shutdown_connections 2024-05-09T01:17:35.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:35.439+0000 7fea83b9a700 1 -- 172.21.15.37:0/3858374898 wait complete. 2024-05-09T01:17:36.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f59feffd640 1 -- 172.21.15.37:0/213952204 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x5580adfb0240 con 0x5580adc341c0 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f59feffd640 10 client.18003 handle_command_reply: tid=0 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 client.18003 shutdown 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 msgr2=0x5580ae0c1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae0c1fe0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5a18010f60 tx=0x7f5a18004a40 comp rx=0 tx=0).stop 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 shutdown_connections 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x5580adc341c0 0x5580ae0c5fa0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580adca01b0 0x5580ae0c1fe0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5580adc7f4d0 0x5580ae0522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 --2- 172.21.15.37:0/213952204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5580adc772f0 0x5580ae051da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f59feffd640 0 client.18003 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 >> 172.21.15.37:0/213952204 conn(0x5580adc94300 msgr2=0x5580ae04de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 shutdown_connections 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 1 -- 172.21.15.37:0/213952204 wait complete. 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.370+0000 7f5a2ce28740 20 client.18003 trim_cache size 0 max 16384 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-05-09T01:17:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-05-09T01:17:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a080b27e0 msgr2=0x7f5a080b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a080b27e0 0x7f5a080b4cf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5580ae0456d0 tx=0x7f5a180098a0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a20102b50 msgr2=0x7f5a2019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a20102b50 0x7f5a2019a390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5a1002a930 tx=0x7f5a10004270 comp rx=0 tx=0).stop 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 shutdown_connections 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f5a080b27e0 0x7f5a080b4cf0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a20108a90 0x7f5a201a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a20103d90 0x7f5a2019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 --2- 172.21.15.37:0/3215457161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a20102b50 0x7f5a2019a390 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 >> 172.21.15.37:0/3215457161 conn(0x7f5a200fdd40 msgr2=0x7f5a20109fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 shutdown_connections 2024-05-09T01:17:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-05-09T01:17:36.371+0000 7f5a25e96640 1 -- 172.21.15.37:0/3215457161 wait complete. 2024-05-09T01:17:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:36.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:36 smithi037 ceph-mon[30122]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 1.64k op/s 2024-05-09T01:17:36.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:36 smithi151 ceph-mon[34780]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 1.64k op/s 2024-05-09T01:17:36.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-09T01:17:36.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:36 smithi136 ceph-mon[34110]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 1.64k op/s 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 .. 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 data 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:total 36 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 . 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 .. 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 9 01:02 base 2024-05-09T01:17:36.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 May 9 01:02 current_logfiles 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 May 9 01:02 global 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 log 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_commit_ts 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_dynshmem 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 9 01:02 pg_hba.conf 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 9 01:02 pg_ident.conf 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 pg_logical 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 pg_multixact 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_notify 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_replslot 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_serial 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_snapshots 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 pg_stat 2024-05-09T01:17:36.894 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:17 pg_stat_tmp 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:17 pg_subtrans 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_tblspc 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pg_twophase 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 May 9 01:17 pg_wal 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 pg_xact 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 9 01:02 postgresql.auto.conf 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 9 01:02 postgresql.conf 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 May 9 01:02 postmaster.opts 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base: 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 9 01:02 . 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.895 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 1 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 13493 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 May 9 01:04 13494 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 pgsql_tmp 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 . 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 9 01:02 .. 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 112 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 113 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 1247 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1247_fsm 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1247_vm 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 9 01:02 1249 2024-05-09T01:17:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1249_fsm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1249_vm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 9 01:02 1255 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1255_fsm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1255_vm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 9 01:02 1259 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1259_fsm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1259_vm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 9 01:02 13344 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13344_fsm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13344_vm 2024-05-09T01:17:36.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13346 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13348 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13349_fsm 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349_vm 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13351 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13353 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13354_fsm 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354_vm 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13356 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13358 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13359_fsm 2024-05-09T01:17:36.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359_vm 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13361 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13363 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1417 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1418 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 174 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 175 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2187 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2224 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2328 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2336 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2337 2024-05-09T01:17:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2579 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2600 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2600_fsm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2600_vm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2601_fsm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601_vm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2602 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2602_fsm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2602_vm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2603 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2603_fsm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2603_vm 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2604 2024-05-09T01:17:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2605 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2605_fsm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2605_vm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2606_fsm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606_vm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2607 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2607_fsm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2607_vm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 9 01:02 2608 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2608_fsm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2608_vm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 9 01:02 2609 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2609_fsm 2024-05-09T01:17:36.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2609_vm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2610 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2610_fsm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2610_vm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2611 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2612_fsm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612_vm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2613 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2615_fsm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615_vm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2616 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2616_fsm 2024-05-09T01:17:36.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2616_vm 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 9 01:02 2617 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2617_fsm 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2617_vm 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 9 01:02 2618 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2618_fsm 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2618_vm 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 9 01:02 2619 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2619_fsm 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2619_vm 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2620 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2650 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2651 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2652 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2653 2024-05-09T01:17:36.903 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2654 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2655 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2656 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2657 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 9 01:02 2658 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 2659 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2660 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2661 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2662 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2663 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2664 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2665 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2666 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2667 2024-05-09T01:17:36.904 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2668 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2669 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2670 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 9 01:02 2673 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 9 01:02 2674 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 9 01:02 2675 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2678 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2679 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2680 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2681 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2682 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2683 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2684 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2685 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2686 2024-05-09T01:17:36.905 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2687 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2688 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2689 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 9 01:02 2690 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 9 01:02 2691 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2692 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2693 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2696 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2699 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2701 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2702 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2703 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2704 2024-05-09T01:17:36.906 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2753 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2753_fsm 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2753_vm 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2754 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2755 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2756 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2757 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2830 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2831 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2832 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2833 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2834 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2835 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2836 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2837 2024-05-09T01:17:36.907 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 9 01:02 2838 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2838_fsm 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2838_vm 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2839 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840_fsm 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2840_vm 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2841 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2995 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2996 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3079_fsm 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079_vm 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3080 2024-05-09T01:17:36.908 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3081 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3085 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3118 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3119 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 9 01:02 3164 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3256 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3257 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3258 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3350 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3351 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3379 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3380 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3381 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3394 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3394_fsm 2024-05-09T01:17:36.909 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3394_vm 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3395 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3429 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3430 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3431 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3433 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3439 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3440 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3455 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 9 01:02 3456 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3456_fsm 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3456_vm 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3466 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3467 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3468 2024-05-09T01:17:36.910 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3501 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3502 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3503 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3534 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3541_fsm 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541_vm 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3542 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3574 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3575 2024-05-09T01:17:36.911 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3576 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3596 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3597 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3598 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3599 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3600_fsm 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600_vm 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3601_fsm 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601_vm 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3602_fsm 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602_vm 2024-05-09T01:17:36.912 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603_fsm 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3603_vm 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3604 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3605 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3606 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3607 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3608 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 3609 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3712 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3764_fsm 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764_vm 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3766 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3767 2024-05-09T01:17:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3997 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4143 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4144 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4145 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4146 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4147 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4148 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4149 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4150 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4151 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4152 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4153 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4154 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4155 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4156 2024-05-09T01:17:36.914 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4157 2024-05-09T01:17:36.915 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4158 2024-05-09T01:17:36.915 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4159 2024-05-09T01:17:36.915 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4160 2024-05-09T01:17:36.915 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4161 2024-05-09T01:17:36.915 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4162 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4163 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4164 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4165 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4166 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4167 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4168 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4169 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4170 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4171 2024-05-09T01:17:36.916 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4172 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4173 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4174 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 5002 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 548 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 549 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6102 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6104 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6106 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6110 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6111 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6112 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6113 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6117 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 826 2024-05-09T01:17:36.917 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 827 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 828 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 9 01:02 . 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 9 01:02 .. 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 112 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 113 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 1247 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1247_fsm 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1247_vm 2024-05-09T01:17:36.918 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 9 01:02 1249 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1249_fsm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1249_vm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 9 01:02 1255 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1255_fsm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1255_vm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 9 01:02 1259 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1259_fsm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1259_vm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 9 01:02 13344 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13344_fsm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13344_vm 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13346 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13348 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349 2024-05-09T01:17:36.919 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13349_fsm 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349_vm 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13351 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13353 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13354_fsm 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354_vm 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13356 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13358 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13359_fsm 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359_vm 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13361 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13363 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1417 2024-05-09T01:17:36.920 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1418 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 174 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 175 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2187 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2224 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2328 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2336 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2337 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2579 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2600 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2600_fsm 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2600_vm 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2601_fsm 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601_vm 2024-05-09T01:17:36.921 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2602 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2602_fsm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2602_vm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2603 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2603_fsm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2603_vm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2604 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2605 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2605_fsm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2605_vm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2606_fsm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606_vm 2024-05-09T01:17:36.922 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2607 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2607_fsm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2607_vm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 9 01:02 2608 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2608_fsm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2608_vm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 9 01:02 2609 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2609_fsm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2609_vm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2610 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2610_fsm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2610_vm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2611 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2612_fsm 2024-05-09T01:17:36.923 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612_vm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2613 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2615_fsm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615_vm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2616 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2616_fsm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2616_vm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 9 01:02 2617 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2617_fsm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2617_vm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 9 01:02 2618 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2618_fsm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2618_vm 2024-05-09T01:17:36.924 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 9 01:02 2619 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2619_fsm 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2619_vm 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2620 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2650 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2651 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2652 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2653 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2654 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2655 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2656 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2657 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 9 01:02 2658 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 2659 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2660 2024-05-09T01:17:36.925 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2661 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2662 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2663 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2664 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2665 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2666 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2667 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2668 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2669 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2670 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 9 01:02 2673 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 9 01:02 2674 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 9 01:02 2675 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2678 2024-05-09T01:17:36.926 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2679 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2680 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2681 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2682 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2683 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2684 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2685 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2686 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2687 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2688 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2689 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 9 01:02 2690 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 9 01:02 2691 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2692 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2693 2024-05-09T01:17:36.927 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2696 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2699 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2701 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2702 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2703 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2704 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2753 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2753_fsm 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2753_vm 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2754 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2755 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2756 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2757 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2830 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2831 2024-05-09T01:17:36.928 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2832 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2833 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2834 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2835 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2836 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2837 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 9 01:02 2838 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2838_fsm 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2838_vm 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2839 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840_fsm 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2840_vm 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2841 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2995 2024-05-09T01:17:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2996 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3079_fsm 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079_vm 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3080 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3081 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3085 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3118 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3119 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 9 01:02 3164 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3256 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3257 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3258 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3350 2024-05-09T01:17:36.930 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3351 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3379 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3380 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3381 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3394 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3394_fsm 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3394_vm 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3395 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3429 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3430 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3431 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3433 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3439 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3440 2024-05-09T01:17:36.931 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3455 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 9 01:02 3456 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3456_fsm 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3456_vm 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3466 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3467 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3468 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3501 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3502 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3503 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3534 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3541_fsm 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541_vm 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3542 2024-05-09T01:17:36.932 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3574 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3575 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3576 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3596 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3597 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3598 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3599 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3600_fsm 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600_vm 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3601_fsm 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601_vm 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3602_fsm 2024-05-09T01:17:36.933 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602_vm 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603_fsm 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3603_vm 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3604 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3605 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3606 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3607 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3608 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 3609 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3712 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3764_fsm 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764_vm 2024-05-09T01:17:36.934 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3766 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3767 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3997 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4143 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4144 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4145 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4146 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4147 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4148 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4149 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4150 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4151 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4152 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4153 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4154 2024-05-09T01:17:36.935 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4155 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4156 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4157 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4158 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4159 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4160 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4161 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4162 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4163 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4164 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4165 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4166 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4167 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4168 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4169 2024-05-09T01:17:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4170 2024-05-09T01:17:36.937 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4171 2024-05-09T01:17:36.937 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4172 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4173 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4174 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 5002 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 548 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 549 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6102 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6104 2024-05-09T01:17:36.939 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6106 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6110 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6111 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6112 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6113 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6117 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 826 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 827 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 828 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:total 628862 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 May 9 01:04 . 2024-05-09T01:17:36.940 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 9 01:02 .. 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 112 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 113 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 1247 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1247_fsm 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1247_vm 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 9 01:02 1249 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1249_fsm 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1249_vm 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 9 01:02 1255 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1255_fsm 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1255_vm 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 9 01:16 1259 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1259_fsm 2024-05-09T01:17:36.941 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1259_vm 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 9 01:02 13344 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13344_fsm 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13344_vm 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13346 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13348 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13349_fsm 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13349_vm 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13351 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13353 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13354_fsm 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13354_vm 2024-05-09T01:17:36.942 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13356 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13358 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 13359_fsm 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13359_vm 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 13361 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 13363 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1417 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 1418 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 445767680 May 9 01:17 16396 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 9 01:17 16396_fsm 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:04 16396_vm 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2113536 May 9 01:17 16397 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:17 16397_fsm 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:17 16397_vm 2024-05-09T01:17:36.943 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2007040 May 9 01:17 16399 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:17 16399_fsm 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:17 16399_vm 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:17 16400 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 9 01:17 16402 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 May 9 01:17 16404 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 113672192 May 9 01:17 16406 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:17 16406_fsm 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:15 16406_vm 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 174 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 175 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2187 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2224 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2328 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2336 2024-05-09T01:17:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2337 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2579 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2600 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2600_fsm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2600_vm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2601_fsm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2601_vm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2602 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2602_fsm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2602_vm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2603 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2603_fsm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2603_vm 2024-05-09T01:17:36.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2604 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2605 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2605_fsm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2605_vm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2606_fsm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2606_vm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2607 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2607_fsm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2607_vm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 9 01:02 2608 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2608_fsm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2608_vm 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 9 01:02 2609 2024-05-09T01:17:36.946 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2609_fsm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2609_vm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2610 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2610_fsm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2610_vm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2611 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2612_fsm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2612_vm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2613 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2615_fsm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2615_vm 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2616 2024-05-09T01:17:36.947 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2616_fsm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2616_vm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 9 01:02 2617 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2617_fsm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2617_vm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 9 01:02 2618 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2618_fsm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2618_vm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 May 9 01:16 2619 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:04 2619_fsm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2619_vm 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2620 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2650 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2651 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2652 2024-05-09T01:17:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2653 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2654 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2655 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2656 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2657 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 9 01:02 2658 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 9 01:02 2659 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2660 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2661 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2662 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2663 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2664 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2665 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2666 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2667 2024-05-09T01:17:36.949 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2668 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2669 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2670 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 9 01:02 2673 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 9 01:02 2674 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 9 01:02 2675 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2678 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2679 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2680 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2681 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2682 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2683 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2684 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2685 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2686 2024-05-09T01:17:36.950 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2687 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2688 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 9 01:02 2689 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 9 01:02 2690 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 9 01:02 2691 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2692 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2693 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:06 2696 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2699 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2701 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2702 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2703 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 2704 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2753 2024-05-09T01:17:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2753_fsm 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2753_vm 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2754 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2755 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2756 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 2757 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2830 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2831 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2832 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2833 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2834 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2835 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2836 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2837 2024-05-09T01:17:36.952 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 9 01:02 2838 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2838_fsm 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2838_vm 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2839 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2840_fsm 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2840_vm 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2841 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2995 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2996 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3079_fsm 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3079_vm 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3080 2024-05-09T01:17:36.953 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3081 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3085 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3118 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3119 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 9 01:02 3164 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3256 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3257 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3258 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3350 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3351 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3379 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3380 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3381 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3394 2024-05-09T01:17:36.954 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3394_fsm 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3394_vm 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3395 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3429 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3430 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3431 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3433 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3439 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3440 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 9 01:02 3455 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 9 01:02 3456 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3456_fsm 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3456_vm 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3466 2024-05-09T01:17:36.955 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3467 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3468 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3501 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3502 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3503 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3534 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3541_fsm 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3541_vm 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3542 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3574 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3575 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3576 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3596 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3597 2024-05-09T01:17:36.956 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3598 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3599 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3600_fsm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3600_vm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3601_fsm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3601_vm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3602_fsm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3602_vm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3603_fsm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3603_vm 2024-05-09T01:17:36.957 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3604 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3605 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3606 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3607 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3608 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 9 01:02 3609 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3712 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 3764_fsm 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3764_vm 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3766 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 3767 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3997 2024-05-09T01:17:36.958 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4143 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4144 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4145 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4146 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4147 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4148 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4149 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4150 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4151 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4152 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4153 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4154 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4155 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4156 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4157 2024-05-09T01:17:36.959 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4158 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4159 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4160 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4161 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4162 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4163 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4164 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4165 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4166 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4167 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4168 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4169 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4170 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4171 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4172 2024-05-09T01:17:36.960 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4173 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4174 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 5002 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 548 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 549 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6102 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6104 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6106 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6110 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6111 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6112 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6113 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6117 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 826 2024-05-09T01:17:36.961 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 827 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 828 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 May 9 01:02 pg_internal.init 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:02 PG_VERSION 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 9 01:02 .. 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/global: 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:total 560 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 May 9 01:02 . 2024-05-09T01:17:36.962 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1213 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1213_fsm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1213_vm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1214 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1214_fsm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1214_vm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 1232 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 1233 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1260 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1260_fsm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1260_vm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1261 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1261_fsm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1261_vm 2024-05-09T01:17:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1262 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 1262_fsm 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 1262_vm 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2396 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:02 2396_fsm 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2396_vm 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2397 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2671 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2672 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2676 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2677 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2694 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2695 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2697 2024-05-09T01:17:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 9 01:02 2698 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2846 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2847 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2964 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2965 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 2966 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 2967 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 3592 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 3593 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4060 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4061 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4175 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4176 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4177 2024-05-09T01:17:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4178 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4181 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4182 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4183 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4184 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 4185 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 4186 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6000 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6001 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6002 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 6100 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6114 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 6115 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:17 pg_control 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 9 01:02 pg_filenode.map 2024-05-09T01:17:36.966 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 May 9 01:02 pg_internal.init 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/log: 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:total 2 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1223 May 9 01:17 postgresql-Thu.log 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-09T01:17:36.967 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:total 1 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 . 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 mappings 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 9 01:17 replorigin_checkpoint 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 snapshots 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.968 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 .. 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 .. 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 . 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 members 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 offsets 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-09T01:17:36.969 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 .. 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:02 0000 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:02 . 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 9 01:02 .. 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 9 01:04 0000 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.970 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.971 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:total 15 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 . 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 May 9 01:17 db_0.stat 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 May 9 01:17 db_13494.stat 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 May 9 01:17 global.stat 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:17 . 2024-05-09T01:17:36.972 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:total 64 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 9 01:17 . 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 9 01:17 0021 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-09T01:17:36.973 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:total 1048576 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 May 9 01:17 . 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:17 0000000100000000000000C4 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000C5 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:13 0000000100000000000000C6 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000C7 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000C8 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000C9 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000CA 2024-05-09T01:17:36.974 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:14 0000000100000000000000CB 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000CC 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000CD 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000CE 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:13 0000000100000000000000CF 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:14 0000000100000000000000D0 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:14 0000000100000000000000D1 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000D2 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000D3 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000D4 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000D5 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000D6 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:13 0000000100000000000000D7 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000D8 2024-05-09T01:17:36.975 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:14 0000000100000000000000D9 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000DA 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000DB 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000DC 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000DD 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000DE 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:15 0000000100000000000000DF 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000E0 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000E1 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000E2 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:13 0000000100000000000000E3 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000E4 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000E5 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:12 0000000100000000000000E6 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:11 0000000100000000000000E7 2024-05-09T01:17:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:15 0000000100000000000000E8 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000E9 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:17 0000000100000000000000EA 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000EB 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000EC 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000ED 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000EE 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000EF 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:15 0000000100000000000000F0 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:15 0000000100000000000000F1 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F2 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F3 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F4 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F5 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F6 2024-05-09T01:17:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F7 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F8 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000F9 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:15 0000000100000000000000FA 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000FB 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000FC 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:15 0000000100000000000000FD 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:17 0000000100000000000000FE 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 0000000100000000000000FF 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:17 000000010000000100000000 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:17 000000010000000100000001 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:16 000000010000000100000002 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 9 01:15 000000010000000100000003 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 archive_status 2024-05-09T01:17:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 9 01:02 . 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 May 9 01:17 .. 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:total 536 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 9 01:17 . 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 9 01:17 .. 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 May 9 01:07 0000 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 May 9 01:17 0001 2024-05-09T01:17:36.979 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 9 01:17 0002 2024-05-09T01:17:36.980 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-09T01:17:36.990 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:17:36.999 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-09T01:17:37.034 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-09T01:17:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 -- 172.21.15.37:0/362383066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c108740 msgr2=0x7f643c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 --2- 172.21.15.37:0/362383066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c108740 0x7f643c1100a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f643400b0d0 tx=0x7f643400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 -- 172.21.15.37:0/362383066 shutdown_connections 2024-05-09T01:17:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 --2- 172.21.15.37:0/362383066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c108740 0x7f643c1100a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 --2- 172.21.15.37:0/362383066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643c1034c0 0x7f643c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 --2- 172.21.15.37:0/362383066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f643c107df0 0x7f643c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 -- 172.21.15.37:0/362383066 >> 172.21.15.37:0/362383066 conn(0x7f643c0fedc0 msgr2=0x7f643c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 -- 172.21.15.37:0/362383066 shutdown_connections 2024-05-09T01:17:38.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.326+0000 7f6444275700 1 -- 172.21.15.37:0/362383066 wait complete. 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.327+0000 7f6444275700 1 Processor -- start 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.327+0000 7f6444275700 1 -- start start 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6444275700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f643c1034c0 0x7f643c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6444275700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c107df0 0x7f643c19c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6444275700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643c108740 0x7f643c1a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6444275700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f643c113370 con 0x7f643c107df0 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6444275700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1131f0 con 0x7f643c1034c0 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6444275700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1134f0 con 0x7f643c108740 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c107df0 0x7f643c19c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c107df0 0x7f643c19c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37092/0 (socket says 172.21.15.37:37092) 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 -- 172.21.15.37:0/3933638889 learned_addr learned my addr 172.21.15.37:0/3933638889 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6442812700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643c108740 0x7f643c1a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6442011700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f643c1034c0 0x7f643c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 -- 172.21.15.37:0/3933638889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643c108740 msgr2=0x7f643c1a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643c108740 0x7f643c1a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 -- 172.21.15.37:0/3933638889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f643c1034c0 msgr2=0x7f643c19bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f643c1034c0 0x7f643c19bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 -- 172.21.15.37:0/3933638889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c19c9a0 con 0x7f643c107df0 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.328+0000 7f6441810700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c107df0 0x7f643c19c0f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f643000d950 tx=0x7f643000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.329+0000 7f642f7fe700 1 -- 172.21.15.37:0/3933638889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430016070 con 0x7f643c107df0 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.329+0000 7f642f7fe700 1 -- 172.21.15.37:0/3933638889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6430004830 con 0x7f643c107df0 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.329+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c1a7290 con 0x7f643c107df0 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.329+0000 7f642f7fe700 1 -- 172.21.15.37:0/3933638889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6430005520 con 0x7f643c107df0 2024-05-09T01:17:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.329+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c1a77a0 con 0x7f643c107df0 2024-05-09T01:17:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.332+0000 7f642f7fe700 1 -- 172.21.15.37:0/3933638889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6430004220 con 0x7f643c107df0 2024-05-09T01:17:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 Processor -- start 2024-05-09T01:17:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 -- start start 2024-05-09T01:17:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f642f7fe700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64280b2880 0x7f64280b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ecf4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b60ec16ff0 con 0x55b60ecf46a0 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b60ebb57f0 con 0x55b60ec61160 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b60ec12fb0 con 0x55b60eb774a0 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f642f7fe700 1 -- 172.21.15.37:0/3933638889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f64300e1e00 con 0x7f643c107df0 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6442812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ecf4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6442812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ecf4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37098/0 (socket says 172.21.15.37:37098) 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.333+0000 7f6442812700 1 -- 172.21.15.37:0/1905112489 learned_addr learned my addr 172.21.15.37:0/1905112489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442011700 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6441810700 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64280b2880 0x7f64280b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 -- 172.21.15.37:0/1905112489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 msgr2=0x55b60ecfaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 -- 172.21.15.37:0/1905112489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 msgr2=0x55b60ecfa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 -- 172.21.15.37:0/1905112489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b60ebad370 con 0x55b60ecf46a0 2024-05-09T01:17:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6441810700 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442011700 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ecf4ad0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6434009460 tx=0x7f6434009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63d2da1dc0c937c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f6442812700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64280b2880 0x7f64280b4d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f643401a000 tx=0x7f6434027000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.334+0000 7f642cd47700 1 -- 172.21.15.37:0/1905112489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64340077c0 con 0x55b60ecf46a0 2024-05-09T01:17:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.335+0000 7f642cd47700 1 -- 172.21.15.37:0/1905112489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6434007e10 con 0x55b60ecf46a0 2024-05-09T01:17:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.335+0000 7f642cd47700 1 -- 172.21.15.37:0/1905112489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434020e40 con 0x55b60ecf46a0 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.335+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1905112489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 msgr2=0x55b60ecf4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.335+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ecf4ad0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6434009460 tx=0x7f6434009490 comp rx=0 tx=0).stop 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1905112489 shutdown_connections 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ecf4ad0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1905112489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1905112489 >> 172.21.15.37:0/1905112489 conn(0x55b60ebd76a0 msgr2=0x55b60ecef400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1905112489 shutdown_connections 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1905112489 wait complete. 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 -- start start 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.336+0000 7f6452c8bb80 1 Processor -- start 2024-05-09T01:17:38.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60eb774a0 0x55b60ecfe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfe710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60ecf46a0 0x55b60ecfec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b60ea92ba0 con 0x55b60eb774a0 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b60ebd1150 con 0x55b60ec61160 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b60ecf54e0 con 0x55b60ecf46a0 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6452c8bb80 10 client.0 _ll_register_callbacks cb 0x55b60ea886c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60eb774a0 0x55b60ecfe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60eb774a0 0x55b60ecfe1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37104/0 (socket says 172.21.15.37:37104) 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 -- 172.21.15.37:0/1052593809 learned_addr learned my addr 172.21.15.37:0/1052593809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6441810700 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442812700 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60ecf46a0 0x55b60ecfec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 -- 172.21.15.37:0/1052593809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60ecf46a0 msgr2=0x55b60ecfec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60ecf46a0 0x55b60ecfec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 -- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 msgr2=0x55b60ecfe710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfe710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.337+0000 7f6442011700 1 -- 172.21.15.37:0/1052593809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b60ea92490 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6442011700 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60eb774a0 0x55b60ecfe1d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f64380116c0 tx=0x7f64380119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866169f43162d1ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6425ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6425ffb700 1 -- 172.21.15.37:0/1052593809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438010640 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6425ffb700 1 -- 172.21.15.37:0/1052593809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f64380107e0 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6434007e10 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6425ffb700 1 -- 172.21.15.37:0/1052593809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f64380109e0 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6452c8bb80 10 client.18033 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b60ed0bb90 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6425ffb700 1 -- 172.21.15.37:0/1052593809 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6434007e10 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6425ffb700 1 -- 172.21.15.37:0/1052593809 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f6438003830 con 0x55b60eb774a0 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.338+0000 7f6452c8bb80 10 client.18033 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6452c8bb80 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:38.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6452c8bb80 20 client.18033 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed0e1d0 0x55b60ed105f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6452c8bb80 4 client.18033 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b60ec249d0 con 0x55b60ed0e1d0 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6441810700 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed0e1d0 0x55b60ed105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6425ffb700 10 client.18033 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.339+0000 7f6441810700 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed0e1d0 0x55b60ed105f0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d9e25c57d2db89 server_cookie=acb78d865a7d7abc in_seq=0 out_seq=0 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6425ffb700 1 -- 172.21.15.37:0/1052593809 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b60ec249d0 con 0x55b60ed0e1d0 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6425ffb700 10 client.18033 handle_command_reply: tid=0 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 client.18033 shutdown 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60eb774a0 msgr2=0x55b60ecfe1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60eb774a0 0x55b60ecfe1d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f64380116c0 tx=0x7f64380119d0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 shutdown_connections 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed0e1d0 0x55b60ed105f0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6425ffb700 0 client.18033 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:38.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60ecf46a0 0x55b60ecfec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60eb774a0 0x55b60ecfe1d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/1052593809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecfe710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.340+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 >> 172.21.15.37:0/1052593809 conn(0x55b60ebd76a0 msgr2=0x55b60ecef1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.341+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 shutdown_connections 2024-05-09T01:17:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.341+0000 7f6452c8bb80 1 -- 172.21.15.37:0/1052593809 wait complete. 2024-05-09T01:17:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.341+0000 7f6452c8bb80 20 client.18033 trim_cache size 0 max 16384 2024-05-09T01:17:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 Processor -- start 2024-05-09T01:17:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 -- start start 2024-05-09T01:17:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecf8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed09f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1aeb40 con 0x55b60ecf46a0 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1b0680 con 0x55b60ec61160 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1af210 con 0x55b60eb774a0 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.356+0000 7f6442812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed09f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6442812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed09f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37112/0 (socket says 172.21.15.37:37112) 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6442812700 1 -- 172.21.15.37:0/2983916443 learned_addr learned my addr 172.21.15.37:0/2983916443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6441810700 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecf8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6442011700 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6441810700 1 -- 172.21.15.37:0/2983916443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 msgr2=0x55b60ecfea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6441810700 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6441810700 1 -- 172.21.15.37:0/2983916443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 msgr2=0x55b60ed09f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6441810700 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed09f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6441810700 1 -- 172.21.15.37:0/2983916443 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b60ecff290 con 0x55b60ec61160 2024-05-09T01:17:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6442812700 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed09f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6441810700 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecf8510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f64300df9f0 tx=0x7f6430091040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a12684e6cb27109e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6427fff700 1 -- 172.21.15.37:0/2983916443 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64300a9bc0 con 0x55b60ec61160 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6427fff700 1 -- 172.21.15.37:0/2983916443 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f643008d040 con 0x55b60ec61160 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.357+0000 7f6427fff700 1 -- 172.21.15.37:0/2983916443 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64300056c0 con 0x55b60ec61160 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 -- 172.21.15.37:0/2983916443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 msgr2=0x55b60ecf8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecf8510 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f64300df9f0 tx=0x7f6430091040 comp rx=0 tx=0).stop 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 -- 172.21.15.37:0/2983916443 shutdown_connections 2024-05-09T01:17:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed09f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ecfea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/2983916443 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ecf8510 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 -- 172.21.15.37:0/2983916443 >> 172.21.15.37:0/2983916443 conn(0x55b60ebd76a0 msgr2=0x55b60ecf7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 -- 172.21.15.37:0/2983916443 shutdown_connections 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.358+0000 7f6452c8bb80 1 -- 172.21.15.37:0/2983916443 wait complete. 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 -- start start 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 Processor -- start 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ed154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ed159e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed15f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1affb0 con 0x55b60ecf46a0 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1af8e0 con 0x55b60ec61160 2024-05-09T01:17:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.359+0000 7f6452c8bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f643c1acb00 con 0x55b60eb774a0 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6452c8bb80 10 client.0 _ll_register_callbacks cb 0x55b60ea886c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6441810700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ed159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442011700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ed154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442812700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed15f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6441810700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ed159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.37:53758/0 (socket says 172.21.15.37:53758) 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6441810700 1 -- 172.21.15.37:0/4256296847 learned_addr learned my addr 172.21.15.37:0/4256296847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442812700 1 -- 172.21.15.37:0/4256296847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 msgr2=0x55b60ed154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442812700 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ed154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442812700 1 -- 172.21.15.37:0/4256296847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 msgr2=0x55b60ed159e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442812700 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ed159e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442812700 1 -- 172.21.15.37:0/4256296847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b60ed06cd0 con 0x55b60ecf46a0 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6442812700 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed15f20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6434009330 tx=0x7f64340087e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c314539a4aab511b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:38.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6425ffb700 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.360+0000 7f6425ffb700 1 -- 172.21.15.37:0/4256296847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434038070 con 0x55b60ecf46a0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6425ffb700 1 -- 172.21.15.37:0/4256296847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f6434008be0 con 0x55b60ecf46a0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f643008d040 con 0x55b60ecf46a0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6425ffb700 1 -- 172.21.15.37:0/4256296847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f6434008e00 con 0x55b60ecf46a0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 10 client.18039 fetch_fsmap learned FSMap version 51 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55b60ed789d0 con 0x55b60ecf46a0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6425ffb700 1 -- 172.21.15.37:0/4256296847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f643008d040 con 0x55b60ecf46a0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6425ffb700 1 -- 172.21.15.37:0/4256296847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8354+0+0 (secure 0 0 0) 0x7f6434011070 con 0x55b60ecf46a0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 10 client.18039 fetch_fsmap finished waiting for FSMap version 51 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 20 client.18039 populate_metadata read hostname 'smithi037' 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed78cb0 0x55b60ed7b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 4 client.18039 mds_command: new command op to 24491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.361+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 --> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b60ec1ea70 con 0x55b60ed78cb0 2024-05-09T01:17:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6442011700 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed78cb0 0x55b60ed7b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:38.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6425ffb700 10 client.18039 ms_handle_connect on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6442011700 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed78cb0 0x55b60ed7b0d0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242a6e05aa91467c server_cookie=9636da647d9ef42d in_seq=0 out_seq=0 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6425ffb700 1 -- 172.21.15.37:0/4256296847 <== mds.0 v2:172.21.15.136:6838/336490852 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b60ec1ea70 con 0x55b60ed78cb0 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6425ffb700 10 client.18039 handle_command_reply: tid=0 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 client.18039 shutdown 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 msgr2=0x55b60ed15f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed15f20 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6434009330 tx=0x7f64340087e0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 shutdown_connections 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.136:6838/336490852,v1:172.21.15.136:6839/336490852] conn(0x55b60ed78cb0 0x55b60ed7b0d0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b60ecf46a0 0x55b60ed15f20 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b60eb774a0 0x55b60ed154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 --2- 172.21.15.37:0/4256296847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b60ec61160 0x55b60ed159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 >> 172.21.15.37:0/4256296847 conn(0x55b60ebd76a0 msgr2=0x55b60ecf7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.362+0000 7f6425ffb700 0 client.18039 ms_handle_reset on v2:172.21.15.136:6838/336490852 2024-05-09T01:17:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 shutdown_connections 2024-05-09T01:17:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6452c8bb80 1 -- 172.21.15.37:0/4256296847 wait complete. 2024-05-09T01:17:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6452c8bb80 20 client.18039 trim_cache size 0 max 16384 2024-05-09T01:17:38.367 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64280b2880 msgr2=0x7f64280b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64280b2880 0x7f64280b4d90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f643401a000 tx=0x7f6434027000 comp rx=0 tx=0).stop 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c107df0 msgr2=0x7f643c19c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c107df0 0x7f643c19c0f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f643000d950 tx=0x7f643000dc60 comp rx=0 tx=0).stop 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 shutdown_connections 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64280b2880 0x7f64280b4d90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643c108740 0x7f643c1a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f643c1034c0 0x7f643c19bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 --2- 172.21.15.37:0/3933638889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643c107df0 0x7f643c19c0f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.363+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 >> 172.21.15.37:0/3933638889 conn(0x7f643c0fedc0 msgr2=0x7f643c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.364+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 shutdown_connections 2024-05-09T01:17:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:38.364+0000 7f6444275700 1 -- 172.21.15.37:0/3933638889 wait complete. 2024-05-09T01:17:38.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:38 smithi037 ceph-mon[30122]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 1.67k op/s 2024-05-09T01:17:38.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:38 smithi151 ceph-mon[34780]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 1.67k op/s 2024-05-09T01:17:38.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:38 smithi136 ceph-mon[34110]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 1.67k op/s 2024-05-09T01:17:39.104 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-05-09T01:17:39.105 INFO:tasks.fwd_scrub:done joining 2024-05-09T01:17:39.105 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-09T01:17:39.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 -- 172.21.15.37:0/2047572105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 msgr2=0x7fbfcc1037f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/2047572105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc1037f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc009900 tx=0x7fbfbc02a410 comp rx=0 tx=0).stop 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 -- 172.21.15.37:0/2047572105 shutdown_connections 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/2047572105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfcc108a30 0x7fbfcc10ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/2047572105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfcc103d30 0x7fbfcc104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/2047572105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc1037f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 -- 172.21.15.37:0/2047572105 >> 172.21.15.37:0/2047572105 conn(0x7fbfcc0fdd00 msgr2=0x7fbfcc100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 -- 172.21.15.37:0/2047572105 shutdown_connections 2024-05-09T01:17:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.237+0000 7fbfd20b1640 1 -- 172.21.15.37:0/2047572105 wait complete. 2024-05-09T01:17:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 Processor -- start 2024-05-09T01:17:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 -- start start 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc0ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfcc103d30 0x7fbfcc0fe230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfcc108a30 0x7fbfcc0fe770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc10e5d0 con 0x7fbfcc102af0 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc10e450 con 0x7fbfcc103d30 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfd20b1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfcc10e750 con 0x7fbfcc108a30 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc0ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc0ffb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37140/0 (socket says 172.21.15.37:37140) 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 -- 172.21.15.37:0/3350147901 learned_addr learned my addr 172.21.15.37:0/3350147901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcbfff640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfcc108a30 0x7fbfcc0fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcaffd640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfcc103d30 0x7fbfcc0fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 -- 172.21.15.37:0/3350147901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfcc108a30 msgr2=0x7fbfcc0fe770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfcc108a30 0x7fbfcc0fe770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 -- 172.21.15.37:0/3350147901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfcc103d30 msgr2=0x7fbfcc0fe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfcc103d30 0x7fbfcc0fe230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.238+0000 7fbfcb7fe640 1 -- 172.21.15.37:0/3350147901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfcc0feea0 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.239+0000 7fbfcaffd640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfcc103d30 0x7fbfcc0fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.239+0000 7fbfcb7fe640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc0ffb90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc006010 tx=0x7fbfbc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.239+0000 7fbfc8ff9640 1 -- 172.21.15.37:0/3350147901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc03f030 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.239+0000 7fbfc8ff9640 1 -- 172.21.15.37:0/3350147901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbfbc003aa0 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.239+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfcc1a4410 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.239+0000 7fbfc8ff9640 1 -- 172.21.15.37:0/3350147901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc035070 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.239+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfcc1a4810 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.240+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfcc06b0d0 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.241+0000 7fbfc8ff9640 1 -- 172.21.15.37:0/3350147901 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbfbc042030 con 0x7fbfcc102af0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.243+0000 7fbfc8ff9640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfb40b27f0 0x7fbfb40b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.243+0000 7fbfcaffd640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfb40b27f0 0x7fbfb40b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.243+0000 7fbfc8ff9640 1 -- 172.21.15.37:0/3350147901 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbfbc1027d0 con 0x7fbfcc102af0 2024-05-09T01:17:39.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.243+0000 7fbfcaffd640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfb40b27f0 0x7fbfb40b4d00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ff530 tx=0x7fbfc0005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:39.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.248+0000 7fbfc8ff9640 1 -- 172.21.15.37:0/3350147901 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbfbc0ca4f0 con 0x7fbfcc102af0 2024-05-09T01:17:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.445+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfcc1a5130 con 0x7fbfcc102af0 2024-05-09T01:17:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.447+0000 7fbfc8ff9640 1 -- 172.21.15.37:0/3350147901 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7fbfbc0c9df0 con 0x7fbfcc102af0 2024-05-09T01:17:39.447 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:39.447 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfb40b27f0 msgr2=0x7fbfb40b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfb40b27f0 0x7fbfb40b4d00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0ff530 tx=0x7fbfc0005e70 comp rx=0 tx=0).stop 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 msgr2=0x7fbfcc0ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc0ffb90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc006010 tx=0x7fbfbc031a50 comp rx=0 tx=0).stop 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 shutdown_connections 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfcc108a30 0x7fbfcc0fe770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbfb40b27f0 0x7fbfb40b4d00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbfcc103d30 0x7fbfcc0fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 --2- 172.21.15.37:0/3350147901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfcc102af0 0x7fbfcc0ffb90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 >> 172.21.15.37:0/3350147901 conn(0x7fbfcc0fdd00 msgr2=0x7fbfcc109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 shutdown_connections 2024-05-09T01:17:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.449+0000 7fbfd20b1640 1 -- 172.21.15.37:0/3350147901 wait complete. 2024-05-09T01:17:39.461 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T00:53:46.888552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:58:33.187247+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:58:36.068427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T01:17:39.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 -- 172.21.15.37:0/322463834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87481030f0 msgr2=0x7f8748103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 --2- 172.21.15.37:0/322463834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87481030f0 0x7f8748103500 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f8738009900 tx=0x7f873802a410 comp rx=0 tx=0).stop 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 -- 172.21.15.37:0/322463834 shutdown_connections 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 --2- 172.21.15.37:0/322463834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87481047b0 0x7f874810af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 --2- 172.21.15.37:0/322463834 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8748103c50 0x7f8748104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 --2- 172.21.15.37:0/322463834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87481030f0 0x7f8748103500 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 -- 172.21.15.37:0/322463834 >> 172.21.15.37:0/322463834 conn(0x7f87480fd4b0 msgr2=0x7f87480ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 -- 172.21.15.37:0/322463834 shutdown_connections 2024-05-09T01:17:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.581+0000 7f874ce61640 1 -- 172.21.15.37:0/322463834 wait complete. 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 Processor -- start 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 -- start start 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87481030f0 0x7f8748102340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8748103c50 0x7f874819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874819f4c0 0x7f87481a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f874810e850 con 0x7f8748103c50 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f874810e6d0 con 0x7f87481030f0 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874ce61640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f874810e9d0 con 0x7f874819f4c0 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f873ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8748103c50 0x7f874819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f873ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8748103c50 0x7f874819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37156/0 (socket says 172.21.15.37:37156) 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f873ffff640 1 -- 172.21.15.37:0/1448703361 learned_addr learned my addr 172.21.15.37:0/1448703361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f8746d9d640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874819f4c0 0x7f87481a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.582+0000 7f874659c640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87481030f0 0x7f8748102340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873ffff640 1 -- 172.21.15.37:0/1448703361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874819f4c0 msgr2=0x7f87481a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873ffff640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874819f4c0 0x7f87481a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873ffff640 1 -- 172.21.15.37:0/1448703361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87481030f0 msgr2=0x7f8748102340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873ffff640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87481030f0 0x7f8748102340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873ffff640 1 -- 172.21.15.37:0/1448703361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87481a20b0 con 0x7f8748103c50 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f874659c640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87481030f0 0x7f8748102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f8746d9d640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874819f4c0 0x7f87481a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873ffff640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8748103c50 0x7f874819ef80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f873000c890 tx=0x7f873000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873f7fe640 1 -- 172.21.15.37:0/1448703361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730004220 con 0x7f8748103c50 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873f7fe640 1 -- 172.21.15.37:0/1448703361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87300043c0 con 0x7f8748103c50 2024-05-09T01:17:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f873f7fe640 1 -- 172.21.15.37:0/1448703361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730004a00 con 0x7f8748103c50 2024-05-09T01:17:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87481a23a0 con 0x7f8748103c50 2024-05-09T01:17:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.583+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87481a2940 con 0x7f8748103c50 2024-05-09T01:17:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.584+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874806b4e0 con 0x7f8748103c50 2024-05-09T01:17:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.586+0000 7f873f7fe640 1 -- 172.21.15.37:0/1448703361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f87300079b0 con 0x7f8748103c50 2024-05-09T01:17:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.586+0000 7f873f7fe640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87340b2870 0x7f87340b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.587+0000 7f874659c640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87340b2870 0x7f87340b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.587+0000 7f873f7fe640 1 -- 172.21.15.37:0/1448703361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f87300e2360 con 0x7f8748103c50 2024-05-09T01:17:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.587+0000 7f874659c640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87340b2870 0x7f87340b4d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8738005f70 tx=0x7f8738000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.590+0000 7f873f7fe640 1 -- 172.21.15.37:0/1448703361 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8730014030 con 0x7f8748103c50 2024-05-09T01:17:39.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.785+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f874802dea0 con 0x7f8748103c50 2024-05-09T01:17:39.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.785+0000 7f873f7fe640 1 -- 172.21.15.37:0/1448703361 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f87300aa1a0 con 0x7f8748103c50 2024-05-09T01:17:39.785 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-09T01:17:39.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87340b2870 msgr2=0x7f87340b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87340b2870 0x7f87340b4d80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8738005f70 tx=0x7f8738000bc0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8748103c50 msgr2=0x7f874819ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8748103c50 0x7f874819ef80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f873000c890 tx=0x7f873000cd50 comp rx=0 tx=0).stop 2024-05-09T01:17:39.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 shutdown_connections 2024-05-09T01:17:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874819f4c0 0x7f87481a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8748103c50 0x7f874819ef80 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f87340b2870 0x7f87340b4d80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 --2- 172.21.15.37:0/1448703361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87481030f0 0x7f8748102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 >> 172.21.15.37:0/1448703361 conn(0x7f87480fd4b0 msgr2=0x7f87480ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 shutdown_connections 2024-05-09T01:17:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.788+0000 7f874ce61640 1 -- 172.21.15.37:0/1448703361 wait complete. 2024-05-09T01:17:39.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T01:17:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 -- 172.21.15.37:0/1485628542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c109b70 msgr2=0x7fa66c10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 --2- 172.21.15.37:0/1485628542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c109b70 0x7fa66c10bf90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa664009ca0 tx=0x7fa66402a8c0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 -- 172.21.15.37:0/1485628542 shutdown_connections 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 --2- 172.21.15.37:0/1485628542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c109b70 0x7fa66c10bf90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 --2- 172.21.15.37:0/1485628542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa66c104e70 0x7fa66c105280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 --2- 172.21.15.37:0/1485628542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa66c103c30 0x7fa66c104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 -- 172.21.15.37:0/1485628542 >> 172.21.15.37:0/1485628542 conn(0x7fa66c0fee40 msgr2=0x7fa66c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 -- 172.21.15.37:0/1485628542 shutdown_connections 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 -- 172.21.15.37:0/1485628542 wait complete. 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.918+0000 7fa671e8b640 1 Processor -- start 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa671e8b640 1 -- start start 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa671e8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c103c30 0x7fa66c077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa671e8b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa66c104e70 0x7fa66c076130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa671e8b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa66c109b70 0x7fa66c076670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa671e8b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c10f760 con 0x7fa66c103c30 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa671e8b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c10f5e0 con 0x7fa66c109b70 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa671e8b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c10f8e0 con 0x7fa66c104e70 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c103c30 0x7fa66c077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c103c30 0x7fa66c077a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37180/0 (socket says 172.21.15.37:37180) 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 -- 172.21.15.37:0/3449751075 learned_addr learned my addr 172.21.15.37:0/3449751075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 -- 172.21.15.37:0/3449751075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa66c104e70 msgr2=0x7fa66c076130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa66c104e70 0x7fa66c076130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 -- 172.21.15.37:0/3449751075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa66c109b70 msgr2=0x7fa66c076670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa66c109b70 0x7fa66c076670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 -- 172.21.15.37:0/3449751075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c076da0 con 0x7fa66c103c30 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa66b7fe640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c103c30 0x7fa66c077a90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00e9f0 tx=0x7fa65c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.919+0000 7fa668ff9640 1 -- 172.21.15.37:0/3449751075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00ccc0 con 0x7fa66c103c30 2024-05-09T01:17:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.920+0000 7fa668ff9640 1 -- 172.21.15.37:0/3449751075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa65c0035f0 con 0x7fa66c103c30 2024-05-09T01:17:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.920+0000 7fa668ff9640 1 -- 172.21.15.37:0/3449751075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00ce60 con 0x7fa66c103c30 2024-05-09T01:17:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.920+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c1a4420 con 0x7fa66c103c30 2024-05-09T01:17:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.920+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1a48e0 con 0x7fa66c103c30 2024-05-09T01:17:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.920+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66c108980 con 0x7fa66c103c30 2024-05-09T01:17:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.922+0000 7fa668ff9640 1 -- 172.21.15.37:0/3449751075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa65c003aa0 con 0x7fa66c103c30 2024-05-09T01:17:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.923+0000 7fa668ff9640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6580b27f0 0x7fa6580b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.923+0000 7fa66affd640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6580b27f0 0x7fa6580b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.923+0000 7fa668ff9640 1 -- 172.21.15.37:0/3449751075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa65c0e2710 con 0x7fa66c103c30 2024-05-09T01:17:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.924+0000 7fa66affd640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6580b27f0 0x7fa6580b4d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa654005fd0 tx=0x7fa654005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:39.927+0000 7fa668ff9640 1 -- 172.21.15.37:0/3449751075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa65c0aa430 con 0x7fa66c103c30 2024-05-09T01:17:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.118+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa66c02de70 con 0x7fa66c103c30 2024-05-09T01:17:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.118+0000 7fa668ff9640 1 -- 172.21.15.37:0/3449751075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7fa65c0a9d30 con 0x7fa66c103c30 2024-05-09T01:17:40.119 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-09T01:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6580b27f0 msgr2=0x7fa6580b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6580b27f0 0x7fa6580b4d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa654005fd0 tx=0x7fa654005850 comp rx=0 tx=0).stop 2024-05-09T01:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c103c30 msgr2=0x7fa66c077a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c103c30 0x7fa66c077a90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00e9f0 tx=0x7fa65c00eeb0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 shutdown_connections 2024-05-09T01:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa6580b27f0 0x7fa6580b4d00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa66c109b70 0x7fa66c076670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa66c104e70 0x7fa66c076130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 --2- 172.21.15.37:0/3449751075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa66c103c30 0x7fa66c077a90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.120+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 >> 172.21.15.37:0/3449751075 conn(0x7fa66c0fee40 msgr2=0x7fa66c105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.121+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 shutdown_connections 2024-05-09T01:17:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.121+0000 7fa671e8b640 1 -- 172.21.15.37:0/3449751075 wait complete. 2024-05-09T01:17:40.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T01:17:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 -- 172.21.15.37:0/2085376074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28103d50 msgr2=0x7fbc28104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 --2- 172.21.15.37:0/2085376074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28103d50 0x7fbc28104160 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009900 tx=0x7fbc1802a410 comp rx=0 tx=0).stop 2024-05-09T01:17:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 -- 172.21.15.37:0/2085376074 shutdown_connections 2024-05-09T01:17:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 --2- 172.21.15.37:0/2085376074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc28108a50 0x7fbc2810ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 --2- 172.21.15.37:0/2085376074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28103d50 0x7fbc28104160 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 --2- 172.21.15.37:0/2085376074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc28102b10 0x7fbc28103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 -- 172.21.15.37:0/2085376074 >> 172.21.15.37:0/2085376074 conn(0x7fbc280fdd00 msgr2=0x7fbc281001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 -- 172.21.15.37:0/2085376074 shutdown_connections 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.251+0000 7fbc2f334640 1 -- 172.21.15.37:0/2085376074 wait complete. 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 Processor -- start 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 -- start start 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc28102b10 0x7fbc2819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc28103d50 0x7fbc2819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28108a50 0x7fbc281a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2810f7a0 con 0x7fbc28108a50 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2810f620 con 0x7fbc28102b10 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2f334640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2810f920 con 0x7fbc28103d50 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2d8d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28108a50 0x7fbc281a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2d8d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28108a50 0x7fbc281a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37198/0 (socket says 172.21.15.37:37198) 2024-05-09T01:17:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.252+0000 7fbc2d8d1640 1 -- 172.21.15.37:0/7185908 learned_addr learned my addr 172.21.15.37:0/7185908 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d0d0640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc28102b10 0x7fbc2819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2c8cf640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc28103d50 0x7fbc2819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d8d1640 1 -- 172.21.15.37:0/7185908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc28103d50 msgr2=0x7fbc2819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d8d1640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc28103d50 0x7fbc2819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d8d1640 1 -- 172.21.15.37:0/7185908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc28102b10 msgr2=0x7fbc2819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d8d1640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc28102b10 0x7fbc2819a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d8d1640 1 -- 172.21.15.37:0/7185908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc281a20c0 con 0x7fbc28108a50 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d0d0640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc28102b10 0x7fbc2819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2d8d1640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28108a50 0x7fbc281a1b00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000cce0 tx=0x7fbc2000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc1e7fc640 1 -- 172.21.15.37:0/7185908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000f450 con 0x7fbc28108a50 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc1e7fc640 1 -- 172.21.15.37:0/7185908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc2000faa0 con 0x7fbc28108a50 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc281a23b0 con 0x7fbc28108a50 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc1e7fc640 1 -- 172.21.15.37:0/7185908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20018b70 con 0x7fbc28108a50 2024-05-09T01:17:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.253+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc281a28b0 con 0x7fbc28108a50 2024-05-09T01:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.254+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc28107860 con 0x7fbc28108a50 2024-05-09T01:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.256+0000 7fbc1e7fc640 1 -- 172.21.15.37:0/7185908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbc20018d10 con 0x7fbc28108a50 2024-05-09T01:17:40.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.256+0000 7fbc1e7fc640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbc140b27f0 0x7fbc140b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.256+0000 7fbc2d0d0640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbc140b27f0 0x7fbc140b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.256+0000 7fbc1e7fc640 1 -- 172.21.15.37:0/7185908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fbc200e2740 con 0x7fbc28108a50 2024-05-09T01:17:40.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.257+0000 7fbc2d0d0640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbc140b27f0 0x7fbc140b4d00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbc240058c0 tx=0x7fbc24005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:40.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.260+0000 7fbc1e7fc640 1 -- 172.21.15.37:0/7185908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbc20014030 con 0x7fbc28108a50 2024-05-09T01:17:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.456+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbc2802de10 con 0x7fbc28108a50 2024-05-09T01:17:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.457+0000 7fbc1e7fc640 1 -- 172.21.15.37:0/7185908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7fbc200aa590 con 0x7fbc28108a50 2024-05-09T01:17:40.457 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbc140b27f0 msgr2=0x7fbc140b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbc140b27f0 0x7fbc140b4d00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbc240058c0 tx=0x7fbc24005850 comp rx=0 tx=0).stop 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28108a50 msgr2=0x7fbc281a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28108a50 0x7fbc281a1b00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000cce0 tx=0x7fbc2000a620 comp rx=0 tx=0).stop 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 shutdown_connections 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc28108a50 0x7fbc281a1b00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc28103d50 0x7fbc2819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fbc140b27f0 0x7fbc140b4d00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 --2- 172.21.15.37:0/7185908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc28102b10 0x7fbc2819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 >> 172.21.15.37:0/7185908 conn(0x7fbc280fdd00 msgr2=0x7fbc28104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 shutdown_connections 2024-05-09T01:17:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.459+0000 7fbc2f334640 1 -- 172.21.15.37:0/7185908 wait complete. 2024-05-09T01:17:40.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 -- 172.21.15.37:0/964553133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 msgr2=0x7f61e4103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 --2- 172.21.15.37:0/964553133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4103810 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009900 tx=0x7f61cc02a410 comp rx=0 tx=0).stop 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 -- 172.21.15.37:0/964553133 shutdown_connections 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 --2- 172.21.15.37:0/964553133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e4108a50 0x7f61e410ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 --2- 172.21.15.37:0/964553133 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e4103d50 0x7f61e4104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 --2- 172.21.15.37:0/964553133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4103810 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 -- 172.21.15.37:0/964553133 >> 172.21.15.37:0/964553133 conn(0x7f61e40fdd00 msgr2=0x7f61e41001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:40.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 -- 172.21.15.37:0/964553133 shutdown_connections 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.586+0000 7f61e93b7640 1 -- 172.21.15.37:0/964553133 wait complete. 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 Processor -- start 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 -- start start 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4075990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e4103d50 0x7f61e419f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e4108a50 0x7f61e41a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410e610 con 0x7f61e4102b10 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410e490 con 0x7f61e4108a50 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e93b7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61e410e790 con 0x7f61e4103d50 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4075990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4075990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37224/0 (socket says 172.21.15.37:37224) 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.587+0000 7f61e2ffd640 1 -- 172.21.15.37:0/2697710258 learned_addr learned my addr 172.21.15.37:0/2697710258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e27fc640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e4103d50 0x7f61e419f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e37fe640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e4108a50 0x7f61e41a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e2ffd640 1 -- 172.21.15.37:0/2697710258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e4103d50 msgr2=0x7f61e419f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e2ffd640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e4103d50 0x7f61e419f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e2ffd640 1 -- 172.21.15.37:0/2697710258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e4108a50 msgr2=0x7f61e41a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e2ffd640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e4108a50 0x7f61e41a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e2ffd640 1 -- 172.21.15.37:0/2697710258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e41a1ed0 con 0x7f61e4102b10 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e37fe640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e4108a50 0x7f61e41a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e2ffd640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4075990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f61cc006010 tx=0x7f61cc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61dbfff640 1 -- 172.21.15.37:0/2697710258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc03f030 con 0x7f61e4102b10 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e41a2160 con 0x7f61e4102b10 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61dbfff640 1 -- 172.21.15.37:0/2697710258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61cc003aa0 con 0x7f61e4102b10 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61dbfff640 1 -- 172.21.15.37:0/2697710258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc035070 con 0x7f61e4102b10 2024-05-09T01:17:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.588+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41a26a0 con 0x7f61e4102b10 2024-05-09T01:17:40.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.589+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e4107860 con 0x7f61e4102b10 2024-05-09T01:17:40.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.591+0000 7f61dbfff640 1 -- 172.21.15.37:0/2697710258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f61cc042030 con 0x7f61e4102b10 2024-05-09T01:17:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.591+0000 7f61dbfff640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b27f0 0x7f61d00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:17:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.591+0000 7f61dbfff640 1 -- 172.21.15.37:0/2697710258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f61cc102bd0 con 0x7f61e4102b10 2024-05-09T01:17:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.591+0000 7f61e27fc640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b27f0 0x7f61d00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:17:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.592+0000 7f61e27fc640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b27f0 0x7f61d00b4d00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f61e4075330 tx=0x7f61d4009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:17:40.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.595+0000 7f61dbfff640 1 -- 172.21.15.37:0/2697710258 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f61cc0ca990 con 0x7f61e4102b10 2024-05-09T01:17:40.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:40 smithi037 ceph-mon[30122]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2024-05-09T01:17:40.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:40 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3350147901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:17:40.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:40 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1448703361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T01:17:40.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:40 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3449751075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T01:17:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:40 smithi151 ceph-mon[34780]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2024-05-09T01:17:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:40 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3350147901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:17:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:40 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1448703361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T01:17:40.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:40 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3449751075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T01:17:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.843+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f61e402de00 con 0x7f61e4102b10 2024-05-09T01:17:40.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.853+0000 7f61dbfff640 1 -- 172.21.15.37:0/2697710258 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+815642 (secure 0 0 0) 0x7f61cc0ca290 con 0x7f61e4102b10 2024-05-09T01:17:40.867 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:17:40.867 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:17:40.867 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-09T01:17:40.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.868 INFO:teuthology.orchestra.run.smithi037.stdout: "active_gid": 14152, 2024-05-09T01:17:40.868 INFO:teuthology.orchestra.run.smithi037.stdout: "active_name": "x", 2024-05-09T01:17:40.868 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addrs": { 2024-05-09T01:17:40.868 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-05-09T01:17:40.868 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:40.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-05-09T01:17:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6800", 2024-05-09T01:17:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2764436863 2024-05-09T01:17:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-05-09T01:17:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6801", 2024-05-09T01:17:40.869 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2764436863 2024-05-09T01:17:40.870 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:40.870 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:40.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.870 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addr": "172.21.15.37:6801/2764436863", 2024-05-09T01:17:40.870 INFO:teuthology.orchestra.run.smithi037.stdout: "active_change": "2024-05-09T00:51:18.788795+0000", 2024-05-09T01:17:40.870 INFO:teuthology.orchestra.run.smithi037.stdout: "active_mgr_features": 4540701547738038271, 2024-05-09T01:17:40.871 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-09T01:17:40.871 INFO:teuthology.orchestra.run.smithi037.stdout: "standbys": [ 2024-05-09T01:17:40.871 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:40.871 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24109, 2024-05-09T01:17:40.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "z", 2024-05-09T01:17:40.872 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-05-09T01:17:40.872 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-05-09T01:17:40.872 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:40.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-05-09T01:17:40.872 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:40.872 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:40.873 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:40.873 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:40.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:40.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:40.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T01:17:40.875 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.875 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.875 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:40.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:40.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.877 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:40.877 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:40.877 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:40.877 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:40.878 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:40.878 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:40.878 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.879 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.879 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.879 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:40.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:40.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.880 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.882 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:40.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:40.882 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.882 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.882 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:40.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.883 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:40.883 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:40.884 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:40.884 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:40.884 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:40.884 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:40.884 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.885 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:40.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:40.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.886 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.886 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.887 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.887 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.887 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.887 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.888 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-05-09T01:17:40.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-05-09T01:17:40.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-05-09T01:17:40.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-05-09T01:17:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-05-09T01:17:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.891 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.891 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-05-09T01:17:40.891 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.891 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.891 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.891 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-05-09T01:17:40.891 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.893 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.894 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T01:17:40.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.898 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:40.900 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T01:17:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.903 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:40.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-05-09T01:17:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.908 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.909 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:40.910 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:40.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.913 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-05-09T01:17:40.916 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-05-09T01:17:40.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:40.918 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-05-09T01:17:40.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-05-09T01:17:40.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:40.922 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.923 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-05-09T01:17:40.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-05-09T01:17:40.925 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.926 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:40.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.928 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.930 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.931 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-05-09T01:17:40.934 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-05-09T01:17:40.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.938 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.939 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.941 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.943 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-05-09T01:17:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-05-09T01:17:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.947 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T01:17:40.948 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.948 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.948 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.948 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-05-09T01:17:40.948 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.948 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.949 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.949 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-05-09T01:17:40.949 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-05-09T01:17:40.949 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.950 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.950 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T01:17:40.950 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.950 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.951 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-05-09T01:17:40.951 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.951 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.952 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:40.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.955 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.955 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T01:17:40.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.956 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.956 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-05-09T01:17:40.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T01:17:40.956 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.957 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-05-09T01:17:40.957 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.957 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-05-09T01:17:40.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.962 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.965 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T01:17:40.968 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T01:17:40.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.976 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T01:17:40.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-05-09T01:17:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.980 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-05-09T01:17:40.982 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.984 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T01:17:40.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.986 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.988 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.990 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.990 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.990 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.990 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T01:17:40.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.992 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-05-09T01:17:40.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-05-09T01:17:40.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-05-09T01:17:40.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:40.994 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-05-09T01:17:40.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-05-09T01:17:40.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-05-09T01:17:40.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-05-09T01:17:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:40.999 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.002 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.003 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.007 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.010 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-05-09T01:17:41.010 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-05-09T01:17:41.010 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.012 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T01:17:41.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.025 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T01:17:41.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T01:17:41.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.025 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.025 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.026 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.027 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T01:17:41.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T01:17:41.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.028 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T01:17:41.029 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T01:17:41.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T01:17:41.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.033 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-05-09T01:17:41.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-05-09T01:17:41.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.035 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.040 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.044 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.046 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.052 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T01:17:41.054 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T01:17:41.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T01:17:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T01:17:41.057 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T01:17:41.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T01:17:41.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:41.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.061 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-05-09T01:17:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-05-09T01:17:41.067 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-05-09T01:17:41.069 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-05-09T01:17:41.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.072 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.073 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.073 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.073 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.073 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.074 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.078 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.081 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.083 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.087 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.088 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.090 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.095 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T01:17:41.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.104 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.104 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.104 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.104 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.104 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-05-09T01:17:41.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-05-09T01:17:41.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.105 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.105 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-05-09T01:17:41.105 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T01:17:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.106 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.107 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.107 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.107 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.107 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-05-09T01:17:41.107 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.108 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.108 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.108 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.109 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.109 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.109 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.110 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.110 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.110 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.110 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.110 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.112 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.112 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.113 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.113 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.113 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.113 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.113 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.114 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.114 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.114 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.114 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.114 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.115 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.116 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.117 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.117 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.118 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-05-09T01:17:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-05-09T01:17:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-05-09T01:17:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.126 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.126 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.127 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.134 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.135 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-05-09T01:17:41.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:41.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-05-09T01:17:41.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.144 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.145 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.146 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.147 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.148 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.154 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.157 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.162 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.163 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.166 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-05-09T01:17:41.167 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.169 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.170 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.171 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-05-09T01:17:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-05-09T01:17:41.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-05-09T01:17:41.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-05-09T01:17:41.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.180 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-05-09T01:17:41.186 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.192 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.195 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.197 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.201 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T01:17:41.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.205 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.208 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-05-09T01:17:41.209 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.211 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.212 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.218 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.219 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.222 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.225 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.233 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.234 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.237 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.238 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.240 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.249 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.252 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T01:17:41.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.260 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-05-09T01:17:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.266 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.270 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.275 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.279 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.285 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.287 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.288 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.289 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.290 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.291 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.294 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.296 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.299 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.303 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.304 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-05-09T01:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.310 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-05-09T01:17:41.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.318 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.325 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.327 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.328 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.332 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.333 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T01:17:41.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.335 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.337 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.340 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.343 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.344 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.346 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.347 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.350 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.358 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.363 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.364 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.368 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T01:17:41.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-05-09T01:17:41.382 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.383 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.389 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.396 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.404 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.405 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.406 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.408 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-05-09T01:17:41.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.421 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.422 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.424 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.427 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24116, 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "y", 2024-05-09T01:17:41.431 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-05-09T01:17:41.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-05-09T01:17:41.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-05-09T01:17:41.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-05-09T01:17:41.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.453 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T01:17:41.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-05-09T01:17:41.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-05-09T01:17:41.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:41.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.460 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-05-09T01:17:41.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-05-09T01:17:41.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-05-09T01:17:41.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.477 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T01:17:41.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T01:17:41.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.481 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-05-09T01:17:41.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-05-09T01:17:41.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-05-09T01:17:41.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.493 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-05-09T01:17:41.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-05-09T01:17:41.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.501 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:41.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-05-09T01:17:41.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-05-09T01:17:41.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-05-09T01:17:41.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T01:17:41.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-05-09T01:17:41.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-05-09T01:17:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-05-09T01:17:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T01:17:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-05-09T01:17:41.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.535 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.541 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-05-09T01:17:41.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-05-09T01:17:41.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.558 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.561 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T01:17:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T01:17:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T01:17:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T01:17:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T01:17:41.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T01:17:41.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-05-09T01:17:41.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T01:17:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T01:17:41.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.597 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T01:17:41.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T01:17:41.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:41.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T01:17:41.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.611 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-05-09T01:17:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-05-09T01:17:41.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:41.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-05-09T01:17:41.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-05-09T01:17:41.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-05-09T01:17:41.637 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.640 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.654 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T01:17:41.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.658 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-05-09T01:17:41.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-05-09T01:17:41.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-05-09T01:17:41.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.671 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.673 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.676 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.686 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.687 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.690 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.701 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.704 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.705 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.706 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.707 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.712 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.718 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.719 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-05-09T01:17:41.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-05-09T01:17:41.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.725 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.726 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.728 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.733 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.739 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.740 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.746 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T01:17:41.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.748 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.751 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.753 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-05-09T01:17:41.754 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-05-09T01:17:41.756 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.757 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.758 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.760 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.765 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.768 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.775 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.777 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.779 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-05-09T01:17:41.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.783 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.784 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.787 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:41.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-05-09T01:17:41.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.795 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.796 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.797 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.799 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.800 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T01:17:41.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.803 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.804 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T01:17:41.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-05-09T01:17:41.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-05-09T01:17:41.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.812 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.813 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.814 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.816 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-05-09T01:17:41.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-05-09T01:17:41.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.834 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.837 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.843 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.845 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.848 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.852 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.856 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.857 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-05-09T01:17:41.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.864 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-05-09T01:17:41.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.867 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.872 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.874 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.877 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.879 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.880 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.881 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-05-09T01:17:41.883 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.885 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.887 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.888 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.889 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.891 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.892 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.893 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.894 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.896 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.897 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.900 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.902 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.903 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.905 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.908 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-05-09T01:17:41.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.915 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.916 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.918 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.919 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.920 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.921 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-05-09T01:17:41.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.924 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.928 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.930 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-05-09T01:17:41.931 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-05-09T01:17:41.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.933 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.934 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.935 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.936 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.937 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-05-09T01:17:41.939 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.957 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.958 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.958 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.958 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.959 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-05-09T01:17:41.959 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-05-09T01:17:41.959 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.959 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.959 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.960 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-05-09T01:17:41.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.965 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.970 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.971 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.973 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.974 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:41.975 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-05-09T01:17:41.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.979 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-05-09T01:17:41.980 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard", 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:41.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.983 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:41.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:41.986 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.990 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.993 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-05-09T01:17:41.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.995 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.996 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.998 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:41.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.001 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-05-09T01:17:42.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-05-09T01:17:42.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-05-09T01:17:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-05-09T01:17:42.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-05-09T01:17:42.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-05-09T01:17:42.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.009 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.010 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.012 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.013 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T01:17:42.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T01:17:42.018 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.021 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-05-09T01:17:42.022 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:42.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-05-09T01:17:42.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-05-09T01:17:42.029 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-05-09T01:17:42.030 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-05-09T01:17:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-05-09T01:17:42.032 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-05-09T01:17:42.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-05-09T01:17:42.034 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-05-09T01:17:42.035 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-05-09T01:17:42.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-05-09T01:17:42.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-05-09T01:17:42.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-05-09T01:17:42.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-05-09T01:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-05-09T01:17:42.042 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.044 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.051 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T01:17:42.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-05-09T01:17:42.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T01:17:42.056 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-05-09T01:17:42.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T01:17:42.059 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.060 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.063 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.065 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.068 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.071 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-05-09T01:17:42.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T01:17:42.073 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.074 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.077 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T01:17:42.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T01:17:42.082 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T01:17:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T01:17:42.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.088 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.090 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-05-09T01:17:42.092 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T01:17:42.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T01:17:42.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T01:17:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T01:17:42.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T01:17:42.099 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T01:17:42.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T01:17:42.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T01:17:42.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T01:17:42.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T01:17:42.104 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T01:17:42.106 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.108 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.110 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.111 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.114 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.116 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-05-09T01:17:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.121 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.124 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.132 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.135 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.140 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.141 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.142 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.143 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-05-09T01:17:42.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.148 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-05-09T01:17:42.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-05-09T01:17:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.166 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T01:17:42.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.175 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-05-09T01:17:42.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.177 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.181 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-05-09T01:17:42.188 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-05-09T01:17:42.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.195 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.197 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-05-09T01:17:42.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.204 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.205 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.207 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.208 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.214 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.218 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.219 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-05-09T01:17:42.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.225 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.231 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T01:17:42.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.233 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.234 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.235 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.236 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-05-09T01:17:42.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-05-09T01:17:42.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.245 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.246 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.248 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.257 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.260 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.261 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.267 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.269 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.272 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.282 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.284 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.289 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.290 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-05-09T01:17:42.292 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.293 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.294 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.296 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.302 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-05-09T01:17:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.314 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.326 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:42.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.328 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.330 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.337 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.340 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.345 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.349 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.364 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.365 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.368 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.373 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.376 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-05-09T01:17:42.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.387 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.393 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.397 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.398 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.402 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.405 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.406 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.407 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.408 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.411 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.416 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.417 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.420 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.423 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-05-09T01:17:42.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-05-09T01:17:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.452 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.463 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.465 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.468 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-05-09T01:17:42.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.485 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-05-09T01:17:42.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-05-09T01:17:42.488 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-05-09T01:17:42.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-05-09T01:17:42.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.491 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-05-09T01:17:42.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard": "https://172.21.15.37:8443/" 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "always_on_modules": { 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "octopus": [ 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-05-09T01:17:42.495 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "pacific": [ 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-05-09T01:17:42.496 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "quincy": [ 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-05-09T01:17:42.497 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "reef": [ 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-05-09T01:17:42.498 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "squid": [ 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-05-09T01:17:42.499 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "last_failure_osd_epoch": 3, 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "active_clients": [ 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-05-09T01:17:42.500 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3076343336 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "libcephsqlite", 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-05-09T01:17:42.501 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1589009487 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 325439124 2024-05-09T01:17:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3704275929 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:42.503 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:42.504 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-09T01:17:42.504 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:17:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b27f0 msgr2=0x7f61d00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b27f0 0x7f61d00b4d00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f61e4075330 tx=0x7f61d4009520 comp rx=0 tx=0).stop 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 msgr2=0x7f61e4075990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4075990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f61cc006010 tx=0x7f61cc031a50 comp rx=0 tx=0).stop 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 shutdown_connections 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f61d00b27f0 0x7f61d00b4d00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61e4108a50 0x7f61e41a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61e4103d50 0x7f61e419f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 --2- 172.21.15.37:0/2697710258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61e4102b10 0x7f61e4075990 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 >> 172.21.15.37:0/2697710258 conn(0x7f61e40fdd00 msgr2=0x7f61e4104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 shutdown_connections 2024-05-09T01:17:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:17:40.858+0000 7f61e93b7640 1 -- 172.21.15.37:0/2697710258 wait complete. 2024-05-09T01:17:42.507 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:41 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/7185908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T01:17:42.507 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:41 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2697710258' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T01:17:42.513 DEBUG:tasks.check_counter:Getting stats from a 2024-05-09T01:17:42.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-09T01:17:42.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:41 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/7185908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T01:17:42.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:41 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2697710258' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T01:17:42.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:40 smithi136 ceph-mon[34110]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 MiB/s wr, 1.38k op/s 2024-05-09T01:17:42.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:40 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3350147901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:17:42.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:40 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1448703361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T01:17:42.514 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:40 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3449751075' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T01:17:42.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:41 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/7185908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T01:17:42.515 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:41 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2697710258' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T01:17:42.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:42 smithi037 ceph-mon[30122]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 19 MiB/s wr, 1.23k op/s 2024-05-09T01:17:42.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:42 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:42.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:42 smithi151 ceph-mon[34780]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 19 MiB/s wr, 1.23k op/s 2024-05-09T01:17:42.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:42 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:42.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:42 smithi136 ceph-mon[34110]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 19 MiB/s wr, 1.23k op/s 2024-05-09T01:17:42.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:42 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:43.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:43 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:43.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:43 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:43.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:43 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:44.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:44 smithi037 ceph-mon[30122]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-05-09T01:17:44.485 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:17:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:17:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 2399, 2024-05-09T01:17:44.485 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2399, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1693408, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 762059, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 6, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.257950234, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.067226674, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.064455671, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.107153587, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2398, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.150821890, 2024-05-09T01:17:44.486 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000062894 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 350, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 321, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 734046, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 194126, 2024-05-09T01:17:44.487 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 6, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.049764368, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.019230683, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.023498266, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.007328710, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 320, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.020159545, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000062998 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.488 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 732656, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 193104 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1036, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1271, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 254792, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 822138, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 6, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-05-09T01:17:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.124982745, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.039625362, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.026320151, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.045186507, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1269, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.069575786, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000054827 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.490 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 493008 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 5613, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.203753393, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000036300 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.491 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.492 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 218, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 11, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 207, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 211, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-05-09T01:17:44.493 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 7, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-05-09T01:17:44.494 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T01:17:44.495 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-05-09T01:17:44.496 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:17:44.497 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 783, 2024-05-09T01:17:44.498 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 2, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 5177219, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 5176043, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.499 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 783 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 210, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 212, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 2, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 15, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 15, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 0, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 218, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 218, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 0, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-05-09T01:17:44.500 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 123156, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 215440 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-05-09T01:17:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-05-09T01:17:44.505 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.506 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.507 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.508 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.511 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-05-09T01:17:44.512 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.513 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.514 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 2, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 2141, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.515 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:17:44.516 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:17:44.517 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 205778, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 260, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:17:44.518 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 7336, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 154, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 651703, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 5444, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-05-09T01:17:44.519 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 3433, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 3433, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3433, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 13.289833309, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.003871201 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-05-09T01:17:44.520 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3433, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 3434 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 3433, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 3433, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 2150, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 1281, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-05-09T01:17:44.521 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-05-09T01:17:44.522 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-05-09T01:17:44.523 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 81, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 2, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 6, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 9, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 3, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-05-09T01:17:44.524 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T01:17:44.525 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 3781, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 2321204, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 3781, 2024-05-09T01:17:44.526 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3781, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2321204, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:44.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3433, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 982920, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3433, 2024-05-09T01:17:44.528 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 982920, 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-05-09T01:17:44.529 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3433, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 3433, 2024-05-09T01:17:44.530 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3433, 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3433, 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:17:44.531 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-05-09T01:17:44.532 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x55f78e7ac8f0": { 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:44.533 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:44.534 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:17:44.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:44 smithi151 ceph-mon[34780]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-05-09T01:17:44.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:44 smithi136 ceph-mon[34110]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-05-09T01:17:45.217 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-09T01:17:45.217 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-09T01:17:45.217 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-05-09T01:17:45.218 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-05-09T01:17:45.218 DEBUG:tasks.check_counter:Getting stats from d 2024-05-09T01:17:45.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-09T01:17:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:46.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:46 smithi037 ceph-mon[30122]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 279 op/s 2024-05-09T01:17:46.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:46 smithi151 ceph-mon[34780]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 279 op/s 2024-05-09T01:17:46.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:46 smithi136 ceph-mon[34110]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.0 MiB/s wr, 279 op/s 2024-05-09T01:17:47.206 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:17:47.206 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:17:47.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 320, 2024-05-09T01:17:47.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 317, 2024-05-09T01:17:47.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 542592, 2024-05-09T01:17:47.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 195760, 2024-05-09T01:17:47.206 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.051051973, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.021042899, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.020394481, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.007439724, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 316, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.018578454, 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000058792 2024-05-09T01:17:47.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 542592, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 195760 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 6, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 244, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 3312, 2024-05-09T01:17:47.208 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 200576, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.018566674, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.014153814, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.002499514, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 243, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.025269406, 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000103989 2024-05-09T01:17:47.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 200576 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-05-09T01:17:47.210 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000405065, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000328431, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:47.211 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-05-09T01:17:47.212 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:17:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:17:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:17:47.215 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-05-09T01:17:47.216 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148744, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 30, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-05-09T01:17:47.217 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-05-09T01:17:47.218 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-05-09T01:17:47.219 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 322, 2024-05-09T01:17:47.220 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 497347, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 322, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 322, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 497347, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:47.221 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:47.222 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:47.222 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:47.222 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:47.222 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:17:47.472 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:47 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:47.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:47 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:47.838 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-09T01:17:47.838 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-09T01:17:47.838 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-09T01:17:47.838 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-09T01:17:47.838 DEBUG:tasks.check_counter:Getting stats from g 2024-05-09T01:17:47.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-09T01:17:47.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:47 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:48.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:48 smithi037 ceph-mon[30122]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-05-09T01:17:48.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:48 smithi151 ceph-mon[34780]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-05-09T01:17:48.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:48 smithi136 ceph-mon[34110]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 160 op/s 2024-05-09T01:17:49.804 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1446, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1416, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1108208, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 542912, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.183789250, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.068909449, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.054150854, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.050360630, 2024-05-09T01:17:49.805 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1415, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.107588839, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000076034 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 739952, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 194384 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:17:49.806 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 2201, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2438, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 3603437, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 1194633, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.202179094, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.057498306, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.051620460, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.078796346, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2436, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.116384720, 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000047776 2024-05-09T01:17:49.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 494976 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 8, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 8, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 4621, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 1732, 2024-05-09T01:17:49.808 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 7, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.002394191, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000107767, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001968783, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000106007, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 7, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.003213824, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000459117 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 5566, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.178485831, 2024-05-09T01:17:49.810 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000032067 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.811 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-05-09T01:17:49.812 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 695, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 14, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 681, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 676, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 17, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-05-09T01:17:49.813 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-05-09T01:17:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-05-09T01:17:49.815 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-05-09T01:17:49.816 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-05-09T01:17:49.817 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 1078, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-05-09T01:17:49.818 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 3, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 7238781, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 7231117, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.819 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 1078 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 342, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 809, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 467, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 53, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 55, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 2, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 357, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 879, 2024-05-09T01:17:49.820 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 522, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 123036, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 215440 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.821 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-05-09T01:17:49.822 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.823 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.824 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.825 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-05-09T01:17:49.826 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.826 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.826 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.826 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.829 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.830 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.831 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:17:49.832 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 1, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 0, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-05-09T01:17:49.833 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 2146, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:17:49.834 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:17:49.835 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:17:49.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 222815, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 720, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 7336, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 154, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:17:49.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 2093107, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 17713, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 3300, 2024-05-09T01:17:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 3300, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3300, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 38.574515865, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.011689247 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3300, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 3301 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 3300, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 3300, 2024-05-09T01:17:49.839 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 1991, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 1307, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-05-09T01:17:49.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-05-09T01:17:49.841 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-05-09T01:17:49.842 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 81, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 2, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 6, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 8, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 2, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:17:49.843 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "osd-slow-ops": { 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 3651, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 4366775, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 3651, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3651, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 4366775, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3300, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 3044482, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3300, 2024-05-09T01:17:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3044482, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3300, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 3300, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3300, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3300, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x5556b003a8f0": { 2024-05-09T01:17:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:49.851 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:17:50.505 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:50 smithi037 ceph-mon[30122]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 546 KiB/s wr, 54 op/s 2024-05-09T01:17:50.539 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-09T01:17:50.539 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-09T01:17:50.539 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-05-09T01:17:50.539 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-05-09T01:17:50.539 DEBUG:tasks.check_counter:Getting stats from j 2024-05-09T01:17:50.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-09T01:17:50.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:50 smithi151 ceph-mon[34780]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 546 KiB/s wr, 54 op/s 2024-05-09T01:17:50.795 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:17:50.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:50 smithi136 ceph-mon[34110]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 546 KiB/s wr, 54 op/s 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 322, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 319, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 543136, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 197040, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.048217775, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.019234363, 2024-05-09T01:17:52.438 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.019435661, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.007177296, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 318, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.015661281, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000049249 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 543136, 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 197040 2024-05-09T01:17:52.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 6, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 246, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 3312, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 200928, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.019709629, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.014315450, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.002839622, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 245, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.018130010, 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000074000 2024-05-09T01:17:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 200928 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-05-09T01:17:52.441 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000457743, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000376200, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:52.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:17:52.443 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:17:52.444 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148721, 2024-05-09T01:17:52.445 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 30, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-05-09T01:17:52.446 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 324, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 497607, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 324, 2024-05-09T01:17:52.447 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 324, 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 497607, 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-09T01:17:52.448 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-09T01:17:52.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:52 smithi037 ceph-mon[30122]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-05-09T01:17:52.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:52 smithi151 ceph-mon[34780]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-05-09T01:17:52.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:52 smithi136 ceph-mon[34110]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 53 KiB/s wr, 19 op/s 2024-05-09T01:17:53.211 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-09T01:17:53.211 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-09T01:17:53.211 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-09T01:17:53.211 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-09T01:17:53.211 DEBUG:tasks.check_counter:Getting stats from b 2024-05-09T01:17:53.212 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-09T01:17:53.466 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T01:17:54.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:54 smithi136 ceph-mon[34110]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 20 op/s 2024-05-09T01:17:54.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:54 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:54.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:54 smithi037 ceph-mon[30122]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 20 op/s 2024-05-09T01:17:54.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:54 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:54.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:54 smithi151 ceph-mon[34780]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 20 op/s 2024-05-09T01:17:54.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:54 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:55.206 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 8945, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 11367, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 3782436, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 8819510, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 15, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.774958711, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.287817484, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.537833060, 2024-05-09T01:17:55.207 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.105338398, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 11367, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.857181816, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000075409 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 15960, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.003048915, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000191 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 2381456, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 3741616 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:17:55.208 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 4215, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 4533, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1797418, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 2978457, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 10, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 8, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.300372043, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.111445393, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.180444399, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.032025942, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4528, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.626472527, 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000138355 2024-05-09T01:17:55.209 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5799, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001555979, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000268 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 508880 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 7333, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 7719, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 2390940, 2024-05-09T01:17:55.210 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 10709699, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 266, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 7, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.628570062, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.253377730, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.383317654, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.045239099, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 7720, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.549755799, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000071211 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.211 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 10853, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.002262208, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000208 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:17:55.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3297, 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.871856162, 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000567745 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 91, 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.002294570, 2024-05-09T01:17:55.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000025215 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 1822, 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 1635, 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1635, 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 5.867066740, 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.003588420 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-05-09T01:17:55.214 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 187, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 2, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 531, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 3, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 340, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 27, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 300, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 13, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 302, 2024-05-09T01:17:55.215 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 1036, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 233, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 233, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 20, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 2080, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 1441, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 183, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 3, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 1, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 4006, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-05-09T01:17:55.216 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 44, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 1099, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 32, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 353, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 911, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 1030, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 1734794433, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 911, 2024-05-09T01:17:55.217 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-05-09T01:17:55.218 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:17:55.218 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:17:55.218 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 309, 2024-05-09T01:17:55.218 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 15, 2024-05-09T01:17:55.218 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 294, 2024-05-09T01:17:55.218 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 602, 2024-05-09T01:17:55.218 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 7, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 129, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 1170, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 1041, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 852, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 10, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 134 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.219 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 158, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 93, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 47, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 87, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 571, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 18, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 17, 2024-05-09T01:17:55.220 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 1, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 15, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 50, 2024-05-09T01:17:55.221 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 3, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 2571, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 2537, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 2537, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 34, 2024-05-09T01:17:55.222 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 2, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 73, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 72, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 72, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 1, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 1, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 1, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 11191273, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 11390901, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-05-09T01:17:55.223 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1040, 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 71.528032249, 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.068776954 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 293, 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 1280, 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 987, 2024-05-09T01:17:55.224 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 53, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 128, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 75, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 328, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 1619, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 1291, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 233, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 1258, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 1025, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 139984, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 231824 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 1910, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 1014, 2024-05-09T01:17:55.225 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 1822, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 227, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 2029, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 977, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 4.909565026, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.005025143 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 32, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.156477451, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.004889920 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-05-09T01:17:55.226 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001016464, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001016464 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 123, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.042301864, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000343917 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-05-09T01:17:55.227 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000168836, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000168836 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-05-09T01:17:55.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 37, 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.045604979, 2024-05-09T01:17:55.230 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001232567 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 387, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.076420508, 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000197469 2024-05-09T01:17:55.231 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 41, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.435436784, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.010620409 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 15, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.131678471, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.008778564 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.232 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.014436851, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.007218425 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.233 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001013953, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001013953 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 7, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.021666008, 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.003095144 2024-05-09T01:17:55.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 11, 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.031279545, 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002843595 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.236 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 2, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 1, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-05-09T01:17:55.237 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 2, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 2, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 960, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:17:55.238 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:17:55.239 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 356969, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 390, 2024-05-09T01:17:55.240 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7336, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 154, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-05-09T01:17:55.241 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 1099769, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 10493, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 4446, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 9006410, 2024-05-09T01:17:55.242 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 37, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 4446, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4446, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 178.995812822, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.040259966 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4446, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 7506 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 4446, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 951, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 3495, 2024-05-09T01:17:55.243 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 462, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 1018, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 23, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 1048, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 235, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 3, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 545, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-05-09T01:17:55.244 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 928, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 2036, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-05-09T01:17:55.245 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-05-09T01:17:55.246 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 12, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-05-09T01:17:55.247 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 1166, 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 4, 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 38 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-05-09T01:17:55.248 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 1 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 10, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 6, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 31, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 17, 2024-05-09T01:17:55.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 20489, 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 5893267, 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:55.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 20489, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 20489, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 5893267, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.251 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 4446, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 9008095, 2024-05-09T01:17:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 4446, 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 9008095, 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:55.253 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 4446, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 4446, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 4446, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4446, 2024-05-09T01:17:55.254 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 17, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 1717, 2024-05-09T01:17:55.255 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 17, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 8, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1717, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x5556c7fd44e0": { 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:55.256 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 2571, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 7196597, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 2571, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1040, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 7196597, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:55.257 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-09T01:17:56.017 INFO:tasks.check_counter:Daemon mds.b mds.exported=44 2024-05-09T01:17:56.018 INFO:tasks.check_counter:Daemon mds.b mds.imported=32 2024-05-09T01:17:56.018 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=158 2024-05-09T01:17:56.018 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=93 2024-05-09T01:17:56.018 DEBUG:tasks.check_counter:Getting stats from e 2024-05-09T01:17:56.018 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-09T01:17:56.272 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T01:17:56.654 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:56 smithi136 ceph-mon[34110]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 KiB/s wr, 18 op/s 2024-05-09T01:17:56.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:56 smithi037 ceph-mon[30122]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 KiB/s wr, 18 op/s 2024-05-09T01:17:56.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:56 smithi151 ceph-mon[34780]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 KiB/s wr, 18 op/s 2024-05-09T01:17:58.055 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 2000, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 2301, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 946226, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 2012060, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 17, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.176840058, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.068021258, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.088987087, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.023356195, 2024-05-09T01:17:58.056 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2300, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.106634994, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000046363 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2070, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000503285, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000243 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 215504, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 533264 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:17:58.057 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 1606, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1568, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1551831, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 728303, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 9, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 6, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.134270545, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.044773094, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.054952042, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.030088505, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1567, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.094175680, 2024-05-09T01:17:58.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000060099 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 348, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000134530, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000386 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 771840, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 214832 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 4755, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 4013, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 2236065, 2024-05-09T01:17:58.059 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 2283339, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 39, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 6, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.336241113, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.137812792, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.204459052, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.026728111, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4011, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.217045016, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000054112 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:17:58.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5977, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001537032, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000257 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 501952 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:17:58.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2665, 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.549316013, 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000206122 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 17, 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000353009, 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000020765 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-05-09T01:17:58.062 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 265, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 160, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 160, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.087960695, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000549754 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 105, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 1, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 11, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-05-09T01:17:58.063 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 235, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 9, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 226, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 221, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 4, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 202, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 202, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 15, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 615, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 472, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 104, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 26, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:17:58.064 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 5878, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 1, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 5, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 204, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 2790, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 1033, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 1731362092, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-05-09T01:17:58.065 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 2790, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 2790, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 5, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 153, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:17:58.066 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 292, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 212, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 8, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 11 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 56, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 398, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 211, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 349, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 61, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-05-09T01:17:58.067 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 2, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 2, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:17:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 787, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 787, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-05-09T01:17:58.069 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 2, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 2, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 2, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 5179515, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 225, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 6.708486751, 2024-05-09T01:17:58.070 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.029815496 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 237, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 241, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 4, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 45, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 208, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 163, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 235, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 248, 2024-05-09T01:17:58.071 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 13, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 202, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 389, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 187, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 129776, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 223632 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 278, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 265, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 17, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 4, 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-05-09T01:17:58.072 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.005896958, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002948479 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000377267, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000377267 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 128, 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.060163430, 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000470026 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-05-09T01:17:58.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000126088, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000126088 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.076 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.077 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.077 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.077 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-05-09T01:17:58.077 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.077 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-05-09T01:17:58.078 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.079 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 21, 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.011473088, 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000546337 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5, 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.004931795, 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000986359 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.080 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.081 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-05-09T01:17:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-05-09T01:17:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-05-09T01:17:58.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.086 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.004992069, 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002496034 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.087 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-05-09T01:17:58.088 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 2, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 1, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 5, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 5, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 951, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:17:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:17:58.091 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 323204, 2024-05-09T01:17:58.092 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 346, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7336, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 154, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-05-09T01:17:58.093 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 857406, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 8483, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 3150, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 1036743, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 33, 2024-05-09T01:17:58.094 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 3150, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3150, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 17.537601070, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.005567492 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3150, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 3201 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 3150, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 2796, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 354, 2024-05-09T01:17:58.095 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 10, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 1, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 226, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 63, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 14, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-05-09T01:17:58.096 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 2790, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 20, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-05-09T01:17:58.097 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-05-09T01:17:58.098 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 12, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 56, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 6, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 15 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-05-09T01:17:58.099 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 2, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 2, 2024-05-09T01:17:58.100 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 2, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 2, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 8357, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 3929317, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 8357, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:17:58.101 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 8357, 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3929317, 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:58.102 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3150, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 1036829, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3150, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1036829, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.103 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3150, 2024-05-09T01:17:58.104 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 3150, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3150, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3150, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 2, 2024-05-09T01:17:58.105 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 202, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 2, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 202, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:17:58.106 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x55669eb70680": { 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 787, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 985211, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 787, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 225, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 985211, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:17:58.107 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:17:58.108 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:17:58.108 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.108 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:17:58.108 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-09T01:17:58.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:58 smithi037 ceph-mon[30122]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-05-09T01:17:58.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:58 smithi151 ceph-mon[34780]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-05-09T01:17:58.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:58 smithi136 ceph-mon[34110]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 KiB/s wr, 21 op/s 2024-05-09T01:17:59.113 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-09T01:17:59.113 INFO:tasks.check_counter:Daemon mds.e mds.imported=5 2024-05-09T01:17:59.113 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=56 2024-05-09T01:17:59.114 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=398 2024-05-09T01:17:59.114 DEBUG:tasks.check_counter:Getting stats from h 2024-05-09T01:17:59.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-09T01:17:59.358 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T01:17:59.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:17:59 smithi037 ceph-mon[30122]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:59.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:17:59 smithi151 ceph-mon[34780]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:17:59.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:17:59 smithi136 ceph-mon[34110]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-09T01:18:00.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:00 smithi037 ceph-mon[30122]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 KiB/s wr, 17 op/s 2024-05-09T01:18:00.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:00 smithi151 ceph-mon[34780]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 KiB/s wr, 17 op/s 2024-05-09T01:18:00.782 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:00 smithi136 ceph-mon[34110]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 KiB/s wr, 17 op/s 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3771, 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 3484, 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 2018546, 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 4444378, 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 17, 2024-05-09T01:18:01.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 5, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.270213542, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.093907229, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.133598280, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.047558684, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3482, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.131085869, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000037646 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3079, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000550746, 2024-05-09T01:18:01.040 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000178 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 790496, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 215952 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3759, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 4175, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1316113, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 1902624, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 9, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 5, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.325839076, 2024-05-09T01:18:01.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.148400795, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.183363999, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.013663042, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4179, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.179766697, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000043016 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 6858, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001488852, 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000217 2024-05-09T01:18:01.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 503200 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 4115, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 4858, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1330473, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 2993183, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 38, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 8, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.292682168, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.119523663, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.196932643, 2024-05-09T01:18:01.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.016814102, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4852, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.169125278, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000034856 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 6905, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001062234, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000153 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 1155104, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 2405872 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-05-09T01:18:01.044 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3356, 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.192971809, 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000355474 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000008985, 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000004492 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 1836, 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 1797, 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-05-09T01:18:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1797, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 4.516690272, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002513461 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 39, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 11, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 451, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 5, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 315, 2024-05-09T01:18:01.047 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 131, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 441, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 95, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 67, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 67, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 5, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 6127, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 4594, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 39, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 33, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 453, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 10942, 2024-05-09T01:18:01.048 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 1, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 2, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 79, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 3, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 82, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 976, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 1033, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 1731362092, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 976, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:18:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 16, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 16, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 960, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 332, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 863, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 1082, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 514, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 38, 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 1101 2024-05-09T01:18:01.050 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 277, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 385, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 209, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 315, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 278, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 258, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 258, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-05-09T01:18:01.051 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 2, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 1766, 2024-05-09T01:18:01.052 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 1766, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 3, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 3, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 2, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 7174168, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-05-09T01:18:01.053 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1296, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 36.491154617, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.028156755 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 98, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 172, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 74, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 32, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 199, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 167, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 451, 2024-05-09T01:18:01.054 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 546, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 95, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 67, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 214, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 147, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 126716, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 223632 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 3744, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 1836, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 514, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 840, 2024-05-09T01:18:01.055 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 63, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.084254323, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001337370 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 17, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.012561939, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000738937 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 258, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.644051553, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002496323 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 860, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.054232197, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001225851 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.058 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.059 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-05-09T01:18:01.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 76, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.081227968, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001068789 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.061 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 7, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.013415766, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001916538 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 258, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 2.130285417, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.008256920 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 258, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.496661109, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001925043 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.066 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 1, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 0, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-05-09T01:18:01.067 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 323, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 323, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 951, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:18:01.068 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:18:01.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-05-09T01:18:01.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 286183, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 187, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:18:01.071 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7336, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 154, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 658376, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 20728, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-05-09T01:18:01.072 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 2523, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 3038372, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 33, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 2523, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2523, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 61.516610325, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.024382326 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.073 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2523, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 2717 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 2523, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 976, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 1547, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 0, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 10, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 0, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 1296, 2024-05-09T01:18:01.074 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 59, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 6, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 976, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 20, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-05-09T01:18:01.075 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-05-09T01:18:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 12, 2024-05-09T01:18:01.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 262, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 0, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 88 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-05-09T01:18:01.078 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 0, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:01.079 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 11641, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 3428213, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 11641, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 11641, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3428213, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.080 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 2523, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 3038372, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 2523, 2024-05-09T01:18:01.081 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3038372, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:01.082 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 2523, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 2523, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 2523, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 2523, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:18:01.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x560f1dbf4410": { 2024-05-09T01:18:01.084 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 574, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 1766, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 2979864, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 1766, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1296, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 2979290, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.085 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:01.086 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-09T01:18:01.868 INFO:tasks.check_counter:Daemon mds.h mds.exported=2 2024-05-09T01:18:01.868 INFO:tasks.check_counter:Daemon mds.h mds.imported=3 2024-05-09T01:18:01.869 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=277 2024-05-09T01:18:01.869 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=385 2024-05-09T01:18:01.869 DEBUG:tasks.check_counter:Getting stats from k 2024-05-09T01:18:01.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-09T01:18:02.111 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T01:18:02.516 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:02 smithi136 ceph-mon[34110]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-05-09T01:18:02.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:02 smithi037 ceph-mon[30122]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-05-09T01:18:02.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:02 smithi151 ceph-mon[34780]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-05-09T01:18:03.921 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-09T01:18:03.921 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:18:03.921 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3363, 2024-05-09T01:18:03.921 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 3365, 2024-05-09T01:18:03.921 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 3925931, 2024-05-09T01:18:03.921 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 1069441, 2024-05-09T01:18:03.921 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 6, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 2, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.242790226, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.071402564, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.064324439, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.089132756, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3363, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.124772574, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000037101 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.922 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 368, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 334, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 759740, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 201930, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 4, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 2, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.048776014, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.017890991, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.023898093, 2024-05-09T01:18:03.923 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.007391601, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 334, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.016735133, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000050105 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 759184, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 201232 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.924 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 248, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 588, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 589950, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 6, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.013297580, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.009350818, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.001882990, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000014240, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 246, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.012376684, 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000050311 2024-05-09T01:18:03.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 589632 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-05-09T01:18:03.926 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5692, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.138953925, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000024412 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.927 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-05-09T01:18:03.928 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 431, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 431, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 431, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 3, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:18:03.929 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-05-09T01:18:03.930 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:18:03.931 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 0 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-05-09T01:18:03.932 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:18:03.933 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 1765, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-05-09T01:18:03.934 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 0, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 3, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 2, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 7173594, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 7172338, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.936 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 1765 2024-05-09T01:18:03.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.936 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-05-09T01:18:03.936 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 77, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 139, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 62, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 12, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 15, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 3, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 431, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 512, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 81, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 0, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 0, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 124608, 2024-05-09T01:18:03.937 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 215440 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 0, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 0, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 0, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 0, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.938 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.939 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-05-09T01:18:03.940 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-05-09T01:18:03.941 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.942 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.942 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.942 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-05-09T01:18:03.942 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-05-09T01:18:03.943 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.944 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-05-09T01:18:03.945 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.946 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.947 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.948 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-05-09T01:18:03.949 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 1, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 0, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 0, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 0, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 2427, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:18:03.950 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-05-09T01:18:03.951 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-05-09T01:18:03.952 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 184643, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 117, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-05-09T01:18:03.953 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7336, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 154, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 511436, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 16334, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.954 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 3366, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 21, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 3, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 3366, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3366, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 27.569373004, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.008190544 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-05-09T01:18:03.955 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3366, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 3367 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 3366, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 3366, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 2049, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 1315, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-05-09T01:18:03.956 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 1, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:18:03.957 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-05-09T01:18:03.958 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 81, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 4, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 6, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 2, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 0, 2024-05-09T01:18:03.959 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 2, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 0 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 0, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T01:18:03.960 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 3730, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 4329001, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 3730, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:18:03.961 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3730, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4329001, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:18:03.962 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3366, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 2979295, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3366, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 2979295, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-05-09T01:18:03.963 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3366, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 3366, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3366, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3366, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.964 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:03.965 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x5637fa1d28f0": { 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-05-09T01:18:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-05-09T01:18:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-05-09T01:18:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-05-09T01:18:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-05-09T01:18:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-05-09T01:18:03.968 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-09T01:18:04.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:04 smithi136 ceph-mon[34110]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-05-09T01:18:04.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:04 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:18:04.708 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-09T01:18:04.709 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-09T01:18:04.709 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-05-09T01:18:04.709 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-05-09T01:18:04.709 DEBUG:tasks.check_counter:Getting stats from c 2024-05-09T01:18:04.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-09T01:18:04.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:04 smithi037 ceph-mon[30122]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-05-09T01:18:04.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:04 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:18:04.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:04 smithi151 ceph-mon[34780]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-05-09T01:18:04.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:04 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T01:18:04.947 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T01:18:05.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:05 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:18:05.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:18:05.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:05 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:18:05.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T01:18:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:05 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' 2024-05-09T01:18:06.719 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:06 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-09T01:18:06.719 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:06 smithi151 ceph-mon[34780]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-09T01:18:06.719 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:06 smithi151 ceph-mon[34780]: Adjusting osd_memory_target on smithi136 to 176.2M 2024-05-09T01:18:06.719 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:06 smithi151 ceph-mon[34780]: Unable to set osd_memory_target on smithi136 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-09T01:18:06.719 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:06 smithi151 ceph-mon[34780]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T01:18:06.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:06 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-09T01:18:06.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:06 smithi037 ceph-mon[30122]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-09T01:18:06.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:06 smithi037 ceph-mon[30122]: Adjusting osd_memory_target on smithi136 to 176.2M 2024-05-09T01:18:06.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:06 smithi037 ceph-mon[30122]: Unable to set osd_memory_target on smithi136 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-09T01:18:06.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:06 smithi037 ceph-mon[30122]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T01:18:06.867 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-09T01:18:06.867 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:18:06.867 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 7860, 2024-05-09T01:18:06.867 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 8084, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 4225054, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 5626678, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 11, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.475827975, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.178171858, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.241629953, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.073674021, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 8082, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.332131722, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000041095 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.868 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 7945, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001665864, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000209 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 4642, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 5508, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 2505044, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 2780578, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 14, 2024-05-09T01:18:06.869 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.276641542, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.102790042, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.123035267, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.046586900, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5509, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.174749963, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000031720 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3908, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000748756, 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000191 2024-05-09T01:18:06.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 592416 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 3978, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 4976, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 2692785, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 2762476, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 39, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.298209444, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.111699372, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.130272931, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.056397210, 2024-05-09T01:18:06.871 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4973, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.165146283, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000033208 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1930, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000460798, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000238 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1004384, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 1394624 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-09T01:18:06.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 8147, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.378827929, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000169243 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 56, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.007217588, 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000128885 2024-05-09T01:18:06.873 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 215, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 175, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 175, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.143454191, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000819738 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 40, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 5, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 2, 2024-05-09T01:18:06.874 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 11, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 360, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 6, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 354, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 360, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 500, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 334, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 334, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 25, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 491, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 407, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 39, 2024-05-09T01:18:06.875 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 22, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 1020, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 17, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 498, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 18, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 847, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 9015, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 1033, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 1731362092, 2024-05-09T01:18:06.876 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 9015, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 144, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 144, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 8871, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 6, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 33, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 155, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 266, 2024-05-09T01:18:06.877 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 111, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 19, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 71 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 63, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 308, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 165, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 293, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 256, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:18:06.878 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 13, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 13, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 17, 2024-05-09T01:18:06.879 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 1086, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 1086, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 3, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-09T01:18:06.880 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 3, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 7248950, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 409, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 58.060541292, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.141957313 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-05-09T01:18:06.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 355, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 823, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 468, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 61, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 188, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 127, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 361, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 900, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 539, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 334, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 1333, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 999, 2024-05-09T01:18:06.882 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 135032, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223632 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 242, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 349, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 215, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 100, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 698, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 14, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.023897000, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001706928 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.883 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.002575387, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002575387 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.884 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 92, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.036513290, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000396883 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.885 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.886 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.887 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-09T01:18:06.887 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:06 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-09T01:18:06.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:06 smithi136 ceph-mon[34110]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-05-09T01:18:06.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:06 smithi136 ceph-mon[34110]: Adjusting osd_memory_target on smithi136 to 176.2M 2024-05-09T01:18:06.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:06 smithi136 ceph-mon[34110]: Unable to set osd_memory_target on smithi136 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-05-09T01:18:06.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:06 smithi136 ceph-mon[34110]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T01:18:06.888 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.888 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.888 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-09T01:18:06.888 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.888 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.889 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 21, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.014158525, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000674215 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 31, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.038694968, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001248224 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.006548286, 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001309657 2024-05-09T01:18:06.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.892 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.893 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.895 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-09T01:18:06.895 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.895 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.895 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.895 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.895 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.896 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-09T01:18:06.897 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.897 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.897 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.897 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.897 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-09T01:18:06.897 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 11, 2024-05-09T01:18:06.897 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.021066735, 2024-05-09T01:18:06.898 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001915157 2024-05-09T01:18:06.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.898 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:18:06.898 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:18:06.898 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-09T01:18:06.898 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.899 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.899 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.899 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.899 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.899 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-09T01:18:06.899 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-05-09T01:18:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 1, 2024-05-09T01:18:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 0, 2024-05-09T01:18:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-05-09T01:18:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-09T01:18:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 63, 2024-05-09T01:18:06.900 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 63, 2024-05-09T01:18:06.901 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 2407, 2024-05-09T01:18:06.901 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-09T01:18:06.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.901 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-09T01:18:06.901 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:18:06.901 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-09T01:18:06.901 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:18:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:18:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:18:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:18:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:18:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:18:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:18:06.902 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:18:06.903 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:18:06.903 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:18:06.903 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:18:06.903 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:18:06.903 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:18:06.903 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-09T01:18:06.904 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:18:06.904 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-09T01:18:06.904 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:18:06.904 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:18:06.904 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:18:06.904 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:18:06.904 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:18:06.905 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 303756, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 455, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 440, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 5, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-09T01:18:06.906 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7336, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 154, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 1303052, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 13472, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-09T01:18:06.907 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 9622, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 3177937, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 9622, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 9622, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 96.866892137, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.010067230 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 9622, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 9720 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.908 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 9622, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 9034, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 588, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 6, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 415, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 66, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-09T01:18:06.909 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 25, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 9020, 2024-05-09T01:18:06.910 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-09T01:18:06.911 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:18:06.912 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-09T01:18:06.912 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-09T01:18:06.912 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-09T01:18:06.912 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-09T01:18:06.912 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-09T01:18:06.912 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-09T01:18:06.912 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-09T01:18:06.913 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-09T01:18:06.913 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-09T01:18:06.913 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-09T01:18:06.913 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-09T01:18:06.913 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-09T01:18:06.913 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-09T01:18:06.913 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-09T01:18:06.914 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-09T01:18:06.914 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-09T01:18:06.914 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-09T01:18:06.914 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 81, 2024-05-09T01:18:06.914 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-09T01:18:06.914 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 114, 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 20, 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 24 2024-05-09T01:18:06.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.916 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-09T01:18:06.916 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-05-09T01:18:06.916 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:18:06.916 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-09T01:18:06.916 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-09T01:18:06.916 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.916 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 1 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 6, 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 6, 2024-05-09T01:18:06.917 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 13, 2024-05-09T01:18:06.918 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 13, 2024-05-09T01:18:06.918 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-09T01:18:06.918 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.918 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:18:06.918 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:06.918 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:06.918 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:06.919 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 16476, 2024-05-09T01:18:06.919 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 7885143, 2024-05-09T01:18:06.919 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:06.919 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 16476, 2024-05-09T01:18:06.919 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:06.919 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:06.920 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 16476, 2024-05-09T01:18:06.920 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 7885143, 2024-05-09T01:18:06.920 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:06.920 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.920 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.920 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.921 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.921 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.921 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-09T01:18:06.921 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:06.921 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:06.921 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:06.921 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 9622, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 3179005, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 9622, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3179005, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.922 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 9622, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 9622, 2024-05-09T01:18:06.923 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 9622, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 9622, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:06.924 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 13, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1313, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 13, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 6, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1313, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.925 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.926 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.926 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:06.926 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x55f061daa4e0": { 2024-05-09T01:18:06.926 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 574, 2024-05-09T01:18:06.926 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:06.927 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:06.927 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 1086, 2024-05-09T01:18:06.927 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 3054646, 2024-05-09T01:18:06.929 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:06.929 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 1086, 2024-05-09T01:18:06.929 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 409, 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3054072, 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:06.930 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.931 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:06.931 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-09T01:18:07.627 INFO:tasks.check_counter:Daemon mds.c mds.exported=17 2024-05-09T01:18:07.627 INFO:tasks.check_counter:Daemon mds.c mds.imported=18 2024-05-09T01:18:07.627 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=63 2024-05-09T01:18:07.627 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=308 2024-05-09T01:18:07.627 DEBUG:tasks.check_counter:Getting stats from f 2024-05-09T01:18:07.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-09T01:18:07.917 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T01:18:08.473 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:08 smithi151 ceph-mon[34780]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-09T01:18:08.541 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:08 smithi037 ceph-mon[30122]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-09T01:18:08.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:08 smithi136 ceph-mon[34110]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1356, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1358, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 4632545, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 431218, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 6, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 2, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.141360541, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.041468364, 2024-05-09T01:18:09.721 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.040817063, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.046234332, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1356, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.072946285, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000053795 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T01:18:09.722 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1273, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1239, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 982840, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 488922, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 5, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.125397050, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.041400597, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.040151036, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.037090197, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1239, 2024-05-09T01:18:09.723 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.065366715, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000052757 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 758800, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 200112 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1385, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1629, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 3372666, 2024-05-09T01:18:09.724 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 944401, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.121531846, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.047269178, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.029236448, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.033924535, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1627, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.078339841, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000048149 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.725 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 504288 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-09T01:18:09.726 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6077, 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.179106266, 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000029472 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-09T01:18:09.728 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 313, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 53, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 260, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 237, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 14, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:18:09.729 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 1027, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 1734860476, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T01:18:09.730 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 0, 2024-05-09T01:18:09.731 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 0 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 0, 2024-05-09T01:18:09.732 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-09T01:18:09.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 2578, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 2, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 71, 2024-05-09T01:18:09.734 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 11191273, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 11405907, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 11404761, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 2578 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 258, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 1322, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 1064, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 29, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 85, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 56, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 313, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 1400, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 1087, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 0, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 0, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 121372, 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 215440 2024-05-09T01:18:09.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 0, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 0, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 0, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.739 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-09T01:18:09.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-09T01:18:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.742 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.743 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-09T01:18:09.744 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.745 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.746 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.747 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 2, 2024-05-09T01:18:09.748 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 1, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 2409, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:18:09.749 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:18:09.750 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:18:09.751 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 199161, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 295, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7336, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 154, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:18:09.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 844929, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 6798, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-09T01:18:09.753 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 3648, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 26, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 4, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 3648, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3648, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 35.234581112, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.009658602 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3648, 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 3649 2024-05-09T01:18:09.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 3648, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 3648, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 2231, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 1414, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-09T01:18:09.755 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 2, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:18:09.756 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-09T01:18:09.757 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 81, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 5, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 6, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 1, 2024-05-09T01:18:09.758 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 0, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 2, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 0 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 0, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-05-09T01:18:09.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:09.760 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 4010, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 8605694, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 4010, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 4010, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 8605694, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 3648, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 7211613, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3648, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 7211613, 2024-05-09T01:18:09.762 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:09.763 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 3648, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 3648, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3648, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3648, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:09.764 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:09.765 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x5620730608f0": { 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:09.766 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.767 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:09.767 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-09T01:18:10.465 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-09T01:18:10.466 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-09T01:18:10.466 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-09T01:18:10.466 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-09T01:18:10.466 DEBUG:tasks.check_counter:Getting stats from i 2024-05-09T01:18:10.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-09T01:18:10.708 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T01:18:10.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:10 smithi037 ceph-mon[30122]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-09T01:18:10.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:10 smithi151 ceph-mon[34780]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-09T01:18:10.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:10 smithi136 ceph-mon[34110]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-09T01:18:12.487 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-09T01:18:12.487 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2817, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 4077, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1134656, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 5159032, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 16, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.245238482, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.098133246, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.140505314, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.022319278, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4078, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.187803854, 2024-05-09T01:18:12.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000046052 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4775, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000969843, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000203 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 658912, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 1699120 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1458, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1433, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1246456, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 657475, 2024-05-09T01:18:12.489 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 12, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 7, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.129059005, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.046436635, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.045926846, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.030761257, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1430, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.074781148, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000052294 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000723, 2024-05-09T01:18:12.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000361 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 783600, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 221184 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 5419, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 5072, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 2450601, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 2749949, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 36, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.363540139, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.143215514, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.241379576, 2024-05-09T01:18:12.491 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.018810208, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5070, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.202885715, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000040016 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 8836, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001695833, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000191 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 507072 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-09T01:18:12.492 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1894, 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.742390820, 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000391969 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:12.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 828, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.032508394, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000039261 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 985, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 901, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 901, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 10.906316344, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.012104679 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 84, 2024-05-09T01:18:12.494 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 11, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 250, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 234, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 16, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 249, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 221, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 231, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 231, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 18, 2024-05-09T01:18:12.495 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 2555, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 1951, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 84, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 39, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 78, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 647, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 27, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 192, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 32, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 382, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 1202, 2024-05-09T01:18:12.496 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 1033, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 1731362092, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 1202, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 44, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 44, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 1158, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 68, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 717, 2024-05-09T01:18:12.497 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 536, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 279, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 152, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 970 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 148, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 326, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 176, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 279, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 157, 2024-05-09T01:18:12.498 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 243, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 243, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:18:12.499 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 27, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 1736, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 1736, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 3, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-09T01:18:12.500 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 3, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 7220850, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 372, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 34.229565089, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.092014959 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.501 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 255, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 678, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 423, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 37, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 190, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 153, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 250, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 714, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 464, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 231, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 643, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 412, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 128252, 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223632 2024-05-09T01:18:12.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 1702, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 985, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 29, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 518, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 246, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.356635756, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001449738 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.008987668, 2024-05-09T01:18:12.503 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.004493834 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 251, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 9.861209343, 2024-05-09T01:18:12.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.039287686 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.505 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.506 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-09T01:18:12.507 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.507 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.507 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.507 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-09T01:18:12.507 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-09T01:18:12.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 154, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.068113445, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000442295 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001465026, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000488342 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 216, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.557468343, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002580871 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-09T01:18:12.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.510 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.511 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.512 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 29, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.052436763, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001808164 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.513 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 2, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 1, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-09T01:18:12.514 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 60, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 60, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 980, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:18:12.515 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:18:12.516 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 308083, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 356, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 264, 2024-05-09T01:18:12.517 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 3, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7336, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 154, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 897721, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 7849, 2024-05-09T01:18:12.518 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 2358, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 3131705, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 30, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 2358, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2358, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 71.890131548, 2024-05-09T01:18:12.519 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.030487757 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2358, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 2562 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 2358, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 1299, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 1059, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 97, 2024-05-09T01:18:12.520 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 470, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 142, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 255, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 1202, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-09T01:18:12.521 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-09T01:18:12.522 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 81, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-05-09T01:18:12.523 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 282, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 0, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 84 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-09T01:18:12.524 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 6, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 6, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 243, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 243, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 9690, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 3848033, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:12.525 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 9690, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 9690, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3848033, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:12.526 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 2358, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 3156248, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 2358, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3156248, 2024-05-09T01:18:12.527 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 2358, 2024-05-09T01:18:12.528 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 2358, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 2358, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 2358, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 243, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 24543, 2024-05-09T01:18:12.529 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 243, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 98, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 24543, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x559570634680": { 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:12.530 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 1736, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 3026546, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 1736, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 372, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3026546, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.531 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:12.532 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-09T01:18:12.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:12 smithi136 ceph-mon[34110]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-05-09T01:18:12.897 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:12 smithi151 ceph-mon[34780]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-05-09T01:18:12.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:12 smithi037 ceph-mon[30122]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-05-09T01:18:13.422 INFO:tasks.check_counter:Daemon mds.i mds.exported=27 2024-05-09T01:18:13.423 INFO:tasks.check_counter:Daemon mds.i mds.imported=32 2024-05-09T01:18:13.423 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=148 2024-05-09T01:18:13.423 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=326 2024-05-09T01:18:13.423 DEBUG:tasks.check_counter:Getting stats from l 2024-05-09T01:18:13.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-09T01:18:13.666 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T01:18:14.834 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:14 smithi151 ceph-mon[34780]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-09T01:18:14.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:14 smithi136 ceph-mon[34110]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-09T01:18:14.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:14 smithi037 ceph-mon[30122]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 371, 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 337, 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 761106, 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 204116, 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 6, 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 1, 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.050024875, 2024-05-09T01:18:15.465 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.017529224, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.024713424, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.007653048, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 337, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.020864379, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000061912 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 760272, 2024-05-09T01:18:15.466 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 203792 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1048, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1296, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 257744, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 837943, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 5, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.102403338, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.031988227, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.023077806, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.037046309, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1294, 2024-05-09T01:18:15.467 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.052055027, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000040227 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 504992 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2468, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2471, 2024-05-09T01:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 3753235, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 784959, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.230069297, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.062974318, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.064987080, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.084156349, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2469, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.113001405, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000045768 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-09T01:18:15.469 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:15.470 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5888, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.166102119, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000028210 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 0, 2024-05-09T01:18:15.471 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 478, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-05-09T01:18:15.472 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 478, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 478, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 7, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-05-09T01:18:15.473 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T01:18:15.474 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 0, 2024-05-09T01:18:15.475 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 0 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-09T01:18:15.476 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.477 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 1736, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 3, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-09T01:18:15.478 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 7220850, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 7219712, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 1736 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 238, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 671, 2024-05-09T01:18:15.479 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 433, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 16, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 55, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 39, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 478, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 704, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 226, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 0, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 0, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 121200, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 215440 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-09T01:18:15.480 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 0, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 0, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 0, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.481 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-09T01:18:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.485 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-09T01:18:15.486 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.487 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 2, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 1, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-05-09T01:18:15.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 2412, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T01:18:15.493 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T01:18:15.494 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-09T01:18:15.495 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 198720, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 283, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7336, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 154, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-09T01:18:15.496 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 899202, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 7093, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 3516, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 21, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 3, 2024-05-09T01:18:15.497 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 3516, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3516, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 31.808621942, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.009046820 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3516, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 3517 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 3516, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 3516, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 0, 2024-05-09T01:18:15.498 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 2172, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 1342, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-09T01:18:15.499 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 1, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-09T01:18:15.500 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 81, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-09T01:18:15.501 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 5, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 6, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 1, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 0, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 2, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 0 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 0, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-09T01:18:15.502 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 0, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 0, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 0, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:15.503 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 3883, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 4400892, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 3883, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3883, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 4400892, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.504 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 3516, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 3026551, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3516, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3026551, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.505 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 3516, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 3516, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3516, 2024-05-09T01:18:15.506 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3516, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:15.507 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x558bf3c82410": { 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-09T01:18:15.508 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-09T01:18:15.509 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-09T01:18:16.255 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-09T01:18:16.255 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-09T01:18:16.255 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-05-09T01:18:16.255 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-05-09T01:18:16.256 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T01:18:16.269 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T01:18:16.270 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T01:18:16.270 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T01:18:16.292 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-09T01:18:16.292 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T01:18:16.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-09T01:18:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:16.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:16 smithi037 ceph-mon[30122]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-05-09T01:18:16.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:16 smithi136 ceph-mon[34110]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-05-09T01:18:16.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:16 smithi151 ceph-mon[34780]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.7 KiB/s wr, 11 op/s 2024-05-09T01:18:18.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.416+0000 7fa1c00f4700 1 -- 172.21.15.37:0/48755675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b81030e0 msgr2=0x7fa1b8111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.416+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/48755675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b81030e0 0x7fa1b8111170 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa1b0009990 tx=0x7fa1b0009ca0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 -- 172.21.15.37:0/48755675 shutdown_connections 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/48755675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b81030e0 0x7fa1b8111170 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/48755675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b8109300 0x7fa1b8109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/48755675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1b8102790 0x7fa1b8102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 -- 172.21.15.37:0/48755675 >> 172.21.15.37:0/48755675 conn(0x7fa1b80fe4e0 msgr2=0x7fa1b8100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 -- 172.21.15.37:0/48755675 shutdown_connections 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 -- 172.21.15.37:0/48755675 wait complete. 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.417+0000 7fa1c00f4700 1 Processor -- start 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1c00f4700 1 -- start start 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1c00f4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b8102790 0x7fa1b819ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1c00f4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1b81030e0 0x7fa1b819b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1c00f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8109300 0x7fa1b819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:18.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1c00f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b81145a0 con 0x7fa1b8109300 2024-05-09T01:18:18.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1c00f4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b8114420 con 0x7fa1b8102790 2024-05-09T01:18:18.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1c00f4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b8114720 con 0x7fa1b81030e0 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1be691700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8109300 0x7fa1b819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1be691700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8109300 0x7fa1b819f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60180/0 (socket says 172.21.15.37:60180) 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1be691700 1 -- 172.21.15.37:0/1759163286 learned_addr learned my addr 172.21.15.37:0/1759163286 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1bde90700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b8102790 0x7fa1b819ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.418+0000 7fa1bd68f700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1b81030e0 0x7fa1b819b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1be691700 1 -- 172.21.15.37:0/1759163286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1b81030e0 msgr2=0x7fa1b819b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1be691700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1b81030e0 0x7fa1b819b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1be691700 1 -- 172.21.15.37:0/1759163286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b8102790 msgr2=0x7fa1b819ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1be691700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b8102790 0x7fa1b819ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1be691700 1 -- 172.21.15.37:0/1759163286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b819fd60 con 0x7fa1b8109300 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1be691700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8109300 0x7fa1b819f6c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00057c0 tx=0x7fa1b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1aeffd700 1 -- 172.21.15.37:0/1759163286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0027070 con 0x7fa1b8109300 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b819fff0 con 0x7fa1b8109300 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1aeffd700 1 -- 172.21.15.37:0/1759163286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1b0003f20 con 0x7fa1b8109300 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1aeffd700 1 -- 172.21.15.37:0/1759163286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0022c50 con 0x7fa1b8109300 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.419+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b81a04d0 con 0x7fa1b8109300 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.420+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b819c1f0 con 0x7fa1b8109300 2024-05-09T01:18:18.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.422+0000 7fa1aeffd700 1 -- 172.21.15.37:0/1759163286 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa1b002a070 con 0x7fa1b8109300 2024-05-09T01:18:18.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.423+0000 7fa1aeffd700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1a40b2880 0x7fa1a40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:18.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.423+0000 7fa1aeffd700 1 -- 172.21.15.37:0/1759163286 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa1b00e3910 con 0x7fa1b8109300 2024-05-09T01:18:18.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.423+0000 7fa1bde90700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1a40b2880 0x7fa1a40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:18.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.424+0000 7fa1bde90700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1a40b2880 0x7fa1a40b4d90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009550 tx=0x7fa1b40091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:18.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.427+0000 7fa1aeffd700 1 -- 172.21.15.37:0/1759163286 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa1b0013070 con 0x7fa1b8109300 2024-05-09T01:18:18.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.660+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa1b802e710 con 0x7fa1b8109300 2024-05-09T01:18:18.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.661+0000 7fa1aeffd700 1 -- 172.21.15.37:0/1759163286 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v81) ==== 81+0+589 (secure 0 0 0) 0x7fa1b00ab6c0 con 0x7fa1b8109300 2024-05-09T01:18:18.659 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1655313927 2024-05-10T00:51:18.788676+0000 2024-05-09T01:18:18.659 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1149890534 2024-05-10T00:51:18.788676+0000 2024-05-09T01:18:18.659 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1416845590 2024-05-10T00:50:51.377266+0000 2024-05-09T01:18:18.659 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1512065281 2024-05-10T00:51:18.788676+0000 2024-05-09T01:18:18.660 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1416845590 2024-05-10T00:50:51.377266+0000 2024-05-09T01:18:18.660 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/722560957 2024-05-10T00:50:51.377266+0000 2024-05-09T01:18:18.660 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/613766853 2024-05-10T00:50:51.377266+0000 2024-05-09T01:18:18.660 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/791077362 2024-05-10T00:51:18.788676+0000 2024-05-09T01:18:18.660 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1512065281 2024-05-10T00:51:18.788676+0000 2024-05-09T01:18:18.660 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2410271980 2024-05-10T00:50:51.377266+0000 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1a40b2880 msgr2=0x7fa1a40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1a40b2880 0x7fa1a40b4d90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4009550 tx=0x7fa1b40091b0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8109300 msgr2=0x7fa1b819f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8109300 0x7fa1b819f6c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00057c0 tx=0x7fa1b00057f0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 shutdown_connections 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa1a40b2880 0x7fa1a40b4d90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1b8109300 0x7fa1b819f6c0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1b8102790 0x7fa1b819ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 --2- 172.21.15.37:0/1759163286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1b81030e0 0x7fa1b819b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:18.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 >> 172.21.15.37:0/1759163286 conn(0x7fa1b80fe4e0 msgr2=0x7fa1b8106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:18.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 shutdown_connections 2024-05-09T01:18:18.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:18.663+0000 7fa1c00f4700 1 -- 172.21.15.37:0/1759163286 wait complete. 2024-05-09T01:18:18.663 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-05-09T01:18:18.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:18 smithi037 ceph-mon[30122]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-05-09T01:18:18.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:18 smithi151 ceph-mon[34780]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-05-09T01:18:18.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:18 smithi136 ceph-mon[34110]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-05-09T01:18:19.413 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T01:18:19.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:18:19.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /tmp/cephfs 2024-05-09T01:18:19.723 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:18:19.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:18:19.724 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-05-09T01:18:19.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:19 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1759163286' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T01:18:19.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:18:19.778 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-09T01:18:19.834 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-05-09T01:18:19.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:18:19.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-05-09T01:18:19.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:19 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1759163286' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T01:18:19.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T01:18:19.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-09T01:18:19.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:19 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1759163286' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T01:18:20.027 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-09T01:18:20.039 INFO:tasks.cephadm:Teardown begin 2024-05-09T01:18:20.039 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T01:18:20.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:18:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:20.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:20 smithi037 ceph-mon[30122]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T01:18:20.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:20 smithi136 ceph-mon[34110]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T01:18:20.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:20 smithi151 ceph-mon[34780]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T01:18:22.575 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:22 smithi037 ceph-mon[30122]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 -- 172.21.15.37:0/4285513125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414107e30 msgr2=0x7f6414108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 --2- 172.21.15.37:0/4285513125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414107e30 0x7f6414108240 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0099c0 tx=0x7f63fc009cd0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 -- 172.21.15.37:0/4285513125 shutdown_connections 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 --2- 172.21.15.37:0/4285513125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6414108780 0x7f64141100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 --2- 172.21.15.37:0/4285513125 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6414103550 0x7f6414103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 --2- 172.21.15.37:0/4285513125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414107e30 0x7f6414108240 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 -- 172.21.15.37:0/4285513125 >> 172.21.15.37:0/4285513125 conn(0x7f6414078e00 msgr2=0x7f6414079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 -- 172.21.15.37:0/4285513125 shutdown_connections 2024-05-09T01:18:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.694+0000 7f6418b24700 1 -- 172.21.15.37:0/4285513125 wait complete. 2024-05-09T01:18:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.695+0000 7f6418b24700 1 Processor -- start 2024-05-09T01:18:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.695+0000 7f6418b24700 1 -- start start 2024-05-09T01:18:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6418b24700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414103550 0x7f6414106a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6418b24700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6414107e30 0x7f6414104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6418b24700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6414108780 0x7f64141054b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6418b24700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6414113390 con 0x7f6414103550 2024-05-09T01:18:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6418b24700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6414113210 con 0x7f6414107e30 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6418b24700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6414113510 con 0x7f6414108780 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414103550 0x7f6414106a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414103550 0x7f6414106a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43854/0 (socket says 172.21.15.37:43854) 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 -- 172.21.15.37:0/3262897051 learned_addr learned my addr 172.21.15.37:0/3262897051 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6409d9b700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6414107e30 0x7f6414104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6412d9d700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6414108780 0x7f64141054b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 -- 172.21.15.37:0/3262897051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6414108780 msgr2=0x7f64141054b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6414108780 0x7f64141054b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 -- 172.21.15.37:0/3262897051 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6414107e30 msgr2=0x7f6414104ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6414107e30 0x7f6414104ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 -- 172.21.15.37:0/3262897051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6414105ce0 con 0x7f6414103550 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6412d9d700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6414108780 0x7f64141054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f641259c700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414103550 0x7f6414106a70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f640400c920 tx=0x7f640400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f640bfff700 1 -- 172.21.15.37:0/3262897051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404007b00 con 0x7f6414103550 2024-05-09T01:18:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.696+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64141ad920 con 0x7f6414103550 2024-05-09T01:18:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.697+0000 7f640bfff700 1 -- 172.21.15.37:0/3262897051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6404004ce0 con 0x7f6414103550 2024-05-09T01:18:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.697+0000 7f640bfff700 1 -- 172.21.15.37:0/3262897051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404005500 con 0x7f6414103550 2024-05-09T01:18:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.697+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64141ade80 con 0x7f6414103550 2024-05-09T01:18:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.698+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64141049b0 con 0x7f6414103550 2024-05-09T01:18:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.699+0000 7f640bfff700 1 -- 172.21.15.37:0/3262897051 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6404007ca0 con 0x7f6414103550 2024-05-09T01:18:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.700+0000 7f640bfff700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64000b2880 0x7f64000b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.700+0000 7f6409d9b700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64000b2880 0x7f64000b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.700+0000 7f640bfff700 1 -- 172.21.15.37:0/3262897051 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f64040e20f0 con 0x7f6414103550 2024-05-09T01:18:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.700+0000 7f6409d9b700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64000b2880 0x7f64000b4d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f63fc006010 tx=0x7f63fc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.703+0000 7f640bfff700 1 -- 172.21.15.37:0/3262897051 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6404014030 con 0x7f6414103550 2024-05-09T01:18:22.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:22 smithi136 ceph-mon[34110]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-05-09T01:18:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.965+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6414106400 con 0x7f6414103550 2024-05-09T01:18:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.966+0000 7f640bfff700 1 -- 172.21.15.37:0/3262897051 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11947 (secure 0 0 0) 0x7f64040a9eb0 con 0x7f6414103550 2024-05-09T01:18:22.966 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:18:22.966 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:17:57.469072+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:18:22.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.968+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64000b2880 msgr2=0x7f64000b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:22.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.968+0000 7f6418b24700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64000b2880 0x7f64000b4d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f63fc006010 tx=0x7f63fc000bc0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.968+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414103550 msgr2=0x7f6414106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:22.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.968+0000 7f6418b24700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414103550 0x7f6414106a70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f640400c920 tx=0x7f640400cc30 comp rx=0 tx=0).stop 2024-05-09T01:18:22.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 shutdown_connections 2024-05-09T01:18:22.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f64000b2880 0x7f64000b4d90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6414108780 0x7f64141054b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6414103550 0x7f6414106a70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 --2- 172.21.15.37:0/3262897051 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6414107e30 0x7f6414104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 >> 172.21.15.37:0/3262897051 conn(0x7f6414078e00 msgr2=0x7f6414075d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 shutdown_connections 2024-05-09T01:18:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:22.969+0000 7f6418b24700 1 -- 172.21.15.37:0/3262897051 wait complete. 2024-05-09T01:18:22.969 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-05-09T01:18:22.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:22 smithi151 ceph-mon[34780]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.3 KiB/s wr, 12 op/s 2024-05-09T01:18:23.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:23 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3262897051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:18:23.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T01:18:23.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:23 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3262897051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:18:23.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:23 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3262897051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:18:24.033 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:24.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:24 smithi037 ceph-mon[30122]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2024-05-09T01:18:24.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:24 smithi136 ceph-mon[34110]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2024-05-09T01:18:24.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:24 smithi151 ceph-mon[34780]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 15 op/s 2024-05-09T01:18:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 -- 172.21.15.37:0/642734399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8108760 msgr2=0x7f50f81100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 --2- 172.21.15.37:0/642734399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8108760 0x7f50f81100c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f50f000b0d0 tx=0x7f50f000b3e0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 -- 172.21.15.37:0/642734399 shutdown_connections 2024-05-09T01:18:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 --2- 172.21.15.37:0/642734399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8108760 0x7f50f81100c0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 --2- 172.21.15.37:0/642734399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f81034e0 0x7f50f81038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 --2- 172.21.15.37:0/642734399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50f8107e10 0x7f50f8108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 -- 172.21.15.37:0/642734399 >> 172.21.15.37:0/642734399 conn(0x7f50f80fef30 msgr2=0x7f50f8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 -- 172.21.15.37:0/642734399 shutdown_connections 2024-05-09T01:18:26.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 -- 172.21.15.37:0/642734399 wait complete. 2024-05-09T01:18:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 Processor -- start 2024-05-09T01:18:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.094+0000 7f50fe59b700 1 -- start start 2024-05-09T01:18:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fe59b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f81034e0 0x7f50f80ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fe59b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8107e10 0x7f50f80ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fe59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50f8108760 0x7f50f80ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fe59b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50f81133b0 con 0x7f50f8107e10 2024-05-09T01:18:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fe59b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f50f8113230 con 0x7f50f81034e0 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fe59b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f50f8113530 con 0x7f50f8108760 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8107e10 0x7f50f80ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8107e10 0x7f50f80ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43878/0 (socket says 172.21.15.37:43878) 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 -- 172.21.15.37:0/1759555451 learned_addr learned my addr 172.21.15.37:0/1759555451 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50f7fff700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f81034e0 0x7f50f80ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fcb38700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50f8108760 0x7f50f80ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 -- 172.21.15.37:0/1759555451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50f8108760 msgr2=0x7f50f80ffe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50f8108760 0x7f50f80ffe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 -- 172.21.15.37:0/1759555451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f81034e0 msgr2=0x7f50f80ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f81034e0 0x7f50f80ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50effff700 1 -- 172.21.15.37:0/1759555451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f81a91d0 con 0x7f50f8107e10 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.095+0000 7f50fcb38700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50f8108760 0x7f50f80ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.096+0000 7f50effff700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8107e10 0x7f50f80ff950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f50e000c970 tx=0x7f50e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.096+0000 7f50f5ffb700 1 -- 172.21.15.37:0/1759555451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e000ce60 con 0x7f50f8107e10 2024-05-09T01:18:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.096+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f81a94c0 con 0x7f50f8107e10 2024-05-09T01:18:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.096+0000 7f50f5ffb700 1 -- 172.21.15.37:0/1759555451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50e0004830 con 0x7f50f8107e10 2024-05-09T01:18:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.096+0000 7f50f5ffb700 1 -- 172.21.15.37:0/1759555451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0005530 con 0x7f50f8107e10 2024-05-09T01:18:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.096+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f81a99b0 con 0x7f50f8107e10 2024-05-09T01:18:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.097+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f80512c0 con 0x7f50f8107e10 2024-05-09T01:18:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.099+0000 7f50f5ffb700 1 -- 172.21.15.37:0/1759555451 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f50e00049e0 con 0x7f50f8107e10 2024-05-09T01:18:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.100+0000 7f50f5ffb700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50e40b2880 0x7f50e40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.100+0000 7f50f7fff700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50e40b2880 0x7f50e40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.100+0000 7f50f5ffb700 1 -- 172.21.15.37:0/1759555451 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7f50e00e20f0 con 0x7f50f8107e10 2024-05-09T01:18:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.100+0000 7f50f7fff700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50e40b2880 0x7f50e40b4d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f50e8005950 tx=0x7f50e800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.104+0000 7f50f5ffb700 1 -- 172.21.15.37:0/1759555451 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f50e0014030 con 0x7f50f8107e10 2024-05-09T01:18:26.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.364+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50f802e5f0 con 0x7f50f8107e10 2024-05-09T01:18:26.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.365+0000 7f50f5ffb700 1 -- 172.21.15.37:0/1759555451 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11947 (secure 0 0 0) 0x7f50e00a9eb0 con 0x7f50f8107e10 2024-05-09T01:18:26.365 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:18:26.365 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2528930406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2528930406},{"type":"v1","addr":"172.21.15.37:6835","nonce":2528930406}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/1940552634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":1940552634},{"type":"v1","addr":"172.21.15.37:6837","nonce":1940552634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:58:39.582936+0000","modified":"2024-05-09T01:17:57.469072+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24491,"mds_1":24467,"mds_2":24454,"mds_3":24446,"mds_4":24445},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14547":{"gid":14547,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/752211904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":752211904},{"type":"v1","addr":"172.21.15.37:6839","nonce":752211904}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14559":{"gid":14559,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/828379246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":828379246},{"type":"v1","addr":"172.21.15.37:6841","nonce":828379246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24400":{"gid":24400,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/1277029223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1277029223},{"type":"v1","addr":"172.21.15.151:6833","nonce":1277029223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6833/3863179212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":3863179212},{"type":"v1","addr":"172.21.15.136:6833","nonce":3863179212}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24439":{"gid":24439,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/1211505643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1211505643},{"type":"v1","addr":"172.21.15.151:6835","nonce":1211505643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"c","rank":4,"incarnation":25,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6837/980204664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":980204664},{"type":"v1","addr":"172.21.15.151:6837","nonce":980204664}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":15,"addr":"172.21.15.136:6835/3966539810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":3966539810},{"type":"v1","addr":"172.21.15.136:6835","nonce":3966539810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.151:6839/1727507509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":1727507509},{"type":"v1","addr":"172.21.15.151:6839","nonce":1727507509}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":13,"addr":"172.21.15.136:6837/2054090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2054090484},{"type":"v1","addr":"172.21.15.136:6837","nonce":2054090484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24491":{"gid":24491,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.136:6839/336490852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":336490852},{"type":"v1","addr":"172.21.15.136:6839","nonce":336490852}]},"join_fscid":-1,"export_targets":[2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24491,"qdb_cluster":[24467,24446,24445,24454,24491]},"id":1}]} 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50e40b2880 msgr2=0x7f50e40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50e40b2880 0x7f50e40b4d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f50e8005950 tx=0x7f50e800a300 comp rx=0 tx=0).stop 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8107e10 msgr2=0x7f50f80ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8107e10 0x7f50f80ff950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f50e000c970 tx=0x7f50e000cc80 comp rx=0 tx=0).stop 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 shutdown_connections 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f50e40b2880 0x7f50e40b4d90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50f8108760 0x7f50f80ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f81034e0 0x7f50f80ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 --2- 172.21.15.37:0/1759555451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f8107e10 0x7f50f80ff950 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.367+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 >> 172.21.15.37:0/1759555451 conn(0x7f50f80fef30 msgr2=0x7f50f806c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.368+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 shutdown_connections 2024-05-09T01:18:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:26.368+0000 7f50fe59b700 1 -- 172.21.15.37:0/1759555451 wait complete. 2024-05-09T01:18:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-05-09T01:18:26.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:26 smithi037 ceph-mon[30122]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-05-09T01:18:26.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:26 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1759555451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:18:26.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:26 smithi136 ceph-mon[34110]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-05-09T01:18:26.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:26 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1759555451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:18:26.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:26 smithi151 ceph-mon[34780]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-05-09T01:18:26.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:26 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1759555451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T01:18:27.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T01:18:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:28.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:28 smithi037 ceph-mon[30122]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-05-09T01:18:28.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:28 smithi136 ceph-mon[34110]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-05-09T01:18:28.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:28 smithi151 ceph-mon[34780]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 -- 172.21.15.37:0/2949321342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01089f0 msgr2=0x7fa9a0108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 --2- 172.21.15.37:0/2949321342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01089f0 0x7fa9a0108e00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa990009990 tx=0x7fa990009ca0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 -- 172.21.15.37:0/2949321342 shutdown_connections 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 --2- 172.21.15.37:0/2949321342 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9a0103310 0x7fa9a010f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 --2- 172.21.15.37:0/2949321342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01089f0 0x7fa9a0108e00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 --2- 172.21.15.37:0/2949321342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9a01029c0 0x7fa9a0102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 -- 172.21.15.37:0/2949321342 >> 172.21.15.37:0/2949321342 conn(0x7fa9a00fe4e0 msgr2=0x7fa9a0100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 -- 172.21.15.37:0/2949321342 shutdown_connections 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.058+0000 7fa9a660c700 1 -- 172.21.15.37:0/2949321342 wait complete. 2024-05-09T01:18:29.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.059+0000 7fa9a660c700 1 Processor -- start 2024-05-09T01:18:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.059+0000 7fa9a660c700 1 -- start start 2024-05-09T01:18:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa9a660c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01029c0 0x7fa9a019afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa9a660c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9a0103310 0x7fa9a019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa9a660c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9a01089f0 0x7fa9a019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa9a660c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a0112bf0 con 0x7fa9a01029c0 2024-05-09T01:18:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa9a660c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a0112a70 con 0x7fa9a0103310 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa9a660c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a0112d70 con 0x7fa9a01089f0 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01029c0 0x7fa9a019afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa99ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01029c0 0x7fa9a019afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43898/0 (socket says 172.21.15.37:43898) 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa99ffff700 1 -- 172.21.15.37:0/3364976408 learned_addr learned my addr 172.21.15.37:0/3364976408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa9a4ba9700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9a01089f0 0x7fa9a019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.060+0000 7fa99f7fe700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9a0103310 0x7fa9a019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99ffff700 1 -- 172.21.15.37:0/3364976408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9a01089f0 msgr2=0x7fa9a019f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99ffff700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9a01089f0 0x7fa9a019f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99ffff700 1 -- 172.21.15.37:0/3364976408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9a0103310 msgr2=0x7fa9a019b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99ffff700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9a0103310 0x7fa9a019b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99ffff700 1 -- 172.21.15.37:0/3364976408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a019fe90 con 0x7fa9a01029c0 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99f7fe700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9a0103310 0x7fa9a019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:18:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99ffff700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01029c0 0x7fa9a019afc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa990000c00 tx=0x7fa990009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99d7fa700 1 -- 172.21.15.37:0/3364976408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990027070 con 0x7fa9a01029c0 2024-05-09T01:18:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99d7fa700 1 -- 172.21.15.37:0/3364976408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa990003fb0 con 0x7fa9a01029c0 2024-05-09T01:18:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a01a0120 con 0x7fa9a01029c0 2024-05-09T01:18:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa99d7fa700 1 -- 172.21.15.37:0/3364976408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990022cb0 con 0x7fa9a01029c0 2024-05-09T01:18:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.061+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a01a7aa0 con 0x7fa9a01029c0 2024-05-09T01:18:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.063+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a0104100 con 0x7fa9a01029c0 2024-05-09T01:18:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.064+0000 7fa99d7fa700 1 -- 172.21.15.37:0/3364976408 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa99002a070 con 0x7fa9a01029c0 2024-05-09T01:18:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.065+0000 7fa99d7fa700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9880b2900 0x7fa9880b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.065+0000 7fa99f7fe700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9880b2900 0x7fa9880b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.065+0000 7fa99d7fa700 1 -- 172.21.15.37:0/3364976408 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fa9900e35a0 con 0x7fa9a01029c0 2024-05-09T01:18:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.065+0000 7fa99f7fe700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9880b2900 0x7fa9880b4e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0101320 tx=0x7fa994008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:29.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.068+0000 7fa99d7fa700 1 -- 172.21.15.37:0/3364976408 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa990031080 con 0x7fa9a01029c0 2024-05-09T01:18:29.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.282+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9a019c320 con 0x7fa9a01029c0 2024-05-09T01:18:29.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.284+0000 7fa99d7fa700 1 -- 172.21.15.37:0/3364976408 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22534 (secure 0 0 0) 0x7fa990013070 con 0x7fa9a01029c0 2024-05-09T01:18:29.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-09T01:18:29.284 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"ec4482a6-0d9d-11ef-bc97-c7b262605968","created":"2024-05-09T00:50:23.248208+0000","modified":"2024-05-09T00:59:20.069520+0000","last_up_change":"2024-05-09T00:57:30.997880+0000","last_in_change":"2024-05-09T00:57:10.677363+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T00:53:46.888552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:58:33.187247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:58:36.068427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"25eb0fa7-a2db-4c82-a630-8f9cdbd0a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6803","nonce":3555372504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6805","nonce":3555372504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6809","nonce":3555372504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3555372504},{"type":"v1","addr":"172.21.15.37:6807","nonce":3555372504}]},"public_addr":"172.21.15.37:6803/3555372504","cluster_addr":"172.21.15.37:6805/3555372504","heartbeat_back_addr":"172.21.15.37:6809/3555372504","heartbeat_front_addr":"172.21.15.37:6807/3555372504","state":["exists","up"]},{"osd":1,"uuid":"95653797-b846-453e-8884-1f30a924c060","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6801","nonce":368492738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6803","nonce":368492738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6807","nonce":368492738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":368492738},{"type":"v1","addr":"172.21.15.136:6805","nonce":368492738}]},"public_addr":"172.21.15.136:6801/368492738","cluster_addr":"172.21.15.136:6803/368492738","heartbeat_back_addr":"172.21.15.136:6807/368492738","heartbeat_front_addr":"172.21.15.136:6805/368492738","state":["exists","up"]},{"osd":2,"uuid":"39dfb29d-97a5-43c3-b38c-72d80c4f6a3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6801","nonce":373949032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6803","nonce":373949032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6807","nonce":373949032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":373949032},{"type":"v1","addr":"172.21.15.151:6805","nonce":373949032}]},"public_addr":"172.21.15.151:6801/373949032","cluster_addr":"172.21.15.151:6803/373949032","heartbeat_back_addr":"172.21.15.151:6807/373949032","heartbeat_front_addr":"172.21.15.151:6805/373949032","state":["exists","up"]},{"osd":3,"uuid":"9b9c00e5-3ca7-4e87-9977-a03a58a8d469","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6811","nonce":1053835571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6813","nonce":1053835571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6817","nonce":1053835571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":1053835571},{"type":"v1","addr":"172.21.15.37:6815","nonce":1053835571}]},"public_addr":"172.21.15.37:6811/1053835571","cluster_addr":"172.21.15.37:6813/1053835571","heartbeat_back_addr":"172.21.15.37:6817/1053835571","heartbeat_front_addr":"172.21.15.37:6815/1053835571","state":["exists","up"]},{"osd":4,"uuid":"4e49af9f-a958-439e-8a9a-a1e4a4f0417b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6809","nonce":4131324959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6811","nonce":4131324959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6815","nonce":4131324959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":4131324959},{"type":"v1","addr":"172.21.15.136:6813","nonce":4131324959}]},"public_addr":"172.21.15.136:6809/4131324959","cluster_addr":"172.21.15.136:6811/4131324959","heartbeat_back_addr":"172.21.15.136:6815/4131324959","heartbeat_front_addr":"172.21.15.136:6813/4131324959","state":["exists","up"]},{"osd":5,"uuid":"dc7ae8e6-3f9e-49a9-aefe-c18ef96d4d8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6809","nonce":1854577417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6811","nonce":1854577417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6815","nonce":1854577417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1854577417},{"type":"v1","addr":"172.21.15.151:6813","nonce":1854577417}]},"public_addr":"172.21.15.151:6809/1854577417","cluster_addr":"172.21.15.151:6811/1854577417","heartbeat_back_addr":"172.21.15.151:6815/1854577417","heartbeat_front_addr":"172.21.15.151:6813/1854577417","state":["exists","up"]},{"osd":6,"uuid":"658cbbc1-8426-41a3-81f2-604aad93fc5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6819","nonce":545144898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6821","nonce":545144898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6825","nonce":545144898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":545144898},{"type":"v1","addr":"172.21.15.37:6823","nonce":545144898}]},"public_addr":"172.21.15.37:6819/545144898","cluster_addr":"172.21.15.37:6821/545144898","heartbeat_back_addr":"172.21.15.37:6825/545144898","heartbeat_front_addr":"172.21.15.37:6823/545144898","state":["exists","up"]},{"osd":7,"uuid":"a968a66d-5c3c-45eb-ba5b-40014fd1e831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6817","nonce":3759016475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6819","nonce":3759016475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6823","nonce":3759016475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3759016475},{"type":"v1","addr":"172.21.15.136:6821","nonce":3759016475}]},"public_addr":"172.21.15.136:6817/3759016475","cluster_addr":"172.21.15.136:6819/3759016475","heartbeat_back_addr":"172.21.15.136:6823/3759016475","heartbeat_front_addr":"172.21.15.136:6821/3759016475","state":["exists","up"]},{"osd":8,"uuid":"4beeb243-ed25-40a3-9aac-04a7d79e74d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6817","nonce":4201522027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6819","nonce":4201522027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6823","nonce":4201522027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4201522027},{"type":"v1","addr":"172.21.15.151:6821","nonce":4201522027}]},"public_addr":"172.21.15.151:6817/4201522027","cluster_addr":"172.21.15.151:6819/4201522027","heartbeat_back_addr":"172.21.15.151:6823/4201522027","heartbeat_front_addr":"172.21.15.151:6821/4201522027","state":["exists","up"]},{"osd":9,"uuid":"6b819cc6-32b0-4abb-80a3-cd74996b94ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6827","nonce":479009325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6829","nonce":479009325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6833","nonce":479009325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":479009325},{"type":"v1","addr":"172.21.15.37:6831","nonce":479009325}]},"public_addr":"172.21.15.37:6827/479009325","cluster_addr":"172.21.15.37:6829/479009325","heartbeat_back_addr":"172.21.15.37:6833/479009325","heartbeat_front_addr":"172.21.15.37:6831/479009325","state":["exists","up"]},{"osd":10,"uuid":"38839342-1039-4594-aa73-8ed002d99e65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6825","nonce":2664303650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6827","nonce":2664303650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6831","nonce":2664303650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2664303650},{"type":"v1","addr":"172.21.15.136:6829","nonce":2664303650}]},"public_addr":"172.21.15.136:6825/2664303650","cluster_addr":"172.21.15.136:6827/2664303650","heartbeat_back_addr":"172.21.15.136:6831/2664303650","heartbeat_front_addr":"172.21.15.136:6829/2664303650","state":["exists","up"]},{"osd":11,"uuid":"b9b7c282-e2d0-40fb-bd30-7ac42adf5dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6825","nonce":443816849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6827","nonce":443816849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6831","nonce":443816849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":443816849},{"type":"v1","addr":"172.21.15.151:6829","nonce":443816849}]},"public_addr":"172.21.15.151:6825/443816849","cluster_addr":"172.21.15.151:6827/443816849","heartbeat_back_addr":"172.21.15.151:6831/443816849","heartbeat_front_addr":"172.21.15.151:6829/443816849","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:52:54.707705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:18.796352+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:53:42.548836+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:07.239467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:31.806895+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:54:56.499832+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:22.155463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:55:47.436835+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:12.113628+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:56:38.437191+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:03.504310+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:57:28.816963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/1655313927":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/1149890534":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:6800/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6800/1416845590":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/722560957":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/613766853":"2024-05-10T00:50:51.377266+0000","172.21.15.37:0/791077362":"2024-05-10T00:51:18.788676+0000","172.21.15.37:6801/1512065281":"2024-05-10T00:51:18.788676+0000","172.21.15.37:0/2410271980":"2024-05-10T00:50:51.377266+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T01:18:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9880b2900 msgr2=0x7fa9880b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9880b2900 0x7fa9880b4e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0101320 tx=0x7fa994008040 comp rx=0 tx=0).stop 2024-05-09T01:18:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01029c0 msgr2=0x7fa9a019afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01029c0 0x7fa9a019afc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa990000c00 tx=0x7fa990009f50 comp rx=0 tx=0).stop 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 shutdown_connections 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fa9880b2900 0x7fa9880b4e10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9a01089f0 0x7fa9a019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a01029c0 0x7fa9a019afc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 --2- 172.21.15.37:0/3364976408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9a0103310 0x7fa9a019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 >> 172.21.15.37:0/3364976408 conn(0x7fa9a00fe4e0 msgr2=0x7fa9a01066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 shutdown_connections 2024-05-09T01:18:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:29.287+0000 7fa9a660c700 1 -- 172.21.15.37:0/3364976408 wait complete. 2024-05-09T01:18:29.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:29 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3364976408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:18:29.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:29 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3364976408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:18:29.975 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:29 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3364976408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T01:18:30.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-09T01:18:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:30.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:30 smithi037 ceph-mon[30122]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-05-09T01:18:30.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:30 smithi136 ceph-mon[34110]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-05-09T01:18:30.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:30 smithi151 ceph-mon[34780]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-05-09T01:18:32.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 -- 172.21.15.37:0/1332181423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c108740 msgr2=0x7fba9c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:32.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 --2- 172.21.15.37:0/1332181423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c108740 0x7fba9c1100a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fba9400b0d0 tx=0x7fba9400b3e0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 -- 172.21.15.37:0/1332181423 shutdown_connections 2024-05-09T01:18:32.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 --2- 172.21.15.37:0/1332181423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c108740 0x7fba9c1100a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 --2- 172.21.15.37:0/1332181423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba9c1034c0 0x7fba9c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 --2- 172.21.15.37:0/1332181423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba9c107df0 0x7fba9c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 -- 172.21.15.37:0/1332181423 >> 172.21.15.37:0/1332181423 conn(0x7fba9c0fedf0 msgr2=0x7fba9c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:32.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 -- 172.21.15.37:0/1332181423 shutdown_connections 2024-05-09T01:18:32.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.046+0000 7fbaa1048700 1 -- 172.21.15.37:0/1332181423 wait complete. 2024-05-09T01:18:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.047+0000 7fbaa1048700 1 Processor -- start 2024-05-09T01:18:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.047+0000 7fbaa1048700 1 -- start start 2024-05-09T01:18:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fbaa1048700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba9c1034c0 0x7fba9c19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fbaa1048700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c107df0 0x7fba9c19c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fbaa1048700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba9c108740 0x7fba9c19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fbaa1048700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c113370 con 0x7fba9c107df0 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fbaa1048700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1131f0 con 0x7fba9c1034c0 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fbaa1048700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c1134f0 con 0x7fba9c108740 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c107df0 0x7fba9c19c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c107df0 0x7fba9c19c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56630/0 (socket says 172.21.15.37:56630) 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9a59c700 1 -- 172.21.15.37:0/30221580 learned_addr learned my addr 172.21.15.37:0/30221580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9ad9d700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba9c1034c0 0x7fba9c19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9b59e700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba9c108740 0x7fba9c19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9ad9d700 1 -- 172.21.15.37:0/30221580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba9c108740 msgr2=0x7fba9c19c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9ad9d700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba9c108740 0x7fba9c19c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9ad9d700 1 -- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c107df0 msgr2=0x7fba9c19c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9ad9d700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c107df0 0x7fba9c19c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9ad9d700 1 -- 172.21.15.37:0/30221580 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c1a6ed0 con 0x7fba9c1034c0 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9a59c700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c107df0 0x7fba9c19c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.048+0000 7fba9ad9d700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba9c1034c0 0x7fba9c19bc10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00d950 tx=0x7fba8c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.049+0000 7fba83fff700 1 -- 172.21.15.37:0/30221580 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c016070 con 0x7fba9c1034c0 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.049+0000 7fba83fff700 1 -- 172.21.15.37:0/30221580 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba8c00fd40 con 0x7fba9c1034c0 2024-05-09T01:18:32.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.049+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c1a71c0 con 0x7fba9c1034c0 2024-05-09T01:18:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.049+0000 7fba83fff700 1 -- 172.21.15.37:0/30221580 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c00e3b0 con 0x7fba9c1034c0 2024-05-09T01:18:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.049+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c1a7700 con 0x7fba9c1034c0 2024-05-09T01:18:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.050+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9c0512c0 con 0x7fba9c1034c0 2024-05-09T01:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.051+0000 7fba83fff700 1 -- 172.21.15.37:0/30221580 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fba8c019070 con 0x7fba9c1034c0 2024-05-09T01:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.052+0000 7fba83fff700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba840b2880 0x7fba840b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.052+0000 7fba9a59c700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba840b2880 0x7fba840b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.052+0000 7fba83fff700 1 -- 172.21.15.37:0/30221580 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8153+0+0 (secure 0 0 0) 0x7fba8c0e2100 con 0x7fba9c1034c0 2024-05-09T01:18:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.053+0000 7fba9a59c700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba840b2880 0x7fba840b4d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba9c1066c0 tx=0x7fba9000a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.055+0000 7fba83fff700 1 -- 172.21.15.37:0/30221580 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba8c0a9e20 con 0x7fba9c1034c0 2024-05-09T01:18:32.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.319+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fba9c02e5f0 con 0x7fba9c1034c0 2024-05-09T01:18:32.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.329+0000 7fba83fff700 1 -- 172.21.15.37:0/30221580 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7fba8c0a9720 con 0x7fba9c1034c0 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba840b2880 msgr2=0x7fba840b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba840b2880 0x7fba840b4d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fba9c1066c0 tx=0x7fba9000a400 comp rx=0 tx=0).stop 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba9c1034c0 msgr2=0x7fba9c19bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba9c1034c0 0x7fba9c19bc10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00d950 tx=0x7fba8c00dc60 comp rx=0 tx=0).stop 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 shutdown_connections 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7fba840b2880 0x7fba840b4d90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba9c108740 0x7fba9c19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba9c1034c0 0x7fba9c19bc10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 --2- 172.21.15.37:0/30221580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c107df0 0x7fba9c19c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.331+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 >> 172.21.15.37:0/30221580 conn(0x7fba9c0fedf0 msgr2=0x7fba9c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:32.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.332+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 shutdown_connections 2024-05-09T01:18:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:32.332+0000 7fbaa1048700 1 -- 172.21.15.37:0/30221580 wait complete. 2024-05-09T01:18:32.332 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T01:18:32.652 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:18:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g[69704]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.652 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:18:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g[69704]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mds[69712]: -- 172.21.15.37:0/1113330718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617762f3a40 con 0x56177633b600 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:18:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g[69704]: starting mds.g at 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a[70173]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a[70173]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mds[70177]: -- 172.21.15.37:0/3529757114 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5621b92ada40 con 0x5621b92f5180 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a[70173]: starting mds.a at 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a[30118]: 2024-05-09T01:18:32.321+0000 7f3455629700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T01:18:32.653 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-05-09T01:18:32.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/30221580' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T01:18:32.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T01:18:32.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T01:18:32.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T01:18:32.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T01:18:32.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T01:18:32.654 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:32 smithi037 ceph-mon[30122]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-09T01:18:32.723 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i[66122]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.724 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i[66122]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.724 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mds[66126]: -- 172.21.15.151:0/1208196643 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d7110a9a40 con 0x55d7110f1a80 2024-05-09T01:18:32.724 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i[66122]: starting mds.i at 2024-05-09T01:18:32.724 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l[65195]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.724 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l[65195]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.724 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mds[65199]: -- 172.21.15.151:0/2795667763 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0861e5a40 con 0x55e08622da80 2024-05-09T01:18:32.724 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l[65195]: starting mds.l at 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/30221580' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T01:18:32.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mon[34780]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c[65821]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c[65821]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mds[65825]: -- 172.21.15.151:0/3797291837 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55caffd73a40 con 0x55caffdbb180 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c[65821]: starting mds.c at 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f[65503]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f[65503]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:18:32 smithi151 ceph-mds[65508]: -- 172.21.15.151:0/1205389564 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55962dc95a40 con 0x55962dcdda80 2024-05-09T01:18:32.726 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:18:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f[65503]: starting mds.f at 2024-05-09T01:18:32.876 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e[63954]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.877 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e[63954]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.877 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mds[63958]: -- 172.21.15.136:0/4292976385 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56001c383a40 con 0x56001c3cb180 2024-05-09T01:18:32.877 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e[63954]: starting mds.e at 2024-05-09T01:18:32.877 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k[63628]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.877 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k[63628]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.877 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mds[63632]: -- 172.21.15.136:0/3938872815 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56005bc7da40 con 0x56005bcc5a80 2024-05-09T01:18:32.877 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k[63628]: starting mds.k at 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/30221580' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T01:18:32.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mon[34110]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mds[64586]: -- 172.21.15.136:0/537340418 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5579f027da40 con 0x5579f02c5180 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: starting mds.b at 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h[64278]: ignoring --setuser ceph since I am not root 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h[64278]: ignoring --setgroup ceph since I am not root 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:18:32 smithi136 ceph-mds[64282]: -- 172.21.15.136:0/1845256932 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56433b96ba40 con 0x56433b9b3a80 2024-05-09T01:18:32.879 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:18:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h[64278]: starting mds.h at 2024-05-09T01:18:33.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T01:18:33.300 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:34.467 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.37:6838/225364192,v1:172.21.15.37:6840/225364192] up:boot 2024-05-09T01:18:34.467 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.37:6839/2948080659,v1:172.21.15.37:6841/2948080659] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6833/3046183932,v1:172.21.15.136:6834/3046183932] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6832/793844291,v1:172.21.15.136:6835/793844291] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6832/2952559599,v1:172.21.15.151:6834/2952559599] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6833/1687560456,v1:172.21.15.151:6835/1687560456] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6836/2640361601,v1:172.21.15.136:6837/2640361601] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.136:6838/868631091,v1:172.21.15.136:6839/868631091] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6836/212008215,v1:172.21.15.151:6838/212008215] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: mds.? [v2:172.21.15.151:6837/2745022831,v1:172.21.15.151:6839/2745022831] up:boot 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-09T01:18:34.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T01:18:34.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:34 smithi037 ceph-mon[30122]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-09T01:18:34.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.37:6838/225364192,v1:172.21.15.37:6840/225364192] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.37:6839/2948080659,v1:172.21.15.37:6841/2948080659] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6833/3046183932,v1:172.21.15.136:6834/3046183932] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6832/793844291,v1:172.21.15.136:6835/793844291] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6832/2952559599,v1:172.21.15.151:6834/2952559599] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6833/1687560456,v1:172.21.15.151:6835/1687560456] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6836/2640361601,v1:172.21.15.136:6837/2640361601] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.136:6838/868631091,v1:172.21.15.136:6839/868631091] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6836/212008215,v1:172.21.15.151:6838/212008215] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: mds.? [v2:172.21.15.151:6837/2745022831,v1:172.21.15.151:6839/2745022831] up:boot 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T01:18:34.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T01:18:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T01:18:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T01:18:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T01:18:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T01:18:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T01:18:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T01:18:34.628 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:34 smithi136 ceph-mon[34110]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.37:6838/225364192,v1:172.21.15.37:6840/225364192] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.37:6839/2948080659,v1:172.21.15.37:6841/2948080659] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6833/3046183932,v1:172.21.15.136:6834/3046183932] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6832/793844291,v1:172.21.15.136:6835/793844291] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6832/2952559599,v1:172.21.15.151:6834/2952559599] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6833/1687560456,v1:172.21.15.151:6835/1687560456] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6836/2640361601,v1:172.21.15.136:6837/2640361601] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.136:6838/868631091,v1:172.21.15.136:6839/868631091] up:boot 2024-05-09T01:18:34.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6836/212008215,v1:172.21.15.151:6838/212008215] up:boot 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: mds.? [v2:172.21.15.151:6837/2745022831,v1:172.21.15.151:6839/2745022831] up:boot 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: from='mgr.14152 172.21.15.37:0/2173740226' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T01:18:34.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:34 smithi151 ceph-mon[34780]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-09T01:18:35.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.041+0000 7f49a49a4700 1 -- 172.21.15.37:0/1424984886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 msgr2=0x7f49a0108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:35.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.041+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1424984886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a0108200 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f49940099c0 tx=0x7f4994009cd0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.042+0000 7f49a49a4700 1 -- 172.21.15.37:0/1424984886 shutdown_connections 2024-05-09T01:18:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.042+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1424984886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a0108740 0x7f49a01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.042+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1424984886 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a01034c0 0x7f49a01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.042+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1424984886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a0108200 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.042+0000 7f49a49a4700 1 -- 172.21.15.37:0/1424984886 >> 172.21.15.37:0/1424984886 conn(0x7f49a00fedc0 msgr2=0x7f49a01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.042+0000 7f49a49a4700 1 -- 172.21.15.37:0/1424984886 shutdown_connections 2024-05-09T01:18:35.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.042+0000 7f49a49a4700 1 -- 172.21.15.37:0/1424984886 wait complete. 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 Processor -- start 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 -- start start 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a01034c0 0x7f49a010a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a010a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a0108740 0x7f49a010abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0113350 con 0x7f49a0107df0 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01131d0 con 0x7f49a0108740 2024-05-09T01:18:35.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f49a49a4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01134d0 con 0x7f49a01034c0 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a010a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a010a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56682/0 (socket says 172.21.15.37:56682) 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f499dd9b700 1 -- 172.21.15.37:0/1590517705 learned_addr learned my addr 172.21.15.37:0/1590517705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.043+0000 7f499e59c700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a01034c0 0x7f49a010a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f499dd9b700 1 -- 172.21.15.37:0/1590517705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a01034c0 msgr2=0x7f49a010a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f499dd9b700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a01034c0 0x7f49a010a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f499dd9b700 1 -- 172.21.15.37:0/1590517705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a0108740 msgr2=0x7f49a010abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f499dd9b700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a0108740 0x7f49a010abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f499dd9b700 1 -- 172.21.15.37:0/1590517705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a01a9130 con 0x7f49a0107df0 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f499dd9b700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a010a680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f49940045e0 tx=0x7f4994004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f498f7fe700 1 -- 172.21.15.37:0/1590517705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994026070 con 0x7f49a0107df0 2024-05-09T01:18:35.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a01a93c0 con 0x7f49a0107df0 2024-05-09T01:18:35.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f498f7fe700 1 -- 172.21.15.37:0/1590517705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f499400f460 con 0x7f49a0107df0 2024-05-09T01:18:35.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f498f7fe700 1 -- 172.21.15.37:0/1590517705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994009e60 con 0x7f49a0107df0 2024-05-09T01:18:35.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.044+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a01a9870 con 0x7f49a0107df0 2024-05-09T01:18:35.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.045+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a00512c0 con 0x7f49a0107df0 2024-05-09T01:18:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.047+0000 7f498f7fe700 1 -- 172.21.15.37:0/1590517705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4994029070 con 0x7f49a0107df0 2024-05-09T01:18:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.048+0000 7f498f7fe700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49880b2880 0x7f49880b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.048+0000 7f499e59c700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49880b2880 0x7f49880b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.048+0000 7f498f7fe700 1 -- 172.21.15.37:0/1590517705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8583+0+0 (secure 0 0 0) 0x7f49940e2fe0 con 0x7f49a0107df0 2024-05-09T01:18:35.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.048+0000 7f499e59c700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49880b2880 0x7f49880b4d90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4990009550 tx=0x7f49900091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:35.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.051+0000 7f498f7fe700 1 -- 172.21.15.37:0/1590517705 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4994030080 con 0x7f49a0107df0 2024-05-09T01:18:35.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.316+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f49a01a9b90 con 0x7f49a0107df0 2024-05-09T01:18:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.339+0000 7f498f7fe700 1 -- 172.21.15.37:0/1590517705 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) ==== 104+0+0 (secure 0 0 0) 0x7f4994013070 con 0x7f49a0107df0 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49880b2880 msgr2=0x7f49880b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49880b2880 0x7f49880b4d90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4990009550 tx=0x7f49900091b0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 msgr2=0x7f49a010a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a010a680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f49940045e0 tx=0x7f4994004610 comp rx=0 tx=0).stop 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 shutdown_connections 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f49880b2880 0x7f49880b4d90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a0108740 0x7f49a010abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a01034c0 0x7f49a010a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 --2- 172.21.15.37:0/1590517705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49a0107df0 0x7f49a010a680 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 >> 172.21.15.37:0/1590517705 conn(0x7f49a00fedc0 msgr2=0x7f49a01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 shutdown_connections 2024-05-09T01:18:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:35.341+0000 7f49a49a4700 1 -- 172.21.15.37:0/1590517705 wait complete. 2024-05-09T01:18:35.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:35 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1590517705' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T01:18:35.657 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:35 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1590517705' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T01:18:35.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:35 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1590517705' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T01:18:35.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T01:18:36.232 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:36.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:36 smithi136 ceph-mon[34110]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T01:18:36.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:36 smithi136 ceph-mon[34110]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T01:18:36.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:36 smithi136 ceph-mon[34110]: Cluster is now healthy 2024-05-09T01:18:36.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:36 smithi136 ceph-mon[34110]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-05-09T01:18:36.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:36 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/1590517705' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T01:18:36.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:36 smithi136 ceph-mon[34110]: fsmap 12 up:standby 2024-05-09T01:18:36.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:36 smithi037 ceph-mon[30122]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T01:18:36.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:36 smithi037 ceph-mon[30122]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T01:18:36.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:36 smithi037 ceph-mon[30122]: Cluster is now healthy 2024-05-09T01:18:36.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:36 smithi037 ceph-mon[30122]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-05-09T01:18:36.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:36 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/1590517705' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T01:18:36.670 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:36 smithi037 ceph-mon[30122]: fsmap 12 up:standby 2024-05-09T01:18:36.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:36 smithi151 ceph-mon[34780]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T01:18:36.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:36 smithi151 ceph-mon[34780]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T01:18:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:36 smithi151 ceph-mon[34780]: Cluster is now healthy 2024-05-09T01:18:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:36 smithi151 ceph-mon[34780]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-05-09T01:18:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:36 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/1590517705' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T01:18:36.724 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:36 smithi151 ceph-mon[34780]: fsmap 12 up:standby 2024-05-09T01:18:37.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 -- 172.21.15.37:0/1122790773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 msgr2=0x7f6c20108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:37.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 --2- 172.21.15.37:0/1122790773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c20108200 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6c140099c0 tx=0x7f6c14009cd0 comp rx=0 tx=0).stop 2024-05-09T01:18:37.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 -- 172.21.15.37:0/1122790773 shutdown_connections 2024-05-09T01:18:37.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 --2- 172.21.15.37:0/1122790773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c20108740 0x7f6c201100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 --2- 172.21.15.37:0/1122790773 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c201034c0 0x7f6c201038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 --2- 172.21.15.37:0/1122790773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c20108200 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 -- 172.21.15.37:0/1122790773 >> 172.21.15.37:0/1122790773 conn(0x7f6c200fedf0 msgr2=0x7f6c20101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 -- 172.21.15.37:0/1122790773 shutdown_connections 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.899+0000 7f6c248a3700 1 -- 172.21.15.37:0/1122790773 wait complete. 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.900+0000 7f6c248a3700 1 Processor -- start 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.900+0000 7f6c248a3700 1 -- start start 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c248a3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c201034c0 0x7f6c200ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c248a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c200ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:37.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c248a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c20108740 0x7f6c200ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c248a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20113440 con 0x7f6c20107df0 2024-05-09T01:18:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c248a3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6c201132c0 con 0x7f6c201034c0 2024-05-09T01:18:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c248a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6c201135c0 con 0x7f6c20108740 2024-05-09T01:18:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c200ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c200ff810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56694/0 (socket says 172.21.15.37:56694) 2024-05-09T01:18:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 -- 172.21.15.37:0/2698621332 learned_addr learned my addr 172.21.15.37:0/2698621332 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:37.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1e59c700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c201034c0 0x7f6c200ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1ed9d700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c20108740 0x7f6c200ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 -- 172.21.15.37:0/2698621332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c20108740 msgr2=0x7f6c200ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c20108740 0x7f6c200ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 -- 172.21.15.37:0/2698621332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c201034c0 msgr2=0x7f6c200ff2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c201034c0 0x7f6c200ff2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 -- 172.21.15.37:0/2698621332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c201a92a0 con 0x7f6c20107df0 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1ed9d700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c20108740 0x7f6c200ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.901+0000 7f6c1dd9b700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c200ff810 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009f50 tx=0x7f6c140037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.902+0000 7f6c0f7fe700 1 -- 172.21.15.37:0/2698621332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14027070 con 0x7f6c20107df0 2024-05-09T01:18:37.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.902+0000 7f6c0f7fe700 1 -- 172.21.15.37:0/2698621332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c14004090 con 0x7f6c20107df0 2024-05-09T01:18:37.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.902+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c201a9530 con 0x7f6c20107df0 2024-05-09T01:18:37.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.902+0000 7f6c0f7fe700 1 -- 172.21.15.37:0/2698621332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14022e60 con 0x7f6c20107df0 2024-05-09T01:18:37.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.902+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c201a99e0 con 0x7f6c20107df0 2024-05-09T01:18:37.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.903+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c200512c0 con 0x7f6c20107df0 2024-05-09T01:18:37.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.904+0000 7f6c0f7fe700 1 -- 172.21.15.37:0/2698621332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6c1402a070 con 0x7f6c20107df0 2024-05-09T01:18:37.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.905+0000 7f6c0f7fe700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6c080b2900 0x7f6c080b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:37.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.905+0000 7f6c1e59c700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6c080b2900 0x7f6c080b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:37.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.905+0000 7f6c0f7fe700 1 -- 172.21.15.37:0/2698621332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8583+0+0 (secure 0 0 0) 0x7f6c140e32b0 con 0x7f6c20107df0 2024-05-09T01:18:37.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.906+0000 7f6c1e59c700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6c080b2900 0x7f6c080b4e10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000a400 tx=0x7f6c1000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:37.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:37.908+0000 7f6c0f7fe700 1 -- 172.21.15.37:0/2698621332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6c14013070 con 0x7f6c20107df0 2024-05-09T01:18:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.121+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6c2002e5f0 con 0x7f6c20107df0 2024-05-09T01:18:38.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.343+0000 7f6c0f7fe700 1 -- 172.21.15.37:0/2698621332 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) ==== 181+0+0 (secure 0 0 0) 0x7f6c140aaf00 con 0x7f6c20107df0 2024-05-09T01:18:38.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6c080b2900 msgr2=0x7f6c080b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:38.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6c080b2900 0x7f6c080b4e10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000a400 tx=0x7f6c1000d040 comp rx=0 tx=0).stop 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 msgr2=0x7f6c200ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c200ff810 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009f50 tx=0x7f6c140037c0 comp rx=0 tx=0).stop 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 shutdown_connections 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f6c080b2900 0x7f6c080b4e10 secure :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000a400 tx=0x7f6c1000d040 comp rx=0 tx=0).stop 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c20108740 0x7f6c200ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c201034c0 0x7f6c200ff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 --2- 172.21.15.37:0/2698621332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c20107df0 0x7f6c200ff810 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.346+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 >> 172.21.15.37:0/2698621332 conn(0x7f6c200fedf0 msgr2=0x7f6c20075d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.347+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 shutdown_connections 2024-05-09T01:18:38.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:38.347+0000 7f6c248a3700 1 -- 172.21.15.37:0/2698621332 wait complete. 2024-05-09T01:18:38.348 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-09T01:18:38.508 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:38 smithi037 ceph-mon[30122]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T01:18:38.508 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:38 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2698621332' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T01:18:38.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:38 smithi136 ceph-mon[34110]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T01:18:38.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:38 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2698621332' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T01:18:38.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:38 smithi151 ceph-mon[34780]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T01:18:38.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:38 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2698621332' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T01:18:39.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T01:18:39.285 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T01:18:39.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:39 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/2698621332' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T01:18:39.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:39 smithi136 ceph-mon[34110]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T01:18:39.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:39 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/2698621332' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T01:18:39.660 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:39 smithi037 ceph-mon[30122]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T01:18:39.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:39 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/2698621332' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T01:18:39.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:39 smithi151 ceph-mon[34780]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T01:18:40.372 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:40 smithi037 ceph-mon[30122]: pgmap v893: 65 pgs: 65 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T01:18:40.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:40 smithi136 ceph-mon[34110]: pgmap v893: 65 pgs: 65 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T01:18:40.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:40 smithi151 ceph-mon[34780]: pgmap v893: 65 pgs: 65 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T01:18:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 -- 172.21.15.37:0/3373561030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c110c70 msgr2=0x7f8d4c113090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3373561030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c110c70 0x7f8d4c113090 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400b0a0 tx=0x7f8d4400b3b0 comp rx=0 tx=0).stop 2024-05-09T01:18:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 -- 172.21.15.37:0/3373561030 shutdown_connections 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3373561030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c110c70 0x7f8d4c113090 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3373561030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d4c1030c0 0x7f8d4c1034d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3373561030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4c103aa0 0x7f8d4c110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 -- 172.21.15.37:0/3373561030 >> 172.21.15.37:0/3373561030 conn(0x7f8d4c078e50 msgr2=0x7f8d4c079290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 -- 172.21.15.37:0/3373561030 shutdown_connections 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.913+0000 7f8d539f3700 1 -- 172.21.15.37:0/3373561030 wait complete. 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.914+0000 7f8d539f3700 1 Processor -- start 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.914+0000 7f8d539f3700 1 -- start start 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d539f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c1030c0 0x7f8d4c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d539f3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d4c103aa0 0x7f8d4c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d539f3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4c110c70 0x7f8d4c1a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d539f3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c116780 con 0x7f8d4c1030c0 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d539f3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c116600 con 0x7f8d4c103aa0 2024-05-09T01:18:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d539f3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4c116900 con 0x7f8d4c110c70 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c1030c0 0x7f8d4c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c1030c0 0x7f8d4c19d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56716/0 (socket says 172.21.15.37:56716) 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 -- 172.21.15.37:0/3663821030 learned_addr learned my addr 172.21.15.37:0/3663821030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d51f90700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4c110c70 0x7f8d4c1a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d50f8e700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d4c103aa0 0x7f8d4c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 -- 172.21.15.37:0/3663821030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4c110c70 msgr2=0x7f8d4c1a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4c110c70 0x7f8d4c1a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 -- 172.21.15.37:0/3663821030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d4c103aa0 msgr2=0x7f8d4c19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d4c103aa0 0x7f8d4c19d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 -- 172.21.15.37:0/3663821030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4c1a1f20 con 0x7f8d4c1030c0 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d51f90700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4c110c70 0x7f8d4c1a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d5178f700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c1030c0 0x7f8d4c19d050 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800d950 tx=0x7f8d4800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:40.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.915+0000 7f8d427fc700 1 -- 172.21.15.37:0/3663821030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48016070 con 0x7f8d4c1030c0 2024-05-09T01:18:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.916+0000 7f8d427fc700 1 -- 172.21.15.37:0/3663821030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d48010460 con 0x7f8d4c1030c0 2024-05-09T01:18:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.916+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4c1a2210 con 0x7f8d4c1030c0 2024-05-09T01:18:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.916+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4c1a9b30 con 0x7f8d4c1030c0 2024-05-09T01:18:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.916+0000 7f8d427fc700 1 -- 172.21.15.37:0/3663821030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800f620 con 0x7f8d4c1030c0 2024-05-09T01:18:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.917+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d4c0512c0 con 0x7f8d4c1030c0 2024-05-09T01:18:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.918+0000 7f8d427fc700 1 -- 172.21.15.37:0/3663821030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8d48019070 con 0x7f8d4c1030c0 2024-05-09T01:18:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.919+0000 7f8d427fc700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d380b2900 0x7f8d380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T01:18:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.919+0000 7f8d50f8e700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d380b2900 0x7f8d380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T01:18:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.919+0000 7f8d427fc700 1 -- 172.21.15.37:0/3663821030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8087+0+0 (secure 0 0 0) 0x7f8d480e20d0 con 0x7f8d4c1030c0 2024-05-09T01:18:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.920+0000 7f8d50f8e700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d380b2900 0x7f8d380b4e10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c006fd0 tx=0x7f8d3c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T01:18:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:40.924+0000 7f8d427fc700 1 -- 172.21.15.37:0/3663821030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8d480a9ed0 con 0x7f8d4c1030c0 2024-05-09T01:18:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.135+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8d4c02e5f0 con 0x7f8d4c1030c0 2024-05-09T01:18:41.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.365+0000 7f8d427fc700 1 -- 172.21.15.37:0/3663821030 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) ==== 169+0+0 (secure 0 0 0) 0x7f8d480a97d0 con 0x7f8d4c1030c0 2024-05-09T01:18:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d380b2900 msgr2=0x7f8d380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d380b2900 0x7f8d380b4e10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c006fd0 tx=0x7f8d3c008040 comp rx=0 tx=0).stop 2024-05-09T01:18:41.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c1030c0 msgr2=0x7f8d4c19d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c1030c0 0x7f8d4c19d050 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800d950 tx=0x7f8d4800dd10 comp rx=0 tx=0).stop 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 shutdown_connections 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:6800/2764436863,v1:172.21.15.37:6801/2764436863] conn(0x7f8d380b2900 0x7f8d380b4e10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4c110c70 0x7f8d4c1a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d4c1030c0 0x7f8d4c19d050 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 --2- 172.21.15.37:0/3663821030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d4c103aa0 0x7f8d4c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.370+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 >> 172.21.15.37:0/3663821030 conn(0x7f8d4c078e50 msgr2=0x7f8d4c111f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.371+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 shutdown_connections 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-09T01:18:41.371+0000 7f8d539f3700 1 -- 172.21.15.37:0/3663821030 wait complete. 2024-05-09T01:18:41.371 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-09T01:18:41.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:41 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3663821030' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T01:18:41.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:41 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3663821030' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T01:18:41.723 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:41 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3663821030' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T01:18:42.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T01:18:42.112 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T01:18:42.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T01:18:42.168 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-09T01:18:42.168 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T01:18:42.184 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T01:18:42.198 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T01:18:42.222 INFO:tasks.cephadm:Stopping all daemons... 2024-05-09T01:18:42.223 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-09T01:18:42.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a 2024-05-09T01:18:42.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 systemd[1]: Stopping Ceph mon.a for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:18:42.473 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:42 smithi151 ceph-mon[34780]: pgmap v894: 65 pgs: 65 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T01:18:42.473 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:42 smithi151 ceph-mon[34780]: from='client.? 172.21.15.37:0/3663821030' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T01:18:42.473 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:42 smithi151 ceph-mon[34780]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T01:18:42.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:42 smithi136 ceph-mon[34110]: pgmap v894: 65 pgs: 65 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T01:18:42.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:42 smithi136 ceph-mon[34110]: from='client.? 172.21.15.37:0/3663821030' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T01:18:42.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:42 smithi136 ceph-mon[34110]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T01:18:42.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 ceph-mon[30122]: pgmap v894: 65 pgs: 65 active+clean; 1.6 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T01:18:42.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 ceph-mon[30122]: from='client.? 172.21.15.37:0/3663821030' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T01:18:42.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 ceph-mon[30122]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T01:18:42.722 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a[30118]: 2024-05-09T01:18:42.552+0000 7f345ae34700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:18:42.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a[30118]: 2024-05-09T01:18:42.552+0000 7f345ae34700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-09T01:18:42.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 podman[118459]: 2024-05-09 01:18:42.594161754 +0000 UTC m=+0.173785023 container died d9bacac277c5f3e9798373200224b9a06a0810c3dc6ffdb070d139df5a1c2fbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-09T01:18:43.142 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 podman[118459]: 2024-05-09 01:18:42.93498307 +0000 UTC m=+0.514606333 container cleanup d9bacac277c5f3e9798373200224b9a06a0810c3dc6ffdb070d139df5a1c2fbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-09T01:18:43.143 INFO:journalctl@ceph.mon.a.smithi037.stdout:May 09 01:18:42 smithi037 bash[118459]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-a 2024-05-09T01:18:43.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.a.service' 2024-05-09T01:18:43.417 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:18:43.417 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-09T01:18:43.417 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-09T01:18:43.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.b 2024-05-09T01:18:43.747 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:43 smithi136 systemd[1]: Stopping Ceph mon.b for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:18:44.126 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b[34106]: 2024-05-09T01:18:43.748+0000 7f2210baf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:18:44.126 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b[34106]: 2024-05-09T01:18:43.748+0000 7f2210baf700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-09T01:18:44.126 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:43 smithi136 podman[70080]: 2024-05-09 01:18:43.881521798 +0000 UTC m=+0.278781589 container died 8791a6ea5d272c87bdd29fd5f702c9140a66e0974e80b353efbcb3476da09ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:18:44.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:44 smithi136 podman[70080]: 2024-05-09 01:18:44.290755845 +0000 UTC m=+0.688015624 container cleanup 8791a6ea5d272c87bdd29fd5f702c9140a66e0974e80b353efbcb3476da09ea7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T01:18:44.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 09 01:18:44 smithi136 bash[70080]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-b 2024-05-09T01:18:44.676 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.b.service' 2024-05-09T01:18:44.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:18:44.723 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-09T01:18:44.723 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-09T01:18:44.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.c 2024-05-09T01:18:45.013 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:44 smithi151 systemd[1]: Stopping Ceph mon.c for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:18:45.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:45 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-c[34768]: 2024-05-09T01:18:45.013+0000 7f628a9d9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:18:45.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:45 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-c[34768]: 2024-05-09T01:18:45.013+0000 7f628a9d9700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-09T01:18:45.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:45 smithi151 podman[71932]: 2024-05-09 01:18:45.034824708 +0000 UTC m=+0.118990779 container stop 3db7f298ed87a4aa2caa74caddb06ba3ad2f1c1aeec086a1c7dad812a93ba923 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:18:45.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:45 smithi151 podman[71932]: 2024-05-09 01:18:45.060360865 +0000 UTC m=+0.144526936 container died 3db7f298ed87a4aa2caa74caddb06ba3ad2f1c1aeec086a1c7dad812a93ba923 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:18:45.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:45 smithi151 podman[71932]: 2024-05-09 01:18:45.423375367 +0000 UTC m=+0.507541437 container cleanup 3db7f298ed87a4aa2caa74caddb06ba3ad2f1c1aeec086a1c7dad812a93ba923 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-c, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:18:45.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 09 01:18:45 smithi151 bash[71932]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mon-c 2024-05-09T01:18:45.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mon.c.service' 2024-05-09T01:18:45.895 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:18:45.895 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-09T01:18:45.895 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-09T01:18:45.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.x 2024-05-09T01:18:46.218 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 01:18:45 smithi037 systemd[1]: Stopping Ceph mgr.x for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:18:46.472 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 01:18:46 smithi037 podman[118581]: 2024-05-09 01:18:46.221138276 +0000 UTC m=+0.132195154 container died 00d64b3c7a23ef9eab3b80d11f93993f82a9080a78d70646189d46d4b28ecc09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-09T01:18:46.881 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 01:18:46 smithi037 podman[118581]: 2024-05-09 01:18:46.606826782 +0000 UTC m=+0.517883693 container cleanup 00d64b3c7a23ef9eab3b80d11f93993f82a9080a78d70646189d46d4b28ecc09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True) 2024-05-09T01:18:46.882 INFO:journalctl@ceph.mgr.x.smithi037.stdout:May 09 01:18:46 smithi037 bash[118581]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-x 2024-05-09T01:18:47.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-09T01:18:47.075 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:18:47.076 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-09T01:18:47.076 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-09T01:18:47.076 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.y 2024-05-09T01:18:47.376 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:47 smithi136 systemd[1]: Stopping Ceph mgr.y for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:18:47.695 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:47 smithi136 podman[70203]: 2024-05-09 01:18:47.424651848 +0000 UTC m=+0.153212795 container died 70b7d49e8a7e57b1dd847c89c9e118871aec6fcbde5aff975e39dad05ff32c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-09T01:18:47.956 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:47 smithi136 podman[70203]: 2024-05-09 01:18:47.770998289 +0000 UTC m=+0.499559227 container cleanup 70b7d49e8a7e57b1dd847c89c9e118871aec6fcbde5aff975e39dad05ff32c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-09T01:18:47.956 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:47 smithi136 bash[70203]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y 2024-05-09T01:18:48.206 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:47 smithi136 podman[70217]: 2024-05-09 01:18:47.957682973 +0000 UTC m=+0.528425851 container remove 70b7d49e8a7e57b1dd847c89c9e118871aec6fcbde5aff975e39dad05ff32c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-09T01:18:48.206 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:47 smithi136 systemd[1]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-09T01:18:48.206 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:48 smithi136 systemd[1]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-05-09T01:18:48.206 INFO:journalctl@ceph.mgr.y.smithi136.stdout:May 09 01:18:48 smithi136 systemd[1]: Stopped Ceph mgr.y for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T01:18:48.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-09T01:18:48.240 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:18:48.241 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-09T01:18:48.241 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-09T01:18:48.241 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.z 2024-05-09T01:18:48.566 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 01:18:48 smithi151 systemd[1]: Stopping Ceph mgr.z for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:18:48.856 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 01:18:48 smithi151 podman[72053]: 2024-05-09 01:18:48.568185162 +0000 UTC m=+0.143807127 container died e02b5abdae5c8939e9e9cb05ba01461249617d718f2161c8e7eabb6b2a88bdce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:18:49.223 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 01:18:48 smithi151 podman[72053]: 2024-05-09 01:18:48.93253402 +0000 UTC m=+0.508156017 container cleanup e02b5abdae5c8939e9e9cb05ba01461249617d718f2161c8e7eabb6b2a88bdce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T01:18:49.223 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 01:18:48 smithi151 bash[72053]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z 2024-05-09T01:18:49.223 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 01:18:49 smithi151 podman[72067]: 2024-05-09 01:18:49.093596892 +0000 UTC m=+0.520775237 container remove e02b5abdae5c8939e9e9cb05ba01461249617d718f2161c8e7eabb6b2a88bdce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mgr-z, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:18:49.224 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 09 01:18:49 smithi151 systemd[1]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-09T01:18:49.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-09T01:18:49.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:18:49.374 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-09T01:18:49.374 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-09T01:18:49.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.0 2024-05-09T01:18:49.695 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:49 smithi037 systemd[1]: Stopping Ceph osd.0 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:18:49.972 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0[42653]: 2024-05-09T01:18:49.696+0000 7fb4463e3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:18:49.972 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0[42653]: 2024-05-09T01:18:49.696+0000 7fb4463e3700 -1 osd.0 84 *** Got signal Terminated *** 2024-05-09T01:18:49.972 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0[42653]: 2024-05-09T01:18:49.696+0000 7fb4463e3700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:18:58.185 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:57 smithi037 podman[118701]: 2024-05-09 01:18:57.87985268 +0000 UTC m=+8.305938974 container died dfc3207479f55fc843c7f5bd5dcc2c3e549352c2d99da95dc3776b932c204064 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:18:58.472 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:58 smithi037 podman[118701]: 2024-05-09 01:18:58.294588663 +0000 UTC m=+8.720675000 container cleanup dfc3207479f55fc843c7f5bd5dcc2c3e549352c2d99da95dc3776b932c204064 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True) 2024-05-09T01:18:58.472 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:58 smithi037 bash[118701]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0 2024-05-09T01:18:58.836 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:58 smithi037 podman[118720]: 2024-05-09 01:18:58.504298343 +0000 UTC m=+0.621945622 container remove dfc3207479f55fc843c7f5bd5dcc2c3e549352c2d99da95dc3776b932c204064 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-09T01:18:59.139 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:58 smithi037 podman[118811]: 2024-05-09 01:18:58.741871656 +0000 UTC m=+0.018823504 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:18:59.139 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:58 smithi037 podman[118811]: 2024-05-09 01:18:58.846816473 +0000 UTC m=+0.123768349 container create 2a24af1264087eada98fc72563e4dc00193cd1fb9b9857460f1911585095b2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:18:59.139 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:59 smithi037 podman[118811]: 2024-05-09 01:18:59.057653467 +0000 UTC m=+0.334605311 container init 2a24af1264087eada98fc72563e4dc00193cd1fb9b9857460f1911585095b2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-09T01:18:59.139 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:59 smithi037 podman[118811]: 2024-05-09 01:18:59.061780311 +0000 UTC m=+0.338732154 container start 2a24af1264087eada98fc72563e4dc00193cd1fb9b9857460f1911585095b2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:18:59.139 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:59 smithi037 podman[118811]: 2024-05-09 01:18:59.14072503 +0000 UTC m=+0.417676864 container attach 2a24af1264087eada98fc72563e4dc00193cd1fb9b9857460f1911585095b2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-09T01:18:59.472 INFO:journalctl@ceph.osd.0.smithi037.stdout:May 09 01:18:59 smithi037 podman[118811]: 2024-05-09 01:18:59.373857152 +0000 UTC m=+0.650808992 container died 2a24af1264087eada98fc72563e4dc00193cd1fb9b9857460f1911585095b2e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T01:18:59.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.0.service' 2024-05-09T01:19:00.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:19:00.043 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-09T01:19:00.043 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-09T01:19:00.043 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.1 2024-05-09T01:19:00.376 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:00 smithi136 systemd[1]: Stopping Ceph osd.1 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:19:00.644 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1[38695]: 2024-05-09T01:19:00.425+0000 7fa31350d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:19:00.644 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1[38695]: 2024-05-09T01:19:00.425+0000 7fa31350d700 -1 osd.1 84 *** Got signal Terminated *** 2024-05-09T01:19:00.644 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1[38695]: 2024-05-09T01:19:00.425+0000 7fa31350d700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:19:10.792 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:10 smithi136 podman[70328]: 2024-05-09 01:19:10.468362465 +0000 UTC m=+10.233481721 container died 497d0f2b93638b38863ba226cc30b6f7883a6367e15bd9ecf11bb72a5b37720c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-05-09T01:19:11.078 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:10 smithi136 podman[70328]: 2024-05-09 01:19:10.892326397 +0000 UTC m=+10.657445660 container cleanup 497d0f2b93638b38863ba226cc30b6f7883a6367e15bd9ecf11bb72a5b37720c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T01:19:11.078 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:10 smithi136 bash[70328]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1 2024-05-09T01:19:11.376 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:11 smithi136 podman[70359]: 2024-05-09 01:19:11.119210089 +0000 UTC m=+0.652122407 container remove 497d0f2b93638b38863ba226cc30b6f7883a6367e15bd9ecf11bb72a5b37720c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-09T01:19:11.812 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:11 smithi136 podman[70448]: 2024-05-09 01:19:11.456544584 +0000 UTC m=+0.018394848 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:19:11.812 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:11 smithi136 podman[70448]: 2024-05-09 01:19:11.586729637 +0000 UTC m=+0.148579896 container create 4c4d672ff6587aa9cfc140cea4d64e9451491fb4f05ec7d79649518f9ef7a6cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-09T01:19:11.812 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:11 smithi136 podman[70448]: 2024-05-09 01:19:11.814246014 +0000 UTC m=+0.376096274 container init 4c4d672ff6587aa9cfc140cea4d64e9451491fb4f05ec7d79649518f9ef7a6cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:19:12.104 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:11 smithi136 podman[70448]: 2024-05-09 01:19:11.817611801 +0000 UTC m=+0.379462062 container start 4c4d672ff6587aa9cfc140cea4d64e9451491fb4f05ec7d79649518f9ef7a6cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:19:12.104 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:11 smithi136 podman[70448]: 2024-05-09 01:19:11.88937939 +0000 UTC m=+0.451229662 container attach 4c4d672ff6587aa9cfc140cea4d64e9451491fb4f05ec7d79649518f9ef7a6cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-09T01:19:12.376 INFO:journalctl@ceph.osd.1.smithi136.stdout:May 09 01:19:12 smithi136 podman[70448]: 2024-05-09 01:19:12.106570417 +0000 UTC m=+0.668420680 container died 4c4d672ff6587aa9cfc140cea4d64e9451491fb4f05ec7d79649518f9ef7a6cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-09T01:19:12.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.1.service' 2024-05-09T01:19:12.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:19:12.733 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-09T01:19:12.733 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-09T01:19:12.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.2 2024-05-09T01:19:13.028 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:12 smithi151 systemd[1]: Stopping Ceph osd.2 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:19:13.293 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2[39903]: 2024-05-09T01:19:13.029+0000 7fc518dc2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:19:13.294 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2[39903]: 2024-05-09T01:19:13.029+0000 7fc518dc2700 -1 osd.2 84 *** Got signal Terminated *** 2024-05-09T01:19:13.294 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2[39903]: 2024-05-09T01:19:13.029+0000 7fc518dc2700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:19:18.772 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:18 smithi151 podman[72177]: 2024-05-09 01:19:18.479267153 +0000 UTC m=+5.560340711 container died c3f4b1b53d715761b6ed213f38105bb5990196516b399dd39acb63ce6af0c322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T01:19:19.106 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:18 smithi151 podman[72177]: 2024-05-09 01:19:18.864376326 +0000 UTC m=+5.945449873 container cleanup c3f4b1b53d715761b6ed213f38105bb5990196516b399dd39acb63ce6af0c322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-09T01:19:19.106 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:18 smithi151 bash[72177]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2 2024-05-09T01:19:19.413 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:19 smithi151 podman[72206]: 2024-05-09 01:19:19.107814891 +0000 UTC m=+0.630466052 container remove c3f4b1b53d715761b6ed213f38105bb5990196516b399dd39acb63ce6af0c322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:19:19.685 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:19 smithi151 podman[72296]: 2024-05-09 01:19:19.317882334 +0000 UTC m=+0.018138785 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:19:19.685 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:19 smithi151 podman[72296]: 2024-05-09 01:19:19.41716449 +0000 UTC m=+0.117420970 container create 754942153fe154fc8d845b9c9f362de29b6b17d2d1cf6dbff7b2802a073eb7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-09T01:19:19.685 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:19 smithi151 podman[72296]: 2024-05-09 01:19:19.620608029 +0000 UTC m=+0.320864464 container init 754942153fe154fc8d845b9c9f362de29b6b17d2d1cf6dbff7b2802a073eb7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-09T01:19:19.685 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:19 smithi151 podman[72296]: 2024-05-09 01:19:19.62386471 +0000 UTC m=+0.324121147 container start 754942153fe154fc8d845b9c9f362de29b6b17d2d1cf6dbff7b2802a073eb7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T01:19:19.685 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:19 smithi151 podman[72296]: 2024-05-09 01:19:19.686751788 +0000 UTC m=+0.387008239 container attach 754942153fe154fc8d845b9c9f362de29b6b17d2d1cf6dbff7b2802a073eb7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:19:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:19.429+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:19.973 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 09 01:19:19 smithi151 podman[72296]: 2024-05-09 01:19:19.919955461 +0000 UTC m=+0.620211904 container died 754942153fe154fc8d845b9c9f362de29b6b17d2d1cf6dbff7b2802a073eb7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=) 2024-05-09T01:19:19.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:19.901+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:20.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.2.service' 2024-05-09T01:19:20.472 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:20 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:20.146+0000 7f35e9e34700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.051702+0000 front 2024-05-09T01:18:50.051726+0000 (oldest deadline 2024-05-09T01:19:20.052659+0000) 2024-05-09T01:19:20.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:19:20.510 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-09T01:19:20.510 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-09T01:19:20.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.3 2024-05-09T01:19:20.837 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:20 smithi037 systemd[1]: Stopping Ceph osd.3 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:19:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:20.450+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:21.163 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:20 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:20.838+0000 7f35ed87e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:19:21.163 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:20 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:20.838+0000 7f35ed87e700 -1 osd.3 84 *** Got signal Terminated *** 2024-05-09T01:19:21.163 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:20 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:20.838+0000 7f35ed87e700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:19:21.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:20.940+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:21.472 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:21 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:21.164+0000 7f35e9e34700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.051702+0000 front 2024-05-09T01:18:50.051726+0000 (oldest deadline 2024-05-09T01:19:20.052659+0000) 2024-05-09T01:19:21.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:21 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:21.202+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:21.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:21.407+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:21.913 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:21.637+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:22.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:21.914+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:22.472 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:22 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:22.131+0000 7f35e9e34700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.051702+0000 front 2024-05-09T01:18:50.051726+0000 (oldest deadline 2024-05-09T01:19:20.052659+0000) 2024-05-09T01:19:22.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:22 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:22.191+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:22.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:22 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:22.373+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:22.942 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:22.595+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:23.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:22.943+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:23.472 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:23 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:23.122+0000 7f35e9e34700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.051702+0000 front 2024-05-09T01:18:50.051726+0000 (oldest deadline 2024-05-09T01:19:20.052659+0000) 2024-05-09T01:19:23.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:23 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:23.239+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:23.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:23 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:23.146+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:23.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:23 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:23.354+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:23.931 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:23.626+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:24.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:23.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:24.472 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:24 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:24.111+0000 7f35e9e34700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.051702+0000 front 2024-05-09T01:18:50.051726+0000 (oldest deadline 2024-05-09T01:19:20.052659+0000) 2024-05-09T01:19:24.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:24 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:24.115+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:24.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:24 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:24.257+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:24.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:24 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:24.310+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:24.893 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:24.613+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:25.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:24.894+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:25.472 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:25 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3[49149]: 2024-05-09T01:19:25.068+0000 7f35e9e34700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.051702+0000 front 2024-05-09T01:18:50.051726+0000 (oldest deadline 2024-05-09T01:19:20.052659+0000) 2024-05-09T01:19:25.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:25 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:25.106+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:25.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:25 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:25.223+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:25.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:25 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:25.315+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:25.909 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:25.609+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:26.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:25.910+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:26.358 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:26 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:26.063+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:26.359 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:26 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:26.178+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:26.621 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:26 smithi037 podman[118942]: 2024-05-09 01:19:26.360397413 +0000 UTC m=+5.641665094 container died a9e1dd450e136d56544825015db38488a33c3cbfed3586dc3dbf6048058a2902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T01:19:26.625 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:26 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:26.339+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:26.972 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:26 smithi037 podman[118942]: 2024-05-09 01:19:26.81361712 +0000 UTC m=+6.094884810 container cleanup a9e1dd450e136d56544825015db38488a33c3cbfed3586dc3dbf6048058a2902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-05-09T01:19:26.972 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:26 smithi037 bash[118942]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3 2024-05-09T01:19:26.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:26 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:26.619+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:26.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:26 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:26.866+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:27.422 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:27 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:27.107+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:27.423 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:27 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:27.178+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:27.423 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:27 smithi037 podman[118959]: 2024-05-09 01:19:27.103789399 +0000 UTC m=+0.740804824 container remove a9e1dd450e136d56544825015db38488a33c3cbfed3586dc3dbf6048058a2902 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:19:27.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:27 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:27.293+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:27.722 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:27 smithi037 podman[119049]: 2024-05-09 01:19:27.424204781 +0000 UTC m=+0.101731380 container create 89a044cae42af0171ba7e7e87fabd92c50fa2a6e98ec23a1697d2fc613f78725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-09T01:19:27.722 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:27 smithi037 podman[119049]: 2024-05-09 01:19:27.340791027 +0000 UTC m=+0.018317594 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:19:27.722 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:27 smithi037 podman[119049]: 2024-05-09 01:19:27.66849444 +0000 UTC m=+0.346020998 container init 89a044cae42af0171ba7e7e87fabd92c50fa2a6e98ec23a1697d2fc613f78725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:19:27.722 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:27 smithi037 podman[119049]: 2024-05-09 01:19:27.67187134 +0000 UTC m=+0.349397898 container start 89a044cae42af0171ba7e7e87fabd92c50fa2a6e98ec23a1697d2fc613f78725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-09T01:19:27.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:27.628+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:27.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:27.874+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:28.090 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:27 smithi037 podman[119049]: 2024-05-09 01:19:27.743245416 +0000 UTC m=+0.420771985 container attach 89a044cae42af0171ba7e7e87fabd92c50fa2a6e98ec23a1697d2fc613f78725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T01:19:28.090 INFO:journalctl@ceph.osd.3.smithi037.stdout:May 09 01:19:27 smithi037 podman[119049]: 2024-05-09 01:19:27.975893728 +0000 UTC m=+0.653420291 container died 89a044cae42af0171ba7e7e87fabd92c50fa2a6e98ec23a1697d2fc613f78725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T01:19:28.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:28 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:28.175+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:28.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:28 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:28.091+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:28.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:28 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:28.318+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:28.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.3.service' 2024-05-09T01:19:28.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:19:28.734 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-09T01:19:28.734 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-09T01:19:28.734 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.4 2024-05-09T01:19:28.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:28 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:28.600+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:28.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:28 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:28.848+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:29.035 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:28 smithi136 systemd[1]: Stopping Ceph osd.4 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:19:29.289 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:29 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4[45640]: 2024-05-09T01:19:29.036+0000 7f7d93a5a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:19:29.289 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:29 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4[45640]: 2024-05-09T01:19:29.036+0000 7f7d93a5a700 -1 osd.4 84 *** Got signal Terminated *** 2024-05-09T01:19:29.289 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:29 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4[45640]: 2024-05-09T01:19:29.036+0000 7f7d93a5a700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:19:29.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:29 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:29.185+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:29.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:29 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:29.064+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:29.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:29 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:29.291+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:29.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:29.646+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:29.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:29.827+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:30.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:30 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:30.035+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:30.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:30 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:30.142+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:30.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:30 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:30.340+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:30.816 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:30.615+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:30.817 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:30.818+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:31.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:31 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:31.041+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:31.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:31 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:31.185+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:31.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:31 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:31.291+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:31.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:31.597+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:31.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:31.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:31.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:31 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:31.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:32.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:31 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:31.992+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:32.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:32 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:32.211+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:32.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:32.290+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:32.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:32 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:32.290+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:32.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:32.577+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:32.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:32.736+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:32.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:32.821+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:32.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:32 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:32.821+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:33.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:33.007+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:33.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:33.197+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:33.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:33.197+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:33.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:33 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:33.329+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:33.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:33 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:33.329+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:33.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:33 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:33.708+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:33.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:33 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:33.579+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:33.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:33 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:33.801+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:33.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:33 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:33.801+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:34.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:34 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:34.015+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:34.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:34 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:34.195+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:34.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:34 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:34.195+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:34.626 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:34 smithi136 podman[70564]: 2024-05-09 01:19:34.598652169 +0000 UTC m=+5.662524507 container died 3a79445960f2ad82383e7a06a60ce4f53c9d93675e52581cde83513cfb60e579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T01:19:34.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:34 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:34.373+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:34.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:34 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:34.373+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:34.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:34.614+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:34.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:34.709+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:34.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:34.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:34.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:34 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:34.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:35.127 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:34 smithi136 podman[70564]: 2024-05-09 01:19:34.952769562 +0000 UTC m=+6.016641897 container cleanup 3a79445960f2ad82383e7a06a60ce4f53c9d93675e52581cde83513cfb60e579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:19:35.127 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:34 smithi136 bash[70564]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4 2024-05-09T01:19:35.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:35.165+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:35.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:35.165+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:35.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:34 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:34.988+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:35.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:34 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:34.988+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:35.572 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:35 smithi136 podman[70593]: 2024-05-09 01:19:35.12907001 +0000 UTC m=+0.534876241 container remove 3a79445960f2ad82383e7a06a60ce4f53c9d93675e52581cde83513cfb60e579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:19:35.572 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:35 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:35.325+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:35.572 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:35 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:35.325+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:35.572 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:35 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:35.231+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:35.860 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:35.689+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:35.860 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:35.589+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:35.860 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:35.589+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:01.406530+0000 front 2024-05-09T01:19:01.406495+0000 (oldest deadline 2024-05-09T01:19:34.907918+0000) 2024-05-09T01:19:35.876 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:35 smithi136 podman[70683]: 2024-05-09 01:19:35.476480338 +0000 UTC m=+0.018599352 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:19:35.876 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:35 smithi136 podman[70683]: 2024-05-09 01:19:35.58008043 +0000 UTC m=+0.122199440 container create 23e973966b66a8a034683eb0cb0fd65bb518b88d7248593164e1c754824f704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T01:19:35.876 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:35 smithi136 podman[70683]: 2024-05-09 01:19:35.80800024 +0000 UTC m=+0.350119243 container init 23e973966b66a8a034683eb0cb0fd65bb518b88d7248593164e1c754824f704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-09T01:19:35.876 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:35 smithi136 podman[70683]: 2024-05-09 01:19:35.811137721 +0000 UTC m=+0.353256722 container start 23e973966b66a8a034683eb0cb0fd65bb518b88d7248593164e1c754824f704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-09T01:19:36.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:35.861+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:36.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:35 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:35.861+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:36.241 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:35 smithi136 podman[70683]: 2024-05-09 01:19:35.901456569 +0000 UTC m=+0.443575580 container attach 23e973966b66a8a034683eb0cb0fd65bb518b88d7248593164e1c754824f704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-09T01:19:36.241 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 09 01:19:36 smithi136 podman[70683]: 2024-05-09 01:19:36.109183932 +0000 UTC m=+0.651302926 container died 23e973966b66a8a034683eb0cb0fd65bb518b88d7248593164e1c754824f704e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-09T01:19:36.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:35.977+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:36.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:35 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:35.977+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:36.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:36.177+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:36.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:36.177+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:36.619 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:36 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:36.283+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:36.619 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:36 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:36.283+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:36.619 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:36 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:36.242+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:36.649 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.4.service' 2024-05-09T01:19:36.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:19:36.691 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-09T01:19:36.691 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-09T01:19:36.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.5 2024-05-09T01:19:36.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:36 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:36.654+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:36.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:36 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:36.866+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:36.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:36 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:36.866+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:36.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:36 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:36.622+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:36.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:36 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:36.622+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:01.406530+0000 front 2024-05-09T01:19:01.406495+0000 (oldest deadline 2024-05-09T01:19:34.907918+0000) 2024-05-09T01:19:36.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:36 smithi151 systemd[1]: Stopping Ceph osd.5 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:19:37.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:37 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:37.191+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:37.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:37 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:37.191+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:37.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:36.984+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:37.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:36 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:36.984+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:37.624 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:37.303+0000 7f0837477700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:19:37.624 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:37.303+0000 7f0837477700 -1 osd.5 84 *** Got signal Terminated *** 2024-05-09T01:19:37.624 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:37.303+0000 7f0837477700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:19:37.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:37 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:37.292+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:37.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:37 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:37.278+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:37.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:37 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:37.278+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:37.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:37.683+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:37.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:37.625+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:37.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:37.625+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:01.406530+0000 front 2024-05-09T01:19:01.406495+0000 (oldest deadline 2024-05-09T01:19:34.907918+0000) 2024-05-09T01:19:37.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:37.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:37.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:37 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:37.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:38.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:38 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:38.018+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:38.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:38 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:38.018+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:38.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:38 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:38.189+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:38.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:38 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:38.189+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:38.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:38 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:38.328+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:38.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:38 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:38.281+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:38.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:38 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:38.281+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:38.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:38 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:38.698+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:38.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:38 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:38.698+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:38.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:38 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:38.821+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:38.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:38 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:38.821+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:38.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:38 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:38.666+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:38.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:38 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:38.666+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:01.406530+0000 front 2024-05-09T01:19:01.406495+0000 (oldest deadline 2024-05-09T01:19:34.907918+0000) 2024-05-09T01:19:39.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:39 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:39.160+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:39.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:39 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:39.160+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:39.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:39 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:39.018+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:39.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:39 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:39.018+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:39.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:39 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:39.018+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:39.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:39 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:39.325+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:39.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:39 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:39.262+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:39.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:39 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:39.262+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:39.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:39 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:39.800+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:39.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:39 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:39.800+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:39.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:39 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:39.713+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:39.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:39 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:39.713+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:39.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:39 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:39.617+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:39.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:39 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:39.617+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:01.406530+0000 front 2024-05-09T01:19:01.406495+0000 (oldest deadline 2024-05-09T01:19:34.907918+0000) 2024-05-09T01:19:40.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:40 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:40.158+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:40.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:40 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:40.158+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:40.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:40 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:40.158+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:40.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:40 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:40.060+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:40.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:40 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:40.060+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:40.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:40 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:40.060+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:40.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:40 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:40.342+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:40.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:40 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:40.230+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:40.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:40 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:40.230+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:40.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:40 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:40.230+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:40.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:40 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:40.772+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:40.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:40 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:40.772+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:40.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:40 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:40.573+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:40.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:40 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:40.573+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:01.406530+0000 front 2024-05-09T01:19:01.406495+0000 (oldest deadline 2024-05-09T01:19:34.907918+0000) 2024-05-09T01:19:40.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:40 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:40.685+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:40.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:40 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:40.686+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:41.373 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:41 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:41.148+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:41.374 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:41 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:41.148+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:41.374 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:41 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:41.148+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:41.374 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:41 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:41.045+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:41.374 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:41 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:41.045+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:41.374 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:41 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:41.045+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:41.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:41 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:41.306+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:41.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:41 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:41.306+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:41.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:41 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:41.231+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:41.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:41 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:41.231+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:41.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:41 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:41.231+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:41.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:41 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:41.770+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:41.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:41 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:41.770+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:41.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:41 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:41.704+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:41.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:41 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:41.704+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:41.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:41 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:41.568+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:52.005745+0000 front 2024-05-09T01:18:52.005599+0000 (oldest deadline 2024-05-09T01:19:21.406076+0000) 2024-05-09T01:19:41.974 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:41 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5[46452]: 2024-05-09T01:19:41.568+0000 7f0833a2d700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:01.406530+0000 front 2024-05-09T01:19:01.406495+0000 (oldest deadline 2024-05-09T01:19:34.907918+0000) 2024-05-09T01:19:42.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:42.024+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:42.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:42.024+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:42.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:42.024+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:42.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:42.170+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:42.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:42.170+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:42.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:42.170+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:42.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:42 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:42.305+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:42.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:42 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:42.305+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:42.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:42 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:42.234+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:42.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:42 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:42.234+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:42.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:42 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:42.234+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:42.973 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:42 smithi151 podman[72405]: 2024-05-09 01:19:42.772464548 +0000 UTC m=+5.885376844 container died 0f8f809df8bbc7daa2ae7145af7dd110f32e16a988c9096ceb5aa5e7ac513d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-09T01:19:42.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:42 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:42.698+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:42.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:42 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:42.698+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:42.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:42 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:42.759+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:42.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:42 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:42.759+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:43.465 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:43 smithi151 podman[72405]: 2024-05-09 01:19:43.128983814 +0000 UTC m=+6.241896150 container cleanup 0f8f809df8bbc7daa2ae7145af7dd110f32e16a988c9096ceb5aa5e7ac513d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-09T01:19:43.465 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:43 smithi151 bash[72405]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5 2024-05-09T01:19:43.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:43.219+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:43.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:43.219+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:43.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:43.219+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:43.472 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:43.013+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:43.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:43.013+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:43.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:43.013+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:43.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:43.287+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:43.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:43.287+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:43.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:43.199+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:43.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:43.199+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:43.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:43 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:43.199+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:43.723 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:43 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:43.676+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:43.723 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:43 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:43.676+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:43.723 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:43 smithi151 podman[72424]: 2024-05-09 01:19:43.466904825 +0000 UTC m=+0.689478597 container remove 0f8f809df8bbc7daa2ae7145af7dd110f32e16a988c9096ceb5aa5e7ac513d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-09T01:19:44.067 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:43 smithi151 podman[72518]: 2024-05-09 01:19:43.697860956 +0000 UTC m=+0.018274534 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:19:44.067 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:43 smithi151 podman[72518]: 2024-05-09 01:19:43.824012555 +0000 UTC m=+0.144426121 container create f3819e4b1969a090672820ea744b9db5d4b9948176d200b9f6088b504293fbae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-09T01:19:44.067 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:43 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:43.758+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:44.067 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:43 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:43.758+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:44.067 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:43 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:43.758+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:44.222 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:43.972+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:44.222 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:43.972+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:44.223 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:43 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:43.972+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:44.365 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:44 smithi151 podman[72518]: 2024-05-09 01:19:44.068960554 +0000 UTC m=+0.389374124 container init f3819e4b1969a090672820ea744b9db5d4b9948176d200b9f6088b504293fbae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-09T01:19:44.365 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:44 smithi151 podman[72518]: 2024-05-09 01:19:44.072646733 +0000 UTC m=+0.393060295 container start f3819e4b1969a090672820ea744b9db5d4b9948176d200b9f6088b504293fbae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:19:44.366 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:44 smithi151 podman[72518]: 2024-05-09 01:19:44.14387091 +0000 UTC m=+0.464284485 container attach f3819e4b1969a090672820ea744b9db5d4b9948176d200b9f6088b504293fbae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:19:44.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:44 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:44.316+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:44.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:44 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:44.316+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:44.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:44 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:44.222+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:44.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:44 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:44.222+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:44.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:44 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:44.222+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:44.642 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 09 01:19:44 smithi151 podman[72518]: 2024-05-09 01:19:44.367458382 +0000 UTC m=+0.687871942 container died f3819e4b1969a090672820ea744b9db5d4b9948176d200b9f6088b504293fbae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-09T01:19:44.722 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:44.239+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:44.722 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:44.239+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:44.722 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:44.239+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:44.954 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:44 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:44.707+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:44.955 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:44 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:44.707+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:44.955 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:44 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:44.770+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:44.955 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:44 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:44.770+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:44.955 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:44 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:44.770+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:44.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.5.service' 2024-05-09T01:19:45.015 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:19:45.015 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-09T01:19:45.016 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-09T01:19:45.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.6 2024-05-09T01:19:45.222 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:44.943+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:45.222 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:44.943+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:45.222 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:44 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:44.943+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:45.222 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:45 smithi037 systemd[1]: Stopping Ceph osd.6 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:19:45.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:45 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:45.295+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:45.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:45 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:45.295+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:45.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:45 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:45.210+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:45.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:45 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:45.210+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:45.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:45 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:45.210+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:45.722 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:45.332+0000 7f1ac5cf9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:19:45.722 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:45.332+0000 7f1ac5cf9700 -1 osd.6 84 *** Got signal Terminated *** 2024-05-09T01:19:45.722 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:45.332+0000 7f1ac5cf9700 -1 osd.6 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:19:45.722 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:45.228+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:45.722 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:45.228+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:45.722 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:45.228+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:45.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:45 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:45.719+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:45.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:45 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:45.719+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:45.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:45 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:45.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:45.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:45 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:45.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:45.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:45 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:45.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:46.204 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:45.947+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:46.205 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:45.947+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:46.205 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:45.947+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:46.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:46.205+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:46.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:46.205+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:46.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:46.205+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:46.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:46 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:46.252+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:46.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:46 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:46.252+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:46.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:46 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:46.243+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:46.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:46 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:46.243+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:46.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:46 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:46.243+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:47.219 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:46.947+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:47.219 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:46.947+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:47.219 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:46 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:46.947+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:47.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:46 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:46.731+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:47.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:46 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:46.731+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:47.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:46 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:46.845+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:47.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:46 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:46.845+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:47.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:46 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:46.845+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:47.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:47.219+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:47.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:47.220+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:47.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:47.220+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:47.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:47 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:47.259+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:47.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:47 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:47.259+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:47.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:47 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:47.247+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:47.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:47 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:47.247+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:47.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:47 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:47.247+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:47.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:47 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:47.247+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:48.222 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:48.187+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:48.222 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:48.187+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:48.222 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:48.187+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:48.222 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:47.959+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:48.223 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:47.959+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:48.223 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:47 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:47.959+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:48.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:47 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:47.758+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:48.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:47 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:47.758+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:48.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:47 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:47.758+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:48.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:47 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:47.881+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:48.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:47 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:47.881+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:48.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:47 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:47.881+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:48.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:48.262+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:48.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:48.262+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:48.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:48.248+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:48.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:48.248+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:48.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:48.248+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:48.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:48 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:48.248+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:49.162 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:48.910+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:49.162 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:48.910+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:49.162 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:48.910+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:49.162 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:48 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:48.910+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:22.256840+0000 front 2024-05-09T01:19:22.256931+0000 (oldest deadline 2024-05-09T01:19:48.157060+0000) 2024-05-09T01:19:49.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:48 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:48.756+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:49.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:48 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:48.756+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:49.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:48 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:48.756+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:49.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:48 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:48.867+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:49.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:48 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:48.867+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:49.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:48 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:48.867+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:49.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:48 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:48.867+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:49.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:49.163+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:49.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:49.163+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:49.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:49.163+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:49.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:49.163+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:49.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:49 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:49.248+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:49.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:49 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:49.248+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:49.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:49 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:49.264+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:49.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:49 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:49.264+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:49.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:49 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:49.264+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:49.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:49 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:49.264+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:50.157 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:49.880+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:54.252028+0000 front 2024-05-09T01:18:54.252055+0000 (oldest deadline 2024-05-09T01:19:22.953584+0000) 2024-05-09T01:19:50.157 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:49.880+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.254414+0000 front 2024-05-09T01:19:05.254466+0000 (oldest deadline 2024-05-09T01:19:34.055316+0000) 2024-05-09T01:19:50.157 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:49.880+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:14.056111+0000 front 2024-05-09T01:19:14.055847+0000 (oldest deadline 2024-05-09T01:19:38.755880+0000) 2024-05-09T01:19:50.158 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:49 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6[56118]: 2024-05-09T01:19:49.880+0000 7f1abe2a7700 -1 osd.6 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:22.256840+0000 front 2024-05-09T01:19:22.256931+0000 (oldest deadline 2024-05-09T01:19:48.157060+0000) 2024-05-09T01:19:50.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:49 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:49.788+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:50.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:49 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:49.788+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:50.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:49 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:49.788+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:50.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:49 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:49.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:50.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:49 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:49.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:50.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:49 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:49.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:50.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:49 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:49.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:50.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:50 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:50.158+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:50.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:50 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:50.158+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:50.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:50 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:50.158+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:50.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:50 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:50.158+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:50.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:50.290+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:50.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:50.290+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:50.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:50.290+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:50.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:50.275+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:50.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:50.275+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:50.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:50.275+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:50.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:50.275+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:51.124 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:50 smithi037 podman[119166]: 2024-05-09 01:19:50.838125122 +0000 UTC m=+5.620160304 container died 95755ee791bc56bbc1c803d10fe3d59fe75e3b4cbd5065d70d3a80f1fa60b553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-09T01:19:51.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:50 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:50.750+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:51.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:50 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:50.750+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:51.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:50 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:50.750+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:51.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:50 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:50.826+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:51.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:50 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:50.826+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:51.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:50 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:50.826+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:51.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:50 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:50.826+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:51.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:51 smithi037 podman[119166]: 2024-05-09 01:19:51.257868864 +0000 UTC m=+6.039904045 container cleanup 95755ee791bc56bbc1c803d10fe3d59fe75e3b4cbd5065d70d3a80f1fa60b553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True) 2024-05-09T01:19:51.473 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:51 smithi037 bash[119166]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6 2024-05-09T01:19:51.474 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:51 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:51.125+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:51.474 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:51 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:51.125+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:51.474 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:51 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:51.125+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:51.474 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:51 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:51.125+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:51.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:51 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:51.250+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:51.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:51 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:51.250+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:51.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:51 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:51.250+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:51.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:51 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:51.292+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:51.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:51 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:51.292+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:51.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:51 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:51.292+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:51.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:51 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:51.292+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:51.891 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:51 smithi037 podman[119185]: 2024-05-09 01:19:51.484251712 +0000 UTC m=+0.637668147 container remove 95755ee791bc56bbc1c803d10fe3d59fe75e3b4cbd5065d70d3a80f1fa60b553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T01:19:51.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:51 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:51.706+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:51.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:51 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:51.706+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:51.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:51 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:51.707+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:51.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:51 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:51.845+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:51.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:51 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:51.845+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:51.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:51 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:51.845+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:51.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:51 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:51.845+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:52.159 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:51 smithi037 podman[119275]: 2024-05-09 01:19:51.893331717 +0000 UTC m=+0.110538835 container create e9c2ac62f1944a57c77b8ef9245f7acc0046f9854363c6870aee44507779f503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-09T01:19:52.159 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:51 smithi037 podman[119275]: 2024-05-09 01:19:51.801633763 +0000 UTC m=+0.018840860 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:19:52.159 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:52 smithi037 podman[119275]: 2024-05-09 01:19:52.137245908 +0000 UTC m=+0.354452985 container init e9c2ac62f1944a57c77b8ef9245f7acc0046f9854363c6870aee44507779f503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:19:52.159 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:52 smithi037 podman[119275]: 2024-05-09 01:19:52.140737509 +0000 UTC m=+0.357944587 container start e9c2ac62f1944a57c77b8ef9245f7acc0046f9854363c6870aee44507779f503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-09T01:19:52.442 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:52 smithi037 podman[119275]: 2024-05-09 01:19:52.25420648 +0000 UTC m=+0.471413569 container attach e9c2ac62f1944a57c77b8ef9245f7acc0046f9854363c6870aee44507779f503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-09T01:19:52.442 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:52 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:52.159+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:52.442 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:52 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:52.159+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:52.442 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:52 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:52.159+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:52.442 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:52 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:52.159+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:52.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:52 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:52.243+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:52.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:52 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:52.243+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:52.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:52 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:52.243+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:52.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:52 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:52.265+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:52.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:52 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:52.265+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:52.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:52 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:52.265+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:52.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:52 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:52.265+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:52.717 INFO:journalctl@ceph.osd.6.smithi037.stdout:May 09 01:19:52 smithi037 podman[119275]: 2024-05-09 01:19:52.444189659 +0000 UTC m=+0.661396739 container died e9c2ac62f1944a57c77b8ef9245f7acc0046f9854363c6870aee44507779f503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-05-09T01:19:52.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:52 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:52.703+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:52.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:52 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:52.703+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:52.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:52 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:52.703+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:52.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:52 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:52.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:52.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:52 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:52.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:52.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:52 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:52.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:52.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:52 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:52.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:53.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.6.service' 2024-05-09T01:19:53.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:19:53.180 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-09T01:19:53.180 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-09T01:19:53.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.7 2024-05-09T01:19:53.407 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:53 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:53.136+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:53.407 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:53 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:53.136+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:53.407 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:53 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:53.136+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:53.407 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:53 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:53.136+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:53.486 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:53.236+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:53.486 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:53.236+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:53.486 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:53.236+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:53.486 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:53.236+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:53.486 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:53 smithi136 systemd[1]: Stopping Ceph osd.7 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:19:53.487 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:53.254+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:53.487 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:53.254+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:53.487 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:53.254+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:53.487 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:53.487+0000 7f715cf59700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:19:53.487 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:53.487+0000 7f715cf59700 -1 osd.7 84 *** Got signal Terminated *** 2024-05-09T01:19:53.487 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:53.487+0000 7f715cf59700 -1 osd.7 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:19:54.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:53 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:53.726+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:54.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:53 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:53.726+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:54.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:53 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:53.726+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:54.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:53 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:53.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:54.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:53 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:53.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:54.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:53 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:53.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:54.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:53 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:53.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:54.396 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:54 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:54.138+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:54.396 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:54 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:54.138+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:54.396 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:54 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:54.138+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:54.396 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:54 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:54.138+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:54.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:54 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:54.304+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:54.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:54 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:54.304+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:54.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:54 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:54.304+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:54.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:54 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:54.212+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:54.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:54 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:54.212+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:54.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:54 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:54.212+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:54.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:54 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:54.212+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:54.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:54 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:54.691+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:54.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:54 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:54.691+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:54.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:54 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:54.691+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:54.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:54 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:54.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:54.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:54 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:54.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:54.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:54 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:54.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:54.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:54 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:54.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:55.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:55 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:55.102+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:55.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:55 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:55.102+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:55.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:55 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:55.102+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:55.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:55 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:55.102+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:55.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:55 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:55.346+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:55.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:55 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:55.346+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:55.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:55 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:55.346+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:55.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:55 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:55.192+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:55.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:55 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:55.192+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:55.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:55 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:55.192+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:55.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:55 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:55.192+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:55.911 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:55 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:55.661+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:55.911 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:55 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:55.661+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:55.911 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:55 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:55.661+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:56.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:55 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:55.912+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:56.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:55 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:55.912+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:56.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:55 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:55.912+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:56.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:55 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:55.912+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:56.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:56.143+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:56.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:56.143+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:56.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:56.143+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:56.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:56.143+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:56.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:56 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:56.143+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:19:56.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:56.229+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:56.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:56.229+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:56.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:56.229+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:56.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:56.229+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:56.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:56.379+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:56.627 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:56.379+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:56.627 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:56.379+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:56.627 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:56 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:56.379+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.541743+0000 front 2024-05-09T01:19:33.541696+0000 (oldest deadline 2024-05-09T01:19:55.841745+0000) 2024-05-09T01:19:56.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:56.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:56.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:56.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:56.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:56.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:56.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:56.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:56.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:56.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:19:56.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:56.639+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:56.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:56.639+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:56.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:56.639+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:56.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:56 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:56.639+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:19:57.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:57 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:57.146+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:57.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:57 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:57.146+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:57.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:57 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:57.146+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:57.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:57 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:57.146+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:57.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:57 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:57.146+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:19:57.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:57.366+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:57.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:57.366+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:57.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:57.366+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:57.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:57.366+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.541743+0000 front 2024-05-09T01:19:33.541696+0000 (oldest deadline 2024-05-09T01:19:55.841745+0000) 2024-05-09T01:19:57.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:57.235+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:57.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:57.235+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:57.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:57.235+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:57.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:57.235+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:57.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:57.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:57.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:57.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:57.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:57.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:57.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:57.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:19:57.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:57.850+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:57.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:57.850+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:57.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:57.850+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:57.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:57.850+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:57.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:57 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:57.850+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:19:58.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:58 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:58.116+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:58.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:58 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:58.116+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:58.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:58 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:58.116+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:58.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:58 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:58.116+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:58.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:58 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:58.116+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:19:58.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:58.381+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:05.136025+0000 front 2024-05-09T01:19:05.136056+0000 (oldest deadline 2024-05-09T01:19:35.037174+0000) 2024-05-09T01:19:58.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:58.381+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:16.738310+0000 front 2024-05-09T01:19:16.738325+0000 (oldest deadline 2024-05-09T01:19:40.739033+0000) 2024-05-09T01:19:58.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:58.381+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:25.440366+0000 front 2024-05-09T01:19:25.440535+0000 (oldest deadline 2024-05-09T01:19:50.040793+0000) 2024-05-09T01:19:58.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7[52183]: 2024-05-09T01:19:58.381+0000 7f715950f700 -1 osd.7 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.541743+0000 front 2024-05-09T01:19:33.541696+0000 (oldest deadline 2024-05-09T01:19:55.841745+0000) 2024-05-09T01:19:58.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:58.222+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:58.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:58.222+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:58.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:58.222+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:58.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:58 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:58.222+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:58.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:58.638+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:58.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:58.638+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:58.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:58.638+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:58.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:58.638+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:19:58.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:58.871+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:58.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:58.871+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:58.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:58.871+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:58.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:58.871+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:58.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:58 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:58.871+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:19:59.218 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:58 smithi136 podman[70787]: 2024-05-09 01:19:58.895172444 +0000 UTC m=+5.514461840 container died cfec0b5ecead3c7ecd264605133ceecafd6acad7d7319e28dde821dd511827a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-09T01:19:59.218 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:59 smithi136 podman[70787]: 2024-05-09 01:19:59.220575946 +0000 UTC m=+5.839865384 container cleanup cfec0b5ecead3c7ecd264605133ceecafd6acad7d7319e28dde821dd511827a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2) 2024-05-09T01:19:59.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:59 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:59.068+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:19:59.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:59 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:59.068+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:19:59.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:59 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:59.068+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:19:59.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:59 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:59.068+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:19:59.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:19:59 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:19:59.068+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:19:59.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:59 smithi136 bash[70787]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7 2024-05-09T01:19:59.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:59 smithi136 podman[70804]: 2024-05-09 01:19:59.430097762 +0000 UTC m=+0.531058262 container remove cfec0b5ecead3c7ecd264605133ceecafd6acad7d7319e28dde821dd511827a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T01:19:59.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:59 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:59.249+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:19:59.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:59 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:59.249+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:19:59.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:59 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:59.249+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:19:59.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:59 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:59.249+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:19:59.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:19:59 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:19:59.249+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:19:59.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:59.885+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:19:59.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:59.885+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:19:59.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:59.885+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:19:59.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:59.885+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:19:59.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:19:59.885+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:19:59.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:59.655+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:19:59.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:59.655+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:19:59.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:59.655+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:19:59.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:19:59 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:19:59.655+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:20:00.126 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:59 smithi136 podman[70894]: 2024-05-09 01:19:59.831045733 +0000 UTC m=+0.101269284 container create 7c31412c6b749fcd6c7efb70c2d7b107070b0498ac7970235d3201ebf44eeb38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:00.126 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:19:59 smithi136 podman[70894]: 2024-05-09 01:19:59.748026162 +0000 UTC m=+0.018249715 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:20:00.126 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:20:00 smithi136 podman[70894]: 2024-05-09 01:20:00.008346724 +0000 UTC m=+0.278570283 container init 7c31412c6b749fcd6c7efb70c2d7b107070b0498ac7970235d3201ebf44eeb38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:20:00.126 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:20:00 smithi136 podman[70894]: 2024-05-09 01:20:00.011549404 +0000 UTC m=+0.281772957 container start 7c31412c6b749fcd6c7efb70c2d7b107070b0498ac7970235d3201ebf44eeb38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:00.126 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:20:00 smithi136 podman[70894]: 2024-05-09 01:20:00.075021528 +0000 UTC m=+0.345245091 container attach 7c31412c6b749fcd6c7efb70c2d7b107070b0498ac7970235d3201ebf44eeb38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:20:00.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:00 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:00.055+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:00.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:00 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:00.055+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:00.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:00 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:00.055+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:00.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:00 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:00.055+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:00.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:00 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:00.055+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:00.626 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:20:00 smithi136 podman[70894]: 2024-05-09 01:20:00.315192556 +0000 UTC m=+0.585416109 container died 7c31412c6b749fcd6c7efb70c2d7b107070b0498ac7970235d3201ebf44eeb38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-09T01:20:00.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:00.296+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:00.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:00.296+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:00.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:00.296+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:00.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:00.296+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:00.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:00 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:00.296+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:00.924 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:00.636+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:20:00.925 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:00.636+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:20:00.925 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:00.636+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:20:00.925 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:00.636+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:20:00.931 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 09 01:20:00 smithi136 podman[70921]: 2024-05-09 01:20:00.912226446 +0000 UTC m=+0.591357245 container remove 7c31412c6b749fcd6c7efb70c2d7b107070b0498ac7970235d3201ebf44eeb38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0) 2024-05-09T01:20:00.937 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.7.service' 2024-05-09T01:20:00.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:00.976 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-09T01:20:00.976 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-09T01:20:00.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.8 2024-05-09T01:20:01.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 systemd[1]: Stopping Ceph osd.8 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:01.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:00.926+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:01.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:00.926+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:01.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:00.926+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:01.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:00.926+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:01.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:00 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:00.926+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:01.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:01.030+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:01.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:01.030+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:01.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:01.030+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:01.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:01.030+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:01.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:01 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:01.030+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:01.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:01 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:01.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:01.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:01 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:01.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:01.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:01 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:01.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:01.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:01 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:01.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:01.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:01 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:01.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:01.658 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:01.284+0000 7f6560f24700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:01.658 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:01.284+0000 7f6560f24700 -1 osd.8 84 *** Got signal Terminated *** 2024-05-09T01:20:01.658 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:01.284+0000 7f6560f24700 -1 osd.8 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:20:01.658 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:01.659+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:20:01.659 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:01.659+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:20:01.659 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:01.659+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:20:01.659 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:01.659+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:20:01.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:01.884+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:01.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:01.884+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:01.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:01.884+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:01.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:01.884+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:01.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:01 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:01.884+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:02.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:02 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:02.029+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:02.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:02 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:02.029+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:02.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:02 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:02.029+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:02.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:02 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:02.029+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:02.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:02 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:02.029+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:02.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:02 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:02.308+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:02.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:02 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:02.308+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:02.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:02 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:02.308+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:02.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:02 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:02.308+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:02.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:02 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:02.308+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:02.907 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:02.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:20:02.908 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:02.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:20:02.908 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:02.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:20:02.908 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:02.649+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:20:03.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:02.909+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:03.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:02.909+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:03.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:02.909+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:03.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:02.909+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:03.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:02 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:02.909+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:03.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.025+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:03.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.025+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:03.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.025+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:03.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.025+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:03.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.025+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:03.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:03 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:03.335+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:03.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:03 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:03.335+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:03.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:03 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:03.335+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:03.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:03 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:03.335+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:03.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:03 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:03.335+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:03.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:03.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:03.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:03.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:03.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:03.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:03.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:03.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:03.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:03.875+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:03.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:03.674+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:20:03.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:03.674+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:20:03.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:03.674+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:20:03.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:03 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:03.674+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:20:04.222 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.998+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:04.222 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.998+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:04.223 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.998+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:04.223 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.998+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:04.223 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:03 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:03.998+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:04.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:04 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:04.347+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:04.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:04 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:04.347+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:04.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:04 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:04.347+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:04.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:04 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:04.347+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:04.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:04 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:04.347+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:04.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:04.723+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:20:04.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:04.723+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:20:04.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:04.723+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:20:04.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:04.723+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:20:04.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:04.855+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:04.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:04.855+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:04.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:04.855+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:04.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:04.855+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:04.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:04 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:04.855+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:05.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:05 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:05.006+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:05.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:05 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:05.006+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:05.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:05 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:05.006+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:05.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:05 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:05.006+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:05.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:05 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:05.006+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:05.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:05 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:05.006+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:05.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:05 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:05.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:05.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:05 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:05.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:05.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:05 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:05.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:05.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:05 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:05.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:05.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:05 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:05.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:05.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:05 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:05.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:05.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:05.695+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.070891+0000 front 2024-05-09T01:19:04.070913+0000 (oldest deadline 2024-05-09T01:19:32.271854+0000) 2024-05-09T01:20:05.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:05.695+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.772687+0000 front 2024-05-09T01:19:15.772654+0000 (oldest deadline 2024-05-09T01:19:38.672824+0000) 2024-05-09T01:20:05.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:05.695+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:24.474259+0000 front 2024-05-09T01:19:24.474518+0000 (oldest deadline 2024-05-09T01:19:46.774258+0000) 2024-05-09T01:20:05.973 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8[53322]: 2024-05-09T01:20:05.695+0000 7f65594d2700 -1 osd.8 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:30.676270+0000 front 2024-05-09T01:19:30.676294+0000 (oldest deadline 2024-05-09T01:19:56.576350+0000) 2024-05-09T01:20:05.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:05.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:05.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:05.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:05.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:05.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:05.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:05.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:05.974 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:05.868+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:06.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:06 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:06.054+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:06.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:06 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:06.054+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:06.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:06 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:06.054+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:06.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:06 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:06.054+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:06.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:06 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:06.054+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:06.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:06 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:06.054+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:06.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:06 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:06.297+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:06.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:06 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:06.297+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:06.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:06 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:06.297+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:06.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:06 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:06.297+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:06.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:06 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:06.297+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:06.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:06 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:06.297+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:06.951 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:06 smithi151 podman[72637]: 2024-05-09 01:20:06.699364383 +0000 UTC m=+5.530422794 container died 4f3cca232003936d70c59fe66a99f383e284f0cebb5fdaab6c2bc17ce3cfb897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-09T01:20:06.951 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:06 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:06.849+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:06.951 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:06 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:06.849+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:06.951 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:06 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:06.849+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:06.951 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:06 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:06.849+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:06.951 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:06 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:06.849+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:06.951 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:06 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:06.849+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:07.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:07 smithi151 podman[72637]: 2024-05-09 01:20:07.02716533 +0000 UTC m=+5.858223738 container cleanup 4f3cca232003936d70c59fe66a99f383e284f0cebb5fdaab6c2bc17ce3cfb897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:20:07.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:07 smithi151 bash[72637]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8 2024-05-09T01:20:07.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:07 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:07.060+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:07.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:07 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:07.060+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:07.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:07 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:07.060+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:07.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:07 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:07.060+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:07.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:07 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:07.060+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:07.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:07 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:07.060+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:07.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:07 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:07.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:07.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:07 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:07.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:07.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:07 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:07.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:07.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:07 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:07.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:07.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:07 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:07.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:07.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:07 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:07.321+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:07.641 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:07 smithi151 podman[72656]: 2024-05-09 01:20:07.228595969 +0000 UTC m=+0.530925565 container remove 4f3cca232003936d70c59fe66a99f383e284f0cebb5fdaab6c2bc17ce3cfb897 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:07.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:07 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:07.843+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:07.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:07 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:07.843+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:07.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:07 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:07.843+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:07.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:07 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:07.843+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:07.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:07 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:07.843+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:07.973 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:07 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:07.843+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:07.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:07 smithi151 podman[72748]: 2024-05-09 01:20:07.546921069 +0000 UTC m=+0.018035044 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:20:07.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:07 smithi151 podman[72748]: 2024-05-09 01:20:07.654630426 +0000 UTC m=+0.125744416 container create 626c9a0ad0b6e3554d7f3172e5d620e8707c799a7d2919e378640dbde3909862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-09T01:20:07.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:07 smithi151 podman[72748]: 2024-05-09 01:20:07.866860578 +0000 UTC m=+0.337974528 container init 626c9a0ad0b6e3554d7f3172e5d620e8707c799a7d2919e378640dbde3909862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8-deactivate, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-09T01:20:07.974 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:07 smithi151 podman[72748]: 2024-05-09 01:20:07.870134202 +0000 UTC m=+0.341248153 container start 626c9a0ad0b6e3554d7f3172e5d620e8707c799a7d2919e378640dbde3909862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:08.447 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:08 smithi151 podman[72748]: 2024-05-09 01:20:08.019263338 +0000 UTC m=+0.490377289 container attach 626c9a0ad0b6e3554d7f3172e5d620e8707c799a7d2919e378640dbde3909862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-09T01:20:08.447 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 09 01:20:08 smithi151 podman[72748]: 2024-05-09 01:20:08.163127377 +0000 UTC m=+0.634241333 container died 626c9a0ad0b6e3554d7f3172e5d620e8707c799a7d2919e378640dbde3909862 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-09T01:20:08.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:08.027+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:08.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:08.027+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:08.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:08.027+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:08.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:08.027+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:08.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:08.027+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:08.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:08 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:08.027+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:08.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:08 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:08.313+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:08.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:08 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:08.313+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:08.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:08 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:08.313+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:08.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:08 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:08.313+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:08.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:08 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:08.313+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:08.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:08 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:08.313+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:08.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.8.service' 2024-05-09T01:20:08.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:08.788 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-09T01:20:08.788 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-09T01:20:08.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.9 2024-05-09T01:20:09.109 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:08 smithi037 systemd[1]: Stopping Ceph osd.9 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:09.109 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.020+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:09.109 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.020+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:09.109 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.020+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:09.109 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.020+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:09.109 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.020+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:09.109 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.020+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:09.110 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.109+0000 7fcd084ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:09.110 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.109+0000 7fcd084ea700 -1 osd.9 84 *** Got signal Terminated *** 2024-05-09T01:20:09.110 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:09 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:09.109+0000 7fcd084ea700 -1 osd.9 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:20:09.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:08 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:08.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:09.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:08 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:08.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:09.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:08 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:08.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:09.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:08 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:08.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:09.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:08 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:08.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:09.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:08 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:08.833+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:09.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:09 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:09.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:09.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:09 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:09.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:09.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:09 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:09.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:09.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:09 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:09.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:09.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:09 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:09.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:09.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:09 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:09.337+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:10.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:09.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:10.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:09.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:10.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:09.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:10.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:09.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:10.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:09.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:10.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:09.796+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:10.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:10 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:10.004+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:10.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:10 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:10.004+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:10.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:10 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:10.004+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:10.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:10 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:10.004+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:10.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:10 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:10.004+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:10.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:10 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:10.004+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:10.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:10 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:10.376+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:10.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:10 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:10.376+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:10.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:10 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:10.376+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:10.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:10 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:10.376+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:10.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:10 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:10.376+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:10.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:10 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:10.376+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:11.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:10 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:10.838+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:11.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:10 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:10.838+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:11.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:10 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:10.838+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:11.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:10 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:10.838+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:11.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:10 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:10.838+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:11.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:10 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:10.838+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:11.373 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.003+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:11.374 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.003+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:11.374 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.003+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:11.374 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.003+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:11.374 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.003+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:11.374 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.003+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:11.698 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:11 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:11.416+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:11.698 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:11 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:11.416+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:11.698 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:11 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:11.416+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:11.698 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:11 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:11.416+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:11.698 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:11 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:11.416+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:11.698 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:11 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:11.416+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:12.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:11 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:11.794+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:12.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:11 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:11.794+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:12.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:11 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:11.794+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:12.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:11 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:11.794+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:12.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:11 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:11.794+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:12.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:11 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:11.794+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:12.390 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.983+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:12.390 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.983+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:12.390 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.983+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:12.390 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.983+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:12.391 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.983+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:12.391 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.983+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:12.391 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:11 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:11.983+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:47.528464+0000 front 2024-05-09T01:19:47.528440+0000 (oldest deadline 2024-05-09T01:20:11.628477+0000) 2024-05-09T01:20:12.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:12 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:12.431+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:12.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:12 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:12.431+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:12.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:12 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:12.431+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:12.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:12 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:12.431+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:12.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:12 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:12.431+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:12.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:12 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:12.431+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:13.125 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:12 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:12.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:13.125 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:12 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:12.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:13.125 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:12 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:12.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:13.125 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:12 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:12.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:13.125 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:12 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:12.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:13.125 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:12 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:12.839+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:13.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:13.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:13.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:13.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:13.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:13.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:13.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:13.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:13.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:13.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:13.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:13.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:13.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:13 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:13.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:47.528464+0000 front 2024-05-09T01:19:47.528440+0000 (oldest deadline 2024-05-09T01:20:11.628477+0000) 2024-05-09T01:20:13.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:13 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:13.457+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:13.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:13 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:13.457+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:13.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:13 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:13.457+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:13.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:13 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:13.457+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:13.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:13 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:13.457+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:13.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:13 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:13.457+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:14.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:13.811+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:14.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:13.811+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:14.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:13.811+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:14.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:13.811+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:14.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:13.811+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:14.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:13.811+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:14.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:14.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:50.319347+0000 front 2024-05-09T01:18:50.319372+0000 (oldest deadline 2024-05-09T01:19:20.820553+0000) 2024-05-09T01:20:14.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:14.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:00.821051+0000 front 2024-05-09T01:19:00.821079+0000 (oldest deadline 2024-05-09T01:19:32.522346+0000) 2024-05-09T01:20:14.472 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:14.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:15.423318+0000 front 2024-05-09T01:19:15.423287+0000 (oldest deadline 2024-05-09T01:19:40.123476+0000) 2024-05-09T01:20:14.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:14.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.624540+0000 front 2024-05-09T01:19:23.624659+0000 (oldest deadline 2024-05-09T01:19:48.924766+0000) 2024-05-09T01:20:14.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:14.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.825887+0000 front 2024-05-09T01:19:31.825934+0000 (oldest deadline 2024-05-09T01:19:55.926009+0000) 2024-05-09T01:20:14.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:14.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:39.427031+0000 front 2024-05-09T01:19:39.427096+0000 (oldest deadline 2024-05-09T01:20:04.127033+0000) 2024-05-09T01:20:14.473 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9[62705]: 2024-05-09T01:20:14.012+0000 7fcd04aa0700 -1 osd.9 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:47.528464+0000 front 2024-05-09T01:19:47.528440+0000 (oldest deadline 2024-05-09T01:20:11.628477+0000) 2024-05-09T01:20:14.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:14 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:14.470+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:14.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:14 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:14.470+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:14.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:14 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:14.470+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:14.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:14 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:14.470+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:14.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:14 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:14.470+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:14.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:14 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:14.470+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:14.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:14 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:14.470+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:14.972 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:14 smithi037 podman[119393]: 2024-05-09 01:20:14.711067968 +0000 UTC m=+5.710854712 container died 6557de925d50f6c5219d1fc02d5cd2c36804895ecd790856b62dbe2ccbef1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:20:15.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:14 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:14.791+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:15.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:14 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:14.791+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:15.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:14 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:14.791+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:15.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:14 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:14.791+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:15.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:14 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:14.791+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:15.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:14 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:14.791+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:15.283 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:15 smithi037 podman[119393]: 2024-05-09 01:20:15.271077202 +0000 UTC m=+6.270863985 container cleanup 6557de925d50f6c5219d1fc02d5cd2c36804895ecd790856b62dbe2ccbef1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:15.283 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:15 smithi037 bash[119393]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9 2024-05-09T01:20:15.843 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:15 smithi037 podman[119422]: 2024-05-09 01:20:15.511425116 +0000 UTC m=+0.798948948 container remove 6557de925d50f6c5219d1fc02d5cd2c36804895ecd790856b62dbe2ccbef1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-09T01:20:15.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:15.462+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:15.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:15.462+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:15.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:15.462+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:15.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:15.462+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:15.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:15.462+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:15.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:15.462+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:15.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:15 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:15.462+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:16.129 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:15 smithi037 podman[119513]: 2024-05-09 01:20:15.845576909 +0000 UTC m=+0.109917599 container create c5d49362f2c8b27947347d1e7c2f45b358645b6b54f12cf48b0587b276651cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True) 2024-05-09T01:20:16.129 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:15 smithi037 podman[119513]: 2024-05-09 01:20:15.753982933 +0000 UTC m=+0.018323595 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:20:16.129 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:16 smithi037 podman[119513]: 2024-05-09 01:20:16.072688225 +0000 UTC m=+0.337028872 container init c5d49362f2c8b27947347d1e7c2f45b358645b6b54f12cf48b0587b276651cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:20:16.129 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:16 smithi037 podman[119513]: 2024-05-09 01:20:16.076186355 +0000 UTC m=+0.340527004 container start c5d49362f2c8b27947347d1e7c2f45b358645b6b54f12cf48b0587b276651cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:20:16.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:15 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:15.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:16.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:15 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:15.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:16.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:15 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:15.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:16.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:15 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:15.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:16.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:15 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:15.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:16.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:15 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:15.829+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:16.387 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:16 smithi037 podman[119513]: 2024-05-09 01:20:16.13098164 +0000 UTC m=+0.395322296 container attach c5d49362f2c8b27947347d1e7c2f45b358645b6b54f12cf48b0587b276651cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-09T01:20:16.665 INFO:journalctl@ceph.osd.9.smithi037.stdout:May 09 01:20:16 smithi037 podman[119513]: 2024-05-09 01:20:16.389793467 +0000 UTC m=+0.654134117 container died c5d49362f2c8b27947347d1e7c2f45b358645b6b54f12cf48b0587b276651cb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-09T01:20:16.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:16 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:16.467+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:16.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:16 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:16.467+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:16.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:16 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:16.467+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:16.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:16 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:16.467+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:16.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:16 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:16.467+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:16.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:16 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:16.467+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:16.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:16 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:16.467+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:16.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.9.service' 2024-05-09T01:20:16.995 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:16.995 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-09T01:20:16.996 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-09T01:20:16.996 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.10 2024-05-09T01:20:17.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:16 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:16.876+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:17.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:16 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:16.876+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:17.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:16 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:16.876+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:17.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:16 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:16.876+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:17.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:16 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:16.876+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:17.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:16 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:16.876+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:17.286 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 systemd[1]: Stopping Ceph osd.10 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:17.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.287+0000 7faf2e339700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:17.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.287+0000 7faf2e339700 -1 osd.10 84 *** Got signal Terminated *** 2024-05-09T01:20:17.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.287+0000 7faf2e339700 -1 osd.10 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:20:17.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.460+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:17.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.460+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:17.626 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.460+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:17.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.460+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:17.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.460+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:17.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.460+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:17.627 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:17 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:17.460+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:18.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:17.904+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:18.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:17.904+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:18.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:17.904+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:18.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:17.904+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:18.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:17.904+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:18.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:17.904+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:18.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:18 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:18.461+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:18.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:18 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:18.461+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:18.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:18 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:18.461+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:18.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:18 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:18.461+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:18.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:18 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:18.461+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:18.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:18 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:18.461+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:18.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:18 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:18.461+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:19.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:18 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:18.908+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:19.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:18 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:18.908+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:19.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:18 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:18.908+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:19.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:18 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:18.908+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:19.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:18 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:18.908+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:19.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:18 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:18.908+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:19.498+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:19.498+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:19.498+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:19.498+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:19.498+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:19.498+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:19.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:19 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:19.498+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:20.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:19.879+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:20.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:19.879+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:20.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:19.879+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:20.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:19.879+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:20.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:19.879+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:20.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:19.879+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:20.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:19 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:19.879+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:20.482+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:20.482+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:20.482+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:20.482+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:20.482+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:20.482+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:20.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:20 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:20.482+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:21.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:20.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:21.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:20.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:21.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:20.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:21.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:20.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:21.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:20.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:21.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:20.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:21.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:20 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:20.863+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:21.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:21.472+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.875937+0000 front 2024-05-09T01:18:53.876276+0000 (oldest deadline 2024-05-09T01:19:18.576114+0000) 2024-05-09T01:20:21.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:21.472+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:03.877222+0000 front 2024-05-09T01:19:03.877133+0000 (oldest deadline 2024-05-09T01:19:31.477718+0000) 2024-05-09T01:20:21.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:21.472+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.279467+0000 front 2024-05-09T01:19:17.279661+0000 (oldest deadline 2024-05-09T01:19:39.579374+0000) 2024-05-09T01:20:21.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:21.472+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.581305+0000 front 2024-05-09T01:19:23.581383+0000 (oldest deadline 2024-05-09T01:19:47.081273+0000) 2024-05-09T01:20:21.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:21.472+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:33.883750+0000 front 2024-05-09T01:19:33.883783+0000 (oldest deadline 2024-05-09T01:19:59.183877+0000) 2024-05-09T01:20:21.877 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:21.472+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:40.884997+0000 front 2024-05-09T01:19:40.885115+0000 (oldest deadline 2024-05-09T01:20:04.984873+0000) 2024-05-09T01:20:21.877 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:21 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10[58915]: 2024-05-09T01:20:21.472+0000 7faf2a8ef700 -1 osd.10 84 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-05-09T01:19:49.686212+0000 front 2024-05-09T01:19:49.686282+0000 (oldest deadline 2024-05-09T01:20:14.386020+0000) 2024-05-09T01:20:22.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:21.886+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:22.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:21.886+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:22.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:21.886+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:22.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:21.886+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:22.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:21.886+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:22.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:21.886+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:22.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:21 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:21.886+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:23.077 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:22 smithi136 podman[71011]: 2024-05-09 01:20:22.743449092 +0000 UTC m=+5.550938296 container died e458312898e53b0777d8c50fe1b6582a2767eea50541ea52dc2c436f438ec928 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-09T01:20:23.078 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 podman[71011]: 2024-05-09 01:20:23.079814171 +0000 UTC m=+5.887303378 container cleanup e458312898e53b0777d8c50fe1b6582a2767eea50541ea52dc2c436f438ec928 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-09T01:20:23.210 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:22.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:23.210 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:22.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:23.210 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:22.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:23.210 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:22.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:23.211 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:22.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:23.211 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:22.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:23.211 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:22 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:22.932+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:23.378 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 bash[71011]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10 2024-05-09T01:20:23.378 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 podman[71032]: 2024-05-09 01:20:23.289403282 +0000 UTC m=+0.544143873 container remove e458312898e53b0777d8c50fe1b6582a2767eea50541ea52dc2c436f438ec928 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=) 2024-05-09T01:20:23.876 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 podman[71119]: 2024-05-09 01:20:23.523022757 +0000 UTC m=+0.018374277 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:20:23.877 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 podman[71119]: 2024-05-09 01:20:23.623400545 +0000 UTC m=+0.118752065 container create 4370cbed7a938ce0126f1b75b8f0a90b2ddaddaf72e30ba31cce9bd73c9748b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True) 2024-05-09T01:20:23.877 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 podman[71119]: 2024-05-09 01:20:23.809058124 +0000 UTC m=+0.304409644 container init 4370cbed7a938ce0126f1b75b8f0a90b2ddaddaf72e30ba31cce9bd73c9748b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-09T01:20:23.877 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 podman[71119]: 2024-05-09 01:20:23.811972788 +0000 UTC m=+0.307324316 container start 4370cbed7a938ce0126f1b75b8f0a90b2ddaddaf72e30ba31cce9bd73c9748b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:20:23.877 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:23 smithi136 podman[71119]: 2024-05-09 01:20:23.867274336 +0000 UTC m=+0.362625874 container attach 4370cbed7a938ce0126f1b75b8f0a90b2ddaddaf72e30ba31cce9bd73c9748b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-09T01:20:24.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:23.892+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:24.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:23.892+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:24.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:23.892+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:24.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:23.892+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:24.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:23.892+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:24.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:23.892+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:24.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:23 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:23.893+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:24.376 INFO:journalctl@ceph.osd.10.smithi136.stdout:May 09 01:20:24 smithi136 podman[71119]: 2024-05-09 01:20:24.114250861 +0000 UTC m=+0.609602387 container died 4370cbed7a938ce0126f1b75b8f0a90b2ddaddaf72e30ba31cce9bd73c9748b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-09T01:20:24.719 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.10.service' 2024-05-09T01:20:24.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:24.759 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-09T01:20:24.759 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-09T01:20:24.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.11 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 systemd[1]: Stopping Ceph osd.11 for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:24.920+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:24.920+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:24.920+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:24.920+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:24.921+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:24.921+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:24 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:24.921+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:25.064 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.064+0000 7f076ccd2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:25.065 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.064+0000 7f076ccd2700 -1 osd.11 84 *** Got signal Terminated *** 2024-05-09T01:20:25.065 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.064+0000 7f076ccd2700 -1 osd.11 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T01:20:26.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.968+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:26.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.968+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:26.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.968+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:26.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.968+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:26.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.968+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:26.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.968+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:26.224 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:25 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:25.968+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:27.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.017+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:27.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.017+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:27.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.017+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:27.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.017+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:27.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.017+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:27.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.017+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:27.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.017+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:28.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:28.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:28.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:28.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:28.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:28.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:28.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:28.474 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:27 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:27.988+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6820 osd.8 since back 2024-05-09T01:20:06.258208+0000 front 2024-05-09T01:20:06.258238+0000 (oldest deadline 2024-05-09T01:20:27.358210+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:29.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:29 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:29.012+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6820 osd.8 since back 2024-05-09T01:20:06.258208+0000 front 2024-05-09T01:20:06.258238+0000 (oldest deadline 2024-05-09T01:20:27.358210+0000) 2024-05-09T01:20:30.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-05-09T01:18:53.347317+0000 front 2024-05-09T01:18:53.347226+0000 (oldest deadline 2024-05-09T01:19:19.247234+0000) 2024-05-09T01:20:30.473 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-05-09T01:19:04.949545+0000 front 2024-05-09T01:19:04.949664+0000 (oldest deadline 2024-05-09T01:19:31.350370+0000) 2024-05-09T01:20:30.474 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-09T01:19:17.751942+0000 front 2024-05-09T01:19:17.751972+0000 (oldest deadline 2024-05-09T01:19:43.052142+0000) 2024-05-09T01:20:30.474 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-05-09T01:19:23.052683+0000 front 2024-05-09T01:19:23.052746+0000 (oldest deadline 2024-05-09T01:19:48.352600+0000) 2024-05-09T01:20:30.474 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-05-09T01:19:31.754009+0000 front 2024-05-09T01:19:31.753986+0000 (oldest deadline 2024-05-09T01:19:56.453908+0000) 2024-05-09T01:20:30.474 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-09T01:19:42.255462+0000 front 2024-05-09T01:19:42.255495+0000 (oldest deadline 2024-05-09T01:20:06.355511+0000) 2024-05-09T01:20:30.474 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-05-09T01:19:54.556956+0000 front 2024-05-09T01:19:54.556973+0000 (oldest deadline 2024-05-09T01:20:19.256836+0000) 2024-05-09T01:20:30.474 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11[60376]: 2024-05-09T01:20:30.008+0000 7f0765280700 -1 osd.11 84 heartbeat_check: no reply from 172.21.15.151:6820 osd.8 since back 2024-05-09T01:20:06.258208+0000 front 2024-05-09T01:20:06.258238+0000 (oldest deadline 2024-05-09T01:20:27.358210+0000) 2024-05-09T01:20:30.930 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:30 smithi151 podman[72864]: 2024-05-09 01:20:30.677827015 +0000 UTC m=+5.726654815 container died 5e27da2fb93a98217d13ecac89422e434cd3a8d6d6b9f949e63e9307b1cc50d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-05-09T01:20:31.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 podman[72864]: 2024-05-09 01:20:31.023992844 +0000 UTC m=+6.072820619 container cleanup 5e27da2fb93a98217d13ecac89422e434cd3a8d6d6b9f949e63e9307b1cc50d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-09T01:20:31.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 bash[72864]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11 2024-05-09T01:20:31.632 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 podman[72882]: 2024-05-09 01:20:31.300698716 +0000 UTC m=+0.626273521 container remove 5e27da2fb93a98217d13ecac89422e434cd3a8d6d6b9f949e63e9307b1cc50d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2) 2024-05-09T01:20:31.927 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 podman[72973]: 2024-05-09 01:20:31.537382433 +0000 UTC m=+0.018008428 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T01:20:31.927 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 podman[72973]: 2024-05-09 01:20:31.634773735 +0000 UTC m=+0.115399721 container create 81618d120d60e5b46251a9d2865c89d0eb3082ea5f367bec984939a52313c318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:31.927 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 podman[72973]: 2024-05-09 01:20:31.85451408 +0000 UTC m=+0.335140065 container init 81618d120d60e5b46251a9d2865c89d0eb3082ea5f367bec984939a52313c318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-09T01:20:31.927 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 podman[72973]: 2024-05-09 01:20:31.857718737 +0000 UTC m=+0.338344723 container start 81618d120d60e5b46251a9d2865c89d0eb3082ea5f367bec984939a52313c318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:20:31.928 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:31 smithi151 podman[72973]: 2024-05-09 01:20:31.929552494 +0000 UTC m=+0.410178494 container attach 81618d120d60e5b46251a9d2865c89d0eb3082ea5f367bec984939a52313c318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-09T01:20:32.223 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 09 01:20:32 smithi151 podman[72973]: 2024-05-09 01:20:32.157992749 +0000 UTC m=+0.638618738 container died 81618d120d60e5b46251a9d2865c89d0eb3082ea5f367bec984939a52313c318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:32.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@osd.11.service' 2024-05-09T01:20:32.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:32.759 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-09T01:20:32.759 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-09T01:20:32.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.a 2024-05-09T01:20:33.068 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:20:32 smithi037 systemd[1]: Stopping Ceph mds.a for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:33.472 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:20:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a[70173]: 2024-05-09T01:20:33.069+0000 7f102794c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:33.472 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:20:33 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a[70173]: 2024-05-09T01:20:33.069+0000 7f102794c700 -1 mds.a *** got signal Terminated *** 2024-05-09T01:20:36.722 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:20:36 smithi037 podman[119617]: 2024-05-09 01:20:36.42769675 +0000 UTC m=+3.466204774 container died cb18d56c95e14158b726a2441f96ea3c0427712720617221c34d8d155ae9727d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:20:37.185 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:20:36 smithi037 podman[119617]: 2024-05-09 01:20:36.818956327 +0000 UTC m=+3.857464350 container cleanup cb18d56c95e14158b726a2441f96ea3c0427712720617221c34d8d155ae9727d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:20:37.185 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:20:36 smithi037 bash[119617]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a 2024-05-09T01:20:37.185 INFO:journalctl@ceph.mds.a.smithi037.stdout:May 09 01:20:37 smithi037 podman[119631]: 2024-05-09 01:20:37.053651345 +0000 UTC m=+0.622509164 container remove cb18d56c95e14158b726a2441f96ea3c0427712720617221c34d8d155ae9727d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T01:20:37.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.a.service' 2024-05-09T01:20:37.235 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:37.236 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-09T01:20:37.236 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-09T01:20:37.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.d 2024-05-09T01:20:37.471 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:37 smithi037 systemd[1]: Stopping Ceph mds.d for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:37.972 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:37 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d[68865]: 2024-05-09T01:20:37.572+0000 7f001e38b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:37.972 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:37 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d[68865]: 2024-05-09T01:20:37.572+0000 7f001e38b700 -1 mds.d *** got signal Terminated *** 2024-05-09T01:20:41.838 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:41 smithi037 podman[119738]: 2024-05-09 01:20:41.578334842 +0000 UTC m=+4.107981276 container died 5ceb014e1213b670cdee1f2802e005925545d652b3af203ee92efb891c195be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-09T01:20:42.222 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:41 smithi037 podman[119738]: 2024-05-09 01:20:41.997879314 +0000 UTC m=+4.527525780 container cleanup 5ceb014e1213b670cdee1f2802e005925545d652b3af203ee92efb891c195be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-09T01:20:42.222 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:41 smithi037 bash[119738]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d 2024-05-09T01:20:42.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.d.service' 2024-05-09T01:20:42.498 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:42 smithi037 podman[119752]: 2024-05-09 01:20:42.232343051 +0000 UTC m=+0.647550858 container remove 5ceb014e1213b670cdee1f2802e005925545d652b3af203ee92efb891c195be4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-d, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T01:20:42.499 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:42 smithi037 systemd[1]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.d.service: Deactivated successfully. 2024-05-09T01:20:42.499 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:42 smithi037 systemd[1]: Stopped Ceph mds.d for ec4482a6-0d9d-11ef-bc97-c7b262605968. 2024-05-09T01:20:42.499 INFO:journalctl@ceph.mds.d.smithi037.stdout:May 09 01:20:42 smithi037 systemd[1]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.d.service: Consumed 1.216s CPU time. 2024-05-09T01:20:42.511 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:42.511 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-09T01:20:42.511 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-09T01:20:42.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.g 2024-05-09T01:20:42.833 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:20:42 smithi037 systemd[1]: Stopping Ceph mds.g for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:43.221 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:20:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g[69704]: 2024-05-09T01:20:42.834+0000 7fd15a685700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:43.222 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:20:42 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g[69704]: 2024-05-09T01:20:42.834+0000 7fd15a685700 -1 mds.g *** got signal Terminated *** 2024-05-09T01:20:44.722 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:20:44 smithi037 podman[119863]: 2024-05-09 01:20:44.428640744 +0000 UTC m=+1.688588609 container died 0e97b0a8939505ee62e8d27de827b35b144542f0a2122af076e158524e09a8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-09T01:20:45.056 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:20:44 smithi037 podman[119863]: 2024-05-09 01:20:44.726630906 +0000 UTC m=+1.986578780 container cleanup 0e97b0a8939505ee62e8d27de827b35b144542f0a2122af076e158524e09a8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-09T01:20:45.056 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:20:44 smithi037 bash[119863]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g 2024-05-09T01:20:45.057 INFO:journalctl@ceph.mds.g.smithi037.stdout:May 09 01:20:44 smithi037 podman[119888]: 2024-05-09 01:20:44.953153103 +0000 UTC m=+0.528359336 container remove 0e97b0a8939505ee62e8d27de827b35b144542f0a2122af076e158524e09a8f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:20:45.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.g.service' 2024-05-09T01:20:45.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:45.108 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-09T01:20:45.108 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-09T01:20:45.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.j 2024-05-09T01:20:45.446 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 01:20:45 smithi037 systemd[1]: Stopping Ceph mds.j for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:45.722 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 01:20:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j[68436]: 2024-05-09T01:20:45.447+0000 7f6889dd4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:45.722 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 01:20:45 smithi037 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j[68436]: 2024-05-09T01:20:45.447+0000 7f6889dd4700 -1 mds.j *** got signal Terminated *** 2024-05-09T01:20:49.722 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 01:20:49 smithi037 podman[119995]: 2024-05-09 01:20:49.462800142 +0000 UTC m=+4.125110418 container died 68d994b4b6f84dc8dd3b6523550a9aaac1a9750d4ce8ff2952362fd91b3eaeb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-09T01:20:50.062 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 01:20:49 smithi037 podman[119995]: 2024-05-09 01:20:49.813713887 +0000 UTC m=+4.476024173 container cleanup 68d994b4b6f84dc8dd3b6523550a9aaac1a9750d4ce8ff2952362fd91b3eaeb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-09T01:20:50.062 INFO:journalctl@ceph.mds.j.smithi037.stdout:May 09 01:20:49 smithi037 bash[119995]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-j 2024-05-09T01:20:50.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.j.service' 2024-05-09T01:20:50.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:50.247 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-09T01:20:50.247 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-09T01:20:50.248 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.b 2024-05-09T01:20:50.552 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:20:50 smithi136 systemd[1]: Stopping Ceph mds.b for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:50.876 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:20:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:20:50.553+0000 7fe62cc9c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:50.876 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:20:50 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b[64582]: 2024-05-09T01:20:50.553+0000 7fe62cc9c700 -1 mds.b *** got signal Terminated *** 2024-05-09T01:20:52.702 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:20:52 smithi136 podman[71225]: 2024-05-09 01:20:52.441213421 +0000 UTC m=+1.990807782 container died cf0016c1dfa57755e6a219a8cdc818a168df0d8e661a865746b2cbfbcead7f47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-09T01:20:53.044 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:20:52 smithi136 podman[71225]: 2024-05-09 01:20:52.795184627 +0000 UTC m=+2.344778986 container cleanup cf0016c1dfa57755e6a219a8cdc818a168df0d8e661a865746b2cbfbcead7f47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-09T01:20:53.044 INFO:journalctl@ceph.mds.b.smithi136.stdout:May 09 01:20:52 smithi136 bash[71225]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-b 2024-05-09T01:20:53.174 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.b.service' 2024-05-09T01:20:53.208 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:53.209 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-09T01:20:53.209 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-09T01:20:53.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.e 2024-05-09T01:20:53.375 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:20:53 smithi136 systemd[1]: Stopping Ceph mds.e for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:53.876 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:20:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e[63954]: 2024-05-09T01:20:53.532+0000 7f1fadb27700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:53.876 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:20:53 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e[63954]: 2024-05-09T01:20:53.532+0000 7f1fadb27700 -1 mds.e *** got signal Terminated *** 2024-05-09T01:20:56.715 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:20:56 smithi136 podman[71358]: 2024-05-09 01:20:56.434160055 +0000 UTC m=+3.012033665 container died 7db6c509525b6ab3bc1a6d6bdffcb5f14161a42bc63b7326240c9f3ce4cb7fbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T01:20:57.057 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:20:56 smithi136 podman[71358]: 2024-05-09 01:20:56.824772812 +0000 UTC m=+3.402646426 container cleanup 7db6c509525b6ab3bc1a6d6bdffcb5f14161a42bc63b7326240c9f3ce4cb7fbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-05-09T01:20:57.057 INFO:journalctl@ceph.mds.e.smithi136.stdout:May 09 01:20:56 smithi136 bash[71358]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-e 2024-05-09T01:20:57.210 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.e.service' 2024-05-09T01:20:57.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:20:57.243 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-09T01:20:57.243 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-09T01:20:57.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.h 2024-05-09T01:20:57.625 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:20:57 smithi136 systemd[1]: Stopping Ceph mds.h for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:20:57.626 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:20:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h[64278]: 2024-05-09T01:20:57.561+0000 7fc21583c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:20:57.626 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:20:57 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h[64278]: 2024-05-09T01:20:57.561+0000 7fc21583c700 -1 mds.h *** got signal Terminated *** 2024-05-09T01:21:00.876 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:21:00 smithi136 podman[71478]: 2024-05-09 01:21:00.431630796 +0000 UTC m=+2.964984521 container died 641f714e6c2a28499ca950f4c388ed481006649b0b934551398051cde1573a8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-09T01:21:01.244 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:21:01 smithi136 podman[71478]: 2024-05-09 01:21:01.011722279 +0000 UTC m=+3.545076000 container cleanup 641f714e6c2a28499ca950f4c388ed481006649b0b934551398051cde1573a8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-05-09T01:21:01.244 INFO:journalctl@ceph.mds.h.smithi136.stdout:May 09 01:21:01 smithi136 bash[71478]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-h 2024-05-09T01:21:01.376 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.h.service' 2024-05-09T01:21:01.407 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:21:01.407 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-09T01:21:01.407 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-09T01:21:01.407 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.k 2024-05-09T01:21:01.624 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:21:01 smithi136 systemd[1]: Stopping Ceph mds.k for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:21:01.875 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:21:01 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k[63628]: 2024-05-09T01:21:01.731+0000 7f6ac82db700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:21:01.876 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:21:01 smithi136 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k[63628]: 2024-05-09T01:21:01.731+0000 7f6ac82db700 -1 mds.k *** got signal Terminated *** 2024-05-09T01:21:04.780 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:21:04 smithi136 podman[71598]: 2024-05-09 01:21:04.425828683 +0000 UTC m=+2.790266658 container died 2617c853fb144b86fb3115964ddeb8ae74f22e615ac429eb922109dad5f2d55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T01:21:05.125 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:21:04 smithi136 podman[71598]: 2024-05-09 01:21:04.857132123 +0000 UTC m=+3.221570097 container cleanup 2617c853fb144b86fb3115964ddeb8ae74f22e615ac429eb922109dad5f2d55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-09T01:21:05.126 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:21:04 smithi136 bash[71598]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k 2024-05-09T01:21:05.126 INFO:journalctl@ceph.mds.k.smithi136.stdout:May 09 01:21:05 smithi136 podman[71612]: 2024-05-09 01:21:05.032998706 +0000 UTC m=+0.600685759 container remove 2617c853fb144b86fb3115964ddeb8ae74f22e615ac429eb922109dad5f2d55d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:21:05.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.k.service' 2024-05-09T01:21:05.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:21:05.317 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-09T01:21:05.317 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-09T01:21:05.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.c 2024-05-09T01:21:05.616 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:21:05 smithi151 systemd[1]: Stopping Ceph mds.c for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:21:05.972 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:21:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c[65821]: 2024-05-09T01:21:05.617+0000 7f188d09b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:21:05.972 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:21:05 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c[65821]: 2024-05-09T01:21:05.617+0000 7f188d09b700 -1 mds.c *** got signal Terminated *** 2024-05-09T01:21:08.691 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:21:08 smithi151 podman[73079]: 2024-05-09 01:21:08.437288764 +0000 UTC m=+2.925170291 container died 119ac92182b3fa20c821d0af178832d841bd4975a7214ed0637889cf19aa5f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5) 2024-05-09T01:21:08.972 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:21:08 smithi151 podman[73079]: 2024-05-09 01:21:08.792570609 +0000 UTC m=+3.280452124 container cleanup 119ac92182b3fa20c821d0af178832d841bd4975a7214ed0637889cf19aa5f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:21:08.973 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 09 01:21:08 smithi151 bash[73079]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-c 2024-05-09T01:21:09.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.c.service' 2024-05-09T01:21:09.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:21:09.242 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-09T01:21:09.242 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-09T01:21:09.243 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.f 2024-05-09T01:21:09.722 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:21:09 smithi151 systemd[1]: Stopping Ceph mds.f for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:21:09.723 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:21:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f[65503]: 2024-05-09T01:21:09.554+0000 7ff7e1d90700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:21:09.723 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:21:09 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f[65503]: 2024-05-09T01:21:09.554+0000 7ff7e1d90700 -1 mds.f *** got signal Terminated *** 2024-05-09T01:21:12.703 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:21:12 smithi151 podman[73212]: 2024-05-09 01:21:12.442544936 +0000 UTC m=+2.985247171 container died 2544b0495f1a84b259aa9a6bcd340f35c7a99a643cf407440552f951315d8c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T01:21:12.972 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:21:12 smithi151 podman[73212]: 2024-05-09 01:21:12.805164507 +0000 UTC m=+3.347866739 container cleanup 2544b0495f1a84b259aa9a6bcd340f35c7a99a643cf407440552f951315d8c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T01:21:12.973 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 09 01:21:12 smithi151 bash[73212]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-f 2024-05-09T01:21:13.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.f.service' 2024-05-09T01:21:13.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:21:13.259 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-09T01:21:13.259 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-09T01:21:13.259 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.i 2024-05-09T01:21:13.723 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:21:13 smithi151 systemd[1]: Stopping Ceph mds.i for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:21:14.223 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:21:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i[66122]: 2024-05-09T01:21:13.768+0000 7f44af1e1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:21:14.223 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:21:13 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i[66122]: 2024-05-09T01:21:13.768+0000 7f44af1e1700 -1 mds.i *** got signal Terminated *** 2024-05-09T01:21:16.722 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:21:16 smithi151 podman[73333]: 2024-05-09 01:21:16.432145797 +0000 UTC m=+2.949853066 container died 103667fe17a0f293c5e0d5dd3df1de9b3dc15266bdb0da2455801c62a112a71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-09T01:21:17.051 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:21:16 smithi151 podman[73333]: 2024-05-09 01:21:16.802335842 +0000 UTC m=+3.320043153 container cleanup 103667fe17a0f293c5e0d5dd3df1de9b3dc15266bdb0da2455801c62a112a71e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-09T01:21:17.051 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 09 01:21:16 smithi151 bash[73333]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-i 2024-05-09T01:21:17.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.i.service' 2024-05-09T01:21:17.204 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:21:17.205 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-09T01:21:17.205 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-09T01:21:17.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.l 2024-05-09T01:21:17.472 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:21:17 smithi151 systemd[1]: Stopping Ceph mds.l for ec4482a6-0d9d-11ef-bc97-c7b262605968... 2024-05-09T01:21:17.972 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:21:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l[65195]: 2024-05-09T01:21:17.522+0000 7f025dc58700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T01:21:17.972 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:21:17 smithi151 ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l[65195]: 2024-05-09T01:21:17.522+0000 7f025dc58700 -1 mds.l *** got signal Terminated *** 2024-05-09T01:21:20.713 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:21:20 smithi151 podman[73454]: 2024-05-09 01:21:20.44625879 +0000 UTC m=+3.025803716 container died 3b4450749e8ae4b461d3ff22f932886067f0c428fbc4f66ba23852016ce37f19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-09T01:21:20.972 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:21:20 smithi151 podman[73454]: 2024-05-09 01:21:20.790121526 +0000 UTC m=+3.369666451 container cleanup 3b4450749e8ae4b461d3ff22f932886067f0c428fbc4f66ba23852016ce37f19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=) 2024-05-09T01:21:20.973 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 09 01:21:20 smithi151 bash[73454]: ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968-mds-l 2024-05-09T01:21:21.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ec4482a6-0d9d-11ef-bc97-c7b262605968@mds.l.service' 2024-05-09T01:21:21.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T01:21:21.257 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-09T01:21:21.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T01:21:21.460 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T01:21:24.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T01:21:24.287 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T01:21:26.735 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T01:21:26.924 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T01:21:29.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T01:21:29.322 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T01:21:29.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T01:21:29.384 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-09T01:21:29.386 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi037/crash 2024-05-09T01:21:29.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash -- . 2024-05-09T01:21:29.468 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T01:21:29.468 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-05-09T01:21:29.470 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi136/crash 2024-05-09T01:21:29.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash -- . 2024-05-09T01:21:29.582 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T01:21:29.583 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2024-05-09T01:21:29.585 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi151/crash 2024-05-09T01:21:29.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash -- . 2024-05-09T01:21:29.616 INFO:teuthology.orchestra.run.smithi151.stderr:tar: /var/lib/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T01:21:29.616 INFO:teuthology.orchestra.run.smithi151.stderr:tar: Error is not recoverable: exiting now 2024-05-09T01:21:29.617 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-09T01:21:29.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-09T01:21:29.658 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-09T01:05:15.668117+0000 mds.b (mds.0) 19 : cluster [WRN] Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:21:29.658 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-05-09T01:21:29.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-09T01:21:29.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-09T01:21:29.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[WRN\]' /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-09T01:21:29.894 INFO:teuthology.orchestra.run.smithi037.stdout:2024-05-09T01:05:15.668117+0000 mds.b (mds.0) 19 : cluster [WRN] Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details 2024-05-09T01:21:29.895 INFO:tasks.cephadm:Compressing logs... 2024-05-09T01:21:29.895 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T01:21:29.937 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T01:21:29.942 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T01:21:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T01:21:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:: No such file or directory 2024-05-09T01:21:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log 2024-05-09T01:21:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T01:21:29.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-09T01:21:29.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log: /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-09T01:21:29.965 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-09T01:21:29.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.g.log: /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-09T01:21:29.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-09T01:21:29.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-09T01:21:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.x.log: 90.4% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.a.log: 87.3% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.6.log: 94.7% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.5% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T01:21:29.980 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.a.log: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T01:21:29.984 INFO:teuthology.orchestra.run.smithi136.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-05-09T01:21:29.984 INFO:teuthology.orchestra.run.smithi136.stderr: -- /var/log/ceph/cephadm.log 2024-05-09T01:21:29.984 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log 2024-05-09T01:21:29.984 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T01:21:29.984 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.7.log: --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.b.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr: 90.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.10.log: 87.3% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr: 93.2% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-09T01:21:29.985 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-09T01:21:29.986 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T01:21:29.986 INFO:teuthology.orchestra.run.smithi136.stderr: 83.5% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T01:21:29.986 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-09T01:21:29.986 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2024-05-09T01:21:29.986 INFO:teuthology.orchestra.run.smithi151.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log: -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.z.log: 87.3% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr: 90.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T01:21:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T01:21:29.988 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-09T01:21:29.988 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.4% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T01:21:29.988 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-09T01:21:29.988 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.11.log: 93.3% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-09T01:21:29.988 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T01:21:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-09T01:21:29.991 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-09T01:21:29.991 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-09T01:21:29.992 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T01:21:29.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-09T01:21:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.d.log: 91.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T01:21:30.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.9.log: 94.7% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-09T01:21:30.019 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T01:21:30.119 INFO:teuthology.orchestra.run.smithi037.stderr: 93.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-09T01:21:30.180 INFO:teuthology.orchestra.run.smithi037.stderr: 93.9% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-09T01:21:30.208 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.k.log: 94.7% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-09T01:21:30.301 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-09T01:21:30.310 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-09T01:21:30.316 INFO:teuthology.orchestra.run.smithi037.stderr: 90.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-09T01:21:30.540 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-09T01:21:30.654 INFO:teuthology.orchestra.run.smithi136.stderr: 91.5% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-09T01:21:30.808 INFO:teuthology.orchestra.run.smithi136.stderr: 93.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-09T01:21:31.563 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-09T01:21:31.776 INFO:teuthology.orchestra.run.smithi151.stderr: 94.5% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-09T01:21:31.803 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-09T01:21:32.585 INFO:teuthology.orchestra.run.smithi136.stderr: 93.6% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-09T01:21:32.625 INFO:teuthology.orchestra.run.smithi136.stderr: 93.9% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-09T01:21:40.499 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-09T01:21:43.025 INFO:teuthology.orchestra.run.smithi151.stderr: 94.2% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-09T01:21:43.393 INFO:teuthology.orchestra.run.smithi136.stderr: 94.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-09T01:21:47.506 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-09T01:21:48.181 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-09T01:21:50.128 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-09T01:21:50.138 INFO:teuthology.orchestra.run.smithi151.stderr: 94.4% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-09T01:21:50.139 INFO:teuthology.orchestra.run.smithi136.stderr: 94.0% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-09T01:21:50.990 INFO:teuthology.orchestra.run.smithi151.stderr: 93.9% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-09T01:21:50.991 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-05-09T01:21:50.991 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m21.035s 2024-05-09T01:21:50.991 INFO:teuthology.orchestra.run.smithi151.stderr:user 1m13.483s 2024-05-09T01:21:50.992 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m2.740s 2024-05-09T01:21:56.682 INFO:teuthology.orchestra.run.smithi037.stderr: 94.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-09T01:21:57.339 INFO:teuthology.orchestra.run.smithi037.stderr: 94.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-09T01:21:57.341 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-09T01:21:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m27.390s 2024-05-09T01:21:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:user 1m23.803s 2024-05-09T01:21:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m2.851s 2024-05-09T01:21:58.014 INFO:teuthology.orchestra.run.smithi136.stderr: 94.1% -- replaced with /var/log/ceph/ec4482a6-0d9d-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-09T01:21:58.016 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-05-09T01:21:58.016 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m28.061s 2024-05-09T01:21:58.016 INFO:teuthology.orchestra.run.smithi136.stderr:user 1m23.414s 2024-05-09T01:21:58.016 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m3.035s 2024-05-09T01:21:58.017 INFO:tasks.cephadm:Archiving logs... 2024-05-09T01:21:58.017 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi037/log 2024-05-09T01:21:58.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T01:22:09.455 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi136/log 2024-05-09T01:22:09.456 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T01:22:21.163 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi151/log 2024-05-09T01:22:21.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T01:22:31.765 INFO:tasks.cephadm:Removing cluster... 2024-05-09T01:22:31.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 --force 2024-05-09T01:22:31.968 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T01:22:32.344 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 --force 2024-05-09T01:22:32.535 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T01:22:32.965 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ec4482a6-0d9d-11ef-bc97-c7b262605968 --force 2024-05-09T01:22:33.157 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: ec4482a6-0d9d-11ef-bc97-c7b262605968 2024-05-09T01:22:33.517 INFO:tasks.cephadm:Removing cephadm ... 2024-05-09T01:22:33.517 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T01:22:33.535 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T01:22:33.551 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T01:22:33.566 INFO:tasks.cephadm:Teardown complete 2024-05-09T01:22:33.566 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T01:22:33.579 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T01:22:33.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T01:22:33.582 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T01:22:33.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T01:22:33.703 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T01:22:33.713 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T01:22:33.713 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T01:22:33.716 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T01:22:33.718 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T01:22:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-05-09T01:22:33.729 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-05-09T01:22:33.731 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-05-09T01:22:33.733 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T01:22:33.733 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-05-09T01:22:33.733 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +698us[ +716us] +/- 65ms 2024-05-09T01:22:33.733 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -661us[ -661us] +/- 57ms 2024-05-09T01:22:33.733 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +250us[ +267us] +/- 77ms 2024-05-09T01:22:33.733 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:22:33.735 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T01:22:33.735 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-05-09T01:22:33.735 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +666us[ +696us] +/- 65ms 2024-05-09T01:22:33.735 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -710us[ -680us] +/- 57ms 2024-05-09T01:22:33.735 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +236us[ +266us] +/- 78ms 2024-05-09T01:22:33.735 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:22:33.736 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T01:22:33.736 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-05-09T01:22:33.736 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +676us[ +686us] +/- 65ms 2024-05-09T01:22:33.736 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -681us[ -681us] +/- 57ms 2024-05-09T01:22:33.736 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +235us[ +244us] +/- 78ms 2024-05-09T01:22:33.736 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T01:22:33.737 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T01:22:33.810 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T01:22:33.811 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T01:22:33.920 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T01:22:34.009 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T01:22:34.075 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T01:22:34.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T01:22:34.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:22:34.169 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T01:22:34.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:22:34.196 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T01:22:34.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:22:34.223 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T01:22:34.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T01:22:34.394 INFO:teuthology.task.internal:Duration was 2402.363437 seconds 2024-05-09T01:22:34.394 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T01:22:34.475 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T01:22:34.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T01:22:34.478 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T01:22:34.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T01:22:34.515 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T01:22:34.516 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T01:22:34.517 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T01:22:35.010 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T01:22:35.010 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-05-09T01:22:35.011 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T01:22:35.073 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-05-09T01:22:35.073 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T01:22:35.111 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-05-09T01:22:35.111 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T01:22:35.133 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T01:22:35.133 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T01:22:35.136 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T01:22:35.153 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T01:22:35.198 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T01:22:35.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T01:22:35.204 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T01:22:35.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T01:22:36.449 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T01:22:36.464 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T01:22:36.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T01:22:36.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T01:22:36.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T01:22:36.543 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T01:22:36.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:22:36.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:22:36.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:22:36.579 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-05-09T01:22:36.580 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-05-09T01:22:36.609 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-05-09T01:22:36.846 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:22:36.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:22:36.862 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:22:36.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:22:36.901 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T01:22:36.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T01:22:36.918 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T01:22:36.930 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T01:22:36.932 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi037 2024-05-09T01:22:36.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T01:22:37.000 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi136 2024-05-09T01:22:37.001 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T01:22:37.039 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915/remote/smithi151 2024-05-09T01:22:37.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T01:22:37.080 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T01:22:37.080 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T01:22:37.083 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T01:22:37.085 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T01:22:37.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T01:22:37.144 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T01:22:37.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T01:22:37.247 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T01:22:37.248 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T01:22:37.250 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T01:22:37.253 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T01:22:37.264 INFO:teuthology.orchestra.run.smithi037.stdout: 265295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 01:22 /home/ubuntu/cephtest 2024-05-09T01:22:37.266 INFO:teuthology.orchestra.run.smithi136.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 01:22 /home/ubuntu/cephtest 2024-05-09T01:22:37.270 INFO:teuthology.orchestra.run.smithi151.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 01:22 /home/ubuntu/cephtest 2024-05-09T01:22:37.271 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T01:22:37.333 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T01:22:37.680 INFO:teuthology.nuke:Checking targets against current locks 2024-05-09T01:22:37.707 DEBUG:teuthology.nuke:shortname: smithi037 2024-05-09T01:22:37.708 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T01:22:37.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 00:33:28.388700', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHMM0oyeg/rts1LYE3O86d++khfdns45zmSFMB8s0FTBvexX5r8fsqp1twQmthj9KSJtyF6lRD7xnxT5yCC4ag='} 2024-05-09T01:22:37.735 DEBUG:teuthology.nuke:shortname: smithi136 2024-05-09T01:22:37.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T01:22:37.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 00:33:28.391871', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHikpoGZS4zdZdP8mpfo66YVeEAmxx8tcj6dmin9/USFUIQhwAKbTh/IZ3XN39VqzLUL9mhXtg5gshMmKLgeFHw='} 2024-05-09T01:22:37.764 DEBUG:teuthology.nuke:shortname: smithi151 2024-05-09T01:22:37.764 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T01:22:37.793 INFO:teuthology.orchestra.console.smithi037:Power off 2024-05-09T01:22:37.793 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-09T01:22:37.807 INFO:teuthology.orchestra.console.smithi136:Power off 2024-05-09T01:22:37.807 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-09T01:22:37.816 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7698915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 00:33:28.390395', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNxEOyrD/fnG/6UdipwLu/+15N8lCOa4kfef30wFLdbS7D03dfK+rQXaRnqRKCU3MqvXmictC89CWrMpKsmrscM='} 2024-05-09T01:22:37.826 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2024-05-09T01:22:37.826 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:37.835 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-05-09T01:22:37.835 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:37.852 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-05-09T01:22:37.860 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-05-09T01:22:37.875 INFO:teuthology.orchestra.console.smithi151:Power off 2024-05-09T01:22:37.875 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-09T01:22:37.897 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2024-05-09T01:22:37.897 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:37.921 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-05-09T01:22:41.853 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:41.861 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:41.922 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:41.963 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-05-09T01:22:41.970 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-05-09T01:22:42.032 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-05-09T01:22:45.967 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:45.975 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:46.033 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:46.078 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-05-09T01:22:46.085 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-05-09T01:22:46.144 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-05-09T01:22:46.186 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-05-09T01:22:46.245 INFO:teuthology.orchestra.console.smithi151:Power off completed 2024-05-09T01:22:50.082 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-09T01:22:50.193 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-05-09T01:22:50.294 INFO:teuthology.orchestra.console.smithi037:Power off completed 2024-05-09T01:22:50.399 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/postgres}} duration: 2402.363436937332 failure_reason: '"2024-05-09T01:05:15.668117+0000 mds.b (mds.0) 19 : cluster [WRN] Scrub error on inode 0x1000000000f (/volumes/qa/sv_1/fa53dd61-a27c-4c7c-ad54-d0cea4b59ea1/postgres/data/pg_subtrans) see mds.b log and `damage ls` output for details" in cluster log' flavor: default owner: scheduled_pdonnell@teuthology success: false 2024-05-09T01:22:50.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T01:22:50.494 INFO:teuthology.run:FAIL